2024-04-12T13:10:50.093 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-12T13:10:50.093 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --name vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --verbose --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889 -- /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/orig.config.yaml 2024-04-12T13:10:50.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T13:10:50.248 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7653889' kernel: flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/wip-64502-quincy-2 ' name: vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-64502-quincy-2 sha1: 35087f9f8bbf4292364e0bbb9a4062d5cd47de0a owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2201 sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: wip-64502-quincy-2 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: 35087f9f8bbf4292364e0bbb9a4062d5cd47de0a targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI60fY9WQqC4h9Ckumwe0dk0HzcNbwcqEcYevTJgBPXcoFYpGl5Rne1nGabJmS5yUq6g52FCCGo80PdthepUrgs= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPHzzWnrc2phk4GtxkpMoqCOqfD98CUXUbY9btTVj4i2a6kLFb7GGX8O/l0YwyVkwQXiMlhyWqD46PQL0wtvYI= tasks: - install: branch: wip-64502-quincy-2 exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/vshankar/src/github.com_vshankar_ceph_wip-64502-quincy-2/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-12_13:03:29 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-12T13:10:50.248 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa; will attempt to use it 2024-04-12T13:10:50.356 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks 2024-04-12T13:10:50.356 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-12T13:10:50.358 INFO:teuthology.task.internal:Checking packages... 2024-04-12T13:10:50.387 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a971fd5f5719038c70b817bafacd6d5400b1d888' 2024-04-12T13:10:50.387 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:10:50.387 INFO:teuthology.packaging:ref: None 2024-04-12T13:10:50.387 INFO:teuthology.packaging:tag: None 2024-04-12T13:10:50.387 INFO:teuthology.packaging:branch: main 2024-04-12T13:10:50.387 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:10:50.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-12T13:10:50.612 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2870.g62ed3a09 2024-04-12T13:10:50.614 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-12T13:10:50.626 INFO:teuthology.task.internal:no buildpackages task found 2024-04-12T13:10:50.626 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-12T13:10:50.640 INFO:teuthology.task.internal:Saving configuration 2024-04-12T13:10:50.659 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-12T13:10:50.670 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T13:10:50.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 13:05:46.666762', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI60fY9WQqC4h9Ckumwe0dk0HzcNbwcqEcYevTJgBPXcoFYpGl5Rne1nGabJmS5yUq6g52FCCGo80PdthepUrgs='} 2024-04-12T13:10:50.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 13:05:46.669229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPHzzWnrc2phk4GtxkpMoqCOqfD98CUXUbY9btTVj4i2a6kLFb7GGX8O/l0YwyVkwQXiMlhyWqD46PQL0wtvYI='} 2024-04-12T13:10:50.719 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-12T13:10:50.728 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-12T13:10:50.728 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-12T13:10:50.728 INFO:teuthology.run_tasks:Running task console_log... 2024-04-12T13:10:50.846 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc07fec3160>, signals=[15]) 2024-04-12T13:10:50.847 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-12T13:10:50.860 INFO:teuthology.task.internal:Opening connections... 2024-04-12T13:10:50.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:10:50.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:10:50.977 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-04-12T13:10:50.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:10:51.068 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-12T13:10:51.077 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-04-12T13:10:51.095 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-04-12T13:10:51.095 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-04-12T13:10:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-04-12T13:10:51.153 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T13:10:51.153 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-04-12T13:10:51.153 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T13:10:51.153 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T13:10:51.153 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T13:10:51.154 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-04-12T13:10:51.173 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-04-12T13:10:51.191 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-04-12T13:10:51.191 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-12T13:10:51.249 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-04-12T13:10:51.249 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-04-12T13:10:51.249 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-04-12T13:10:51.249 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-04-12T13:10:51.249 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T13:10:51.250 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T13:10:51.250 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-12T13:10:51.273 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-12T13:10:51.283 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-12T13:10:51.295 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-12T13:10:51.295 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-04-12T13:10:51.297 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-04-12T13:10:51.313 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-12T13:10:51.324 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-12T13:10:51.325 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-04-12T13:10:51.355 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-04-12T13:10:51.461 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-12T13:10:51.510 INFO:teuthology.run_tasks:Running task kernel... 2024-04-12T13:10:51.530 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-12T13:10:51.530 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, timeout 300 2024-04-12T13:10:51.530 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T13:10:51.531 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T13:10:51.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:10:51.547 DEBUG:teuthology.task.kernel:sha1 for host.b is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.547 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-12T13:10:51.547 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-12T13:10:51.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:10:51.548 DEBUG:teuthology.task.kernel:sha1 for host.a is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.548 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-12T13:10:51.549 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-04-12T13:10:51.604 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-361.el9.x86_64 2024-04-12T13:10:51.605 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.605 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-12T13:10:51.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.609 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-361.el9.x86_64 2024-04-12T13:10:51.609 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.609 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-12T13:10:51.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:10:51.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum upgrade -y linux-firmware 2024-04-12T13:10:51.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2024-04-12T13:10:53.979 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-04-12T13:10:53.998 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-04-12T13:10:55.638 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS-9 - BaseOS 8.4 MB/s | 2.5 MB 00:00 2024-04-12T13:10:55.782 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.5 MB 00:00 2024-04-12T13:10:56.924 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-12T13:10:57.919 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-04-12T13:10:59.896 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-12T13:11:04.255 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-12T13:11:05.856 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-04-12T13:11:08.715 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 21 MB 00:02 2024-04-12T13:11:14.058 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.415 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:11:16.416 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:11:16.417 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.418 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.419 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.420 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:11:16.421 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.422 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.423 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:11:16.957 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:11:16.968 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:11:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-04-12T13:11:16.968 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 1 Package 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 376 M 2024-04-12T13:11:16.969 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:11:18.796 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 931 kB/s | 19 MB 00:20 2024-04-12T13:11:30.363 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 817 kB/s | 6.2 MB 00:07 2024-04-12T13:11:31.839 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-12T13:11:33.066 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-12T13:11:36.357 INFO:teuthology.orchestra.run.smithi060.stdout:linux-firmware-20240219-143.el9.noarch.rpm 20 MB/s | 376 MB 00:19 2024-04-12T13:11:36.357 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:11:36.357 INFO:teuthology.orchestra.run.smithi060.stdout:Total 19 MB/s | 376 MB 00:19 2024-04-12T13:11:38.257 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-12T13:11:39.539 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:11:39.653 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:11:39.653 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.507 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.508 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:11:40.509 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.510 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.511 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.512 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:11:40.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:11:41.092 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:11:41.106 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:11:41.107 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:11:41.107 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 1 Package 2024-04-12T13:11:41.107 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:11:41.107 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 376 M 2024-04-12T13:11:41.107 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:11:43.166 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:11:43.167 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:11:50.902 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:11:51.247 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T13:11:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:11:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:11:52.324 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T13:11:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:11:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:11:52.751 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-04-12T13:11:52.751 INFO:teuthology.orchestra.run.smithi060.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-12T13:11:52.752 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:11:52.752 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:11:53.078 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on host.a... 2024-04-12T13:11:53.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:11:53.314 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-12T13:11:53.314 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-12T13:11:53.317 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2024-04-12T13:12:06.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12 13:12:06 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-12T13:12:06.330 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2024-04-12 13:12:06-- 2024-04-12T13:12:06.331 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 13s 2024-04-12T13:12:06.331 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 341M in 13s (27.0 MB/s) 2024-04-12T13:12:06.333 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on host.a... 2024-04-12T13:12:06.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-12T13:12:08.485 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying... ######################################## 2024-04-12T13:12:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing... ######################################## 2024-04-12T13:12:08.632 INFO:teuthology.orchestra.run.smithi060.stdout:Updating / installing... 2024-04-12T13:12:16.934 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-12T13:12:33.957 INFO:teuthology.orchestra.run.smithi060.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T13:12:57.855 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-12T13:12:57.855 DEBUG:teuthology.orchestra.run.smithi060:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-12T13:12:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-12T13:12:57.932 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-12T13:12:57.933 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-12T13:12:57.934 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-12T13:12:57.935 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-12T13:12:57.936 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-12T13:12:57.937 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-12T13:12:57.938 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-12T13:12:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-12T13:12:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-12T13:12:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-12T13:12:57.942 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-12T13:12:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-12T13:12:57.944 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-12T13:12:57.945 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-12T13:12:57.946 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-12T13:12:57.947 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-12T13:12:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-12T13:12:57.949 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-12T13:12:57.950 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-12T13:12:57.951 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-12T13:12:57.952 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-12T13:12:57.953 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-12T13:12:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-12T13:12:57.955 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-12T13:12:57.956 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-12T13:12:57.957 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-12T13:12:57.958 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-12T13:12:57.959 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-12T13:12:57.960 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-12T13:12:57.961 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-12T13:12:57.962 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-12T13:12:57.963 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-12T13:12:57.964 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-12T13:12:57.965 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-12T13:12:57.966 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-12T13:12:57.967 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-12T13:12:57.968 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-12T13:12:57.969 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-12T13:12:57.970 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-12T13:12:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-12T13:12:57.972 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-12T13:12:57.973 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-12T13:12:57.974 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-12T13:12:57.975 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-12T13:12:57.976 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-12T13:12:57.977 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-12T13:12:57.978 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-12T13:12:57.979 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-12T13:12:57.980 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-12T13:12:57.981 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-12T13:12:57.982 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-12T13:12:57.983 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-12T13:12:57.984 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-12T13:12:57.985 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-12T13:12:57.986 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-12T13:12:57.987 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-12T13:12:57.988 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-12T13:12:57.989 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-12T13:12:57.990 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-12T13:12:57.991 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-12T13:12:57.992 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-12T13:12:57.993 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-12T13:12:57.994 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-12T13:12:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-12T13:12:57.996 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-12T13:12:57.997 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-12T13:12:57.998 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-12T13:12:57.999 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-12T13:12:58.000 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-12T13:12:58.001 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-12T13:12:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-12T13:12:58.003 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-12T13:12:58.004 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-12T13:12:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-12T13:12:58.006 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-12T13:12:58.007 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-12T13:12:58.008 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-12T13:12:58.009 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-12T13:12:58.010 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-12T13:12:58.011 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-12T13:12:58.012 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-12T13:12:58.013 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-12T13:12:58.014 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-12T13:12:58.015 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-12T13:12:58.016 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-12T13:12:58.017 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-12T13:12:58.018 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-12T13:12:58.019 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-12T13:12:58.020 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-12T13:12:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-12T13:12:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-12T13:12:58.023 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-12T13:12:58.024 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-12T13:12:58.025 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-12T13:12:58.026 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-12T13:12:58.027 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-12T13:12:58.028 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-12T13:12:58.029 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-12T13:12:58.030 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-12T13:12:58.031 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-12T13:12:58.032 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-12T13:12:58.033 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-12T13:12:58.034 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-12T13:12:58.035 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-12T13:12:58.036 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-12T13:12:58.037 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-12T13:12:58.038 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-12T13:12:58.039 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-12T13:12:58.040 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-12T13:12:58.041 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-12T13:12:58.042 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-12T13:12:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-12T13:12:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-12T13:12:58.045 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-12T13:12:58.046 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-12T13:12:58.047 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-12T13:12:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-12T13:12:58.049 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-12T13:12:58.050 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-12T13:12:58.051 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-12T13:12:58.052 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-12T13:12:58.053 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-12T13:12:58.054 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-12T13:12:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-12T13:12:58.056 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-12T13:12:58.057 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-12T13:12:58.058 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-12T13:12:58.059 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-12T13:12:58.060 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-12T13:12:58.061 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-12T13:12:58.062 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-12T13:12:58.063 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-12T13:12:58.064 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-12T13:12:58.065 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-12T13:12:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-12T13:12:58.067 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-12T13:12:58.068 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-12T13:12:58.069 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-12T13:12:58.070 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T13:12:58.075 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:58.075 DEBUG:teuthology.orchestra.run.smithi060:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-12T13:12:58.098 INFO:teuthology.orchestra.run.smithi060.stdout:postinstall scriptlet (using /bin/sh): 2024-04-12T13:12:58.098 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T13:12:58.098 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T13:12:58.098 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:for file in vmlinuz System.map config; do 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: fi 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:done 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:58.099 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-04-12T13:12:58.100 INFO:teuthology.orchestra.run.smithi060.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-12T13:12:58.100 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T13:12:58.100 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:58.100 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-04-12T13:12:58.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-04-12T13:12:58.180 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 68.el9 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8264254 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-04-12T13:12:58.181 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:12:58.182 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T13:12:58.183 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T13:12:58.183 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:12:58.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T13:12:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-04-12T13:13:00.239 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T13:13:00.294 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-04-12T13:13:00.296 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-04-12T13:13:00.314 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.bjLeGQ4Wqp 2024-04-12T13:13:00.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bjLeGQ4Wqp 2024-04-12T13:13:00.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.bjLeGQ4Wqp 2024-04-12T13:13:00.528 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.bjLeGQ4Wqp is 6KB 2024-04-12T13:13:00.576 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.bjLeGQ4Wqp 2024-04-12T13:13:00.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T13:13:00.660 INFO:teuthology.orchestra.run.smithi060.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T13:13:00.660 INFO:teuthology.orchestra.run.smithi060.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T13:13:00.660 INFO:teuthology.orchestra.run.smithi060.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T13:13:00.660 INFO:teuthology.orchestra.run.smithi060.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-12T13:13:00.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:13:00.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-04-12T13:13:30.822 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-12T13:13:30.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:13:30.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:13:49.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-12T13:13:58.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:13:58.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:14:31.425 INFO:teuthology.orchestra.run.smithi110.stdout:linux-firmware-20240219-143.el9.noarch.rpm 2.2 MB/s | 376 MB 02:50 2024-04-12T13:14:31.426 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:14:31.427 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.2 MB/s | 376 MB 02:50 2024-04-12T13:14:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:14:34.650 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:14:34.650 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:14:37.905 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:14:37.905 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:14:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:14:45.519 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T13:14:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:14:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:14:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:14:47.075 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:14:47.362 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on host.b... 2024-04-12T13:14:47.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T13:14:47.512 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-12T13:14:47.513 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-12T13:14:47.515 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-04-12T13:14:58.346 DEBUG:teuthology.orchestra.remote:timed out 2024-04-12T13:14:59.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12 13:14:59 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-12T13:14:59.622 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-04-12 13:14:59-- 2024-04-12T13:14:59.622 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 12s 2024-04-12T13:14:59.622 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 341M in 12s (28.9 MB/s) 2024-04-12T13:14:59.625 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on host.b... 2024-04-12T13:14:59.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-12T13:15:01.685 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2024-04-12T13:15:01.735 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2024-04-12T13:15:01.815 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2024-04-12T13:15:09.736 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-12T13:15:10.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:15:10.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:15:10.792 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-04-12T13:15:11.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:15:11.471 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-12T13:15:11.471 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-04-12T13:15:11.527 INFO:teuthology.orchestra.run.smithi060.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:11.527 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:11.527 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T13:15:11.528 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T13:15:12.528 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-12T13:15:12.529 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T13:15:12.686 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-04-12T13:15:12.768 DEBUG:teuthology.parallel:result is None 2024-04-12T13:15:26.592 INFO:teuthology.orchestra.run.smithi110.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T13:15:49.487 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-12T13:15:49.488 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-12T13:15:49.563 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-12T13:15:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-12T13:15:49.565 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-12T13:15:49.566 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-12T13:15:49.567 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-12T13:15:49.568 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-12T13:15:49.569 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-12T13:15:49.570 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-12T13:15:49.571 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-12T13:15:49.572 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-12T13:15:49.573 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-12T13:15:49.574 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-12T13:15:49.575 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-12T13:15:49.576 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-12T13:15:49.577 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-12T13:15:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-12T13:15:49.579 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-12T13:15:49.580 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-12T13:15:49.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-12T13:15:49.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-12T13:15:49.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-12T13:15:49.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-12T13:15:49.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-12T13:15:49.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-12T13:15:49.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-12T13:15:49.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-12T13:15:49.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-12T13:15:49.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-12T13:15:49.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-12T13:15:49.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-12T13:15:49.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-12T13:15:49.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-12T13:15:49.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-12T13:15:49.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-12T13:15:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-12T13:15:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-12T13:15:49.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-12T13:15:49.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-12T13:15:49.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-12T13:15:49.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-12T13:15:49.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-12T13:15:49.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-12T13:15:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-12T13:15:49.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-12T13:15:49.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-12T13:15:49.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-12T13:15:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-12T13:15:49.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-12T13:15:49.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-12T13:15:49.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-12T13:15:49.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-12T13:15:49.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-12T13:15:49.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-12T13:15:49.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-12T13:15:49.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-12T13:15:49.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-12T13:15:49.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-12T13:15:49.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-12T13:15:49.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-12T13:15:49.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-12T13:15:49.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-12T13:15:49.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-12T13:15:49.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-12T13:15:49.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-12T13:15:49.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-12T13:15:49.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-12T13:15:49.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-12T13:15:49.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-12T13:15:49.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-12T13:15:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-12T13:15:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-12T13:15:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-12T13:15:49.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-12T13:15:49.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-12T13:15:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-12T13:15:49.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-12T13:15:49.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-12T13:15:49.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-12T13:15:49.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-12T13:15:49.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-12T13:15:49.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-12T13:15:49.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-12T13:15:49.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-12T13:15:49.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-12T13:15:49.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-12T13:15:49.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-12T13:15:49.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-12T13:15:49.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-12T13:15:49.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-12T13:15:49.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-12T13:15:49.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-12T13:15:49.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-12T13:15:49.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-12T13:15:49.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-12T13:15:49.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-12T13:15:49.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-12T13:15:49.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-12T13:15:49.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-12T13:15:49.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-12T13:15:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-12T13:15:49.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-12T13:15:49.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-12T13:15:49.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-12T13:15:49.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-12T13:15:49.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-12T13:15:49.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-12T13:15:49.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-12T13:15:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-12T13:15:49.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-12T13:15:49.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-12T13:15:49.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-12T13:15:49.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-12T13:15:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-12T13:15:49.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-12T13:15:49.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-12T13:15:49.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-12T13:15:49.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-12T13:15:49.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-12T13:15:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-12T13:15:49.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-12T13:15:49.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-12T13:15:49.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-12T13:15:49.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-12T13:15:49.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-12T13:15:49.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-12T13:15:49.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-12T13:15:49.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-12T13:15:49.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-12T13:15:49.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-12T13:15:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-12T13:15:49.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-12T13:15:49.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-12T13:15:49.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-12T13:15:49.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-12T13:15:49.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-12T13:15:49.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-12T13:15:49.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-12T13:15:49.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-12T13:15:49.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-12T13:15:49.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-12T13:15:49.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T13:15:49.704 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.704 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:for file in vmlinuz System.map config; do 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:15:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: fi 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-12T13:15:49.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-04-12T13:15:49.814 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-04-12T13:15:49.815 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:15:49.816 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T13:15:49.816 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T13:15:49.816 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:49.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T13:15:50.371 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-04-12T13:15:51.789 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T13:15:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-04-12T13:15:51.823 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-04-12T13:15:51.839 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.rRcGIYu1Qi 2024-04-12T13:15:51.839 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rRcGIYu1Qi 2024-04-12T13:15:51.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.rRcGIYu1Qi 2024-04-12T13:15:52.052 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.rRcGIYu1Qi is 6KB 2024-04-12T13:15:52.101 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.rRcGIYu1Qi 2024-04-12T13:15:52.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T13:15:52.185 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T13:15:52.185 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T13:15:52.185 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T13:15:52.185 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-12T13:15:52.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:15:52.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-04-12T13:16:22.349 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-12T13:16:22.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:16:22.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:16:40.867 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-12T13:16:49.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:16:49.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:16:52.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-12T13:17:04.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:17:04.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:18:04.931 DEBUG:teuthology.orchestra.remote:timed out 2024-04-12T13:18:19.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:18:19.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:18:20.275 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-12T13:18:20.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:18:20.986 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-12T13:18:20.987 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-12T13:18:21.041 INFO:teuthology.orchestra.run.smithi110.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:18:21.042 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T13:18:21.042 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T13:18:21.042 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T13:18:22.043 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-12T13:18:22.043 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T13:18:22.186 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-04-12T13:18:22.248 DEBUG:teuthology.parallel:result is None 2024-04-12T13:18:22.249 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-12T13:18:22.256 INFO:teuthology.task.internal:Creating test directory... 2024-04-12T13:18:22.257 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T13:18:22.265 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T13:18:22.322 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-12T13:18:22.329 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-12T13:18:22.340 INFO:teuthology.task.internal:Creating archive directory... 2024-04-12T13:18:22.340 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T13:18:22.348 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T13:18:22.412 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-12T13:18:22.422 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-12T13:18:22.422 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T13:18:22.434 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T13:18:22.524 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T13:18:22.539 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T13:18:22.568 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T13:18:22.581 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T13:18:22.586 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-12T13:18:22.594 INFO:teuthology.task.internal:Configuring sudo... 2024-04-12T13:18:22.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T13:18:22.600 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T13:18:22.699 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-12T13:18:22.712 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-12T13:18:22.712 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T13:18:22.720 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T13:18:22.776 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T13:18:22.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T13:18:22.991 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T13:18:23.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T13:18:23.178 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:18:23.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T13:18:23.274 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T13:18:23.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T13:18:23.502 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T13:18:23.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T13:18:23.691 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:18:23.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T13:18:23.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-04-12T13:18:23.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-04-12T13:18:23.934 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T13:18:23.960 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T13:18:24.313 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-12T13:18:24.322 INFO:teuthology.task.internal:Starting timer... 2024-04-12T13:18:24.323 INFO:teuthology.run_tasks:Running task pcp... 2024-04-12T13:18:24.333 INFO:teuthology.run_tasks:Running task selinux... 2024-04-12T13:18:24.348 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-12T13:18:24.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-04-12T13:18:24.499 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-04-12T13:18:24.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-04-12T13:18:24.680 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-04-12T13:18:24.685 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-12T13:18:24.685 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-04-12T13:18:24.739 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-04-12T13:18:24.740 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-04-12T13:18:24.790 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-04-12T13:18:24.790 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2024-04-12T13:18:24.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T13:18:24.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:18:24.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T13:18:24.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:18:24.968 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-12T13:18:24.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-04-12T13:18:25.069 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-04-12T13:18:25.171 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-12T13:18:25.181 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-12T13:18:25.203 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-12T13:18:25.204 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-12T13:25:01.504 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-04-12T13:25:01.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:25:01.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:25:01.656 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-04-12T13:25:01.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-12T13:25:01.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:25:01.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T13:25:01.977 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-12T13:25:02.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-12T13:25:02.130 INFO:teuthology.run_tasks:Running task clock... 2024-04-12T13:25:02.146 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-12T13:25:02.146 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T13:25:02.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T13:25:02.154 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T13:25:02.154 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T13:25:02.255 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T13:25:02.261 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T13:25:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T13:25:02.319 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T13:25:02.401 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-04-12T13:25:02.420 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-04-12T13:25:02.443 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-04-12T13:25:02.467 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-04-12T13:25:02.499 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T13:25:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T13:25:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T13:25:02.581 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T13:25:02.701 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.710 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.739 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.754 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T13:25:02.755 INFO:teuthology.run_tasks:Running task install... 2024-04-12T13:25:02.764 DEBUG:teuthology.task.install:project ceph 2024-04-12T13:25:02.764 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a971fd5f5719038c70b817bafacd6d5400b1d888'}} 2024-04-12T13:25:02.764 DEBUG:teuthology.task.install:config {'branch': 'wip-64502-quincy-2', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'a971fd5f5719038c70b817bafacd6d5400b1d888'} 2024-04-12T13:25:02.764 INFO:teuthology.task.install:Using flavor: default 2024-04-12T13:25:02.775 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-12T13:25:02.775 INFO:teuthology.task.install:extra packages: [] 2024-04-12T13:25:02.776 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'wip-64502-quincy-2', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a971fd5f5719038c70b817bafacd6d5400b1d888', 'tag': None, 'wait_for_package': False} 2024-04-12T13:25:02.776 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:25:02.776 INFO:teuthology.packaging:ref: None 2024-04-12T13:25:02.776 INFO:teuthology.packaging:tag: None 2024-04-12T13:25:02.776 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:25:02.776 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:25:02.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-64502-quincy-2 2024-04-12T13:25:02.778 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'wip-64502-quincy-2', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a971fd5f5719038c70b817bafacd6d5400b1d888', 'tag': None, 'wait_for_package': False} 2024-04-12T13:25:02.779 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:25:02.779 INFO:teuthology.packaging:ref: None 2024-04-12T13:25:02.779 INFO:teuthology.packaging:tag: None 2024-04-12T13:25:02.779 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:25:02.779 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:25:02.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-64502-quincy-2 2024-04-12T13:25:02.995 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/ 2024-04-12T13:25:02.995 INFO:teuthology.task.install.rpm:Package version is 17.2.7-845.g730340d7 2024-04-12T13:25:03.009 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/ 2024-04-12T13:25:03.010 INFO:teuthology.task.install.rpm:Package version is 17.2.7-845.g730340d7 2024-04-12T13:25:03.405 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T13:25:03.406 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:25:03.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T13:25:03.409 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-64502-quincy-2/730340d76f41e9c8e5e38d06015fbcce8efa14be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T13:25:03.409 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:25:03.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T13:25:03.508 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-12T13:25:03.508 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:25:03.508 INFO:teuthology.packaging:ref: None 2024-04-12T13:25:03.508 INFO:teuthology.packaging:tag: None 2024-04-12T13:25:03.508 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:25:03.508 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:25:03.508 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/wip-64502-quincy-2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T13:25:03.509 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-12T13:25:03.509 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:25:03.509 INFO:teuthology.packaging:ref: None 2024-04-12T13:25:03.510 INFO:teuthology.packaging:tag: None 2024-04-12T13:25:03.510 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:25:03.510 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:25:03.510 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/wip-64502-quincy-2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T13:25:03.648 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T13:25:03.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T13:25:03.779 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T13:25:03.792 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T13:25:03.866 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-04-12T13:25:03.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-04-12T13:25:03.891 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-04-12T13:25:03.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-04-12T13:25:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:74 files removed 2024-04-12T13:25:04.270 INFO:teuthology.orchestra.run.smithi060.stdout:74 files removed 2024-04-12T13:25:04.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw 2024-04-12T13:25:04.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw 2024-04-12T13:25:05.812 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 75 kB/s | 77 kB 00:01 2024-04-12T13:25:05.884 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 74 kB/s | 77 kB 00:01 2024-04-12T13:25:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 14 kB/s | 11 kB 00:00 2024-04-12T13:25:06.818 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 13 kB/s | 11 kB 00:00 2024-04-12T13:25:07.588 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 2.1 kB/s | 1.8 kB 00:00 2024-04-12T13:25:07.735 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 2.1 kB/s | 1.8 kB 00:00 2024-04-12T13:25:08.241 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-04-12T13:25:08.389 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-04-12T13:25:10.176 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.5 MB 00:00 2024-04-12T13:25:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.5 MB 00:00 2024-04-12T13:25:11.380 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-12T13:25:11.677 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-12T13:25:15.923 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 19 MB 00:02 2024-04-12T13:25:18.639 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 19 MB 00:05 2024-04-12T13:25:21.645 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-04-12T13:25:23.421 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-04-12T13:25:23.706 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-04-12T13:25:25.515 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-12T13:25:25.556 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-12T13:25:27.767 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-12T13:25:31.798 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-12T13:25:33.792 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:25:34.582 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.583 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.584 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:25:34.585 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.586 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.587 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.588 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.589 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.590 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:25:34.591 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:25:35.370 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:17.2.7-845.g730340d7.el9 ceph 14 M 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-04-12T13:25:35.383 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 3.1 M 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.9 M 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:17.2.7-845.g730340d7.el9 ceph 5.0 M 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:17.2.7-845.g730340d7.el9 ceph 22 M 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:17.2.7-845.g730340d7.el9 ceph 25 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 637 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:17.2.7-845.g730340d7.el9 ceph 457 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 4.9 M 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T13:25:35.384 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:17.2.7-845.g730340d7.el9 ceph 45 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:17.2.7-845.g730340d7.el9 ceph 118 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:17.2.7-845.g730340d7.el9 ceph 156 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:17.2.7-845.g730340d7.el9 ceph 320 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:17.2.7-845.g730340d7.el9 ceph 293 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:17.2.7-845.g730340d7.el9 ceph 100 k 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout:Install 22 Packages 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2024-04-12T13:25:35.385 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:25:35.386 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 58 M 2024-04-12T13:25:35.386 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:25:36.461 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.462 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.463 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.464 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.465 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.466 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.467 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.468 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.469 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:25:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:25:37.179 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:17.2.7-845.g730340d7.el9 ceph 14 M 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 3.1 M 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.9 M 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:25:37.190 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:17.2.7-845.g730340d7.el9 ceph 5.0 M 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:17.2.7-845.g730340d7.el9 ceph 22 M 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:17.2.7-845.g730340d7.el9 ceph 25 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 637 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:17.2.7-845.g730340d7.el9 ceph 457 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:17.2.7-845.g730340d7.el9 ceph 4.9 M 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:17.2.7-845.g730340d7.el9 ceph 45 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:17.2.7-845.g730340d7.el9 ceph 118 k 2024-04-12T13:25:37.191 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:17.2.7-845.g730340d7.el9 ceph 156 k 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:17.2.7-845.g730340d7.el9 ceph 320 k 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:17.2.7-845.g730340d7.el9 ceph 293 k 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:17.2.7-845.g730340d7.el9 ceph 100 k 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout:Install 22 Packages 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 2 Packages 2024-04-12T13:25:37.192 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:25:37.193 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 58 M 2024-04-12T13:25:37.193 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:25:39.191 INFO:teuthology.orchestra.run.smithi060.stdout:(1/24): ceph-base-17.2.7-845.g730340d7.el9.x86_ 1.5 MB/s | 5.0 MB 00:03 2024-04-12T13:25:39.274 INFO:teuthology.orchestra.run.smithi060.stdout:(2/24): ceph-selinux-17.2.7-845.g730340d7.el9.x 306 kB/s | 25 kB 00:00 2024-04-12T13:25:39.415 INFO:teuthology.orchestra.run.smithi110.stdout:(1/24): ceph-base-17.2.7-845.g730340d7.el9.x86_ 2.9 MB/s | 5.0 MB 00:01 2024-04-12T13:25:39.494 INFO:teuthology.orchestra.run.smithi110.stdout:(2/24): ceph-selinux-17.2.7-845.g730340d7.el9.x 322 kB/s | 25 kB 00:00 2024-04-12T13:25:39.583 INFO:teuthology.orchestra.run.smithi060.stdout:(3/24): libcephfs2-17.2.7-845.g730340d7.el9.x86 2.0 MB/s | 637 kB 00:00 2024-04-12T13:25:39.686 INFO:teuthology.orchestra.run.smithi110.stdout:(3/24): libcephfs2-17.2.7-845.g730340d7.el9.x86 3.3 MB/s | 637 kB 00:00 2024-04-12T13:25:39.844 INFO:teuthology.orchestra.run.smithi110.stdout:(4/24): libradosstriper1-17.2.7-845.g730340d7.e 2.8 MB/s | 457 kB 00:00 2024-04-12T13:25:39.875 INFO:teuthology.orchestra.run.smithi060.stdout:(4/24): libradosstriper1-17.2.7-845.g730340d7.e 1.5 MB/s | 457 kB 00:00 2024-04-12T13:25:40.953 INFO:teuthology.orchestra.run.smithi110.stdout:(5/24): librgw2-17.2.7-845.g730340d7.el9.x86_64 4.4 MB/s | 4.9 MB 00:01 2024-04-12T13:25:41.028 INFO:teuthology.orchestra.run.smithi110.stdout:(6/24): python3-ceph-argparse-17.2.7-845.g73034 610 kB/s | 45 kB 00:00 2024-04-12T13:25:41.103 INFO:teuthology.orchestra.run.smithi110.stdout:(7/24): python3-ceph-common-17.2.7-845.g730340d 1.5 MB/s | 118 kB 00:00 2024-04-12T13:25:41.237 INFO:teuthology.orchestra.run.smithi110.stdout:(8/24): python3-cephfs-17.2.7-845.g730340d7.el9 1.1 MB/s | 156 kB 00:00 2024-04-12T13:25:41.338 INFO:teuthology.orchestra.run.smithi110.stdout:(9/24): python3-rados-17.2.7-845.g730340d7.el9. 3.2 MB/s | 320 kB 00:00 2024-04-12T13:25:41.437 INFO:teuthology.orchestra.run.smithi110.stdout:(10/24): python3-rbd-17.2.7-845.g730340d7.el9.x 2.9 MB/s | 293 kB 00:00 2024-04-12T13:25:41.530 INFO:teuthology.orchestra.run.smithi110.stdout:(11/24): python3-rgw-17.2.7-845.g730340d7.el9.x 1.1 MB/s | 100 kB 00:00 2024-04-12T13:25:41.722 INFO:teuthology.orchestra.run.smithi110.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 839 kB/s | 160 kB 00:00 2024-04-12T13:25:41.772 INFO:teuthology.orchestra.run.smithi110.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 919 kB/s | 45 kB 00:00 2024-04-12T13:25:41.872 INFO:teuthology.orchestra.run.smithi110.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-12T13:25:41.954 INFO:teuthology.orchestra.run.smithi110.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.6 MB/s | 292 kB 00:00 2024-04-12T13:25:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 821 kB/s | 42 kB 00:00 2024-04-12T13:25:42.041 INFO:teuthology.orchestra.run.smithi060.stdout:(5/24): librgw2-17.2.7-845.g730340d7.el9.x86_64 2.3 MB/s | 4.9 MB 00:02 2024-04-12T13:25:42.100 INFO:teuthology.orchestra.run.smithi060.stdout:(6/24): python3-ceph-argparse-17.2.7-845.g73034 790 kB/s | 45 kB 00:00 2024-04-12T13:25:42.182 INFO:teuthology.orchestra.run.smithi060.stdout:(7/24): python3-ceph-common-17.2.7-845.g730340d 1.4 MB/s | 118 kB 00:00 2024-04-12T13:25:42.409 INFO:teuthology.orchestra.run.smithi060.stdout:(8/24): ceph-common-17.2.7-845.g730340d7.el9.x8 3.5 MB/s | 22 MB 00:06 2024-04-12T13:25:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:(9/24): python3-cephfs-17.2.7-845.g730340d7.el9 601 kB/s | 156 kB 00:00 2024-04-12T13:25:42.490 INFO:teuthology.orchestra.run.smithi110.stdout:(17/24): ceph-common-17.2.7-845.g730340d7.el9.x 4.7 MB/s | 22 MB 00:04 2024-04-12T13:25:42.543 INFO:teuthology.orchestra.run.smithi060.stdout:(10/24): python3-rados-17.2.7-845.g730340d7.el9 2.4 MB/s | 320 kB 00:00 2024-04-12T13:25:42.585 INFO:teuthology.orchestra.run.smithi060.stdout:(11/24): python3-rbd-17.2.7-845.g730340d7.el9.x 2.0 MB/s | 293 kB 00:00 2024-04-12T13:25:42.627 INFO:teuthology.orchestra.run.smithi060.stdout:(12/24): python3-rgw-17.2.7-845.g730340d7.el9.x 1.2 MB/s | 100 kB 00:00 2024-04-12T13:25:42.782 INFO:teuthology.orchestra.run.smithi110.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 399 kB/s | 309 kB 00:00 2024-04-12T13:25:42.840 INFO:teuthology.orchestra.run.smithi110.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-12T13:25:42.882 INFO:teuthology.orchestra.run.smithi110.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 677 kB/s | 67 kB 00:00 2024-04-12T13:25:43.035 INFO:teuthology.orchestra.run.smithi060.stdout:(13/24): ceph-radosgw-17.2.7-845.g730340d7.el9. 2.0 MB/s | 14 MB 00:07 2024-04-12T13:25:43.060 INFO:teuthology.orchestra.run.smithi060.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 105 kB/s | 45 kB 00:00 2024-04-12T13:25:43.127 INFO:teuthology.orchestra.run.smithi060.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 296 kB/s | 160 kB 00:00 2024-04-12T13:25:43.186 INFO:teuthology.orchestra.run.smithi060.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 734 kB/s | 42 kB 00:00 2024-04-12T13:25:43.228 INFO:teuthology.orchestra.run.smithi060.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-04-12T13:25:43.241 INFO:teuthology.orchestra.run.smithi110.stdout:(21/24): librados2-17.2.7-845.g730340d7.el9.x86 8.6 MB/s | 3.1 MB 00:00 2024-04-12T13:25:43.308 INFO:teuthology.orchestra.run.smithi110.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-04-12T13:25:43.336 INFO:teuthology.orchestra.run.smithi060.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-12T13:25:43.378 INFO:teuthology.orchestra.run.smithi060.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2024-04-12T13:25:43.454 INFO:teuthology.orchestra.run.smithi060.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-12T13:25:43.554 INFO:teuthology.orchestra.run.smithi060.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 311 kB/s | 67 kB 00:00 2024-04-12T13:25:43.558 INFO:teuthology.orchestra.run.smithi110.stdout:(23/24): librbd1-17.2.7-845.g730340d7.el9.x86_6 9.3 MB/s | 2.9 MB 00:00 2024-04-12T13:25:43.771 INFO:teuthology.orchestra.run.smithi060.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-04-12T13:25:44.104 INFO:teuthology.orchestra.run.smithi060.stdout:(23/24): librados2-17.2.7-845.g730340d7.el9.x86 4.7 MB/s | 3.1 MB 00:00 2024-04-12T13:25:44.288 INFO:teuthology.orchestra.run.smithi060.stdout:(24/24): librbd1-17.2.7-845.g730340d7.el9.x86_6 4.0 MB/s | 2.9 MB 00:00 2024-04-12T13:25:44.292 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:25:44.293 INFO:teuthology.orchestra.run.smithi060.stdout:Total 6.5 MB/s | 58 MB 00:08 2024-04-12T13:25:44.425 INFO:teuthology.orchestra.run.smithi110.stdout:(24/24): ceph-radosgw-17.2.7-845.g730340d7.el9. 2.1 MB/s | 14 MB 00:06 2024-04-12T13:25:44.431 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:25:44.432 INFO:teuthology.orchestra.run.smithi110.stdout:Total 8.0 MB/s | 58 MB 00:07 2024-04-12T13:25:44.489 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:25:44.573 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:25:44.573 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:25:44.625 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:25:44.700 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:25:44.700 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:25:45.122 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:25:45.123 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:25:45.231 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:25:45.231 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:25:46.546 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:25:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:25:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-12T13:25:46.998 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:25:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-12T13:25:47.125 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:25:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:25:47.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 3/26 2024-04-12T13:25:47.250 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:25:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:25:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 3/26 2024-04-12T13:25:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:25:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:25:47.455 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-12T13:25:47.500 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-12T13:25:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:25:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-12T13:25:47.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-12T13:25:48.037 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-12T13:25:48.069 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:17.2.7-845.g730340d7.el9.x86_64 8/26 2024-04-12T13:25:48.161 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:17.2.7-845.g730340d7.el9.x86_64 8/26 2024-04-12T13:25:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-12T13:25:48.196 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-12T13:25:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:17.2.7-845.g730340d7.el9.x86_64 8/26 2024-04-12T13:25:48.261 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x 10/26 2024-04-12T13:25:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:17.2.7-845.g730340d7.el9.x86_64 8/26 2024-04-12T13:25:48.312 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 11/26 2024-04-12T13:25:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-12T13:25:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x 10/26 2024-04-12T13:25:48.395 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 12/26 2024-04-12T13:25:48.411 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 11/26 2024-04-12T13:25:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:25:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 12/26 2024-04-12T13:25:48.532 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:25:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:25:48.584 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-12T13:25:48.633 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-12T13:25:48.633 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:25:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-12T13:25:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-12T13:25:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-12T13:25:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-12T13:25:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-12T13:25:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:17.2.7-845.g730340d7.el9.x86_64 18/26 2024-04-12T13:25:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-12T13:25:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:17.2.7-845.g730340d7.el9.x86_64 18/26 2024-04-12T13:25:49.232 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:17.2.7-845.g730340d7.el9.x86_64 18/26 2024-04-12T13:25:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:17.2.7-845.g730340d7.el9.x86_64 18/26 2024-04-12T13:25:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 19/26 2024-04-12T13:25:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86 20/26 2024-04-12T13:25:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 19/26 2024-04-12T13:25:49.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86 20/26 2024-04-12T13:25:52.296 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:52.342 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:52.376 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:53.008 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 21/26 2024-04-12T13:25:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 22/26 2024-04-12T13:25:53.046 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 22/26 2024-04-12T13:25:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 22/26 2024-04-12T13:25:53.238 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T13:25:53.238 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T13:25:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:25:53.242 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 22/26 2024-04-12T13:25:53.242 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T13:25:53.242 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T13:25:53.242 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:25:53.278 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:25:53.280 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-04-12T13:26:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:26:04.735 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-04-12T13:26:04.735 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-04-12T13:26:04.735 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-04-12T13:26:04.735 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-04-12T13:26:04.736 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-04-12T13:26:04.736 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-04-12T13:26:04.736 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-04-12T13:26:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:05.416 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 24/26 2024-04-12T13:26:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 24/26 2024-04-12T13:26:05.552 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:05.552 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T13:26:05.552 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T13:26:05.552 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T13:26:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T13:26:05.713 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T13:26:05.713 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 24/26 2024-04-12T13:26:06.351 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 24/26 2024-04-12T13:26:06.352 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:06.352 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T13:26:06.352 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T13:26:06.352 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T13:26:06.352 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:06.357 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T13:26:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T13:26:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 1/26 2024-04-12T13:26:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:26:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 3/26 2024-04-12T13:26:07.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 5/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 6/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:17.2.7-845.g730340d7.el9.x86_64 7/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x 8/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86 9/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 10/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 11/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 12/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-12T13:26:07.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-12T13:26:07.303 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:17.2.7-845.g730340d7.el9.x86_64 25/26 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.989 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:07.991 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 1/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 3/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 4/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 5/26 2024-04-12T13:26:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 6/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:17.2.7-845.g730340d7.el9.x86_64 7/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x 8/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86 9/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 10/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 11/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 12/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 13/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-12T13:26:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-12T13:26:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-12T13:26:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-12T13:26:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:17.2.7-845.g730340d7.el9.x86_64 23/26 2024-04-12T13:26:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-12T13:26:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:17.2.7-845.g730340d7.el9.x86_64 25/26 2024-04-12T13:26:08.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-test 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:26:09.140 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T13:26:09.141 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:09.142 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:09.258 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:36 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:09.560 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:09.560 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:09.561 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:09.562 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:09.563 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:09.564 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:09.565 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.566 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.567 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.568 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.569 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:09.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-test 2024-04-12T13:26:09.636 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:17.2.7-845.g730340d7.el9 ceph 48 M 2024-04-12T13:26:09.637 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:17.2.7-845.g730340d7.el9 ceph 163 k 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout:Install 6 Packages 2024-04-12T13:26:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:09.639 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 49 M 2024-04-12T13:26:09.639 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 193 M 2024-04-12T13:26:09.639 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:10.182 INFO:teuthology.orchestra.run.smithi110.stdout:(1/6): libcephsqlite-17.2.7-845.g730340d7.el9.x 530 kB/s | 163 kB 00:00 2024-04-12T13:26:10.424 INFO:teuthology.orchestra.run.smithi110.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 341 kB/s | 187 kB 00:00 2024-04-12T13:26:10.498 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:39 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 437 kB/s | 218 kB 00:00 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.809 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:10.810 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.811 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:10.812 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:10.813 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:10.814 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.815 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:10.816 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:10.817 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.818 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.818 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.818 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:10.882 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:17.2.7-845.g730340d7.el9 ceph 48 M 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T13:26:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:17.2.7-845.g730340d7.el9 ceph 163 k 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2024-04-12T13:26:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:10.885 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 49 M 2024-04-12T13:26:10.885 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 193 M 2024-04-12T13:26:10.885 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:26:10.916 INFO:teuthology.orchestra.run.smithi110.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 274 kB/s | 64 kB 00:00 2024-04-12T13:26:11.333 INFO:teuthology.orchestra.run.smithi110.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 336 kB/s | 305 kB 00:00 2024-04-12T13:26:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 593 kB/s | 187 kB 00:00 2024-04-12T13:26:11.465 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): libcephsqlite-17.2.7-845.g730340d7.el9.x 466 kB/s | 163 kB 00:00 2024-04-12T13:26:11.516 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-12T13:26:11.674 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 404 kB/s | 64 kB 00:00 2024-04-12T13:26:11.814 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 877 kB/s | 305 kB 00:00 2024-04-12T13:26:13.033 INFO:teuthology.orchestra.run.smithi110.stdout:(6/6): ceph-test-17.2.7-845.g730340d7.el9.x86_6 15 MB/s | 48 MB 00:03 2024-04-12T13:26:13.040 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:13.041 INFO:teuthology.orchestra.run.smithi110.stdout:Total 14 MB/s | 49 MB 00:03 2024-04-12T13:26:13.185 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:26:13.238 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:26:13.238 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:26:13.704 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:26:13.704 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:26:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:26:14.517 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-12T13:26:14.584 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-12T13:26:14.626 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-12T13:26:14.685 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-12T13:26:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 5/6 2024-04-12T13:26:17.700 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): ceph-test-17.2.7-845.g730340d7.el9.x86_6 7.3 MB/s | 48 MB 00:06 2024-04-12T13:26:17.703 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:17.704 INFO:teuthology.orchestra.run.smithi060.stdout:Total 7.2 MB/s | 49 MB 00:06 2024-04-12T13:26:17.859 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:26:17.915 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:26:17.915 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:26:18.381 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:26:18.382 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:26:19.098 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:26:19.191 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-12T13:26:19.233 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-12T13:26:19.274 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-12T13:26:19.337 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-12T13:26:19.369 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 5/6 2024-04-12T13:26:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 5/6 2024-04-12T13:26:19.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 6/6 2024-04-12T13:26:22.069 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 6/6 2024-04-12T13:26:22.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 1/6 2024-04-12T13:26:22.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 2/6 2024-04-12T13:26:22.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-12T13:26:22.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-12T13:26:22.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.6-16.el9.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T13:26:22.422 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:22.423 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:22.764 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph 2024-04-12T13:26:23.656 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:50 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:23.978 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.979 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:23.980 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:23.981 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:23.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:23.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:24.056 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:24.058 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:17.2.7-845.g730340d7.el9 ceph 6.5 k 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.1 M 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:17.2.7-845.g730340d7.el9 ceph 1.4 M 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 240 k 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:17.2.7-845.g730340d7.el9 ceph 3.9 M 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:17.2.7-845.g730340d7.el9 ceph 15 M 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T13:26:24.059 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T13:26:24.060 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout:Install 33 Packages 2024-04-12T13:26:24.061 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 27 M 2024-04-12T13:26:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 96 M 2024-04-12T13:26:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:24.446 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 5/6 2024-04-12T13:26:24.585 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 6/6 2024-04-12T13:26:25.338 INFO:teuthology.orchestra.run.smithi110.stdout:(1/33): ceph-17.2.7-845.g730340d7.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2024-04-12T13:26:25.580 INFO:teuthology.orchestra.run.smithi110.stdout:(2/33): ceph-mds-17.2.7-845.g730340d7.el9.x86_6 4.0 MB/s | 2.1 MB 00:00 2024-04-12T13:26:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:(3/33): ceph-mgr-17.2.7-845.g730340d7.el9.x86_6 2.4 MB/s | 1.4 MB 00:00 2024-04-12T13:26:25.755 INFO:teuthology.orchestra.run.smithi110.stdout:(4/33): ceph-mgr-modules-core-17.2.7-845.g73034 2.4 MB/s | 240 kB 00:00 2024-04-12T13:26:26.064 INFO:teuthology.orchestra.run.smithi110.stdout:(5/33): ceph-mon-17.2.7-845.g730340d7.el9.x86_6 5.4 MB/s | 3.9 MB 00:00 2024-04-12T13:26:26.131 INFO:teuthology.orchestra.run.smithi110.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 677 kB/s | 253 kB 00:00 2024-04-12T13:26:26.431 INFO:teuthology.orchestra.run.smithi110.stdout:(7/33): ceph-osd-17.2.7-845.g730340d7.el9.x86_6 18 MB/s | 15 MB 00:00 2024-04-12T13:26:26.456 INFO:teuthology.orchestra.run.smithi110.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 328 kB/s | 106 kB 00:00 2024-04-12T13:26:26.640 INFO:teuthology.orchestra.run.smithi110.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 684 kB/s | 125 kB 00:00 2024-04-12T13:26:26.732 INFO:teuthology.orchestra.run.smithi110.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 451 kB/s | 135 kB 00:00 2024-04-12T13:26:26.808 INFO:teuthology.orchestra.run.smithi110.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.3 MB/s | 215 kB 00:00 2024-04-12T13:26:26.927 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 6/6 2024-04-12T13:26:26.927 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 1/6 2024-04-12T13:26:26.927 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 2/6 2024-04-12T13:26:26.927 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-12T13:26:26.928 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-12T13:26:26.928 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-12T13:26:27.175 INFO:teuthology.orchestra.run.smithi110.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 95 kB/s | 35 kB 00:00 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.6-16.el9.x86_64 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:27.309 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T13:26:27.310 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T13:26:27.310 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T13:26:27.310 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:27.310 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:27.375 INFO:teuthology.orchestra.run.smithi110.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 268 kB/s | 172 kB 00:00 2024-04-12T13:26:27.400 INFO:teuthology.orchestra.run.smithi110.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 227 kB/s | 51 kB 00:00 2024-04-12T13:26:27.450 INFO:teuthology.orchestra.run.smithi110.stdout:(15/33): python3-cryptography-36.0.1-4.el9.x86_ 906 kB/s | 1.2 MB 00:01 2024-04-12T13:26:27.509 INFO:teuthology.orchestra.run.smithi110.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-04-12T13:26:27.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph 2024-04-12T13:26:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 78 kB/s | 43 kB 00:00 2024-04-12T13:26:28.093 INFO:teuthology.orchestra.run.smithi110.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 81 kB/s | 11 kB 00:00 2024-04-12T13:26:28.138 INFO:teuthology.orchestra.run.smithi110.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 251 kB/s | 172 kB 00:00 2024-04-12T13:26:28.194 INFO:teuthology.orchestra.run.smithi110.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2024-04-12T13:26:28.219 INFO:teuthology.orchestra.run.smithi110.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 279 kB/s | 23 kB 00:00 2024-04-12T13:26:28.253 INFO:teuthology.orchestra.run.smithi110.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 483 kB/s | 358 kB 00:00 2024-04-12T13:26:28.320 INFO:teuthology.orchestra.run.smithi110.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 156 kB/s | 19 kB 00:00 2024-04-12T13:26:28.345 INFO:teuthology.orchestra.run.smithi110.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 158 kB/s | 20 kB 00:00 2024-04-12T13:26:28.370 INFO:teuthology.orchestra.run.smithi110.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 397 kB/s | 46 kB 00:00 2024-04-12T13:26:28.479 INFO:teuthology.orchestra.run.smithi110.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 152 kB/s | 16 kB 00:00 2024-04-12T13:26:28.521 INFO:teuthology.orchestra.run.smithi110.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 394 kB/s | 79 kB 00:00 2024-04-12T13:26:28.555 INFO:teuthology.orchestra.run.smithi110.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-04-12T13:26:28.588 INFO:teuthology.orchestra.run.smithi110.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 833 kB/s | 90 kB 00:00 2024-04-12T13:26:28.617 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:57 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:28.638 INFO:teuthology.orchestra.run.smithi110.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 307 kB/s | 36 kB 00:00 2024-04-12T13:26:28.755 INFO:teuthology.orchestra.run.smithi110.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 172 kB/s | 20 kB 00:00 2024-04-12T13:26:28.814 INFO:teuthology.orchestra.run.smithi110.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 889 kB/s | 230 kB 00:00 2024-04-12T13:26:28.855 INFO:teuthology.orchestra.run.smithi110.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-04-12T13:26:28.865 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:28.865 INFO:teuthology.orchestra.run.smithi110.stdout:Total 5.7 MB/s | 27 MB 00:04 2024-04-12T13:26:28.933 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:28.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:28.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:28.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:28.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:28.941 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:28.942 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:17.2.7-845.g730340d7.el9 ceph 6.5 k 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.1 M 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:17.2.7-845.g730340d7.el9 ceph 1.4 M 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 240 k 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:17.2.7-845.g730340d7.el9 ceph 3.9 M 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:17.2.7-845.g730340d7.el9 ceph 15 M 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T13:26:29.014 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T13:26:29.015 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout:Install 33 Packages 2024-04-12T13:26:29.016 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:29.017 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 27 M 2024-04-12T13:26:29.017 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 96 M 2024-04-12T13:26:29.017 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:26:29.230 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:26:29.314 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:26:29.315 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:26:29.762 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:26:29.763 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:26:30.343 INFO:teuthology.orchestra.run.smithi060.stdout:(1/33): ceph-17.2.7-845.g730340d7.el9.x86_64.rp 20 kB/s | 6.5 kB 00:00 2024-04-12T13:26:30.794 INFO:teuthology.orchestra.run.smithi060.stdout:(2/33): ceph-mds-17.2.7-845.g730340d7.el9.x86_6 2.7 MB/s | 2.1 MB 00:00 2024-04-12T13:26:30.885 INFO:teuthology.orchestra.run.smithi060.stdout:(3/33): ceph-mgr-17.2.7-845.g730340d7.el9.x86_6 1.6 MB/s | 1.4 MB 00:00 2024-04-12T13:26:30.986 INFO:teuthology.orchestra.run.smithi060.stdout:(4/33): ceph-mgr-modules-core-17.2.7-845.g73034 2.4 MB/s | 240 kB 00:00 2024-04-12T13:26:31.161 INFO:teuthology.orchestra.run.smithi060.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-04-12T13:26:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:26:31.293 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-12T13:26:31.295 INFO:teuthology.orchestra.run.smithi060.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 9.3 MB/s | 1.2 MB 00:00 2024-04-12T13:26:31.345 INFO:teuthology.orchestra.run.smithi060.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-12T13:26:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-12T13:26:31.404 INFO:teuthology.orchestra.run.smithi060.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-04-12T13:26:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-12T13:26:31.496 INFO:teuthology.orchestra.run.smithi060.stdout:(9/33): ceph-mon-17.2.7-845.g730340d7.el9.x86_6 3.4 MB/s | 3.9 MB 00:01 2024-04-12T13:26:31.529 INFO:teuthology.orchestra.run.smithi060.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.0 MB/s | 125 kB 00:00 2024-04-12T13:26:31.560 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-12T13:26:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-12T13:26:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-12T13:26:31.771 INFO:teuthology.orchestra.run.smithi060.stdout:(11/33): ceph-osd-17.2.7-845.g730340d7.el9.x86_ 16 MB/s | 15 MB 00:00 2024-04-12T13:26:31.802 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-12T13:26:31.805 INFO:teuthology.orchestra.run.smithi060.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 697 kB/s | 215 kB 00:00 2024-04-12T13:26:31.855 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-12T13:26:31.871 INFO:teuthology.orchestra.run.smithi060.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 504 kB/s | 172 kB 00:00 2024-04-12T13:26:31.891 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-12T13:26:31.897 INFO:teuthology.orchestra.run.smithi060.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 280 kB/s | 35 kB 00:00 2024-04-12T13:26:31.922 INFO:teuthology.orchestra.run.smithi060.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 439 kB/s | 51 kB 00:00 2024-04-12T13:26:31.934 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-12T13:26:31.947 INFO:teuthology.orchestra.run.smithi060.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 559 kB/s | 42 kB 00:00 2024-04-12T13:26:31.979 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-12T13:26:32.014 INFO:teuthology.orchestra.run.smithi060.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 374 kB/s | 43 kB 00:00 2024-04-12T13:26:32.016 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-12T13:26:32.048 INFO:teuthology.orchestra.run.smithi060.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-12T13:26:32.049 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-12T13:26:32.065 INFO:teuthology.orchestra.run.smithi060.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 217 kB/s | 11 kB 00:00 2024-04-12T13:26:32.082 INFO:teuthology.orchestra.run.smithi060.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 537 kB/s | 18 kB 00:00 2024-04-12T13:26:32.107 INFO:teuthology.orchestra.run.smithi060.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 562 kB/s | 23 kB 00:00 2024-04-12T13:26:32.119 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-12T13:26:32.149 INFO:teuthology.orchestra.run.smithi060.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-04-12T13:26:32.166 INFO:teuthology.orchestra.run.smithi060.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 235 kB/s | 19 kB 00:00 2024-04-12T13:26:32.183 INFO:teuthology.orchestra.run.smithi060.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 263 kB/s | 20 kB 00:00 2024-04-12T13:26:32.208 INFO:teuthology.orchestra.run.smithi060.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 801 kB/s | 46 kB 00:00 2024-04-12T13:26:32.241 INFO:teuthology.orchestra.run.smithi060.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-04-12T13:26:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-12T13:26:32.267 INFO:teuthology.orchestra.run.smithi060.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 284 kB/s | 16 kB 00:00 2024-04-12T13:26:32.301 INFO:teuthology.orchestra.run.smithi060.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-12T13:26:32.326 INFO:teuthology.orchestra.run.smithi060.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-04-12T13:26:32.351 INFO:teuthology.orchestra.run.smithi060.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 433 kB/s | 36 kB 00:00 2024-04-12T13:26:32.385 INFO:teuthology.orchestra.run.smithi060.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-12T13:26:32.410 INFO:teuthology.orchestra.run.smithi060.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 346 kB/s | 20 kB 00:00 2024-04-12T13:26:32.450 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-12T13:26:32.452 INFO:teuthology.orchestra.run.smithi060.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-04-12T13:26:32.455 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:32.456 INFO:teuthology.orchestra.run.smithi060.stdout:Total 7.9 MB/s | 27 MB 00:03 2024-04-12T13:26:32.552 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-12T13:26:32.612 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-12T13:26:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-12T13:26:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-12T13:26:32.783 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-12T13:26:32.827 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:26:32.917 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:26:32.917 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:26:33.042 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-12T13:26:33.110 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-12T13:26:33.231 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-12T13:26:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-12T13:26:33.348 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:26:33.349 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:26:33.386 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-12T13:26:33.528 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-12T13:26:33.705 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.n 28/33 2024-04-12T13:26:33.736 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 29/33 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 29/33 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T13:26:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:34.907 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:26:34.981 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-12T13:26:35.018 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-12T13:26:35.095 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-12T13:26:35.246 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 30/33 2024-04-12T13:26:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-12T13:26:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 30/33 2024-04-12T13:26:35.325 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:35.325 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T13:26:35.326 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T13:26:35.326 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T13:26:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-12T13:26:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-12T13:26:35.465 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-12T13:26:35.502 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-12T13:26:35.525 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-12T13:26:35.558 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-12T13:26:35.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-12T13:26:35.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-12T13:26:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-12T13:26:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 31/33 2024-04-12T13:26:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-12T13:26:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 31/33 2024-04-12T13:26:35.818 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:35.819 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T13:26:35.819 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T13:26:35.819 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T13:26:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:35.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-12T13:26:36.070 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 32/33 2024-04-12T13:26:36.132 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 32/33 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T13:26:36.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:36.235 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:17.2.7-845.g730340d7.el9.x86_64 33/33 2024-04-12T13:26:36.239 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-12T13:26:36.307 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-12T13:26:36.345 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-2:17.2.7-845.g730340d7.el9.x86_64 33/33 2024-04-12T13:26:36.345 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-12T13:26:36.345 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-12T13:26:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-12T13:26:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-12T13:26:36.934 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-12T13:26:37.004 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-12T13:26:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-12T13:26:37.226 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-12T13:26:37.268 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-12T13:26:37.422 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-12T13:26:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.n 28/33 2024-04-12T13:26:37.658 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 29/33 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 29/33 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T13:26:37.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:17.2.7-845.g730340d7.el9.x86_64 1/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 2/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 3/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 4/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 5/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.n 6/33 2024-04-12T13:26:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-12T13:26:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-12T13:26:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-12T13:26:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-12T13:26:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-12T13:26:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:39.157 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T13:26:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T13:26:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T13:26:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T13:26:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T13:26:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T13:26:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:39.160 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:39.301 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 30/33 2024-04-12T13:26:39.383 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 30/33 2024-04-12T13:26:39.383 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:39.384 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T13:26:39.384 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T13:26:39.384 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T13:26:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:39.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-base 2024-04-12T13:26:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 31/33 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 31/33 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T13:26:39.910 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:40.166 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 32/33 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 32/33 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T13:26:40.242 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:17.2.7-845.g730340d7.el9.x86_64 33/33 2024-04-12T13:26:40.460 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-2:17.2.7-845.g730340d7.el9.x86_64 33/33 2024-04-12T13:26:40.460 INFO:teuthology.orchestra.run.smithi060.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-12T13:26:40.460 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:40.476 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:07 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:40.771 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.772 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:40.773 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.774 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:40.775 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.776 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.777 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.778 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.779 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:40.780 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:26:40.838 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:40.839 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:26:40.840 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:40.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install cephadm 2024-04-12T13:26:41.780 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:08 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.076 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:42.077 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.078 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.079 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.080 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.081 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.082 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.083 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.084 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:42.085 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.085 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.085 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.085 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:17.2.7-845.g730340d7.el9.x86_64 1/33 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 2/33 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 3/33 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 4/33 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 5/33 2024-04-12T13:26:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.n 6/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-12T13:26:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-12T13:26:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-12T13:26:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-12T13:26:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-12T13:26:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-12T13:26:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-12T13:26:42.145 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 82 k 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:42.146 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:26:42.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:42.147 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 82 k 2024-04-12T13:26:42.147 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 372 k 2024-04-12T13:26:42.147 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm-17.2.7-845.g730340d7.el9.noarch.rpm 341 kB/s | 82 kB 00:00 2024-04-12T13:26:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:Total 336 kB/s | 82 kB 00:00 2024-04-12T13:26:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:26:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:26:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:26:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:26:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:26:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:26:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T13:26:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T13:26:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:43.296 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:43.349 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:43.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-base 2024-04-12T13:26:43.848 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:44.450 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-immutable-object-cache 2024-04-12T13:26:44.614 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:13 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:44.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:44.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.930 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.931 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:44.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:44.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:44.937 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-base-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:26:45.000 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:45.001 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:26:45.002 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:45.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install cephadm 2024-04-12T13:26:45.348 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:12 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.648 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.649 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:45.650 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:45.651 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:45.652 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.653 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.654 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.655 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.656 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.657 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.658 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:45.716 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-845.g730340d7.el9 ceph 138 k 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:45.717 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:26:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:45.718 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 138 k 2024-04-12T13:26:45.718 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 379 k 2024-04-12T13:26:45.718 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:45.966 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:14 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:46.071 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-immutable-object-cache-17.2.7-845.g730340d 390 kB/s | 138 kB 00:00 2024-04-12T13:26:46.072 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:46.073 INFO:teuthology.orchestra.run.smithi110.stdout:Total 387 kB/s | 138 kB 00:00 2024-04-12T13:26:46.073 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:26:46.099 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:26:46.099 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:26:46.207 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:26:46.207 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.279 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.280 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.281 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:46.282 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:46.283 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.284 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.285 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:46.286 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:46.287 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.288 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:46.351 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:46.351 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 82 k 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:26:46.352 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:46.353 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 82 k 2024-04-12T13:26:46.353 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 372 k 2024-04-12T13:26:46.353 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:26:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:26:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:46.551 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:46.551 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T13:26:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:46.576 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm-17.2.7-845.g730340d7.el9.noarch.rpm 370 kB/s | 82 kB 00:00 2024-04-12T13:26:46.577 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:46.578 INFO:teuthology.orchestra.run.smithi060.stdout:Total 364 kB/s | 82 kB 00:00 2024-04-12T13:26:46.579 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:26:46.597 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:26:46.597 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:26:46.604 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:26:46.605 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:26:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:26:47.455 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:47.887 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:47.887 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:48.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr 2024-04-12T13:26:48.239 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:48.622 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/1 2024-04-12T13:26:48.623 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:48.623 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:26:48.623 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:48.623 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:48.623 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:48.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-immutable-object-cache 2024-04-12T13:26:49.100 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:16 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:49.395 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.396 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.397 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.398 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:49.399 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.400 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:49.401 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.402 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:49.403 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.404 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.404 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.404 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:49.404 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:26:49.463 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:49.464 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:26:49.464 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:49.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-dashboard 2024-04-12T13:26:49.827 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:18 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:50.141 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:50.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:50.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:50.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:50.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.149 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:50.150 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.150 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.150 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.150 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.213 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-845.g730340d7.el9 ceph 138 k 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:26:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:50.215 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 138 k 2024-04-12T13:26:50.215 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 379 k 2024-04-12T13:26:50.215 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:26:50.393 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:17 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:50.433 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-immutable-object-cache-17.2.7-845.g730340d 639 kB/s | 138 kB 00:00 2024-04-12T13:26:50.434 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:50.434 INFO:teuthology.orchestra.run.smithi060.stdout:Total 628 kB/s | 138 kB 00:00 2024-04-12T13:26:50.435 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:26:50.461 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:26:50.461 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:26:50.571 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:26:50.571 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:50.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:50.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:50.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.703 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:50.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.705 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.706 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:50.769 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:50.769 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 3.4 M 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 24 k 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 15 k 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T13:26:50.770 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout:Install 7 Packages 2024-04-12T13:26:50.771 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:50.772 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 3.7 M 2024-04-12T13:26:50.772 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 80 M 2024-04-12T13:26:50.772 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:50.784 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:26:50.858 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:50.939 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:50.939 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:26:50.939 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T13:26:50.939 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:51.117 INFO:teuthology.orchestra.run.smithi110.stdout:(1/7): ceph-prometheus-alerts-17.2.7-845.g73034 63 kB/s | 15 kB 00:00 2024-04-12T13:26:51.142 INFO:teuthology.orchestra.run.smithi110.stdout:(2/7): ceph-grafana-dashboards-17.2.7-845.g7303 94 kB/s | 24 kB 00:00 2024-04-12T13:26:51.393 INFO:teuthology.orchestra.run.smithi110.stdout:(3/7): ceph-mgr-dashboard-17.2.7-845.g730340d7. 6.6 MB/s | 3.4 MB 00:00 2024-04-12T13:26:51.660 INFO:teuthology.orchestra.run.smithi110.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 116 kB/s | 31 kB 00:00 2024-04-12T13:26:52.026 INFO:teuthology.orchestra.run.smithi110.stdout:(5/7): python3-routes-2.5.1-5.el9.noarch.rpm 515 kB/s | 188 kB 00:00 2024-04-12T13:26:52.410 INFO:teuthology.orchestra.run.smithi110.stdout:(6/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 7.0 kB/s | 9.0 kB 00:01 2024-04-12T13:26:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-845.g730340d7.e 1/1 2024-04-12T13:26:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:52.426 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:26:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:26:52.426 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:52.426 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:52.585 INFO:teuthology.orchestra.run.smithi110.stdout:(7/7): python3-jwt-2.4.0-1.el9.noarch.rpm 28 kB/s | 41 kB 00:01 2024-04-12T13:26:52.590 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:52.590 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.0 MB/s | 3.7 MB 00:01 2024-04-12T13:26:52.591 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:26:52.619 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:26:52.620 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:26:52.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr 2024-04-12T13:26:52.765 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:26:52.765 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:26:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:26:53.297 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-12T13:26:53.342 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-12T13:26:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-12T13:26:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-12T13:26:53.564 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.no 5/7 2024-04-12T13:26:53.671 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:22 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:53.983 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:53.983 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:53.983 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:53.983 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.983 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:53.984 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:53.985 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:53.986 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.987 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:53.988 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.988 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:53.988 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.988 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.989 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:53.990 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.991 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.992 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.993 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.993 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.993 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:53.994 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.995 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.995 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.995 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.995 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:53.995 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.996 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.997 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.998 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.998 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:53.998 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-mgr-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:26:54.056 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:54.057 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:26:54.057 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:26:54.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-dashboard 2024-04-12T13:26:54.844 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.n 6/7 2024-04-12T13:26:54.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 7/7 2024-04-12T13:26:55.028 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:24 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:26:55.332 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:26:55.333 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.334 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.335 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.336 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.337 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.338 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.339 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.340 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.341 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.342 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:55.343 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.343 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.343 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.343 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:55.409 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:26:55.410 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 3.4 M 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 24 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 15 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-12T13:26:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:Install 7 Packages 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.7 M 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 80 M 2024-04-12T13:26:55.412 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:26:55.861 INFO:teuthology.orchestra.run.smithi060.stdout:(1/7): ceph-grafana-dashboards-17.2.7-845.g7303 90 kB/s | 24 kB 00:00 2024-04-12T13:26:55.917 INFO:teuthology.orchestra.run.smithi060.stdout:(2/7): ceph-prometheus-alerts-17.2.7-845.g73034 45 kB/s | 15 kB 00:00 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 7/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.n 1/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 2/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.no 3/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-12T13:26:55.983 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-12T13:26:56.070 INFO:teuthology.orchestra.run.smithi060.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 44 kB/s | 9.0 kB 00:00 2024-04-12T13:26:56.128 INFO:teuthology.orchestra.run.smithi060.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 194 kB/s | 41 kB 00:00 2024-04-12T13:26:56.187 INFO:teuthology.orchestra.run.smithi060.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 265 kB/s | 31 kB 00:00 2024-04-12T13:26:56.287 INFO:teuthology.orchestra.run.smithi060.stdout:(6/7): ceph-mgr-dashboard-17.2.7-845.g730340d7. 4.8 MB/s | 3.4 MB 00:00 2024-04-12T13:26:56.320 INFO:teuthology.orchestra.run.smithi060.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 987 kB/s | 188 kB 00:00 2024-04-12T13:26:56.325 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:26:56.326 INFO:teuthology.orchestra.run.smithi060.stdout:Total 4.0 MB/s | 3.7 MB 00:00 2024-04-12T13:26:56.326 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:26:56.356 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:26:56.356 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:56.357 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:26:56.504 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:26:56.505 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:26:56.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-12T13:26:56.952 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:26:57.022 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-12T13:26:57.077 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-12T13:26:57.181 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-12T13:26:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-12T13:26:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.no 5/7 2024-04-12T13:26:57.548 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:24 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:26:57.869 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:26:57.870 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:26:57.871 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:26:57.872 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:26:57.873 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:26:57.874 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.875 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.876 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.877 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:26:57.945 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 7.4 M 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T13:26:57.946 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout:Install 12 Packages 2024-04-12T13:26:57.947 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:26:57.948 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 38 M 2024-04-12T13:26:57.948 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 209 M 2024-04-12T13:26:57.948 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:26:58.579 INFO:teuthology.orchestra.run.smithi110.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-12T13:26:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.n 6/7 2024-04-12T13:26:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 7/7 2024-04-12T13:26:58.629 INFO:teuthology.orchestra.run.smithi110.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-04-12T13:26:58.754 INFO:teuthology.orchestra.run.smithi110.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 190 kB/s | 33 kB 00:00 2024-04-12T13:26:58.813 INFO:teuthology.orchestra.run.smithi110.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 317 kB/s | 18 kB 00:00 2024-04-12T13:26:58.880 INFO:teuthology.orchestra.run.smithi110.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 35 kB 00:00 2024-04-12T13:26:59.130 INFO:teuthology.orchestra.run.smithi110.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.0 MB/s | 3.0 MB 00:00 2024-04-12T13:26:59.231 INFO:teuthology.orchestra.run.smithi110.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-04-12T13:26:59.348 INFO:teuthology.orchestra.run.smithi110.stdout:(8/12): ceph-mgr-diskprediction-local-17.2.7-84 7.7 MB/s | 7.4 MB 00:00 2024-04-12T13:26:59.540 INFO:teuthology.orchestra.run.smithi110.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-04-12T13:26:59.690 INFO:teuthology.orchestra.run.smithi110.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 737 kB/s | 250 kB 00:00 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 7/7 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.n 1/7 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 2/7 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.no 3/7 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-12T13:26:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-12T13:26:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-12T13:26:59.915 INFO:teuthology.orchestra.run.smithi110.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.6 MB/s | 4.7 MB 00:01 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T13:27:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T13:27:00.203 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:00.203 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:00.365 INFO:teuthology.orchestra.run.smithi110.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-12T13:27:00.367 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:00.368 INFO:teuthology.orchestra.run.smithi110.stdout:Total 16 MB/s | 38 MB 00:02 2024-04-12T13:27:00.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-12T13:27:01.006 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:01.084 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:01.085 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:01.479 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:30 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:01.682 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:01.683 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.794 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.795 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.796 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.798 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.799 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.800 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.801 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.802 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.803 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.803 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:01.873 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:01.874 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-04-12T13:27:01.875 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:27:01.875 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 7.4 M 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T13:27:01.876 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout:Install 12 Packages 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 38 M 2024-04-12T13:27:01.877 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 209 M 2024-04-12T13:27:01.878 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:02.605 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:02.678 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-12T13:27:02.785 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-12T13:27:02.845 INFO:teuthology.orchestra.run.smithi060.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 456 kB/s | 195 kB 00:00 2024-04-12T13:27:02.906 INFO:teuthology.orchestra.run.smithi060.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-04-12T13:27:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-12T13:27:03.000 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-12T13:27:03.030 INFO:teuthology.orchestra.run.smithi060.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 178 kB/s | 33 kB 00:00 2024-04-12T13:27:03.104 INFO:teuthology.orchestra.run.smithi060.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 249 kB/s | 18 kB 00:00 2024-04-12T13:27:03.230 INFO:teuthology.orchestra.run.smithi060.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 283 kB/s | 35 kB 00:00 2024-04-12T13:27:03.253 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-12T13:27:03.290 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-12T13:27:03.398 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-12T13:27:03.922 INFO:teuthology.orchestra.run.smithi060.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-04-12T13:27:04.032 INFO:teuthology.orchestra.run.smithi060.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-04-12T13:27:04.259 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-12T13:27:04.381 INFO:teuthology.orchestra.run.smithi060.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2024-04-12T13:27:04.401 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-12T13:27:04.514 INFO:teuthology.orchestra.run.smithi060.stdout:(9/12): ceph-mgr-diskprediction-local-17.2.7-84 3.5 MB/s | 7.4 MB 00:02 2024-04-12T13:27:04.548 INFO:teuthology.orchestra.run.smithi060.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.5 MB/s | 250 kB 00:00 2024-04-12T13:27:05.065 INFO:teuthology.orchestra.run.smithi060.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-04-12T13:27:05.949 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T13:27:07.102 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-12T13:27:07.131 INFO:teuthology.orchestra.run.smithi060.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-04-12T13:27:07.138 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:07.139 INFO:teuthology.orchestra.run.smithi060.stdout:Total 7.2 MB/s | 38 MB 00:05 2024-04-12T13:27:07.139 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 12/12 2024-04-12T13:27:07.789 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:07.872 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:07.872 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:08.498 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:08.499 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:09.440 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:09.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-12T13:27:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 12/12 2024-04-12T13:27:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 1/12 2024-04-12T13:27:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-12T13:27:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-12T13:27:09.708 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T13:27:09.709 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-12T13:27:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-12T13:27:09.915 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-12T13:27:09.958 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-12T13:27:10.200 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T13:27:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:10.215 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:10.230 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-12T13:27:10.340 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-12T13:27:10.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-rook 2024-04-12T13:27:11.199 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-12T13:27:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-12T13:27:11.548 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:38 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.845 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:11.846 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.847 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:11.847 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.847 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:11.847 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.847 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:11.848 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.848 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:11.848 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.848 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:11.848 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.849 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:11.849 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.849 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:11.849 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.849 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:11.850 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.850 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:11.850 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.850 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.851 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.852 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.853 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.854 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.855 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.856 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.857 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.858 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:11.858 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.858 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.858 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.859 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.859 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:11.859 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.859 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.859 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.860 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:11.917 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 47 k 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T13:27:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:11.919 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:11.920 INFO:teuthology.orchestra.run.smithi110.stdout:Install 13 Packages 2024-04-12T13:27:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:11.920 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.2 M 2024-04-12T13:27:11.920 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 26 M 2024-04-12T13:27:11.920 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:12.436 INFO:teuthology.orchestra.run.smithi110.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 171 kB/s | 26 kB 00:00 2024-04-12T13:27:12.461 INFO:teuthology.orchestra.run.smithi110.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 109 kB/s | 19 kB 00:00 2024-04-12T13:27:12.578 INFO:teuthology.orchestra.run.smithi110.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-04-12T13:27:12.604 INFO:teuthology.orchestra.run.smithi110.stdout:(4/13): ceph-mgr-rook-17.2.7-845.g730340d7.el9. 149 kB/s | 47 kB 00:00 2024-04-12T13:27:12.628 INFO:teuthology.orchestra.run.smithi110.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 970 kB/s | 159 kB 00:00 2024-04-12T13:27:12.654 INFO:teuthology.orchestra.run.smithi110.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-12T13:27:12.687 INFO:teuthology.orchestra.run.smithi110.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-04-12T13:27:12.986 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T13:27:13.188 INFO:teuthology.orchestra.run.smithi110.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 58 kB/s | 32 kB 00:00 2024-04-12T13:27:13.213 INFO:teuthology.orchestra.run.smithi110.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 27 kB/s | 15 kB 00:00 2024-04-12T13:27:13.531 INFO:teuthology.orchestra.run.smithi110.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 186 kB/s | 59 kB 00:00 2024-04-12T13:27:13.655 INFO:teuthology.orchestra.run.smithi110.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 210 kB/s | 203 kB 00:00 2024-04-12T13:27:13.748 INFO:teuthology.orchestra.run.smithi110.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 417 kB/s | 90 kB 00:00 2024-04-12T13:27:14.215 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-12T13:27:14.245 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 12/12 2024-04-12T13:27:14.731 INFO:teuthology.orchestra.run.smithi110.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 678 kB/s | 1.0 MB 00:01 2024-04-12T13:27:14.737 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:14.738 INFO:teuthology.orchestra.run.smithi110.stdout:Total 798 kB/s | 2.2 MB 00:02 2024-04-12T13:27:14.951 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:14.998 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:14.998 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:15.157 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:15.158 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:15.834 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:16.058 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-12T13:27:16.133 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-12T13:27:16.198 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-12T13:27:16.236 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-12T13:27:16.291 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-12T13:27:16.428 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-12T13:27:16.588 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-12T13:27:16.668 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-12T13:27:16.773 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 12/12 2024-04-12T13:27:16.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-845.g730340 1/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T13:27:16.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-12T13:27:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-12T13:27:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:17.477 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:17.478 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-12T13:27:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-12T13:27:17.700 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-12T13:27:17.763 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-12T13:27:17.785 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 13/13 2024-04-12T13:27:17.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-rook 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 13/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 1/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-12T13:27:18.705 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-12T13:27:18.706 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-12T13:27:18.706 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-12T13:27:18.829 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:47 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:19.139 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.140 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.141 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.142 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.143 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:19.144 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:19.145 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.146 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.147 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.148 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.149 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T13:27:19.178 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:19.179 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:19.215 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:19.216 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 47 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T13:27:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2024-04-12T13:27:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:19.219 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 2.2 M 2024-04-12T13:27:19.219 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 26 M 2024-04-12T13:27:19.219 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:19.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-cephadm 2024-04-12T13:27:19.663 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 152 kB/s | 26 kB 00:00 2024-04-12T13:27:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 99 kB/s | 19 kB 00:00 2024-04-12T13:27:19.930 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 922 kB/s | 222 kB 00:00 2024-04-12T13:27:19.955 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 597 kB/s | 159 kB 00:00 2024-04-12T13:27:19.980 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): ceph-mgr-rook-17.2.7-845.g730340d7.el9. 98 kB/s | 47 kB 00:00 2024-04-12T13:27:20.031 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 721 kB/s | 54 kB 00:00 2024-04-12T13:27:20.064 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.0 MB/s | 279 kB 00:00 2024-04-12T13:27:20.123 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 165 kB/s | 15 kB 00:00 2024-04-12T13:27:20.148 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 193 kB/s | 32 kB 00:00 2024-04-12T13:27:20.240 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.1 MB/s | 203 kB 00:00 2024-04-12T13:27:20.265 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 509 kB/s | 59 kB 00:00 2024-04-12T13:27:20.308 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-04-12T13:27:20.375 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.1 MB/s | 1.0 MB 00:00 2024-04-12T13:27:20.375 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:20.376 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.9 MB/s | 2.2 MB 00:01 2024-04-12T13:27:20.396 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:47 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:20.592 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:20.641 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:20.641 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:20.694 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:20.694 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:20.694 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:20.694 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.694 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:20.695 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.696 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:20.697 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.698 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:20.699 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.700 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.701 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.702 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:20.703 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.704 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:20.763 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:20.764 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:27:20.764 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 123 k 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout:Install 6 Packages 2024-04-12T13:27:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:20.766 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 7.0 M 2024-04-12T13:27:20.766 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 33 M 2024-04-12T13:27:20.766 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:20.810 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:20.811 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:21.636 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:21.758 INFO:teuthology.orchestra.run.smithi110.stdout:(1/6): ceph-mgr-cephadm-17.2.7-845.g730340d7.el 329 kB/s | 123 kB 00:00 2024-04-12T13:27:21.854 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-12T13:27:21.926 INFO:teuthology.orchestra.run.smithi110.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 458 kB/s | 248 kB 00:00 2024-04-12T13:27:21.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-12T13:27:22.001 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-12T13:27:22.046 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-12T13:27:22.090 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-12T13:27:22.118 INFO:teuthology.orchestra.run.smithi110.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.5 MB/s | 548 kB 00:00 2024-04-12T13:27:22.164 INFO:teuthology.orchestra.run.smithi110.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 243 kB/s | 58 kB 00:00 2024-04-12T13:27:22.218 INFO:teuthology.orchestra.run.smithi110.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 956 kB/s | 51 kB 00:00 2024-04-12T13:27:22.224 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-12T13:27:22.454 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-12T13:27:22.519 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-12T13:27:22.920 INFO:teuthology.orchestra.run.smithi110.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-04-12T13:27:22.927 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:22.928 INFO:teuthology.orchestra.run.smithi110.stdout:Total 3.2 MB/s | 7.0 MB 00:02 2024-04-12T13:27:23.057 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:23.096 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:23.096 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:23.255 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:23.256 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:23.493 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-12T13:27:23.552 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-12T13:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-12T13:27:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-12T13:27:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 13/13 2024-04-12T13:27:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:23.918 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-12T13:27:23.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-12T13:27:24.664 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-12T13:27:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 13/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 1/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-12T13:27:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-12T13:27:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-12T13:27:24.852 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-12T13:27:24.882 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 6/6 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T13:27:25.170 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:25.171 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:25.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-cephadm 2024-04-12T13:27:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 6/6 2024-04-12T13:27:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/6 2024-04-12T13:27:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-12T13:27:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-12T13:27:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-12T13:27:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T13:27:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T13:27:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T13:27:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T13:27:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T13:27:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:26.226 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:26.435 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:55 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:26.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-fuse 2024-04-12T13:27:26.747 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:26.747 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.748 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:26.749 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.750 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.751 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.752 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.753 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:26.754 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.755 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.756 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:26.826 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:17.2.7-845.g730340d7.el9 ceph-noarch 123 k 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:27:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2024-04-12T13:27:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:26.829 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 7.0 M 2024-04-12T13:27:26.829 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 33 M 2024-04-12T13:27:26.829 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:27.450 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:54 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:27.618 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 971 kB/s | 248 kB 00:00 2024-04-12T13:27:27.745 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:27.745 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:27.745 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:27.745 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.745 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.746 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.747 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:27.748 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.748 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:27.748 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.748 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:27.748 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:27.749 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.750 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.751 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:27.752 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.753 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.754 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.755 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.756 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:27.757 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.757 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.757 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.757 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:27.802 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): ceph-mgr-cephadm-17.2.7-845.g730340d7.el 281 kB/s | 123 kB 00:00 2024-04-12T13:27:27.815 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:27.817 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:27.817 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-12T13:27:27.817 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:27.817 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:17.2.7-845.g730340d7.el9 ceph 814 k 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:27.818 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:27.819 INFO:teuthology.orchestra.run.smithi110.stdout:Install 2 Packages 2024-04-12T13:27:27.819 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:27.819 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 894 k 2024-04-12T13:27:27.819 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 2.6 M 2024-04-12T13:27:27.819 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:28.271 INFO:teuthology.orchestra.run.smithi110.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 489 kB/s | 80 kB 00:00 2024-04-12T13:27:28.344 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 6.1 MB/s | 6.0 MB 00:00 2024-04-12T13:27:28.385 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 99 kB/s | 58 kB 00:00 2024-04-12T13:27:28.605 INFO:teuthology.orchestra.run.smithi110.stdout:(2/2): ceph-fuse-17.2.7-845.g730340d7.el9.x86_6 1.6 MB/s | 814 kB 00:00 2024-04-12T13:27:28.606 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:28.607 INFO:teuthology.orchestra.run.smithi110.stdout:Total 1.1 MB/s | 894 kB 00:00 2024-04-12T13:27:28.647 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:28.718 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:28.718 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:28.819 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:28.820 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:28.935 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 416 kB/s | 548 kB 00:01 2024-04-12T13:27:28.961 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 83 kB/s | 51 kB 00:00 2024-04-12T13:27:28.969 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:28.970 INFO:teuthology.orchestra.run.smithi060.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-04-12T13:27:29.098 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:29.099 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:29.138 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:29.138 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:29.304 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:29.305 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:29.314 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-12T13:27:29.397 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2/2 2024-04-12T13:27:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:29.996 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-12T13:27:30.061 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-12T13:27:30.340 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2/2 2024-04-12T13:27:30.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/2 2024-04-12T13:27:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-12T13:27:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-12T13:27:30.715 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:30.715 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:30.816 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-12T13:27:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-12T13:27:31.005 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-12T13:27:31.033 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 6/6 2024-04-12T13:27:31.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados-devel 2024-04-12T13:27:31.933 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 6/6 2024-04-12T13:27:31.934 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 1/6 2024-04-12T13:27:31.934 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-12T13:27:31.934 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-12T13:27:31.934 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-12T13:27:31.934 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-12T13:27:31.991 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:58 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:32.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:32.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.293 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.294 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.295 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.296 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.297 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.298 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.299 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.300 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:17.2.7-845.g730340d7.el9.noarch 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T13:27:32.357 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T13:27:32.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T13:27:32.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T13:27:32.358 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T13:27:32.358 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:32.358 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:32.361 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:17.2.7-845.g730340d7.el9 ceph 126 k 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:27:32.362 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 126 k 2024-04-12T13:27:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 448 k 2024-04-12T13:27:32.363 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:32.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-fuse 2024-04-12T13:27:32.749 INFO:teuthology.orchestra.run.smithi110.stdout:librados-devel-17.2.7-845.g730340d7.el9.x86_64. 327 kB/s | 126 kB 00:00 2024-04-12T13:27:32.750 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:32.751 INFO:teuthology.orchestra.run.smithi110.stdout:Total 324 kB/s | 126 kB 00:00 2024-04-12T13:27:32.752 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:32.770 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:32.771 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:32.881 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:32.882 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:33.077 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:33.207 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:33.608 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:02 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:33.752 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:33.920 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:33.920 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:33.920 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.921 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.922 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:33.923 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.924 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.925 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.926 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.927 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:33.928 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.929 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.930 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:33.996 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:17.2.7-845.g730340d7.el9 ceph 814 k 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-12T13:27:33.997 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout:Install 2 Packages 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:33.998 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 894 k 2024-04-12T13:27:33.999 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 2.6 M 2024-04-12T13:27:33.999 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:34.087 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:34.087 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:34.088 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:34.088 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:34.088 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:34.088 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:34.404 INFO:teuthology.orchestra.run.smithi060.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 285 kB/s | 80 kB 00:00 2024-04-12T13:27:34.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs2 2024-04-12T13:27:34.596 INFO:teuthology.orchestra.run.smithi060.stdout:(2/2): ceph-fuse-17.2.7-845.g730340d7.el9.x86_6 1.7 MB/s | 814 kB 00:00 2024-04-12T13:27:34.598 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:34.599 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.5 MB/s | 894 kB 00:00 2024-04-12T13:27:34.640 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:34.714 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:34.714 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:34.817 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:34.818 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:35.096 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:35.275 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-12T13:27:35.318 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:02 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:35.356 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2/2 2024-04-12T13:27:35.614 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:35.614 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.615 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.616 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:35.617 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:35.618 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:35.619 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:35.620 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.621 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:35.622 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:35.623 INFO:teuthology.orchestra.run.smithi110.stdout:Package libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:35.686 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:35.687 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:35.687 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:35.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs-devel 2024-04-12T13:27:36.300 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2/2 2024-04-12T13:27:36.300 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/2 2024-04-12T13:27:36.643 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:03 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:17.2.7-845.g730340d7.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:36.669 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:36.987 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:36.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:36.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:36.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:36.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:36.992 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.993 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.994 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.995 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:36.996 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:37.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados-devel 2024-04-12T13:27:37.057 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:17.2.7-845.g730340d7.el9 ceph 25 k 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:37.058 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 25 k 2024-04-12T13:27:37.059 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 110 k 2024-04-12T13:27:37.059 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:37.233 INFO:teuthology.orchestra.run.smithi110.stdout:libcephfs-devel-17.2.7-845.g730340d7.el9.x86_64 143 kB/s | 25 kB 00:00 2024-04-12T13:27:37.234 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:37.234 INFO:teuthology.orchestra.run.smithi110.stdout:Total 141 kB/s | 25 kB 00:00 2024-04-12T13:27:37.235 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:37.243 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:37.243 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:37.247 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:37.248 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:37.386 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:37.539 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:37.955 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:06 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:38.266 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.267 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.268 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.269 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:38.270 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.271 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.272 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.273 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.274 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.275 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:38.275 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.275 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.275 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.275 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:38.292 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:17.2.7-845.g730340d7.el9 ceph 126 k 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:38.343 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:38.344 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:27:38.344 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:38.344 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 126 k 2024-04-12T13:27:38.344 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 448 k 2024-04-12T13:27:38.344 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:38.502 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados2 2024-04-12T13:27:38.561 INFO:teuthology.orchestra.run.smithi060.stdout:librados-devel-17.2.7-845.g730340d7.el9.x86_64. 583 kB/s | 126 kB 00:00 2024-04-12T13:27:38.563 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:38.564 INFO:teuthology.orchestra.run.smithi060.stdout:Total 574 kB/s | 126 kB 00:00 2024-04-12T13:27:38.564 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:38.584 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:38.584 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:38.697 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:38.697 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:38.880 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:39.379 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:06 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:39.580 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:39.674 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.675 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.676 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.677 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:39.678 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.679 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.680 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.681 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:39.682 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:39.747 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:39.748 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:39.748 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:39.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librbd1 2024-04-12T13:27:39.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:39.941 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:39.941 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:39.941 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:39.942 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:39.942 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:40.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs2 2024-04-12T13:27:40.680 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:07 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:40.982 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:40.983 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:40.984 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.985 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.986 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.987 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.988 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.989 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.990 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.991 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:40.991 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:41.053 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:41.054 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:41.055 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:41.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rados 2024-04-12T13:27:41.214 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:10 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:41.526 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:41.526 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.527 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.528 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:41.529 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:41.530 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.531 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:41.532 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.533 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.534 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.535 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:41.536 INFO:teuthology.orchestra.run.smithi060.stdout:Package libcephfs2-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:41.601 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:41.602 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:41.602 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:41.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs-devel 2024-04-12T13:27:41.987 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:08 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:42.283 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:42.283 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.284 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:42.285 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:42.286 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:42.287 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:42.288 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.289 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.290 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.291 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.292 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:42.354 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:42.355 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:42.355 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:42.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rgw 2024-04-12T13:27:42.587 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:11 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:42.897 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:42.897 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:42.897 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:42.897 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.897 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:42.898 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.899 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:42.900 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.901 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.902 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.903 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.904 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.905 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.906 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.907 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:42.971 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:42.972 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-04-12T13:27:42.972 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:42.972 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:17.2.7-845.g730340d7.el9 ceph 25 k 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 25 k 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 110 k 2024-04-12T13:27:42.973 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:43.248 INFO:teuthology.orchestra.run.smithi060.stdout:libcephfs-devel-17.2.7-845.g730340d7.el9.x86_64 91 kB/s | 25 kB 00:00 2024-04-12T13:27:43.250 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:43.251 INFO:teuthology.orchestra.run.smithi060.stdout:Total 90 kB/s | 25 kB 00:00 2024-04-12T13:27:43.251 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:43.263 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:43.263 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:43.270 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:43.271 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:43.298 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:10 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:43.581 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:43.593 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:43.593 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:43.594 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.595 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:43.596 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:43.597 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.598 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.599 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:43.602 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:43.665 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:43.666 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:43.666 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:43.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-cephfs 2024-04-12T13:27:44.081 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:44.421 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:44.422 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:44.609 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:11 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:44.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados2 2024-04-12T13:27:44.910 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:44.911 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:44.912 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.913 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:44.914 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:44.915 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.916 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.917 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.918 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.919 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.920 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:44.920 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:44.979 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:44.980 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:44.981 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:45.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rbd 2024-04-12T13:27:45.574 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:14 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:45.886 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:45.887 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.889 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:45.889 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.889 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:45.889 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.890 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.891 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:45.892 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.893 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.894 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.895 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:45.896 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:45.924 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:12 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:45.961 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:45.962 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:45.963 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:46.039 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librbd1 2024-04-12T13:27:46.219 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:46.219 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:46.219 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:46.219 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.219 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.220 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.221 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.222 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.223 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:46.224 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:46.225 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.226 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:46.227 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.228 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:46.229 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:46.290 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:46.291 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-12T13:27:46.292 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:46.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-fuse 2024-04-12T13:27:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:15 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:14 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:47.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:47.226 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:47.227 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.228 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:47.229 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.230 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.231 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.232 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.233 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.234 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.234 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.234 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:47.300 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:47.301 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:47.301 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:47.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rados 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.513 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.514 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.515 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:47.516 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:47.517 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:47.518 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.519 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.520 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.521 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.522 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.522 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:47.598 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:47.598 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:17.2.7-845.g730340d7.el9 ceph 82 k 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 82 k 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 222 k 2024-04-12T13:27:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:47.803 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-fuse-17.2.7-845.g730340d7.el9.x86_64.rpm 403 kB/s | 82 kB 00:00 2024-04-12T13:27:47.804 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:47.805 INFO:teuthology.orchestra.run.smithi110.stdout:Total 397 kB/s | 82 kB 00:00 2024-04-12T13:27:47.806 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:47.828 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:47.828 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:47.930 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:47.931 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:48.106 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:48.222 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:48.249 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:17 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:48.560 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.561 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.562 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.563 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.564 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:48.565 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.566 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:48.567 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.568 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:48.569 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.569 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.569 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.569 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:48.569 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rados-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:48.636 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:48.637 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:48.637 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:48.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rgw 2024-04-12T13:27:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:49.083 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:49.414 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-mirror 2024-04-12T13:27:49.622 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:18 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:49.932 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:49.932 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:49.932 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.933 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.934 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.935 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.936 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.937 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.938 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.939 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.940 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:49.941 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rgw-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:50.009 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:50.010 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:50.010 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:50.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-cephfs 2024-04-12T13:27:50.299 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:17 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:50.600 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:50.601 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.602 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.603 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:50.604 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.605 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.606 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.607 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.608 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.609 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:50.609 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.609 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.609 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.609 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:50.673 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:50.674 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:50.674 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.9 M 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.9 M 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 12 M 2024-04-12T13:27:50.675 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:50.998 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:19 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:51.133 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-mirror-17.2.7-845.g730340d7.el9.x86_64.rpm 6.4 MB/s | 2.9 MB 00:00 2024-04-12T13:27:51.135 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:51.136 INFO:teuthology.orchestra.run.smithi110.stdout:Total 6.4 MB/s | 2.9 MB 00:00 2024-04-12T13:27:51.136 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:51.167 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:51.167 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:51.284 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:51.285 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.314 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.315 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:51.316 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:51.317 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:51.318 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.319 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.320 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.321 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.322 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.323 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:51.324 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-cephfs-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:51.388 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:51.390 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:51.390 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:51.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rbd 2024-04-12T13:27:51.851 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:51.909 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:51.984 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:51.984 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:27:51.984 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T13:27:51.984 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T13:27:51.984 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T13:27:51.985 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:52.391 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:21 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:52.702 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:52.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:52.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:52.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:52.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.712 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:52.712 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rbd-2:17.2.7-845.g730340d7.el9.x86_64 is already installed. 2024-04-12T13:27:52.778 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:52.779 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-12T13:27:52.779 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:52.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-fuse 2024-04-12T13:27:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:53.435 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:53.436 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:53.742 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:22 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:53.761 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-nbd 2024-04-12T13:27:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:54.058 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:54.059 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:54.060 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:54.061 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:54.062 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.063 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.064 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.065 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.066 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.067 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:54.067 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.067 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.067 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.067 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.133 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:17.2.7-845.g730340d7.el9 ceph 82 k 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:27:54.134 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:54.135 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 82 k 2024-04-12T13:27:54.135 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 222 k 2024-04-12T13:27:54.135 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:54.343 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-fuse-17.2.7-845.g730340d7.el9.x86_64.rpm 395 kB/s | 82 kB 00:00 2024-04-12T13:27:54.344 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:54.345 INFO:teuthology.orchestra.run.smithi060.stdout:Total 389 kB/s | 82 kB 00:00 2024-04-12T13:27:54.346 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:54.370 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:54.370 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:54.655 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:21 ago on Fri 12 Apr 2024 01:25:33 PM UTC. 2024-04-12T13:27:54.690 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:54.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr:Modular dependency problems: 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 1: conflicting requests 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 2: conflicting requests 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 3: conflicting requests 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 4: conflicting requests 2024-04-12T13:27:54.951 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 5: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 6: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 7: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 8: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 9: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 10: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 11: conflicting requests 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.952 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 12: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 13: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 14: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 15: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 16: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 17: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 18: conflicting requests 2024-04-12T13:27:54.953 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 19: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 20: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 21: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 22: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 23: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 24: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 25: conflicting requests 2024-04-12T13:27:54.954 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 26: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 27: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 28: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 29: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 30: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 31: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 32: conflicting requests 2024-04-12T13:27:54.955 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 33: conflicting requests 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 34: conflicting requests 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 35: conflicting requests 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 36: conflicting requests 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 37: conflicting requests 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:54.956 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 39: conflicting requests 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.957 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.958 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:54.959 INFO:teuthology.orchestra.run.smithi110.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:55.022 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:17.2.7-845.g730340d7.el9 ceph 165 k 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 165 k 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 477 k 2024-04-12T13:27:55.023 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-12T13:27:55.354 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-nbd-17.2.7-845.g730340d7.el9.x86_64.rpm 500 kB/s | 165 kB 00:00 2024-04-12T13:27:55.356 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:55.356 INFO:teuthology.orchestra.run.smithi110.stdout:Total 495 kB/s | 165 kB 00:00 2024-04-12T13:27:55.357 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-12T13:27:55.367 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:55.383 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-12T13:27:55.383 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-12T13:27:55.496 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-12T13:27:55.497 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-12T13:27:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:55.697 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:27:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:55.698 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:27:55.728 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-12T13:27:55.871 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:56.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-mirror 2024-04-12T13:27:56.463 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:56.829 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-12T13:27:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:27:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:27:56.830 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-12T13:27:56.903 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:25 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:27:57.194 DEBUG:teuthology.parallel:result is None 2024-04-12T13:27:57.216 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:27:57.216 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:27:57.217 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.218 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:27:57.219 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.220 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.221 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.222 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.223 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.224 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.225 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:27:57.295 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:17.2.7-845.g730340d7.el9 ceph 2.9 M 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:57.296 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 2.9 M 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 12 M 2024-04-12T13:27:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:27:57.939 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-mirror-17.2.7-845.g730340d7.el9.x86_64.rpm 4.6 MB/s | 2.9 MB 00:00 2024-04-12T13:27:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:27:57.940 INFO:teuthology.orchestra.run.smithi060.stdout:Total 4.6 MB/s | 2.9 MB 00:00 2024-04-12T13:27:57.941 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:27:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:27:57.954 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:27:58.043 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:27:58.044 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:27:58.536 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:27:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:27:58.681 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T13:27:58.681 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T13:27:58.681 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T13:27:58.682 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T13:27:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:00.112 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:28:00.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-nbd 2024-04-12T13:28:01.381 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:02:30 ago on Fri 12 Apr 2024 01:25:31 PM UTC. 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr:Modular dependency problems: 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 1: conflicting requests 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 2: conflicting requests 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.702 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 3: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 4: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 5: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 6: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 7: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 8: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 9: conflicting requests 2024-04-12T13:28:01.703 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 10: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 11: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 12: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 13: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 14: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 15: conflicting requests 2024-04-12T13:28:01.704 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 16: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 17: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 18: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 19: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 20: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 21: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 22: conflicting requests 2024-04-12T13:28:01.705 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 23: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 24: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 25: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 26: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 27: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 28: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 29: conflicting requests 2024-04-12T13:28:01.706 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 30: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 31: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 32: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 33: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 34: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 35: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 36: conflicting requests 2024-04-12T13:28:01.707 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 37: conflicting requests 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 39: conflicting requests 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.708 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T13:28:01.709 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.710 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.711 INFO:teuthology.orchestra.run.smithi060.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T13:28:01.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.711 INFO:teuthology.orchestra.run.smithi060.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T13:28:01.778 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-12T13:28:01.778 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:28:01.778 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:17.2.7-845.g730340d7.el9 ceph 165 k 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 165 k 2024-04-12T13:28:01.780 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 477 k 2024-04-12T13:28:01.780 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-12T13:28:02.142 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-nbd-17.2.7-845.g730340d7.el9.x86_64.rpm 456 kB/s | 165 kB 00:00 2024-04-12T13:28:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:28:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:Total 452 kB/s | 165 kB 00:00 2024-04-12T13:28:02.145 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-12T13:28:02.172 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-12T13:28:02.173 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-12T13:28:02.291 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-12T13:28:02.292 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-12T13:28:02.521 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-12T13:28:02.645 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:28:03.214 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:28:03.591 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 1/1 2024-04-12T13:28:03.592 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:03.592 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-12T13:28:03.592 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:17.2.7-845.g730340d7.el9.x86_64 2024-04-12T13:28:03.592 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:28:03.592 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-12T13:28:03.890 DEBUG:teuthology.parallel:result is None 2024-04-12T13:28:03.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:28:03.890 INFO:teuthology.packaging:ref: None 2024-04-12T13:28:03.890 INFO:teuthology.packaging:tag: None 2024-04-12T13:28:03.890 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:28:03.891 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:28:03.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-64502-quincy-2 2024-04-12T13:28:04.125 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T13:28:04.201 INFO:teuthology.orchestra.run.smithi060.stdout:17.2.7-845.g730340d7.el9 2024-04-12T13:28:04.202 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-845.g730340d7.el9 2024-04-12T13:28:04.202 INFO:teuthology.task.install:The correct ceph version 17.2.7-845.g730340d7 is installed. 2024-04-12T13:28:04.204 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T13:28:04.204 INFO:teuthology.packaging:ref: None 2024-04-12T13:28:04.204 INFO:teuthology.packaging:tag: None 2024-04-12T13:28:04.204 INFO:teuthology.packaging:branch: wip-64502-quincy-2 2024-04-12T13:28:04.204 INFO:teuthology.packaging:sha1: a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:28:04.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-64502-quincy-2 2024-04-12T13:28:04.354 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T13:28:04.429 INFO:teuthology.orchestra.run.smithi110.stdout:17.2.7-845.g730340d7.el9 2024-04-12T13:28:04.429 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-845.g730340d7.el9 2024-04-12T13:28:04.429 INFO:teuthology.task.install:The correct ceph version 17.2.7-845.g730340d7 is installed. 2024-04-12T13:28:04.431 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-12T13:28:04.432 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:28:04.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T13:28:04.539 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:28:04.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T13:28:04.642 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-12T13:28:04.643 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:28:04.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T13:28:04.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T13:28:04.843 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:28:04.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T13:28:04.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T13:28:05.030 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-12T13:28:05.030 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:28:05.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T13:28:05.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T13:28:05.282 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:28:05.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T13:28:05.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T13:28:05.513 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-12T13:28:05.513 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:28:05.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T13:28:05.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T13:28:05.702 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:28:05.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T13:28:05.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T13:28:05.883 INFO:teuthology.run_tasks:Running task print... 2024-04-12T13:28:05.893 INFO:teuthology.task.print:**** done install task... 2024-04-12T13:28:05.893 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-12T13:28:05.998 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a971fd5f5719038c70b817bafacd6d5400b1d888'} 2024-04-12T13:28:05.998 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 2024-04-12T13:28:05.999 INFO:tasks.cephadm:Cluster fsid is 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:28:05.999 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-12T13:28:05.999 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-12T13:28:05.999 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi060': '172.21.15.60', 'mon.smithi110': '172.21.15.110'} 2024-04-12T13:28:05.999 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-12T13:28:05.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-04-12T13:28:06.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-04-12T13:28:06.201 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-12T13:28:06.202 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.463 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 12 13:28 /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.463 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 12 13:28 /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.751 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.817 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-12T13:28:06.885 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 on all hosts... 2024-04-12T13:28:06.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 pull 2024-04-12T13:28:06.893 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 pull 2024-04-12T13:28:08.105 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2... 2024-04-12T13:28:08.113 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2... 2024-04-12T13:28:43.514 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-12T13:28:43.514 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)", 2024-04-12T13:28:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "036a68d499522cc84c04cb53b2823d10a17041c93d4e70f18349789fc6a06db8", 2024-04-12T13:28:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-04-12T13:28:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f" 2024-04-12T13:28:43.515 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-12T13:28:43.515 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)", 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "036a68d499522cc84c04cb53b2823d10a17041c93d4e70f18349789fc6a06db8", 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f" 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-12T13:28:50.599 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:28:50.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-04-12T13:28:50.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-04-12T13:28:50.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-04-12T13:28:50.914 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-04-12T13:28:51.009 INFO:tasks.cephadm:Writing seed config... 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-12T13:28:51.011 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-12T13:28:51.012 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-12T13:28:51.013 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-12T13:28:51.014 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-12T13:28:51.014 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-12T13:28:51.014 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:28:51.014 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-12T13:28:51.068 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7ed74db6-f8d0-11ee-bc8c-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-12T13:28:51.069 DEBUG:teuthology.orchestra.run.smithi060:mon.smithi060> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service 2024-04-12T13:28:51.118 INFO:tasks.cephadm:Bootstrapping... 2024-04-12T13:28:51.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 -v bootstrap --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.60 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-12T13:28:51.428 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-12T13:28:51.428 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2', '-v', 'bootstrap', '--fsid', '7ed74db6-f8d0-11ee-bc8c-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.60', '--skip-admin-label'] 2024-04-12T13:28:51.491 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T13:28:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-12T13:28:51.492 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying podman|docker is present... 2024-04-12T13:28:51.540 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T13:28:51.540 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying lvm2 is present... 2024-04-12T13:28:51.540 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying time synchronization is in place... 2024-04-12T13:28:51.555 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-12T13:28:51.555 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-12T13:28:51.572 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-12T13:28:51.572 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:28:51.592 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-04-12T13:28:51.614 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-04-12T13:28:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-04-12T13:28:51.615 INFO:teuthology.orchestra.run.smithi060.stdout:Repeating the final host check... 2024-04-12T13:28:51.676 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T13:28:51.676 INFO:teuthology.orchestra.run.smithi060.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-12T13:28:51.677 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl is present 2024-04-12T13:28:51.677 INFO:teuthology.orchestra.run.smithi060.stdout:lvcreate is present 2024-04-12T13:28:51.699 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-12T13:28:51.699 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-12T13:28:51.722 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-12T13:28:51.723 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:28:51.748 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-04-12T13:28:51.770 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-04-12T13:28:51.770 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-04-12T13:28:51.771 INFO:teuthology.orchestra.run.smithi060.stdout:Host looks OK 2024-04-12T13:28:51.771 INFO:teuthology.orchestra.run.smithi060.stdout:Cluster fsid: 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:28:51.772 INFO:teuthology.orchestra.run.smithi060.stdout:Acquiring lock 140712987141216 on /run/cephadm/7ed74db6-f8d0-11ee-bc8c-c7b262605968.lock 2024-04-12T13:28:51.772 INFO:teuthology.orchestra.run.smithi060.stdout:Lock 140712987141216 acquired on /run/cephadm/7ed74db6-f8d0-11ee-bc8c-c7b262605968.lock 2024-04-12T13:28:51.773 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 3300 ... 2024-04-12T13:28:51.775 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 6789 ... 2024-04-12T13:28:51.775 INFO:teuthology.orchestra.run.smithi060.stdout:Base mon IP(s) is [172.21.15.60:3300, 172.21.15.60:6789], mon addrv is [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-04-12T13:28:51.792 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.60 metric 100 2024-04-12T13:28:51.792 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.60 metric 100 2024-04-12T13:28:51.806 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-12T13:28:51.806 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-12T13:28:51.806 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-12T13:28:51.818 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-12T13:28:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-12T13:28:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-12T13:28:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-12T13:28:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1560/64 scope link noprefixroute 2024-04-12T13:28:51.819 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-12T13:28:51.822 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-04-12T13:28:51.822 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-04-12T13:28:51.822 INFO:teuthology.orchestra.run.smithi060.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-12T13:28:51.825 INFO:teuthology.orchestra.run.smithi060.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-12T13:28:51.828 INFO:teuthology.orchestra.run.smithi060.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2... 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 036a68d499522cc84c04cb53b2823d10a17041c93d4e70f18349789fc6a06db8 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2... 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Getting image source signatures 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:2c31b41c7527c5002d052edb18a7fc4d116e8a3cfde832359b66eb23f3f2ac97 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:9793b5b5582798bde394f4383d142e9f248a25e4ebfd72ee05ea9ec6251a877d 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying config sha256:036a68d499522cc84c04cb53b2823d10a17041c93d4e70f18349789fc6a06db8 2024-04-12T13:29:01.779 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-12T13:29:02.935 INFO:teuthology.orchestra.run.smithi060.stdout:ceph: stdout ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable) 2024-04-12T13:29:02.937 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph version: ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable) 2024-04-12T13:29:02.937 INFO:teuthology.orchestra.run.smithi060.stdout:Extracting ceph user uid/gid from container image... 2024-04-12T13:29:04.148 INFO:teuthology.orchestra.run.smithi060.stdout:stat: stdout 167 167 2024-04-12T13:29:04.148 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial keys... 2024-04-12T13:29:05.377 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQAgNxlmw5pvKRAAScKz9srZZoHLRj1QWP3AbQ== 2024-04-12T13:29:06.472 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQAhNxlm/oU8MxAAYTsp5M4N3aV5w2y+n/4e9Q== 2024-04-12T13:29:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQAiNxlmMIgFNRAASupw3fIE+CajfUZ4uxlSnw== 2024-04-12T13:29:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial monmap... 2024-04-12T13:29:08.668 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-12T13:29:08.668 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-12T13:29:08.668 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:08.668 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool for smithi060 [v2:172.21.15.60:3300,v1:172.21.15.60:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = octopus 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: set fsid to 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:29:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mon... 2024-04-12T13:29:09.859 INFO:teuthology.orchestra.run.smithi060.stdout:create mon.smithi060 on 2024-04-12T13:29:10.200 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-12T13:29:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-12T13:29:10.726 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target → /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target. 2024-04-12T13:29:10.726 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target → /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target. 2024-04-12T13:29:11.047 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060 2024-04-12T13:29:11.047 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service: Unit ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service not loaded. 2024-04-12T13:29:11.355 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target.wants/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service → /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@.service. 2024-04-12T13:29:12.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:11 smithi060 podman[28704]: 2024-04-12 13:29:11.765799295 +0000 UTC m=+0.133219124 container create 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-64502-quincy-2-730340d, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-04-12T13:29:12.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 podman[28704]: 2024-04-12 13:29:12.036542474 +0000 UTC m=+0.403962307 container init 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, RELEASE=wip-64502-quincy-2-730340d, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-12T13:29:12.162 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T13:29:12.163 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-04-12T13:29:12.180 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T13:29:12.180 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:29:12.180 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-04-12T13:29:12.180 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-04-12T13:29:12.181 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon to start... 2024-04-12T13:29:12.181 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon... 2024-04-12T13:29:12.333 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 podman[28704]: 2024-04-12 13:29:12.047592028 +0000 UTC m=+0.415011842 container start 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, ceph=True, RELEASE=wip-64502-quincy-2-730340d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-12T13:29:12.333 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 ceph-mon[28723]: mkfs 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:12.333 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 bash[28704]: 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb 2024-04-12T13:29:12.333 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 ceph-mon[28723]: mon.smithi060 is new leader, mons smithi060 in quorum (ranks 0) 2024-04-12T13:29:12.333 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:12 smithi060 systemd[1]: Started Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:29:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:13 smithi060 ceph-mon[28723]: mon.smithi060 is new leader, mons smithi060 in quorum (ranks 0) 2024-04-12T13:29:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:13 smithi060 ceph-mon[28723]: monmap e1: 1 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T13:29:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:13 smithi060 ceph-mon[28723]: fsmap 2024-04-12T13:29:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:13 smithi060 ceph-mon[28723]: osdmap e1: 0 total, 0 up, 0 in 2024-04-12T13:29:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:13 smithi060 ceph-mon[28723]: mgrmap e1: no daemons active 2024-04-12T13:29:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:14 smithi060 ceph-mon[28723]: from='client.? 172.21.15.60:0/3195196475' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-12T13:29:14.714 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout cluster: 2024-04-12T13:29:14.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout id: 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:14.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-12T13:29:14.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:14.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout services: 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi060 (age 2s) 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout data: 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pgs: 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.048+0000 7ff990e00700 1 Processor -- start 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.048+0000 7ff990e00700 1 -- start start 2024-04-12T13:29:14.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.049+0000 7ff990e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.049+0000 7ff990e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c079110 con 0x7ff98c078d00 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.050+0000 7ff989e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.050+0000 7ff989e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48300/0 (socket says 172.21.15.60:48300) 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.050+0000 7ff989e00700 1 -- 172.21.15.60:0/4132783673 learned_addr learned my addr 172.21.15.60:0/4132783673 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.050+0000 7ff989e00700 1 -- 172.21.15.60:0/4132783673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0777a0 con 0x7ff98c078d00 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.051+0000 7ff989e00700 1 --2- 172.21.15.60:0/4132783673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0098e0 tx=0x7ff97c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfcb36330da31d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.051+0000 7ff988a00700 1 -- 172.21.15.60:0/4132783673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c00b860 con 0x7ff98c078d00 2024-04-12T13:29:14.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.051+0000 7ff988a00700 1 -- 172.21.15.60:0/4132783673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00b9c0 con 0x7ff98c078d00 2024-04-12T13:29:14.723 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.051+0000 7ff988a00700 1 -- 172.21.15.60:0/4132783673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c00bc90 con 0x7ff98c078d00 2024-04-12T13:29:14.723 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 -- 172.21.15.60:0/4132783673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 msgr2=0x7ff98c077260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 --2- 172.21.15.60:0/4132783673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0098e0 tx=0x7ff97c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 -- 172.21.15.60:0/4132783673 shutdown_connections 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 --2- 172.21.15.60:0/4132783673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c077260 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 -- 172.21.15.60:0/4132783673 >> 172.21.15.60:0/4132783673 conn(0x7ff98c0fe050 msgr2=0x7ff98c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 -- 172.21.15.60:0/4132783673 shutdown_connections 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.052+0000 7ff990e00700 1 -- 172.21.15.60:0/4132783673 wait complete. 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.053+0000 7ff990e00700 1 Processor -- start 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.053+0000 7ff990e00700 1 -- start start 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.053+0000 7ff990e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.053+0000 7ff990e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1134f0 con 0x7ff98c078d00 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.054+0000 7ff989e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.054+0000 7ff989e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48316/0 (socket says 172.21.15.60:48316) 2024-04-12T13:29:14.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.054+0000 7ff989e00700 1 -- 172.21.15.60:0/3195196475 learned_addr learned my addr 172.21.15.60:0/3195196475 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.054+0000 7ff989e00700 1 -- 172.21.15.60:0/3195196475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0094f0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff989e00700 1 --2- 172.21.15.60:0/3195196475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009290 tx=0x7ff97c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c01c5c0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c01c740 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c1136f0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97c01ca50 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.055+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c114260 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.056+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff97c01cbb0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.056+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff97c01ac30 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.056+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c05f5f0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.060+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7ff97c01adf0 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.140+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff98c114d30 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.141+0000 7ff982000700 1 -- 172.21.15.60:0/3195196475 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7ff97c025440 con 0x7ff98c078d00 2024-04-12T13:29:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 msgr2=0x7ff98c112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 --2- 172.21.15.60:0/3195196475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009290 tx=0x7ff97c016000 comp rx=0 tx=0).stop 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 shutdown_connections 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 --2- 172.21.15.60:0/3195196475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff98c078d00 0x7ff98c112fb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 >> 172.21.15.60:0/3195196475 conn(0x7ff98c0fe050 msgr2=0x7ff98c109dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.142+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 shutdown_connections 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:14.143+0000 7ff990e00700 1 -- 172.21.15.60:0/3195196475 wait complete. 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:mon is available 2024-04-12T13:29:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:Assimilating anything we can from ceph.conf... 2024-04-12T13:29:15.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:15 smithi060 ceph-mon[28723]: from='client.? 172.21.15.60:0/1570148536' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-12T13:29:15.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:15 smithi060 ceph-mon[28723]: from='client.? 172.21.15.60:0/1570148536' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-12T13:29:16.120 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.332+0000 7f2325800700 1 Processor -- start 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.332+0000 7f2325800700 1 -- start start 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.332+0000 7f2325800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:16.121 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.333+0000 7f2325800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320103250 con 0x7f2320102900 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.333+0000 7f231ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.333+0000 7f231ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48326/0 (socket says 172.21.15.60:48326) 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.333+0000 7f231ea00700 1 -- 172.21.15.60:0/684123646 learned_addr learned my addr 172.21.15.60:0/684123646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.334+0000 7f231ea00700 1 -- 172.21.15.60:0/684123646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320103390 con 0x7f2320102900 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.334+0000 7f231ea00700 1 --2- 172.21.15.60:0/684123646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f23100098e0 tx=0x7f2310009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2daad3399effc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.334+0000 7f231d600700 1 -- 172.21.15.60:0/684123646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231000b860 con 0x7f2320102900 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.334+0000 7f231d600700 1 -- 172.21.15.60:0/684123646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000b9c0 con 0x7f2320102900 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.334+0000 7f231d600700 1 -- 172.21.15.60:0/684123646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231000bc90 con 0x7f2320102900 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.335+0000 7f2325800700 1 -- 172.21.15.60:0/684123646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 msgr2=0x7f2320102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.335+0000 7f2325800700 1 --2- 172.21.15.60:0/684123646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f23100098e0 tx=0x7f2310009250 comp rx=0 tx=0).stop 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.336+0000 7f2325800700 1 -- 172.21.15.60:0/684123646 shutdown_connections 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.336+0000 7f2325800700 1 --2- 172.21.15.60:0/684123646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320102d10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:16.122 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.336+0000 7f2325800700 1 -- 172.21.15.60:0/684123646 >> 172.21.15.60:0/684123646 conn(0x7f23200fe0a0 msgr2=0x7f23201004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.336+0000 7f2325800700 1 -- 172.21.15.60:0/684123646 shutdown_connections 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.336+0000 7f2325800700 1 -- 172.21.15.60:0/684123646 wait complete. 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.337+0000 7f2325800700 1 Processor -- start 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.337+0000 7f2325800700 1 -- start start 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.337+0000 7f2325800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.337+0000 7f2325800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320111380 con 0x7f2320102900 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.338+0000 7f231ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.338+0000 7f231ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48336/0 (socket says 172.21.15.60:48336) 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.338+0000 7f231ea00700 1 -- 172.21.15.60:0/1570148536 learned_addr learned my addr 172.21.15.60:0/1570148536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.338+0000 7f231ea00700 1 -- 172.21.15.60:0/1570148536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100094f0 con 0x7f2320102900 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.338+0000 7f231ea00700 1 --2- 172.21.15.60:0/1570148536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2310003080 tx=0x7f2310016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231001c5c0 con 0x7f2320102900 2024-04-12T13:29:16.123 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231001c720 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231001ca30 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320111580 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320111fb0 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f231001cc60 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.339+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f231001ac80 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.340+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232005f5f0 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.343+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f231001a450 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.420+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f232004bed0 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.431+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f231001ae90 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.431+0000 7f2316a00700 1 -- 172.21.15.60:0/1570148536 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f231001b4a0 con 0x7f2320102900 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.433+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 msgr2=0x7f2320110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.433+0000 7f2325800700 1 --2- 172.21.15.60:0/1570148536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2310003080 tx=0x7f2310016000 comp rx=0 tx=0).stop 2024-04-12T13:29:16.124 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.433+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 shutdown_connections 2024-04-12T13:29:16.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.433+0000 7f2325800700 1 --2- 172.21.15.60:0/1570148536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2320102900 0x7f2320110e40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:16.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.433+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 >> 172.21.15.60:0/1570148536 conn(0x7f23200fe0a0 msgr2=0x7f23201075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:16.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.434+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 shutdown_connections 2024-04-12T13:29:16.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:15.434+0000 7f2325800700 1 -- 172.21.15.60:0/1570148536 wait complete. 2024-04-12T13:29:16.125 INFO:teuthology.orchestra.run.smithi060.stdout:Generating new minimal ceph.conf... 2024-04-12T13:29:17.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:16 smithi060 ceph-mon[28723]: from='client.? 172.21.15.60:0/3563229643' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:29:17.557 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.730+0000 7f273f600700 1 Processor -- start 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.731+0000 7f273f600700 1 -- start start 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.731+0000 7f273f600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.731+0000 7f273f600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273807a110 con 0x7f2738079730 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.732+0000 7f273cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.732+0000 7f273cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48348/0 (socket says 172.21.15.60:48348) 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.732+0000 7f273cc00700 1 -- 172.21.15.60:0/4077750244 learned_addr learned my addr 172.21.15.60:0/4077750244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.732+0000 7f273cc00700 1 -- 172.21.15.60:0/4077750244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273807a250 con 0x7f2738079730 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.733+0000 7f273cc00700 1 --2- 172.21.15.60:0/4077750244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f272c0098e0 tx=0x7f272c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a979153df2ead45 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.733+0000 7f2737400700 1 -- 172.21.15.60:0/4077750244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272c00b860 con 0x7f2738079730 2024-04-12T13:29:17.558 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.733+0000 7f2737400700 1 -- 172.21.15.60:0/4077750244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f272c00be50 con 0x7f2738079730 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.733+0000 7f2737400700 1 -- 172.21.15.60:0/4077750244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272c010380 con 0x7f2738079730 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 -- 172.21.15.60:0/4077750244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 msgr2=0x7f2738079b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 --2- 172.21.15.60:0/4077750244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f272c0098e0 tx=0x7f272c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 -- 172.21.15.60:0/4077750244 shutdown_connections 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 --2- 172.21.15.60:0/4077750244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738079b40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 -- 172.21.15.60:0/4077750244 >> 172.21.15.60:0/4077750244 conn(0x7f2738078320 msgr2=0x7f2738078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 -- 172.21.15.60:0/4077750244 shutdown_connections 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.734+0000 7f273f600700 1 -- 172.21.15.60:0/4077750244 wait complete. 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.735+0000 7f273f600700 1 Processor -- start 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.735+0000 7f273f600700 1 -- start start 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.735+0000 7f273f600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:17.559 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.735+0000 7f273f600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381180d0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.736+0000 7f273cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.736+0000 7f273cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48360/0 (socket says 172.21.15.60:48360) 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.736+0000 7f273cc00700 1 -- 172.21.15.60:0/3563229643 learned_addr learned my addr 172.21.15.60:0/3563229643 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.736+0000 7f273cc00700 1 -- 172.21.15.60:0/3563229643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0094f0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.736+0000 7f273cc00700 1 --2- 172.21.15.60:0/3563229643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f272c00ba90 tx=0x7f272c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272c01a8a0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f272c01ae90 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27381182d0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272c019e80 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2738118e40 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f272c0184b0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.737+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f272c0237a0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.738+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273805f5f0 con 0x7f2738079730 2024-04-12T13:29:17.560 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.741+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f272c028060 con 0x7f2738079730 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.820+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f273807b440 con 0x7f2738079730 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.821+0000 7f2734c00700 1 -- 172.21.15.60:0/3563229643 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f272c01e070 con 0x7f2738079730 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 msgr2=0x7f2738117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 --2- 172.21.15.60:0/3563229643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f272c00ba90 tx=0x7f272c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 shutdown_connections 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 --2- 172.21.15.60:0/3563229643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738079730 0x7f2738117b90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 >> 172.21.15.60:0/3563229643 conn(0x7f2738078320 msgr2=0x7f2738102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 shutdown_connections 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:16.823+0000 7f273f600700 1 -- 172.21.15.60:0/3563229643 wait complete. 2024-04-12T13:29:17.561 INFO:teuthology.orchestra.run.smithi060.stdout:Restarting the monitor... 2024-04-12T13:29:17.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:17 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:29:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:18 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[28719]: 2024-04-12T13:29:18.099+0000 7f1c3e000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:29:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:18 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[28719]: 2024-04-12T13:29:18.099+0000 7f1c3e000700 -1 mon.smithi060@0(leader) e1 *** Got Signal Terminated *** 2024-04-12T13:29:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:18 smithi060 podman[28969]: 2024-04-12 13:29:18.326637417 +0000 UTC m=+0.345726435 container died 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-12T13:29:18.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:18 smithi060 podman[28969]: 2024-04-12 13:29:18.707443144 +0000 UTC m=+0.726532155 container cleanup 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-64502-quincy-2-730340d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5) 2024-04-12T13:29:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:18 smithi060 bash[28969]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060 2024-04-12T13:29:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:19 smithi060 podman[28983]: 2024-04-12 13:29:19.817452162 +0000 UTC m=+1.479159134 container remove 890fcbdb373f37b5b224152809904bd1ae8073351909e5780d102f7c82c892fb (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, io.buildah.version=1.33.5, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409) 2024-04-12T13:29:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service: Deactivated successfully. 2024-04-12T13:29:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 systemd[1]: Stopped Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:29:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service: Consumed 2.049s CPU time. 2024-04-12T13:29:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 systemd[1]: Starting Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:29:20.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 podman[29075]: 2024-04-12 13:29:20.701477615 +0000 UTC m=+0.128688811 container create a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:29:20.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 podman[29075]: 2024-04-12 13:29:20.608925334 +0000 UTC m=+0.036136506 image pull 036a68d499522cc84c04cb53b2823d10a17041c93d4e70f18349789fc6a06db8 quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 2024-04-12T13:29:20.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 podman[29075]: 2024-04-12 13:29:20.938427989 +0000 UTC m=+0.365639191 container init a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, CEPH_POINT_RELEASE=, RELEASE=wip-64502-quincy-2-730340d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-12T13:29:20.992 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 podman[29075]: 2024-04-12 13:29:20.948970834 +0000 UTC m=+0.376182013 container start a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-64502-quincy-2-730340d, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-12T13:29:21.084 INFO:teuthology.orchestra.run.smithi060.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable), process ceph-mon, pid 2 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: pidfile_write: ignore empty --pid-file 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: load: jerasure load: lrc 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: RocksDB version: 6.15.5 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Compile date Apr 12 2024 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: DB SUMMARY 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: DB Session ID: 9PKPXNHTQG4ARONPN765 2024-04-12T13:29:21.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: CURRENT file: CURRENT 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 1, files: 000008.sst 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000010.log size: 98592 ; 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.error_if_exists: 0 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.create_if_missing: 0 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.paranoid_checks: 1 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.env: 0x558cc96deb00 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.fs: Posix File System 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.info_log: 0x558d00453c00 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.statistics: (nil) 2024-04-12T13:29:21.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.use_fsync: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_log_file_size: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_fallocate: 1 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.use_direct_reads: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.db_log_dir: 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi060/store.db 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T13:29:21.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T13:29:21.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T13:29:21.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T13:29:21.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T13:29:21.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.write_buffer_manager: 0x558d011c8a20 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.unordered_write: 0 2024-04-12T13:29:21.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.row_cache: None 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.wal_filter: None 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.preserve_deletes: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.two_write_queues: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.atomic_flush: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T13:29:21.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.log_readahead_size: 0 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_background_jobs: 2 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_background_compactions: -1 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_subcompactions: 1 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T13:29:21.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.max_open_files: -1 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:20 smithi060 ceph-mon[29097]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_background_flushes: -1 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Compression algorithms supported: 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T13:29:21.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kZSTD supported: 0 2024-04-12T13:29:21.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kXpressCompression supported: 0 2024-04-12T13:29:21.374 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T13:29:21.374 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kZlibCompression supported: 1 2024-04-12T13:29:21.374 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kSnappyCompression supported: 1 2024-04-12T13:29:21.374 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kLZ4Compression supported: 1 2024-04-12T13:29:21.374 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: kBZip2Compression supported: 0 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000009 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.merge_operator: 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_filter: None 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558d004a8f58) 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T13:29:21.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_type: 0 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_index_type: 0 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_shortening: 1 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T13:29:21.376 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: hash_index_allow_collision: 1 2024-04-12T13:29:21.377 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: checksum: 1 2024-04-12T13:29:21.377 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: no_block_cache: 0 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache: 0x558d004db090 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_options: 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: capacity : 536870912 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_shard_bits : 4 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: strict_capacity_limit : 0 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_compressed: (nil) 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: persistent_cache: (nil) 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size: 4096 2024-04-12T13:29:21.378 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size_deviation: 10 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_restart_interval: 16 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_block_restart_interval: 1 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_block_size: 4096 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: partition_filters: 0 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: use_delta_encoding: 1 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: whole_key_filtering: 1 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: verify_compression: 0 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: format_version: 4 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_index_compression: 1 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_align: 0 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression: NoCompression 2024-04-12T13:29:21.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.num_levels: 7 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T13:29:21.380 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T13:29:21.381 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T13:29:21.381 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T13:29:21.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T13:29:21.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T13:29:21.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T13:29:21.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T13:29:21.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.arena_block_size: 4194304 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T13:29:21.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.table_properties_collectors: 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.inplace_update_support: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.bloom_locality: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.max_successive_merges: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.ttl: 2592000 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T13:29:21.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.enable_blob_files: false 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.min_blob_size: 0 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712928561002881, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712928561004833, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93699, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91783, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13606, "raw_average_key_size": 49, "raw_value_size": 84293, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712928561, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "d70d631a-4c68-4249-bd81-f0dff1013972", "db_session_id": "9PKPXNHTQG4ARONPN765"}} 2024-04-12T13:29:21.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712928561005638, "job": 1, "event": "recovery_finished"} 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi060/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x558d0046f180 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: DB pointer 0x558d00544000 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** DB Stats ** 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-12T13:29:21.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L0 2/0 93.30 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Sum 2/0 93.30 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T13:29:21.389 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative compaction: 0.00 GB write, 10.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval compaction: 0.00 GB write, 10.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L0 2/0 93.30 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Sum 2/0 93.30 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.1 0.00 0.00 1 0.001 0 0 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative compaction: 0.00 GB write, 10.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:29:21.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: starting mon.smithi060 rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???) e1 preinit fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).mds e1 new map 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).mds e1 print_map 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: e1 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: legacy client fscid: -1 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: No filesystems configured 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T13:29:21.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mon.smithi060 is new leader, mons smithi060 in quorum (ranks 0) 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: monmap e1: 1 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: fsmap 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: osdmap e1: 0 total, 0 up, 0 in 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 ceph-mon[29097]: mgrmap e1: no daemons active 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 bash[29075]: a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 2024-04-12T13:29:21.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:21 smithi060 systemd[1]: Started Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:29:22.462 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.660+0000 7f5cc0e00700 1 Processor -- start 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.661+0000 7f5cc0e00700 1 -- start start 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.661+0000 7f5cc0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.661+0000 7f5cc0e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc102180 con 0x7f5cbc101830 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.662+0000 7f5cb9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.663+0000 7f5cb9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46952/0 (socket says 172.21.15.60:46952) 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.663+0000 7f5cb9e00700 1 -- 172.21.15.60:0/4020365261 learned_addr learned my addr 172.21.15.60:0/4020365261 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.663+0000 7f5cb9e00700 1 -- 172.21.15.60:0/4020365261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc1022c0 con 0x7f5cbc101830 2024-04-12T13:29:22.465 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.664+0000 7f5cb9e00700 1 --2- 172.21.15.60:0/4020365261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0098e0 tx=0x7f5cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53472b3f7db55ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.664+0000 7f5cb8a00700 1 -- 172.21.15.60:0/4020365261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cac00b860 con 0x7f5cbc101830 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.664+0000 7f5cb8a00700 1 -- 172.21.15.60:0/4020365261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f5cac00be50 con 0x7f5cbc101830 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.664+0000 7f5cb8a00700 1 -- 172.21.15.60:0/4020365261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cac010380 con 0x7f5cbc101830 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 -- 172.21.15.60:0/4020365261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 msgr2=0x7f5cbc101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 --2- 172.21.15.60:0/4020365261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0098e0 tx=0x7f5cac009250 comp rx=0 tx=0).stop 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 -- 172.21.15.60:0/4020365261 shutdown_connections 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 --2- 172.21.15.60:0/4020365261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc101c40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 -- 172.21.15.60:0/4020365261 >> 172.21.15.60:0/4020365261 conn(0x7f5cbc0fcfd0 msgr2=0x7f5cbc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 -- 172.21.15.60:0/4020365261 shutdown_connections 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.665+0000 7f5cc0e00700 1 -- 172.21.15.60:0/4020365261 wait complete. 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.666+0000 7f5cc0e00700 1 Processor -- start 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.666+0000 7f5cc0e00700 1 -- start start 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.666+0000 7f5cc0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:22.466 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.666+0000 7f5cc0e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc113d30 con 0x7f5cbc101830 2024-04-12T13:29:22.467 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.667+0000 7f5cb9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:22.467 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.667+0000 7f5cb9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46960/0 (socket says 172.21.15.60:46960) 2024-04-12T13:29:22.467 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.667+0000 7f5cb9e00700 1 -- 172.21.15.60:0/3782693695 learned_addr learned my addr 172.21.15.60:0/3782693695 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:22.467 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.667+0000 7f5cb9e00700 1 -- 172.21.15.60:0/3782693695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0094f0 con 0x7f5cbc101830 2024-04-12T13:29:22.467 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.667+0000 7f5cb9e00700 1 --2- 172.21.15.60:0/3782693695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cac01a8a0 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f5cac01ae90 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc113f30 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc114aa0 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cac019e80 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5cac023510 con 0x7f5cbc101830 2024-04-12T13:29:22.469 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.668+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5cac02b6f0 con 0x7f5cbc101830 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.669+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc05f5f0 con 0x7f5cbc101830 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.674+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f5cac028060 con 0x7f5cbc101830 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.749+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f5cbc1035c0 con 0x7f5cbc101830 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.752+0000 7f5cb2000700 1 -- 172.21.15.60:0/3782693695 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5cac01e070 con 0x7f5cbc101830 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 msgr2=0x7f5cbc1137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 --2- 172.21.15.60:0/3782693695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000c00 tx=0x7f5cac009250 comp rx=0 tx=0).stop 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 shutdown_connections 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 --2- 172.21.15.60:0/3782693695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc101830 0x7f5cbc1137f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 >> 172.21.15.60:0/3782693695 conn(0x7f5cbc0fcfd0 msgr2=0x7f5cbc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 shutdown_connections 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:21.754+0000 7f5cc0e00700 1 -- 172.21.15.60:0/3782693695 wait complete. 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-12T13:29:22.470 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-12T13:29:22.471 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mgr... 2024-04-12T13:29:22.471 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 9283 ... 2024-04-12T13:29:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mgr.smithi060.bpzacg 2024-04-12T13:29:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mgr.smithi060.bpzacg.service: Unit ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mgr.smithi060.bpzacg.service not loaded. 2024-04-12T13:29:23.084 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968.target.wants/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mgr.smithi060.bpzacg.service → /etc/systemd/system/ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@.service. 2024-04-12T13:29:23.120 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:22 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3782693695' entity='client.admin' 2024-04-12T13:29:23.896 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T13:29:23.896 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-04-12T13:29:23.912 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T13:29:23.912 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:29:23.912 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-04-12T13:29:23.912 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-04-12T13:29:23.932 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T13:29:23.932 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr to start... 2024-04-12T13:29:23.949 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr... 2024-04-12T13:29:25.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:24 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3532408086' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "7ed74db6-f8d0-11ee-bc8c-c7b262605968", 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T13:29:25.582 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.583 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T13:29:25.584 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:25.584 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T13:29:25.584 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T13:29:25.584 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T13:29:25.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T13:29:25.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T13:29:25.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T13:29:25.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T13:29:25.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T13:29:25.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T13:29:12.121222+0000", 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.766+0000 7f0a79400700 1 Processor -- start 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.766+0000 7f0a79400700 1 -- start start 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.767+0000 7f0a79400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.767+0000 7f0a79400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74078040 con 0x7f0a74077c30 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.767+0000 7f0a73e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.767+0000 7f0a73e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46984/0 (socket says 172.21.15.60:46984) 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.767+0000 7f0a73e00700 1 -- 172.21.15.60:0/2392697469 learned_addr learned my addr 172.21.15.60:0/2392697469 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.768+0000 7f0a73e00700 1 -- 172.21.15.60:0/2392697469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740766b0 con 0x7f0a74077c30 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.768+0000 7f0a73e00700 1 --2- 172.21.15.60:0/2392697469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316cd350f99b524 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:25.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.768+0000 7f0a72a00700 1 -- 172.21.15.60:0/2392697469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a6400b860 con 0x7f0a74077c30 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a72a00700 1 -- 172.21.15.60:0/2392697469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f0a6400be50 con 0x7f0a74077c30 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a72a00700 1 -- 172.21.15.60:0/2392697469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a64010380 con 0x7f0a74077c30 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 -- 172.21.15.60:0/2392697469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 msgr2=0x7f0a74076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 --2- 172.21.15.60:0/2392697469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a64009250 comp rx=0 tx=0).stop 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 -- 172.21.15.60:0/2392697469 shutdown_connections 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 --2- 172.21.15.60:0/2392697469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74076170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 -- 172.21.15.60:0/2392697469 >> 172.21.15.60:0/2392697469 conn(0x7f0a740fde30 msgr2=0x7f0a74100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.769+0000 7f0a79400700 1 -- 172.21.15.60:0/2392697469 shutdown_connections 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.770+0000 7f0a79400700 1 -- 172.21.15.60:0/2392697469 wait complete. 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.770+0000 7f0a79400700 1 Processor -- start 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.770+0000 7f0a79400700 1 -- start start 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a79400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a79400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74113bb0 con 0x7f0a74077c30 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a73e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:25.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a73e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46998/0 (socket says 172.21.15.60:46998) 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a73e00700 1 -- 172.21.15.60:0/3532408086 learned_addr learned my addr 172.21.15.60:0/3532408086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.771+0000 7f0a73e00700 1 -- 172.21.15.60:0/3532408086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640094f0 con 0x7f0a74077c30 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a73e00700 1 --2- 172.21.15.60:0/3532408086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400ba90 tx=0x7f0a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a6401a8a0 con 0x7f0a74077c30 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f0a6401ae90 con 0x7f0a74077c30 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a64019e80 con 0x7f0a74077c30 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74113db0 con 0x7f0a74077c30 2024-04-12T13:29:25.597 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.772+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a74114920 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.773+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0a64018460 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.773+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0a640237a0 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.773+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7405f5f0 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.776+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f0a64028060 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.855+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0a74108950 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.856+0000 7f0a6be00700 1 -- 172.21.15.60:0/3532408086 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f0a6401e070 con 0x7f0a74077c30 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 msgr2=0x7f0a74113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 --2- 172.21.15.60:0/3532408086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400ba90 tx=0x7f0a64009250 comp rx=0 tx=0).stop 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 shutdown_connections 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 --2- 172.21.15.60:0/3532408086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a74077c30 0x7f0a74113670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 >> 172.21.15.60:0/3532408086 conn(0x7f0a740fde30 msgr2=0x7f0a740fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 shutdown_connections 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:24.858+0000 7f0a79400700 1 -- 172.21.15.60:0/3532408086 wait complete. 2024-04-12T13:29:25.598 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (1/15)... 2024-04-12T13:29:28.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:28 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/620118505' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T13:29:29.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:29.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "7ed74db6-f8d0-11ee-bc8c-c7b262605968", 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T13:29:12.121222+0000", 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:29.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.110+0000 7fdafcc00700 1 Processor -- start 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.110+0000 7fdafcc00700 1 -- start start 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.111+0000 7fdafcc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.111+0000 7fdafcc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8105660 con 0x7fdaf8104c80 2024-04-12T13:29:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.111+0000 7fdaf5e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.112+0000 7fdaf5e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47012/0 (socket says 172.21.15.60:47012) 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.112+0000 7fdaf5e00700 1 -- 172.21.15.60:0/1051526372 learned_addr learned my addr 172.21.15.60:0/1051526372 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.112+0000 7fdaf5e00700 1 -- 172.21.15.60:0/1051526372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf81057a0 con 0x7fdaf8104c80 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.112+0000 7fdaf5e00700 1 --2- 172.21.15.60:0/1051526372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098e0 tx=0x7fdae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adaf91400c167bd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdaf4a00700 1 -- 172.21.15.60:0/1051526372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae800b860 con 0x7fdaf8104c80 2024-04-12T13:29:29.010 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdaf4a00700 1 -- 172.21.15.60:0/1051526372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7fdae800be50 con 0x7fdaf8104c80 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdaf4a00700 1 -- 172.21.15.60:0/1051526372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae8010380 con 0x7fdaf8104c80 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdafcc00700 1 -- 172.21.15.60:0/1051526372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 msgr2=0x7fdaf8105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdafcc00700 1 --2- 172.21.15.60:0/1051526372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098e0 tx=0x7fdae8009250 comp rx=0 tx=0).stop 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdafcc00700 1 -- 172.21.15.60:0/1051526372 shutdown_connections 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdafcc00700 1 --2- 172.21.15.60:0/1051526372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8105090 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.113+0000 7fdafcc00700 1 -- 172.21.15.60:0/1051526372 >> 172.21.15.60:0/1051526372 conn(0x7fdaf8078560 msgr2=0x7fdaf8078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.114+0000 7fdafcc00700 1 -- 172.21.15.60:0/1051526372 shutdown_connections 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.114+0000 7fdafcc00700 1 -- 172.21.15.60:0/1051526372 wait complete. 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdafcc00700 1 Processor -- start 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdafcc00700 1 -- start start 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdafcc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdafcc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8113c80 con 0x7fdaf8104c80 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdaf5e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:29.011 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdaf5e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47026/0 (socket says 172.21.15.60:47026) 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.115+0000 7fdaf5e00700 1 -- 172.21.15.60:0/620118505 learned_addr learned my addr 172.21.15.60:0/620118505 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdaf5e00700 1 -- 172.21.15.60:0/620118505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80094f0 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdaf5e00700 1 --2- 172.21.15.60:0/620118505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae801a870 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7fdae801ae60 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf8113e80 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.116+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae80193c0 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.117+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf81149f0 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.117+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdae8019520 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.117+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdae802b7d0 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.118+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf805f5f0 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.120+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fdae8022770 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.201+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdaf8106940 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.202+0000 7fdaee000700 1 -- 172.21.15.60:0/620118505 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fdae8022400 con 0x7fdaf8104c80 2024-04-12T13:29:29.012 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.203+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 msgr2=0x7fdaf8113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.203+0000 7fdafcc00700 1 --2- 172.21.15.60:0/620118505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae8009250 comp rx=0 tx=0).stop 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.203+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 shutdown_connections 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.203+0000 7fdafcc00700 1 --2- 172.21.15.60:0/620118505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8104c80 0x7fdaf8113740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.203+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 >> 172.21.15.60:0/620118505 conn(0x7fdaf8078560 msgr2=0x7fdaf81023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.204+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 shutdown_connections 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:28.204+0000 7fdafcc00700 1 -- 172.21.15.60:0/620118505 wait complete. 2024-04-12T13:29:29.013 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (2/15)... 2024-04-12T13:29:32.028 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:31 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2999813362' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T13:29:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "7ed74db6-f8d0-11ee-bc8c-c7b262605968", 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T13:29:32.411 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T13:29:32.412 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T13:29:32.421 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T13:29:12.121222+0000", 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.596+0000 7fd6f6a00700 1 Processor -- start 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.596+0000 7fd6f6a00700 1 -- start start 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.596+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.596+0000 7fd6f6a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0077ff0 con 0x7fd6f0077be0 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.597+0000 7fd6efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.597+0000 7fd6efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46158/0 (socket says 172.21.15.60:46158) 2024-04-12T13:29:32.423 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.597+0000 7fd6efe00700 1 -- 172.21.15.60:0/2255126429 learned_addr learned my addr 172.21.15.60:0/2255126429 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.597+0000 7fd6efe00700 1 -- 172.21.15.60:0/2255126429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00766d0 con 0x7fd6f0077be0 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.598+0000 7fd6efe00700 1 --2- 172.21.15.60:0/2255126429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00098e0 tx=0x7fd6e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601242b69d6c570b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.598+0000 7fd6eea00700 1 -- 172.21.15.60:0/2255126429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e000b860 con 0x7fd6f0077be0 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.598+0000 7fd6eea00700 1 -- 172.21.15.60:0/2255126429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7fd6e000be50 con 0x7fd6f0077be0 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.598+0000 7fd6eea00700 1 -- 172.21.15.60:0/2255126429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e0010380 con 0x7fd6f0077be0 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2255126429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 msgr2=0x7fd6f0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 --2- 172.21.15.60:0/2255126429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00098e0 tx=0x7fd6e0009250 comp rx=0 tx=0).stop 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2255126429 shutdown_connections 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 --2- 172.21.15.60:0/2255126429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0076190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2255126429 >> 172.21.15.60:0/2255126429 conn(0x7fd6f00fe0a0 msgr2=0x7fd6f01004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2255126429 shutdown_connections 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.599+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2255126429 wait complete. 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.600+0000 7fd6f6a00700 1 Processor -- start 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.600+0000 7fd6f6a00700 1 -- start start 2024-04-12T13:29:32.424 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6f6a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0113da0 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46172/0 (socket says 172.21.15.60:46172) 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6efe00700 1 -- 172.21.15.60:0/2999813362 learned_addr learned my addr 172.21.15.60:0/2999813362 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.601+0000 7fd6efe00700 1 -- 172.21.15.60:0/2999813362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00094f0 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6efe00700 1 --2- 172.21.15.60:0/2999813362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0011cc0 tx=0x7fd6e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e0010750 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7fd6e0010d40 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e001ad50 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0113fa0 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0114b10 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.602+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd6e0025400 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.603+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd6e0019710 con 0x7fd6f0077be0 2024-04-12T13:29:32.425 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.604+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f005f5f0 con 0x7fd6f0077be0 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.606+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fd6e0020020 con 0x7fd6f0077be0 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.711+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd6f0108b40 con 0x7fd6f0077be0 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.712+0000 7fd6e7e00700 1 -- 172.21.15.60:0/2999813362 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7fd6e001a5d0 con 0x7fd6f0077be0 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 msgr2=0x7fd6f0113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 --2- 172.21.15.60:0/2999813362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0011cc0 tx=0x7fd6e0009250 comp rx=0 tx=0).stop 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 shutdown_connections 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 --2- 172.21.15.60:0/2999813362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f0077be0 0x7fd6f0113860 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 >> 172.21.15.60:0/2999813362 conn(0x7fd6f00fe0a0 msgr2=0x7fd6f00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 shutdown_connections 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:31.714+0000 7fd6f6a00700 1 -- 172.21.15.60:0/2999813362 wait complete. 2024-04-12T13:29:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (3/15)... 2024-04-12T13:29:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:29:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: mgrmap e2: smithi060.bpzacg(active, starting, since 0.00962169s) 2024-04-12T13:29:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:29:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:29:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:29:33.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:29:33.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:29:33.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:32 smithi060 ceph-mon[29097]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: from='mgr.14100 172.21.15.60:0/2065140883' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:33 smithi060 ceph-mon[29097]: mgrmap e3: smithi060.bpzacg(active, since 1.02093s) 2024-04-12T13:29:35.981 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:35 smithi060 ceph-mon[29097]: mgrmap e4: smithi060.bpzacg(active, since 2s) 2024-04-12T13:29:35.981 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:35 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/271904287' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "7ed74db6-f8d0-11ee-bc8c-c7b262605968", 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-04-12T13:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T13:29:36.001 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T13:29:36.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:36.003 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T13:29:12.121222+0000", 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.080+0000 7f3269600700 1 Processor -- start 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.080+0000 7f3269600700 1 -- start start 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.080+0000 7f3269600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.080+0000 7f3269600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326407d420 con 0x7f326407ca40 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.081+0000 7f3262a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.081+0000 7f3262a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46230/0 (socket says 172.21.15.60:46230) 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.081+0000 7f3262a00700 1 -- 172.21.15.60:0/4002489218 learned_addr learned my addr 172.21.15.60:0/4002489218 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.081+0000 7f3262a00700 1 -- 172.21.15.60:0/4002489218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326407d560 con 0x7f326407ca40 2024-04-12T13:29:36.004 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.081+0000 7f3262a00700 1 --2- 172.21.15.60:0/4002489218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32540098e0 tx=0x7f3254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9593da63e5bd789 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.082+0000 7f3261600700 1 -- 172.21.15.60:0/4002489218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325400b860 con 0x7f326407ca40 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.082+0000 7f3261600700 1 -- 172.21.15.60:0/4002489218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f325400be50 con 0x7f326407ca40 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.082+0000 7f3261600700 1 -- 172.21.15.60:0/4002489218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3254010380 con 0x7f326407ca40 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.082+0000 7f3269600700 1 -- 172.21.15.60:0/4002489218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 msgr2=0x7f326407ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.082+0000 7f3269600700 1 --2- 172.21.15.60:0/4002489218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32540098e0 tx=0x7f3254009250 comp rx=0 tx=0).stop 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.083+0000 7f3269600700 1 -- 172.21.15.60:0/4002489218 shutdown_connections 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.083+0000 7f3269600700 1 --2- 172.21.15.60:0/4002489218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f326407ce50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.083+0000 7f3269600700 1 -- 172.21.15.60:0/4002489218 >> 172.21.15.60:0/4002489218 conn(0x7f3264078350 msgr2=0x7f326407a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.083+0000 7f3269600700 1 -- 172.21.15.60:0/4002489218 shutdown_connections 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.083+0000 7f3269600700 1 -- 172.21.15.60:0/4002489218 wait complete. 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.084+0000 7f3269600700 1 Processor -- start 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.084+0000 7f3269600700 1 -- start start 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3269600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3269600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264118120 con 0x7f326407ca40 2024-04-12T13:29:36.005 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3262a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3262a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46240/0 (socket says 172.21.15.60:46240) 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3262a00700 1 -- 172.21.15.60:0/271904287 learned_addr learned my addr 172.21.15.60:0/271904287 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.085+0000 7f3262a00700 1 -- 172.21.15.60:0/271904287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540094f0 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f3262a00700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3254000c00 tx=0x7f3254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f325401a8a0 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f325401ae90 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3264118320 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3254019e70 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.086+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3264118e90 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.087+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f3254019730 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.087+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326405f5f0 con 0x7f326407ca40 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.088+0000 7f325aa00700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 0x7f3248038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:36.006 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.088+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3254049fe0 con 0x7f326407ca40 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.088+0000 7f3262000700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 0x7f3248038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.089+0000 7f3262000700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 0x7f3248038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3250009990 tx=0x7f3250006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.094+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3254021d30 con 0x7f326407ca40 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.389+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f326404bed0 con 0x7f326407ca40 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.390+0000 7f325aa00700 1 -- 172.21.15.60:0/271904287 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f325401e070 con 0x7f326407ca40 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.392+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 msgr2=0x7f3248038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.392+0000 7f3269600700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 0x7f3248038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3250009990 tx=0x7f3250006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.392+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 msgr2=0x7f3264117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.392+0000 7f3269600700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3254000c00 tx=0x7f3254009250 comp rx=0 tx=0).stop 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 shutdown_connections 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3248036850 0x7f3248038d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 --2- 172.21.15.60:0/271904287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f326407ca40 0x7f3264117be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 >> 172.21.15.60:0/271904287 conn(0x7f3264078350 msgr2=0x7f3264079dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 shutdown_connections 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:35.393+0000 7f3269600700 1 -- 172.21.15.60:0/271904287 wait complete. 2024-04-12T13:29:36.007 INFO:teuthology.orchestra.run.smithi060.stdout:mgr is available 2024-04-12T13:29:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:36 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1377102440' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-12T13:29:37.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:37.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-04-12T13:29:37.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:37.593 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-12T13:29:37.594 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.604+0000 7f3060c00700 1 Processor -- start 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.604+0000 7f3060c00700 1 -- start start 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.605+0000 7f3060c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.605+0000 7f3060c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c105600 con 0x7f305c104c20 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.605+0000 7f3059e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.605+0000 7f3059e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46254/0 (socket says 172.21.15.60:46254) 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.605+0000 7f3059e00700 1 -- 172.21.15.60:0/535758659 learned_addr learned my addr 172.21.15.60:0/535758659 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.606+0000 7f3059e00700 1 -- 172.21.15.60:0/535758659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c105740 con 0x7f305c104c20 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.606+0000 7f3059e00700 1 --2- 172.21.15.60:0/535758659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f304c0098e0 tx=0x7f304c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ee2bd27547ba59 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.606+0000 7f3058a00700 1 -- 172.21.15.60:0/535758659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304c00b860 con 0x7f305c104c20 2024-04-12T13:29:37.595 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.606+0000 7f3058a00700 1 -- 172.21.15.60:0/535758659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f304c00be50 con 0x7f305c104c20 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.606+0000 7f3058a00700 1 -- 172.21.15.60:0/535758659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304c010380 con 0x7f305c104c20 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 -- 172.21.15.60:0/535758659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 msgr2=0x7f305c105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 --2- 172.21.15.60:0/535758659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f304c0098e0 tx=0x7f304c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 -- 172.21.15.60:0/535758659 shutdown_connections 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 --2- 172.21.15.60:0/535758659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c105030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 -- 172.21.15.60:0/535758659 >> 172.21.15.60:0/535758659 conn(0x7f305c078350 msgr2=0x7f305c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 -- 172.21.15.60:0/535758659 shutdown_connections 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.607+0000 7f3060c00700 1 -- 172.21.15.60:0/535758659 wait complete. 2024-04-12T13:29:37.596 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.608+0000 7f3060c00700 1 Processor -- start 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.608+0000 7f3060c00700 1 -- start start 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.608+0000 7f3060c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.609+0000 7f3060c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c113d30 con 0x7f305c104c20 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.609+0000 7f3059e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.609+0000 7f3059e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46264/0 (socket says 172.21.15.60:46264) 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.609+0000 7f3059e00700 1 -- 172.21.15.60:0/1377102440 learned_addr learned my addr 172.21.15.60:0/1377102440 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.609+0000 7f3059e00700 1 -- 172.21.15.60:0/1377102440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0094f0 con 0x7f305c104c20 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3059e00700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f304c000c00 tx=0x7f304c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:37.600 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304c01a8a0 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f304c01ae90 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304c019e70 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c113f30 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.610+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c114aa0 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.611+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f304c019730 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.611+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c05f5f0 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.612+0000 7f3052000700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 0x7f3040038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.612+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f304c04a020 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.612+0000 7f3059400700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 0x7f3040038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.612+0000 7f3059400700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 0x7f3040038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3048009990 tx=0x7f3048006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.617+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f304c021d30 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.836+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f305c04bed0 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.838+0000 7f3052000700 1 -- 172.21.15.60:0/1377102440 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f304c01e070 con 0x7f305c104c20 2024-04-12T13:29:37.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.841+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 msgr2=0x7f3040038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.841+0000 7f3060c00700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 0x7f3040038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3048009990 tx=0x7f3048006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.841+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 msgr2=0x7f305c1137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.841+0000 7f3060c00700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f304c000c00 tx=0x7f304c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 shutdown_connections 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f3040036850 0x7f3040038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 --2- 172.21.15.60:0/1377102440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f305c104c20 0x7f305c1137f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:37.602 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 >> 172.21.15.60:0/1377102440 conn(0x7f305c078350 msgr2=0x7f305c102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:37.603 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 shutdown_connections 2024-04-12T13:29:37.603 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:36.842+0000 7f3060c00700 1 -- 172.21.15.60:0/1377102440 wait complete. 2024-04-12T13:29:37.603 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling cephadm module... 2024-04-12T13:29:38.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:38 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3583588197' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.195+0000 7f0772c00700 1 Processor -- start 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.196+0000 7f0772c00700 1 -- start start 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.196+0000 7f0772c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.196+0000 7f0772c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c07d420 con 0x7f076c07ca40 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.197+0000 7f076be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.197+0000 7f076be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46276/0 (socket says 172.21.15.60:46276) 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.197+0000 7f076be00700 1 -- 172.21.15.60:0/1568701877 learned_addr learned my addr 172.21.15.60:0/1568701877 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:39.281 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.197+0000 7f076be00700 1 -- 172.21.15.60:0/1568701877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c07d560 con 0x7f076c07ca40 2024-04-12T13:29:39.286 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.197+0000 7f076be00700 1 --2- 172.21.15.60:0/1568701877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f075c0098e0 tx=0x7f075c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa44c8a5ea91add4 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:39.286 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f076aa00700 1 -- 172.21.15.60:0/1568701877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075c00b860 con 0x7f076c07ca40 2024-04-12T13:29:39.286 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f076aa00700 1 -- 172.21.15.60:0/1568701877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f075c00be50 con 0x7f076c07ca40 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f076aa00700 1 -- 172.21.15.60:0/1568701877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075c010380 con 0x7f076c07ca40 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f0772c00700 1 -- 172.21.15.60:0/1568701877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 msgr2=0x7f076c07ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f0772c00700 1 --2- 172.21.15.60:0/1568701877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f075c0098e0 tx=0x7f075c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f0772c00700 1 -- 172.21.15.60:0/1568701877 shutdown_connections 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f0772c00700 1 --2- 172.21.15.60:0/1568701877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c07ce50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.198+0000 7f0772c00700 1 -- 172.21.15.60:0/1568701877 >> 172.21.15.60:0/1568701877 conn(0x7f076c078350 msgr2=0x7f076c07a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.199+0000 7f0772c00700 1 -- 172.21.15.60:0/1568701877 shutdown_connections 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.199+0000 7f0772c00700 1 -- 172.21.15.60:0/1568701877 wait complete. 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.199+0000 7f0772c00700 1 Processor -- start 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f0772c00700 1 -- start start 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f0772c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f0772c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c118120 con 0x7f076c07ca40 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f076be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f076be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46286/0 (socket says 172.21.15.60:46286) 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f076be00700 1 -- 172.21.15.60:0/3583588197 learned_addr learned my addr 172.21.15.60:0/3583588197 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.200+0000 7f076be00700 1 -- 172.21.15.60:0/3583588197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0094f0 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f076be00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f075c000c00 tx=0x7f075c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075c01a8a0 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f075c01ae90 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c118320 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075c019e90 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.201+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c118e90 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.202+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f075c019750 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.202+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c05f5f0 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.203+0000 7f0763e00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 0x7f0750038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.203+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f075c049fe0 con 0x7f076c07ca40 2024-04-12T13:29:39.288 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.203+0000 7f076b400700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 0x7f0750038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.204+0000 7f076b400700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 0x7f0750038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0758009990 tx=0x7f0758006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.208+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f075c022b60 con 0x7f076c07ca40 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.481+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f076c04bed0 con 0x7f076c07ca40 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.537+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f075c01fd40 con 0x7f076c07ca40 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.539+0000 7f0763e00700 1 -- 172.21.15.60:0/3583588197 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f075c04e4c0 con 0x7f076c07ca40 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.542+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 msgr2=0x7f0750038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.542+0000 7f0772c00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 0x7f0750038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0758009990 tx=0x7f0758006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.542+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 msgr2=0x7f076c117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.542+0000 7f0772c00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f075c000c00 tx=0x7f075c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 shutdown_connections 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f0750036850 0x7f0750038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 --2- 172.21.15.60:0/3583588197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f076c07ca40 0x7f076c117be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 >> 172.21.15.60:0/3583588197 conn(0x7f076c078350 msgr2=0x7f076c079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 shutdown_connections 2024-04-12T13:29:39.289 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:38.543+0000 7f0772c00700 1 -- 172.21.15.60:0/3583588197 wait complete. 2024-04-12T13:29:39.822 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:39 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3583588197' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-12T13:29:39.822 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:39 smithi060 ceph-mon[29097]: mgrmap e5: smithi060.bpzacg(active, since 5s) 2024-04-12T13:29:40.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:40 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1374227236' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "smithi060.bpzacg", 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.880+0000 7f89e3e00700 1 Processor -- start 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.880+0000 7f89e3e00700 1 -- start start 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.881+0000 7f89e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.881+0000 7f89e3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41030b0 con 0x7f89e4071360 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.881+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.881+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53324/0 (socket says 172.21.15.60:53324) 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.881+0000 7f89e2a00700 1 -- 172.21.15.60:0/4238566205 learned_addr learned my addr 172.21.15.60:0/4238566205 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.882+0000 7f89e2a00700 1 -- 172.21.15.60:0/4238566205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4107c00 con 0x7f89e4071360 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.882+0000 7f89e2a00700 1 --2- 172.21.15.60:0/4238566205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89d40098e0 tx=0x7f89d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ef9e74b7607b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.883+0000 7f89e1600700 1 -- 172.21.15.60:0/4238566205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d400b860 con 0x7f89e4071360 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.883+0000 7f89e1600700 1 -- 172.21.15.60:0/4238566205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f89d400be50 con 0x7f89e4071360 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.883+0000 7f89e1600700 1 -- 172.21.15.60:0/4238566205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d4010380 con 0x7f89e4071360 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.883+0000 7f89e3e00700 1 -- 172.21.15.60:0/4238566205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 msgr2=0x7f89e41076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.883+0000 7f89e3e00700 1 --2- 172.21.15.60:0/4238566205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89d40098e0 tx=0x7f89d4009250 comp rx=0 tx=0).stop 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.884+0000 7f89e3e00700 1 -- 172.21.15.60:0/4238566205 shutdown_connections 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.884+0000 7f89e3e00700 1 --2- 172.21.15.60:0/4238566205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41076c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.884+0000 7f89e3e00700 1 -- 172.21.15.60:0/4238566205 >> 172.21.15.60:0/4238566205 conn(0x7f89e40fcd30 msgr2=0x7f89e40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.884+0000 7f89e3e00700 1 -- 172.21.15.60:0/4238566205 shutdown_connections 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.884+0000 7f89e3e00700 1 -- 172.21.15.60:0/4238566205 wait complete. 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e3e00700 1 Processor -- start 2024-04-12T13:29:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e3e00700 1 -- start start 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4113bf0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53334/0 (socket says 172.21.15.60:53334) 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.885+0000 7f89e2a00700 1 -- 172.21.15.60:0/1374227236 learned_addr learned my addr 172.21.15.60:0/1374227236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89e2a00700 1 -- 172.21.15.60:0/1374227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40094f0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89e2a00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89d4006fd0 tx=0x7f89d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d401a7d0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f89d401adc0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e4113df0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.886+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d4019ea0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.887+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e4114960 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f89d40213f0 con 0x7f89e4071360 2024-04-12T13:29:41.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e405f5f0 con 0x7f89e4071360 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89daa00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 0x7f89c8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f89d404a050 con 0x7f89e4071360 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89e2000700 1 -- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 msgr2=0x7f89c8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.888+0000 7f89e2000700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 0x7f89c8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:39.893+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f89d4010d50 con 0x7f89e4071360 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.089+0000 7f89e2000700 1 -- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 msgr2=0x7f89c8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.089+0000 7f89e2000700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 0x7f89c8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.165+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f89e4114d00 con 0x7f89e4071360 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.166+0000 7f89daa00700 1 -- 172.21.15.60:0/1374227236 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f89d4010b70 con 0x7f89e4071360 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 msgr2=0x7f89c8038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 0x7f89c8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 msgr2=0x7f89e41136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:41.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89d4006fd0 tx=0x7f89d4009250 comp rx=0 tx=0).stop 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 shutdown_connections 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7f89c80368a0 0x7f89c8038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 --2- 172.21.15.60:0/1374227236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89e4071360 0x7f89e41136b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 >> 172.21.15.60:0/1374227236 conn(0x7f89e40fcd30 msgr2=0x7f89e40fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 shutdown_connections 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:40.169+0000 7f89e3e00700 1 -- 172.21.15.60:0/1374227236 wait complete. 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-04-12T13:29:41.200 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 5... 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: Active manager daemon smithi060.bpzacg restarted 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: osdmap e2: 0 total, 0 up, 0 in 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: mgrmap e6: smithi060.bpzacg(active, starting, since 0.00896983s) 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:29:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:47.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:47 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:48.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: Found migration_current of "None". Setting to last migration. 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:29:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:48 smithi060 ceph-mon[29097]: mgrmap e7: smithi060.bpzacg(active, since 1.01604s) 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.761+0000 7ff103e00700 1 Processor -- start 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.762+0000 7ff103e00700 1 -- start start 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.762+0000 7ff103e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.762+0000 7ff103e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040766b0 con 0x7ff104077d30 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.762+0000 7ff102a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.763+0000 7ff102a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53340/0 (socket says 172.21.15.60:53340) 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.763+0000 7ff102a00700 1 -- 172.21.15.60:0/2588995994 learned_addr learned my addr 172.21.15.60:0/2588995994 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:49.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.763+0000 7ff102a00700 1 -- 172.21.15.60:0/2588995994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040767f0 con 0x7ff104077d30 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.763+0000 7ff102a00700 1 --2- 172.21.15.60:0/2588995994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098e0 tx=0x7ff0f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d35ab84c8610da server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.764+0000 7ff101600700 1 -- 172.21.15.60:0/2588995994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0f400b8f0 con 0x7ff104077d30 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.764+0000 7ff101600700 1 -- 172.21.15.60:0/2588995994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7ff0f4011420 con 0x7ff104077d30 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.764+0000 7ff101600700 1 -- 172.21.15.60:0/2588995994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0f4010540 con 0x7ff104077d30 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.764+0000 7ff103e00700 1 -- 172.21.15.60:0/2588995994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 msgr2=0x7ff104076170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.764+0000 7ff103e00700 1 --2- 172.21.15.60:0/2588995994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098e0 tx=0x7ff0f4009250 comp rx=0 tx=0).stop 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.765+0000 7ff103e00700 1 -- 172.21.15.60:0/2588995994 shutdown_connections 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.765+0000 7ff103e00700 1 --2- 172.21.15.60:0/2588995994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff104076170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.765+0000 7ff103e00700 1 -- 172.21.15.60:0/2588995994 >> 172.21.15.60:0/2588995994 conn(0x7ff1040fde90 msgr2=0x7ff1041002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:49.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.765+0000 7ff103e00700 1 -- 172.21.15.60:0/2588995994 shutdown_connections 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.765+0000 7ff103e00700 1 -- 172.21.15.60:0/2588995994 wait complete. 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff103e00700 1 Processor -- start 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff103e00700 1 -- start start 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff103e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff103e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff104113bf0 con 0x7ff104077d30 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff102a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff102a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53348/0 (socket says 172.21.15.60:53348) 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.766+0000 7ff102a00700 1 -- 172.21.15.60:0/861315431 learned_addr learned my addr 172.21.15.60:0/861315431 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.767+0000 7ff102a00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40094f0 con 0x7ff104077d30 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.767+0000 7ff102a00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400bb00 tx=0x7ff0f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.767+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0f400bec0 con 0x7ff104077d30 2024-04-12T13:29:49.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.767+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7ff0f4010e10 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.767+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0f401ae50 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.768+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff104113df0 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.768+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff104114960 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff0f4010980 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff0faa00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0e8039410 con 0x7ff0e8036850 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff0f404aaf0 con 0x7ff104077d30 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff102000700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.769+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.970+0000 7ff102000700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:41.970+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:42.371+0000 7ff102000700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:42.371+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T13:29:49.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:43.172+0000 7ff102000700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:43.172+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:44.774+0000 7ff102000700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/3232156266 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:44.774+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:47.334+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7ff0f402c960 con 0x7ff104077d30 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:47.335+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 msgr2=0x7ff0e8038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:47.335+0000 7ff0faa00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.339+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7ff0f404c2d0 con 0x7ff104077d30 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.339+0000 7ff0faa00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 0x7ff0e803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.339+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0e8039410 con 0x7ff0e8039ff0 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.341+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 0x7ff0e803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.344+0000 7ff102000700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 0x7ff0e803c3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00039d0 tx=0x7ff0f0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.347+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7ff0e8039410 con 0x7ff0e8039ff0 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.354+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff104114280 con 0x7ff0e8039ff0 2024-04-12T13:29:49.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.355+0000 7ff0faa00700 1 -- 172.21.15.60:0/861315431 <== mgr.14120 v2:172.21.15.60:6800/1558416897 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff104114280 con 0x7ff0e8039ff0 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 msgr2=0x7ff0e803c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 0x7ff0e803c3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00039d0 tx=0x7ff0f0009350 comp rx=0 tx=0).stop 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 msgr2=0x7ff1041136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400bb00 tx=0x7ff0f4009250 comp rx=0 tx=0).stop 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 shutdown_connections 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7ff0e8039ff0 0x7ff0e803c3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff104077d30 0x7ff1041136b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 --2- 172.21.15.60:0/861315431 >> [v2:172.21.15.60:6800/3232156266,v1:172.21.15.60:6801/3232156266] conn(0x7ff0e8036850 0x7ff0e8038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:49.130 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 >> 172.21.15.60:0/861315431 conn(0x7ff1040fde90 msgr2=0x7ff1040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:49.131 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 shutdown_connections 2024-04-12T13:29:49.131 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:48.356+0000 7ff103e00700 1 -- 172.21.15.60:0/861315431 wait complete. 2024-04-12T13:29:49.131 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 5 is available 2024-04-12T13:29:49.131 INFO:teuthology.orchestra.run.smithi060.stdout:Setting orchestrator backend to cephadm... 2024-04-12T13:29:49.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:49 smithi060 ceph-mon[29097]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-12T13:29:49.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:49 smithi060 ceph-mon[29097]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-12T13:29:49.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:49 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:49.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:49 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:29:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: [12/Apr/2024:13:29:48] ENGINE Bus STARTING 2024-04-12T13:29:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: [12/Apr/2024:13:29:49] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:29:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: [12/Apr/2024:13:29:49] ENGINE Bus STARTED 2024-04-12T13:29:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: mgrmap e8: smithi060.bpzacg(active, since 2s) 2024-04-12T13:29:50.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:50 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:29:50.709 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.734+0000 7f0504400700 1 Processor -- start 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.734+0000 7f0504400700 1 -- start start 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.734+0000 7f0504400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.734+0000 7f0504400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc07d420 con 0x7f04fc07ca40 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.735+0000 7f0501a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.735+0000 7f0501a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57776/0 (socket says 172.21.15.60:57776) 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.735+0000 7f0501a00700 1 -- 172.21.15.60:0/1397116912 learned_addr learned my addr 172.21.15.60:0/1397116912 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:50.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.735+0000 7f0501a00700 1 -- 172.21.15.60:0/1397116912 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc07d560 con 0x7f04fc07ca40 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.736+0000 7f0501a00700 1 --2- 172.21.15.60:0/1397116912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04f00098e0 tx=0x7f04f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e545ea2a0d0ceb74 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.736+0000 7f04fbe00700 1 -- 172.21.15.60:0/1397116912 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f000b860 con 0x7f04fc07ca40 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.736+0000 7f04fbe00700 1 -- 172.21.15.60:0/1397116912 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f04f000be50 con 0x7f04fc07ca40 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.736+0000 7f04fbe00700 1 -- 172.21.15.60:0/1397116912 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f0010380 con 0x7f04fc07ca40 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 -- 172.21.15.60:0/1397116912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 msgr2=0x7f04fc07ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 --2- 172.21.15.60:0/1397116912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f04f00098e0 tx=0x7f04f0009250 comp rx=0 tx=0).stop 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 -- 172.21.15.60:0/1397116912 shutdown_connections 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 --2- 172.21.15.60:0/1397116912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc07ce50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 -- 172.21.15.60:0/1397116912 >> 172.21.15.60:0/1397116912 conn(0x7f04fc078350 msgr2=0x7f04fc07a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 -- 172.21.15.60:0/1397116912 shutdown_connections 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.737+0000 7f0504400700 1 -- 172.21.15.60:0/1397116912 wait complete. 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.738+0000 7f0504400700 1 Processor -- start 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.738+0000 7f0504400700 1 -- start start 2024-04-12T13:29:50.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.738+0000 7f0504400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.738+0000 7f0504400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc118120 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.738+0000 7f0501a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f0501a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57790/0 (socket says 172.21.15.60:57790) 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f0501a00700 1 -- 172.21.15.60:0/1985733552 learned_addr learned my addr 172.21.15.60:0/1985733552 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f0501a00700 1 -- 172.21.15.60:0/1985733552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00094f0 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f0501a00700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04f0006fd0 tx=0x7f04f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f0010800 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f04f0010df0 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f001ad80 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.739+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc118320 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.740+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc118e90 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.741+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f04f001a660 con 0x7f04fc07ca40 2024-04-12T13:29:50.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.741+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc05f5f0 con 0x7f04fc07ca40 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.741+0000 7f04f9600700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 0x7f04e4038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.741+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f04f0049e40 con 0x7f04fc07ca40 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.741+0000 7f0501000700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 0x7f04e4038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.742+0000 7f0501000700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 0x7f04e4038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009990 tx=0x7f04e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.747+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f04f004d030 con 0x7f04fc07ca40 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.975+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f04fc07a4b0 con 0x7f04e4036770 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.991+0000 7f04f9600700 1 -- 172.21.15.60:0/1985733552 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f04fc07a4b0 con 0x7f04e4036770 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 msgr2=0x7f04e4038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:50.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 0x7f04e4038c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009990 tx=0x7f04e8006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 msgr2=0x7f04fc117be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04f0006fd0 tx=0x7f04f0009250 comp rx=0 tx=0).stop 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 shutdown_connections 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f04e4036770 0x7f04e4038c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 --2- 172.21.15.60:0/1985733552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04fc07ca40 0x7f04fc117be0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 >> 172.21.15.60:0/1985733552 conn(0x7f04fc078350 msgr2=0x7f04fc079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 shutdown_connections 2024-04-12T13:29:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:49.994+0000 7f0504400700 1 -- 172.21.15.60:0/1985733552 wait complete. 2024-04-12T13:29:51.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:51 smithi060 ceph-mon[29097]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:29:52.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-12T13:29:52.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.322+0000 7f1595e00700 1 Processor -- start 2024-04-12T13:29:52.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.322+0000 7f1595e00700 1 -- start start 2024-04-12T13:29:52.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.323+0000 7f1595e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.323+0000 7f1595e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590078010 con 0x7f1590077c00 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.323+0000 7f158ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.323+0000 7f158ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57798/0 (socket says 172.21.15.60:57798) 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.323+0000 7f158ea00700 1 -- 172.21.15.60:0/1082972285 learned_addr learned my addr 172.21.15.60:0/1082972285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.324+0000 7f158ea00700 1 -- 172.21.15.60:0/1082972285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900766f0 con 0x7f1590077c00 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.324+0000 7f158ea00700 1 --2- 172.21.15.60:0/1082972285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15800098e0 tx=0x7f1580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e695db5557ad86 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.324+0000 7f158d600700 1 -- 172.21.15.60:0/1082972285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f158000b860 con 0x7f1590077c00 2024-04-12T13:29:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.324+0000 7f158d600700 1 -- 172.21.15.60:0/1082972285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f158000be50 con 0x7f1590077c00 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.324+0000 7f158d600700 1 -- 172.21.15.60:0/1082972285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1580010380 con 0x7f1590077c00 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 -- 172.21.15.60:0/1082972285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 msgr2=0x7f15900761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 --2- 172.21.15.60:0/1082972285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15800098e0 tx=0x7f1580009250 comp rx=0 tx=0).stop 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 -- 172.21.15.60:0/1082972285 shutdown_connections 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 --2- 172.21.15.60:0/1082972285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f15900761b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 -- 172.21.15.60:0/1082972285 >> 172.21.15.60:0/1082972285 conn(0x7f15900fe0a0 msgr2=0x7f15901004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:52.179 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 -- 172.21.15.60:0/1082972285 shutdown_connections 2024-04-12T13:29:52.182 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.325+0000 7f1595e00700 1 -- 172.21.15.60:0/1082972285 wait complete. 2024-04-12T13:29:52.182 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.326+0000 7f1595e00700 1 Processor -- start 2024-04-12T13:29:52.182 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.326+0000 7f1595e00700 1 -- start start 2024-04-12T13:29:52.182 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.326+0000 7f1595e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:52.182 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.326+0000 7f1595e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590113d90 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.327+0000 7f158ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.327+0000 7f158ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57800/0 (socket says 172.21.15.60:57800) 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.327+0000 7f158ea00700 1 -- 172.21.15.60:0/147962451 learned_addr learned my addr 172.21.15.60:0/147962451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.327+0000 7f158ea00700 1 -- 172.21.15.60:0/147962451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800094f0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.327+0000 7f158ea00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.328+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f158001a7d0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.328+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f158001adc0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.328+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1580019ea0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.328+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1590113f90 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.328+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1590114b00 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.329+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f1580019730 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.329+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159005f5f0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.330+0000 7f1586a00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 0x7f1574038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.330+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f158004a0f0 con 0x7f1590077c00 2024-04-12T13:29:52.183 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.330+0000 7f158e000700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 0x7f1574038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.331+0000 7f158e000700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 0x7f1574038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f157c009990 tx=0x7f157c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.335+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f158007c250 con 0x7f1590077c00 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.550+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f15900ff230 con 0x7f15740368a0 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.552+0000 7f1586a00700 1 -- 172.21.15.60:0/147962451 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f15900ff230 con 0x7f15740368a0 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.554+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 msgr2=0x7f1574038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.554+0000 7f1595e00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 0x7f1574038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f157c009990 tx=0x7f157c006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.554+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 msgr2=0x7f1590113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.554+0000 7f1595e00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580009250 comp rx=0 tx=0).stop 2024-04-12T13:29:52.184 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 shutdown_connections 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f15740368a0 0x7f1574038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 --2- 172.21.15.60:0/147962451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1590077c00 0x7f1590113850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 >> 172.21.15.60:0/147962451 conn(0x7f15900fe0a0 msgr2=0x7f15900feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 shutdown_connections 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:51.555+0000 7f1595e00700 1 -- 172.21.15.60:0/147962451 wait complete. 2024-04-12T13:29:52.185 INFO:teuthology.orchestra.run.smithi060.stdout:Generating ssh key... 2024-04-12T13:29:52.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:52 smithi060 ceph-mon[29097]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:29:53.965 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.844+0000 7f760f200700 1 Processor -- start 2024-04-12T13:29:53.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.844+0000 7f760f200700 1 -- start start 2024-04-12T13:29:53.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.844+0000 7f760f200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.845+0000 7f760f200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608103200 con 0x7f76081028b0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.845+0000 7f7607e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.845+0000 7f7607e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57812/0 (socket says 172.21.15.60:57812) 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.845+0000 7f7607e00700 1 -- 172.21.15.60:0/1211855180 learned_addr learned my addr 172.21.15.60:0/1211855180 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.846+0000 7f7607e00700 1 -- 172.21.15.60:0/1211855180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608103340 con 0x7f76081028b0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.846+0000 7f7607e00700 1 --2- 172.21.15.60:0/1211855180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75f80098e0 tx=0x7f75f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7944a7852fcae5d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.846+0000 7f7607400700 1 -- 172.21.15.60:0/1211855180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75f800b860 con 0x7f76081028b0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.846+0000 7f7607400700 1 -- 172.21.15.60:0/1211855180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f75f800be50 con 0x7f76081028b0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.846+0000 7f7607400700 1 -- 172.21.15.60:0/1211855180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75f8010380 con 0x7f76081028b0 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 -- 172.21.15.60:0/1211855180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 msgr2=0x7f7608102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 --2- 172.21.15.60:0/1211855180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75f80098e0 tx=0x7f75f8009250 comp rx=0 tx=0).stop 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 -- 172.21.15.60:0/1211855180 shutdown_connections 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 --2- 172.21.15.60:0/1211855180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608102cc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 -- 172.21.15.60:0/1211855180 >> 172.21.15.60:0/1211855180 conn(0x7f76080fe070 msgr2=0x7f7608100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:53.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 -- 172.21.15.60:0/1211855180 shutdown_connections 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.847+0000 7f760f200700 1 -- 172.21.15.60:0/1211855180 wait complete. 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.848+0000 7f760f200700 1 Processor -- start 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f760f200700 1 -- start start 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f760f200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f760f200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080791b0 con 0x7f76081028b0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f7607e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f7607e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57828/0 (socket says 172.21.15.60:57828) 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.849+0000 7f7607e00700 1 -- 172.21.15.60:0/4256344087 learned_addr learned my addr 172.21.15.60:0/4256344087 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f7607e00700 1 -- 172.21.15.60:0/4256344087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80094f0 con 0x7f76081028b0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f7607e00700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000c00 tx=0x7f75f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75f801a870 con 0x7f76081028b0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f75f801ae60 con 0x7f76081028b0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75f80193c0 con 0x7f76081028b0 2024-04-12T13:29:53.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.850+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7608077220 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.851+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7608077710 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.852+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f75f8022770 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.852+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760804bed0 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.852+0000 7f7604c00700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 0x7f75ec038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.852+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f75f804a540 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.852+0000 7f75ffe00700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 0x7f75ec038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.853+0000 7f75ffe00700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 0x7f75ec038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009990 tx=0x7f75f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:52.858+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f75f8010bd0 con 0x7f76081028b0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.074+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7608077e20 con 0x7f75ec0368a0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.289+0000 7f7604c00700 1 -- 172.21.15.60:0/4256344087 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7608077e20 con 0x7f75ec0368a0 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.291+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 msgr2=0x7f75ec038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.291+0000 7f760f200700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 0x7f75ec038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009990 tx=0x7f75f0006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.291+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 msgr2=0x7f7608078c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:53.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.291+0000 7f760f200700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000c00 tx=0x7f75f8009250 comp rx=0 tx=0).stop 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 shutdown_connections 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f75ec0368a0 0x7f75ec038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 --2- 172.21.15.60:0/4256344087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76081028b0 0x7f7608078c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 >> 172.21.15.60:0/4256344087 conn(0x7f76080fe070 msgr2=0x7f76080fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 shutdown_connections 2024-04-12T13:29:53.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:53.292+0000 7f760f200700 1 -- 172.21.15.60:0/4256344087 wait complete. 2024-04-12T13:29:54.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:54 smithi060 ceph-mon[29097]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:29:54.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:54 smithi060 ceph-mon[29097]: Generating ssh key... 2024-04-12T13:29:54.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:54 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:54.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:54 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:29:55.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6Ptvi2I/DRyGhqoxk2lxcuUWyu3bBhzc+12Ty3GZCLr1IPuXAHS13nt50Y/AEnmGZ2v1YNdjchZRcW7dqlt5DlNajvvCrw4RKupWAhg5oFdmBEuaB8i9/dFdDUnbgH+qN0btM9ls9nWFf0/bAB5Ei48uVjpkpCOJ/MGGNo2PbllpzLKnjhbhVrBHqmPkpEJI7eSQY8yvuK6rM41gzMxg9pbQPm8s7elGI5KAwMjWsGIj92wkAMIKdfu9CNJLN4d4whtjB9p9VXxYMwVUnZnOhTTO944hwDgJCH278hlW8BbFBzJmbxWHqoCmzoCkOEKI7+VraW0gfFC5omnjd1iKPA5+s4H0nyKX/pLG2pmfqcIL7NjH2lQe3jDAu78pt/HElUDKpbYz/ppy0/3sFMa5o469kSUs7NTVwn73mtC4nUGa22oAKw4iwBhPZ52aim/8FKrtSVgUT7E7E2ipx/0E83daIhf/A6HVUPgiSHsQuoLE0FxL9KwX+4jJEMhYBCs= ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:29:55.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.585+0000 7f58afc00700 1 Processor -- start 2024-04-12T13:29:55.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.586+0000 7f58afc00700 1 -- start start 2024-04-12T13:29:55.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.586+0000 7f58afc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.586+0000 7f58afc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8102120 con 0x7f58a81017d0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.586+0000 7f58ad200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.587+0000 7f58ad200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57832/0 (socket says 172.21.15.60:57832) 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.587+0000 7f58ad200700 1 -- 172.21.15.60:0/3583277586 learned_addr learned my addr 172.21.15.60:0/3583277586 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.587+0000 7f58ad200700 1 -- 172.21.15.60:0/3583277586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a8102260 con 0x7f58a81017d0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.587+0000 7f58ad200700 1 --2- 172.21.15.60:0/3583277586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f589c0098e0 tx=0x7f589c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f040bb3212847b07 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.587+0000 7f58a7400700 1 -- 172.21.15.60:0/3583277586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f589c00b860 con 0x7f58a81017d0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58a7400700 1 -- 172.21.15.60:0/3583277586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f589c00be50 con 0x7f58a81017d0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58a7400700 1 -- 172.21.15.60:0/3583277586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f589c010380 con 0x7f58a81017d0 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58afc00700 1 -- 172.21.15.60:0/3583277586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 msgr2=0x7f58a8101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58afc00700 1 --2- 172.21.15.60:0/3583277586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f589c0098e0 tx=0x7f589c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58afc00700 1 -- 172.21.15.60:0/3583277586 shutdown_connections 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58afc00700 1 --2- 172.21.15.60:0/3583277586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a8101be0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:55.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.588+0000 7f58afc00700 1 -- 172.21.15.60:0/3583277586 >> 172.21.15.60:0/3583277586 conn(0x7f58a80fcfd0 msgr2=0x7f58a80ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.589+0000 7f58afc00700 1 -- 172.21.15.60:0/3583277586 shutdown_connections 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.589+0000 7f58afc00700 1 -- 172.21.15.60:0/3583277586 wait complete. 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.589+0000 7f58afc00700 1 Processor -- start 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58afc00700 1 -- start start 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58afc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58afc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a810f920 con 0x7f58a81017d0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58ad200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58ad200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57838/0 (socket says 172.21.15.60:57838) 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.590+0000 7f58ad200700 1 -- 172.21.15.60:0/3376085556 learned_addr learned my addr 172.21.15.60:0/3376085556 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58ad200700 1 -- 172.21.15.60:0/3376085556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c0094f0 con 0x7f58a81017d0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58ad200700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f589c000c00 tx=0x7f589c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f589c01a8a0 con 0x7f58a81017d0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f589c01ae90 con 0x7f58a81017d0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f589c019e70 con 0x7f58a81017d0 2024-04-12T13:29:55.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a810fb20 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.591+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a8110690 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.592+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a805f5f0 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.592+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f589c019730 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.593+0000 7f58a4c00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 0x7f589003afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.593+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f589c04a0f0 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.593+0000 7f58a7e00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 0x7f589003afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.594+0000 7f58a7e00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 0x7f589003afa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5894009990 tx=0x7f5894006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.598+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f589c07c250 con 0x7f58a81017d0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.815+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f58a8110aa0 con 0x7f5890038af0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.817+0000 7f58a4c00700 1 -- 172.21.15.60:0/3376085556 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f58a8110aa0 con 0x7f5890038af0 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 msgr2=0x7f589003afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 0x7f589003afa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5894009990 tx=0x7f5894006e40 comp rx=0 tx=0).stop 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 msgr2=0x7f58a810f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:29:55.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f589c000c00 tx=0x7f589c009250 comp rx=0 tx=0).stop 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 shutdown_connections 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f5890038af0 0x7f589003afa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 --2- 172.21.15.60:0/3376085556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a81017d0 0x7f58a810f3e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 >> 172.21.15.60:0/3376085556 conn(0x7f58a80fcfd0 msgr2=0x7f58a8105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 shutdown_connections 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:54.820+0000 7f58afc00700 1 -- 172.21.15.60:0/3376085556 wait complete. 2024-04-12T13:29:55.721 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-12T13:29:55.722 INFO:teuthology.orchestra.run.smithi060.stdout:Adding key to root@localhost authorized_keys... 2024-04-12T13:29:55.722 INFO:teuthology.orchestra.run.smithi060.stdout:Adding host smithi060... 2024-04-12T13:29:55.991 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:55 smithi060 ceph-mon[29097]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:29:56.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:56 smithi060 ceph-mon[29097]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:29:58.809 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:29:58 smithi060 ceph-mon[29097]: Deploying cephadm binary to smithi060 2024-04-12T13:30:01.693 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Added host 'smithi060' with addr '172.21.15.60' 2024-04-12T13:30:01.693 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.304+0000 7f1d41400700 1 Processor -- start 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d41400700 1 -- start start 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d41400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d41400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1026a0 con 0x7f1d3c101d50 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d3a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d3a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57846/0 (socket says 172.21.15.60:57846) 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.305+0000 7f1d3a800700 1 -- 172.21.15.60:0/3678783305 learned_addr learned my addr 172.21.15.60:0/3678783305 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.306+0000 7f1d3a800700 1 -- 172.21.15.60:0/3678783305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c1027e0 con 0x7f1d3c101d50 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.306+0000 7f1d3a800700 1 --2- 172.21.15.60:0/3678783305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129f40fce04a94e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.306+0000 7f1d39400700 1 -- 172.21.15.60:0/3678783305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2c00b860 con 0x7f1d3c101d50 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d39400700 1 -- 172.21.15.60:0/3678783305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f1d2c00be50 con 0x7f1d3c101d50 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d39400700 1 -- 172.21.15.60:0/3678783305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2c010380 con 0x7f1d3c101d50 2024-04-12T13:30:01.694 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 -- 172.21.15.60:0/3678783305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 msgr2=0x7f1d3c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 --2- 172.21.15.60:0/3678783305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c009250 comp rx=0 tx=0).stop 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 -- 172.21.15.60:0/3678783305 shutdown_connections 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 --2- 172.21.15.60:0/3678783305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c102160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 -- 172.21.15.60:0/3678783305 >> 172.21.15.60:0/3678783305 conn(0x7f1d3c0fc760 msgr2=0x7f1d3c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 -- 172.21.15.60:0/3678783305 shutdown_connections 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.307+0000 7f1d41400700 1 -- 172.21.15.60:0/3678783305 wait complete. 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.308+0000 7f1d41400700 1 Processor -- start 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.308+0000 7f1d41400700 1 -- start start 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d41400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d41400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c113d70 con 0x7f1d3c101d50 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d3a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d3a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57854/0 (socket says 172.21.15.60:57854) 2024-04-12T13:30:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d3a800700 1 -- 172.21.15.60:0/367213127 learned_addr learned my addr 172.21.15.60:0/367213127 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.309+0000 7f1d3a800700 1 -- 172.21.15.60:0/367213127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0094f0 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d3a800700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0094c0 tx=0x7f1d2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2c010750 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f1d2c010d40 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c113f70 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2c01adf0 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.310+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c114a90 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.311+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f1d2c0108b0 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.311+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c05f5f0 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.312+0000 7f1d32a00700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 0x7f1d20038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.312+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1d2c04a420 con 0x7f1d3c101d50 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.312+0000 7f1d39e00700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 0x7f1d20038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.313+0000 7f1d39e00700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 0x7f1d20038d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009990 tx=0x7f1d28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.317+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1d2c0189a0 con 0x7f1d3c101d50 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:29:56.536+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d3c115610 con 0x7f1d20036890 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.898+0000 7f1d32a00700 1 -- 172.21.15.60:0/367213127 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f1d3c115610 con 0x7f1d20036890 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 msgr2=0x7f1d20038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 0x7f1d20038d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009990 tx=0x7f1d28006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 msgr2=0x7f1d3c113830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0094c0 tx=0x7f1d2c009250 comp rx=0 tx=0).stop 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 shutdown_connections 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f1d20036890 0x7f1d20038d40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 --2- 172.21.15.60:0/367213127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d3c101d50 0x7f1d3c113830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.903+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 >> 172.21.15.60:0/367213127 conn(0x7f1d3c0fc760 msgr2=0x7f1d3c10a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.904+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 shutdown_connections 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:00.904+0000 7f1d41400700 1 -- 172.21.15.60:0/367213127 wait complete. 2024-04-12T13:30:01.697 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying mon service with default placement... 2024-04-12T13:30:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:01 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:01 smithi060 ceph-mon[29097]: Added host smithi060 2024-04-12T13:30:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:01 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:30:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:03 smithi060 ceph-mon[29097]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:03 smithi060 ceph-mon[29097]: Saving service mon spec with placement count:5 2024-04-12T13:30:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:03 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.351+0000 7f8b96800700 1 Processor -- start 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.352+0000 7f8b96800700 1 -- start start 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.352+0000 7f8b96800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.352+0000 7f8b96800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9007d440 con 0x7f8b9007cfa0 2024-04-12T13:30:03.979 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.353+0000 7f8b8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:03.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.353+0000 7f8b8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50094/0 (socket says 172.21.15.60:50094) 2024-04-12T13:30:03.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.353+0000 7f8b8f400700 1 -- 172.21.15.60:0/2517174229 learned_addr learned my addr 172.21.15.60:0/2517174229 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:03.980 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.353+0000 7f8b8f400700 1 -- 172.21.15.60:0/2517174229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9007d580 con 0x7f8b9007cfa0 2024-04-12T13:30:03.981 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.353+0000 7f8b8f400700 1 --2- 172.21.15.60:0/2517174229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b800098e0 tx=0x7f8b80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38696d9bc1914042 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:03.981 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.354+0000 7f8b8e000700 1 -- 172.21.15.60:0/2517174229 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8000b860 con 0x7f8b9007cfa0 2024-04-12T13:30:03.981 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.354+0000 7f8b8e000700 1 -- 172.21.15.60:0/2517174229 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f8b8000be50 con 0x7f8b9007cfa0 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.354+0000 7f8b8e000700 1 -- 172.21.15.60:0/2517174229 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b80010380 con 0x7f8b9007cfa0 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 -- 172.21.15.60:0/2517174229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 msgr2=0x7f8b9010bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 --2- 172.21.15.60:0/2517174229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b800098e0 tx=0x7f8b80009250 comp rx=0 tx=0).stop 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 -- 172.21.15.60:0/2517174229 shutdown_connections 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 --2- 172.21.15.60:0/2517174229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b9010bd00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 -- 172.21.15.60:0/2517174229 >> 172.21.15.60:0/2517174229 conn(0x7f8b90078560 msgr2=0x7f8b9007a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 -- 172.21.15.60:0/2517174229 shutdown_connections 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.355+0000 7f8b96800700 1 -- 172.21.15.60:0/2517174229 wait complete. 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.356+0000 7f8b96800700 1 Processor -- start 2024-04-12T13:30:03.982 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.356+0000 7f8b96800700 1 -- start start 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.356+0000 7f8b96800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.356+0000 7f8b96800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901180d0 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.357+0000 7f8b8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.357+0000 7f8b8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50106/0 (socket says 172.21.15.60:50106) 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.357+0000 7f8b8f400700 1 -- 172.21.15.60:0/648879509 learned_addr learned my addr 172.21.15.60:0/648879509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.357+0000 7f8b8f400700 1 -- 172.21.15.60:0/648879509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800094f0 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.357+0000 7f8b8f400700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000ba90 tx=0x7f8b80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.358+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8001a8a0 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.358+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1056+0+0 (secure 0 0 0) 0x7f8b8001ae90 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.358+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b80019e80 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.358+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b901182d0 con 0x7f8b9007cfa0 2024-04-12T13:30:03.986 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.358+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b90118e40 con 0x7f8b9007cfa0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.359+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f8b80019730 con 0x7f8b9007cfa0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.359+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9005f5f0 con 0x7f8b9007cfa0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.360+0000 7f8b87400700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 0x7f8b74038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.360+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8b80049f50 con 0x7f8b9007cfa0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.360+0000 7f8b8ea00700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 0x7f8b74038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.361+0000 7f8b8ea00700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 0x7f8b74038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009990 tx=0x7f8b7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.365+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8b80010380 con 0x7f8b9007cfa0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.633+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b9007d580 con 0x7f8b740368a0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.646+0000 7f8b87400700 1 -- 172.21.15.60:0/648879509 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8b9007d580 con 0x7f8b740368a0 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 msgr2=0x7f8b74038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 0x7f8b74038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009990 tx=0x7f8b7c006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 msgr2=0x7f8b90117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000ba90 tx=0x7f8b80009250 comp rx=0 tx=0).stop 2024-04-12T13:30:03.987 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 shutdown_connections 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8b740368a0 0x7f8b74038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 --2- 172.21.15.60:0/648879509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b9007cfa0 0x7f8b90117b90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 >> 172.21.15.60:0/648879509 conn(0x7f8b90078560 msgr2=0x7f8b90079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.649+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 shutdown_connections 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:02.650+0000 7f8b96800700 1 -- 172.21.15.60:0/648879509 wait complete. 2024-04-12T13:30:03.988 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying mgr service with default placement... 2024-04-12T13:30:05.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:05 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:05.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:05 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:05.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:05 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:06.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-12T13:30:06.047 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.031+0000 7f545b400700 1 Processor -- start 2024-04-12T13:30:06.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.031+0000 7f545b400700 1 -- start start 2024-04-12T13:30:06.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.031+0000 7f545b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:06.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.031+0000 7f545b400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454079080 con 0x7f5454078c70 2024-04-12T13:30:06.048 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.032+0000 7f5458a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:06.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.032+0000 7f5458a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50108/0 (socket says 172.21.15.60:50108) 2024-04-12T13:30:06.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.032+0000 7f5458a00700 1 -- 172.21.15.60:0/3776938512 learned_addr learned my addr 172.21.15.60:0/3776938512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:06.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.032+0000 7f5458a00700 1 -- 172.21.15.60:0/3776938512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454077800 con 0x7f5454078c70 2024-04-12T13:30:06.049 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.033+0000 7f5458a00700 1 --2- 172.21.15.60:0/3776938512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54480098e0 tx=0x7f5448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55ea03499589807 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:06.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.033+0000 7f5453400700 1 -- 172.21.15.60:0/3776938512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f544800b860 con 0x7f5454078c70 2024-04-12T13:30:06.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.033+0000 7f5453400700 1 -- 172.21.15.60:0/3776938512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f544800be90 con 0x7f5454078c70 2024-04-12T13:30:06.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.033+0000 7f5453400700 1 -- 172.21.15.60:0/3776938512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54480103c0 con 0x7f5454078c70 2024-04-12T13:30:06.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 -- 172.21.15.60:0/3776938512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 msgr2=0x7f54540772c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:06.050 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 --2- 172.21.15.60:0/3776938512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54480098e0 tx=0x7f5448009250 comp rx=0 tx=0).stop 2024-04-12T13:30:06.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 -- 172.21.15.60:0/3776938512 shutdown_connections 2024-04-12T13:30:06.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 --2- 172.21.15.60:0/3776938512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54540772c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:06.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 -- 172.21.15.60:0/3776938512 >> 172.21.15.60:0/3776938512 conn(0x7f54540fe120 msgr2=0x7f5454100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:06.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 -- 172.21.15.60:0/3776938512 shutdown_connections 2024-04-12T13:30:06.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.034+0000 7f545b400700 1 -- 172.21.15.60:0/3776938512 wait complete. 2024-04-12T13:30:06.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.035+0000 7f545b400700 1 Processor -- start 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.035+0000 7f545b400700 1 -- start start 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.035+0000 7f545b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.035+0000 7f545b400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454113d30 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.036+0000 7f5458a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.036+0000 7f5458a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50116/0 (socket says 172.21.15.60:50116) 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.036+0000 7f5458a00700 1 -- 172.21.15.60:0/2680420548 learned_addr learned my addr 172.21.15.60:0/2680420548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.036+0000 7f5458a00700 1 -- 172.21.15.60:0/2680420548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480094f0 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.036+0000 7f5458a00700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5448006d40 tx=0x7f5448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.037+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5448010840 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.037+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5448010e70 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.037+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5454113f30 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.037+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5448024ea0 con 0x7f5454078c70 2024-04-12T13:30:06.056 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.037+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5454114aa0 con 0x7f5454078c70 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.038+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f544801a4c0 con 0x7f5454078c70 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.038+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545405f5f0 con 0x7f5454078c70 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.039+0000 7f5450c00700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 0x7f543c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.039+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f544804a780 con 0x7f5454078c70 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.039+0000 7f5453e00700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 0x7f543c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.040+0000 7f5453e00700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 0x7f543c038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5440009990 tx=0x7f5440006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.044+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5448018940 con 0x7f5454078c70 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.282+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f54540ff270 con 0x7f543c036850 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.287+0000 7f5450c00700 1 -- 172.21.15.60:0/2680420548 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f54540ff270 con 0x7f543c036850 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 msgr2=0x7f543c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 0x7f543c038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5440009990 tx=0x7f5440006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 msgr2=0x7f54541137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5448006d40 tx=0x7f5448009250 comp rx=0 tx=0).stop 2024-04-12T13:30:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 shutdown_connections 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f543c036850 0x7f543c038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 --2- 172.21.15.60:0/2680420548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5454078c70 0x7f54541137f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.290+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 >> 172.21.15.60:0/2680420548 conn(0x7f54540fe120 msgr2=0x7f54540feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.291+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 shutdown_connections 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:05.291+0000 7f545b400700 1 -- 172.21.15.60:0/2680420548 wait complete. 2024-04-12T13:30:06.058 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying crash service with default placement... 2024-04-12T13:30:06.609 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:06 smithi060 ceph-mon[29097]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:06.609 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:06 smithi060 ceph-mon[29097]: Saving service mgr spec with placement count:2 2024-04-12T13:30:07.613 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-12T13:30:07.613 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.634+0000 7f6899800700 1 Processor -- start 2024-04-12T13:30:07.613 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.635+0000 7f6899800700 1 -- start start 2024-04-12T13:30:07.614 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.635+0000 7f6899800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:07.614 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.635+0000 7f6899800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894103040 con 0x7f68941026f0 2024-04-12T13:30:07.614 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.636+0000 7f6893e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:07.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.636+0000 7f6893e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50120/0 (socket says 172.21.15.60:50120) 2024-04-12T13:30:07.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.636+0000 7f6893e00700 1 -- 172.21.15.60:0/2413257148 learned_addr learned my addr 172.21.15.60:0/2413257148 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.636+0000 7f6893e00700 1 -- 172.21.15.60:0/2413257148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894103180 con 0x7f68941026f0 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.637+0000 7f6893e00700 1 --2- 172.21.15.60:0/2413257148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68840098e0 tx=0x7f6884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159c6f0d4c0c5a39 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.637+0000 7f6892a00700 1 -- 172.21.15.60:0/2413257148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f688400b860 con 0x7f68941026f0 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.637+0000 7f6892a00700 1 -- 172.21.15.60:0/2413257148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f688400be90 con 0x7f68941026f0 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.637+0000 7f6892a00700 1 -- 172.21.15.60:0/2413257148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68840103c0 con 0x7f68941026f0 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 -- 172.21.15.60:0/2413257148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 msgr2=0x7f6894102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 --2- 172.21.15.60:0/2413257148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68840098e0 tx=0x7f6884009250 comp rx=0 tx=0).stop 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 -- 172.21.15.60:0/2413257148 shutdown_connections 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 --2- 172.21.15.60:0/2413257148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f6894102b00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 -- 172.21.15.60:0/2413257148 >> 172.21.15.60:0/2413257148 conn(0x7f68940fded0 msgr2=0x7f68941002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 -- 172.21.15.60:0/2413257148 shutdown_connections 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.638+0000 7f6899800700 1 -- 172.21.15.60:0/2413257148 wait complete. 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.639+0000 7f6899800700 1 Processor -- start 2024-04-12T13:30:07.620 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.639+0000 7f6899800700 1 -- start start 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.640+0000 7f6899800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.640+0000 7f6899800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894113be0 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.640+0000 7f6893e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.640+0000 7f6893e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50130/0 (socket says 172.21.15.60:50130) 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.640+0000 7f6893e00700 1 -- 172.21.15.60:0/639850844 learned_addr learned my addr 172.21.15.60:0/639850844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f6893e00700 1 -- 172.21.15.60:0/639850844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840094f0 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f6893e00700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68840090b0 tx=0x7f6884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6884010840 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6884010e70 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6894113de0 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6884024e40 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.641+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6894114950 con 0x7f68941026f0 2024-04-12T13:30:07.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.642+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689405f5f0 con 0x7f68941026f0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.643+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f688401a530 con 0x7f68941026f0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.643+0000 7f688be00700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 0x7f6878038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.643+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f688404a930 con 0x7f68941026f0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.643+0000 7f6893400700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 0x7f6878038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.644+0000 7f6893400700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 0x7f6878038cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6880009990 tx=0x7f6880006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.649+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6884018940 con 0x7f68941026f0 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.883+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f68940fefc0 con 0x7f6878036800 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.889+0000 7f688be00700 1 -- 172.21.15.60:0/639850844 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f68940fefc0 con 0x7f6878036800 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 msgr2=0x7f6878038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 0x7f6878038cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6880009990 tx=0x7f6880006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 msgr2=0x7f68941136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68840090b0 tx=0x7f6884009250 comp rx=0 tx=0).stop 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 shutdown_connections 2024-04-12T13:30:07.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f6878036800 0x7f6878038cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:07.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 --2- 172.21.15.60:0/639850844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68941026f0 0x7f68941136a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:07.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 >> 172.21.15.60:0/639850844 conn(0x7f68940fded0 msgr2=0x7f68940fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:07.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 shutdown_connections 2024-04-12T13:30:07.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:06.893+0000 7f6899800700 1 -- 172.21.15.60:0/639850844 wait complete. 2024-04-12T13:30:07.623 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying prometheus service with default placement... 2024-04-12T13:30:08.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:07 smithi060 ceph-mon[29097]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:08.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:07 smithi060 ceph-mon[29097]: Saving service crash spec with placement * 2024-04-12T13:30:08.149 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:07 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:08.150 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:07 smithi060 ceph-mon[29097]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:09.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:09 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:09.371 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:09 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:09.383 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.442+0000 7f59ea400700 1 Processor -- start 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.442+0000 7f59ea400700 1 -- start start 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59ea400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59ea400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40790f0 con 0x7f59e4078ce0 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50132/0 (socket says 172.21.15.60:50132) 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59e3400700 1 -- 172.21.15.60:0/3171325849 learned_addr learned my addr 172.21.15.60:0/3171325849 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.443+0000 7f59e3400700 1 -- 172.21.15.60:0/3171325849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4077780 con 0x7f59e4078ce0 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.444+0000 7f59e3400700 1 --2- 172.21.15.60:0/3171325849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59d40098e0 tx=0x7f59d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41caa0a7b4ff099 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:09.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.444+0000 7f59e2000700 1 -- 172.21.15.60:0/3171325849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59d400b860 con 0x7f59e4078ce0 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.444+0000 7f59e2000700 1 -- 172.21.15.60:0/3171325849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59d400be90 con 0x7f59e4078ce0 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.444+0000 7f59e2000700 1 -- 172.21.15.60:0/3171325849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59d40103c0 con 0x7f59e4078ce0 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 -- 172.21.15.60:0/3171325849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 msgr2=0x7f59e4077240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 --2- 172.21.15.60:0/3171325849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59d40098e0 tx=0x7f59d4009250 comp rx=0 tx=0).stop 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 -- 172.21.15.60:0/3171325849 shutdown_connections 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 --2- 172.21.15.60:0/3171325849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e4077240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 -- 172.21.15.60:0/3171325849 >> 172.21.15.60:0/3171325849 conn(0x7f59e40fe050 msgr2=0x7f59e4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 -- 172.21.15.60:0/3171325849 shutdown_connections 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.445+0000 7f59ea400700 1 -- 172.21.15.60:0/3171325849 wait complete. 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.446+0000 7f59ea400700 1 Processor -- start 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59ea400700 1 -- start start 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59ea400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:09.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59ea400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4113d00 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50134/0 (socket says 172.21.15.60:50134) 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.447+0000 7f59e3400700 1 -- 172.21.15.60:0/3928600441 learned_addr learned my addr 172.21.15.60:0/3928600441 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59e3400700 1 -- 172.21.15.60:0/3928600441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094f0 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59e3400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59d4006d40 tx=0x7f59d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59d4010840 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59d4010e70 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59d4024ea0 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.448+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e4113f00 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.449+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e4114a70 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.450+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f59d4024780 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.450+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e405f5f0 con 0x7f59e4078ce0 2024-04-12T13:30:09.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.450+0000 7f59db400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 0x7f59c8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.450+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f59d404a740 con 0x7f59e4078ce0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.451+0000 7f59e2a00700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 0x7f59c8038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.451+0000 7f59e2a00700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 0x7f59c8038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009990 tx=0x7f59d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.456+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f59d402c910 con 0x7f59e4078ce0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.684+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f59e40ff130 con 0x7f59c80368a0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.690+0000 7f59db400700 1 -- 172.21.15.60:0/3928600441 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f59e40ff130 con 0x7f59c80368a0 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 msgr2=0x7f59c8038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 0x7f59c8038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009990 tx=0x7f59d0006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 msgr2=0x7f59e41137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59d4006d40 tx=0x7f59d4009250 comp rx=0 tx=0).stop 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 shutdown_connections 2024-04-12T13:30:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f59c80368a0 0x7f59c8038d50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:09.393 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 --2- 172.21.15.60:0/3928600441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59e4078ce0 0x7f59e41137c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:09.393 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 >> 172.21.15.60:0/3928600441 conn(0x7f59e40fe050 msgr2=0x7f59e40fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:09.393 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.692+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 shutdown_connections 2024-04-12T13:30:09.393 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:08.693+0000 7f59ea400700 1 -- 172.21.15.60:0/3928600441 wait complete. 2024-04-12T13:30:09.393 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying grafana service with default placement... 2024-04-12T13:30:10.655 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:10 smithi060 ceph-mon[29097]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:10.655 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:10 smithi060 ceph-mon[29097]: Saving service prometheus spec with placement count:1 2024-04-12T13:30:10.656 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:10 smithi060 ceph-mon[29097]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:10.656 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:10 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.039+0000 7f2339a00700 1 Processor -- start 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.039+0000 7f2339a00700 1 -- start start 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.039+0000 7f2339a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.039+0000 7f2339a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334103250 con 0x7f2334102900 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.040+0000 7f2332a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.040+0000 7f2332a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50958/0 (socket says 172.21.15.60:50958) 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.040+0000 7f2332a00700 1 -- 172.21.15.60:0/3540698771 learned_addr learned my addr 172.21.15.60:0/3540698771 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.040+0000 7f2332a00700 1 -- 172.21.15.60:0/3540698771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334103390 con 0x7f2334102900 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.041+0000 7f2332a00700 1 --2- 172.21.15.60:0/3540698771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23240098e0 tx=0x7f2324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10af9b012f14a40e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.041+0000 7f2331600700 1 -- 172.21.15.60:0/3540698771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f232400b860 con 0x7f2334102900 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.041+0000 7f2331600700 1 -- 172.21.15.60:0/3540698771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f232400be90 con 0x7f2334102900 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.041+0000 7f2331600700 1 -- 172.21.15.60:0/3540698771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23240103c0 con 0x7f2334102900 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 -- 172.21.15.60:0/3540698771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 msgr2=0x7f2334102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 --2- 172.21.15.60:0/3540698771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23240098e0 tx=0x7f2324009250 comp rx=0 tx=0).stop 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 -- 172.21.15.60:0/3540698771 shutdown_connections 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 --2- 172.21.15.60:0/3540698771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334102d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 -- 172.21.15.60:0/3540698771 >> 172.21.15.60:0/3540698771 conn(0x7f23340fe0a0 msgr2=0x7f23341004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 -- 172.21.15.60:0/3540698771 shutdown_connections 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.042+0000 7f2339a00700 1 -- 172.21.15.60:0/3540698771 wait complete. 2024-04-12T13:30:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.043+0000 7f2339a00700 1 Processor -- start 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.043+0000 7f2339a00700 1 -- start start 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.043+0000 7f2339a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.043+0000 7f2339a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23340780a0 con 0x7f2334102900 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.044+0000 7f2332a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.044+0000 7f2332a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50974/0 (socket says 172.21.15.60:50974) 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.044+0000 7f2332a00700 1 -- 172.21.15.60:0/2460592192 learned_addr learned my addr 172.21.15.60:0/2460592192 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.044+0000 7f2332a00700 1 -- 172.21.15.60:0/2460592192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240094f0 con 0x7f2334102900 2024-04-12T13:30:10.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f2332a00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2324006b00 tx=0x7f2324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2324010840 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2324010e70 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2334076110 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f232401ae70 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.045+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2334076600 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.046+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233404bed0 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.047+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f232401a780 con 0x7f2334102900 2024-04-12T13:30:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.047+0000 7f232aa00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 0x7f2318038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.047+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f232404aba0 con 0x7f2334102900 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.048+0000 7f2332000700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 0x7f2318038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.048+0000 7f2332000700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 0x7f2318038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2320009990 tx=0x7f2320006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.052+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f232401a430 con 0x7f2334102900 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.284+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f2334076dc0 con 0x7f23180368a0 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.294+0000 7f232aa00700 1 -- 172.21.15.60:0/2460592192 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f2334076dc0 con 0x7f23180368a0 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 msgr2=0x7f2318038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 0x7f2318038d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2320009990 tx=0x7f2320006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 msgr2=0x7f2334077b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2324006b00 tx=0x7f2324009250 comp rx=0 tx=0).stop 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 shutdown_connections 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f23180368a0 0x7f2318038d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 --2- 172.21.15.60:0/2460592192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334102900 0x7f2334077b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:10.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 >> 172.21.15.60:0/2460592192 conn(0x7f23340fe0a0 msgr2=0x7f23340feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:10.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 shutdown_connections 2024-04-12T13:30:10.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:10.297+0000 7f2339a00700 1 -- 172.21.15.60:0/2460592192 wait complete. 2024-04-12T13:30:10.976 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying node-exporter service with default placement... 2024-04-12T13:30:11.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:11 smithi060 ceph-mon[29097]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:11.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:11 smithi060 ceph-mon[29097]: Saving service grafana spec with placement count:1 2024-04-12T13:30:11.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:11 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:12 smithi060 ceph-mon[29097]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:12 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:12.775 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.838+0000 7f8bd1e00700 1 Processor -- start 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.838+0000 7f8bd1e00700 1 -- start start 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.838+0000 7f8bd1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.838+0000 7f8bd1e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc077fb0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.839+0000 7f8bcaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.839+0000 7f8bcaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50984/0 (socket says 172.21.15.60:50984) 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.839+0000 7f8bcaa00700 1 -- 172.21.15.60:0/162806299 learned_addr learned my addr 172.21.15.60:0/162806299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.839+0000 7f8bcaa00700 1 -- 172.21.15.60:0/162806299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc076690 con 0x7f8bcc077ba0 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bcaa00700 1 --2- 172.21.15.60:0/162806299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0098e0 tx=0x7f8bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42777b8c5b0130e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bc9600700 1 -- 172.21.15.60:0/162806299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc00b860 con 0x7f8bcc077ba0 2024-04-12T13:30:12.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bc9600700 1 -- 172.21.15.60:0/162806299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bbc00be90 con 0x7f8bcc077ba0 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bc9600700 1 -- 172.21.15.60:0/162806299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc0103c0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bd1e00700 1 -- 172.21.15.60:0/162806299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 msgr2=0x7f8bcc076150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.840+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/162806299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0098e0 tx=0x7f8bbc009250 comp rx=0 tx=0).stop 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.841+0000 7f8bd1e00700 1 -- 172.21.15.60:0/162806299 shutdown_connections 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.841+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/162806299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc076150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.841+0000 7f8bd1e00700 1 -- 172.21.15.60:0/162806299 >> 172.21.15.60:0/162806299 conn(0x7f8bcc0fe0a0 msgr2=0x7f8bcc1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.841+0000 7f8bd1e00700 1 -- 172.21.15.60:0/162806299 shutdown_connections 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.841+0000 7f8bd1e00700 1 -- 172.21.15.60:0/162806299 wait complete. 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bd1e00700 1 Processor -- start 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bd1e00700 1 -- start start 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bd1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:12.780 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bd1e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc113dc0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bcaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bcaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51000/0 (socket says 172.21.15.60:51000) 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.842+0000 7f8bcaa00700 1 -- 172.21.15.60:0/3635235174 learned_addr learned my addr 172.21.15.60:0/3635235174 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bcaa00700 1 -- 172.21.15.60:0/3635235174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0094f0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bcaa00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0105b0 tx=0x7f8bbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc010840 con 0x7f8bcc077ba0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bbc010e70 con 0x7f8bcc077ba0 2024-04-12T13:30:12.781 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc01ae30 con 0x7f8bcc077ba0 2024-04-12T13:30:12.783 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.843+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc113fc0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.844+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc114b30 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.844+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f8bbc01a430 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.845+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc05f5f0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.845+0000 7f8bc2a00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 0x7f8bb0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.845+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8bbc04a250 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.845+0000 7f8bca000700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 0x7f8bb0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.846+0000 7f8bca000700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 0x7f8bb0038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009990 tx=0x7f8bb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:11.850+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8bbc02b8c0 con 0x7f8bcc077ba0 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.083+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bcc0ff230 con 0x7f8bb0036850 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.092+0000 7f8bc2a00700 1 -- 172.21.15.60:0/3635235174 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f8bcc0ff230 con 0x7f8bb0036850 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 msgr2=0x7f8bb0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 0x7f8bb0038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009990 tx=0x7f8bb8006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:12.784 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 msgr2=0x7f8bcc113880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0105b0 tx=0x7f8bbc009250 comp rx=0 tx=0).stop 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 shutdown_connections 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f8bb0036850 0x7f8bb0038d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 --2- 172.21.15.60:0/3635235174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bcc077ba0 0x7f8bcc113880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.095+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 >> 172.21.15.60:0/3635235174 conn(0x7f8bcc0fe0a0 msgr2=0x7f8bcc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:12.785 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.096+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 shutdown_connections 2024-04-12T13:30:12.786 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:12.096+0000 7f8bd1e00700 1 -- 172.21.15.60:0/3635235174 wait complete. 2024-04-12T13:30:12.786 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying alertmanager service with default placement... 2024-04-12T13:30:13.613 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:13 smithi060 ceph-mon[29097]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:13.613 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:13 smithi060 ceph-mon[29097]: Saving service node-exporter spec with placement * 2024-04-12T13:30:14.480 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:14 smithi060 ceph-mon[29097]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:14.480 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:14 smithi060 ceph-mon[29097]: from='mgr.14120 172.21.15.60:0/262475821' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:14.768 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-12T13:30:14.769 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.926+0000 7fce54200700 1 Processor -- start 2024-04-12T13:30:14.769 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.927+0000 7fce54200700 1 -- start start 2024-04-12T13:30:14.769 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.927+0000 7fce54200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:14.769 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.927+0000 7fce54200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1059e0 con 0x7fce4c071330 2024-04-12T13:30:14.769 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.928+0000 7fce51800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:14.770 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.928+0000 7fce51800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51014/0 (socket says 172.21.15.60:51014) 2024-04-12T13:30:14.770 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.928+0000 7fce51800700 1 -- 172.21.15.60:0/58439875 learned_addr learned my addr 172.21.15.60:0/58439875 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.928+0000 7fce51800700 1 -- 172.21.15.60:0/58439875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c105b20 con 0x7fce4c071330 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.929+0000 7fce51800700 1 --2- 172.21.15.60:0/58439875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce400098e0 tx=0x7fce40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7355d77ac415f91b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.929+0000 7fce4be00700 1 -- 172.21.15.60:0/58439875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce4000b860 con 0x7fce4c071330 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.929+0000 7fce4be00700 1 -- 172.21.15.60:0/58439875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce4000be90 con 0x7fce4c071330 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.929+0000 7fce4be00700 1 -- 172.21.15.60:0/58439875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce400103c0 con 0x7fce4c071330 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 -- 172.21.15.60:0/58439875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 msgr2=0x7fce4c1054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:14.771 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 --2- 172.21.15.60:0/58439875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce400098e0 tx=0x7fce40009250 comp rx=0 tx=0).stop 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 -- 172.21.15.60:0/58439875 shutdown_connections 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 --2- 172.21.15.60:0/58439875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c1054a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 -- 172.21.15.60:0/58439875 >> 172.21.15.60:0/58439875 conn(0x7fce4c0fcfd0 msgr2=0x7fce4c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.930+0000 7fce54200700 1 -- 172.21.15.60:0/58439875 shutdown_connections 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.931+0000 7fce54200700 1 -- 172.21.15.60:0/58439875 wait complete. 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.931+0000 7fce54200700 1 Processor -- start 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce54200700 1 -- start start 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce54200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce54200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c10f960 con 0x7fce4c071330 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce51800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:14.773 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce51800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51030/0 (socket says 172.21.15.60:51030) 2024-04-12T13:30:14.774 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.932+0000 7fce51800700 1 -- 172.21.15.60:0/1766964892 learned_addr learned my addr 172.21.15.60:0/1766964892 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:14.774 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce51800700 1 -- 172.21.15.60:0/1766964892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400094f0 con 0x7fce4c071330 2024-04-12T13:30:14.774 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce51800700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce400105b0 tx=0x7fce40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:14.774 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce40010840 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce40010e70 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce4001ae30 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.933+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c10fb60 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.934+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c1106d0 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.935+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fce4001a430 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.935+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c05f5f0 con 0x7fce4c071330 2024-04-12T13:30:14.777 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.935+0000 7fce49600700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 0x7fce3403d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.935+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fce4004a100 con 0x7fce4c071330 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.935+0000 7fce50e00700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 0x7fce3403d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.936+0000 7fce50e00700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 0x7fce3403d180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce38009990 tx=0x7fce38006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:13.940+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fce4002b4d0 con 0x7fce4c071330 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.167+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fce4c1112b0 con 0x7fce3403acd0 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.176+0000 7fce49600700 1 -- 172.21.15.60:0/1766964892 <== mgr.14120 v2:172.21.15.60:6800/1558416897 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fce4c1112b0 con 0x7fce3403acd0 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.179+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 msgr2=0x7fce3403d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.179+0000 7fce54200700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 0x7fce3403d180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce38009990 tx=0x7fce38006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.179+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 msgr2=0x7fce4c10f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.179+0000 7fce54200700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce400105b0 tx=0x7fce40009250 comp rx=0 tx=0).stop 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 shutdown_connections 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fce3403acd0 0x7fce3403d180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 --2- 172.21.15.60:0/1766964892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce4c071330 0x7fce4c10f420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:14.778 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 >> 172.21.15.60:0/1766964892 conn(0x7fce4c0fcfd0 msgr2=0x7fce4c103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:14.779 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 shutdown_connections 2024-04-12T13:30:14.779 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:14.180+0000 7fce54200700 1 -- 172.21.15.60:0/1766964892 wait complete. 2024-04-12T13:30:15.411 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:15 smithi060 ceph-mon[29097]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:15.411 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:15 smithi060 ceph-mon[29097]: Saving service alertmanager spec with placement count:1 2024-04-12T13:30:16.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.409+0000 7f769aa00700 1 Processor -- start 2024-04-12T13:30:16.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.409+0000 7f769aa00700 1 -- start start 2024-04-12T13:30:16.297 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.410+0000 7f769aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.410+0000 7f769aa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76941030b0 con 0x7f7694071360 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.410+0000 7f7699600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.411+0000 7f7699600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51042/0 (socket says 172.21.15.60:51042) 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.411+0000 7f7699600700 1 -- 172.21.15.60:0/398258473 learned_addr learned my addr 172.21.15.60:0/398258473 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.411+0000 7f7699600700 1 -- 172.21.15.60:0/398258473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694107c00 con 0x7f7694071360 2024-04-12T13:30:16.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.411+0000 7f7699600700 1 --2- 172.21.15.60:0/398258473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76880098e0 tx=0x7f7688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03251d8ae713a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f7693e00700 1 -- 172.21.15.60:0/398258473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f768800b860 con 0x7f7694071360 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f7693e00700 1 -- 172.21.15.60:0/398258473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f768800be90 con 0x7f7694071360 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f7693e00700 1 -- 172.21.15.60:0/398258473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76880103c0 con 0x7f7694071360 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f769aa00700 1 -- 172.21.15.60:0/398258473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 msgr2=0x7f76941076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f769aa00700 1 --2- 172.21.15.60:0/398258473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76880098e0 tx=0x7f7688009250 comp rx=0 tx=0).stop 2024-04-12T13:30:16.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f769aa00700 1 -- 172.21.15.60:0/398258473 shutdown_connections 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f769aa00700 1 --2- 172.21.15.60:0/398258473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f76941076c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.412+0000 7f769aa00700 1 -- 172.21.15.60:0/398258473 >> 172.21.15.60:0/398258473 conn(0x7f76940fcd30 msgr2=0x7f76940ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.413+0000 7f769aa00700 1 -- 172.21.15.60:0/398258473 shutdown_connections 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.413+0000 7f769aa00700 1 -- 172.21.15.60:0/398258473 wait complete. 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.413+0000 7f769aa00700 1 Processor -- start 2024-04-12T13:30:16.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f769aa00700 1 -- start start 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f769aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f769aa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694113c40 con 0x7f7694071360 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f7699600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f7699600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51052/0 (socket says 172.21.15.60:51052) 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.414+0000 7f7699600700 1 -- 172.21.15.60:0/112660474 learned_addr learned my addr 172.21.15.60:0/112660474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f7699600700 1 -- 172.21.15.60:0/112660474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880094f0 con 0x7f7694071360 2024-04-12T13:30:16.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f7699600700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76880105b0 tx=0x7f7688009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7688010840 con 0x7f7694071360 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7688010e70 con 0x7f7694071360 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f768801ae30 con 0x7f7694071360 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7694113e40 con 0x7f7694071360 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.415+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941149b0 con 0x7f7694071360 2024-04-12T13:30:16.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.417+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f768801a430 con 0x7f7694071360 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.416+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769405f5f0 con 0x7f7694071360 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.417+0000 7f7691600700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 0x7f767c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.417+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f768804a150 con 0x7f7694071360 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.417+0000 7f7698c00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 0x7f767c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.418+0000 7f7698c00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 0x7f767c038d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7680009990 tx=0x7f7680006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:16.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.422+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f768802b4d0 con 0x7f7694071360 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.635+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f769404bed0 con 0x7f7694071360 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.644+0000 7f7691600700 1 -- 172.21.15.60:0/112660474 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f768802b2f0 con 0x7f7694071360 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 msgr2=0x7f767c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 0x7f767c038d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7680009990 tx=0x7f7680006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 msgr2=0x7f7694113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76880105b0 tx=0x7f7688009250 comp rx=0 tx=0).stop 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 shutdown_connections 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f767c0368a0 0x7f767c038d50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 --2- 172.21.15.60:0/112660474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694071360 0x7f7694113700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 >> 172.21.15.60:0/112660474 conn(0x7f76940fcd30 msgr2=0x7f76940fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 shutdown_connections 2024-04-12T13:30:16.305 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:15.647+0000 7f769aa00700 1 -- 172.21.15.60:0/112660474 wait complete. 2024-04-12T13:30:16.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:16 smithi060 ceph-mon[29097]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:16.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:16 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/112660474' entity='client.admin' 2024-04-12T13:30:17.835 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.918+0000 7fda2e000700 1 Processor -- start 2024-04-12T13:30:17.835 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.918+0000 7fda2e000700 1 -- start start 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.918+0000 7fda2e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.918+0000 7fda2e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2807a0e0 con 0x7fda28079700 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.919+0000 7fda27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.919+0000 7fda27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51062/0 (socket says 172.21.15.60:51062) 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.919+0000 7fda27400700 1 -- 172.21.15.60:0/570457210 learned_addr learned my addr 172.21.15.60:0/570457210 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.920+0000 7fda27400700 1 -- 172.21.15.60:0/570457210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2807a220 con 0x7fda28079700 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.920+0000 7fda27400700 1 --2- 172.21.15.60:0/570457210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda180098e0 tx=0x7fda18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfc6dc623276ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.920+0000 7fda26000700 1 -- 172.21.15.60:0/570457210 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda1800b860 con 0x7fda28079700 2024-04-12T13:30:17.836 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.920+0000 7fda26000700 1 -- 172.21.15.60:0/570457210 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda1800be90 con 0x7fda28079700 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.920+0000 7fda26000700 1 -- 172.21.15.60:0/570457210 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda180103c0 con 0x7fda28079700 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 -- 172.21.15.60:0/570457210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 msgr2=0x7fda28079b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 --2- 172.21.15.60:0/570457210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda180098e0 tx=0x7fda18009250 comp rx=0 tx=0).stop 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 -- 172.21.15.60:0/570457210 shutdown_connections 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 --2- 172.21.15.60:0/570457210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28079b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 -- 172.21.15.60:0/570457210 >> 172.21.15.60:0/570457210 conn(0x7fda28078350 msgr2=0x7fda28078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 -- 172.21.15.60:0/570457210 shutdown_connections 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.921+0000 7fda2e000700 1 -- 172.21.15.60:0/570457210 wait complete. 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.922+0000 7fda2e000700 1 Processor -- start 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.922+0000 7fda2e000700 1 -- start start 2024-04-12T13:30:17.837 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.922+0000 7fda2e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.922+0000 7fda2e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28118150 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.923+0000 7fda27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.923+0000 7fda27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51072/0 (socket says 172.21.15.60:51072) 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.923+0000 7fda27400700 1 -- 172.21.15.60:0/2587555474 learned_addr learned my addr 172.21.15.60:0/2587555474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.923+0000 7fda27400700 1 -- 172.21.15.60:0/2587555474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda180094f0 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.923+0000 7fda27400700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda180105b0 tx=0x7fda18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.924+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda18010840 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.924+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda18010e70 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.924+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda1801ae30 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.924+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda28118350 con 0x7fda28079700 2024-04-12T13:30:17.838 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.924+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda28118ec0 con 0x7fda28079700 2024-04-12T13:30:17.839 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.925+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fda1801a430 con 0x7fda28079700 2024-04-12T13:30:17.839 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.925+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2805f5f0 con 0x7fda28079700 2024-04-12T13:30:17.839 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.925+0000 7fda1f400700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 0x7fda0c038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:17.839 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.926+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fda1804a210 con 0x7fda28079700 2024-04-12T13:30:17.841 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.926+0000 7fda26a00700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 0x7fda0c038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:17.841 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.927+0000 7fda26a00700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 0x7fda0c038da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda14009990 tx=0x7fda14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:17.841 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:16.931+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fda1802b4d0 con 0x7fda28079700 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.146+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fda2804bed0 con 0x7fda28079700 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.150+0000 7fda1f400700 1 -- 172.21.15.60:0/2587555474 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fda1802b2f0 con 0x7fda28079700 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.153+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 msgr2=0x7fda0c038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.153+0000 7fda2e000700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 0x7fda0c038da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda14009990 tx=0x7fda14006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.153+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 msgr2=0x7fda28117c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.153+0000 7fda2e000700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda180105b0 tx=0x7fda18009250 comp rx=0 tx=0).stop 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 shutdown_connections 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fda0c0368f0 0x7fda0c038da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 --2- 172.21.15.60:0/2587555474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28079700 0x7fda28117c10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 >> 172.21.15.60:0/2587555474 conn(0x7fda28078350 msgr2=0x7fda28102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:17.842 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 shutdown_connections 2024-04-12T13:30:17.843 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:17.154+0000 7fda2e000700 1 -- 172.21.15.60:0/2587555474 wait complete. 2024-04-12T13:30:17.843 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling the dashboard module... 2024-04-12T13:30:18.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:18 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2587555474' entity='client.admin' 2024-04-12T13:30:18.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:18 smithi060 ceph-mon[29097]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:19.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:19 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/436170718' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-12T13:30:19.882 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.436+0000 7fbdeec00700 1 Processor -- start 2024-04-12T13:30:19.882 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.437+0000 7fbdeec00700 1 -- start start 2024-04-12T13:30:19.882 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.437+0000 7fbdeec00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.437+0000 7fbdeec00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde807d420 con 0x7fbde807ca40 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.438+0000 7fbde7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.438+0000 7fbde7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51086/0 (socket says 172.21.15.60:51086) 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.438+0000 7fbde7e00700 1 -- 172.21.15.60:0/3441023605 learned_addr learned my addr 172.21.15.60:0/3441023605 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.438+0000 7fbde7e00700 1 -- 172.21.15.60:0/3441023605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde807d560 con 0x7fbde807ca40 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.439+0000 7fbde7e00700 1 --2- 172.21.15.60:0/3441023605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098e0 tx=0x7fbdd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4eeb73af4d2fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.439+0000 7fbde6a00700 1 -- 172.21.15.60:0/3441023605 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdd800b860 con 0x7fbde807ca40 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.439+0000 7fbde6a00700 1 -- 172.21.15.60:0/3441023605 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdd800be90 con 0x7fbde807ca40 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.439+0000 7fbde6a00700 1 -- 172.21.15.60:0/3441023605 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdd80103c0 con 0x7fbde807ca40 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 -- 172.21.15.60:0/3441023605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 msgr2=0x7fbde807ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 --2- 172.21.15.60:0/3441023605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098e0 tx=0x7fbdd8009250 comp rx=0 tx=0).stop 2024-04-12T13:30:19.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 -- 172.21.15.60:0/3441023605 shutdown_connections 2024-04-12T13:30:19.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 --2- 172.21.15.60:0/3441023605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde807ce50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:19.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 -- 172.21.15.60:0/3441023605 >> 172.21.15.60:0/3441023605 conn(0x7fbde8078350 msgr2=0x7fbde807a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:19.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 -- 172.21.15.60:0/3441023605 shutdown_connections 2024-04-12T13:30:19.885 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.440+0000 7fbdeec00700 1 -- 172.21.15.60:0/3441023605 wait complete. 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.441+0000 7fbdeec00700 1 Processor -- start 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.441+0000 7fbdeec00700 1 -- start start 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbdeec00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbdeec00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8118150 con 0x7fbde807ca40 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbde7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbde7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51090/0 (socket says 172.21.15.60:51090) 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbde7e00700 1 -- 172.21.15.60:0/436170718 learned_addr learned my addr 172.21.15.60:0/436170718 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.442+0000 7fbde7e00700 1 -- 172.21.15.60:0/436170718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80094f0 con 0x7fbde807ca40 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbde7e00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006b00 tx=0x7fbdd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdd8010840 con 0x7fbde807ca40 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdd8010e70 con 0x7fbde807ca40 2024-04-12T13:30:19.886 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdd801ae70 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8118350 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.443+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8118ec0 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.445+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fbdd801a780 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.445+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde805f5f0 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.445+0000 7fbddfe00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 0x7fbdcc038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.445+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbdd804aac0 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.445+0000 7fbde7400700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 0x7fbdcc038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.446+0000 7fbde7400700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 0x7fbdcc038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009990 tx=0x7fbdd4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.450+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbdd804ce60 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:18.724+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fbde804bed0 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.168+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fbdd802e960 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.171+0000 7fbddfe00700 1 -- 172.21.15.60:0/436170718 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fbdd8017780 con 0x7fbde807ca40 2024-04-12T13:30:19.887 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 msgr2=0x7fbdcc038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 0x7fbdcc038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009990 tx=0x7fbdd4006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 msgr2=0x7fbde8117c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006b00 tx=0x7fbdd8009250 comp rx=0 tx=0).stop 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 shutdown_connections 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7fbdcc0368a0 0x7fbdcc038d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 --2- 172.21.15.60:0/436170718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde807ca40 0x7fbde8117c10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 >> 172.21.15.60:0/436170718 conn(0x7fbde8078350 msgr2=0x7fbde8079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 shutdown_connections 2024-04-12T13:30:19.888 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:19.174+0000 7fbdeec00700 1 -- 172.21.15.60:0/436170718 wait complete. 2024-04-12T13:30:20.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:20 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/436170718' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-12T13:30:20.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:20 smithi060 ceph-mon[29097]: mgrmap e9: smithi060.bpzacg(active, since 31s) 2024-04-12T13:30:21.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:21 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4078765765' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-12T13:30:21.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:30:21.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-12T13:30:21.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T13:30:21.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "smithi060.bpzacg", 2024-04-12T13:30:21.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-12T13:30:21.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:30:21.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.452+0000 7f2834a00700 1 Processor -- start 2024-04-12T13:30:21.503 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.452+0000 7f2834a00700 1 -- start start 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.453+0000 7f2834a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.453+0000 7f2834a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830079000 con 0x7f2830078bf0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.453+0000 7f282de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.453+0000 7f282de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45716/0 (socket says 172.21.15.60:45716) 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.453+0000 7f282de00700 1 -- 172.21.15.60:0/3686355876 learned_addr learned my addr 172.21.15.60:0/3686355876 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.454+0000 7f282de00700 1 -- 172.21.15.60:0/3686355876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830079140 con 0x7f2830078bf0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.454+0000 7f282de00700 1 --2- 172.21.15.60:0/3686355876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28200098e0 tx=0x7f2820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7cc208275de4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.454+0000 7f282ca00700 1 -- 172.21.15.60:0/3686355876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f282000b860 con 0x7f2830078bf0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.454+0000 7f282ca00700 1 -- 172.21.15.60:0/3686355876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f282000be90 con 0x7f2830078bf0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.454+0000 7f282ca00700 1 -- 172.21.15.60:0/3686355876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28200103c0 con 0x7f2830078bf0 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 -- 172.21.15.60:0/3686355876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 msgr2=0x7f2830077240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:21.504 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 --2- 172.21.15.60:0/3686355876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28200098e0 tx=0x7f2820009250 comp rx=0 tx=0).stop 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 -- 172.21.15.60:0/3686355876 shutdown_connections 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 --2- 172.21.15.60:0/3686355876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830077240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 -- 172.21.15.60:0/3686355876 >> 172.21.15.60:0/3686355876 conn(0x7f28300fe120 msgr2=0x7f2830100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 -- 172.21.15.60:0/3686355876 shutdown_connections 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.455+0000 7f2834a00700 1 -- 172.21.15.60:0/3686355876 wait complete. 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.456+0000 7f2834a00700 1 Processor -- start 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f2834a00700 1 -- start start 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f2834a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f2834a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830113d40 con 0x7f2830078bf0 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f282de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f282de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45728/0 (socket says 172.21.15.60:45728) 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.457+0000 7f282de00700 1 -- 172.21.15.60:0/4078765765 learned_addr learned my addr 172.21.15.60:0/4078765765 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.458+0000 7f282de00700 1 -- 172.21.15.60:0/4078765765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200094f0 con 0x7f2830078bf0 2024-04-12T13:30:21.505 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.458+0000 7f282de00700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2820006d40 tx=0x7f2820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.458+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2820010840 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.459+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2820010e70 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.459+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2820024ea0 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.459+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2830113f40 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.459+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2830114ab0 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.460+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f2820024780 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.460+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283005f5f0 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.460+0000 7f2826000700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 0x7f2814038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.460+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f282004a6d0 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.461+0000 7f282d400700 1 -- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 msgr2=0x7f2814038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.461+0000 7f282d400700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 0x7f2814038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.465+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f282002c930 con 0x7f2830078bf0 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.662+0000 7f282d400700 1 -- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 msgr2=0x7f2814038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.662+0000 7f282d400700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 0x7f2814038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.832+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2830114e50 con 0x7f2830078bf0 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.833+0000 7f2826000700 1 -- 172.21.15.60:0/4078765765 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f282002c340 con 0x7f2830078bf0 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.836+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 msgr2=0x7f2814038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.836+0000 7f2834a00700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 0x7f2814038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.836+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 msgr2=0x7f2830113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.836+0000 7f2834a00700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2820006d40 tx=0x7f2820009250 comp rx=0 tx=0).stop 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.836+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 shutdown_connections 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.837+0000 7f2834a00700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f28140368a0 0x7f2814038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.837+0000 7f2834a00700 1 --2- 172.21.15.60:0/4078765765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830078bf0 0x7f2830113800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.837+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 >> 172.21.15.60:0/4078765765 conn(0x7f28300fe120 msgr2=0x7f28300feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.837+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 shutdown_connections 2024-04-12T13:30:21.507 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:20.837+0000 7f2834a00700 1 -- 172.21.15.60:0/4078765765 wait complete. 2024-04-12T13:30:21.508 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-04-12T13:30:21.508 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 9... 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: Active manager daemon smithi060.bpzacg restarted 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: osdmap e3: 0 total, 0 up, 0 in 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: mgrmap e10: smithi060.bpzacg(active, starting, since 0.00508027s) 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:30:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:30:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:28 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:30:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:29 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:30:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:29 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:30:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:29 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:30:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:29 smithi060 ceph-mon[29097]: mgrmap e11: smithi060.bpzacg(active, since 1.0074s) 2024-04-12T13:30:30.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:30 smithi060 ceph-mon[29097]: [12/Apr/2024:13:30:29] ENGINE Bus STARTING 2024-04-12T13:30:30.507 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:30 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:30.516 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.088+0000 7f25c3e00700 1 Processor -- start 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.089+0000 7f25c3e00700 1 -- start start 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.089+0000 7f25c3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:30.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.089+0000 7f25c3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4103140 con 0x7f25c4076bd0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.090+0000 7f25c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.090+0000 7f25c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45736/0 (socket says 172.21.15.60:45736) 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.090+0000 7f25c2a00700 1 -- 172.21.15.60:0/1110140953 learned_addr learned my addr 172.21.15.60:0/1110140953 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.090+0000 7f25c2a00700 1 -- 172.21.15.60:0/1110140953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4107c90 con 0x7f25c4076bd0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.091+0000 7f25c2a00700 1 --2- 172.21.15.60:0/1110140953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25b40098e0 tx=0x7f25b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f62aeb511edc2d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.091+0000 7f25c1600700 1 -- 172.21.15.60:0/1110140953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25b400b860 con 0x7f25c4076bd0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.091+0000 7f25c1600700 1 -- 172.21.15.60:0/1110140953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25b400be90 con 0x7f25c4076bd0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.091+0000 7f25c1600700 1 -- 172.21.15.60:0/1110140953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25b40103c0 con 0x7f25c4076bd0 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 -- 172.21.15.60:0/1110140953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 msgr2=0x7f25c4107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1110140953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25b40098e0 tx=0x7f25b4009250 comp rx=0 tx=0).stop 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 -- 172.21.15.60:0/1110140953 shutdown_connections 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1110140953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4107750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 -- 172.21.15.60:0/1110140953 >> 172.21.15.60:0/1110140953 conn(0x7f25c40fcda0 msgr2=0x7f25c40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 -- 172.21.15.60:0/1110140953 shutdown_connections 2024-04-12T13:30:30.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.092+0000 7f25c3e00700 1 -- 172.21.15.60:0/1110140953 wait complete. 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.093+0000 7f25c3e00700 1 Processor -- start 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.093+0000 7f25c3e00700 1 -- start start 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4113bc0 con 0x7f25c4076bd0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45752/0 (socket says 172.21.15.60:45752) 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c2a00700 1 -- 172.21.15.60:0/1185340859 learned_addr learned my addr 172.21.15.60:0/1185340859 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.094+0000 7f25c2a00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40094f0 con 0x7f25c4076bd0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25c2a00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006d40 tx=0x7f25b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25b4010840 con 0x7f25c4076bd0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25b4010e70 con 0x7f25c4076bd0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25b4024ea0 con 0x7f25c4076bd0 2024-04-12T13:30:30.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c4113dc0 con 0x7f25c4076bd0 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.095+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c4114930 con 0x7f25c4076bd0 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.096+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f25b40109a0 con 0x7f25c4076bd0 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.097+0000 7f25baa00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.097+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25a8039460 con 0x7f25a80368a0 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.097+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f25b404a7c0 con 0x7f25c4076bd0 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.097+0000 7f25c2000700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.097+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.298+0000 7f25c2000700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.298+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.699+0000 7f25c2000700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:22.699+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:23.500+0000 7f25c2000700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:23.500+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T13:30:30.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:25.102+0000 7f25c2000700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1558416897 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:25.102+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:28.133+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7f25b4024780 con 0x7f25c4076bd0 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:28.134+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 msgr2=0x7f25a8038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:28.134+0000 7f25baa00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.135+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f25b400fba0 con 0x7f25c4076bd0 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.136+0000 7f25baa00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 0x7f25a803c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.136+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25a8039460 con 0x7f25a803a090 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.137+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 0x7f25a803c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.138+0000 7f25c2000700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 0x7f25a803c470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25b00039d0 tx=0x7f25b0009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.139+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f25a8039460 con 0x7f25a803a090 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.145+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f25c4114250 con 0x7f25a803a090 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25baa00700 1 -- 172.21.15.60:0/1185340859 <== mgr.14162 v2:172.21.15.60:6800/4071152381 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f25c4114250 con 0x7f25a803a090 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 msgr2=0x7f25a803c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 0x7f25a803c470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f25b00039d0 tx=0x7f25b0009350 comp rx=0 tx=0).stop 2024-04-12T13:30:30.528 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 msgr2=0x7f25c4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006d40 tx=0x7f25b4009250 comp rx=0 tx=0).stop 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 shutdown_connections 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f25a803a090 0x7f25a803c470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25c4076bd0 0x7f25c4113680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 --2- 172.21.15.60:0/1185340859 >> [v2:172.21.15.60:6800/1558416897,v1:172.21.15.60:6801/1558416897] conn(0x7f25a80368a0 0x7f25a8038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 >> 172.21.15.60:0/1185340859 conn(0x7f25c40fcda0 msgr2=0x7f25c40fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.146+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 shutdown_connections 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:29.147+0000 7f25c3e00700 1 -- 172.21.15.60:0/1185340859 wait complete. 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 9 is available 2024-04-12T13:30:30.529 INFO:teuthology.orchestra.run.smithi060.stdout:Generating a dashboard self-signed certificate... 2024-04-12T13:30:31.355 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:31 smithi060 ceph-mon[29097]: [12/Apr/2024:13:30:29] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:30:31.355 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:31 smithi060 ceph-mon[29097]: [12/Apr/2024:13:30:29] ENGINE Bus STARTED 2024-04-12T13:30:31.355 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:31 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:31.355 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:31 smithi060 ceph-mon[29097]: mgrmap e12: smithi060.bpzacg(active, since 2s) 2024-04-12T13:30:32.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-12T13:30:32.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.083+0000 7f774ce00700 1 Processor -- start 2024-04-12T13:30:32.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.083+0000 7f774ce00700 1 -- start start 2024-04-12T13:30:32.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.083+0000 7f774ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:32.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.083+0000 7f774ce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77481046b0 con 0x7f7748103d60 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.084+0000 7f7747400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.084+0000 7f7747400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32914/0 (socket says 172.21.15.60:32914) 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.084+0000 7f7747400700 1 -- 172.21.15.60:0/2333934418 learned_addr learned my addr 172.21.15.60:0/2333934418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.084+0000 7f7747400700 1 -- 172.21.15.60:0/2333934418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748102380 con 0x7f7748103d60 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.085+0000 7f7747400700 1 --2- 172.21.15.60:0/2333934418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77380098e0 tx=0x7f7738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a63094aee7c645 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:32.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.085+0000 7f7746000700 1 -- 172.21.15.60:0/2333934418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f773800b860 con 0x7f7748103d60 2024-04-12T13:30:32.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.085+0000 7f7746000700 1 -- 172.21.15.60:0/2333934418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f773800be90 con 0x7f7748103d60 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.085+0000 7f7746000700 1 -- 172.21.15.60:0/2333934418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77380103c0 con 0x7f7748103d60 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 -- 172.21.15.60:0/2333934418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 msgr2=0x7f7748104170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 --2- 172.21.15.60:0/2333934418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77380098e0 tx=0x7f7738009250 comp rx=0 tx=0).stop 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 -- 172.21.15.60:0/2333934418 shutdown_connections 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 --2- 172.21.15.60:0/2333934418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748104170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 -- 172.21.15.60:0/2333934418 >> 172.21.15.60:0/2333934418 conn(0x7f77480fde90 msgr2=0x7f77481002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 -- 172.21.15.60:0/2333934418 shutdown_connections 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.086+0000 7f774ce00700 1 -- 172.21.15.60:0/2333934418 wait complete. 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.087+0000 7f774ce00700 1 Processor -- start 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.087+0000 7f774ce00700 1 -- start start 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.088+0000 7f774ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.088+0000 7f774ce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748111960 con 0x7f7748103d60 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.088+0000 7f7747400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:32.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.088+0000 7f7747400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32926/0 (socket says 172.21.15.60:32926) 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.088+0000 7f7747400700 1 -- 172.21.15.60:0/1252646140 learned_addr learned my addr 172.21.15.60:0/1252646140 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f7747400700 1 -- 172.21.15.60:0/1252646140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380094f0 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f7747400700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77380090b0 tx=0x7f7738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7738010840 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7738010e70 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7738024e90 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.089+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7748111b60 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.090+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77481126d0 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.091+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f7738024430 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.091+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748111ff0 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.091+0000 7f773f400700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 0x7f772c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.092+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f773804a940 con 0x7f7748103d60 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.092+0000 7f7746a00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 0x7f772c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:32.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.093+0000 7f7746a00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 0x7f772c038d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7734009990 tx=0x7f7734006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.097+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f773802c910 con 0x7f7748103d60 2024-04-12T13:30:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.353+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f77480fefa0 con 0x7f772c0368a0 2024-04-12T13:30:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.465+0000 7f773f400700 1 -- 172.21.15.60:0/1252646140 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f77480fefa0 con 0x7f772c0368a0 2024-04-12T13:30:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.467+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 msgr2=0x7f772c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.467+0000 7f774ce00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 0x7f772c038d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7734009990 tx=0x7f7734006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.467+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 msgr2=0x7f7748111420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.467+0000 7f774ce00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77380090b0 tx=0x7f7738009250 comp rx=0 tx=0).stop 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 shutdown_connections 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f772c0368a0 0x7f772c038d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 --2- 172.21.15.60:0/1252646140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7748103d60 0x7f7748111420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 >> 172.21.15.60:0/1252646140 conn(0x7f77480fde90 msgr2=0x7f77480fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 shutdown_connections 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:31.468+0000 7f774ce00700 1 -- 172.21.15.60:0/1252646140 wait complete. 2024-04-12T13:30:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial admin user... 2024-04-12T13:30:32.758 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:32 smithi060 ceph-mon[29097]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:32.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:32.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:32.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:33.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:33 smithi060 ceph-mon[29097]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:33 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4khv6H0o/CUnCfDkO2UjYOusL981nKqmwcQ.rsW9DPtNOwzmQZJwm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1712928633, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-12T13:30:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.810+0000 7f5ce5400700 1 Processor -- start 2024-04-12T13:30:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.810+0000 7f5ce5400700 1 -- start start 2024-04-12T13:30:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.811+0000 7f5ce5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.811+0000 7f5ce5400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01055d0 con 0x7f5ce0104bf0 2024-04-12T13:30:34.853 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.811+0000 7f5cde800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:34.853 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.811+0000 7f5cde800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32936/0 (socket says 172.21.15.60:32936) 2024-04-12T13:30:34.853 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.811+0000 7f5cde800700 1 -- 172.21.15.60:0/2644995084 learned_addr learned my addr 172.21.15.60:0/2644995084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:34.854 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.812+0000 7f5cde800700 1 -- 172.21.15.60:0/2644995084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0105710 con 0x7f5ce0104bf0 2024-04-12T13:30:34.854 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.812+0000 7f5cde800700 1 --2- 172.21.15.60:0/2644995084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00098e0 tx=0x7f5cd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5054ea1c2c595917 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.812+0000 7f5cdd400700 1 -- 172.21.15.60:0/2644995084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd000b860 con 0x7f5ce0104bf0 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.812+0000 7f5cdd400700 1 -- 172.21.15.60:0/2644995084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd000be90 con 0x7f5ce0104bf0 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.812+0000 7f5cdd400700 1 -- 172.21.15.60:0/2644995084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd00103c0 con 0x7f5ce0104bf0 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 -- 172.21.15.60:0/2644995084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 msgr2=0x7f5ce0105000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 --2- 172.21.15.60:0/2644995084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00098e0 tx=0x7f5cd0009250 comp rx=0 tx=0).stop 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 -- 172.21.15.60:0/2644995084 shutdown_connections 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 --2- 172.21.15.60:0/2644995084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce0105000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:34.855 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 -- 172.21.15.60:0/2644995084 >> 172.21.15.60:0/2644995084 conn(0x7f5ce0100590 msgr2=0x7f5ce0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 -- 172.21.15.60:0/2644995084 shutdown_connections 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.813+0000 7f5ce5400700 1 -- 172.21.15.60:0/2644995084 wait complete. 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.814+0000 7f5ce5400700 1 Processor -- start 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.814+0000 7f5ce5400700 1 -- start start 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5ce5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5ce5400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0113d30 con 0x7f5ce0104bf0 2024-04-12T13:30:34.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5cde800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5cde800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32952/0 (socket says 172.21.15.60:32952) 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5cde800700 1 -- 172.21.15.60:0/3066185815 learned_addr learned my addr 172.21.15.60:0/3066185815 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.815+0000 7f5cde800700 1 -- 172.21.15.60:0/3066185815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd00094f0 con 0x7f5ce0104bf0 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5cde800700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006b00 tx=0x7f5cd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd0010840 con 0x7f5ce0104bf0 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd0010e70 con 0x7f5ce0104bf0 2024-04-12T13:30:34.858 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd001ae70 con 0x7f5ce0104bf0 2024-04-12T13:30:34.859 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce0113f30 con 0x7f5ce0104bf0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.816+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce0114aa0 con 0x7f5ce0104bf0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.817+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f5cd001a780 con 0x7f5ce0104bf0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.818+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce005f5f0 con 0x7f5ce0104bf0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.818+0000 7f5cd6a00700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 0x7f5cc4038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.818+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5cd004ad10 con 0x7f5ce0104bf0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.818+0000 7f5cdde00700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 0x7f5cc4038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:34.861 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.819+0000 7f5cdde00700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 0x7f5cc4038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009990 tx=0x7f5ccc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:32.824+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5cd001a430 con 0x7f5ce0104bf0 2024-04-12T13:30:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.069+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5ce005f410 con 0x7f5cc40368f0 2024-04-12T13:30:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.337+0000 7f5cd6a00700 1 -- 172.21.15.60:0/3066185815 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f5ce005f410 con 0x7f5cc40368f0 2024-04-12T13:30:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 msgr2=0x7f5cc4038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 0x7f5cc4038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009990 tx=0x7f5ccc006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 msgr2=0x7f5ce01137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006b00 tx=0x7f5cd0009250 comp rx=0 tx=0).stop 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 shutdown_connections 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f5cc40368f0 0x7f5cc4038da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 --2- 172.21.15.60:0/3066185815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0104bf0 0x7f5ce01137f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 >> 172.21.15.60:0/3066185815 conn(0x7f5ce0100590 msgr2=0x7f5ce0101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:34.864 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 shutdown_connections 2024-04-12T13:30:34.864 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:33.340+0000 7f5ce5400700 1 -- 172.21.15.60:0/3066185815 wait complete. 2024-04-12T13:30:34.864 INFO:teuthology.orchestra.run.smithi060.stdout:Fetching dashboard port number... 2024-04-12T13:30:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:35 smithi060 ceph-mon[29097]: mgrmap e13: smithi060.bpzacg(active, since 6s) 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 8443 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.513+0000 7f0c04400700 1 Processor -- start 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.513+0000 7f0c04400700 1 -- start start 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.514+0000 7f0c04400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.514+0000 7f0c04400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1032a0 con 0x7f0bfc102950 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.514+0000 7f0c01a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:36.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.514+0000 7f0c01a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32960/0 (socket says 172.21.15.60:32960) 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.514+0000 7f0c01a00700 1 -- 172.21.15.60:0/280576031 learned_addr learned my addr 172.21.15.60:0/280576031 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.515+0000 7f0c01a00700 1 -- 172.21.15.60:0/280576031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc1033e0 con 0x7f0bfc102950 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.515+0000 7f0c01a00700 1 --2- 172.21.15.60:0/280576031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00098e0 tx=0x7f0bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a5755e42e5bd3f server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.515+0000 7f0bfbe00700 1 -- 172.21.15.60:0/280576031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf000b860 con 0x7f0bfc102950 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.516+0000 7f0bfbe00700 1 -- 172.21.15.60:0/280576031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bf000be90 con 0x7f0bfc102950 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.516+0000 7f0bfbe00700 1 -- 172.21.15.60:0/280576031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf00103c0 con 0x7f0bfc102950 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.516+0000 7f0c04400700 1 -- 172.21.15.60:0/280576031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 msgr2=0x7f0bfc102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.516+0000 7f0c04400700 1 --2- 172.21.15.60:0/280576031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00098e0 tx=0x7f0bf0009250 comp rx=0 tx=0).stop 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.517+0000 7f0c04400700 1 -- 172.21.15.60:0/280576031 shutdown_connections 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.517+0000 7f0c04400700 1 --2- 172.21.15.60:0/280576031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc102d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.517+0000 7f0c04400700 1 -- 172.21.15.60:0/280576031 >> 172.21.15.60:0/280576031 conn(0x7f0bfc0fe110 msgr2=0x7f0bfc100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.517+0000 7f0c04400700 1 -- 172.21.15.60:0/280576031 shutdown_connections 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.517+0000 7f0c04400700 1 -- 172.21.15.60:0/280576031 wait complete. 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c04400700 1 Processor -- start 2024-04-12T13:30:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c04400700 1 -- start start 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c04400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c04400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0780a0 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c01a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c01a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32970/0 (socket says 172.21.15.60:32970) 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.518+0000 7f0c01a00700 1 -- 172.21.15.60:0/3419371163 learned_addr learned my addr 172.21.15.60:0/3419371163 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.519+0000 7f0c01a00700 1 -- 172.21.15.60:0/3419371163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00094f0 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.519+0000 7f0c01a00700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006b00 tx=0x7f0bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.519+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf0010840 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.519+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bf0010e70 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.520+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc076110 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.520+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf001ae70 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.520+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc076600 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.521+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc04bed0 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.521+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f0bf001a780 con 0x7f0bfc102950 2024-04-12T13:30:36.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.521+0000 7f0bf9600700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 0x7f0be4038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.521+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0bf004ae30 con 0x7f0bfc102950 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.522+0000 7f0c01000700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 0x7f0be4038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.522+0000 7f0c01000700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 0x7f0be4038e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009990 tx=0x7f0be8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.526+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0bf004f070 con 0x7f0bfc102950 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.744+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0bfc1046a0 con 0x7f0bfc102950 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.745+0000 7f0bf9600700 1 -- 172.21.15.60:0/3419371163 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0bf001a430 con 0x7f0bfc102950 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.747+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 msgr2=0x7f0be4038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.747+0000 7f0c04400700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 0x7f0be4038e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009990 tx=0x7f0be8006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.747+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 msgr2=0x7f0bfc077b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.747+0000 7f0c04400700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006b00 tx=0x7f0bf0009250 comp rx=0 tx=0).stop 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 shutdown_connections 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f0be4036990 0x7f0be4038e40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:36.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 --2- 172.21.15.60:0/3419371163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bfc102950 0x7f0bfc077b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:36.483 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 >> 172.21.15.60:0/3419371163 conn(0x7f0bfc0fe110 msgr2=0x7f0bfc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:36.483 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 shutdown_connections 2024-04-12T13:30:36.483 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:35.748+0000 7f0c04400700 1 -- 172.21.15.60:0/3419371163 wait complete. 2024-04-12T13:30:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T13:30:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-04-12T13:30:36.535 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T13:30:36.536 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-04-12T13:30:36.536 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-04-12T13:30:36.536 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-12T13:30:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph Dashboard is now available at: 2024-04-12T13:30:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: URL: https://smithi060.front.sepia.ceph.com:8443/ 2024-04-12T13:30:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: User: admin 2024-04-12T13:30:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: Password: gix8kisgox 2024-04-12T13:30:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:36.544 INFO:teuthology.orchestra.run.smithi060.stdout:Saving cluster configuration to /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config directory 2024-04-12T13:30:36.546 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling autotune for osd_memory_target 2024-04-12T13:30:36.727 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:36 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3419371163' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-12T13:30:38.069 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.154+0000 7f9efea00700 1 Processor -- start 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.155+0000 7f9efea00700 1 -- start start 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.155+0000 7f9efea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.155+0000 7f9efea00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef810ace0 con 0x7f9ef810a300 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.156+0000 7f9efd600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.156+0000 7f9efd600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32986/0 (socket says 172.21.15.60:32986) 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.156+0000 7f9efd600700 1 -- 172.21.15.60:0/1813997447 learned_addr learned my addr 172.21.15.60:0/1813997447 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.156+0000 7f9efd600700 1 -- 172.21.15.60:0/1813997447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef807c4e0 con 0x7f9ef810a300 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.156+0000 7f9efd600700 1 --2- 172.21.15.60:0/1813997447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0098e0 tx=0x7f9eec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2377a819fb9c8d32 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.157+0000 7f9ef7e00700 1 -- 172.21.15.60:0/1813997447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9eec00b860 con 0x7f9ef810a300 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.157+0000 7f9ef7e00700 1 -- 172.21.15.60:0/1813997447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eec00be90 con 0x7f9ef810a300 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.157+0000 7f9ef7e00700 1 -- 172.21.15.60:0/1813997447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9eec0103c0 con 0x7f9ef810a300 2024-04-12T13:30:38.070 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 -- 172.21.15.60:0/1813997447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 msgr2=0x7f9ef810a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:38.071 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 --2- 172.21.15.60:0/1813997447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0098e0 tx=0x7f9eec009250 comp rx=0 tx=0).stop 2024-04-12T13:30:38.071 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 -- 172.21.15.60:0/1813997447 shutdown_connections 2024-04-12T13:30:38.074 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 --2- 172.21.15.60:0/1813997447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef810a710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 -- 172.21.15.60:0/1813997447 >> 172.21.15.60:0/1813997447 conn(0x7f9ef8078010 msgr2=0x7f9ef807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 -- 172.21.15.60:0/1813997447 shutdown_connections 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.158+0000 7f9efea00700 1 -- 172.21.15.60:0/1813997447 wait complete. 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.159+0000 7f9efea00700 1 Processor -- start 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.159+0000 7f9efea00700 1 -- start start 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efea00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8117ef0 con 0x7f9ef810a300 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efd600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efd600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32992/0 (socket says 172.21.15.60:32992) 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efd600700 1 -- 172.21.15.60:0/1863523555 learned_addr learned my addr 172.21.15.60:0/1863523555 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:38.075 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.160+0000 7f9efd600700 1 -- 172.21.15.60:0/1863523555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0094f0 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9efd600700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0090b0 tx=0x7f9eec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9eec010840 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eec010e70 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9eec024e40 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef81180f0 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.161+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef8118c60 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.162+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f9eec024430 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.162+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8118580 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.163+0000 7f9ef5600700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 0x7f9ee0038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.163+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9eec04aa50 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.163+0000 7f9efcc00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 0x7f9ee0038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.164+0000 7f9efcc00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 0x7f9ee0038e40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009990 tx=0x7f9ee4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.168+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9eec02c930 con 0x7f9ef810a300 2024-04-12T13:30:38.076 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.384+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f9ef805f5f0 con 0x7f9ef810a300 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.385+0000 7f9ef5600700 1 -- 172.21.15.60:0/1863523555 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9eec02c340 con 0x7f9ef810a300 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 msgr2=0x7f9ee0038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 0x7f9ee0038e40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009990 tx=0x7f9ee4006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 msgr2=0x7f9ef81179b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0090b0 tx=0x7f9eec009250 comp rx=0 tx=0).stop 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 shutdown_connections 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f9ee0036990 0x7f9ee0038e40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 --2- 172.21.15.60:0/1863523555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef810a300 0x7f9ef81179b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 >> 172.21.15.60:0/1863523555 conn(0x7f9ef8078010 msgr2=0x7f9ef80789c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 shutdown_connections 2024-04-12T13:30:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:37.389+0000 7f9efea00700 1 -- 172.21.15.60:0/1863523555 wait complete. 2024-04-12T13:30:39.724 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.695+0000 7f6192000700 1 Processor -- start 2024-04-12T13:30:39.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.696+0000 7f6192000700 1 -- start start 2024-04-12T13:30:39.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.696+0000 7f6192000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:39.725 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.696+0000 7f6192000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c1032a0 con 0x7f618c102950 2024-04-12T13:30:39.727 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.696+0000 7f618b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.697+0000 7f618b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33004/0 (socket says 172.21.15.60:33004) 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.697+0000 7f618b400700 1 -- 172.21.15.60:0/487283192 learned_addr learned my addr 172.21.15.60:0/487283192 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.697+0000 7f618b400700 1 -- 172.21.15.60:0/487283192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c1033e0 con 0x7f618c102950 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.697+0000 7f618b400700 1 --2- 172.21.15.60:0/487283192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098e0 tx=0x7f617c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfbfa9d3c16818 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f618aa00700 1 -- 172.21.15.60:0/487283192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f617c00b860 con 0x7f618c102950 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f618aa00700 1 -- 172.21.15.60:0/487283192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f617c00be90 con 0x7f618c102950 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f618aa00700 1 -- 172.21.15.60:0/487283192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f617c0103c0 con 0x7f618c102950 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 -- 172.21.15.60:0/487283192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 msgr2=0x7f618c102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 --2- 172.21.15.60:0/487283192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098e0 tx=0x7f617c009250 comp rx=0 tx=0).stop 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 -- 172.21.15.60:0/487283192 shutdown_connections 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 --2- 172.21.15.60:0/487283192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c102d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 -- 172.21.15.60:0/487283192 >> 172.21.15.60:0/487283192 conn(0x7f618c0fe110 msgr2=0x7f618c100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:39.728 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.698+0000 7f6192000700 1 -- 172.21.15.60:0/487283192 shutdown_connections 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.699+0000 7f6192000700 1 -- 172.21.15.60:0/487283192 wait complete. 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.699+0000 7f6192000700 1 Processor -- start 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f6192000700 1 -- start start 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f6192000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f6192000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0780a0 con 0x7f618c102950 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f618b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:39.729 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f618b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33020/0 (socket says 172.21.15.60:33020) 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.700+0000 7f618b400700 1 -- 172.21.15.60:0/3298060121 learned_addr learned my addr 172.21.15.60:0/3298060121 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f618b400700 1 -- 172.21.15.60:0/3298060121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0094f0 con 0x7f618c102950 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f618b400700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f617c006b00 tx=0x7f617c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f617c010840 con 0x7f618c102950 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f617c010e70 con 0x7f618c102950 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f617c01ae70 con 0x7f618c102950 2024-04-12T13:30:39.733 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c076110 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.701+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c076600 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.703+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c04bed0 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.703+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f617c01a780 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.703+0000 7f6183400700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 0x7f6170038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.703+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f617c04ad70 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.703+0000 7f6183e00700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 0x7f6170038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.704+0000 7f6183e00700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 0x7f6170038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6174009990 tx=0x7f6174006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:38.709+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f617c04f070 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.046+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f618c1046a0 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.051+0000 7f6183400700 1 -- 172.21.15.60:0/3298060121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f617c01a430 con 0x7f618c102950 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 msgr2=0x7f6170038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 0x7f6170038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6174009990 tx=0x7f6174006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 msgr2=0x7f618c077b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:39.734 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f617c006b00 tx=0x7f617c009250 comp rx=0 tx=0).stop 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 shutdown_connections 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6170036990 0x7f6170038e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 --2- 172.21.15.60:0/3298060121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f618c102950 0x7f618c077b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 >> 172.21.15.60:0/3298060121 conn(0x7f618c0fe110 msgr2=0x7f618c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.054+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 shutdown_connections 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-04-12T13:30:39.055+0000 7f6192000700 1 -- 172.21.15.60:0/3298060121 wait complete. 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout:Or, if you are only running a single cluster on this host: 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-12T13:30:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: ceph telemetry on 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout:For more information see: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:30:39.736 INFO:teuthology.orchestra.run.smithi060.stdout:Bootstrap complete. 2024-04-12T13:30:39.863 INFO:tasks.cephadm:Fetching config... 2024-04-12T13:30:39.864 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:30:39.864 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-12T13:30:39.911 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-12T13:30:39.911 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:30:39.911 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-12T13:30:40.006 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-12T13:30:40.006 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:30:40.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/keyring of=/dev/stdout 2024-04-12T13:30:40.104 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-12T13:30:40.105 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:30:40.105 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-12T13:30:40.160 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-12T13:30:40.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6Ptvi2I/DRyGhqoxk2lxcuUWyu3bBhzc+12Ty3GZCLr1IPuXAHS13nt50Y/AEnmGZ2v1YNdjchZRcW7dqlt5DlNajvvCrw4RKupWAhg5oFdmBEuaB8i9/dFdDUnbgH+qN0btM9ls9nWFf0/bAB5Ei48uVjpkpCOJ/MGGNo2PbllpzLKnjhbhVrBHqmPkpEJI7eSQY8yvuK6rM41gzMxg9pbQPm8s7elGI5KAwMjWsGIj92wkAMIKdfu9CNJLN4d4whtjB9p9VXxYMwVUnZnOhTTO944hwDgJCH278hlW8BbFBzJmbxWHqoCmzoCkOEKI7+VraW0gfFC5omnjd1iKPA5+s4H0nyKX/pLG2pmfqcIL7NjH2lQe3jDAu78pt/HElUDKpbYz/ppy0/3sFMa5o469kSUs7NTVwn73mtC4nUGa22oAKw4iwBhPZ52aim/8FKrtSVgUT7E7E2ipx/0E83daIhf/A6HVUPgiSHsQuoLE0FxL9KwX+4jJEMhYBCs= ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-12T13:30:40.298 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:40 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3298060121' entity='client.admin' 2024-04-12T13:30:40.306 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6Ptvi2I/DRyGhqoxk2lxcuUWyu3bBhzc+12Ty3GZCLr1IPuXAHS13nt50Y/AEnmGZ2v1YNdjchZRcW7dqlt5DlNajvvCrw4RKupWAhg5oFdmBEuaB8i9/dFdDUnbgH+qN0btM9ls9nWFf0/bAB5Ei48uVjpkpCOJ/MGGNo2PbllpzLKnjhbhVrBHqmPkpEJI7eSQY8yvuK6rM41gzMxg9pbQPm8s7elGI5KAwMjWsGIj92wkAMIKdfu9CNJLN4d4whtjB9p9VXxYMwVUnZnOhTTO944hwDgJCH278hlW8BbFBzJmbxWHqoCmzoCkOEKI7+VraW0gfFC5omnjd1iKPA5+s4H0nyKX/pLG2pmfqcIL7NjH2lQe3jDAu78pt/HElUDKpbYz/ppy0/3sFMa5o469kSUs7NTVwn73mtC4nUGa22oAKw4iwBhPZ52aim/8FKrtSVgUT7E7E2ipx/0E83daIhf/A6HVUPgiSHsQuoLE0FxL9KwX+4jJEMhYBCs= ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:30:40.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6Ptvi2I/DRyGhqoxk2lxcuUWyu3bBhzc+12Ty3GZCLr1IPuXAHS13nt50Y/AEnmGZ2v1YNdjchZRcW7dqlt5DlNajvvCrw4RKupWAhg5oFdmBEuaB8i9/dFdDUnbgH+qN0btM9ls9nWFf0/bAB5Ei48uVjpkpCOJ/MGGNo2PbllpzLKnjhbhVrBHqmPkpEJI7eSQY8yvuK6rM41gzMxg9pbQPm8s7elGI5KAwMjWsGIj92wkAMIKdfu9CNJLN4d4whtjB9p9VXxYMwVUnZnOhTTO944hwDgJCH278hlW8BbFBzJmbxWHqoCmzoCkOEKI7+VraW0gfFC5omnjd1iKPA5+s4H0nyKX/pLG2pmfqcIL7NjH2lQe3jDAu78pt/HElUDKpbYz/ppy0/3sFMa5o469kSUs7NTVwn73mtC4nUGa22oAKw4iwBhPZ52aim/8FKrtSVgUT7E7E2ipx/0E83daIhf/A6HVUPgiSHsQuoLE0FxL9KwX+4jJEMhYBCs= ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-12T13:30:40.499 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6Ptvi2I/DRyGhqoxk2lxcuUWyu3bBhzc+12Ty3GZCLr1IPuXAHS13nt50Y/AEnmGZ2v1YNdjchZRcW7dqlt5DlNajvvCrw4RKupWAhg5oFdmBEuaB8i9/dFdDUnbgH+qN0btM9ls9nWFf0/bAB5Ei48uVjpkpCOJ/MGGNo2PbllpzLKnjhbhVrBHqmPkpEJI7eSQY8yvuK6rM41gzMxg9pbQPm8s7elGI5KAwMjWsGIj92wkAMIKdfu9CNJLN4d4whtjB9p9VXxYMwVUnZnOhTTO944hwDgJCH278hlW8BbFBzJmbxWHqoCmzoCkOEKI7+VraW0gfFC5omnjd1iKPA5+s4H0nyKX/pLG2pmfqcIL7NjH2lQe3jDAu78pt/HElUDKpbYz/ppy0/3sFMa5o469kSUs7NTVwn73mtC4nUGa22oAKw4iwBhPZ52aim/8FKrtSVgUT7E7E2ipx/0E83daIhf/A6HVUPgiSHsQuoLE0FxL9KwX+4jJEMhYBCs= ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:30:40.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-12T13:30:41.012 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.606+0000 7fa757e00700 1 -- 172.21.15.60:0/3771910622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 msgr2=0x7fa7580703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.606+0000 7fa757e00700 1 --2- 172.21.15.60:0/3771910622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa7580703b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7480048c0 tx=0x7fa748009e30 comp rx=0 tx=0).stop 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.607+0000 7fa757e00700 1 -- 172.21.15.60:0/3771910622 shutdown_connections 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.607+0000 7fa757e00700 1 --2- 172.21.15.60:0/3771910622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa7580703b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.607+0000 7fa757e00700 1 -- 172.21.15.60:0/3771910622 >> 172.21.15.60:0/3771910622 conn(0x7fa7580f8030 msgr2=0x7fa7580fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.607+0000 7fa757e00700 1 -- 172.21.15.60:0/3771910622 shutdown_connections 2024-04-12T13:30:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.607+0000 7fa757e00700 1 -- 172.21.15.60:0/3771910622 wait complete. 2024-04-12T13:30:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.608+0000 7fa757e00700 1 Processor -- start 2024-04-12T13:30:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.608+0000 7fa757e00700 1 -- start start 2024-04-12T13:30:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.608+0000 7fa757e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.608+0000 7fa757e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758113a60 con 0x7fa758071ea0 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.609+0000 7fa756a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.609+0000 7fa756a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33222/0 (socket says 172.21.15.60:33222) 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.609+0000 7fa756a00700 1 -- 172.21.15.60:0/3731237884 learned_addr learned my addr 172.21.15.60:0/3731237884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.609+0000 7fa756a00700 1 -- 172.21.15.60:0/3731237884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748005040 con 0x7fa758071ea0 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.609+0000 7fa756a00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa74800b900 tx=0x7fa748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.610+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74800b5c0 con 0x7fa758071ea0 2024-04-12T13:30:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.610+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa74800be70 con 0x7fa758071ea0 2024-04-12T13:30:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.610+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758113c60 con 0x7fa758071ea0 2024-04-12T13:30:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.610+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa74801c590 con 0x7fa758071ea0 2024-04-12T13:30:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.610+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7581147d0 con 0x7fa758071ea0 2024-04-12T13:30:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.611+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758109410 con 0x7fa758071ea0 2024-04-12T13:30:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.611+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa748004d30 con 0x7fa758071ea0 2024-04-12T13:30:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.612+0000 7fa74ea00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 0x7fa73c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.612+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa748049410 con 0x7fa758071ea0 2024-04-12T13:30:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.612+0000 7fa74fe00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 0x7fa73c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.613+0000 7fa74fe00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 0x7fa73c038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa740009990 tx=0x7fa740006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.617+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa74801b350 con 0x7fa758071ea0 2024-04-12T13:30:43.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.841+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa7581152a0 con 0x7fa758071ea0 2024-04-12T13:30:43.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.845+0000 7fa74ea00700 1 -- 172.21.15.60:0/3731237884 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa748021030 con 0x7fa758071ea0 2024-04-12T13:30:43.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 msgr2=0x7fa73c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:43.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 0x7fa73c038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa740009990 tx=0x7fa740006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:43.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 msgr2=0x7fa758113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa74800b900 tx=0x7fa748009e30 comp rx=0 tx=0).stop 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 shutdown_connections 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fa73c0368d0 0x7fa73c038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 --2- 172.21.15.60:0/3731237884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758071ea0 0x7fa758113520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 >> 172.21.15.60:0/3731237884 conn(0x7fa7580f8030 msgr2=0x7fa7580f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.849+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 shutdown_connections 2024-04-12T13:30:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:43.850+0000 7fa757e00700 1 -- 172.21.15.60:0/3731237884 wait complete. 2024-04-12T13:30:44.748 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-12T13:30:44.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-12T13:30:45.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:44 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3731237884' entity='client.admin' 2024-04-12T13:30:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:30:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 -- 172.21.15.60:0/2338046200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 msgr2=0x7f74a40fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 --2- 172.21.15.60:0/2338046200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a40fce80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7494009c60 tx=0x7f7494004d10 comp rx=0 tx=0).stop 2024-04-12T13:30:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 -- 172.21.15.60:0/2338046200 shutdown_connections 2024-04-12T13:30:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 --2- 172.21.15.60:0/2338046200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a40fce80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 -- 172.21.15.60:0/2338046200 >> 172.21.15.60:0/2338046200 conn(0x7f74a40f81d0 msgr2=0x7f74a40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.886+0000 7f74aa800700 1 -- 172.21.15.60:0/2338046200 shutdown_connections 2024-04-12T13:30:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.887+0000 7f74aa800700 1 -- 172.21.15.60:0/2338046200 wait complete. 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.888+0000 7f74aa800700 1 Processor -- start 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.888+0000 7f74aa800700 1 -- start start 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.888+0000 7f74aa800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.888+0000 7f74aa800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a410f840 con 0x7f74a40fca70 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.889+0000 7f74a3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.889+0000 7f74a3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33246/0 (socket says 172.21.15.60:33246) 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.889+0000 7f74a3400700 1 -- 172.21.15.60:0/119358152 learned_addr learned my addr 172.21.15.60:0/119358152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.889+0000 7f74a3400700 1 -- 172.21.15.60:0/119358152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009940 con 0x7f74a40fca70 2024-04-12T13:30:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.889+0000 7f74a3400700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7494004e60 tx=0x7f7494004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.890+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7494012410 con 0x7f74a40fca70 2024-04-12T13:30:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.890+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7494012a40 con 0x7f74a40fca70 2024-04-12T13:30:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.890+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f749401ba40 con 0x7f74a40fca70 2024-04-12T13:30:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.890+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a410fa40 con 0x7f74a40fca70 2024-04-12T13:30:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.890+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a41105b0 con 0x7f74a40fca70 2024-04-12T13:30:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.891+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7494019040 con 0x7f74a40fca70 2024-04-12T13:30:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.891+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a4102f80 con 0x7f74a40fca70 2024-04-12T13:30:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.891+0000 7f749b400700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 0x7f7488038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.892+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7494049b50 con 0x7f74a40fca70 2024-04-12T13:30:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.892+0000 7f74a2a00700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 0x7f7488038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.893+0000 7f74a2a00700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 0x7f7488038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7490009990 tx=0x7f7490006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:47.897+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f749401b3f0 con 0x7f74a40fca70 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:30:48.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:47 smithi060 ceph-mon[29097]: Deploying daemon crash.smithi060 on smithi060 2024-04-12T13:30:48.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.132+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a4071740 con 0x7f74880368d0 2024-04-12T13:30:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.140+0000 7f749b400700 1 -- 172.21.15.60:0/119358152 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f74a4071740 con 0x7f74880368d0 2024-04-12T13:30:48.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 msgr2=0x7f7488038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 0x7f7488038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7490009990 tx=0x7f7490006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 msgr2=0x7f74a410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7494004e60 tx=0x7f7494004d10 comp rx=0 tx=0).stop 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 shutdown_connections 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f74880368d0 0x7f7488038d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 --2- 172.21.15.60:0/119358152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74a40fca70 0x7f74a410f300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 >> 172.21.15.60:0/119358152 conn(0x7f74a40f81d0 msgr2=0x7f74a40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 shutdown_connections 2024-04-12T13:30:48.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:48.143+0000 7f74aa800700 1 -- 172.21.15.60:0/119358152 wait complete. 2024-04-12T13:30:49.268 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi110 2024-04-12T13:30:49.269 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:30:49.269 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.conf 2024-04-12T13:30:49.328 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:30:49.328 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:30:49.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:49 smithi060 ceph-mon[29097]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:49.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:49 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:49.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:49 smithi060 ceph-mon[29097]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:49.426 INFO:tasks.cephadm:Adding host smithi110 to orchestrator... 2024-04-12T13:30:49.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch host add smithi110 2024-04-12T13:30:49.940 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:30:51.324 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:51 smithi060 ceph-mon[29097]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 -- 172.21.15.60:0/3576032971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 msgr2=0x7f3e180ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 --2- 172.21.15.60:0/3576032971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e180ff080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e080048c0 tx=0x7f3e08009e30 comp rx=0 tx=0).stop 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 -- 172.21.15.60:0/3576032971 shutdown_connections 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 --2- 172.21.15.60:0/3576032971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e180ff080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 -- 172.21.15.60:0/3576032971 >> 172.21.15.60:0/3576032971 conn(0x7f3e180fa5d0 msgr2=0x7f3e180fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 -- 172.21.15.60:0/3576032971 shutdown_connections 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.454+0000 7f3e1f000700 1 -- 172.21.15.60:0/3576032971 wait complete. 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e1f000700 1 Processor -- start 2024-04-12T13:30:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e1f000700 1 -- start start 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e1f000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e1f000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1810f7f0 con 0x7f3e180fec70 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e17e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.456+0000 7f3e17e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53936/0 (socket says 172.21.15.60:53936) 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.457+0000 7f3e17e00700 1 -- 172.21.15.60:0/4173161290 learned_addr learned my addr 172.21.15.60:0/4173161290 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:30:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.457+0000 7f3e17e00700 1 -- 172.21.15.60:0/4173161290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08005040 con 0x7f3e180fec70 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.457+0000 7f3e17e00700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e080096b0 tx=0x7f3e08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.457+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e0800bed0 con 0x7f3e180fec70 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.458+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e0800b5c0 con 0x7f3e180fec70 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.458+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e0801c5b0 con 0x7f3e180fec70 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.458+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1810f9f0 con 0x7f3e180fec70 2024-04-12T13:30:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.458+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18110560 con 0x7f3e180fec70 2024-04-12T13:30:52.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.459+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3e08013420 con 0x7f3e180fec70 2024-04-12T13:30:52.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.459+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e18105180 con 0x7f3e180fec70 2024-04-12T13:30:52.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.460+0000 7f3e14c00700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 0x7f3dfc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:30:52.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.460+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3e080499b0 con 0x7f3e180fec70 2024-04-12T13:30:52.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.461+0000 7f3e0f400700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 0x7f3dfc038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:30:52.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.461+0000 7f3e0f400700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 0x7f3dfc038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009990 tx=0x7f3e00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:30:52.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.466+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3e08013a80 con 0x7f3e180fec70 2024-04-12T13:30:52.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:52.741+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e181107a0 con 0x7f3dfc0368d0 2024-04-12T13:30:53.270 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:53.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:53.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:53.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:53.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: Deploying daemon node-exporter.smithi060 on smithi060 2024-04-12T13:30:53.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:52 smithi060 ceph-mon[29097]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:54.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:54 smithi060 ceph-mon[29097]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:30:54.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:54 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:55.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:55 smithi060 ceph-mon[29097]: Deploying cephadm binary to smithi110 2024-04-12T13:30:55.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:55 smithi060 ceph-mon[29097]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:57.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.002+0000 7f3e14c00700 1 -- 172.21.15.60:0/4173161290 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3e181107a0 con 0x7f3dfc0368d0 2024-04-12T13:30:57.006 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi110' with addr '172.21.15.110' 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 msgr2=0x7f3dfc038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 0x7f3dfc038d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009990 tx=0x7f3e00006e40 comp rx=0 tx=0).stop 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 msgr2=0x7f3e1810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e080096b0 tx=0x7f3e08009e30 comp rx=0 tx=0).stop 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 shutdown_connections 2024-04-12T13:30:57.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f3dfc0368d0 0x7f3dfc038d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:30:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 --2- 172.21.15.60:0/4173161290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e180fec70 0x7f3e1810f2b0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e080096b0 tx=0x7f3e08009e30 comp rx=0 tx=0).stop 2024-04-12T13:30:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 >> 172.21.15.60:0/4173161290 conn(0x7f3e180fa5d0 msgr2=0x7f3e180fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:30:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 shutdown_connections 2024-04-12T13:30:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:30:57.006+0000 7f3e1f000700 1 -- 172.21.15.60:0/4173161290 wait complete. 2024-04-12T13:30:57.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:30:57.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:57.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:57.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:57.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:57.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:57 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:57.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch host ls --format=json 2024-04-12T13:30:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:30:58.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:58 smithi060 ceph-mon[29097]: Added host smithi110 2024-04-12T13:30:58.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:58 smithi060 ceph-mon[29097]: Deploying daemon alertmanager.smithi060 on smithi060 2024-04-12T13:30:58.528 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:58 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:30:59.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:30:59 smithi060 ceph-mon[29097]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:01.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:01 smithi060 ceph-mon[29097]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:02.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 -- 172.21.15.60:0/4142666079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 msgr2=0x7fead80feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:02.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 --2- 172.21.15.60:0/4142666079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead80feed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feac80048c0 tx=0x7feac8009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 -- 172.21.15.60:0/4142666079 shutdown_connections 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 --2- 172.21.15.60:0/4142666079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead80feed0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 -- 172.21.15.60:0/4142666079 >> 172.21.15.60:0/4142666079 conn(0x7fead80fa5d0 msgr2=0x7fead80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 -- 172.21.15.60:0/4142666079 shutdown_connections 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.021+0000 7fead7e00700 1 -- 172.21.15.60:0/4142666079 wait complete. 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.022+0000 7fead7e00700 1 Processor -- start 2024-04-12T13:31:02.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.022+0000 7fead7e00700 1 -- start start 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.023+0000 7fead7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.023+0000 7fead7e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead810f620 con 0x7fead80feac0 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.023+0000 7fead6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.023+0000 7fead6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47610/0 (socket says 172.21.15.60:47610) 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.023+0000 7fead6a00700 1 -- 172.21.15.60:0/1222978123 learned_addr learned my addr 172.21.15.60:0/1222978123 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7fead6a00700 1 -- 172.21.15.60:0/1222978123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8005040 con 0x7fead80feac0 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7fead6a00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feac8009680 tx=0x7feac8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:02.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feac800b5c0 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac800be70 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feac80135a0 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead810f820 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.024+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead8110390 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.025+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7feac801ca90 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.025+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead8104fd0 con 0x7fead80feac0 2024-04-12T13:31:02.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.026+0000 7feacea00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 0x7feabc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:02.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.026+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feac8049420 con 0x7fead80feac0 2024-04-12T13:31:02.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.026+0000 7fead6000700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 0x7feabc038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:02.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.027+0000 7fead6000700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 0x7feabc038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feac4009990 tx=0x7feac4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:02.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.032+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feac8011960 con 0x7fead80feac0 2024-04-12T13:31:02.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.364+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fead805f690 con 0x7feabc0368d0 2024-04-12T13:31:02.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.367+0000 7feacea00700 1 -- 172.21.15.60:0/1222978123 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fead805f690 con 0x7feabc0368d0 2024-04-12T13:31:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:31:02.369 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}] 2024-04-12T13:31:02.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.369+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 msgr2=0x7feabc038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:02.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.369+0000 7fead7e00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 0x7feabc038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feac4009990 tx=0x7feac4006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.369+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 msgr2=0x7fead810f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.369+0000 7fead7e00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feac8009680 tx=0x7feac8009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 shutdown_connections 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7feabc0368d0 0x7feabc038d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 --2- 172.21.15.60:0/1222978123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead80feac0 0x7fead810f0e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 >> 172.21.15.60:0/1222978123 conn(0x7fead80fa5d0 msgr2=0x7fead80fb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 shutdown_connections 2024-04-12T13:31:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:02.370+0000 7fead7e00700 1 -- 172.21.15.60:0/1222978123 wait complete. 2024-04-12T13:31:03.600 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:03 smithi060 ceph-mon[29097]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:03.677 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-12T13:31:03.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd crush tunables default 2024-04-12T13:31:04.319 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:04 smithi060 ceph-mon[29097]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T13:31:05.365 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:31:05.519 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:05 smithi060 ceph-mon[29097]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:07.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:07 smithi060 ceph-mon[29097]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:09.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.844+0000 7fe8b2c00700 1 -- 172.21.15.60:0/3933268111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 msgr2=0x7fe8ac0ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.844+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/3933268111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac0ff660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0048c0 tx=0x7fe89c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.845+0000 7fe8b2c00700 1 -- 172.21.15.60:0/3933268111 shutdown_connections 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.845+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/3933268111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac0ff660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.845+0000 7fe8b2c00700 1 -- 172.21.15.60:0/3933268111 >> 172.21.15.60:0/3933268111 conn(0x7fe8ac0f70d0 msgr2=0x7fe8ac0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.845+0000 7fe8b2c00700 1 -- 172.21.15.60:0/3933268111 shutdown_connections 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.845+0000 7fe8b2c00700 1 -- 172.21.15.60:0/3933268111 wait complete. 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.846+0000 7fe8b2c00700 1 Processor -- start 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.846+0000 7fe8b2c00700 1 -- start start 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.846+0000 7fe8b2c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.846+0000 7fe8b2c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac10f810 con 0x7fe8ac065d60 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.846+0000 7fe8abe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:09.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.847+0000 7fe8abe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47622/0 (socket says 172.21.15.60:47622) 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.847+0000 7fe8abe00700 1 -- 172.21.15.60:0/2244125941 learned_addr learned my addr 172.21.15.60:0/2244125941 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.847+0000 7fe8abe00700 1 -- 172.21.15.60:0/2244125941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c005040 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.847+0000 7fe8abe00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b900 tx=0x7fe89c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.847+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe89c00b5c0 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.848+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe89c00be70 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.848+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac10fa10 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.848+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe89c01c590 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.848+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac110580 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.849+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe89c01c850 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.849+0000 7fe8a3e00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 0x7fe890038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.849+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe89c049470 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.849+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac102f70 con 0x7fe8ac065d60 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.850+0000 7fe8ab400700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 0x7fe890038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:09.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.850+0000 7fe8ab400700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 0x7fe890038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe898009990 tx=0x7fe898006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:09.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:08.855+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe89c021070 con 0x7fe8ac065d60 2024-04-12T13:31:09.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.084+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe8ac102930 con 0x7fe8ac065d60 2024-04-12T13:31:09.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.229+0000 7fe8a3e00700 1 -- 172.21.15.60:0/2244125941 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe8ac102930 con 0x7fe8ac065d60 2024-04-12T13:31:09.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 msgr2=0x7fe890038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:09.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 0x7fe890038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe898009990 tx=0x7fe898006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:09.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 msgr2=0x7fe8ac10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b900 tx=0x7fe89c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 shutdown_connections 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe890036880 0x7fe890038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 --2- 172.21.15.60:0/2244125941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8ac065d60 0x7fe8ac10f2d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 >> 172.21.15.60:0/2244125941 conn(0x7fe8ac0f70d0 msgr2=0x7fe8ac0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 shutdown_connections 2024-04-12T13:31:09.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:31:09.233+0000 7fe8b2c00700 1 -- 172.21.15.60:0/2244125941 wait complete. 2024-04-12T13:31:09.237 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-04-12T13:31:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:09 smithi060 ceph-mon[29097]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:09 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2244125941' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-12T13:31:10.263 INFO:tasks.cephadm:Adding mon.smithi060 on smithi060 2024-04-12T13:31:10.263 INFO:tasks.cephadm:Adding mon.smithi110 on smithi110 2024-04-12T13:31:10.263 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch apply mon '2;smithi060:172.21.15.60=smithi060;smithi110:172.21.15.110=smithi110' 2024-04-12T13:31:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:10 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2244125941' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-12T13:31:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:10 smithi060 ceph-mon[29097]: osdmap e4: 0 total, 0 up, 0 in 2024-04-12T13:31:10.716 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:11.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:11 smithi060 ceph-mon[29097]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:11 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:11 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:11 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:11 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:12 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:12 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:12 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T13:31:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:12 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:13.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:13 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T13:31:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:13 smithi060 ceph-mon[29097]: Deploying daemon grafana.smithi060 on smithi060 2024-04-12T13:31:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:13 smithi060 ceph-mon[29097]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:13 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.695+0000 7f99a7c00700 1 -- 172.21.15.110:0/558738880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 msgr2=0x7f99a00ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.695+0000 7f99a7c00700 1 --2- 172.21.15.110:0/558738880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a00ff080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99940048c0 tx=0x7f9994009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.695+0000 7f99a7c00700 1 -- 172.21.15.110:0/558738880 shutdown_connections 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.695+0000 7f99a7c00700 1 --2- 172.21.15.110:0/558738880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a00ff080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.695+0000 7f99a7c00700 1 -- 172.21.15.110:0/558738880 >> 172.21.15.110:0/558738880 conn(0x7f99a00fa5d0 msgr2=0x7f99a00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.696+0000 7f99a7c00700 1 -- 172.21.15.110:0/558738880 shutdown_connections 2024-04-12T13:31:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.696+0000 7f99a7c00700 1 -- 172.21.15.110:0/558738880 wait complete. 2024-04-12T13:31:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.697+0000 7f99a7c00700 1 Processor -- start 2024-04-12T13:31:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.697+0000 7f99a7c00700 1 -- start start 2024-04-12T13:31:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.697+0000 7f99a7c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.697+0000 7f99a7c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a010f7f0 con 0x7f99a00fec70 2024-04-12T13:31:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.698+0000 7f99a5200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:13.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.698+0000 7f99a5200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:52136/0 (socket says 172.21.15.110:52136) 2024-04-12T13:31:13.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.698+0000 7f99a5200700 1 -- 172.21.15.110:0/1583692736 learned_addr learned my addr 172.21.15.110:0/1583692736 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:13.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.699+0000 7f99a5200700 1 -- 172.21.15.110:0/1583692736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994005040 con 0x7f99a00fec70 2024-04-12T13:31:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.699+0000 7f99a5200700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9994009680 tx=0x7f9994009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.699+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f999400b5c0 con 0x7f99a00fec70 2024-04-12T13:31:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.699+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a010f9f0 con 0x7f99a00fec70 2024-04-12T13:31:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.700+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0110560 con 0x7f99a00fec70 2024-04-12T13:31:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.700+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f999400be70 con 0x7f99a00fec70 2024-04-12T13:31:13.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.700+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9994013420 con 0x7f99a00fec70 2024-04-12T13:31:13.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.701+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99800052e0 con 0x7f99a00fec70 2024-04-12T13:31:13.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.702+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f999401c430 con 0x7f99a00fec70 2024-04-12T13:31:13.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.703+0000 7f999cc00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 0x7f9988038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:13.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.703+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9994049730 con 0x7f99a00fec70 2024-04-12T13:31:13.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.704+0000 7f999fe00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 0x7f9988038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:13.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.705+0000 7f999fe00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 0x7f9988038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f998c009990 tx=0x7f998c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:13.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.718+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9994004d30 con 0x7f99a00fec70 2024-04-12T13:31:13.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.944+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 --> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi060:172.21.15.60=smithi060;smithi110:172.21.15.110=smithi110", "target": ["mon-mgr", ""]}) v1 -- 0x7f9980000ca0 con 0x7f99880368d0 2024-04-12T13:31:13.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.960+0000 7f999cc00700 1 -- 172.21.15.110:0/1583692736 <== mgr.14162 v2:172.21.15.60:6800/4071152381 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9980000ca0 con 0x7f99880368d0 2024-04-12T13:31:13.963 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled mon update... 2024-04-12T13:31:13.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 msgr2=0x7f9988038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:13.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 0x7f9988038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f998c009990 tx=0x7f998c006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:13.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 msgr2=0x7f99a010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9994009680 tx=0x7f9994009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 shutdown_connections 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f99880368d0 0x7f9988038d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 --2- 172.21.15.110:0/1583692736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99a00fec70 0x7f99a010f2b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.963+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 >> 172.21.15.110:0/1583692736 conn(0x7f99a00fa5d0 msgr2=0x7f99a00fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.964+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 shutdown_connections 2024-04-12T13:31:13.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:13.964+0000 7f99a7c00700 1 -- 172.21.15.110:0/1583692736 wait complete. 2024-04-12T13:31:14.707 DEBUG:teuthology.orchestra.run.smithi110:mon.smithi110> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi110.service 2024-04-12T13:31:14.712 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:14.712 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:15.176 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:15.280 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:15.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:14 smithi060 ceph-mon[29097]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi060:172.21.15.60=smithi060;smithi110:172.21.15.110=smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:31:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:14 smithi060 ceph-mon[29097]: Saving service mon spec with placement smithi060:172.21.15.60=smithi060;smithi110:172.21.15.110=smithi110;count:2 2024-04-12T13:31:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:14 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:14 smithi060 ceph-mon[29097]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 -- 172.21.15.110:0/2936577593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 msgr2=0x7fd8e40fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 --2- 172.21.15.110:0/2936577593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e40fce70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40048c0 tx=0x7fd8d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 -- 172.21.15.110:0/2936577593 shutdown_connections 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 --2- 172.21.15.110:0/2936577593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e40fce70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 -- 172.21.15.110:0/2936577593 >> 172.21.15.110:0/2936577593 conn(0x7fd8e40f81c0 msgr2=0x7fd8e40fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 -- 172.21.15.110:0/2936577593 shutdown_connections 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.202+0000 7fd8e9800700 1 -- 172.21.15.110:0/2936577593 wait complete. 2024-04-12T13:31:17.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.203+0000 7fd8e9800700 1 Processor -- start 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.203+0000 7fd8e9800700 1 -- start start 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.204+0000 7fd8e9800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.204+0000 7fd8e9800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40722a0 con 0x7fd8e40fca60 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.204+0000 7fd8e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.204+0000 7fd8e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:59700/0 (socket says 172.21.15.110:59700) 2024-04-12T13:31:17.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.204+0000 7fd8e2a00700 1 -- 172.21.15.110:0/43471293 learned_addr learned my addr 172.21.15.110:0/43471293 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.205+0000 7fd8e2a00700 1 -- 172.21.15.110:0/43471293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4005040 con 0x7fd8e40fca60 2024-04-12T13:31:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.205+0000 7fd8e2a00700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40096b0 tx=0x7fd8d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.213+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d400bed0 con 0x7fd8e40fca60 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.214+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8d400b5c0 con 0x7fd8e40fca60 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.214+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8d401c5b0 con 0x7fd8e40fca60 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.214+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e4070370 con 0x7fd8e40fca60 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.214+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e4070860 con 0x7fd8e40fca60 2024-04-12T13:31:17.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.215+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e405f5f0 con 0x7fd8e40fca60 2024-04-12T13:31:17.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.215+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fd8d4004d30 con 0x7fd8e40fca60 2024-04-12T13:31:17.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.216+0000 7fd8daa00700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 0x7fd8c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:17.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.216+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd8d4049f20 con 0x7fd8e40fca60 2024-04-12T13:31:17.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.217+0000 7fd8e2000700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 0x7fd8c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:17.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.218+0000 7fd8e2000700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 0x7fd8c8038e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009990 tx=0x7fd8d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:17.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.232+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd8d4011960 con 0x7fd8e40fca60 2024-04-12T13:31:17.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.526+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8e404bed0 con 0x7fd8e40fca60 2024-04-12T13:31:17.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.528+0000 7fd8daa00700 1 -- 172.21.15.110:0/43471293 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd8d4017200 con 0x7fd8e40fca60 2024-04-12T13:31:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:17.530 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 msgr2=0x7fd8c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 0x7fd8c8038e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009990 tx=0x7fd8d0006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 msgr2=0x7fd8e4071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40096b0 tx=0x7fd8d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 shutdown_connections 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fd8c8036960 0x7fd8c8038e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 --2- 172.21.15.110:0/43471293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e40fca60 0x7fd8e4071d60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 >> 172.21.15.110:0/43471293 conn(0x7fd8e40f81c0 msgr2=0x7fd8e4103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 shutdown_connections 2024-04-12T13:31:17.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:17.531+0000 7fd8e9800700 1 -- 172.21.15.110:0/43471293 wait complete. 2024-04-12T13:31:17.534 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:17.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:17 smithi060 ceph-mon[29097]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:18.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:18 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/43471293' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:19.233 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:19.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:19.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:19 smithi060 ceph-mon[29097]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:19.789 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:21.492 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:21 smithi060 ceph-mon[29097]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 -- 172.21.15.110:0/3633113946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 msgr2=0x7f7cec0fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3633113946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec0fce60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0048c0 tx=0x7f7cdc009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 -- 172.21.15.110:0/3633113946 shutdown_connections 2024-04-12T13:31:21.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3633113946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec0fce60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:21.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 -- 172.21.15.110:0/3633113946 >> 172.21.15.110:0/3633113946 conn(0x7f7cec0f81d0 msgr2=0x7f7cec0fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:21.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 -- 172.21.15.110:0/3633113946 shutdown_connections 2024-04-12T13:31:21.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.760+0000 7f7cf1600700 1 -- 172.21.15.110:0/3633113946 wait complete. 2024-04-12T13:31:21.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.761+0000 7f7cf1600700 1 Processor -- start 2024-04-12T13:31:21.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.761+0000 7f7cf1600700 1 -- start start 2024-04-12T13:31:21.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.761+0000 7f7cf1600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:21.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.761+0000 7f7cf1600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec10d5e0 con 0x7f7cec0fca50 2024-04-12T13:31:21.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.762+0000 7f7ceaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:21.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.762+0000 7f7ceaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:59718/0 (socket says 172.21.15.110:59718) 2024-04-12T13:31:21.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.762+0000 7f7ceaa00700 1 -- 172.21.15.110:0/3637313268 learned_addr learned my addr 172.21.15.110:0/3637313268 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:21.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.763+0000 7f7ceaa00700 1 -- 172.21.15.110:0/3637313268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc005040 con 0x7f7cec0fca50 2024-04-12T13:31:21.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.763+0000 7f7ceaa00700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0096b0 tx=0x7f7cdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:21.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.763+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cdc00bed0 con 0x7f7cec0fca50 2024-04-12T13:31:21.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.764+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec10d7e0 con 0x7f7cec0fca50 2024-04-12T13:31:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.764+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7cdc00b5c0 con 0x7f7cec0fca50 2024-04-12T13:31:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.764+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cdc01c5b0 con 0x7f7cec0fca50 2024-04-12T13:31:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.764+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec10e350 con 0x7f7cec0fca50 2024-04-12T13:31:21.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.765+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec102f60 con 0x7f7cec0fca50 2024-04-12T13:31:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.765+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7cdc004d30 con 0x7f7cec0fca50 2024-04-12T13:31:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.765+0000 7f7ce2a00700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 0x7f7cd0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:21.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.765+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7cdc049a90 con 0x7f7cec0fca50 2024-04-12T13:31:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.766+0000 7f7cea000700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 0x7f7cd0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:21.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.767+0000 7f7cea000700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 0x7f7cd0038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009990 tx=0x7f7cd8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:21.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:21.773+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7cdc011960 con 0x7f7cec0fca50 2024-04-12T13:31:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.068+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7cec10ee20 con 0x7f7cec0fca50 2024-04-12T13:31:22.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.070+0000 7f7ce2a00700 1 -- 172.21.15.110:0/3637313268 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7cdc011370 con 0x7f7cec0fca50 2024-04-12T13:31:22.071 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:22.071 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:22.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 msgr2=0x7f7cd0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:22.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 0x7f7cd0038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009990 tx=0x7f7cd8006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:22.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 msgr2=0x7f7cec10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:22.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0096b0 tx=0x7f7cdc009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:22.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 shutdown_connections 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f7cd00368d0 0x7f7cd0038d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 --2- 172.21.15.110:0/3637313268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cec0fca50 0x7f7cec10d0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 >> 172.21.15.110:0/3637313268 conn(0x7f7cec0f81d0 msgr2=0x7f7cec103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 shutdown_connections 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:22.073+0000 7f7cf1600700 1 -- 172.21.15.110:0/3637313268 wait complete. 2024-04-12T13:31:22.075 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:22.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:22 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/3637313268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:23.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:23 smithi060 ceph-mon[29097]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:23.837 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:23.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:24.287 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:24.397 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:25.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:25 smithi060 ceph-mon[29097]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 -- 172.21.15.110:0/464132901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 msgr2=0x7f62e40fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 --2- 172.21.15.110:0/464132901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e40fce80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62d40048c0 tx=0x7f62d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 -- 172.21.15.110:0/464132901 shutdown_connections 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 --2- 172.21.15.110:0/464132901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e40fce80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 -- 172.21.15.110:0/464132901 >> 172.21.15.110:0/464132901 conn(0x7f62e40f81d0 msgr2=0x7f62e40fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 -- 172.21.15.110:0/464132901 shutdown_connections 2024-04-12T13:31:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.358+0000 7f62e9a00700 1 -- 172.21.15.110:0/464132901 wait complete. 2024-04-12T13:31:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.360+0000 7f62e9a00700 1 Processor -- start 2024-04-12T13:31:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.360+0000 7f62e9a00700 1 -- start start 2024-04-12T13:31:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.360+0000 7f62e9a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.360+0000 7f62e9a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e410d600 con 0x7f62e40fca70 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.361+0000 7f62e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.361+0000 7f62e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:59744/0 (socket says 172.21.15.110:59744) 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.361+0000 7f62e2a00700 1 -- 172.21.15.110:0/3056715017 learned_addr learned my addr 172.21.15.110:0/3056715017 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.361+0000 7f62e2a00700 1 -- 172.21.15.110:0/3056715017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4005040 con 0x7f62e40fca70 2024-04-12T13:31:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.361+0000 7f62e2a00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62d40096b0 tx=0x7f62d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:26.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.362+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d400bed0 con 0x7f62e40fca70 2024-04-12T13:31:26.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.362+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e410d800 con 0x7f62e40fca70 2024-04-12T13:31:26.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.362+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62d400b5c0 con 0x7f62e40fca70 2024-04-12T13:31:26.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.362+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e410e370 con 0x7f62e40fca70 2024-04-12T13:31:26.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.362+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d40255c0 con 0x7f62e40fca70 2024-04-12T13:31:26.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.363+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e4102f80 con 0x7f62e40fca70 2024-04-12T13:31:26.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.363+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f62d40139f0 con 0x7f62e40fca70 2024-04-12T13:31:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.364+0000 7f62daa00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 0x7f62c8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.364+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62d4049ba0 con 0x7f62e40fca70 2024-04-12T13:31:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.364+0000 7f62e2000700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 0x7f62c8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.365+0000 7f62e2000700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 0x7f62c8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009990 tx=0x7f62d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:26.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.378+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f62d40238f0 con 0x7f62e40fca70 2024-04-12T13:31:26.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.667+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f62e405f5f0 con 0x7f62e40fca70 2024-04-12T13:31:26.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.669+0000 7f62daa00700 1 -- 172.21.15.110:0/3056715017 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f62d4023300 con 0x7f62e40fca70 2024-04-12T13:31:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:26.670 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.671+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 msgr2=0x7f62c8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.671+0000 7f62e9a00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 0x7f62c8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009990 tx=0x7f62d0006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.671+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 msgr2=0x7f62e410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.671+0000 7f62e9a00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f62d40096b0 tx=0x7f62d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 shutdown_connections 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f62c8036880 0x7f62c8038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 --2- 172.21.15.110:0/3056715017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62e40fca70 0x7f62e410d0c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 >> 172.21.15.110:0/3056715017 conn(0x7f62e40f81d0 msgr2=0x7f62e4103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 shutdown_connections 2024-04-12T13:31:26.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:26.672+0000 7f62e9a00700 1 -- 172.21.15.110:0/3056715017 wait complete. 2024-04-12T13:31:26.674 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:27.578 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:27 smithi060 ceph-mon[29097]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:27.578 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:27 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/3056715017' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:28.305 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:28.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:28.743 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:28.843 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:29 smithi060 ceph-mon[29097]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:30.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.876+0000 7f6c71600700 1 -- 172.21.15.110:0/117036912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 msgr2=0x7f6c6c0feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:30.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.876+0000 7f6c71600700 1 --2- 172.21.15.110:0/117036912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c0feed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0048c0 tx=0x7f6c5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:30.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.877+0000 7f6c71600700 1 -- 172.21.15.110:0/117036912 shutdown_connections 2024-04-12T13:31:30.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.877+0000 7f6c71600700 1 --2- 172.21.15.110:0/117036912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c0feed0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:30.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.877+0000 7f6c71600700 1 -- 172.21.15.110:0/117036912 >> 172.21.15.110:0/117036912 conn(0x7f6c6c0fa5d0 msgr2=0x7f6c6c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:30.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.877+0000 7f6c71600700 1 -- 172.21.15.110:0/117036912 shutdown_connections 2024-04-12T13:31:30.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.877+0000 7f6c71600700 1 -- 172.21.15.110:0/117036912 wait complete. 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.878+0000 7f6c71600700 1 Processor -- start 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.878+0000 7f6c71600700 1 -- start start 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c71600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c71600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c10f880 con 0x7f6c6c0feac0 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c6be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c6be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:54764/0 (socket says 172.21.15.110:54764) 2024-04-12T13:31:30.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c6be00700 1 -- 172.21.15.110:0/3865521795 learned_addr learned my addr 172.21.15.110:0/3865521795 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.879+0000 7f6c6be00700 1 -- 172.21.15.110:0/3865521795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c005040 con 0x7f6c6c0feac0 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c6be00700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009680 tx=0x7f6c5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5c00b5c0 con 0x7f6c6c0feac0 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c5c00be70 con 0x7f6c6c0feac0 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5c0135a0 con 0x7f6c6c0feac0 2024-04-12T13:31:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c10fa80 con 0x7f6c6c0feac0 2024-04-12T13:31:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.880+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c1105f0 con 0x7f6c6c0feac0 2024-04-12T13:31:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.881+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c104fd0 con 0x7f6c6c0feac0 2024-04-12T13:31:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.882+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6c5c01ca90 con 0x7f6c6c0feac0 2024-04-12T13:31:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.882+0000 7f6c63e00700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 0x7f6c50038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.883+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6c5c0493e0 con 0x7f6c6c0feac0 2024-04-12T13:31:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.883+0000 7f6c6b400700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 0x7f6c50038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.884+0000 7f6c6b400700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 0x7f6c50038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009990 tx=0x7f6c58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:30.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:30.888+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c5c011960 con 0x7f6c6c0feac0 2024-04-12T13:31:31.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.182+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c6c104800 con 0x7f6c6c0feac0 2024-04-12T13:31:31.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.183+0000 7f6c63e00700 1 -- 172.21.15.110:0/3865521795 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6c5c021020 con 0x7f6c6c0feac0 2024-04-12T13:31:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:31.185 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:31.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 msgr2=0x7f6c50038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:31.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 0x7f6c50038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009990 tx=0x7f6c58006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 msgr2=0x7f6c6c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009680 tx=0x7f6c5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 shutdown_connections 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f6c500368d0 0x7f6c50038d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 --2- 172.21.15.110:0/3865521795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6c0feac0 0x7f6c6c10f340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 >> 172.21.15.110:0/3865521795 conn(0x7f6c6c0fa5d0 msgr2=0x7f6c6c0fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 shutdown_connections 2024-04-12T13:31:31.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:31.186+0000 7f6c71600700 1 -- 172.21.15.110:0/3865521795 wait complete. 2024-04-12T13:31:31.189 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:31.323 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:31 smithi060 ceph-mon[29097]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:31.323 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:31 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/3865521795' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:32.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: Deploying daemon prometheus.smithi060 on smithi060 2024-04-12T13:31:32.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:32 smithi060 ceph-mon[29097]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:32.967 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:32.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:33.520 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:34.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:34 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:35.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.428+0000 7f279ce00700 1 -- 172.21.15.110:0/1349522329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 msgr2=0x7f27980ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:35.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.428+0000 7f279ce00700 1 --2- 172.21.15.110:0/1349522329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f27980ff080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27880048c0 tx=0x7f2788009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:35.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.429+0000 7f279ce00700 1 -- 172.21.15.110:0/1349522329 shutdown_connections 2024-04-12T13:31:35.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.429+0000 7f279ce00700 1 --2- 172.21.15.110:0/1349522329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f27980ff080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:35.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.429+0000 7f279ce00700 1 -- 172.21.15.110:0/1349522329 >> 172.21.15.110:0/1349522329 conn(0x7f27980fa5d0 msgr2=0x7f27980fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:35.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.429+0000 7f279ce00700 1 -- 172.21.15.110:0/1349522329 shutdown_connections 2024-04-12T13:31:35.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.429+0000 7f279ce00700 1 -- 172.21.15.110:0/1349522329 wait complete. 2024-04-12T13:31:35.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.430+0000 7f279ce00700 1 Processor -- start 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.430+0000 7f279ce00700 1 -- start start 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.431+0000 7f279ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.431+0000 7f279ce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279810f7c0 con 0x7f27980fec70 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.431+0000 7f2795e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.431+0000 7f2795e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:54772/0 (socket says 172.21.15.110:54772) 2024-04-12T13:31:35.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.431+0000 7f2795e00700 1 -- 172.21.15.110:0/1411720131 learned_addr learned my addr 172.21.15.110:0/1411720131 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:35.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.432+0000 7f2795e00700 1 -- 172.21.15.110:0/1411720131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788005040 con 0x7f27980fec70 2024-04-12T13:31:35.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f2795e00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2788009680 tx=0x7f2788009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f278800b5c0 con 0x7f27980fec70 2024-04-12T13:31:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f278800be70 con 0x7f27980fec70 2024-04-12T13:31:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279810f9c0 con 0x7f27980fec70 2024-04-12T13:31:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27880135a0 con 0x7f27980fec70 2024-04-12T13:31:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.433+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2798110530 con 0x7f27980fec70 2024-04-12T13:31:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.434+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2798105180 con 0x7f27980fec70 2024-04-12T13:31:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.435+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f2788004d30 con 0x7f27980fec70 2024-04-12T13:31:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.435+0000 7f278ea00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 0x7f277c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.435+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2788049480 con 0x7f27980fec70 2024-04-12T13:31:35.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.436+0000 7f278d400700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 0x7f277c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.437+0000 7f278d400700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 0x7f277c038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:35.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.450+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2788024770 con 0x7f27980fec70 2024-04-12T13:31:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:35 smithi060 ceph-mon[29097]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.734+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f279804bed0 con 0x7f27980fec70 2024-04-12T13:31:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.735+0000 7f278ea00700 1 -- 172.21.15.110:0/1411720131 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2788021020 con 0x7f27980fec70 2024-04-12T13:31:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:35.737 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 msgr2=0x7f277c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 0x7f277c038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 msgr2=0x7f279810f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2788009680 tx=0x7f2788009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 shutdown_connections 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f277c036880 0x7f277c038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:35.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 --2- 172.21.15.110:0/1411720131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27980fec70 0x7f279810f280 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:35.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 >> 172.21.15.110:0/1411720131 conn(0x7f27980fa5d0 msgr2=0x7f27980fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:35.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 shutdown_connections 2024-04-12T13:31:35.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:35.738+0000 7f279ce00700 1 -- 172.21.15.110:0/1411720131 wait complete. 2024-04-12T13:31:35.740 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:36.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:36 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1411720131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:37.439 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:37.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:37.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:37 smithi060 ceph-mon[29097]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:38.007 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:39 smithi060 ceph-mon[29097]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.988+0000 7f572c200700 1 -- 172.21.15.110:0/1274475021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 msgr2=0x7f57240ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.988+0000 7f572c200700 1 --2- 172.21.15.110:0/1274475021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f57240ff660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5718009c60 tx=0x7f5718004d10 comp rx=0 tx=0).stop 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.989+0000 7f572c200700 1 -- 172.21.15.110:0/1274475021 shutdown_connections 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.989+0000 7f572c200700 1 --2- 172.21.15.110:0/1274475021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f57240ff660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.989+0000 7f572c200700 1 -- 172.21.15.110:0/1274475021 >> 172.21.15.110:0/1274475021 conn(0x7f57240f70d0 msgr2=0x7f57240f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:39.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.989+0000 7f572c200700 1 -- 172.21.15.110:0/1274475021 shutdown_connections 2024-04-12T13:31:39.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.989+0000 7f572c200700 1 -- 172.21.15.110:0/1274475021 wait complete. 2024-04-12T13:31:39.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.990+0000 7f572c200700 1 Processor -- start 2024-04-12T13:31:39.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.990+0000 7f572c200700 1 -- start start 2024-04-12T13:31:39.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.990+0000 7f572c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:39.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.990+0000 7f572c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572410f810 con 0x7f57240665f0 2024-04-12T13:31:39.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.991+0000 7f5729800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:39.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.991+0000 7f5729800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:42400/0 (socket says 172.21.15.110:42400) 2024-04-12T13:31:39.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.991+0000 7f5729800700 1 -- 172.21.15.110:0/1203811043 learned_addr learned my addr 172.21.15.110:0/1203811043 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:39.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.991+0000 7f5729800700 1 -- 172.21.15.110:0/1203811043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009940 con 0x7f57240665f0 2024-04-12T13:31:39.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.992+0000 7f5729800700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57180097b0 tx=0x7f5718004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:39.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.992+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5718012410 con 0x7f57240665f0 2024-04-12T13:31:39.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.992+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572410fa10 con 0x7f57240665f0 2024-04-12T13:31:39.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.992+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724110580 con 0x7f57240665f0 2024-04-12T13:31:39.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.993+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5718012a40 con 0x7f57240665f0 2024-04-12T13:31:39.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.993+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f571801b9f0 con 0x7f57240665f0 2024-04-12T13:31:39.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.993+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57040052e0 con 0x7f57240665f0 2024-04-12T13:31:39.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.994+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5718019040 con 0x7f57240665f0 2024-04-12T13:31:39.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.994+0000 7f5721600700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 0x7f570c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:39.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.994+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f571804a300 con 0x7f57240665f0 2024-04-12T13:31:39.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.995+0000 7f5728e00700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 0x7f570c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:39.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:39.996+0000 7f5728e00700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 0x7f570c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5710009990 tx=0x7f5710006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:40.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.010+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f571801b3f0 con 0x7f57240665f0 2024-04-12T13:31:40.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.304+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5704005860 con 0x7f57240665f0 2024-04-12T13:31:40.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.305+0000 7f5721600700 1 -- 172.21.15.110:0/1203811043 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5718017030 con 0x7f57240665f0 2024-04-12T13:31:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 msgr2=0x7f570c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 0x7f570c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5710009990 tx=0x7f5710006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 msgr2=0x7f572410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57180097b0 tx=0x7f5718004d10 comp rx=0 tx=0).stop 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 shutdown_connections 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f570c036880 0x7f570c038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 --2- 172.21.15.110:0/1203811043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57240665f0 0x7f572410f2d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.308+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 >> 172.21.15.110:0/1203811043 conn(0x7f57240f70d0 msgr2=0x7f57240f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.309+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 shutdown_connections 2024-04-12T13:31:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:40.309+0000 7f572c200700 1 -- 172.21.15.110:0/1203811043 wait complete. 2024-04-12T13:31:40.311 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:41 smithi060 ceph-mon[29097]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:41 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1203811043' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:42.016 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:42.016 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:42.463 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:42.561 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:43.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:43 smithi060 ceph-mon[29097]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:44.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 -- 172.21.15.110:0/375943602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 msgr2=0x7fe6700fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 --2- 172.21.15.110:0/375943602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe6700fce80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6640048c0 tx=0x7fe664009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 -- 172.21.15.110:0/375943602 shutdown_connections 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 --2- 172.21.15.110:0/375943602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe6700fce80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 -- 172.21.15.110:0/375943602 >> 172.21.15.110:0/375943602 conn(0x7fe6700f81d0 msgr2=0x7fe6700fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 -- 172.21.15.110:0/375943602 shutdown_connections 2024-04-12T13:31:44.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.733+0000 7fe678400700 1 -- 172.21.15.110:0/375943602 wait complete. 2024-04-12T13:31:44.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.734+0000 7fe678400700 1 Processor -- start 2024-04-12T13:31:44.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.735+0000 7fe678400700 1 -- start start 2024-04-12T13:31:44.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.735+0000 7fe678400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:44.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.735+0000 7fe678400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700722a0 con 0x7fe6700fca70 2024-04-12T13:31:44.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.736+0000 7fe675a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:44.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.736+0000 7fe675a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:42414/0 (socket says 172.21.15.110:42414) 2024-04-12T13:31:44.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.736+0000 7fe675a00700 1 -- 172.21.15.110:0/4209751108 learned_addr learned my addr 172.21.15.110:0/4209751108 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:44.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.736+0000 7fe675a00700 1 -- 172.21.15.110:0/4209751108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664005040 con 0x7fe6700fca70 2024-04-12T13:31:44.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.737+0000 7fe675a00700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6640096b0 tx=0x7fe664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:44.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.737+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe66400bed0 con 0x7fe6700fca70 2024-04-12T13:31:44.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.737+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe670070370 con 0x7fe6700fca70 2024-04-12T13:31:44.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.737+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe66400b5c0 con 0x7fe6700fca70 2024-04-12T13:31:44.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.737+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe66401c5b0 con 0x7fe6700fca70 2024-04-12T13:31:44.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.738+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe670070860 con 0x7fe6700fca70 2024-04-12T13:31:44.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.739+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67005f5f0 con 0x7fe6700fca70 2024-04-12T13:31:44.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.739+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe664013a80 con 0x7fe6700fca70 2024-04-12T13:31:44.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.740+0000 7fe66d600700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 0x7fe658038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:44.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.740+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe6640499d0 con 0x7fe6700fca70 2024-04-12T13:31:44.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.740+0000 7fe675000700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 0x7fe658038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:44.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.742+0000 7fe675000700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 0x7fe658038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009990 tx=0x7fe65c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:44.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:44.756+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe664011960 con 0x7fe6700fca70 2024-04-12T13:31:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.050+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe670106450 con 0x7fe6700fca70 2024-04-12T13:31:45.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.051+0000 7fe66d600700 1 -- 172.21.15.110:0/4209751108 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe664011370 con 0x7fe6700fca70 2024-04-12T13:31:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:45.054 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.054+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 msgr2=0x7fe658038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.054+0000 7fe678400700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 0x7fe658038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009990 tx=0x7fe65c006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.054+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 msgr2=0x7fe670071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.054+0000 7fe678400700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6640096b0 tx=0x7fe664009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 shutdown_connections 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7fe6580368d0 0x7fe658038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 --2- 172.21.15.110:0/4209751108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6700fca70 0x7fe670071d60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 >> 172.21.15.110:0/4209751108 conn(0x7fe6700f81d0 msgr2=0x7fe670103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:45.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 shutdown_connections 2024-04-12T13:31:45.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:45.055+0000 7fe678400700 1 -- 172.21.15.110:0/4209751108 wait complete. 2024-04-12T13:31:45.058 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:45.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:45 smithi060 ceph-mon[29097]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:45.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:45 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/4209751108' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:47.128 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:47.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:47.588 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:47.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:47 smithi060 ceph-mon[29097]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:47.685 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:49.523 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:49 smithi060 ceph-mon[29097]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:50.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 -- 172.21.15.110:0/1711267275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 msgr2=0x7ff4880ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:50.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 --2- 172.21.15.110:0/1711267275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880ff480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0048c0 tx=0x7ff47c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:50.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 -- 172.21.15.110:0/1711267275 shutdown_connections 2024-04-12T13:31:50.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 --2- 172.21.15.110:0/1711267275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880ff480 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:50.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 -- 172.21.15.110:0/1711267275 >> 172.21.15.110:0/1711267275 conn(0x7ff4880f6ef0 msgr2=0x7ff4880f9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:50.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 -- 172.21.15.110:0/1711267275 shutdown_connections 2024-04-12T13:31:50.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.037+0000 7ff48ec00700 1 -- 172.21.15.110:0/1711267275 wait complete. 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.038+0000 7ff48ec00700 1 Processor -- start 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.038+0000 7ff48ec00700 1 -- start start 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.039+0000 7ff48ec00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.039+0000 7ff48ec00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880fd310 con 0x7ff488065d60 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.039+0000 7ff48d800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.039+0000 7ff48d800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:57056/0 (socket says 172.21.15.110:57056) 2024-04-12T13:31:50.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.039+0000 7ff48d800700 1 -- 172.21.15.110:0/2479397867 learned_addr learned my addr 172.21.15.110:0/2479397867 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:50.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.040+0000 7ff48d800700 1 -- 172.21.15.110:0/2479397867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c005040 con 0x7ff488065d60 2024-04-12T13:31:50.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.040+0000 7ff48d800700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b900 tx=0x7ff47c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.041+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff47c00b5c0 con 0x7ff488065d60 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.041+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880fb3e0 con 0x7ff488065d60 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.041+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880fb8d0 con 0x7ff488065d60 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.041+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff47c00be70 con 0x7ff488065d60 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.041+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff47c01c570 con 0x7ff488065d60 2024-04-12T13:31:50.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.042+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4680052e0 con 0x7ff488065d60 2024-04-12T13:31:50.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.043+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff47c004d30 con 0x7ff488065d60 2024-04-12T13:31:50.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.043+0000 7ff485600700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 0x7ff470038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:50.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.043+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff47c049b80 con 0x7ff488065d60 2024-04-12T13:31:50.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.043+0000 7ff48ce00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 0x7ff470038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:50.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.044+0000 7ff48ce00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 0x7ff470038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff474009990 tx=0x7ff474006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:50.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.059+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff47c011920 con 0x7ff488065d60 2024-04-12T13:31:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.332+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff468005590 con 0x7ff488065d60 2024-04-12T13:31:50.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.333+0000 7ff485600700 1 -- 172.21.15.110:0/2479397867 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff47c021030 con 0x7ff488065d60 2024-04-12T13:31:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:50.336 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 msgr2=0x7ff470038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 0x7ff470038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff474009990 tx=0x7ff474006e40 comp rx=0 tx=0).stop 2024-04-12T13:31:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 msgr2=0x7ff4880fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b900 tx=0x7ff47c009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 shutdown_connections 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7ff4700368d0 0x7ff470038d80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 --2- 172.21.15.110:0/2479397867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff488065d60 0x7ff4880fcdd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 >> 172.21.15.110:0/2479397867 conn(0x7ff4880f6ef0 msgr2=0x7ff4881039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 shutdown_connections 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:50.336+0000 7ff48ec00700 1 -- 172.21.15.110:0/2479397867 wait complete. 2024-04-12T13:31:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:51.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:51.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' 2024-04-12T13:31:51.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-12T13:31:51.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:31:51.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:51 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/2479397867' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:51.977 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:51.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:52.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:52 smithi060 ceph-mon[29097]: from='mgr.14162 172.21.15.60:0/1617893997' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-12T13:31:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:52 smithi060 ceph-mon[29097]: mgrmap e14: smithi060.bpzacg(active, since 82s) 2024-04-12T13:31:52.437 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:52.537 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:54.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 -- 172.21.15.110:0/3009251202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 msgr2=0x7f19340ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 --2- 172.21.15.110:0/3009251202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f19340ff080 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f19240048c0 tx=0x7f1924009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 -- 172.21.15.110:0/3009251202 shutdown_connections 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 --2- 172.21.15.110:0/3009251202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f19340ff080 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 -- 172.21.15.110:0/3009251202 >> 172.21.15.110:0/3009251202 conn(0x7f19340fa5d0 msgr2=0x7f19340fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 -- 172.21.15.110:0/3009251202 shutdown_connections 2024-04-12T13:31:54.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.572+0000 7f1939800700 1 -- 172.21.15.110:0/3009251202 wait complete. 2024-04-12T13:31:54.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.573+0000 7f1939800700 1 Processor -- start 2024-04-12T13:31:54.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.574+0000 7f1939800700 1 -- start start 2024-04-12T13:31:54.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.574+0000 7f1939800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:54.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.574+0000 7f1939800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193410f830 con 0x7f19340fec70 2024-04-12T13:31:54.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.575+0000 7f1932a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:54.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.575+0000 7f1932a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:57076/0 (socket says 172.21.15.110:57076) 2024-04-12T13:31:54.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.575+0000 7f1932a00700 1 -- 172.21.15.110:0/1640170196 learned_addr learned my addr 172.21.15.110:0/1640170196 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:54.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.575+0000 7f1932a00700 1 -- 172.21.15.110:0/1640170196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924005040 con 0x7f19340fec70 2024-04-12T13:31:54.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f1932a00700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1924009680 tx=0x7f1924009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:54.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f192400b5c0 con 0x7f19340fec70 2024-04-12T13:31:54.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f192400be70 con 0x7f19340fec70 2024-04-12T13:31:54.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19240135a0 con 0x7f19340fec70 2024-04-12T13:31:54.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193410fa30 con 0x7f19340fec70 2024-04-12T13:31:54.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.576+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934110550 con 0x7f19340fec70 2024-04-12T13:31:54.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.577+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934105180 con 0x7f19340fec70 2024-04-12T13:31:54.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.578+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f192401ca90 con 0x7f19340fec70 2024-04-12T13:31:54.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.579+0000 7f192aa00700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 0x7f1918038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:54.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.579+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f19240494d0 con 0x7f19340fec70 2024-04-12T13:31:54.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.579+0000 7f1932000700 1 -- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 msgr2=0x7f1918038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4071152381 2024-04-12T13:31:54.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.579+0000 7f1932000700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 0x7f1918038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:31:54.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.593+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1924011780 con 0x7f19340fec70 2024-04-12T13:31:54.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.780+0000 7f1932000700 1 -- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 msgr2=0x7f1918038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4071152381 2024-04-12T13:31:54.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.780+0000 7f1932000700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 0x7f1918038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:31:54.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.885+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1934110fd0 con 0x7f19340fec70 2024-04-12T13:31:54.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.886+0000 7f192aa00700 1 -- 172.21.15.110:0/1640170196 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1924021300 con 0x7f19340fec70 2024-04-12T13:31:54.888 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:54.888 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 msgr2=0x7f1918038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 0x7f1918038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 msgr2=0x7f193410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1924009680 tx=0x7f1924009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 shutdown_connections 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f1918036920 0x7f1918038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 --2- 172.21.15.110:0/1640170196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19340fec70 0x7f193410f2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 >> 172.21.15.110:0/1640170196 conn(0x7f19340fa5d0 msgr2=0x7f19340fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:54.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 shutdown_connections 2024-04-12T13:31:54.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:54.889+0000 7f1939800700 1 -- 172.21.15.110:0/1640170196 wait complete. 2024-04-12T13:31:54.892 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:55.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:54 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1640170196' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:31:56.730 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:31:56.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:31:57.180 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:57.282 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:31:59.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 -- 172.21.15.110:0/1833844517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 msgr2=0x7f87cc103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 --2- 172.21.15.110:0/1833844517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc103490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f87c00048c0 tx=0x7f87c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 -- 172.21.15.110:0/1833844517 shutdown_connections 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 --2- 172.21.15.110:0/1833844517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc103490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 -- 172.21.15.110:0/1833844517 >> 172.21.15.110:0/1833844517 conn(0x7f87cc072300 msgr2=0x7f87cc074710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 -- 172.21.15.110:0/1833844517 shutdown_connections 2024-04-12T13:31:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.332+0000 7f87d4400700 1 -- 172.21.15.110:0/1833844517 wait complete. 2024-04-12T13:31:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.333+0000 7f87d4400700 1 Processor -- start 2024-04-12T13:31:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.333+0000 7f87d4400700 1 -- start start 2024-04-12T13:31:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.334+0000 7f87d4400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.334+0000 7f87d4400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc113c00 con 0x7f87cc103080 2024-04-12T13:31:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.334+0000 7f87d1a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:31:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.334+0000 7f87d1a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:59374/0 (socket says 172.21.15.110:59374) 2024-04-12T13:31:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.334+0000 7f87d1a00700 1 -- 172.21.15.110:0/3986941094 learned_addr learned my addr 172.21.15.110:0/3986941094 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:31:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.335+0000 7f87d1a00700 1 -- 172.21.15.110:0/3986941094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0005040 con 0x7f87cc103080 2024-04-12T13:31:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.335+0000 7f87d1a00700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87c00096b0 tx=0x7f87c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:31:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.336+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87c000bed0 con 0x7f87cc103080 2024-04-12T13:31:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.336+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc113e00 con 0x7f87cc103080 2024-04-12T13:31:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.336+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87c000b5c0 con 0x7f87cc103080 2024-04-12T13:31:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.336+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87c00255c0 con 0x7f87cc103080 2024-04-12T13:31:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.336+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc114970 con 0x7f87cc103080 2024-04-12T13:31:59.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.337+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc109570 con 0x7f87cc103080 2024-04-12T13:31:59.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.337+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f87c00139f0 con 0x7f87cc103080 2024-04-12T13:31:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.338+0000 7f87c9600700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 0x7f87b4038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:31:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.338+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f87c0049be0 con 0x7f87cc103080 2024-04-12T13:31:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.338+0000 7f87d1000700 1 -- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 msgr2=0x7f87b4038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4071152381 2024-04-12T13:31:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.338+0000 7f87d1000700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 0x7f87b4038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:31:59.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.352+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f87c00238f0 con 0x7f87cc103080 2024-04-12T13:31:59.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.539+0000 7f87d1000700 1 -- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 msgr2=0x7f87b4038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/4071152381 2024-04-12T13:31:59.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.539+0000 7f87d1000700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 0x7f87b4038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T13:31:59.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.643+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87cc05f5f0 con 0x7f87cc103080 2024-04-12T13:31:59.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.644+0000 7f87c9600700 1 -- 172.21.15.110:0/3986941094 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f87c0023300 con 0x7f87cc103080 2024-04-12T13:31:59.647 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:31:59.647 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 msgr2=0x7f87b4038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 0x7f87b4038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 msgr2=0x7f87cc1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87c00096b0 tx=0x7f87c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 shutdown_connections 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.647+0000 7f87d4400700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:6800/4071152381,v1:172.21.15.60:6801/4071152381] conn(0x7f87b4036920 0x7f87b4038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.648+0000 7f87d4400700 1 --2- 172.21.15.110:0/3986941094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87cc103080 0x7f87cc1136c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.648+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 >> 172.21.15.110:0/3986941094 conn(0x7f87cc072300 msgr2=0x7f87cc074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.648+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 shutdown_connections 2024-04-12T13:31:59.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:31:59.648+0000 7f87d4400700 1 -- 172.21.15.110:0/3986941094 wait complete. 2024-04-12T13:31:59.651 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:31:59.890 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:31:59 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/3986941094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:01.156 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: Active manager daemon smithi060.bpzacg restarted 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: mgrmap e15: smithi060.bpzacg(active, starting, since 0.00927949s) 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:01.157 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:32:01.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:32:01.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:32:01.421 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:01.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:01.862 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:32:01.970 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:32:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: [12/Apr/2024:13:32:00] ENGINE Bus STARTING 2024-04-12T13:32:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: [12/Apr/2024:13:32:00] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:32:02.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: [12/Apr/2024:13:32:00] ENGINE Bus STARTED 2024-04-12T13:32:02.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:02.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:02.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: mgrmap e16: smithi060.bpzacg(active, since 1.01159s) 2024-04-12T13:32:02.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 -- 172.21.15.110:0/472868471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 msgr2=0x7f92800ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 --2- 172.21.15.110:0/472868471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f92800ff080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92700048c0 tx=0x7f9270009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 -- 172.21.15.110:0/472868471 shutdown_connections 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 --2- 172.21.15.110:0/472868471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f92800ff080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 -- 172.21.15.110:0/472868471 >> 172.21.15.110:0/472868471 conn(0x7f92800fa5d0 msgr2=0x7f92800fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 -- 172.21.15.110:0/472868471 shutdown_connections 2024-04-12T13:32:03.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.980+0000 7f9285c00700 1 -- 172.21.15.110:0/472868471 wait complete. 2024-04-12T13:32:03.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.981+0000 7f9285c00700 1 Processor -- start 2024-04-12T13:32:03.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.981+0000 7f9285c00700 1 -- start start 2024-04-12T13:32:03.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.982+0000 7f9285c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.982+0000 7f9285c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928010f7c0 con 0x7f92800fec70 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.982+0000 7f927ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.982+0000 7f927ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:59394/0 (socket says 172.21.15.110:59394) 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.982+0000 7f927ea00700 1 -- 172.21.15.110:0/111127759 learned_addr learned my addr 172.21.15.110:0/111127759 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.983+0000 7f927ea00700 1 -- 172.21.15.110:0/111127759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270005040 con 0x7f92800fec70 2024-04-12T13:32:03.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.983+0000 7f927ea00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9270009680 tx=0x7f9270009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.983+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f927000b5c0 con 0x7f92800fec70 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.983+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928010f9c0 con 0x7f92800fec70 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.983+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f927000be70 con 0x7f92800fec70 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.984+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92700135a0 con 0x7f92800fec70 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.984+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280110530 con 0x7f92800fec70 2024-04-12T13:32:03.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.985+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280105180 con 0x7f92800fec70 2024-04-12T13:32:03.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.985+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f9270004d30 con 0x7f92800fec70 2024-04-12T13:32:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.986+0000 7f9276a00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 0x7f9264038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.986+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f92700495a0 con 0x7f92800fec70 2024-04-12T13:32:03.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.986+0000 7f927e000700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 0x7f9264038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:03.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.987+0000 7f927e000700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 0x7f9264038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f926c009990 tx=0x7f926c006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:03.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:03.992+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9270011960 con 0x7f92800fec70 2024-04-12T13:32:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:03 smithi060 ceph-mon[29097]: mgrmap e17: smithi060.bpzacg(active, since 2s) 2024-04-12T13:32:04.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:04.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.288+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9280110f40 con 0x7f92800fec70 2024-04-12T13:32:04.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.289+0000 7f9276a00700 1 -- 172.21.15.110:0/111127759 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9270021070 con 0x7f92800fec70 2024-04-12T13:32:04.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:04.292 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:32:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 msgr2=0x7f9264038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 0x7f9264038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f926c009990 tx=0x7f926c006e40 comp rx=0 tx=0).stop 2024-04-12T13:32:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 msgr2=0x7f928010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9270009680 tx=0x7f9270009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 shutdown_connections 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f9264036970 0x7f9264038e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 --2- 172.21.15.110:0/111127759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92800fec70 0x7f928010f280 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 >> 172.21.15.110:0/111127759 conn(0x7f92800fa5d0 msgr2=0x7f92800fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 shutdown_connections 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:04.292+0000 7f9285c00700 1 -- 172.21.15.110:0/111127759 wait complete. 2024-04-12T13:32:04.295 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:32:05.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:04 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/111127759' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:06.671 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:06.672 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:06.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:06 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:06.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:06 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:07.107 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:32:07.213 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T13:32:08.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:08.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:08.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.173+0000 7f17a5c00700 1 -- 172.21.15.110:0/3299921555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 msgr2=0x7f17a00fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.173+0000 7f17a5c00700 1 --2- 172.21.15.110:0/3299921555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a00fbd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f17900048c0 tx=0x7f1790009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.173+0000 7f17a5c00700 1 -- 172.21.15.110:0/3299921555 shutdown_connections 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.173+0000 7f17a5c00700 1 --2- 172.21.15.110:0/3299921555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a00fbd80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.173+0000 7f17a5c00700 1 -- 172.21.15.110:0/3299921555 >> 172.21.15.110:0/3299921555 conn(0x7f17a00f70d0 msgr2=0x7f17a00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.174+0000 7f17a5c00700 1 -- 172.21.15.110:0/3299921555 shutdown_connections 2024-04-12T13:32:10.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.174+0000 7f17a5c00700 1 -- 172.21.15.110:0/3299921555 wait complete. 2024-04-12T13:32:10.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.174+0000 7f17a5c00700 1 Processor -- start 2024-04-12T13:32:10.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.175+0000 7f17a5c00700 1 -- start start 2024-04-12T13:32:10.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.175+0000 7f17a5c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:10.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.175+0000 7f17a5c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a010f7d0 con 0x7f17a00fb970 2024-04-12T13:32:10.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.176+0000 7f179ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:10.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.176+0000 7f179ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:40500/0 (socket says 172.21.15.110:40500) 2024-04-12T13:32:10.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.176+0000 7f179ea00700 1 -- 172.21.15.110:0/1006493717 learned_addr learned my addr 172.21.15.110:0/1006493717 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:10.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.176+0000 7f179ea00700 1 -- 172.21.15.110:0/1006493717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1790005040 con 0x7f17a00fb970 2024-04-12T13:32:10.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f179ea00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17900096b0 tx=0x7f1790009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f179000bed0 con 0x7f17a00fb970 2024-04-12T13:32:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f179000b5c0 con 0x7f17a00fb970 2024-04-12T13:32:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a010f9d0 con 0x7f17a00fb970 2024-04-12T13:32:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0110540 con 0x7f17a00fb970 2024-04-12T13:32:10.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.177+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f179001c5b0 con 0x7f17a00fb970 2024-04-12T13:32:10.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.179+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17800052e0 con 0x7f17a00fb970 2024-04-12T13:32:10.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.179+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f179001c820 con 0x7f17a00fb970 2024-04-12T13:32:10.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.180+0000 7f1796a00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 0x7f1784038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:10.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.180+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1790049c90 con 0x7f17a00fb970 2024-04-12T13:32:10.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.180+0000 7f179e000700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 0x7f1784038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:10.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.181+0000 7f179e000700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 0x7f1784038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f178c009990 tx=0x7f178c006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:10.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.188+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1790025400 con 0x7f17a00fb970 2024-04-12T13:32:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:32:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:09 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:32:10.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.488+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1780005590 con 0x7f17a00fb970 2024-04-12T13:32:10.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.489+0000 7f1796a00700 1 -- 172.21.15.110:0/1006493717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1790011370 con 0x7f17a00fb970 2024-04-12T13:32:10.491 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:32:10.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 msgr2=0x7f1784038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:10.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 0x7f1784038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f178c009990 tx=0x7f178c006e40 comp rx=0 tx=0).stop 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 msgr2=0x7f17a010f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17900096b0 tx=0x7f1790009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 shutdown_connections 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1784036970 0x7f1784038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 --2- 172.21.15.110:0/1006493717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17a00fb970 0x7f17a010f290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 >> 172.21.15.110:0/1006493717 conn(0x7f17a00f70d0 msgr2=0x7f17a00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.492+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 shutdown_connections 2024-04-12T13:32:10.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:10.493+0000 7f17a5c00700 1 -- 172.21.15.110:0/1006493717 wait complete. 2024-04-12T13:32:10.496 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:32:11.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:10 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:11.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:10 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:11.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:10 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1006493717' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:12.234 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:12.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:11 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:32:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:11 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:32:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:11 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:32:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:11 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:11 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:12.663 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:32:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-12T13:32:13.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:13.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:13 smithi060 ceph-mon[29097]: Deploying daemon crash.smithi110 on smithi110 2024-04-12T13:32:15.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:32:16.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.062+0000 7f6300200700 1 -- 172.21.15.110:0/822009379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 msgr2=0x7f62f8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:16.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.062+0000 7f6300200700 1 --2- 172.21.15.110:0/822009379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8109470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0048c0 tx=0x7f62ec009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:16.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.063+0000 7f6300200700 1 -- 172.21.15.110:0/822009379 shutdown_connections 2024-04-12T13:32:16.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.063+0000 7f6300200700 1 --2- 172.21.15.110:0/822009379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8109470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.063+0000 7f6300200700 1 -- 172.21.15.110:0/822009379 >> 172.21.15.110:0/822009379 conn(0x7f62f80728d0 msgr2=0x7f62f8074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.063+0000 7f6300200700 1 -- 172.21.15.110:0/822009379 shutdown_connections 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.063+0000 7f6300200700 1 -- 172.21.15.110:0/822009379 wait complete. 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.064+0000 7f6300200700 1 Processor -- start 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.064+0000 7f6300200700 1 -- start start 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.064+0000 7f6300200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:16.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.064+0000 7f6300200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8119c70 con 0x7f62f81090a0 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.065+0000 7f62fd800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.065+0000 7f62fd800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:40516/0 (socket says 172.21.15.110:40516) 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.065+0000 7f62fd800700 1 -- 172.21.15.110:0/1393825153 learned_addr learned my addr 172.21.15.110:0/1393825153 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.065+0000 7f62fd800700 1 -- 172.21.15.110:0/1393825153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec005040 con 0x7f62f81090a0 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f62fd800700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b820 tx=0x7f62ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:16.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62ec0093c0 con 0x7f62f81090a0 2024-04-12T13:32:16.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f8119e70 con 0x7f62f81090a0 2024-04-12T13:32:16.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62ec013420 con 0x7f62f81090a0 2024-04-12T13:32:16.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62ec01c5b0 con 0x7f62f81090a0 2024-04-12T13:32:16.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.066+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f81136b0 con 0x7f62f81090a0 2024-04-12T13:32:16.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.067+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f81047f0 con 0x7f62f81090a0 2024-04-12T13:32:16.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.068+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f62ec013a90 con 0x7f62f81090a0 2024-04-12T13:32:16.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.068+0000 7f62f5600700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 0x7f62e0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:16.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.068+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f62ec049a70 con 0x7f62f81090a0 2024-04-12T13:32:16.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.069+0000 7f62fce00700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 0x7f62e0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:16.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.070+0000 7f62fce00700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 0x7f62e0038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009990 tx=0x7f62e4006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:16.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.084+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f62ec0098a0 con 0x7f62f81090a0 2024-04-12T13:32:16.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.395+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f62f810d3c0 con 0x7f62f81090a0 2024-04-12T13:32:16.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.396+0000 7f62f5600700 1 -- 172.21.15.110:0/1393825153 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f62ec023300 con 0x7f62f81090a0 2024-04-12T13:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 msgr2=0x7f62e0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 0x7f62e0038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009990 tx=0x7f62e4006e40 comp rx=0 tx=0).stop 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 msgr2=0x7f62f8119730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b820 tx=0x7f62ec009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 shutdown_connections 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f62e0036970 0x7f62e0038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 --2- 172.21.15.110:0/1393825153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62f81090a0 0x7f62f8119730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 >> 172.21.15.110:0/1393825153 conn(0x7f62f80728d0 msgr2=0x7f62f8073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 shutdown_connections 2024-04-12T13:32:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:16.399+0000 7f6300200700 1 -- 172.21.15.110:0/1393825153 wait complete. 2024-04-12T13:32:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:32:16.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:16 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1393825153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:18.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:18 smithi060 ceph-mon[29097]: Deploying daemon node-exporter.smithi110 on smithi110 2024-04-12T13:32:18.479 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:18.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:18.915 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:21.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:20 smithi060 ceph-mon[29097]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:21.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 -- 172.21.15.110:0/3639601396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 msgr2=0x7fc7ec0fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 --2- 172.21.15.110:0/3639601396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0048c0 tx=0x7fc7dc009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 -- 172.21.15.110:0/3639601396 shutdown_connections 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 --2- 172.21.15.110:0/3639601396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fded0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 -- 172.21.15.110:0/3639601396 >> 172.21.15.110:0/3639601396 conn(0x7fc7ec071860 msgr2=0x7fc7ec071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.913+0000 7fc7f3200700 1 -- 172.21.15.110:0/3639601396 shutdown_connections 2024-04-12T13:32:21.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.914+0000 7fc7f3200700 1 -- 172.21.15.110:0/3639601396 wait complete. 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.914+0000 7fc7f3200700 1 Processor -- start 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.915+0000 7fc7f3200700 1 -- start start 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.915+0000 7fc7f3200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.915+0000 7fc7f3200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0fd930 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.916+0000 7fc7ebe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.916+0000 7fc7ebe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:38918/0 (socket says 172.21.15.110:38918) 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.916+0000 7fc7ebe00700 1 -- 172.21.15.110:0/422700944 learned_addr learned my addr 172.21.15.110:0/422700944 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.916+0000 7fc7ebe00700 1 -- 172.21.15.110:0/422700944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc005040 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.917+0000 7fc7ebe00700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b7f0 tx=0x7fc7dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.917+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7dc009370 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.918+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec0fbed0 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.918+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7dc013420 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.918+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7dc01c590 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.918+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec0fc340 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.919+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec1026f0 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.919+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fc7dc013a70 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.920+0000 7fc7e3e00700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 0x7fc7d0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.920+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc7dc049400 con 0x7fc7ec0fdb00 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.921+0000 7fc7eb400700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 0x7fc7d0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.922+0000 7fc7eb400700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 0x7fc7d0038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009990 tx=0x7fc7d8006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:21.936+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc7dc024d30 con 0x7fc7ec0fdb00 2024-04-12T13:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.233+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc7ec04bed0 con 0x7fc7ec0fdb00 2024-04-12T13:32:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.234+0000 7fc7e3e00700 1 -- 172.21.15.110:0/422700944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc7dc021030 con 0x7fc7ec0fdb00 2024-04-12T13:32:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:22.235 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 msgr2=0x7fc7d0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 0x7fc7d0038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009990 tx=0x7fc7d8006e40 comp rx=0 tx=0).stop 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 msgr2=0x7fc7ec0fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b7f0 tx=0x7fc7dc009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 shutdown_connections 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc7d0036970 0x7fc7d0038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 --2- 172.21.15.110:0/422700944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec0fdb00 0x7fc7ec0fb930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 >> 172.21.15.110:0/422700944 conn(0x7fc7ec071860 msgr2=0x7fc7ec1036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 shutdown_connections 2024-04-12T13:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:22.237+0000 7fc7f3200700 1 -- 172.21.15.110:0/422700944 wait complete. 2024-04-12T13:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:32:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:22 smithi060 ceph-mon[29097]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:22 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/422700944' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:22 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:22 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:23 smithi060 ceph-mon[29097]: Deploying daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:32:24.319 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:24.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:25.303 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:24 smithi060 ceph-mon[29097]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:27.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:26 smithi060 ceph-mon[29097]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 -- 172.21.15.110:0/3866677285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 msgr2=0x7efc80102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 --2- 172.21.15.110:0/3866677285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80102ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efc700048c0 tx=0x7efc70009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 -- 172.21.15.110:0/3866677285 shutdown_connections 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 --2- 172.21.15.110:0/3866677285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80102ea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 -- 172.21.15.110:0/3866677285 >> 172.21.15.110:0/3866677285 conn(0x7efc800f85f0 msgr2=0x7efc800faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 -- 172.21.15.110:0/3866677285 shutdown_connections 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.649+0000 7efc85c00700 1 -- 172.21.15.110:0/3866677285 wait complete. 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.650+0000 7efc85c00700 1 Processor -- start 2024-04-12T13:32:27.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.650+0000 7efc85c00700 1 -- start start 2024-04-12T13:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.650+0000 7efc85c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.650+0000 7efc85c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80115860 con 0x7efc80102ad0 2024-04-12T13:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.651+0000 7efc7ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.651+0000 7efc7ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.110:47216/0 (socket says 172.21.15.110:47216) 2024-04-12T13:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.651+0000 7efc7ea00700 1 -- 172.21.15.110:0/1432277461 learned_addr learned my addr 172.21.15.110:0/1432277461 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:27.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.652+0000 7efc7ea00700 1 -- 172.21.15.110:0/1432277461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70005040 con 0x7efc80102ad0 2024-04-12T13:32:27.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.652+0000 7efc7ea00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc7000b820 tx=0x7efc70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:27.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.652+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc700093c0 con 0x7efc80102ad0 2024-04-12T13:32:27.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.652+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc80115a60 con 0x7efc80102ad0 2024-04-12T13:32:27.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.653+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80115f50 con 0x7efc80102ad0 2024-04-12T13:32:27.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.653+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc70013420 con 0x7efc80102ad0 2024-04-12T13:32:27.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.653+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc700255c0 con 0x7efc80102ad0 2024-04-12T13:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.654+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800fe1d0 con 0x7efc80102ad0 2024-04-12T13:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.654+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7efc70009520 con 0x7efc80102ad0 2024-04-12T13:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.655+0000 7efc76a00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 0x7efc64038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.655+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efc70049bd0 con 0x7efc80102ad0 2024-04-12T13:32:27.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.655+0000 7efc7e000700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 0x7efc64038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:27.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.656+0000 7efc7e000700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 0x7efc64038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009990 tx=0x7efc6c006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:27.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:27.669+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efc7001c770 con 0x7efc80102ad0 2024-04-12T13:32:28.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.000+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efc8005f5f0 con 0x7efc80102ad0 2024-04-12T13:32:28.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.002+0000 7efc76a00700 1 -- 172.21.15.110:0/1432277461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7efc70024360 con 0x7efc80102ad0 2024-04-12T13:32:28.003 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:28.003 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:29:08.011338Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T13:32:28.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 msgr2=0x7efc64038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:28.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 0x7efc64038e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009990 tx=0x7efc6c006e40 comp rx=0 tx=0).stop 2024-04-12T13:32:28.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 msgr2=0x7efc80115320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc7000b820 tx=0x7efc70009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 shutdown_connections 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efc640369c0 0x7efc64038e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 --2- 172.21.15.110:0/1432277461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80102ad0 0x7efc80115320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 >> 172.21.15.110:0/1432277461 conn(0x7efc800f85f0 msgr2=0x7efc800f89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 shutdown_connections 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:28.004+0000 7efc85c00700 1 -- 172.21.15.110:0/1432277461 wait complete. 2024-04-12T13:32:28.006 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:32:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: Deploying daemon mon.smithi110 on smithi110 2024-04-12T13:32:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:28 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1432277461' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:29.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T13:32:29.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T13:32:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:30 smithi060 ceph-mon[29097]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:32:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:33.234 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:32 smithi060 ceph-mon[29097]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:33.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:33 smithi110 bash[36006]: 0a064e4e9b78b61136ac1cf89729b6d6517b0a673fa5a22594be03a5ade7bc00 2024-04-12T13:32:34.186 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:33 smithi110 systemd[1]: Started Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:32:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: mon.smithi060 calling monitor election 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: mon.smithi110 calling monitor election 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:32:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: monmap e2: 2 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],smithi110=[v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: fsmap 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: mgrmap e17: smithi060.bpzacg(active, since 38s) 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: overall HEALTH_OK 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:32:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: mon.smithi060 calling monitor election 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: mon.smithi110 calling monitor election 2024-04-12T13:32:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: monmap e2: 2 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],smithi110=[v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: fsmap 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: mgrmap e17: smithi060.bpzacg(active, since 38s) 2024-04-12T13:32:39.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: overall HEALTH_OK 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/284395459' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:32:39.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 -- 172.21.15.110:0/1016748151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc010005c70 msgr2=0x7fc0100080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1016748151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc010005c70 0x7fc0100080f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0280fdf20 tx=0x7fc01c002040 comp rx=0 tx=0).stop 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 -- 172.21.15.110:0/1016748151 shutdown_connections 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1016748151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc010005c70 0x7fc0100080f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 -- 172.21.15.110:0/1016748151 >> 172.21.15.110:0/1016748151 conn(0x7fc0280f85f0 msgr2=0x7fc0280faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 -- 172.21.15.110:0/1016748151 shutdown_connections 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.742+0000 7fc02fe00700 1 -- 172.21.15.110:0/1016748151 wait complete. 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.743+0000 7fc02fe00700 1 Processor -- start 2024-04-12T13:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.744+0000 7fc02fe00700 1 -- start start 2024-04-12T13:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.744+0000 7fc02fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.744+0000 7fc02fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 0x7fc02810d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.744+0000 7fc02fe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02810d9e0 con 0x7fc028113cb0 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.744+0000 7fc02fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02810db50 con 0x7fc0281133a0 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02ca00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 0x7fc02810d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58732/0 (socket says 172.21.15.110:58732) 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 -- 172.21.15.110:0/1393898966 learned_addr learned my addr 172.21.15.110:0/1393898966 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 -- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 msgr2=0x7fc028113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 -- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 msgr2=0x7fc028113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02d400700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02ca00700 1 -- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 msgr2=0x7fc028113770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02ca00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.745+0000 7fc02ca00700 1 -- 172.21.15.110:0/1393898966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c005040 con 0x7fc028113cb0 2024-04-12T13:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.746+0000 7fc02ca00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 0x7fc02810d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc01400b790 tx=0x7fc0140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.746+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc014011810 con 0x7fc028113cb0 2024-04-12T13:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.746+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc014011e40 con 0x7fc028113cb0 2024-04-12T13:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.746+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01400f2e0 con 0x7fc028113cb0 2024-04-12T13:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.746+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02810de30 con 0x7fc028113cb0 2024-04-12T13:32:39.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.747+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc028118380 con 0x7fc028113cb0 2024-04-12T13:32:39.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.748+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0281071d0 con 0x7fc028113cb0 2024-04-12T13:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.749+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fc014010380 con 0x7fc028113cb0 2024-04-12T13:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.750+0000 7fc025600700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 0x7fc00806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.750+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc014086830 con 0x7fc028113cb0 2024-04-12T13:32:39.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.751+0000 7fc02d400700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 0x7fc00806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:39.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.752+0000 7fc02d400700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 0x7fc00806b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc01c004fd0 tx=0x7fc01c024040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:39.763+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc0140576d0 con 0x7fc028113cb0 2024-04-12T13:32:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: mgrmap e18: smithi060.bpzacg(active, since 38s), standbys: smithi110.ezwdax 2024-04-12T13:32:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:32:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:32:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:39 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:40.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.072+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc0280fe1d0 con 0x7fc028113cb0 2024-04-12T13:32:40.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.074+0000 7fc025600700 1 -- 172.21.15.110:0/1393898966 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7fc014015410 con 0x7fc028113cb0 2024-04-12T13:32:40.075 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-12T13:32:40.075 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":2,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","modified":"2024-04-12T13:32:33.616864Z","created":"2024-04-12T13:29:08.011338Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.076+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 msgr2=0x7fc00806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.076+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 0x7fc00806b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc01c004fd0 tx=0x7fc01c024040 comp rx=0 tx=0).stop 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.076+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 msgr2=0x7fc02810d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 0x7fc02810d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc01400b790 tx=0x7fc0140091a0 comp rx=0 tx=0).stop 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 shutdown_connections 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc008069360 0x7fc00806b810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0281133a0 0x7fc028113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:40.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 --2- 172.21.15.110:0/1393898966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc028113cb0 0x7fc02810d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:40.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 >> 172.21.15.110:0/1393898966 conn(0x7fc0280f85f0 msgr2=0x7fc028101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:40.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 shutdown_connections 2024-04-12T13:32:40.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:32:40.077+0000 7fc02fe00700 1 -- 172.21.15.110:0/1393898966 wait complete. 2024-04-12T13:32:40.079 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 2 2024-04-12T13:32:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: mgrmap e18: smithi060.bpzacg(active, since 38s), standbys: smithi110.ezwdax 2024-04-12T13:32:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:32:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:40.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:40.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:40.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:32:40.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:39 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:32:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:40 smithi110 ceph-mon[36055]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:40 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:40 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/1393898966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:41.292 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-12T13:32:41.292 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph config generate-minimal-conf 2024-04-12T13:32:41.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:40 smithi060 ceph-mon[29097]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:41.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:40 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:41.388 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:40 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1393898966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T13:32:41.800 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:32:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:43 smithi110 ceph-mon[36055]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:32:43.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:43 smithi060 ceph-mon[29097]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:43.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:43.404 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:43.404 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:43.404 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:32:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:32:44.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:44 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:44.291 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:32:44.291 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:32:44.291 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:32:44.292 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:44 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.326+0000 7f66db600700 1 -- 172.21.15.60:0/2338658788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 msgr2=0x7f66d4070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.326+0000 7f66db600700 1 --2- 172.21.15.60:0/2338658788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4070360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f66c80048c0 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.327+0000 7f66db600700 1 -- 172.21.15.60:0/2338658788 shutdown_connections 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.327+0000 7f66db600700 1 --2- 172.21.15.60:0/2338658788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4070360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.327+0000 7f66db600700 1 -- 172.21.15.60:0/2338658788 >> 172.21.15.60:0/2338658788 conn(0x7f66d40f85f0 msgr2=0x7f66d40faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.327+0000 7f66db600700 1 -- 172.21.15.60:0/2338658788 shutdown_connections 2024-04-12T13:32:44.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.327+0000 7f66db600700 1 -- 172.21.15.60:0/2338658788 wait complete. 2024-04-12T13:32:44.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 Processor -- start 2024-04-12T13:32:44.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 -- start start 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4119e80 0x7f66d41138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d411a440 con 0x7f66d4071f90 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.328+0000 7f66db600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d4113e00 con 0x7f66d4119e80 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47704/0 (socket says 172.21.15.60:47704) 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 -- 172.21.15.60:0/2435569039 learned_addr learned my addr 172.21.15.60:0/2435569039 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 -- 172.21.15.60:0/2435569039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4119e80 msgr2=0x7f66d41138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4119e80 0x7f66d41138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.329+0000 7f66d8c00700 1 -- 172.21.15.60:0/2435569039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8005040 con 0x7f66d4071f90 2024-04-12T13:32:44.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66d8c00700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009380 tx=0x7f66c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:44.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c800e040 con 0x7f66d4071f90 2024-04-12T13:32:44.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66c8013420 con 0x7f66d4071f90 2024-04-12T13:32:44.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c801c650 con 0x7f66d4071f90 2024-04-12T13:32:44.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4114080 con 0x7f66d4071f90 2024-04-12T13:32:44.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.330+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d41145c0 con 0x7f66d4071f90 2024-04-12T13:32:44.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.332+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d40fff40 con 0x7f66d4071f90 2024-04-12T13:32:44.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.332+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f66c8013590 con 0x7f66d4071f90 2024-04-12T13:32:44.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.333+0000 7f66d0c00700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 0x7f66bc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:44.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.333+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f66c8087400 con 0x7f66d4071f90 2024-04-12T13:32:44.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.334+0000 7f66d3e00700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 0x7f66bc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:44.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.335+0000 7f66d3e00700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 0x7f66bc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009930 tx=0x7f66c0006de0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:44.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.341+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f66c8058280 con 0x7f66d4071f90 2024-04-12T13:32:44.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.571+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f66d405f5f0 con 0x7f66d4071f90 2024-04-12T13:32:44.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.571+0000 7f66d0c00700 1 -- 172.21.15.60:0/2435569039 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f66c8057e10 con 0x7f66d4071f90 2024-04-12T13:32:44.574 INFO:teuthology.orchestra.run.smithi060.stdout:# minimal ceph.conf for 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:32:44.574 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-04-12T13:32:44.574 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:32:44.574 INFO:teuthology.orchestra.run.smithi060.stdout: mon_host = [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-04-12T13:32:44.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 msgr2=0x7f66bc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:44.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 0x7f66bc06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009930 tx=0x7f66c0006de0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 msgr2=0x7f66d4119940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:44.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009380 tx=0x7f66c8009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 shutdown_connections 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f66bc069360 0x7f66bc06b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66d4071f90 0x7f66d4119940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 --2- 172.21.15.60:0/2435569039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4119e80 0x7f66d41138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 >> 172.21.15.60:0/2435569039 conn(0x7f66d40f85f0 msgr2=0x7f66d40fa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 shutdown_connections 2024-04-12T13:32:44.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:44.574+0000 7f66db600700 1 -- 172.21.15.60:0/2435569039 wait complete. 2024-04-12T13:32:45.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:45 smithi060 ceph-mon[29097]: Reconfiguring mon.smithi060 (unknown last config time)... 2024-04-12T13:32:45.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:45 smithi060 ceph-mon[29097]: Reconfiguring daemon mon.smithi060 on smithi060 2024-04-12T13:32:45.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:45 smithi060 ceph-mon[29097]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:45.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:45 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2435569039' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:45.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:32:45.397 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-12T13:32:45.397 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:32:45.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-04-12T13:32:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:45 smithi110 ceph-mon[36055]: Reconfiguring mon.smithi060 (unknown last config time)... 2024-04-12T13:32:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:45 smithi110 ceph-mon[36055]: Reconfiguring daemon mon.smithi060 on smithi060 2024-04-12T13:32:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:45 smithi110 ceph-mon[36055]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:45 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2435569039' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:32:45.484 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:32:45.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:32:45.610 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:32:45.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-04-12T13:32:45.718 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:32:45.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:32:45.861 INFO:tasks.cephadm:Deploying OSDs... 2024-04-12T13:32:45.861 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:32:45.861 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T13:32:45.920 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T13:32:45.920 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-04-12T13:32:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T13:32:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:45.965 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-12T13:32:45.965 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:45.966 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:45.966 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-12 13:31:49.052269722 +0000 2024-04-12T13:32:45.966 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-12 13:24:19.170882971 +0000 2024-04-12T13:32:45.966 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-12 13:24:19.170882971 +0000 2024-04-12T13:32:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-12 13:24:19.170882971 +0000 2024-04-12T13:32:45.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T13:32:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-12T13:32:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-12T13:32:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00528651 s, 96.9 kB/s 2024-04-12T13:32:46.104 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T13:32:46.158 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-12 13:31:49.052269722 +0000 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-12 13:24:19.799876401 +0000 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-12 13:24:19.799876401 +0000 2024-04-12T13:32:46.206 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-12 13:24:19.799876401 +0000 2024-04-12T13:32:46.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T13:32:46.290 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-12T13:32:46.291 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-12T13:32:46.291 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000264457 s, 1.9 MB/s 2024-04-12T13:32:46.293 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T13:32:46.347 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-04-12T13:32:46.398 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-12 13:31:49.053269712 +0000 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-12 13:24:20.419869924 +0000 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-12 13:24:20.419869924 +0000 2024-04-12T13:32:46.399 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-12 13:24:20.419869924 +0000 2024-04-12T13:32:46.399 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T13:32:46.483 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-12T13:32:46.484 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-12T13:32:46.484 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000222621 s, 2.3 MB/s 2024-04-12T13:32:46.487 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T13:32:46.534 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-04-12T13:32:46.573 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T13:32:46.573 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:46.573 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-12 13:31:49.054269701 +0000 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-12 13:24:21.029863552 +0000 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-12 13:24:21.029863552 +0000 2024-04-12T13:32:46.574 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-12 13:24:21.029863552 +0000 2024-04-12T13:32:46.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T13:32:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-12T13:32:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-12T13:32:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000194129 s, 2.6 MB/s 2024-04-12T13:32:46.688 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T13:32:46.732 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:32:46.732 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T13:32:46.789 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T13:32:46.790 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-12 13:32:31.901155537 +0000 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-12 13:24:11.999979660 +0000 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-12 13:24:11.999979660 +0000 2024-04-12T13:32:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-12 13:24:11.999979660 +0000 2024-04-12T13:32:46.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T13:32:46.925 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-12T13:32:46.925 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-12T13:32:46.925 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000334232 s, 1.5 MB/s 2024-04-12T13:32:46.929 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T13:32:46.987 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-04-12T13:32:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T13:32:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:47.037 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-04-12T13:32:47.037 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:47.038 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:47.038 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-12 13:32:31.902155521 +0000 2024-04-12T13:32:47.038 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-12 13:24:12.614969392 +0000 2024-04-12T13:32:47.038 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-12 13:24:12.614969392 +0000 2024-04-12T13:32:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-12 13:24:12.614969392 +0000 2024-04-12T13:32:47.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T13:32:47.125 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-12T13:32:47.126 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-12T13:32:47.126 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000238189 s, 2.1 MB/s 2024-04-12T13:32:47.129 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T13:32:47.187 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:32:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:47 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T13:32:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-04-12T13:32:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-12 13:32:31.902155521 +0000 2024-04-12T13:32:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-12 13:24:13.234958971 +0000 2024-04-12T13:32:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-12 13:24:13.234958971 +0000 2024-04-12T13:32:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-12 13:24:13.234958971 +0000 2024-04-12T13:32:47.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T13:32:47.279 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:47.279 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:47.280 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:47.280 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:32:47.280 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:32:47.280 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:47 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:47.373 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-12T13:32:47.374 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-12T13:32:47.374 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.0003523 s, 1.5 MB/s 2024-04-12T13:32:47.378 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T13:32:47.435 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-04-12T13:32:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T13:32:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T13:32:47.484 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-04-12T13:32:47.484 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:32:47.484 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T13:32:47.485 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-12 13:32:31.903155504 +0000 2024-04-12T13:32:47.485 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-12 13:24:13.848948455 +0000 2024-04-12T13:32:47.485 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-12 13:24:13.848948455 +0000 2024-04-12T13:32:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-12 13:24:13.848948455 +0000 2024-04-12T13:32:47.485 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T13:32:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-12T13:32:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-12T13:32:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000275215 s, 1.9 MB/s 2024-04-12T13:32:47.573 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T13:32:47.626 INFO:tasks.cephadm:Deploying osd.0 on smithi060 with /dev/vg_nvme/lv_4... 2024-04-12T13:32:47.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-12T13:32:48.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:48 smithi060 ceph-mon[29097]: Reconfiguring mgr.smithi060.bpzacg (unknown last config time)... 2024-04-12T13:32:48.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:48 smithi060 ceph-mon[29097]: Reconfiguring daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:32:48.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:48 smithi110 ceph-mon[36055]: Reconfiguring mgr.smithi060.bpzacg (unknown last config time)... 2024-04-12T13:32:48.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:48 smithi110 ceph-mon[36055]: Reconfiguring daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:32:48.490 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:32:49.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:49 smithi060 ceph-mon[29097]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:49.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:49 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:49.366 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:49 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:49.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:49 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:32:49.367 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:49 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:49 smithi110 ceph-mon[36055]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:49 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:49 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:49 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:32:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:49 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:50.166 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:50 smithi060 ceph-mon[29097]: Reconfiguring crash.smithi060 (monmap changed)... 2024-04-12T13:32:50.167 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:50 smithi060 ceph-mon[29097]: Reconfiguring daemon crash.smithi060 on smithi060 2024-04-12T13:32:50.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:50 smithi110 ceph-mon[36055]: Reconfiguring crash.smithi060 (monmap changed)... 2024-04-12T13:32:50.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:50 smithi110 ceph-mon[36055]: Reconfiguring daemon crash.smithi060 on smithi060 2024-04-12T13:32:51.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:51 smithi060 ceph-mon[29097]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:51 smithi110 ceph-mon[36055]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0337161 s, 311 MB/s 2024-04-12T13:32:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-04-12T13:32:52.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-04-12T13:32:53.349 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:53 smithi060 ceph-mon[29097]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:53.349 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:53 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:53.349 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:53 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:53.349 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:53 smithi060 ceph-mon[29097]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-04-12T13:32:53.350 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:53 smithi060 ceph-mon[29097]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-04-12T13:32:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:53 smithi110 ceph-mon[36055]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:53 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:53 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:32:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:53 smithi110 ceph-mon[36055]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-04-12T13:32:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:53 smithi110 ceph-mon[36055]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-04-12T13:32:54.271 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:32:55.379 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:55 smithi060 ceph-mon[29097]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:55 smithi110 ceph-mon[36055]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:57.415 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:57 smithi060 ceph-mon[29097]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:57.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:57 smithi110 ceph-mon[36055]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:57.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.486+0000 7f17c9c00700 1 -- 172.21.15.60:0/2865302849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c41002b0 msgr2=0x7f17c4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:57.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.486+0000 7f17c9c00700 1 --2- 172.21.15.60:0/2865302849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c41002b0 0x7f17c4100720 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17b0004940 tx=0x7f17b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:32:57.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 -- 172.21.15.60:0/2865302849 shutdown_connections 2024-04-12T13:32:57.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 --2- 172.21.15.60:0/2865302849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c41002b0 0x7f17c4100720 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 --2- 172.21.15.60:0/2865302849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c40ff000 0x7f17c40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 -- 172.21.15.60:0/2865302849 >> 172.21.15.60:0/2865302849 conn(0x7f17c40fa950 msgr2=0x7f17c40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:32:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 -- 172.21.15.60:0/2865302849 shutdown_connections 2024-04-12T13:32:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.487+0000 7f17c9c00700 1 -- 172.21.15.60:0/2865302849 wait complete. 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 Processor -- start 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 -- start start 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 0x7f17c4110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4110860 con 0x7f17c40ff000 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.488+0000 7f17c9c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4110fa0 con 0x7f17c41002b0 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38044/0 (socket says 172.21.15.60:38044) 2024-04-12T13:32:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 -- 172.21.15.60:0/752710736 learned_addr learned my addr 172.21.15.60:0/752710736 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:32:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2000700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 0x7f17c4110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 -- 172.21.15.60:0/752710736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 msgr2=0x7f17c4110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:32:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 0x7f17c4110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:32:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2a00700 1 -- 172.21.15.60:0/752710736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0005040 con 0x7f17c40ff000 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.489+0000 7f17c2000700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 0x7f17c4110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17c2a00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c810 tx=0x7f17b4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b4012810 con 0x7f17c40ff000 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17b4012e40 con 0x7f17c40ff000 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b400a370 con 0x7f17c40ff000 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4111280 con 0x7f17c40ff000 2024-04-12T13:32:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.490+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4111840 con 0x7f17c40ff000 2024-04-12T13:32:57.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.492+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c405f5f0 con 0x7f17c40ff000 2024-04-12T13:32:57.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.493+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f17b4011810 con 0x7f17c40ff000 2024-04-12T13:32:57.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.494+0000 7f17baa00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 0x7f17a806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:32:57.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.494+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f17b40864a0 con 0x7f17c40ff000 2024-04-12T13:32:57.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.495+0000 7f17c2000700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 0x7f17a806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:32:57.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.495+0000 7f17c2000700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 0x7f17a806b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17b000b7a0 tx=0x7f17b0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:32:57.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.499+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f17b4057340 con 0x7f17c40ff000 2024-04-12T13:32:57.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:32:57.729+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c4111c20 con 0x7f17a8069210 2024-04-12T13:32:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:32:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:32:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:32:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:32:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:32:59.250 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:59 smithi060 ceph-mon[29097]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:32:59.250 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:32:59 smithi060 ceph-mon[29097]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:32:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:59 smithi110 ceph-mon[36055]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:32:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:32:59 smithi110 ceph-mon[36055]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:00.402 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:01 smithi060 ceph-mon[29097]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:01 smithi110 ceph-mon[36055]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:02 smithi060 ceph-mon[29097]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-04-12T13:33:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:02 smithi060 ceph-mon[29097]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-04-12T13:33:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:02 smithi110 ceph-mon[36055]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-04-12T13:33:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:02 smithi110 ceph-mon[36055]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-04-12T13:33:03.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:03 smithi060 ceph-mon[29097]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:03.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:03 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1861951698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec1d2f83-f08d-4617-af02-a6a7225825b0"}]: dispatch 2024-04-12T13:33:03.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:03 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1861951698' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec1d2f83-f08d-4617-af02-a6a7225825b0"}]': finished 2024-04-12T13:33:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:03 smithi060 ceph-mon[29097]: osdmap e6: 1 total, 0 up, 1 in 2024-04-12T13:33:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:03 smithi110 ceph-mon[36055]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1861951698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec1d2f83-f08d-4617-af02-a6a7225825b0"}]: dispatch 2024-04-12T13:33:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1861951698' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec1d2f83-f08d-4617-af02-a6a7225825b0"}]': finished 2024-04-12T13:33:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:03 smithi110 ceph-mon[36055]: osdmap e6: 1 total, 0 up, 1 in 2024-04-12T13:33:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:04.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:04 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1827630016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:33:04.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:04 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1827630016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:33:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:05 smithi060 ceph-mon[29097]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:05 smithi110 ceph-mon[36055]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:07 smithi060 ceph-mon[29097]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:07 smithi110 ceph-mon[36055]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:09.421 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:09 smithi060 ceph-mon[29097]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:09 smithi110 ceph-mon[36055]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:11.419 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:11 smithi060 ceph-mon[29097]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:11 smithi110 ceph-mon[36055]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:13 smithi110 ceph-mon[36055]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:13 smithi060 ceph-mon[29097]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:15.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:15 smithi060 ceph-mon[29097]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:15.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:15.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:15.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:15 smithi110 ceph-mon[36055]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:16 smithi110 ceph-mon[36055]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:33:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:16 smithi110 ceph-mon[36055]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:33:16.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:16 smithi060 ceph-mon[29097]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:33:16.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:16 smithi060 ceph-mon[29097]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:33:17.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:17 smithi060 ceph-mon[29097]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:17.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:33:17.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:17 smithi110 ceph-mon[36055]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:33:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:18 smithi110 ceph-mon[36055]: Deploying daemon osd.0 on smithi060 2024-04-12T13:33:18.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:18 smithi060 ceph-mon[29097]: Deploying daemon osd.0 on smithi060 2024-04-12T13:33:19.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:19 smithi060 ceph-mon[29097]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:19 smithi110 ceph-mon[36055]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:21.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:21 smithi060 ceph-mon[29097]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:21.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:21 smithi110 ceph-mon[36055]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:23.392 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:23 smithi110 ceph-mon[36055]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:23.392 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:23 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:23.392 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:23 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:23.392 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:23 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:33:23.393 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:23 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:23 smithi060 ceph-mon[29097]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:33:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:24.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:24 smithi110 ceph-mon[36055]: Reconfiguring crash.smithi110 (monmap changed)... 2024-04-12T13:33:24.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:24 smithi110 ceph-mon[36055]: Reconfiguring daemon crash.smithi110 on smithi110 2024-04-12T13:33:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:24 smithi060 ceph-mon[29097]: Reconfiguring crash.smithi110 (monmap changed)... 2024-04-12T13:33:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:24 smithi060 ceph-mon[29097]: Reconfiguring daemon crash.smithi110 on smithi110 2024-04-12T13:33:25.373 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:25.373 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:25.373 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:25.373 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:33:25.374 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:33:25.374 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:25.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:25.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:25.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:25.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:33:25.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:33:25.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:26 smithi110 ceph-mon[36055]: Reconfiguring mgr.smithi110.ezwdax (monmap changed)... 2024-04-12T13:33:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:26 smithi110 ceph-mon[36055]: Reconfiguring daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:33:26.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:26 smithi060 ceph-mon[29097]: Reconfiguring mgr.smithi110.ezwdax (monmap changed)... 2024-04-12T13:33:26.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:26 smithi060 ceph-mon[29097]: Reconfiguring daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:33:27.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:27.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:27.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:27.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:33:27.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:33:27.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:27.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:27.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:27.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:27.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:33:27.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:33:27.389 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:28.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:28 smithi060 ceph-mon[29097]: Reconfiguring mon.smithi110 (monmap changed)... 2024-04-12T13:33:28.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:28 smithi060 ceph-mon[29097]: Reconfiguring daemon mon.smithi110 on smithi110 2024-04-12T13:33:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:28 smithi110 ceph-mon[36055]: Reconfiguring mon.smithi110 (monmap changed)... 2024-04-12T13:33:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:28 smithi110 ceph-mon[36055]: Reconfiguring daemon mon.smithi110 on smithi110 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:29 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.623 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:29.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:29 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:33:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T13:33:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:30.551 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:33:30.551 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T13:33:30.551 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:33:30.551 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T13:33:30.551 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:33:30.552 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T13:33:30.552 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:31.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:31 smithi060 ceph-mon[29097]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:31.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.403 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:31 smithi110 ceph-mon[36055]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:32.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:32 smithi060 ceph-mon[29097]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:32 smithi110 ceph-mon[36055]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:34 smithi060 ceph-mon[29097]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:34 smithi060 ceph-mon[29097]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T13:33:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:34 smithi110 ceph-mon[36055]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:34 smithi110 ceph-mon[36055]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T13:33:35.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.557+0000 7f17baa00700 1 -- 172.21.15.60:0/752710736 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f17c4111c20 con 0x7f17a8069210 2024-04-12T13:33:35.559 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 0 on host 'smithi060' 2024-04-12T13:33:35.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 msgr2=0x7f17a806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:33:35.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 0x7f17a806b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17b000b7a0 tx=0x7f17b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:33:35.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 msgr2=0x7f17c410fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:33:35.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c810 tx=0x7f17b4004470 comp rx=0 tx=0).stop 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 shutdown_connections 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f17a8069210 0x7f17a806b6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17c40ff000 0x7f17c410fd20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 --2- 172.21.15.60:0/752710736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c41002b0 0x7f17c4110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 >> 172.21.15.60:0/752710736 conn(0x7f17c40fa950 msgr2=0x7f17c40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 shutdown_connections 2024-04-12T13:33:35.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:35.561+0000 7f17c9c00700 1 -- 172.21.15.60:0/752710736 wait complete. 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: osdmap e7: 1 total, 0 up, 1 in 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:36.019 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:35 smithi110 ceph-mon[36055]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T13:33:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:35 smithi110 ceph-mon[36055]: osdmap e7: 1 total, 0 up, 1 in 2024-04-12T13:33:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:36.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:35 smithi110 ceph-mon[36055]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:33:36.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:36.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:36 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:36.979 DEBUG:teuthology.orchestra.run.smithi060:osd.0> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.0.service 2024-04-12T13:33:36.988 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_3... 2024-04-12T13:33:36.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-12T13:33:37.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:37 smithi060 ceph-mon[29097]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:37 smithi060 ceph-mon[29097]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:33:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:37 smithi060 ceph-mon[29097]: osdmap e8: 1 total, 0 up, 1 in 2024-04-12T13:33:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:37 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:37 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:37 smithi110 ceph-mon[36055]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:37 smithi110 ceph-mon[36055]: from='osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:33:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:37 smithi110 ceph-mon[36055]: osdmap e8: 1 total, 0 up, 1 in 2024-04-12T13:33:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:37 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:37.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:37 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:37.510 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] boot 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: osdmap e9: 1 total, 1 up, 1 in 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: osd.0 [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] boot 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: osdmap e9: 1 total, 1 up, 1 in 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:33:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:38.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:39.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:39 smithi060 ceph-mon[29097]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:39.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:39 smithi060 ceph-mon[29097]: osdmap e10: 1 total, 1 up, 1 in 2024-04-12T13:33:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:39 smithi110 ceph-mon[36055]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T13:33:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:39 smithi110 ceph-mon[36055]: osdmap e10: 1 total, 1 up, 1 in 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0392903 s, 267 MB/s 2024-04-12T13:33:40.688 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-04-12T13:33:41.409 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:41 smithi060 ceph-mon[29097]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:41 smithi110 ceph-mon[36055]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:41.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-04-12T13:33:42.500 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:33:43.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:43 smithi110 ceph-mon[36055]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:43.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:43 smithi060 ceph-mon[29097]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:45.362 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.420+0000 7fdb2ac00700 1 -- 172.21.15.60:0/2175571516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fe040 msgr2=0x7fdb240fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.420+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/2175571516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fe040 0x7fdb240fe4b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb10004940 tx=0x7fdb10009e30 comp rx=0 tx=0).stop 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 -- 172.21.15.60:0/2175571516 shutdown_connections 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/2175571516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fe040 0x7fdb240fe4b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/2175571516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fce40 0x7fdb240fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 -- 172.21.15.60:0/2175571516 >> 172.21.15.60:0/2175571516 conn(0x7fdb240f8530 msgr2=0x7fdb240fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 -- 172.21.15.60:0/2175571516 shutdown_connections 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.421+0000 7fdb2ac00700 1 -- 172.21.15.60:0/2175571516 wait complete. 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 Processor -- start 2024-04-12T13:33:45.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 -- start start 2024-04-12T13:33:45.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:33:45.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 0x7fdb24070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:33:45.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240708c0 con 0x7fdb240fce40 2024-04-12T13:33:45.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.422+0000 7fdb2ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24070a30 con 0x7fdb240fe040 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34510/0 (socket says 172.21.15.60:34510) 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 -- 172.21.15.60:0/1705759678 learned_addr learned my addr 172.21.15.60:0/1705759678 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23400700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 0x7fdb24070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 -- 172.21.15.60:0/1705759678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 msgr2=0x7fdb24070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 0x7fdb24070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23e00700 1 -- 172.21.15.60:0/1705759678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10005040 con 0x7fdb240fce40 2024-04-12T13:33:45.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.423+0000 7fdb23400700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 0x7fdb24070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb23e00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb70 tx=0x7fdb1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb14007cc0 con 0x7fdb240fce40 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb24070cb0 con 0x7fdb240fce40 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb1400f040 con 0x7fdb240fce40 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1400cbd0 con 0x7fdb240fce40 2024-04-12T13:33:45.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.424+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb241159e0 con 0x7fdb240fce40 2024-04-12T13:33:45.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.426+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2405f5f0 con 0x7fdb240fce40 2024-04-12T13:33:45.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.427+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fdb1400cd30 con 0x7fdb240fce40 2024-04-12T13:33:45.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.429+0000 7fdb1be00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 0x7fdb0806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:33:45.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.429+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fdb14085e80 con 0x7fdb240fce40 2024-04-12T13:33:45.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.430+0000 7fdb23400700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 0x7fdb0806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:33:45.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.431+0000 7fdb23400700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 0x7fdb0806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b0d0 tx=0x7fdb10009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:33:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.434+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdb1404e250 con 0x7fdb240fce40 2024-04-12T13:33:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:33:45.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:33:45.678+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb24102320 con 0x7fdb08069210 2024-04-12T13:33:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi060 2024-04-12T13:33:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi060 to 12870M 2024-04-12T13:33:46.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:33:46.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:33:46.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:33:46.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:46.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi060 2024-04-12T13:33:46.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi060 to 12870M 2024-04-12T13:33:46.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:33:46.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:33:46.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:33:46.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:47.228 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:47 smithi060 ceph-mon[29097]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:33:47.228 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:47 smithi060 ceph-mon[29097]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:47 smithi110 ceph-mon[36055]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:33:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:47 smithi110 ceph-mon[36055]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:48 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:48 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:48 smithi060 ceph-mon[29097]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:49.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:48 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:49.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:48 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:49.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:48 smithi110 ceph-mon[36055]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:51.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:50 smithi060 ceph-mon[29097]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:51.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:50 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/967927078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac4249c9-82a1-4ca8-b7a9-c56aba9a939a"}]: dispatch 2024-04-12T13:33:51.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:50 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/967927078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac4249c9-82a1-4ca8-b7a9-c56aba9a939a"}]': finished 2024-04-12T13:33:51.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:50 smithi060 ceph-mon[29097]: osdmap e11: 2 total, 1 up, 2 in 2024-04-12T13:33:51.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:50 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:33:51.481 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:50 smithi110 ceph-mon[36055]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:51.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:50 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/967927078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac4249c9-82a1-4ca8-b7a9-c56aba9a939a"}]: dispatch 2024-04-12T13:33:51.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:50 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/967927078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac4249c9-82a1-4ca8-b7a9-c56aba9a939a"}]': finished 2024-04-12T13:33:51.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:50 smithi110 ceph-mon[36055]: osdmap e11: 2 total, 1 up, 2 in 2024-04-12T13:33:51.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:50 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:33:52.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:51 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2915910820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:33:52.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:52.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:52.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:51 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2915910820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:33:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:33:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:52 smithi060 ceph-mon[29097]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:33:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:52 smithi110 ceph-mon[36055]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:33:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:33:55.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:55 smithi060 ceph-mon[29097]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:55 smithi110 ceph-mon[36055]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:57.285 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:57 smithi060 ceph-mon[29097]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:57.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:57 smithi110 ceph-mon[36055]: pgmap v57: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:33:59 smithi060 ceph-mon[29097]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:33:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:33:59 smithi110 ceph-mon[36055]: pgmap v58: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:00.325 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:34:00.325 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:00.325 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:34:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:01.328 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:01 smithi060 ceph-mon[29097]: Deploying daemon osd.1 on smithi060 2024-04-12T13:34:01.328 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:01 smithi060 ceph-mon[29097]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:01 smithi110 ceph-mon[36055]: Deploying daemon osd.1 on smithi060 2024-04-12T13:34:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:01 smithi110 ceph-mon[36055]: pgmap v59: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:03.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:03 smithi060 ceph-mon[29097]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:03 smithi110 ceph-mon[36055]: pgmap v60: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:05 smithi060 ceph-mon[29097]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:05 smithi110 ceph-mon[36055]: pgmap v61: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:07.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:07 smithi060 ceph-mon[29097]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:07 smithi110 ceph-mon[36055]: pgmap v62: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:08.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:08.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:08.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:08.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:08 smithi060 ceph-mon[29097]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:08 smithi110 ceph-mon[36055]: pgmap v63: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:10 smithi060 ceph-mon[29097]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:10 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:10 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:10 smithi110 ceph-mon[36055]: pgmap v64: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:10 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:10 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:12.176 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:11 smithi110 ceph-mon[36055]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T13:34:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:11 smithi060 ceph-mon[29097]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T13:34:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.619+0000 7fdb1be00700 1 -- 172.21.15.60:0/1705759678 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdb24102320 con 0x7fdb08069210 2024-04-12T13:34:12.622 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-04-12T13:34:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 msgr2=0x7fdb0806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 0x7fdb0806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b0d0 tx=0x7fdb10009e30 comp rx=0 tx=0).stop 2024-04-12T13:34:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 msgr2=0x7fdb24071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb70 tx=0x7fdb1400b040 comp rx=0 tx=0).stop 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 shutdown_connections 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdb08069210 0x7fdb0806b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb240fce40 0x7fdb24071e40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 --2- 172.21.15.60:0/1705759678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb240fe040 0x7fdb24070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 >> 172.21.15.60:0/1705759678 conn(0x7fdb240f8530 msgr2=0x7fdb240f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 shutdown_connections 2024-04-12T13:34:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:12.623+0000 7fdb2ac00700 1 -- 172.21.15.60:0/1705759678 wait complete. 2024-04-12T13:34:13.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: osdmap e12: 2 total, 1 up, 2 in 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: pgmap v65: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: osdmap e12: 2 total, 1 up, 2 in 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:13.692 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.1.service 2024-04-12T13:34:13.699 INFO:tasks.cephadm:Deploying osd.2 on smithi060 with /dev/vg_nvme/lv_2... 2024-04-12T13:34:13.700 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-12T13:34:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:14 smithi060 ceph-mon[29097]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:34:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:14 smithi060 ceph-mon[29097]: osdmap e13: 2 total, 1 up, 2 in 2024-04-12T13:34:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:14 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:14 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:14 smithi110 ceph-mon[36055]: from='osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:34:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:14 smithi110 ceph-mon[36055]: osdmap e13: 2 total, 1 up, 2 in 2024-04-12T13:34:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:14 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:14 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:34:15.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:34:15.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:34:15.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:15.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:15.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] boot 2024-04-12T13:34:15.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: osdmap e14: 2 total, 2 up, 2 in 2024-04-12T13:34:15.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:15.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: osd.1 [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] boot 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: osdmap e14: 2 total, 2 up, 2 in 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:34:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:16.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:16 smithi060 ceph-mon[29097]: osdmap e15: 2 total, 2 up, 2 in 2024-04-12T13:34:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:16 smithi110 ceph-mon[36055]: osdmap e15: 2 total, 2 up, 2 in 2024-04-12T13:34:17.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:17 smithi060 ceph-mon[29097]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:17 smithi110 ceph-mon[36055]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:18.351 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-12T13:34:18.351 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-12T13:34:18.351 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-04-12T13:34:18.351 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-04-12T13:34:18.351 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0374454 s, 280 MB/s 2024-04-12T13:34:18.352 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-04-12T13:34:18.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:18.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:18 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:18.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:18 smithi060 ceph-mon[29097]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:18.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:18 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:18.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:18 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:18.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:18 smithi110 ceph-mon[36055]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:19.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-04-12T13:34:20.456 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:34:21.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:20 smithi060 ceph-mon[29097]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:21.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:20 smithi110 ceph-mon[36055]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:23.309 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:22 smithi060 ceph-mon[29097]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:23.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 -- 172.21.15.60:0/17351125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 msgr2=0x7f8f40103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 --2- 172.21.15.60:0/17351125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40103830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004940 tx=0x7f8f34009e30 comp rx=0 tx=0).stop 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 -- 172.21.15.60:0/17351125 shutdown_connections 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 --2- 172.21.15.60:0/17351125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 --2- 172.21.15.60:0/17351125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40103830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 -- 172.21.15.60:0/17351125 >> 172.21.15.60:0/17351125 conn(0x7f8f40072640 msgr2=0x7f8f40074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 -- 172.21.15.60:0/17351125 shutdown_connections 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.394+0000 7f8f48600700 1 -- 172.21.15.60:0/17351125 wait complete. 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.395+0000 7f8f48600700 1 Processor -- start 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.395+0000 7f8f48600700 1 -- start start 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f48600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:23.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f48600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f48600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40114b20 con 0x7f8f40103420 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f48600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f401194c0 con 0x7f8f401046d0 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43646/0 (socket says 172.21.15.60:43646) 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 -- 172.21.15.60:0/1755775732 learned_addr learned my addr 172.21.15.60:0/1755775732 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 -- 172.21.15.60:0/1755775732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 msgr2=0x7f8f40114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45200700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45c00700 1 -- 172.21.15.60:0/1755775732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34005040 con 0x7f8f40103420 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.396+0000 7f8f45200700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:34:23.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f45c00700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009150 tx=0x7f8f34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3400e040 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f3400bcc0 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3401c630 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f401196c0 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.397+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f40119c00 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.398+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4004c710 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.399+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f8f34013420 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.400+0000 7f8f3d600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 0x7f8f2806b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.401+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f8f34087230 con 0x7f8f40103420 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.401+0000 7f8f45200700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 0x7f8f2806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.401+0000 7f8f45200700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 0x7f8f2806b790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006fd0 tx=0x7f8f2c008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:34:23.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.405+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8f34057ca0 con 0x7f8f40103420 2024-04-12T13:34:23.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:22 smithi110 ceph-mon[36055]: pgmap v74: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:23.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:23.632+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f40108a10 con 0x7f8f280692e0 2024-04-12T13:34:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:34:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:23 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:34:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:34:24.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:34:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:25 smithi060 ceph-mon[29097]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:34:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:25 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi060 2024-04-12T13:34:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:25 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi060 to 6435M 2024-04-12T13:34:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:25 smithi060 ceph-mon[29097]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:25 smithi110 ceph-mon[36055]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:34:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:25 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi060 2024-04-12T13:34:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:25 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi060 to 6435M 2024-04-12T13:34:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:25 smithi110 ceph-mon[36055]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:27.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:27 smithi060 ceph-mon[29097]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:27 smithi110 ceph-mon[36055]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:28.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:28 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1801314901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2"}]: dispatch 2024-04-12T13:34:28.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:28 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1801314901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2"}]': finished 2024-04-12T13:34:28.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:28 smithi060 ceph-mon[29097]: osdmap e16: 3 total, 2 up, 3 in 2024-04-12T13:34:28.271 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:28 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1801314901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2"}]: dispatch 2024-04-12T13:34:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:28 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1801314901' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2"}]': finished 2024-04-12T13:34:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:28 smithi110 ceph-mon[36055]: osdmap e16: 3 total, 2 up, 3 in 2024-04-12T13:34:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:29 smithi060 ceph-mon[29097]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:29 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1420336196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:34:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:29 smithi110 ceph-mon[36055]: pgmap v78: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:29 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1420336196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:34:30.422 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:31.285 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:31 smithi060 ceph-mon[29097]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:31.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:31 smithi110 ceph-mon[36055]: pgmap v79: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:34:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:34:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:33.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:33 smithi060 ceph-mon[29097]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:33 smithi110 ceph-mon[36055]: pgmap v80: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:35.468 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:35 smithi060 ceph-mon[29097]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:35 smithi110 ceph-mon[36055]: pgmap v81: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:37 smithi060 ceph-mon[29097]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:37 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:34:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:37 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:37 smithi110 ceph-mon[36055]: pgmap v82: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:37 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:34:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:37 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:34:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:38 smithi110 ceph-mon[36055]: Deploying daemon osd.2 on smithi060 2024-04-12T13:34:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:38 smithi060 ceph-mon[29097]: Deploying daemon osd.2 on smithi060 2024-04-12T13:34:39.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:39 smithi060 ceph-mon[29097]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:39 smithi110 ceph-mon[36055]: pgmap v83: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:41.560 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:41 smithi060 ceph-mon[29097]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:41 smithi110 ceph-mon[36055]: pgmap v84: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:43 smithi060 ceph-mon[29097]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:43 smithi110 ceph-mon[36055]: pgmap v85: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:45.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:45 smithi060 ceph-mon[29097]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:45.517 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:45 smithi110 ceph-mon[36055]: pgmap v86: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:34:46.615 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:46.615 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:46.615 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:46 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:34:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:46 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:47 smithi060 ceph-mon[29097]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:47 smithi110 ceph-mon[36055]: pgmap v87: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:49.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:49 smithi060 ceph-mon[29097]: pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:49 smithi110 ceph-mon[36055]: pgmap v88: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.576+0000 7f8f3d600700 1 -- 172.21.15.60:0/1755775732 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8f40108a10 con 0x7f8f280692e0 2024-04-12T13:34:50.579 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 2 on host 'smithi060' 2024-04-12T13:34:50.579 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:50 smithi060 ceph-mon[29097]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T13:34:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.580+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 msgr2=0x7f8f2806b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.580+0000 7f8f48600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 0x7f8f2806b790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006fd0 tx=0x7f8f2c008040 comp rx=0 tx=0).stop 2024-04-12T13:34:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.580+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 msgr2=0x7f8f40113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.580+0000 7f8f48600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009150 tx=0x7f8f34009e30 comp rx=0 tx=0).stop 2024-04-12T13:34:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 shutdown_connections 2024-04-12T13:34:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8f280692e0 0x7f8f2806b790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f40103420 0x7f8f40113f50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 --2- 172.21.15.60:0/1755775732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f401046d0 0x7f8f40114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 >> 172.21.15.60:0/1755775732 conn(0x7f8f40072640 msgr2=0x7f8f40073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:34:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 shutdown_connections 2024-04-12T13:34:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:34:50.581+0000 7f8f48600700 1 -- 172.21.15.60:0/1755775732 wait complete. 2024-04-12T13:34:50.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:50 smithi110 ceph-mon[36055]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: osdmap e17: 3 total, 2 up, 3 in 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:51.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: pgmap v89: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T13:34:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: osdmap e17: 3 total, 2 up, 3 in 2024-04-12T13:34:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:51.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:34:51.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:51.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:52.067 DEBUG:teuthology.orchestra.run.smithi060:osd.2> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service 2024-04-12T13:34:52.075 INFO:tasks.cephadm:Deploying osd.3 on smithi110 with /dev/vg_nvme/lv_4... 2024-04-12T13:34:52.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-12T13:34:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:52 smithi110 ceph-mon[36055]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:34:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:52 smithi110 ceph-mon[36055]: osdmap e18: 3 total, 2 up, 3 in 2024-04-12T13:34:52.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:52.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:52.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:52 smithi110 ceph-mon[36055]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:52.545 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:34:52.652 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:52 smithi060 ceph-mon[29097]: from='osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-04-12T13:34:52.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:52 smithi060 ceph-mon[29097]: osdmap e18: 3 total, 2 up, 3 in 2024-04-12T13:34:52.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:52.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:52.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:52 smithi060 ceph-mon[29097]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T13:34:53.637 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:53 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:34:53.638 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:53 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:34:53.638 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:53 smithi060 ceph-mon[29097]: osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] boot 2024-04-12T13:34:53.638 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:53 smithi060 ceph-mon[29097]: osdmap e19: 3 total, 3 up, 3 in 2024-04-12T13:34:53.638 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:53 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:53.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:53 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:34:53.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:53 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:34:53.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:53 smithi110 ceph-mon[36055]: osd.2 [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] boot 2024-04-12T13:34:53.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:53 smithi110 ceph-mon[36055]: osdmap e19: 3 total, 3 up, 3 in 2024-04-12T13:34:53.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:53 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:34:54.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:54 smithi060 ceph-mon[29097]: osdmap e20: 3 total, 3 up, 3 in 2024-04-12T13:34:54.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:54 smithi110 ceph-mon[36055]: osdmap e20: 3 total, 3 up, 3 in 2024-04-12T13:34:55.510 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-12T13:34:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-12T13:34:55.511 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-12T13:34:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-12T13:34:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0370668 s, 283 MB/s 2024-04-12T13:34:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: pgmap v95: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: osdmap e21: 3 total, 3 up, 3 in 2024-04-12T13:34:55.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:55 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-12T13:34:55.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: pgmap v95: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:55.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-12T13:34:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-12T13:34:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: osdmap e21: 3 total, 3 up, 3 in 2024-04-12T13:34:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:55 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-12T13:34:56.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-04-12T13:34:56.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:56 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-12T13:34:56.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:56 smithi060 ceph-mon[29097]: osdmap e22: 3 total, 3 up, 3 in 2024-04-12T13:34:56.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:56 smithi060 ceph-mon[29097]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:56.862 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:56 smithi060 sudo[64459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T13:34:56.862 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:56 smithi060 sudo[64459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:34:56.862 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:56 smithi060 sudo[64459]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:34:56.863 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:56 smithi060 sudo[64459]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:34:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:34:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:56 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-12T13:34:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:56 smithi110 ceph-mon[36055]: osdmap e22: 3 total, 3 up, 3 in 2024-04-12T13:34:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:56 smithi110 ceph-mon[36055]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:57.590 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64480]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T13:34:57.591 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64480]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:34:57.591 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64480]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:34:57.591 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64480]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:34:57.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:57 smithi060 ceph-mon[29097]: osdmap e23: 3 total, 3 up, 3 in 2024-04-12T13:34:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:57 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:57 smithi110 ceph-mon[36055]: osdmap e23: 3 total, 3 up, 3 in 2024-04-12T13:34:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:57 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:34:58.250 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64504]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T13:34:58.250 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:34:58.250 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:57 smithi060 sudo[64504]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:34:58.250 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:58 smithi060 sudo[64504]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:34:58.870 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:58 smithi110 ceph-mon[36055]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:58.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:58 smithi060 sudo[64514]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T13:34:58.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:58 smithi060 sudo[64514]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:34:58.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:58 smithi060 sudo[64514]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:34:58.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:34:58 smithi060 sudo[64514]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:34:58.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:58 smithi060 ceph-mon[29097]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:34:59.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 -- 172.21.15.110:0/744451232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed80708f0 msgr2=0x7efed8070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:59.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 --2- 172.21.15.110:0/744451232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed80708f0 0x7efed8070d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efec4004970 tx=0x7efec4009e30 comp rx=0 tx=0).stop 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 -- 172.21.15.110:0/744451232 shutdown_connections 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 --2- 172.21.15.110:0/744451232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed80708f0 0x7efed8070d60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 --2- 172.21.15.110:0/744451232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed8071ea0 0x7efed80703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 -- 172.21.15.110:0/744451232 >> 172.21.15.110:0/744451232 conn(0x7efed80f8570 msgr2=0x7efed80fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 -- 172.21.15.110:0/744451232 shutdown_connections 2024-04-12T13:34:59.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.033+0000 7efedcc00700 1 -- 172.21.15.110:0/744451232 wait complete. 2024-04-12T13:34:59.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.034+0000 7efedcc00700 1 Processor -- start 2024-04-12T13:34:59.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.034+0000 7efedcc00700 1 -- start start 2024-04-12T13:34:59.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.034+0000 7efedcc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed80708f0 0x7efed810fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:59.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efedcc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efedcc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8110620 con 0x7efed80708f0 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efedcc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8110790 con 0x7efed8071ea0 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54998/0 (socket says 172.21.15.110:54998) 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 -- 172.21.15.110:0/3655427104 learned_addr learned my addr 172.21.15.110:0/3655427104 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 -- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed80708f0 msgr2=0x7efed810fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed80708f0 0x7efed810fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.035+0000 7efed5400700 1 -- 172.21.15.110:0/3655427104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4005040 con 0x7efed8071ea0 2024-04-12T13:34:59.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efed5400700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efec4004f50 tx=0x7efec4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec400e040 con 0x7efed8071ea0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efec400bce0 con 0x7efed8071ea0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec401c630 con 0x7efed8071ea0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed8115190 con 0x7efed8071ea0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.036+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed8115750 con 0x7efed8071ea0 2024-04-12T13:34:59.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.037+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed804c710 con 0x7efed8071ea0 2024-04-12T13:34:59.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.038+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efec4013a80 con 0x7efed8071ea0 2024-04-12T13:34:59.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.039+0000 7efece000700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 0x7efebc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:34:59.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.039+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3228+0+0 (secure 0 0 0) 0x7efec4087da0 con 0x7efed8071ea0 2024-04-12T13:34:59.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.039+0000 7efed5e00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 0x7efebc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:34:59.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.040+0000 7efed5e00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 0x7efebc06b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efed8071be0 tx=0x7efec8009ce0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:34:59.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.044+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efec4058380 con 0x7efed8071ea0 2024-04-12T13:34:59.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:34:59.262+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7efed8103db0 con 0x7efebc0692a0 2024-04-12T13:34:59.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[64539]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T13:34:59.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[64539]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:34:59.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[64539]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:34:59.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[64539]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:34:59.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:59 smithi110 ceph-mon[36055]: mgrmap e19: smithi060.bpzacg(active, since 2m), standbys: smithi110.ezwdax 2024-04-12T13:34:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:59 smithi110 ceph-mon[36055]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:34:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:59 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:34:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:59 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:34:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:34:59 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:00.180 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[66407]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T13:35:00.180 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[66407]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:35:00.180 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[66407]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:35:00.180 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:34:59 smithi060 sudo[66407]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:35:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:59 smithi060 ceph-mon[29097]: mgrmap e19: smithi060.bpzacg(active, since 2m), standbys: smithi110.ezwdax 2024-04-12T13:35:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:59 smithi060 ceph-mon[29097]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:35:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:59 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:35:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:59 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:35:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:34:59 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:00.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66797]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T13:35:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66797]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:35:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66797]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:35:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66797]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:35:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66800]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T13:35:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66800]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:35:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66800]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:35:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:00 smithi060 sudo[66800]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:35:01.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:01 smithi110 sudo[39319]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T13:35:01.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:01 smithi110 sudo[39319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:35:01.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:01 smithi110 sudo[39319]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:35:01.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:01 smithi110 sudo[39319]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:35:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T13:35:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T13:35:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:35:02.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:35:02.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:02.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:02.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:35:02.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:35:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 sudo[39333]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T13:35:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 sudo[39333]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 sudo[39333]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 sudo[39333]: pam_unix(sudo:session): session closed for user root 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:35:02.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:35:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi060 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi060 to 4290M 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/789283713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]: dispatch 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]: dispatch 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]': finished 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: osdmap e24: 4 total, 3 up, 4 in 2024-04-12T13:35:03.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi060 2024-04-12T13:35:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T13:35:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T13:35:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi060 to 4290M 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/789283713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]: dispatch 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "863337af-34ea-4b8e-85c9-aaf55e0cb5ff"}]': finished 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: osdmap e24: 4 total, 3 up, 4 in 2024-04-12T13:35:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:04.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:04 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/4269861885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:35:04.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:04 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/4269861885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:35:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:05 smithi060 ceph-mon[29097]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:05 smithi110 ceph-mon[36055]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:07.248 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:07 smithi110 ceph-mon[36055]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-12T13:35:07.514 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:07 smithi060 ceph-mon[29097]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-12T13:35:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-12T13:35:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:11 smithi110 ceph-mon[36055]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-12T13:35:11.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:11 smithi060 ceph-mon[29097]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-12T13:35:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:12 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:35:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:12 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:12 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:35:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:12 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:13.402 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:13 smithi110 ceph-mon[36055]: Deploying daemon osd.3 on smithi110 2024-04-12T13:35:13.402 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:13 smithi110 ceph-mon[36055]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-12T13:35:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:13 smithi060 ceph-mon[29097]: Deploying daemon osd.3 on smithi110 2024-04-12T13:35:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:13 smithi060 ceph-mon[29097]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-12T13:35:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:15 smithi060 ceph-mon[29097]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-04-12T13:35:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:15 smithi110 ceph-mon[36055]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-04-12T13:35:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:17.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:17 smithi060 ceph-mon[29097]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T13:35:17.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:17 smithi110 ceph-mon[36055]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T13:35:19.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:19 smithi110 ceph-mon[36055]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:19.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:19 smithi060 ceph-mon[29097]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:20 smithi060 ceph-mon[29097]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:20 smithi110 ceph-mon[36055]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:23 smithi060 ceph-mon[29097]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:23.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:23 smithi110 ceph-mon[36055]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:24.271 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:24 smithi110 ceph-mon[36055]: from='osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:35:24.271 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:24 smithi110 ceph-mon[36055]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:35:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:24 smithi060 ceph-mon[29097]: from='osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:35:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:24 smithi060 ceph-mon[29097]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:35:24.710 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 3 on host 'smithi110' 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.708+0000 7efece000700 1 -- 172.21.15.110:0/3655427104 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efed8103db0 con 0x7efebc0692a0 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 msgr2=0x7efebc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 0x7efebc06b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efed8071be0 tx=0x7efec8009ce0 comp rx=0 tx=0).stop 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 msgr2=0x7efed8110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efec4004f50 tx=0x7efec4009e30 comp rx=0 tx=0).stop 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 shutdown_connections 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7efebc0692a0 0x7efebc06b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed80708f0 0x7efed810fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 --2- 172.21.15.110:0/3655427104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed8071ea0 0x7efed8110020 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.712+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 >> 172.21.15.110:0/3655427104 conn(0x7efed80f8570 msgr2=0x7efed80f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:35:24.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.713+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 shutdown_connections 2024-04-12T13:35:24.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:24.713+0000 7efedcc00700 1 -- 172.21.15.110:0/3655427104 wait complete. 2024-04-12T13:35:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T13:35:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: osdmap e25: 4 total, 3 up, 4 in 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:25 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: osdmap e25: 4 total, 3 up, 4 in 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:25 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:25.555 DEBUG:teuthology.orchestra.run.smithi110:osd.3> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.3.service 2024-04-12T13:35:25.559 INFO:tasks.cephadm:Deploying osd.4 on smithi110 with /dev/vg_nvme/lv_3... 2024-04-12T13:35:25.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-12T13:35:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:26 smithi060 ceph-mon[29097]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:35:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:26 smithi060 ceph-mon[29097]: osdmap e26: 4 total, 3 up, 4 in 2024-04-12T13:35:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:26 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:26 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:26 smithi110 ceph-mon[36055]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:35:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:26 smithi110 ceph-mon[36055]: osdmap e26: 4 total, 3 up, 4 in 2024-04-12T13:35:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:26 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:26 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:26.488 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:35:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:35:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:35:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] boot 2024-04-12T13:35:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: osdmap e27: 4 total, 4 up, 4 in 2024-04-12T13:35:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:27 smithi110 ceph-mon[36055]: osdmap e28: 4 total, 4 up, 4 in 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: osd.3 [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] boot 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: osdmap e27: 4 total, 4 up, 4 in 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:35:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:27 smithi060 ceph-mon[29097]: osdmap e28: 4 total, 4 up, 4 in 2024-04-12T13:35:28.226 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:28 smithi110 ceph-mon[36055]: osdmap e29: 4 total, 4 up, 4 in 2024-04-12T13:35:28.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:28 smithi060 ceph-mon[29097]: osdmap e29: 4 total, 4 up, 4 in 2024-04-12T13:35:29.217 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:29 smithi110 ceph-mon[36055]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:29.217 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:29 smithi110 ceph-mon[36055]: osdmap e30: 4 total, 4 up, 4 in 2024-04-12T13:35:29.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:29 smithi060 ceph-mon[29097]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:29 smithi060 ceph-mon[29097]: osdmap e30: 4 total, 4 up, 4 in 2024-04-12T13:35:30.220 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-12T13:35:30.220 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-12T13:35:30.220 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-12T13:35:30.220 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-12T13:35:30.221 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0324428 s, 323 MB/s 2024-04-12T13:35:30.221 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-12T13:35:30.385 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:30 smithi110 ceph-mon[36055]: osdmap e31: 4 total, 4 up, 4 in 2024-04-12T13:35:30.385 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:30 smithi060 ceph-mon[29097]: osdmap e31: 4 total, 4 up, 4 in 2024-04-12T13:35:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:31.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:31.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:31.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:31.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:31.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:31.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:31.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:35:31.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:31.809 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:35:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:32 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi110 2024-04-12T13:35:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:32 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi110 to 15937M 2024-04-12T13:35:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:32 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi110 2024-04-12T13:35:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:32 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi110 to 15937M 2024-04-12T13:35:33.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:33 smithi060 ceph-mon[29097]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-12T13:35:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:33 smithi110 ceph-mon[36055]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-12T13:35:34.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.124+0000 7f9624c00700 1 -- 172.21.15.110:0/2501257230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620103420 msgr2=0x7f9620103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:35:34.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.124+0000 7f9624c00700 1 --2- 172.21.15.110:0/2501257230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620103420 0x7f9620103830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9610004940 tx=0x7f9610009e30 comp rx=0 tx=0).stop 2024-04-12T13:35:34.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 -- 172.21.15.110:0/2501257230 shutdown_connections 2024-04-12T13:35:34.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 --2- 172.21.15.110:0/2501257230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96201046d0 0x7f9620104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:34.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 --2- 172.21.15.110:0/2501257230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9620103420 0x7f9620103830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:34.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 -- 172.21.15.110:0/2501257230 >> 172.21.15.110:0/2501257230 conn(0x7f9620072640 msgr2=0x7f9620074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:35:34.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 -- 172.21.15.110:0/2501257230 shutdown_connections 2024-04-12T13:35:34.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.125+0000 7f9624c00700 1 -- 172.21.15.110:0/2501257230 wait complete. 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 Processor -- start 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 -- start start 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9620103420 0x7f9620113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620114b50 con 0x7f9620103420 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.126+0000 7f9624c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201194f0 con 0x7f96201046d0 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57742/0 (socket says 172.21.15.110:57742) 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 -- 172.21.15.110:0/4032048895 learned_addr learned my addr 172.21.15.110:0/4032048895 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:35:34.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 -- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9620103420 msgr2=0x7f9620113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9620103420 0x7f9620113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 -- 172.21.15.110:0/4032048895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610005040 con 0x7f96201046d0 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.127+0000 7f961d400700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f960c00b790 tx=0x7f960c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.128+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c00f770 con 0x7f96201046d0 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.128+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f960c00fda0 con 0x7f96201046d0 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.128+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c00d310 con 0x7f96201046d0 2024-04-12T13:35:34.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.128+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9620119750 con 0x7f96201046d0 2024-04-12T13:35:34.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.128+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9620119cc0 con 0x7f96201046d0 2024-04-12T13:35:34.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.129+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962004c710 con 0x7f96201046d0 2024-04-12T13:35:34.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.130+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f960c010420 con 0x7f96201046d0 2024-04-12T13:35:34.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.131+0000 7f9616000700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 0x7f960406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:35:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.131+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f960c086ad0 con 0x7f96201046d0 2024-04-12T13:35:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.132+0000 7f961de00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 0x7f960406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:35:34.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.133+0000 7f961de00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 0x7f960406b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9610004f90 tx=0x7f9610009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:35:34.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.136+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f960c056f10 con 0x7f96201046d0 2024-04-12T13:35:34.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:35:34.351+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9620119f90 con 0x7f96040692a0 2024-04-12T13:35:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:35 smithi060 ceph-mon[29097]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-12T13:35:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:35:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:35:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:35.470 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:35 smithi110 ceph-mon[36055]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-12T13:35:35.470 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:35:35.471 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:35:35.471 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:36.364 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:36 smithi110 ceph-mon[36055]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:35:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:36 smithi060 ceph-mon[29097]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:35:37.258 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:37 smithi110 ceph-mon[36055]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-12T13:35:37.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:37 smithi060 ceph-mon[29097]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-12T13:35:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:38 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/2736430611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]: dispatch 2024-04-12T13:35:38.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:38 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]: dispatch 2024-04-12T13:35:38.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:38 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]': finished 2024-04-12T13:35:38.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:38 smithi110 ceph-mon[36055]: osdmap e32: 5 total, 4 up, 5 in 2024-04-12T13:35:38.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:38 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:35:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:38 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/2736430611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]: dispatch 2024-04-12T13:35:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:38 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]: dispatch 2024-04-12T13:35:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:38 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2638e619-a934-42d4-acea-86c6a01a19ec"}]': finished 2024-04-12T13:35:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:38 smithi060 ceph-mon[29097]: osdmap e32: 5 total, 4 up, 5 in 2024-04-12T13:35:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:38 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:35:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:39 smithi110 ceph-mon[36055]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-12T13:35:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:39 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/349152839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:35:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:39 smithi060 ceph-mon[29097]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-12T13:35:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:39 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/349152839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:35:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:41 smithi110 ceph-mon[36055]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-12T13:35:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:41 smithi060 ceph-mon[29097]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-12T13:35:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:43 smithi110 ceph-mon[36055]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:43.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:43 smithi060 ceph-mon[29097]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:45.355 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:45 smithi110 ceph-mon[36055]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:45.355 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:45 smithi060 ceph-mon[29097]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:35:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:47 smithi110 ceph-mon[36055]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:47 smithi060 ceph-mon[29097]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:48.474 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:48 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:35:48.475 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:48 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:48.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:48 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:35:48.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:48 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:35:49.284 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:49 smithi110 ceph-mon[36055]: Deploying daemon osd.4 on smithi110 2024-04-12T13:35:49.284 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:49 smithi110 ceph-mon[36055]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:49.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:49 smithi060 ceph-mon[29097]: Deploying daemon osd.4 on smithi110 2024-04-12T13:35:49.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:49 smithi060 ceph-mon[29097]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:51.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:51 smithi110 ceph-mon[36055]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:51 smithi060 ceph-mon[29097]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:53 smithi110 ceph-mon[36055]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:53 smithi060 ceph-mon[29097]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:55 smithi060 ceph-mon[29097]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:55 smithi110 ceph-mon[36055]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:56.571 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:56 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:56.571 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:56 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:56.571 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:56 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:56.572 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:56 smithi110 ceph-mon[36055]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:56 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:56 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:35:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:56 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:35:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:56 smithi060 ceph-mon[29097]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:59.333 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:35:59 smithi110 ceph-mon[36055]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:35:59.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:35:59 smithi060 ceph-mon[29097]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:36:00.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.061+0000 7f9616000700 1 -- 172.21.15.110:0/4032048895 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9620119f90 con 0x7f96040692a0 2024-04-12T13:36:00.064 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 4 on host 'smithi110' 2024-04-12T13:36:00.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 msgr2=0x7f960406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:00.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 0x7f960406b750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9610004f90 tx=0x7f9610009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:00.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 msgr2=0x7f96201144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:00.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f960c00b790 tx=0x7f960c009250 comp rx=0 tx=0).stop 2024-04-12T13:36:00.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 shutdown_connections 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f96040692a0 0x7f960406b750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9620103420 0x7f9620113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 --2- 172.21.15.110:0/4032048895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96201046d0 0x7f96201144c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 >> 172.21.15.110:0/4032048895 conn(0x7f9620072640 msgr2=0x7f9620073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 shutdown_connections 2024-04-12T13:36:00.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:00.065+0000 7f9624c00700 1 -- 172.21.15.110:0/4032048895 wait complete. 2024-04-12T13:36:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:00 smithi110 ceph-mon[36055]: from='osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:36:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:00 smithi110 ceph-mon[36055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:36:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:00 smithi060 ceph-mon[29097]: from='osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:36:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:00 smithi060 ceph-mon[29097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:36:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:00.908 DEBUG:teuthology.orchestra.run.smithi110:osd.4> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.4.service 2024-04-12T13:36:00.913 INFO:tasks.cephadm:Deploying osd.5 on smithi110 with /dev/vg_nvme/lv_2... 2024-04-12T13:36:00.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-12T13:36:01.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:36:01.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:01.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T13:36:01.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: osdmap e33: 5 total, 4 up, 5 in 2024-04-12T13:36:01.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:01.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:01.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:01.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:01.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:01.229 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[48145]: 2024-04-12T13:36:01.055+0000 7f4f85200700 -1 osd.4 0 waiting for initial osdmap 2024-04-12T13:36:01.229 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:36:01 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[48145]: 2024-04-12T13:36:01.070+0000 7f4f7b200700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:36:01.413 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: osdmap e33: 5 total, 4 up, 5 in 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:01 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:02 smithi060 ceph-mon[29097]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:36:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:02 smithi060 ceph-mon[29097]: osdmap e34: 5 total, 4 up, 5 in 2024-04-12T13:36:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:02.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:02 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:02.453 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:02 smithi110 ceph-mon[36055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:36:02.453 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:02 smithi110 ceph-mon[36055]: osdmap e34: 5 total, 4 up, 5 in 2024-04-12T13:36:02.453 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:02.453 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:02 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] boot 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: osdmap e35: 5 total, 5 up, 5 in 2024-04-12T13:36:03.348 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:03 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: osd.4 [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] boot 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: osdmap e35: 5 total, 5 up, 5 in 2024-04-12T13:36:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:03 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:36:04.247 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:04 smithi110 ceph-mon[36055]: osdmap e36: 5 total, 5 up, 5 in 2024-04-12T13:36:04.382 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-12T13:36:04.382 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-12T13:36:04.382 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-12T13:36:04.382 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-12T13:36:04.382 INFO:teuthology.orchestra.run.smithi110.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0327741 s, 320 MB/s 2024-04-12T13:36:04.383 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-12T13:36:04.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:04 smithi060 ceph-mon[29097]: osdmap e36: 5 total, 5 up, 5 in 2024-04-12T13:36:05.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:05 smithi110 ceph-mon[36055]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:05.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:05 smithi110 ceph-mon[36055]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:36:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:05 smithi060 ceph-mon[29097]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:05 smithi060 ceph-mon[29097]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:36:05.703 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-04-12T13:36:06.156 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:36:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:07 smithi110 ceph-mon[36055]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:07 smithi060 ceph-mon[29097]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 -- 172.21.15.110:0/1250694706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61480662f0 msgr2=0x7f6148101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 --2- 172.21.15.110:0/1250694706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61480662f0 0x7f6148101e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6130004940 tx=0x7f6130009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 -- 172.21.15.110:0/1250694706 shutdown_connections 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 --2- 172.21.15.110:0/1250694706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6148102370 0x7f6148104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 --2- 172.21.15.110:0/1250694706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61480662f0 0x7f6148101e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 -- 172.21.15.110:0/1250694706 >> 172.21.15.110:0/1250694706 conn(0x7f61480f74c0 msgr2=0x7f61480f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 -- 172.21.15.110:0/1250694706 shutdown_connections 2024-04-12T13:36:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.971+0000 7f614d400700 1 -- 172.21.15.110:0/1250694706 wait complete. 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.972+0000 7f614d400700 1 Processor -- start 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.972+0000 7f614d400700 1 -- start start 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f614d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61480662f0 0x7f614810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f614d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f614d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148110790 con 0x7f61480662f0 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f614d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148110fe0 con 0x7f6148102370 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f613de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f613de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53322/0 (socket says 172.21.15.110:53322) 2024-04-12T13:36:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f613de00700 1 -- 172.21.15.110:0/1682643021 learned_addr learned my addr 172.21.15.110:0/1682643021 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:36:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.973+0000 7f6146800700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61480662f0 0x7f614810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613de00700 1 -- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61480662f0 msgr2=0x7f614810fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613de00700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61480662f0 0x7f614810fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613de00700 1 -- 172.21.15.110:0/1682643021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130005040 con 0x7f6148102370 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613de00700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f613800cb10 tx=0x7f6138007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6138004200 con 0x7f6148102370 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f613800ac70 con 0x7f6148102370 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61481112c0 con 0x7f6148102370 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6138003d90 con 0x7f6148102370 2024-04-12T13:36:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.974+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6148111800 con 0x7f6148102370 2024-04-12T13:36:08.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.975+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614805f5f0 con 0x7f6148102370 2024-04-12T13:36:08.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.977+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6138003430 con 0x7f6148102370 2024-04-12T13:36:08.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.977+0000 7f613f400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 0x7f612c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:08.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.978+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f6138087170 con 0x7f6148102370 2024-04-12T13:36:08.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.978+0000 7f6146800700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 0x7f612c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:08.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.979+0000 7f6146800700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 0x7f612c06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f613000b970 tx=0x7f6130009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:08.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:08.982+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6138057380 con 0x7f6148102370 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi110 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi110 to 7968M 2024-04-12T13:36:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:09.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:09.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:09.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:08 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:09.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:09.200+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6148111c10 con 0x7f612c0692a0 2024-04-12T13:36:09.203 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi110 2024-04-12T13:36:09.203 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.203 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.203 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:09.203 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi110 to 7968M 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:09.204 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:08 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: Cluster is now healthy 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:36:10.122 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:10.123 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:10.123 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:10.123 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:09 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:36:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: Cluster is now healthy 2024-04-12T13:36:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:10.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:09 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:10.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:10 smithi110 ceph-mon[36055]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:10 smithi060 ceph-mon[29097]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/1482732097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]: dispatch 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]: dispatch 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]': finished 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: osdmap e37: 6 total, 5 up, 6 in 2024-04-12T13:36:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1482732097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]: dispatch 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]: dispatch 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "786e4b4d-8426-49e5-8473-bd007cc4e71d"}]': finished 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: osdmap e37: 6 total, 5 up, 6 in 2024-04-12T13:36:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:14 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/4148261073' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:36:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:14 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/4148261073' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T13:36:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:15 smithi060 ceph-mon[29097]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:15 smithi110 ceph-mon[36055]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:17.393 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:17 smithi110 ceph-mon[36055]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:17.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:17 smithi060 ceph-mon[29097]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:19.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:19 smithi060 ceph-mon[29097]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:19 smithi110 ceph-mon[36055]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:21 smithi110 ceph-mon[36055]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:21.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:21 smithi060 ceph-mon[29097]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:22 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:36:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:22 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:22 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:36:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:22 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:23 smithi060 ceph-mon[29097]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:23 smithi060 ceph-mon[29097]: Deploying daemon osd.5 on smithi110 2024-04-12T13:36:23.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:23 smithi110 ceph-mon[36055]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:23.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:23 smithi110 ceph-mon[36055]: Deploying daemon osd.5 on smithi110 2024-04-12T13:36:25.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:25 smithi110 ceph-mon[36055]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:25.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:25 smithi060 ceph-mon[29097]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:27.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:27 smithi110 ceph-mon[36055]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:27 smithi060 ceph-mon[29097]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:29.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:29 smithi060 ceph-mon[29097]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:29.434 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:29 smithi110 ceph-mon[36055]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:31.130 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:31.130 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:31.130 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:31.131 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:30 smithi110 ceph-mon[36055]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:31.131 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:30 smithi060 ceph-mon[29097]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:33.249 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:33 smithi110 ceph-mon[36055]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:33.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:33 smithi060 ceph-mon[29097]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:34 smithi110 ceph-mon[36055]: from='osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:36:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:34 smithi110 ceph-mon[36055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:36:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:34 smithi060 ceph-mon[29097]: from='osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:36:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:34 smithi060 ceph-mon[29097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:36:34.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.778+0000 7f613f400700 1 -- 172.21.15.110:0/1682643021 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6148111c10 con 0x7f612c0692a0 2024-04-12T13:36:34.781 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 5 on host 'smithi110' 2024-04-12T13:36:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 msgr2=0x7f612c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 0x7f612c06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f613000b970 tx=0x7f6130009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 msgr2=0x7f6148110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:34.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f613800cb10 tx=0x7f6138007f70 comp rx=0 tx=0).stop 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 shutdown_connections 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f612c0692a0 0x7f612c06b750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61480662f0 0x7f614810fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 --2- 172.21.15.110:0/1682643021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6148102370 0x7f6148110190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.781+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 >> 172.21.15.110:0/1682643021 conn(0x7f61480f74c0 msgr2=0x7f61480f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.782+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 shutdown_connections 2024-04-12T13:36:34.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:34.782+0000 7f614d400700 1 -- 172.21.15.110:0/1682643021 wait complete. 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: osdmap e38: 6 total, 5 up, 6 in 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:35.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: osdmap e38: 6 total, 5 up, 6 in 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:35.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:35.665 DEBUG:teuthology.orchestra.run.smithi110:osd.5> sudo journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.5.service 2024-04-12T13:36:35.669 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-12T13:36:35.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd stat -f json 2024-04-12T13:36:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:36.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:36:36.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: osdmap e39: 6 total, 5 up, 6 in 2024-04-12T13:36:36.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:36.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:36.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:36.339 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:36 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: osdmap e39: 6 total, 5 up, 6 in 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:36 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: purged_snaps scrub starts 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: purged_snaps scrub ok 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] boot 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: osdmap e40: 6 total, 6 up, 6 in 2024-04-12T13:36:37.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:37 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: purged_snaps scrub starts 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: purged_snaps scrub ok 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: osd.5 [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] boot 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: osdmap e40: 6 total, 6 up, 6 in 2024-04-12T13:36:37.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:37 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:36:38.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 -- 172.21.15.60:0/3183608594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 msgr2=0x7f225c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 --2- 172.21.15.60:0/3183608594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c0fe550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2248004940 tx=0x7f2248009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 -- 172.21.15.60:0/3183608594 shutdown_connections 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 --2- 172.21.15.60:0/3183608594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c0fe550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 --2- 172.21.15.60:0/3183608594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 0x7f225c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 -- 172.21.15.60:0/3183608594 >> 172.21.15.60:0/3183608594 conn(0x7f225c0f8530 msgr2=0x7f225c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 -- 172.21.15.60:0/3183608594 shutdown_connections 2024-04-12T13:36:38.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.439+0000 7f2263800700 1 -- 172.21.15.60:0/3183608594 wait complete. 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.440+0000 7f2263800700 1 Processor -- start 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.440+0000 7f2263800700 1 -- start start 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.440+0000 7f2263800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 0x7f225c10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f2263800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f2263800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c110710 con 0x7f225c0fe0e0 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f2263800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c110f60 con 0x7f225c0fcef0 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59604/0 (socket says 172.21.15.60:59604) 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 -- 172.21.15.60:0/216011485 learned_addr learned my addr 172.21.15.60:0/216011485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f2260e00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 0x7f225c10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:38.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 -- 172.21.15.60:0/216011485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 msgr2=0x7f225c10fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 0x7f225c10fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.441+0000 7f225be00700 1 -- 172.21.15.60:0/216011485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248005040 con 0x7f225c0fe0e0 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f225be00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f224800b3b0 tx=0x7f2248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f224800e040 con 0x7f225c0fe0e0 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c1111e0 con 0x7f225c0fe0e0 2024-04-12T13:36:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2248004290 con 0x7f225c0fe0e0 2024-04-12T13:36:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f224801c630 con 0x7f225c0fe0e0 2024-04-12T13:36:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.442+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c111720 con 0x7f225c0fe0e0 2024-04-12T13:36:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.444+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c101a70 con 0x7f225c0fe0e0 2024-04-12T13:36:38.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.445+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f224800bbf0 con 0x7f225c0fe0e0 2024-04-12T13:36:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.446+0000 7f2258c00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 0x7f224406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.446+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f22480882d0 con 0x7f225c0fe0e0 2024-04-12T13:36:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.446+0000 7f2260e00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 0x7f224406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:38.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.447+0000 7f2260e00700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 0x7f224406b760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f225c0fcc30 tx=0x7f225000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.455+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f22480583b0 con 0x7f225c0fe0e0 2024-04-12T13:36:38.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.675+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f225c05f5f0 con 0x7f225c0fe0e0 2024-04-12T13:36:38.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.676+0000 7f2258c00700 1 -- 172.21.15.60:0/216011485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2248057f40 con 0x7f225c0fe0e0 2024-04-12T13:36:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:36:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 msgr2=0x7f224406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 0x7f224406b760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f225c0fcc30 tx=0x7f225000b040 comp rx=0 tx=0).stop 2024-04-12T13:36:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 msgr2=0x7f225c110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f224800b3b0 tx=0x7f2248009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 shutdown_connections 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22440692b0 0x7f224406b760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f225c0fcef0 0x7f225c10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 --2- 172.21.15.60:0/216011485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f225c0fe0e0 0x7f225c110110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 >> 172.21.15.60:0/216011485 conn(0x7f225c0f8530 msgr2=0x7f225c0f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 shutdown_connections 2024-04-12T13:36:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:38.680+0000 7f2263800700 1 -- 172.21.15.60:0/216011485 wait complete. 2024-04-12T13:36:39.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:38 smithi060 ceph-mon[29097]: osdmap e41: 6 total, 6 up, 6 in 2024-04-12T13:36:39.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:38 smithi060 ceph-mon[29097]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:39.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:38 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/216011485' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T13:36:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:38 smithi110 ceph-mon[36055]: osdmap e41: 6 total, 6 up, 6 in 2024-04-12T13:36:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:38 smithi110 ceph-mon[36055]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:38 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/216011485' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T13:36:39.500 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1712928996,"num_in_osds":6,"osd_in_since":1712928972,"num_remapped_pgs":0} 2024-04-12T13:36:39.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T13:36:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:41.307 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:41 smithi060 ceph-mon[29097]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:41 smithi110 ceph-mon[36055]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.251+0000 7ff05e000700 1 -- 172.21.15.60:0/2200637956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0581094c0 msgr2=0x7ff058109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.251+0000 7ff05e000700 1 --2- 172.21.15.60:0/2200637956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0581094c0 0x7ff058109890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff048004940 tx=0x7ff048009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 -- 172.21.15.60:0/2200637956 shutdown_connections 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 --2- 172.21.15.60:0/2200637956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff058103460 0x7ff0581038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 --2- 172.21.15.60:0/2200637956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0581094c0 0x7ff058109890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 -- 172.21.15.60:0/2200637956 >> 172.21.15.60:0/2200637956 conn(0x7ff058072c30 msgr2=0x7ff058075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 -- 172.21.15.60:0/2200637956 shutdown_connections 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.252+0000 7ff05e000700 1 -- 172.21.15.60:0/2200637956 wait complete. 2024-04-12T13:36:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 Processor -- start 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 -- start start 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0581094c0 0x7ff05811a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05811ab90 con 0x7ff058103460 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff05e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058114170 con 0x7ff0581094c0 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.253+0000 7ff057400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35902/0 (socket says 172.21.15.60:35902) 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 -- 172.21.15.60:0/3148942918 learned_addr learned my addr 172.21.15.60:0/3148942918 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff056a00700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0581094c0 0x7ff05811a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 -- 172.21.15.60:0/3148942918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0581094c0 msgr2=0x7ff05811a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0581094c0 0x7ff05811a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 -- 172.21.15.60:0/3148942918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048005040 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.254+0000 7ff057400700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff04800b3b0 tx=0x7ff048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.255+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04800e040 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.255+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff04800bbc0 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.255+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0581143f0 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.255+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04801c3f0 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.255+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058114930 con 0x7ff058103460 2024-04-12T13:36:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.256+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058104ba0 con 0x7ff058103460 2024-04-12T13:36:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.257+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff04800bd30 con 0x7ff058103460 2024-04-12T13:36:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.258+0000 7ff04f400700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 0x7ff03c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.258+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff048088020 con 0x7ff058103460 2024-04-12T13:36:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.258+0000 7ff056a00700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 0x7ff03c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.259+0000 7ff056a00700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 0x7ff03c06b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0581158a0 tx=0x7ff044009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.263+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff048058120 con 0x7ff058103460 2024-04-12T13:36:42.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: Detected new or changed devices on smithi110 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi110 to 5312M 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:42.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: Detected new or changed devices on smithi110 2024-04-12T13:36:42.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi110 to 5312M 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:36:42.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:36:42.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.481+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff05804c710 con 0x7ff058103460 2024-04-12T13:36:42.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.483+0000 7ff04f400700 1 -- 172.21.15.60:0/3148942918 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7ff05804c710 con 0x7ff058103460 2024-04-12T13:36:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:36:42.485 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:36:37.860488+0000","last_up_change":"2024-04-12T13:36:36.056011+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6803","nonce":3056794206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6805","nonce":3056794206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6809","nonce":3056794206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6807","nonce":3056794206}]},"public_addr":"172.21.15.60:6803/3056794206","cluster_addr":"172.21.15.60:6805/3056794206","heartbeat_back_addr":"172.21.15.60:6809/3056794206","heartbeat_front_addr":"172.21.15.60:6807/3056794206","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6811","nonce":2736571111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6813","nonce":2736571111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6817","nonce":2736571111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6815","nonce":2736571111}]},"public_addr":"172.21.15.60:6811/2736571111","cluster_addr":"172.21.15.60:6813/2736571111","heartbeat_back_addr":"172.21.15.60:6817/2736571111","heartbeat_front_addr":"172.21.15.60:6815/2736571111","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6819","nonce":4220724942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6821","nonce":4220724942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6825","nonce":4220724942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6823","nonce":4220724942}]},"public_addr":"172.21.15.60:6819/4220724942","cluster_addr":"172.21.15.60:6821/4220724942","heartbeat_back_addr":"172.21.15.60:6825/4220724942","heartbeat_front_addr":"172.21.15.60:6823/4220724942","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6801","nonce":552736156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6803","nonce":552736156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6807","nonce":552736156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6805","nonce":552736156}]},"public_addr":"172.21.15.110:6801/552736156","cluster_addr":"172.21.15.110:6803/552736156","heartbeat_back_addr":"172.21.15.110:6807/552736156","heartbeat_front_addr":"172.21.15.110:6805/552736156","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6809","nonce":4183773215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6811","nonce":4183773215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6815","nonce":4183773215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6813","nonce":4183773215}]},"public_addr":"172.21.15.110:6809/4183773215","cluster_addr":"172.21.15.110:6811/4183773215","heartbeat_back_addr":"172.21.15.110:6815/4183773215","heartbeat_front_addr":"172.21.15.110:6813/4183773215","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6817","nonce":2823620341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6819","nonce":2823620341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6823","nonce":2823620341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6821","nonce":2823620341}]},"public_addr":"172.21.15.110:6817/2823620341","cluster_addr":"172.21.15.110:6819/2823620341","heartbeat_back_addr":"172.21.15.110:6823/2823620341","heartbeat_front_addr":"172.21.15.110:6821/2823620341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.485+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 msgr2=0x7ff03c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.485+0000 7ff05e000700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 0x7ff03c06b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0581158a0 tx=0x7ff044009ee0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.485+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 msgr2=0x7ff05811a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.485+0000 7ff05e000700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff04800b3b0 tx=0x7ff048009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 shutdown_connections 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff03c0692a0 0x7ff03c06b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff058103460 0x7ff05811a000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 --2- 172.21.15.60:0/3148942918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0581094c0 0x7ff05811a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 >> 172.21.15.60:0/3148942918 conn(0x7ff058072c30 msgr2=0x7ff058105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 shutdown_connections 2024-04-12T13:36:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:42.486+0000 7ff05e000700 1 -- 172.21.15.60:0/3148942918 wait complete. 2024-04-12T13:36:43.244 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T13:34:54.600821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-12T13:36:43.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-12T13:36:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:43 smithi060 ceph-mon[29097]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:43 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3148942918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:36:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:43 smithi110 ceph-mon[36055]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:43 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3148942918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:36:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:45.359 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:45 smithi060 ceph-mon[29097]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:45.359 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:45 smithi110 ceph-mon[36055]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:36:45.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 -- 172.21.15.60:0/794400455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070360 msgr2=0x7f7bc8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 --2- 172.21.15.60:0/794400455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070360 0x7f7bc8070730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009d10 tx=0x7f7bb8004d10 comp rx=0 tx=0).stop 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 -- 172.21.15.60:0/794400455 shutdown_connections 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 --2- 172.21.15.60:0/794400455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070c70 0x7f7bc8109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 --2- 172.21.15.60:0/794400455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070360 0x7f7bc8070730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 -- 172.21.15.60:0/794400455 >> 172.21.15.60:0/794400455 conn(0x7f7bc80f89d0 msgr2=0x7f7bc80fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 -- 172.21.15.60:0/794400455 shutdown_connections 2024-04-12T13:36:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.863+0000 7f7bce600700 1 -- 172.21.15.60:0/794400455 wait complete. 2024-04-12T13:36:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.864+0000 7f7bce600700 1 Processor -- start 2024-04-12T13:36:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.864+0000 7f7bce600700 1 -- start start 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bce600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070360 0x7f7bc8115fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bce600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bce600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8116b70 con 0x7f7bc8070c70 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bce600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc810ff40 con 0x7f7bc8070360 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bbea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bbea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35926/0 (socket says 172.21.15.60:35926) 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.865+0000 7f7bbea00700 1 -- 172.21.15.60:0/4239410576 learned_addr learned my addr 172.21.15.60:0/4239410576 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bc7400700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070360 0x7f7bc8115fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bbea00700 1 -- 172.21.15.60:0/4239410576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070360 msgr2=0x7f7bc8115fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bbea00700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070360 0x7f7bc8115fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bbea00700 1 -- 172.21.15.60:0/4239410576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009940 con 0x7f7bc8070c70 2024-04-12T13:36:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bbea00700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0002a50 tx=0x7f7bb00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.866+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb0007cc0 con 0x7f7bc8070c70 2024-04-12T13:36:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.867+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bb000f040 con 0x7f7bc8070c70 2024-04-12T13:36:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.867+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb0009640 con 0x7f7bc8070c70 2024-04-12T13:36:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.867+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc8110220 con 0x7f7bc8070c70 2024-04-12T13:36:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.867+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc8110710 con 0x7f7bc8070c70 2024-04-12T13:36:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.868+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8071aa0 con 0x7f7bc8070c70 2024-04-12T13:36:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.869+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7bb00097a0 con 0x7f7bc8070c70 2024-04-12T13:36:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.870+0000 7f7bbfe00700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 0x7f7bac06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.870+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7bb0086d30 con 0x7f7bc8070c70 2024-04-12T13:36:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.870+0000 7f7bc7400700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 0x7f7bac06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.871+0000 7f7bc7400700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 0x7f7bac06b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8015040 tx=0x7f7bb8004d10 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:45.875+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7bb0056d10 con 0x7f7bc8070c70 2024-04-12T13:36:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.089+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bc804bed0 con 0x7f7bc8070c70 2024-04-12T13:36:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.090+0000 7f7bbfe00700 1 -- 172.21.15.60:0/4239410576 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bb00568a0 con 0x7f7bc8070c70 2024-04-12T13:36:46.092 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-04-12T13:36:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.093+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 msgr2=0x7f7bac06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.093+0000 7f7bce600700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 0x7f7bac06b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8015040 tx=0x7f7bb8004d10 comp rx=0 tx=0).stop 2024-04-12T13:36:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.093+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 msgr2=0x7f7bc8116520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.093+0000 7f7bce600700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0002a50 tx=0x7f7bb00046b0 comp rx=0 tx=0).stop 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 shutdown_connections 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7bac0692b0 0x7f7bac06b760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bc8070360 0x7f7bc8115fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 --2- 172.21.15.60:0/4239410576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bc8070c70 0x7f7bc8116520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 >> 172.21.15.60:0/4239410576 conn(0x7f7bc80f89d0 msgr2=0x7f7bc80f9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 shutdown_connections 2024-04-12T13:36:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:46.094+0000 7f7bce600700 1 -- 172.21.15.60:0/4239410576 wait complete. 2024-04-12T13:36:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:46 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4239410576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:36:46.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:46 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4239410576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:36:46.965 INFO:tasks.cephadm:Setting up client nodes... 2024-04-12T13:36:46.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-12T13:36:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:47 smithi110 ceph-mon[36055]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:47.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:47 smithi060 ceph-mon[29097]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:49.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:49 smithi060 ceph-mon[29097]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:49 smithi110 ceph-mon[36055]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:49.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 -- 172.21.15.60:0/1085022193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 msgr2=0x7f3264103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 --2- 172.21.15.60:0/1085022193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264103830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3254004940 tx=0x7f3254009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 -- 172.21.15.60:0/1085022193 shutdown_connections 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 --2- 172.21.15.60:0/1085022193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 0x7f3264104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 --2- 172.21.15.60:0/1085022193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264103830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 -- 172.21.15.60:0/1085022193 >> 172.21.15.60:0/1085022193 conn(0x7f32640725d0 msgr2=0x7f3264074a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 -- 172.21.15.60:0/1085022193 shutdown_connections 2024-04-12T13:36:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.729+0000 7f326a000700 1 -- 172.21.15.60:0/1085022193 wait complete. 2024-04-12T13:36:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 Processor -- start 2024-04-12T13:36:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 -- start start 2024-04-12T13:36:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 0x7f3264114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264114a70 con 0x7f3264103420 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.730+0000 7f326a000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264114be0 con 0x7f32641046d0 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43772/0 (socket says 172.21.15.60:43772) 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 -- 172.21.15.60:0/4144812295 learned_addr learned my addr 172.21.15.60:0/4144812295 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f325aa00700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 0x7f3264114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 -- 172.21.15.60:0/4144812295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 msgr2=0x7f3264114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 0x7f3264114470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:49.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 -- 172.21.15.60:0/4144812295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254005040 con 0x7f3264103420 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.731+0000 7f3263400700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f325400b3b0 tx=0x7f3254009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.732+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325400e040 con 0x7f3264103420 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.732+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3254004290 con 0x7f3264103420 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.732+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32641195e0 con 0x7f3264103420 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.732+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325401c630 con 0x7f3264103420 2024-04-12T13:36:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.732+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3264119ba0 con 0x7f3264103420 2024-04-12T13:36:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.733+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326404c710 con 0x7f3264103420 2024-04-12T13:36:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.734+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f325400bbf0 con 0x7f3264103420 2024-04-12T13:36:49.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.735+0000 7f325be00700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 0x7f324806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:49.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.736+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f32540882d0 con 0x7f3264103420 2024-04-12T13:36:49.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.736+0000 7f325aa00700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 0x7f324806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:49.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.737+0000 7f325aa00700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 0x7f324806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f324c004fa0 tx=0x7f324c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:49.741+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f32540583b0 con 0x7f3264103420 2024-04-12T13:36:50.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.048+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f326411a030 con 0x7f3264103420 2024-04-12T13:36:50.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.056+0000 7f325be00700 1 -- 172.21.15.60:0/4144812295 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3254057f40 con 0x7f3264103420 2024-04-12T13:36:50.057 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-04-12T13:36:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDyOBlmXiXvAhAALaOWt/cK7Z4VGzuuvbsuOg== 2024-04-12T13:36:50.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 msgr2=0x7f324806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:50.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 0x7f324806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f324c004fa0 tx=0x7f324c00b040 comp rx=0 tx=0).stop 2024-04-12T13:36:50.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 msgr2=0x7f3264113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:50.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f325400b3b0 tx=0x7f3254009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 shutdown_connections 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f32480692b0 0x7f324806b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3264103420 0x7f3264113f30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 --2- 172.21.15.60:0/4144812295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32641046d0 0x7f3264114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 >> 172.21.15.60:0/4144812295 conn(0x7f32640725d0 msgr2=0x7f3264073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 shutdown_connections 2024-04-12T13:36:50.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:50.059+0000 7f326a000700 1 -- 172.21.15.60:0/4144812295 wait complete. 2024-04-12T13:36:50.601 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:50 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4144812295' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:50.601 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:50 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4144812295' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T13:36:50.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:50 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4144812295' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:50.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:50 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4144812295' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T13:36:50.845 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:36:50.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-12T13:36:50.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-12T13:36:51.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-12T13:36:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:51 smithi110 ceph-mon[36055]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:51.489 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi110/config 2024-04-12T13:36:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:51 smithi060 ceph-mon[29097]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:53.534 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:53 smithi110 ceph-mon[36055]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:53.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:53 smithi060 ceph-mon[29097]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 -- 172.21.15.110:0/1546931153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 msgr2=0x7f3a3c0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 --2- 172.21.15.110:0/1546931153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c0fd260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c004940 tx=0x7f3a2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 -- 172.21.15.110:0/1546931153 shutdown_connections 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 --2- 172.21.15.110:0/1546931153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 0x7f3a3c0fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 --2- 172.21.15.110:0/1546931153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c0fd260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 -- 172.21.15.110:0/1546931153 >> 172.21.15.110:0/1546931153 conn(0x7f3a3c0f8580 msgr2=0x7f3a3c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:53.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 -- 172.21.15.110:0/1546931153 shutdown_connections 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.807+0000 7f3a42000700 1 -- 172.21.15.110:0/1546931153 wait complete. 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.808+0000 7f3a42000700 1 Processor -- start 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.808+0000 7f3a42000700 1 -- start start 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a42000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a42000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 0x7f3a3c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a42000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c072260 con 0x7f3a3c0fe050 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a42000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c070850 con 0x7f3a3c0fce50 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49838/0 (socket says 172.21.15.110:49838) 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 -- 172.21.15.110:0/1642585767 learned_addr learned my addr 172.21.15.110:0/1642585767 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-12T13:36:53.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a33e00700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 0x7f3a3c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 -- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 msgr2=0x7f3a3c070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 0x7f3a3c070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.809+0000 7f3a3b400700 1 -- 172.21.15.110:0/1642585767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c005040 con 0x7f3a3c0fce50 2024-04-12T13:36:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a3b400700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00b970 tx=0x7f3a2c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:53.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c00e040 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a2c00bbf0 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c070aa0 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c01c630 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.810+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c071060 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.811+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c04c710 con 0x7f3a3c0fce50 2024-04-12T13:36:53.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.812+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3a2c00bd60 con 0x7f3a3c0fce50 2024-04-12T13:36:53.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.813+0000 7f3a33400700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 0x7f3a2006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:53.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.813+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3a2c088150 con 0x7f3a3c0fce50 2024-04-12T13:36:53.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.813+0000 7f3a33e00700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 0x7f3a2006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:53.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.815+0000 7f3a33e00700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 0x7f3a2006b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a24004990 tx=0x7f3a24009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:53.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:53.818+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a2c0583a0 con 0x7f3a3c0fce50 2024-04-12T13:36:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.108+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3a3c1058e0 con 0x7f3a3c0fce50 2024-04-12T13:36:54.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.119+0000 7f3a33400700 1 -- 172.21.15.110:0/1642585767 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3a2c057f30 con 0x7f3a3c0fce50 2024-04-12T13:36:54.122 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-04-12T13:36:54.122 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD2OBlmwyelBhAA02xdSIUnWUvEiNyFSeQcwQ== 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 msgr2=0x7f3a2006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 0x7f3a2006b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a24004990 tx=0x7f3a24009ee0 comp rx=0 tx=0).stop 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 msgr2=0x7f3a3c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00b970 tx=0x7f3a2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 shutdown_connections 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3a200692b0 0x7f3a2006b760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a3c0fce50 0x7f3a3c071c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 --2- 172.21.15.110:0/1642585767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3c0fe050 0x7f3a3c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.122+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 >> 172.21.15.110:0/1642585767 conn(0x7f3a3c0f8580 msgr2=0x7f3a3c0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.123+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 shutdown_connections 2024-04-12T13:36:54.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:36:54.123+0000 7f3a42000700 1 -- 172.21.15.110:0/1642585767 wait complete. 2024-04-12T13:36:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:54 smithi110 ceph-mon[36055]: from='client.? 172.21.15.110:0/1642585767' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:54 smithi110 ceph-mon[36055]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:54 smithi110 ceph-mon[36055]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T13:36:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:54 smithi060 ceph-mon[29097]: from='client.? 172.21.15.110:0/1642585767' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:54 smithi060 ceph-mon[29097]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T13:36:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:54 smithi060 ceph-mon[29097]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T13:36:54.953 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:36:54.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-12T13:36:54.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-12T13:36:55.101 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-12T13:36:55.102 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-12T13:36:55.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph mgr dump --format=json 2024-04-12T13:36:55.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:55 smithi060 ceph-mon[29097]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:55.633 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:55 smithi110 ceph-mon[36055]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:57.496 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:57 smithi060 ceph-mon[29097]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:57.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:57 smithi110 ceph-mon[36055]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 -- 172.21.15.60:0/2255601525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc40103460 msgr2=0x7fdc401038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 --2- 172.21.15.60:0/2255601525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc40103460 0x7fdc401038d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c004940 tx=0x7fdc2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 -- 172.21.15.60:0/2255601525 shutdown_connections 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 --2- 172.21.15.60:0/2255601525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc40103460 0x7fdc401038d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 --2- 172.21.15.60:0/2255601525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc401094c0 0x7fdc40109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 -- 172.21.15.60:0/2255601525 >> 172.21.15.60:0/2255601525 conn(0x7fdc40072c30 msgr2=0x7fdc40075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 -- 172.21.15.60:0/2255601525 shutdown_connections 2024-04-12T13:36:58.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.020+0000 7fdc47800700 1 -- 172.21.15.60:0/2255601525 wait complete. 2024-04-12T13:36:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.021+0000 7fdc47800700 1 Processor -- start 2024-04-12T13:36:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.021+0000 7fdc47800700 1 -- start start 2024-04-12T13:36:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc47800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc40103460 0x7fdc40119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:58.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc47800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc47800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4011ab10 con 0x7fdc401094c0 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc47800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40114130 con 0x7fdc40103460 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc3fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc3fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43788/0 (socket says 172.21.15.60:43788) 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc3fe00700 1 -- 172.21.15.60:0/3285698632 learned_addr learned my addr 172.21.15.60:0/3285698632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:36:58.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.022+0000 7fdc44e00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc40103460 0x7fdc40119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3fe00700 1 -- 172.21.15.60:0/3285698632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc40103460 msgr2=0x7fdc40119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3fe00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc40103460 0x7fdc40119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3fe00700 1 -- 172.21.15.60:0/3285698632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c005040 con 0x7fdc401094c0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3fe00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009150 tx=0x7fdc2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2c00e040 con 0x7fdc401094c0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc2c013420 con 0x7fdc401094c0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc401143b0 con 0x7fdc401094c0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.023+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2c01c630 con 0x7fdc401094c0 2024-04-12T13:36:58.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.024+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40114970 con 0x7fdc401094c0 2024-04-12T13:36:58.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.025+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc40104ba0 con 0x7fdc401094c0 2024-04-12T13:36:58.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.026+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdc2c013590 con 0x7fdc401094c0 2024-04-12T13:36:58.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.027+0000 7fdc3cc00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:36:58.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.028+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdc2c087ff0 con 0x7fdc401094c0 2024-04-12T13:36:58.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.028+0000 7fdc44e00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:36:58.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.029+0000 7fdc44e00700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 0x7fdc2806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009fd0 tx=0x7fdc34009f20 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:36:58.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.033+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdc2c054700 con 0x7fdc401094c0 2024-04-12T13:36:58.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.308+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdc40110550 con 0x7fdc401094c0 2024-04-12T13:36:58.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.317+0000 7fdc3cc00700 1 -- 172.21.15.60:0/3285698632 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167174 (secure 0 0 0) 0x7fdc2c057d20 con 0x7fdc401094c0 2024-04-12T13:36:58.323 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 msgr2=0x7fdc2806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 0x7fdc2806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009fd0 tx=0x7fdc34009f20 comp rx=0 tx=0).stop 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 msgr2=0x7fdc4011a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009150 tx=0x7fdc2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 shutdown_connections 2024-04-12T13:36:58.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdc280692a0 0x7fdc2806b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc40103460 0x7fdc40119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 --2- 172.21.15.60:0/3285698632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc401094c0 0x7fdc4011a4c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:36:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.322+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 >> 172.21.15.60:0/3285698632 conn(0x7fdc40072c30 msgr2=0x7fdc40105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:36:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.323+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 shutdown_connections 2024-04-12T13:36:58.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:36:58.323+0000 7fdc47800700 1 -- 172.21.15.60:0/3285698632 wait complete. 2024-04-12T13:36:59.208 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"flags":0,"active_gid":14212,"active_name":"smithi060.bpzacg","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":673590403},{"type":"v1","addr":"172.21.15.60:6801","nonce":673590403}]},"active_addr":"172.21.15.60:6801/673590403","active_change":"2024-04-12T13:31:59.892535+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi110.ezwdax","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.60:8443/","prometheus":"http://172.21.15.60:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2874214879}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2674766807}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":578861147}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":657445096}]}]} 2024-04-12T13:36:59.213 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-12T13:36:59.213 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-12T13:36:59.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T13:36:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:59 smithi060 ceph-mon[29097]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:36:59 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3285698632' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-12T13:36:59.713 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:36:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:59 smithi110 ceph-mon[36055]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:36:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:36:59 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3285698632' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-12T13:37:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:00.601 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:01.564 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:01 smithi060 ceph-mon[29097]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:01 smithi110 ceph-mon[36055]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.729+0000 7f4b26200700 1 -- 172.21.15.60:0/109517103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 msgr2=0x7f4b200fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.729+0000 7f4b26200700 1 --2- 172.21.15.60:0/109517103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b200fce30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c004940 tx=0x7f4b0c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 -- 172.21.15.60:0/109517103 shutdown_connections 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 --2- 172.21.15.60:0/109517103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b200fce30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 --2- 172.21.15.60:0/109517103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 0x7f4b201031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 -- 172.21.15.60:0/109517103 >> 172.21.15.60:0/109517103 conn(0x7f4b200f89b0 msgr2=0x7f4b200fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 -- 172.21.15.60:0/109517103 shutdown_connections 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.730+0000 7f4b26200700 1 -- 172.21.15.60:0/109517103 wait complete. 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 Processor -- start 2024-04-12T13:37:01.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 -- start start 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 0x7f4b20115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20116780 con 0x7f4b201037c0 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b26200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2010fd60 con 0x7f4b20102e20 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b1ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b1ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50918/0 (socket says 172.21.15.60:50918) 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.731+0000 7f4b1ea00700 1 -- 172.21.15.60:0/2897298003 learned_addr learned my addr 172.21.15.60:0/2897298003 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.732+0000 7f4b1f400700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 0x7f4b20115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.732+0000 7f4b1ea00700 1 -- 172.21.15.60:0/2897298003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 msgr2=0x7f4b20115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.732+0000 7f4b1ea00700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 0x7f4b20115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.732+0000 7f4b1ea00700 1 -- 172.21.15.60:0/2897298003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c005040 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.732+0000 7f4b1ea00700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009100 tx=0x7f4b0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.733+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b0c00e040 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.733+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b0c004290 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.733+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2010ffe0 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.733+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b0c01c3f0 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.733+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b201105a0 con 0x7f4b201037c0 2024-04-12T13:37:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.734+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b20101890 con 0x7f4b201037c0 2024-04-12T13:37:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.735+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4b0c013790 con 0x7f4b201037c0 2024-04-12T13:37:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.736+0000 7f4b17400700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 0x7f4b0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.736+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4b0c0880f0 con 0x7f4b201037c0 2024-04-12T13:37:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.736+0000 7f4b1f400700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 0x7f4b0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:01.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.737+0000 7f4b1f400700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 0x7f4b0406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b10004990 tx=0x7f4b10009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:01.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.741+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4b0c0581d0 con 0x7f4b201037c0 2024-04-12T13:37:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.957+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b20111240 con 0x7f4b201037c0 2024-04-12T13:37:01.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.959+0000 7f4b17400700 1 -- 172.21.15.60:0/2897298003 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7f4b0c013420 con 0x7f4b201037c0 2024-04-12T13:37:01.962 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:37:01.962 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:36:37.860488+0000","last_up_change":"2024-04-12T13:36:36.056011+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6803","nonce":3056794206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6805","nonce":3056794206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6809","nonce":3056794206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6807","nonce":3056794206}]},"public_addr":"172.21.15.60:6803/3056794206","cluster_addr":"172.21.15.60:6805/3056794206","heartbeat_back_addr":"172.21.15.60:6809/3056794206","heartbeat_front_addr":"172.21.15.60:6807/3056794206","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6811","nonce":2736571111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6813","nonce":2736571111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6817","nonce":2736571111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6815","nonce":2736571111}]},"public_addr":"172.21.15.60:6811/2736571111","cluster_addr":"172.21.15.60:6813/2736571111","heartbeat_back_addr":"172.21.15.60:6817/2736571111","heartbeat_front_addr":"172.21.15.60:6815/2736571111","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6819","nonce":4220724942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6821","nonce":4220724942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6825","nonce":4220724942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6823","nonce":4220724942}]},"public_addr":"172.21.15.60:6819/4220724942","cluster_addr":"172.21.15.60:6821/4220724942","heartbeat_back_addr":"172.21.15.60:6825/4220724942","heartbeat_front_addr":"172.21.15.60:6823/4220724942","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6801","nonce":552736156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6803","nonce":552736156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6807","nonce":552736156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6805","nonce":552736156}]},"public_addr":"172.21.15.110:6801/552736156","cluster_addr":"172.21.15.110:6803/552736156","heartbeat_back_addr":"172.21.15.110:6807/552736156","heartbeat_front_addr":"172.21.15.110:6805/552736156","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6809","nonce":4183773215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6811","nonce":4183773215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6815","nonce":4183773215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6813","nonce":4183773215}]},"public_addr":"172.21.15.110:6809/4183773215","cluster_addr":"172.21.15.110:6811/4183773215","heartbeat_back_addr":"172.21.15.110:6815/4183773215","heartbeat_front_addr":"172.21.15.110:6813/4183773215","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6817","nonce":2823620341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6819","nonce":2823620341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6823","nonce":2823620341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6821","nonce":2823620341}]},"public_addr":"172.21.15.110:6817/2823620341","cluster_addr":"172.21.15.110:6819/2823620341","heartbeat_back_addr":"172.21.15.110:6823/2823620341","heartbeat_front_addr":"172.21.15.110:6821/2823620341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 msgr2=0x7f4b0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 0x7f4b0406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b10004990 tx=0x7f4b10009ee0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 msgr2=0x7f4b20116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009100 tx=0x7f4b0c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 shutdown_connections 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b040692a0 0x7f4b0406b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b20102e20 0x7f4b20115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 --2- 172.21.15.60:0/2897298003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b201037c0 0x7f4b20116130 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.962+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 >> 172.21.15.60:0/2897298003 conn(0x7f4b200f89b0 msgr2=0x7f4b201021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.963+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 shutdown_connections 2024-04-12T13:37:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:01.963+0000 7f4b26200700 1 -- 172.21.15.60:0/2897298003 wait complete. 2024-04-12T13:37:02.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:02 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2897298003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:37:02.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:02 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2897298003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:37:02.829 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-12T13:37:02.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T13:37:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:03.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:03 smithi060 ceph-mon[29097]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:03 smithi110 ceph-mon[36055]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:04.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:04 smithi060 ceph-mon[29097]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:04.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:04 smithi110 ceph-mon[36055]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 -- 172.21.15.60:0/1133142371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 msgr2=0x7f1df4109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 --2- 172.21.15.60:0/1133142371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df4109890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1de4004940 tx=0x7f1de4009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 -- 172.21.15.60:0/1133142371 shutdown_connections 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 --2- 172.21.15.60:0/1133142371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 --2- 172.21.15.60:0/1133142371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df4109890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 -- 172.21.15.60:0/1133142371 >> 172.21.15.60:0/1133142371 conn(0x7f1df4072c30 msgr2=0x7f1df4075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 -- 172.21.15.60:0/1133142371 shutdown_connections 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.376+0000 7f1dfa600700 1 -- 172.21.15.60:0/1133142371 wait complete. 2024-04-12T13:37:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 Processor -- start 2024-04-12T13:37:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 -- start start 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df411a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df411ab90 con 0x7f1df41094c0 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1dfa600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4114170 con 0x7f1df4103460 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1df2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1df2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50928/0 (socket says 172.21.15.60:50928) 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.377+0000 7f1df2a00700 1 -- 172.21.15.60:0/4108186134 learned_addr learned my addr 172.21.15.60:0/4108186134 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df3400700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df411a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df2a00700 1 -- 172.21.15.60:0/4108186134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 msgr2=0x7f1df411a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:05.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df2a00700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df411a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df2a00700 1 -- 172.21.15.60:0/4108186134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4005040 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df3400700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df411a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.378+0000 7f1df2a00700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1de0002a50 tx=0x7f1de00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.379+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de0007cc0 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.379+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1de000f040 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.379+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de0009640 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.379+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df4114450 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.379+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df4114990 con 0x7f1df41094c0 2024-04-12T13:37:05.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.380+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df4104ba0 con 0x7f1df41094c0 2024-04-12T13:37:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.381+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1de00097a0 con 0x7f1df41094c0 2024-04-12T13:37:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.382+0000 7f1deb400700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 0x7f1dd806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.382+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1de0086c20 con 0x7f1df41094c0 2024-04-12T13:37:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.382+0000 7f1df3400700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 0x7f1dd806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:05.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.383+0000 7f1df3400700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 0x7f1dd806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.387+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1de0056c80 con 0x7f1df41094c0 2024-04-12T13:37:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.602+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1df404c710 con 0x7f1df41094c0 2024-04-12T13:37:05.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.604+0000 7f1deb400700 1 -- 172.21.15.60:0/4108186134 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7f1de0056810 con 0x7f1df41094c0 2024-04-12T13:37:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:37:05.606 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:36:37.860488+0000","last_up_change":"2024-04-12T13:36:36.056011+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6803","nonce":3056794206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6805","nonce":3056794206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6809","nonce":3056794206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6807","nonce":3056794206}]},"public_addr":"172.21.15.60:6803/3056794206","cluster_addr":"172.21.15.60:6805/3056794206","heartbeat_back_addr":"172.21.15.60:6809/3056794206","heartbeat_front_addr":"172.21.15.60:6807/3056794206","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6811","nonce":2736571111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6813","nonce":2736571111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6817","nonce":2736571111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6815","nonce":2736571111}]},"public_addr":"172.21.15.60:6811/2736571111","cluster_addr":"172.21.15.60:6813/2736571111","heartbeat_back_addr":"172.21.15.60:6817/2736571111","heartbeat_front_addr":"172.21.15.60:6815/2736571111","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6819","nonce":4220724942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6821","nonce":4220724942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6825","nonce":4220724942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6823","nonce":4220724942}]},"public_addr":"172.21.15.60:6819/4220724942","cluster_addr":"172.21.15.60:6821/4220724942","heartbeat_back_addr":"172.21.15.60:6825/4220724942","heartbeat_front_addr":"172.21.15.60:6823/4220724942","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6801","nonce":552736156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6803","nonce":552736156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6807","nonce":552736156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6805","nonce":552736156}]},"public_addr":"172.21.15.110:6801/552736156","cluster_addr":"172.21.15.110:6803/552736156","heartbeat_back_addr":"172.21.15.110:6807/552736156","heartbeat_front_addr":"172.21.15.110:6805/552736156","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6809","nonce":4183773215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6811","nonce":4183773215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6815","nonce":4183773215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6813","nonce":4183773215}]},"public_addr":"172.21.15.110:6809/4183773215","cluster_addr":"172.21.15.110:6811/4183773215","heartbeat_back_addr":"172.21.15.110:6815/4183773215","heartbeat_front_addr":"172.21.15.110:6813/4183773215","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6817","nonce":2823620341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6819","nonce":2823620341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6823","nonce":2823620341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6821","nonce":2823620341}]},"public_addr":"172.21.15.110:6817/2823620341","cluster_addr":"172.21.15.110:6819/2823620341","heartbeat_back_addr":"172.21.15.110:6823/2823620341","heartbeat_front_addr":"172.21.15.110:6821/2823620341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 msgr2=0x7f1dd806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 0x7f1dd806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de4009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 msgr2=0x7f1df411a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1de0002a50 tx=0x7f1de00046b0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 shutdown_connections 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f1dd80692a0 0x7f1dd806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1df4103460 0x7f1df411a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 --2- 172.21.15.60:0/4108186134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df41094c0 0x7f1df411a540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.607+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 >> 172.21.15.60:0/4108186134 conn(0x7f1df4072c30 msgr2=0x7f1df4105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.608+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 shutdown_connections 2024-04-12T13:37:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:05.608+0000 7f1dfa600700 1 -- 172.21.15.60:0/4108186134 wait complete. 2024-04-12T13:37:05.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:05 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4108186134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:37:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:05 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4108186134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:37:06.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-12T13:37:06.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-12T13:37:06.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-12T13:37:06.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-12T13:37:06.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-12T13:37:06.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-12T13:37:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:06 smithi060 ceph-mon[29097]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:06.971 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:06.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:06 smithi110 ceph-mon[36055]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:06.980 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:09 smithi060 ceph-mon[29097]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:09 smithi110 ceph-mon[36055]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:11.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:11 smithi060 ceph-mon[29097]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:11 smithi110 ceph-mon[36055]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:12.359 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:13.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 -- 172.21.15.60:0/1989147993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194103660 msgr2=0x7fd1940fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:13.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 --2- 172.21.15.60:0/1989147993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194103660 0x7fd1940fccd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd180004940 tx=0x7fd180009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:13.091 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:13 smithi060 ceph-mon[29097]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 -- 172.21.15.60:0/1989147993 shutdown_connections 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 --2- 172.21.15.60:0/1989147993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194103660 0x7fd1940fccd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 --2- 172.21.15.60:0/1989147993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194102cc0 0x7fd194103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 -- 172.21.15.60:0/1989147993 >> 172.21.15.60:0/1989147993 conn(0x7fd1940f87f0 msgr2=0x7fd1940fac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 -- 172.21.15.60:0/1989147993 shutdown_connections 2024-04-12T13:37:13.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.088+0000 7fd19b000700 1 -- 172.21.15.60:0/1989147993 wait complete. 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.089+0000 7fd19b000700 1 Processor -- start 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.089+0000 7fd19b000700 1 -- start start 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd19b000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd19b000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194103660 0x7fd194070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd19b000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194070d90 con 0x7fd194102cc0 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd19b000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd194070ed0 con 0x7fd194103660 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44584/0 (socket says 172.21.15.60:44584) 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 -- 172.21.15.60:0/1740082098 learned_addr learned my addr 172.21.15.60:0/1740082098 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199200700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194103660 0x7fd194070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 -- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194103660 msgr2=0x7fd194070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194103660 0x7fd194070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.090+0000 7fd199c00700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180005040 con 0x7fd194102cc0 2024-04-12T13:37:13.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd199c00700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c8c0 tx=0x7fd1880044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd18800a980 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd18800ce60 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd194119d00 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1880115e0 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.091+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19411a180 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.092+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1940fe410 con 0x7fd194102cc0 2024-04-12T13:37:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.093+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd188012400 con 0x7fd194102cc0 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd191600700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 0x7fd17c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd188087000 con 0x7fd194102cc0 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd199200700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 0x7fd17c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd191600700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 0x7fd17c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd17c071a30 con 0x7fd17c06ef70 2024-04-12T13:37:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.094+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd188089550 con 0x7fd194102cc0 2024-04-12T13:37:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.095+0000 7fd199200700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 0x7fd17c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd194071c00 tx=0x7fd180009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.095+0000 7fd19a600700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 0x7fd17c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.096+0000 7fd19a600700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 0x7fd17c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.098+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== osd.3 v2:172.21.15.110:6800/552736156 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd17c071a30 con 0x7fd17c06ef70 2024-04-12T13:37:13.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.115+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 --> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd19405e640 con 0x7fd17c06ef70 2024-04-12T13:37:13.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.116+0000 7fd191600700 1 -- 172.21.15.60:0/1740082098 <== osd.3 v2:172.21.15.110:6800/552736156 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd19405e640 con 0x7fd17c06ef70 2024-04-12T13:37:13.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.116+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 msgr2=0x7fd17c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:13.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.116+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 0x7fd17c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 msgr2=0x7fd17c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 0x7fd17c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd194071c00 tx=0x7fd180009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 msgr2=0x7fd1940702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c8c0 tx=0x7fd1880044c0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 shutdown_connections 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:6800/552736156,v1:172.21.15.110:6801/552736156] conn(0x7fd17c06ef70 0x7fd17c071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd17c0692a0 0x7fd17c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd194102cc0 0x7fd1940702c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 --2- 172.21.15.60:0/1740082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd194103660 0x7fd194070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:13.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 >> 172.21.15.60:0/1740082098 conn(0x7fd1940f87f0 msgr2=0x7fd1941020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:13.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 shutdown_connections 2024-04-12T13:37:13.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:13.117+0000 7fd19b000700 1 -- 172.21.15.60:0/1740082098 wait complete. 2024-04-12T13:37:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:13 smithi110 ceph-mon[36055]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:115964117017 2024-04-12T13:37:15.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-12T13:37:15.377 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:15 smithi060 ceph-mon[29097]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:15.377 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:15 smithi110 ceph-mon[36055]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 -- 172.21.15.60:0/2054910038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 msgr2=0x7f22f8106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 --2- 172.21.15.60:0/2054910038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8106e70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22e0004940 tx=0x7f22e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 -- 172.21.15.60:0/2054910038 shutdown_connections 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 --2- 172.21.15.60:0/2054910038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8106e70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 --2- 172.21.15.60:0/2054910038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 0x7f22f80fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 -- 172.21.15.60:0/2054910038 >> 172.21.15.60:0/2054910038 conn(0x7f22f80f7920 msgr2=0x7f22f80f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 -- 172.21.15.60:0/2054910038 shutdown_connections 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.317+0000 7f22fe000700 1 -- 172.21.15.60:0/2054910038 wait complete. 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.318+0000 7f22fe000700 1 Processor -- start 2024-04-12T13:37:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.318+0000 7f22fe000700 1 -- start start 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.318+0000 7f22fe000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 0x7f22f8115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.318+0000 7f22fe000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.318+0000 7f22fe000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8116680 con 0x7f22f80fe830 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22fe000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f810fc60 con 0x7f22f80fde90 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44600/0 (socket says 172.21.15.60:44600) 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 -- 172.21.15.60:0/1645667112 learned_addr learned my addr 172.21.15.60:0/1645667112 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22f7400700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 0x7f22f8115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 -- 172.21.15.60:0/1645667112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 msgr2=0x7f22f8115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 0x7f22f8115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.319+0000 7f22eea00700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0005040 con 0x7f22f80fe830 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22eea00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009180 tx=0x7f22e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e000e040 con 0x7f22f80fe830 2024-04-12T13:37:15.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22e0013420 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e001c630 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f810fee0 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.320+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8110420 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.321+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22f8110950 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.322+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f22e0013590 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22efe00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 0x7f22dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f22e0088230 con 0x7f22f80fe830 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22f7400700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 0x7f22dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22efe00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 0x7f22dc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22dc071a30 con 0x7f22dc06ef70 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.323+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e008a780 con 0x7f22f80fe830 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.324+0000 7f22f7e00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 0x7f22dc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.324+0000 7f22f7400700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 0x7f22dc06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e8004fd0 tx=0x7f22e800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.324+0000 7f22f7e00700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 0x7f22dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.325+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== osd.2 v2:172.21.15.60:6818/4220724942 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f22dc071a30 con 0x7f22dc06ef70 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.342+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 --> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22f805e680 con 0x7f22dc06ef70 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.342+0000 7f22efe00700 1 -- 172.21.15.60:0/1645667112 <== osd.2 v2:172.21.15.60:6818/4220724942 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22f805e680 con 0x7f22dc06ef70 2024-04-12T13:37:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 msgr2=0x7f22dc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 0x7f22dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 msgr2=0x7f22dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 0x7f22dc06b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e8004fd0 tx=0x7f22e800b040 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 msgr2=0x7f22f8116030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009180 tx=0x7f22e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 shutdown_connections 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6818/4220724942,v1:172.21.15.60:6819/4220724942] conn(0x7f22dc06ef70 0x7f22dc071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f22dc0692a0 0x7f22dc06b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80fde90 0x7f22f8115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 --2- 172.21.15.60:0/1645667112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22f80fe830 0x7f22f8116030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.343+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 >> 172.21.15.60:0/1645667112 conn(0x7f22f80f7920 msgr2=0x7f22f80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.344+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 shutdown_connections 2024-04-12T13:37:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:14.344+0000 7f22fe000700 1 -- 172.21.15.60:0/1645667112 wait complete. 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 -- 172.21.15.60:0/306156596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b280656b0 msgr2=0x7f4b28065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/306156596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b280656b0 0x7f4b28065a80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b18004940 tx=0x7f4b18009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 -- 172.21.15.60:0/306156596 shutdown_connections 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/306156596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b28065fc0 0x7f4b281092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/306156596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b280656b0 0x7f4b28065a80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 -- 172.21.15.60:0/306156596 >> 172.21.15.60:0/306156596 conn(0x7f4b28072bc0 msgr2=0x7f4b28072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 -- 172.21.15.60:0/306156596 shutdown_connections 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.156+0000 7f4b2ee00700 1 -- 172.21.15.60:0/306156596 wait complete. 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.157+0000 7f4b2ee00700 1 Processor -- start 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.157+0000 7f4b2ee00700 1 -- start start 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b2ee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 0x7f4b28115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b2ee00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b2ee00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28116920 con 0x7f4b28065fc0 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b2ee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2810fcf0 con 0x7f4b280656b0 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44624/0 (socket says 172.21.15.60:44624) 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 -- 172.21.15.60:0/1684142818 learned_addr learned my addr 172.21.15.60:0/1684142818 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27e00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 0x7f4b28115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 -- 172.21.15.60:0/1684142818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 msgr2=0x7f4b28115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 0x7f4b28115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.158+0000 7f4b27400700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18005040 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b27e00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 0x7f4b28115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b27400700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c830 tx=0x7f4b14004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1400a760 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2810ffd0 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b1400ad90 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b140113a0 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.159+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b28110590 con 0x7f4b28065fc0 2024-04-12T13:37:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.160+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b28110ad0 con 0x7f4b28065fc0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.162+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4b14012400 con 0x7f4b28065fc0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b1fe00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 0x7f4b0c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4b14086f00 con 0x7f4b28065fc0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b1fe00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 0x7f4b0c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b27e00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 0x7f4b0c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b0c071a40 con 0x7f4b0c06ef80 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b1408c500 con 0x7f4b28065fc0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.163+0000 7f4b2ce00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 0x7f4b0c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.164+0000 7f4b27e00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 0x7f4b0c06b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b18000c00 tx=0x7f4b18009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.164+0000 7f4b2ce00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 0x7f4b0c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.165+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== osd.0 v2:172.21.15.60:6802/3056794206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4b0c071a40 con 0x7f4b0c06ef80 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.182+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 --> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b280fa640 con 0x7f4b0c06ef80 2024-04-12T13:37:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b1fe00700 1 -- 172.21.15.60:0/1684142818 <== osd.0 v2:172.21.15.60:6802/3056794206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b280fa640 con 0x7f4b0c06ef80 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 msgr2=0x7f4b0c071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 0x7f4b0c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 msgr2=0x7f4b0c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 0x7f4b0c06b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b18000c00 tx=0x7f4b18009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 msgr2=0x7f4b281162d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c830 tx=0x7f4b14004470 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 shutdown_connections 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6802/3056794206,v1:172.21.15.60:6803/3056794206] conn(0x7f4b0c06ef80 0x7f4b0c071390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4b0c0692b0 0x7f4b0c06b760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b280656b0 0x7f4b28115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.183+0000 7f4b2ee00700 1 --2- 172.21.15.60:0/1684142818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b28065fc0 0x7f4b281162d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.184+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 >> 172.21.15.60:0/1684142818 conn(0x7f4b28072bc0 msgr2=0x7f4b280f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.184+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 shutdown_connections 2024-04-12T13:37:16.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:16.184+0000 7f4b2ee00700 1 -- 172.21.15.60:0/1684142818 wait complete. 2024-04-12T13:37:17.304 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:17 smithi060 ceph-mon[29097]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:17 smithi110 ceph-mon[36055]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 -- 172.21.15.60:0/2103822902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c0656b0 msgr2=0x7fbb7c065b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:17.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 --2- 172.21.15.60:0/2103822902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c065b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb68004940 tx=0x7fbb68009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 -- 172.21.15.60:0/2103822902 shutdown_connections 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 --2- 172.21.15.60:0/2103822902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c065b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 --2- 172.21.15.60:0/2103822902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c102e60 0x7fbb7c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 -- 172.21.15.60:0/2103822902 >> 172.21.15.60:0/2103822902 conn(0x7fbb7c072bc0 msgr2=0x7fbb7c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 -- 172.21.15.60:0/2103822902 shutdown_connections 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.662+0000 7fbb84600700 1 -- 172.21.15.60:0/2103822902 wait complete. 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.663+0000 7fbb84600700 1 Processor -- start 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.663+0000 7fbb84600700 1 -- start start 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb84600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb84600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb84600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1168f0 con 0x7fbb7c102e60 2024-04-12T13:37:17.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb84600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c10fcc0 con 0x7fbb7c0656b0 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb81200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb81200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44656/0 (socket says 172.21.15.60:44656) 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.664+0000 7fbb81200700 1 -- 172.21.15.60:0/3044621913 learned_addr learned my addr 172.21.15.60:0/3044621913 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81c00700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81200700 1 -- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 msgr2=0x7fbb7c115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81200700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81200700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68005040 con 0x7fbb7c102e60 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81c00700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb81200700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009180 tx=0x7fbb68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6800e040 con 0x7fbb7c102e60 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c10ff40 con 0x7fbb7c102e60 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb6800bbc0 con 0x7fbb7c102e60 2024-04-12T13:37:17.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.665+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6801c630 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.666+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c110500 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.666+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb7c110aa0 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.668+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbb6800bd30 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb79600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 0x7fbb6406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbb68088d90 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb81c00700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 0x7fbb6406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb79600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 0x7fbb64071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb64071a40 con 0x7fbb6406ef80 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.669+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb680890d0 con 0x7fbb7c102e60 2024-04-12T13:37:17.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.670+0000 7fbb81c00700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 0x7fbb6406b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb70007fd0 tx=0x7fbb70009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.670+0000 7fbb82600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 0x7fbb64071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.671+0000 7fbb82600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 0x7fbb64071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.674+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== osd.4 v2:172.21.15.110:6808/4183773215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbb64071a40 con 0x7fbb6406ef80 2024-04-12T13:37:17.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.690+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 --> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb7c1100d0 con 0x7fbb6406ef80 2024-04-12T13:37:17.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.691+0000 7fbb79600700 1 -- 172.21.15.60:0/3044621913 <== osd.4 v2:172.21.15.110:6808/4183773215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbb7c1100d0 con 0x7fbb6406ef80 2024-04-12T13:37:17.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 msgr2=0x7fbb64071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:17.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 0x7fbb64071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 msgr2=0x7fbb6406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:17.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 0x7fbb6406b760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb70007fd0 tx=0x7fbb70009040 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 msgr2=0x7fbb7c1162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009180 tx=0x7fbb68009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 shutdown_connections 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:6808/4183773215,v1:172.21.15.110:6809/4183773215] conn(0x7fbb6406ef80 0x7fbb64071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbb640692b0 0x7fbb6406b760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb7c0656b0 0x7fbb7c115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 --2- 172.21.15.60:0/3044621913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb7c102e60 0x7fbb7c1162a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 >> 172.21.15.60:0/3044621913 conn(0x7fbb7c072bc0 msgr2=0x7fbb7c0fad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 shutdown_connections 2024-04-12T13:37:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.692+0000 7fbb84600700 1 -- 172.21.15.60:0/3044621913 wait complete. 2024-04-12T13:37:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 -- 172.21.15.60:0/2312327761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 msgr2=0x7ff2f81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 --2- 172.21.15.60:0/2312327761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f81031d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8004940 tx=0x7ff2e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 -- 172.21.15.60:0/2312327761 shutdown_connections 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 --2- 172.21.15.60:0/2312327761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 0x7ff2f80fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 --2- 172.21.15.60:0/2312327761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f81031d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 -- 172.21.15.60:0/2312327761 >> 172.21.15.60:0/2312327761 conn(0x7ff2f80f8970 msgr2=0x7ff2f80fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 -- 172.21.15.60:0/2312327761 shutdown_connections 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.316+0000 7ff2ff200700 1 -- 172.21.15.60:0/2312327761 wait complete. 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.317+0000 7ff2ff200700 1 Processor -- start 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2ff200700 1 -- start start 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2ff200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2ff200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 0x7ff2f8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2ff200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8070d90 con 0x7ff2f8102e00 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2ff200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8070ed0 con 0x7ff2f81037a0 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2f7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.318+0000 7ff2f7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44678/0 (socket says 172.21.15.60:44678) 2024-04-12T13:37:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7e00700 1 -- 172.21.15.60:0/3444797465 learned_addr learned my addr 172.21.15.60:0/3444797465 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7400700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 0x7ff2f8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7e00700 1 -- 172.21.15.60:0/3444797465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 msgr2=0x7ff2f8070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7e00700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 0x7ff2f8070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7e00700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8005040 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2f7e00700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009180 tx=0x7ff2e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.319+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e800e040 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.320+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2e800bbc0 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.320+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e801c630 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.320+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8071120 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.320+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f811a2d0 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.321+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2f805e6c0 con 0x7ff2f8102e00 2024-04-12T13:37:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.322+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff2e800bd30 con 0x7ff2f8102e00 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2efe00700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 0x7ff2dc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff2e8088150 con 0x7ff2f8102e00 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2f7400700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 0x7ff2dc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2efe00700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 0x7ff2dc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2dc071a90 con 0x7ff2dc06efd0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e808a760 con 0x7ff2f8102e00 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.323+0000 7ff2fd200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 0x7ff2dc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.324+0000 7ff2f7400700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 0x7ff2dc06b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8071c00 tx=0x7ff2e4009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.324+0000 7ff2fd200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 0x7ff2dc0713e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.325+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== osd.1 v2:172.21.15.60:6810/2736571111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff2dc071a90 con 0x7ff2dc06efd0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.342+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 --> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2f80fe550 con 0x7ff2dc06efd0 2024-04-12T13:37:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.342+0000 7ff2efe00700 1 -- 172.21.15.60:0/3444797465 <== osd.1 v2:172.21.15.60:6810/2736571111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2f80fe550 con 0x7ff2dc06efd0 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 msgr2=0x7ff2dc0713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 0x7ff2dc0713e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 msgr2=0x7ff2dc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 0x7ff2dc06b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8071c00 tx=0x7ff2e4009040 comp rx=0 tx=0).stop 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 msgr2=0x7ff2f80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009180 tx=0x7ff2e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 shutdown_connections 2024-04-12T13:37:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6810/2736571111,v1:172.21.15.60:6811/2736571111] conn(0x7ff2dc06efd0 0x7ff2dc0713e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff2dc0692b0 0x7ff2dc06b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f8102e00 0x7ff2f80702c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 --2- 172.21.15.60:0/3444797465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2f81037a0 0x7ff2f8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 >> 172.21.15.60:0/3444797465 conn(0x7ff2f80f8970 msgr2=0x7ff2f81073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 shutdown_connections 2024-04-12T13:37:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:18.343+0000 7ff2ff200700 1 -- 172.21.15.60:0/3444797465 wait complete. 2024-04-12T13:37:18.895 INFO:teuthology.orchestra.run.smithi060.stdout:150323855378 2024-04-12T13:37:18.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-12T13:37:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.563+0000 7f1235000700 1 -- 172.21.15.60:0/814688388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 msgr2=0x7f12300fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.563+0000 7f1235000700 1 --2- 172.21.15.60:0/814688388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f12300fce20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f121c004940 tx=0x7f121c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 -- 172.21.15.60:0/814688388 shutdown_connections 2024-04-12T13:37:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 --2- 172.21.15.60:0/814688388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f12300fce20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 --2- 172.21.15.60:0/814688388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 0x7f12301031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 -- 172.21.15.60:0/814688388 >> 172.21.15.60:0/814688388 conn(0x7f12300f89a0 msgr2=0x7f12300fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 -- 172.21.15.60:0/814688388 shutdown_connections 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.564+0000 7f1235000700 1 -- 172.21.15.60:0/814688388 wait complete. 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 Processor -- start 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 -- start start 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 0x7f12300702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230070d90 con 0x7f12301037b0 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.565+0000 7f1235000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230070ed0 con 0x7f1230102e10 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:19.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44628/0 (socket says 172.21.15.60:44628) 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 -- 172.21.15.60:0/2416489547 learned_addr learned my addr 172.21.15.60:0/2416489547 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122de00700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 0x7f12300702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 -- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 msgr2=0x7f12300702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 0x7f12300702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c005040 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.566+0000 7f122d400700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f121c009100 tx=0x7f121c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.567+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c00e040 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.567+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f121c004290 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.567+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230071120 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.567+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c01c3f0 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.567+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123011a2f0 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.568+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f123005e6c0 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.569+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f121c013790 con 0x7f12301037b0 2024-04-12T13:37:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f1226000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 0x7f121406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f121c088c30 con 0x7f12301037b0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f122de00700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 0x7f121406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f1226000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 0x7f1214071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1214071a40 con 0x7f121406ef80 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.570+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f121c088f70 con 0x7f12301037b0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.571+0000 7f122de00700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 0x7f121406b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1220004990 tx=0x7f1220009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.571+0000 7f122e800700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 0x7f1214071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.572+0000 7f122e800700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 0x7f1214071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.574+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== osd.5 v2:172.21.15.110:6816/2823620341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1214071a40 con 0x7f121406ef80 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.592+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 --> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f123005eb40 con 0x7f121406ef80 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1226000700 1 -- 172.21.15.60:0/2416489547 <== osd.5 v2:172.21.15.110:6816/2823620341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f123005eb40 con 0x7f121406ef80 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 msgr2=0x7f1214071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 0x7f1214071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 msgr2=0x7f121406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 0x7f121406b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1220004990 tx=0x7f1220009ee0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 msgr2=0x7f1230070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f121c009100 tx=0x7f121c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.593+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 shutdown_connections 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:6816/2823620341,v1:172.21.15.110:6817/2823620341] conn(0x7f121406ef80 0x7f1214071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f12140692b0 0x7f121406b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1230102e10 0x7f12300702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 --2- 172.21.15.60:0/2416489547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12301037b0 0x7f1230070800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 >> 172.21.15.60:0/2416489547 conn(0x7f12300f89a0 msgr2=0x7f1230102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 shutdown_connections 2024-04-12T13:37:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:17.594+0000 7f1235000700 1 -- 172.21.15.60:0/2416489547 wait complete. 2024-04-12T13:37:19.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:19 smithi060 ceph-mon[29097]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:19 smithi110 ceph-mon[36055]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:19.937 INFO:teuthology.orchestra.run.smithi060.stdout:81604378655 2024-04-12T13:37:19.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-12T13:37:20.018 INFO:teuthology.orchestra.run.smithi060.stdout:171798691851 2024-04-12T13:37:20.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-12T13:37:20.670 INFO:teuthology.orchestra.run.smithi060.stdout:38654705710 2024-04-12T13:37:20.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-12T13:37:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:60129542184 2024-04-12T13:37:21.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-12T13:37:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:21.078 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:21.236 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:21 smithi060 ceph-mon[29097]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:21.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:21 smithi110 ceph-mon[36055]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:23.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:23 smithi060 ceph-mon[29097]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:23.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:23 smithi110 ceph-mon[36055]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:25 smithi060 ceph-mon[29097]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:25 smithi110 ceph-mon[36055]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 -- 172.21.15.60:0/369801246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 msgr2=0x7f07340fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 --2- 172.21.15.60:0/369801246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f07340fe260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0728004940 tx=0x7f0728009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 -- 172.21.15.60:0/369801246 shutdown_connections 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 --2- 172.21.15.60:0/369801246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 0x7f0734106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 --2- 172.21.15.60:0/369801246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f07340fe260 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 -- 172.21.15.60:0/369801246 >> 172.21.15.60:0/369801246 conn(0x7f07340f7900 msgr2=0x7f07340f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 -- 172.21.15.60:0/369801246 shutdown_connections 2024-04-12T13:37:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.156+0000 7f073ba00700 1 -- 172.21.15.60:0/369801246 wait complete. 2024-04-12T13:37:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.158+0000 7f073ba00700 1 Processor -- start 2024-04-12T13:37:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.158+0000 7f073ba00700 1 -- start start 2024-04-12T13:37:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f073ba00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f073ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 0x7f0734113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f073ba00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07341144d0 con 0x7f07340fde90 2024-04-12T13:37:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f073ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073410dad0 con 0x7f07340fe830 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f0739000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f0739000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33794/0 (socket says 172.21.15.60:33794) 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.159+0000 7f0739000700 1 -- 172.21.15.60:0/4029429699 learned_addr learned my addr 172.21.15.60:0/4029429699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0733e00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 0x7f0734113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0739000700 1 -- 172.21.15.60:0/4029429699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 msgr2=0x7f0734113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0739000700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 0x7f0734113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0739000700 1 -- 172.21.15.60:0/4029429699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728005040 con 0x7f07340fde90 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0739000700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0728009380 tx=0x7f0728009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.160+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f072800e040 con 0x7f07340fde90 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.161+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0728009af0 con 0x7f07340fde90 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.161+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f072801c630 con 0x7f07340fde90 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.161+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073410dd50 con 0x7f07340fde90 2024-04-12T13:37:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.161+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073410e290 con 0x7f07340fde90 2024-04-12T13:37:26.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.162+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0734066b00 con 0x7f07340fde90 2024-04-12T13:37:26.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.163+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f072800bbc0 con 0x7f07340fde90 2024-04-12T13:37:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.165+0000 7f0730c00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 0x7f071c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.165+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0728088130 con 0x7f07340fde90 2024-04-12T13:37:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.165+0000 7f0733e00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 0x7f071c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.166+0000 7f0733e00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 0x7f071c06b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0720007fd0 tx=0x7f0720009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:26.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.170+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0728058210 con 0x7f07340fde90 2024-04-12T13:37:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.393+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0734109f20 con 0x7f07340fde90 2024-04-12T13:37:26.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.393+0000 7f0730c00700 1 -- 172.21.15.60:0/4029429699 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0728057da0 con 0x7f07340fde90 2024-04-12T13:37:26.396 INFO:teuthology.orchestra.run.smithi060.stdout:171798691852 2024-04-12T13:37:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 msgr2=0x7f071c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 0x7f071c06b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0720007fd0 tx=0x7f0720009040 comp rx=0 tx=0).stop 2024-04-12T13:37:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 msgr2=0x7f0734113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0728009380 tx=0x7f0728009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 shutdown_connections 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f071c0692a0 0x7f071c06b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07340fde90 0x7f0734113940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 --2- 172.21.15.60:0/4029429699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07340fe830 0x7f0734113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.396+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 >> 172.21.15.60:0/4029429699 conn(0x7f07340f7900 msgr2=0x7f07341036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.397+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 shutdown_connections 2024-04-12T13:37:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:26.397+0000 7f073ba00700 1 -- 172.21.15.60:0/4029429699 wait complete. 2024-04-12T13:37:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:27 smithi060 ceph-mon[29097]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:27.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:27 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4029429699' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-12T13:37:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:27 smithi110 ceph-mon[36055]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:27 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4029429699' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-12T13:37:28.094 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691851 got 171798691852 for osd.5 2024-04-12T13:37:28.094 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:29.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 -- 172.21.15.60:0/3288665692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fba20 msgr2=0x7f5bc40fbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/3288665692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fba20 0x7f5bc40fbdf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4004940 tx=0x7f5bb4009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 -- 172.21.15.60:0/3288665692 shutdown_connections 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/3288665692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fc330 0x7f5bc4109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/3288665692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fba20 0x7f5bc40fbdf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 -- 172.21.15.60:0/3288665692 >> 172.21.15.60:0/3288665692 conn(0x7f5bc40f7730 msgr2=0x7f5bc40f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 -- 172.21.15.60:0/3288665692 shutdown_connections 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.150+0000 7f5bc8a00700 1 -- 172.21.15.60:0/3288665692 wait complete. 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.151+0000 7f5bc8a00700 1 Processor -- start 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.151+0000 7f5bc8a00700 1 -- start start 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.151+0000 7f5bc8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fba20 0x7f5bc4115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.151+0000 7f5bc8a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc8a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc4116770 con 0x7f5bc40fc330 2024-04-12T13:37:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc410fb20 con 0x7f5bc40fba20 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33832/0 (socket says 172.21.15.60:33832) 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 -- 172.21.15.60:0/1087001788 learned_addr learned my addr 172.21.15.60:0/1087001788 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc3400700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fba20 0x7f5bc4115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 -- 172.21.15.60:0/1087001788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fba20 msgr2=0x7f5bc4115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fba20 0x7f5bc4115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.152+0000 7f5bc2a00700 1 -- 172.21.15.60:0/1087001788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4005040 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bc2a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b790 tx=0x7f5bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb000f770 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bb000fda0 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc410fe00 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb000d310 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.153+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc41103c0 con 0x7f5bc40fc330 2024-04-12T13:37:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.154+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc41067c0 con 0x7f5bc40fc330 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.155+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5bb0010420 con 0x7f5bc40fc330 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.156+0000 7f5bbb400700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 0x7f5ba806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.156+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5bb0086e30 con 0x7f5bc40fc330 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.156+0000 7f5bc3400700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 0x7f5ba806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.157+0000 7f5bc3400700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 0x7f5ba806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b020 tx=0x7f5bb4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.161+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5bb0056f10 con 0x7f5bc40fc330 2024-04-12T13:37:29.342 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:29 smithi060 ceph-mon[29097]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:29.342 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:29 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1351705210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-12T13:37:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.385+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5bc40668e0 con 0x7f5bc40fc330 2024-04-12T13:37:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.385+0000 7f5bbb400700 1 -- 172.21.15.60:0/1087001788 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bb0056aa0 con 0x7f5bc40fc330 2024-04-12T13:37:29.388 INFO:teuthology.orchestra.run.smithi060.stdout:38654705712 2024-04-12T13:37:29.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 msgr2=0x7f5ba806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 0x7f5ba806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b020 tx=0x7f5bb4009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 msgr2=0x7f5bc4116090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b790 tx=0x7f5bb0009250 comp rx=0 tx=0).stop 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 shutdown_connections 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5ba80692a0 0x7f5ba806b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bc40fba20 0x7f5bc4115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.388+0000 7f5bc8a00700 1 --2- 172.21.15.60:0/1087001788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40fc330 0x7f5bc4116090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.389+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 >> 172.21.15.60:0/1087001788 conn(0x7f5bc40f7730 msgr2=0x7f5bc40f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.389+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 shutdown_connections 2024-04-12T13:37:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.389+0000 7f5bc8a00700 1 -- 172.21.15.60:0/1087001788 wait complete. 2024-04-12T13:37:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:29 smithi110 ceph-mon[36055]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:29 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1351705210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-12T13:37:29.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 -- 172.21.15.60:0/1380888779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 msgr2=0x7fb5ac0ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/1380888779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac0ff090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb598004940 tx=0x7fb598009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 -- 172.21.15.60:0/1380888779 shutdown_connections 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/1380888779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac0ff090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/1380888779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 0x7fb5ac105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 -- 172.21.15.60:0/1380888779 >> 172.21.15.60:0/1380888779 conn(0x7fb5ac0fabd0 msgr2=0x7fb5ac0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 -- 172.21.15.60:0/1380888779 shutdown_connections 2024-04-12T13:37:29.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.731+0000 7fb5b2e00700 1 -- 172.21.15.60:0/1380888779 wait complete. 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.732+0000 7fb5b2e00700 1 Processor -- start 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.732+0000 7fb5b2e00700 1 -- start start 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.732+0000 7fb5b2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 0x7fb5ac115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.732+0000 7fb5b2e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5b2e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac116720 con 0x7fb5ac1059d0 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5b2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac10fd00 con 0x7fb5ac105030 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33694/0 (socket says 172.21.15.60:33694) 2024-04-12T13:37:29.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 -- 172.21.15.60:0/3231930829 learned_addr learned my addr 172.21.15.60:0/3231930829 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5abe00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 0x7fb5ac115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 -- 172.21.15.60:0/3231930829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 msgr2=0x7fb5ac115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 0x7fb5ac115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.733+0000 7fb5ab400700 1 -- 172.21.15.60:0/3231930829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598005040 con 0x7fb5ac1059d0 2024-04-12T13:37:29.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5ab400700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb598009180 tx=0x7fb598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59800e040 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb59800bbc0 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac10ff80 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59801c3f0 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.734+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac110540 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.735+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac100780 con 0x7fb5ac1059d0 2024-04-12T13:37:29.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.736+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb59800bd30 con 0x7fb5ac1059d0 2024-04-12T13:37:29.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.737+0000 7fb5a3e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 0x7fb59006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.737+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb598088240 con 0x7fb5ac1059d0 2024-04-12T13:37:29.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.738+0000 7fb5abe00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 0x7fb59006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.738+0000 7fb5abe00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 0x7fb59006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb59c004990 tx=0x7fb59c009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.742+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb5980582a0 con 0x7fb5ac1059d0 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 -- 172.21.15.60:0/3600593766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda00708a0 msgr2=0x7fbda0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 --2- 172.21.15.60:0/3600593766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda00708a0 0x7fbda0070d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c004970 tx=0x7fbd8c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 -- 172.21.15.60:0/3600593766 shutdown_connections 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 --2- 172.21.15.60:0/3600593766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda00708a0 0x7fbda0070d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 --2- 172.21.15.60:0/3600593766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda0071f90 0x7fbda0070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 -- 172.21.15.60:0/3600593766 >> 172.21.15.60:0/3600593766 conn(0x7fbda00f89d0 msgr2=0x7fbda00fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 -- 172.21.15.60:0/3600593766 shutdown_connections 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.728+0000 7fbda5c00700 1 -- 172.21.15.60:0/3600593766 wait complete. 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.729+0000 7fbda5c00700 1 Processor -- start 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.729+0000 7fbda5c00700 1 -- start start 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbda5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda00708a0 0x7fbda011a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbda5c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbda5c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda011ad20 con 0x7fbda0071f90 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbda5c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01140f0 con 0x7fbda00708a0 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33814/0 (socket says 172.21.15.60:33814) 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 -- 172.21.15.60:0/1351705210 learned_addr learned my addr 172.21.15.60:0/1351705210 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9ea00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda00708a0 0x7fbda011a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 -- 172.21.15.60:0/1351705210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda00708a0 msgr2=0x7fbda011a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda00708a0 0x7fbda011a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.730+0000 7fbd9e000700 1 -- 172.21.15.60:0/1351705210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c005040 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbd9e000700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c004f50 tx=0x7fbd8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd8c00e040 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd8c00bc10 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd8c01c630 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda0114370 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.731+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda01148b0 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.733+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda0071aa0 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.734+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbd8c013420 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.734+0000 7fbd96a00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 0x7fbd8406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.735+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbd8c0882f0 con 0x7fbda0071f90 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.735+0000 7fbd9ea00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 0x7fbd8406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.735+0000 7fbd9ea00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 0x7fbd8406b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd90007fd0 tx=0x7fbd90009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:29.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.739+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbd8c058350 con 0x7fbda0071f90 2024-04-12T13:37:29.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.965+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbda005f5f0 con 0x7fbda0071f90 2024-04-12T13:37:29.836 INFO:teuthology.orchestra.run.smithi060.stdout:115964117020 2024-04-12T13:37:29.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.966+0000 7fbd96a00700 1 -- 172.21.15.60:0/1351705210 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd8c057ee0 con 0x7fbda0071f90 2024-04-12T13:37:29.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 msgr2=0x7fbd8406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 0x7fbd8406b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd90007fd0 tx=0x7fbd90009040 comp rx=0 tx=0).stop 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 msgr2=0x7fbda011a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c004f50 tx=0x7fbd8c009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 shutdown_connections 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fbd840692b0 0x7fbd8406b760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda00708a0 0x7fbda011a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 --2- 172.21.15.60:0/1351705210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbda0071f90 0x7fbda011a6d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 >> 172.21.15.60:0/1351705210 conn(0x7fbda00f89d0 msgr2=0x7fbda00f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.969+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 shutdown_connections 2024-04-12T13:37:29.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:28.970+0000 7fbda5c00700 1 -- 172.21.15.60:0/1351705210 wait complete. 2024-04-12T13:37:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.963+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5ac10c110 con 0x7fb5ac1059d0 2024-04-12T13:37:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.964+0000 7fb5a3e00700 1 -- 172.21.15.60:0/3231930829 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb598057e30 con 0x7fb5ac1059d0 2024-04-12T13:37:29.967 INFO:teuthology.orchestra.run.smithi060.stdout:81604378657 2024-04-12T13:37:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 msgr2=0x7fb59006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 0x7fb59006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb59c004990 tx=0x7fb59c009ee0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 msgr2=0x7fb5ac1160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb598009180 tx=0x7fb598009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 shutdown_connections 2024-04-12T13:37:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5900692a0 0x7fb59006b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5ac105030 0x7fb5ac115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 --2- 172.21.15.60:0/3231930829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5ac1059d0 0x7fb5ac1160d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.967+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 >> 172.21.15.60:0/3231930829 conn(0x7fb5ac0fabd0 msgr2=0x7fb5ac0fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.968+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 shutdown_connections 2024-04-12T13:37:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:29.968+0000 7fb5b2e00700 1 -- 172.21.15.60:0/3231930829 wait complete. 2024-04-12T13:37:30.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:30 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1087001788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-12T13:37:30.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:30 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3231930829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-12T13:37:30.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:30 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1087001788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-12T13:37:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:30 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3231930829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-12T13:37:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:30.680 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117017 got 115964117020 for osd.3 2024-04-12T13:37:30.680 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:31.465 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:31 smithi060 ceph-mon[29097]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:31.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:31 smithi110 ceph-mon[36055]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:31.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705710 got 38654705712 for osd.0 2024-04-12T13:37:31.969 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.164+0000 7f057d400700 1 -- 172.21.15.60:0/2250348815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 msgr2=0x7f05780fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.164+0000 7f057d400700 1 --2- 172.21.15.60:0/2250348815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05780fcc70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0564004940 tx=0x7f0564009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 -- 172.21.15.60:0/2250348815 shutdown_connections 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 --2- 172.21.15.60:0/2250348815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05780fcc70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 --2- 172.21.15.60:0/2250348815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 0x7f0578103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 -- 172.21.15.60:0/2250348815 >> 172.21.15.60:0/2250348815 conn(0x7f05780f8830 msgr2=0x7f05780fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 -- 172.21.15.60:0/2250348815 shutdown_connections 2024-04-12T13:37:32.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.165+0000 7f057d400700 1 -- 172.21.15.60:0/2250348815 wait complete. 2024-04-12T13:37:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 Processor -- start 2024-04-12T13:37:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 -- start start 2024-04-12T13:37:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 0x7f0578115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578116720 con 0x7f0578103600 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.166+0000 7f057d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057810fb30 con 0x7f0578102c60 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33712/0 (socket says 172.21.15.60:33712) 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 -- 172.21.15.60:0/161504500 learned_addr learned my addr 172.21.15.60:0/161504500 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577e00700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 0x7f0578115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 -- 172.21.15.60:0/161504500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 msgr2=0x7f0578115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 0x7f0578115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 -- 172.21.15.60:0/161504500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564005040 con 0x7f0578103600 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.167+0000 7f0577400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0564009180 tx=0x7f0564009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.168+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056400e040 con 0x7f0578103600 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.168+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f056400bbc0 con 0x7f0578103600 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.168+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056401c3f0 con 0x7f0578103600 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.168+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057810fdb0 con 0x7f0578103600 2024-04-12T13:37:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.168+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0578110370 con 0x7f0578103600 2024-04-12T13:37:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.169+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780fe3b0 con 0x7f0578103600 2024-04-12T13:37:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.170+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f056400bd30 con 0x7f0578103600 2024-04-12T13:37:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.171+0000 7f056fe00700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 0x7f055c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.171+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0564088150 con 0x7f0578103600 2024-04-12T13:37:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.171+0000 7f0577e00700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 0x7f055c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.172+0000 7f0577e00700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 0x7f055c06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0568004990 tx=0x7f0568009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:32.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.176+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0564054850 con 0x7f0578103600 2024-04-12T13:37:32.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.397+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0578109d30 con 0x7f0578103600 2024-04-12T13:37:32.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.397+0000 7f056fe00700 1 -- 172.21.15.60:0/161504500 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0564057e70 con 0x7f0578103600 2024-04-12T13:37:32.400 INFO:teuthology.orchestra.run.smithi060.stdout:150323855380 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.400+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 msgr2=0x7f055c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.400+0000 7f057d400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 0x7f055c06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0568004990 tx=0x7f0568009ee0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.400+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 msgr2=0x7f05781160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.400+0000 7f057d400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0564009180 tx=0x7f0564009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 shutdown_connections 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f055c0692a0 0x7f055c06b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0578102c60 0x7f0578115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 --2- 172.21.15.60:0/161504500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0578103600 0x7f05781160d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:32.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 >> 172.21.15.60:0/161504500 conn(0x7f05780f8830 msgr2=0x7f0578071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:32.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 shutdown_connections 2024-04-12T13:37:32.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:32.401+0000 7f057d400700 1 -- 172.21.15.60:0/161504500 wait complete. 2024-04-12T13:37:33.319 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:33 smithi060 ceph-mon[29097]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:33.319 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:33 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/161504500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-12T13:37:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:33 smithi110 ceph-mon[36055]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:33 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/161504500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-12T13:37:33.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378655 got 81604378657 for osd.2 2024-04-12T13:37:33.493 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:34.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855378 got 150323855380 for osd.4 2024-04-12T13:37:34.223 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:34.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 -- 172.21.15.60:0/3253038422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 msgr2=0x7f4e980ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/3253038422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e980ff090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e84004940 tx=0x7f4e84009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 -- 172.21.15.60:0/3253038422 shutdown_connections 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/3253038422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e980ff090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/3253038422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 0x7f4e98105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 -- 172.21.15.60:0/3253038422 >> 172.21.15.60:0/3253038422 conn(0x7f4e980fabd0 msgr2=0x7f4e980fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 -- 172.21.15.60:0/3253038422 shutdown_connections 2024-04-12T13:37:34.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.517+0000 7f4e9cc00700 1 -- 172.21.15.60:0/3253038422 wait complete. 2024-04-12T13:37:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 Processor -- start 2024-04-12T13:37:34.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 -- start start 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 0x7f4e98115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98116720 con 0x7f4e981059d0 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.518+0000 7f4e9cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9810fd00 con 0x7f4e98105030 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33720/0 (socket says 172.21.15.60:33720) 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 -- 172.21.15.60:0/1457916376 learned_addr learned my addr 172.21.15.60:0/1457916376 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95e00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 0x7f4e98115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 -- 172.21.15.60:0/1457916376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 msgr2=0x7f4e98115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 0x7f4e98115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 -- 172.21.15.60:0/1457916376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84005040 con 0x7f4e981059d0 2024-04-12T13:37:34.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.519+0000 7f4e95400700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009100 tx=0x7f4e84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.520+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8400e040 con 0x7f4e981059d0 2024-04-12T13:37:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.520+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e84004290 con 0x7f4e981059d0 2024-04-12T13:37:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.520+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9810ff80 con 0x7f4e981059d0 2024-04-12T13:37:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.520+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8401c3f0 con 0x7f4e981059d0 2024-04-12T13:37:34.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.520+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e98110540 con 0x7f4e981059d0 2024-04-12T13:37:34.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.521+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98100780 con 0x7f4e981059d0 2024-04-12T13:37:34.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.522+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4e84013790 con 0x7f4e981059d0 2024-04-12T13:37:34.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.523+0000 7f4e8e000700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 0x7f4e7c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:34.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.523+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e84087df0 con 0x7f4e981059d0 2024-04-12T13:37:34.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.523+0000 7f4e95e00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 0x7f4e7c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:34.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.524+0000 7f4e95e00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 0x7f4e7c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e88007fd0 tx=0x7f4e88009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:34.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.528+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4e84057f90 con 0x7f4e981059d0 2024-04-12T13:37:34.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.743+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e9810c110 con 0x7f4e981059d0 2024-04-12T13:37:34.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.744+0000 7f4e8e000700 1 -- 172.21.15.60:0/1457916376 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e84013420 con 0x7f4e981059d0 2024-04-12T13:37:34.747 INFO:teuthology.orchestra.run.smithi060.stdout:60129542187 2024-04-12T13:37:34.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 msgr2=0x7f4e7c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 0x7f4e7c06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e88007fd0 tx=0x7f4e88009040 comp rx=0 tx=0).stop 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 msgr2=0x7f4e981160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009100 tx=0x7f4e84009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 shutdown_connections 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f4e7c0692a0 0x7f4e7c06b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98105030 0x7f4e98115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 --2- 172.21.15.60:0/1457916376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e981059d0 0x7f4e981160d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 >> 172.21.15.60:0/1457916376 conn(0x7f4e980fabd0 msgr2=0x7f4e980fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.748+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 shutdown_connections 2024-04-12T13:37:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:34.749+0000 7f4e9cc00700 1 -- 172.21.15.60:0/1457916376 wait complete. 2024-04-12T13:37:35.421 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:35 smithi060 ceph-mon[29097]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:35.422 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:35 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1457916376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-12T13:37:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:35 smithi110 ceph-mon[36055]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:35 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1457916376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-12T13:37:35.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542184 got 60129542187 for osd.1 2024-04-12T13:37:35.503 DEBUG:teuthology.parallel:result is None 2024-04-12T13:37:35.503 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-12T13:37:35.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph pg dump --format=json 2024-04-12T13:37:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:37 smithi110 ceph-mon[36055]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:37.570 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:37 smithi060 ceph-mon[29097]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:38.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 -- 172.21.15.60:0/652592884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 msgr2=0x7f94f8109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 --2- 172.21.15.60:0/652592884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f8109890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94e8004940 tx=0x7f94e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 -- 172.21.15.60:0/652592884 shutdown_connections 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 --2- 172.21.15.60:0/652592884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 0x7f94f81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 --2- 172.21.15.60:0/652592884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f8109890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 -- 172.21.15.60:0/652592884 >> 172.21.15.60:0/652592884 conn(0x7f94f8072c30 msgr2=0x7f94f8075040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 -- 172.21.15.60:0/652592884 shutdown_connections 2024-04-12T13:37:38.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.125+0000 7f94fce00700 1 -- 172.21.15.60:0/652592884 wait complete. 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 Processor -- start 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 -- start start 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 0x7f94f8119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f811ab10 con 0x7f94f81094c0 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.126+0000 7f94fce00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f81140f0 con 0x7f94f8103460 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:38.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33732/0 (socket says 172.21.15.60:33732) 2024-04-12T13:37:38.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 -- 172.21.15.60:0/2335965482 learned_addr learned my addr 172.21.15.60:0/2335965482 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:38.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5e00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 0x7f94f8119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:38.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 -- 172.21.15.60:0/2335965482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 msgr2=0x7f94f8119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 0x7f94f8119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.127+0000 7f94f5400700 1 -- 172.21.15.60:0/2335965482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8005040 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94f5400700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c830 tx=0x7f94e4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94e400a760 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94e400ad90 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94e40113a0 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f81143d0 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.128+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f8114990 con 0x7f94f81094c0 2024-04-12T13:37:38.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.129+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f8104ba0 con 0x7f94f81094c0 2024-04-12T13:37:38.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.130+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f94e4012400 con 0x7f94f81094c0 2024-04-12T13:37:38.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.131+0000 7f94ee000700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 0x7f94dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:38.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.131+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f94e4086ed0 con 0x7f94f81094c0 2024-04-12T13:37:38.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.131+0000 7f94f5e00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 0x7f94dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:38.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.132+0000 7f94f5e00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 0x7f94dc06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94e800b020 tx=0x7f94e8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:38.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.136+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f94e4056fb0 con 0x7f94f81094c0 2024-04-12T13:37:38.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.349+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94f81105a0 con 0x7f94dc0692a0 2024-04-12T13:37:38.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.351+0000 7f94ee000700 1 -- 172.21.15.60:0/2335965482 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27502 (secure 0 0 0) 0x7f94f81105a0 con 0x7f94dc0692a0 2024-04-12T13:37:38.355 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:37:38.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 msgr2=0x7f94dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 0x7f94dc06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94e800b020 tx=0x7f94e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 msgr2=0x7f94f811a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c830 tx=0x7f94e4004470 comp rx=0 tx=0).stop 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 shutdown_connections 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f94dc0692a0 0x7f94dc06b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94f8103460 0x7f94f8119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 --2- 172.21.15.60:0/2335965482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f81094c0 0x7f94f811a4c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.354+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 >> 172.21.15.60:0/2335965482 conn(0x7f94f8072c30 msgr2=0x7f94f8105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.355+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 shutdown_connections 2024-04-12T13:37:38.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:38.355+0000 7f94fce00700 1 -- 172.21.15.60:0/2335965482 wait complete. 2024-04-12T13:37:38.358 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-04-12T13:37:39.144 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-04-12T13:37:37.989611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788084,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682828,"statfs":{"total":575970213888,"available":574139215872,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003141"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-12T13:36:36.063419+0000","last_change":"2024-04-12T13:36:02.060427+0000","last_active":"2024-04-12T13:36:36.063419+0000","last_peered":"2024-04-12T13:36:36.063419+0000","last_clean":"2024-04-12T13:36:36.063419+0000","last_became_active":"2024-04-12T13:36:02.059343+0000","last_became_peered":"2024-04-12T13:36:02.059343+0000","last_unstale":"2024-04-12T13:36:36.063419+0000","last_undegraded":"2024-04-12T13:36:36.063419+0000","last_fullsized":"2024-04-12T13:36:36.063419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T13:34:54.651031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T13:34:54.651031+0000","last_clean_scrub_stamp":"2024-04-12T13:34:54.651031+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T16:24:50.145021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.012},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.173}]},{"osd":3,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.077},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.131}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2050000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6040000000000001,"5min":1.994,"15min":1.994},"last":0.93200000000000005}]},{"osd":1,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.998,"15min":1.01},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2849999999999999,"5min":1.972,"15min":1.972},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.998,"15min":0.999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.421,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.99299999999999999}]},{"osd":2,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0840000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3859999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.2689999999999999,"15min":1.294},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.476,"5min":4.5529999999999999,"15min":4.5529999999999999},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Apr 12 13:37:03 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":2,"up_from":19,"seq":81604378659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.56699999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.93899999999999995,"15min":0.92300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4710000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.98599999999999999,"15min":0.97399999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Apr 12 13:37:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1399999999999999,"15min":1.1279999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.222,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Apr 12 13:37:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298312,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446840,"statfs":{"total":95995035648,"available":95689564160,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 12 13:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83799999999999997,"15min":0.83099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4279999999999999,"5min":1.855,"15min":1.855},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.84899999999999998,"15min":0.78800000000000003},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.1970000000000001}]},{"osd":2,"last update":"Fri Apr 12 13:37:01 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.054,"15min":1.0429999999999999},"min":{"1min":0.86399999999999999,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.649,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.071},"min":{"1min":0.748,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.036},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1519999999999999,"15min":1.1479999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.268}]},{"osd":4,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.117},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.3520000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.752},"min":{"1min":0.51600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.355,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.03,"5min":0.873,"15min":0.82299999999999995},"min":{"1min":0.72999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.462,"5min":1.76,"15min":1.76},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0349999999999999,"15min":1.0329999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3959999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3160000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Apr 12 13:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.196,"15min":1.1839999999999999},"min":{"1min":0.96999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.22,"15min":1.212},"min":{"1min":0.97499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.603,"5min":1.806,"15min":1.806},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Apr 12 13:37:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T13:37:39.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph pg dump --format=json 2024-04-12T13:37:39.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:39 smithi060 ceph-mon[29097]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:39 smithi110 ceph-mon[36055]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:39.637 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:40.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:40 smithi060 ceph-mon[29097]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T13:37:40.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:40 smithi110 ceph-mon[36055]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T13:37:41.518 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:41 smithi060 ceph-mon[29097]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:41 smithi110 ceph-mon[36055]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 -- 172.21.15.60:0/3127028272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c44072e00 msgr2=0x7f7c4410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3127028272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c44072e00 0x7f7c4410d5c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7c30004940 tx=0x7f7c30009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 -- 172.21.15.60:0/3127028272 shutdown_connections 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3127028272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c44072e00 0x7f7c4410d5c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3127028272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c440724f0 0x7f7c440728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 -- 172.21.15.60:0/3127028272 >> 172.21.15.60:0/3127028272 conn(0x7f7c440fab10 msgr2=0x7f7c440fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 -- 172.21.15.60:0/3127028272 shutdown_connections 2024-04-12T13:37:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.833+0000 7f7c4a600700 1 -- 172.21.15.60:0/3127028272 wait complete. 2024-04-12T13:37:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.834+0000 7f7c4a600700 1 Processor -- start 2024-04-12T13:37:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c4a600700 1 -- start start 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c4a600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c4a600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 0x7f7c4411a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c4a600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4411aae0 con 0x7f7c440724f0 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c4a600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44113eb0 con 0x7f7c44072e00 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c49200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c49200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51148/0 (socket says 172.21.15.60:51148) 2024-04-12T13:37:41.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.835+0000 7f7c49200700 1 -- 172.21.15.60:0/3847605026 learned_addr learned my addr 172.21.15.60:0/3847605026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c43e00700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 0x7f7c4411a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c49200700 1 -- 172.21.15.60:0/3847605026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 msgr2=0x7f7c4411a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c49200700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 0x7f7c4411a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c49200700 1 -- 172.21.15.60:0/3847605026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30005040 con 0x7f7c440724f0 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c43e00700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 0x7f7c4411a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c49200700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c810 tx=0x7f7c38004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c38012810 con 0x7f7c440724f0 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c38012e40 con 0x7f7c440724f0 2024-04-12T13:37:41.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.836+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44114190 con 0x7f7c440724f0 2024-04-12T13:37:41.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.837+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3800a370 con 0x7f7c440724f0 2024-04-12T13:37:41.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.837+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44114750 con 0x7f7c440724f0 2024-04-12T13:37:41.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.838+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c44073c30 con 0x7f7c440724f0 2024-04-12T13:37:41.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.839+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7c38011810 con 0x7f7c440724f0 2024-04-12T13:37:41.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.840+0000 7f7c40c00700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 0x7f7c2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:41.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.840+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c38087390 con 0x7f7c440724f0 2024-04-12T13:37:41.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.840+0000 7f7c43e00700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 0x7f7c2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:41.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.841+0000 7f7c43e00700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 0x7f7c2c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c441157f0 tx=0x7f7c30009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:41.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:41.845+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7c38057370 con 0x7f7c440724f0 2024-04-12T13:37:42.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.062+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c4404bf40 con 0x7f7c2c0692a0 2024-04-12T13:37:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.064+0000 7f7c40c00700 1 -- 172.21.15.60:0/3847605026 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+29953 (secure 0 0 0) 0x7f7c4404bf40 con 0x7f7c2c0692a0 2024-04-12T13:37:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.068+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 msgr2=0x7f7c2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.068+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 0x7f7c2c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c441157f0 tx=0x7f7c30009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 msgr2=0x7f7c44119f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c810 tx=0x7f7c38004470 comp rx=0 tx=0).stop 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 shutdown_connections 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7c2c0692a0 0x7f7c2c06b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c440724f0 0x7f7c44119f50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:42.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 --2- 172.21.15.60:0/3847605026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c44072e00 0x7f7c4411a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:42.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 >> 172.21.15.60:0/3847605026 conn(0x7f7c440fab10 msgr2=0x7f7c440faee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:42.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 shutdown_connections 2024-04-12T13:37:42.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:42.069+0000 7f7c4a600700 1 -- 172.21.15.60:0/3847605026 wait complete. 2024-04-12T13:37:42.073 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-04-12T13:37:42.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:37:42.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:37:42.915 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-04-12T13:37:41.990912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788084,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682828,"statfs":{"total":575970213888,"available":574139215872,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003281"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-12T13:36:36.063419+0000","last_change":"2024-04-12T13:36:02.060427+0000","last_active":"2024-04-12T13:36:36.063419+0000","last_peered":"2024-04-12T13:36:36.063419+0000","last_clean":"2024-04-12T13:36:36.063419+0000","last_became_active":"2024-04-12T13:36:02.059343+0000","last_became_peered":"2024-04-12T13:36:02.059343+0000","last_unstale":"2024-04-12T13:36:36.063419+0000","last_undegraded":"2024-04-12T13:36:36.063419+0000","last_fullsized":"2024-04-12T13:36:36.063419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T13:34:54.651031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T13:34:54.651031+0000","last_clean_scrub_stamp":"2024-04-12T13:34:54.651031+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T16:24:50.145021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.034},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Fri Apr 12 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Fri Apr 12 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.161},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.1379999999999999}]},{"osd":3,"last update":"Fri Apr 12 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.276}]},{"osd":4,"last update":"Fri Apr 12 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.232},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.468}]}]},{"osd":4,"up_from":35,"seq":150323855382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.012},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.173}]},{"osd":3,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.077},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.131}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.90200000000000002,"15min":0.89200000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2050000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6040000000000001,"5min":1.994,"15min":1.994},"last":0.93200000000000005}]},{"osd":1,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.998,"15min":1.01},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2849999999999999,"5min":1.972,"15min":1.972},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.998,"15min":0.999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.421,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.99299999999999999}]},{"osd":2,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0700000000000001,"15min":1.0840000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3859999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.2689999999999999,"15min":1.294},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.476,"5min":4.5529999999999999,"15min":4.5529999999999999},"last":0.97199999999999998}]},{"osd":4,"last update":"Fri Apr 12 13:37:03 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.56699999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.032,"5min":0.93899999999999995,"15min":0.92300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4710000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.294},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.98599999999999999,"15min":0.97399999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Fri Apr 12 13:37:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1399999999999999,"15min":1.1279999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.1899999999999999,"15min":1.1839999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Apr 12 13:37:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.26},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Apr 12 13:37:37 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.46},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.4019999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298312,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446840,"statfs":{"total":95995035648,"available":95689564160,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 12 13:37:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83799999999999997,"15min":0.83099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4279999999999999,"5min":1.855,"15min":1.855},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.84899999999999998,"15min":0.78800000000000003},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.149}]},{"osd":2,"last update":"Fri Apr 12 13:37:01 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.054,"15min":1.0429999999999999},"min":{"1min":0.86399999999999999,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.649,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.075,"15min":1.071},"min":{"1min":0.748,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.339,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.028}]},{"osd":3,"last update":"Fri Apr 12 13:37:30 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.0429999999999999,"15min":1.036},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1519999999999999,"15min":1.1479999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.377}]},{"osd":4,"last update":"Fri Apr 12 13:37:02 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.337},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.468}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 13:37:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.80000000000000004,"15min":0.752},"min":{"1min":0.51600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.355,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.03,"5min":0.873,"15min":0.82299999999999995},"min":{"1min":0.72999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.462,"5min":1.76,"15min":1.76},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Apr 12 13:36:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0349999999999999,"15min":1.0329999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3959999999999999,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.79700000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3160000000000001,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.78400000000000003}]},{"osd":3,"last update":"Fri Apr 12 13:37:31 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.196,"15min":1.1839999999999999},"min":{"1min":0.96999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.22,"15min":1.212},"min":{"1min":0.97499999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.603,"5min":1.806,"15min":1.806},"last":1.607}]},{"osd":4,"last update":"Fri Apr 12 13:37:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.234},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2749999999999999}]},{"osd":5,"last update":"Fri Apr 12 13:37:39 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.554}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T13:37:42.916 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-12T13:37:42.917 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-12T13:37:42.917 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-12T13:37:42.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph health --format=json 2024-04-12T13:37:43.384 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:43.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:43 smithi060 ceph-mon[29097]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:43.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:43 smithi060 ceph-mon[29097]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T13:37:43.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:37:43.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:37:43.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:43 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:37:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:43 smithi110 ceph-mon[36055]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:43 smithi110 ceph-mon[36055]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T13:37:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:37:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:37:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:43 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:37:45.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:45 smithi060 ceph-mon[29097]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:45.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 -- 172.21.15.60:0/3964412572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 msgr2=0x7f7cc0102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 --2- 172.21.15.60:0/3964412572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0102110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0004940 tx=0x7f7cb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 -- 172.21.15.60:0/3964412572 shutdown_connections 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 --2- 172.21.15.60:0/3964412572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc00fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 --2- 172.21.15.60:0/3964412572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0102110 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 -- 172.21.15.60:0/3964412572 >> 172.21.15.60:0/3964412572 conn(0x7f7cc00f7870 msgr2=0x7f7cc00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 -- 172.21.15.60:0/3964412572 shutdown_connections 2024-04-12T13:37:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.576+0000 7f7cc5400700 1 -- 172.21.15.60:0/3964412572 wait complete. 2024-04-12T13:37:45.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.577+0000 7f7cc5400700 1 Processor -- start 2024-04-12T13:37:45.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.577+0000 7f7cc5400700 1 -- start start 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cc5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cc5400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc01160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cc5400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0116710 con 0x7f7cc0101d40 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cc5400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc010fcf0 con 0x7f7cc01026e0 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cbe800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cbe800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51164/0 (socket says 172.21.15.60:51164) 2024-04-12T13:37:45.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.578+0000 7f7cbe800700 1 -- 172.21.15.60:0/1469683067 learned_addr learned my addr 172.21.15.60:0/1469683067 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cb7e00700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc01160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cbe800700 1 -- 172.21.15.60:0/1469683067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 msgr2=0x7f7cc01160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cbe800700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc01160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cbe800700 1 -- 172.21.15.60:0/1469683067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0005040 con 0x7f7cc0101d40 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cb7e00700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc01160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cbe800700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009150 tx=0x7f7cb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb0021070 con 0x7f7cc0101d40 2024-04-12T13:37:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7cb0013c00 con 0x7f7cc0101d40 2024-04-12T13:37:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc010ff70 con 0x7f7cc0101d40 2024-04-12T13:37:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.579+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb000e070 con 0x7f7cc0101d40 2024-04-12T13:37:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.580+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0110450 con 0x7f7cc0101d40 2024-04-12T13:37:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.581+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c0052b0 con 0x7f7cc0101d40 2024-04-12T13:37:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.582+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7cb001ca60 con 0x7f7cc0101d40 2024-04-12T13:37:45.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.583+0000 7f7cb6a00700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 0x7f7ca406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:45.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.583+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7cb0088400 con 0x7f7cc0101d40 2024-04-12T13:37:45.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.583+0000 7f7cb7e00700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 0x7f7ca406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:45.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.584+0000 7f7cb7e00700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 0x7f7ca406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8004600 tx=0x7f7ca800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:45.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.588+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7cb0058460 con 0x7f7cc0101d40 2024-04-12T13:37:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:45 smithi110 ceph-mon[36055]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:37:45.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.849+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7c9c005ae0 con 0x7f7cc0101d40 2024-04-12T13:37:45.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.850+0000 7f7cb6a00700 1 -- 172.21.15.60:0/1469683067 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7cb0057ff0 con 0x7f7cc0101d40 2024-04-12T13:37:45.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:37:45.852 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 msgr2=0x7f7ca406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 0x7f7ca406b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8004600 tx=0x7f7ca800b040 comp rx=0 tx=0).stop 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 msgr2=0x7f7cc0115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009150 tx=0x7f7cb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 shutdown_connections 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7ca40692a0 0x7f7ca406b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cc0101d40 0x7f7cc0115b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 --2- 172.21.15.60:0/1469683067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cc01026e0 0x7f7cc01160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:45.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 >> 172.21.15.60:0/1469683067 conn(0x7f7cc00f7870 msgr2=0x7f7cc00f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:45.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 shutdown_connections 2024-04-12T13:37:45.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:45.853+0000 7f7cc5400700 1 -- 172.21.15.60:0/1469683067 wait complete. 2024-04-12T13:37:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:46 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1469683067' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-12T13:37:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:46 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1469683067' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-12T13:37:46.740 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-12T13:37:46.740 INFO:tasks.cephadm:Setup complete, yielding 2024-04-12T13:37:46.741 INFO:teuthology.run_tasks:Running task print... 2024-04-12T13:37:46.750 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-12T13:37:46.750 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:37:46.768 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:37:46.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-12T13:37:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:47.570 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:47 smithi060 ceph-mon[29097]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:47 smithi110 ceph-mon[36055]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 -- 172.21.15.60:0/1402799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 msgr2=0x7f6fbc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 --2- 172.21.15.60:0/1402799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc070350 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0004940 tx=0x7f6fb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 -- 172.21.15.60:0/1402799826 shutdown_connections 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 --2- 172.21.15.60:0/1402799826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 0x7f6fbc070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 --2- 172.21.15.60:0/1402799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc070350 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 -- 172.21.15.60:0/1402799826 >> 172.21.15.60:0/1402799826 conn(0x7f6fbc0f8580 msgr2=0x7f6fbc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 -- 172.21.15.60:0/1402799826 shutdown_connections 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.418+0000 7f6fc4400700 1 -- 172.21.15.60:0/1402799826 wait complete. 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 Processor -- start 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 -- start start 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 0x7f6fbc10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc1106d0 con 0x7f6fbc071e40 2024-04-12T13:37:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.419+0000 7f6fc4400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc110840 con 0x7f6fbc070890 2024-04-12T13:37:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37830/0 (socket says 172.21.15.60:37830) 2024-04-12T13:37:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 -- 172.21.15.60:0/452322966 learned_addr learned my addr 172.21.15.60:0/452322966 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1a00700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 0x7f6fbc10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 -- 172.21.15.60:0/452322966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 msgr2=0x7f6fbc10fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 0x7f6fbc10fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 -- 172.21.15.60:0/452322966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0005040 con 0x7f6fbc071e40 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.420+0000 7f6fc1000700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c830 tx=0x7f6fa8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.421+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa800a760 con 0x7f6fbc071e40 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.421+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc1152a0 con 0x7f6fbc071e40 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.421+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fa800ad90 con 0x7f6fbc071e40 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.421+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa80113a0 con 0x7f6fbc071e40 2024-04-12T13:37:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.421+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc115860 con 0x7f6fbc071e40 2024-04-12T13:37:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.422+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc04c710 con 0x7f6fbc071e40 2024-04-12T13:37:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.423+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6fa8012400 con 0x7f6fbc071e40 2024-04-12T13:37:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.425+0000 7f6fb9600700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 0x7f6fa406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.426+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6fa8086fa0 con 0x7f6fbc071e40 2024-04-12T13:37:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.426+0000 7f6fc1a00700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 0x7f6fa406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.427+0000 7f6fc1a00700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 0x7f6fa406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009fd0 tx=0x7f6fb0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.430+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6fa8057000 con 0x7f6fbc071e40 2024-04-12T13:37:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.645+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f6fbc107ae0 con 0x7f6fbc071e40 2024-04-12T13:37:49.647 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:49 smithi060 ceph-mon[29097]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:49.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.651+0000 7f6fb9600700 1 -- 172.21.15.60:0/452322966 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6fa8056b90 con 0x7f6fbc071e40 2024-04-12T13:37:49.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 msgr2=0x7f6fa406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:49.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 0x7f6fa406b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009fd0 tx=0x7f6fb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:49.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 msgr2=0x7f6fbc1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c830 tx=0x7f6fa8004470 comp rx=0 tx=0).stop 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 shutdown_connections 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6fa40692a0 0x7f6fa406b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc070890 0x7f6fbc10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.654+0000 7f6fc4400700 1 --2- 172.21.15.60:0/452322966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fbc071e40 0x7f6fbc1100d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.655+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 >> 172.21.15.60:0/452322966 conn(0x7f6fbc0f8580 msgr2=0x7f6fbc0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.655+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 shutdown_connections 2024-04-12T13:37:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:49.655+0000 7f6fc4400700 1 -- 172.21.15.60:0/452322966 wait complete. 2024-04-12T13:37:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:49 smithi110 ceph-mon[36055]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:50.543 INFO:teuthology.run_tasks:Running task print... 2024-04-12T13:37:50.556 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-12T13:37:50.556 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:37:50.569 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:37:50.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch status' 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/452322966' entity='client.admin' 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:37:50.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:50 smithi060 ceph-mon[29097]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:50.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/452322966' entity='client.admin' 2024-04-12T13:37:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:37:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:37:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:37:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:37:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:50 smithi110 ceph-mon[36055]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:51.081 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:53.299 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:53 smithi060 ceph-mon[29097]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 -- 172.21.15.60:0/3689024811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650103270 msgr2=0x7f3650103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 --2- 172.21.15.60:0/3689024811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650103270 0x7f3650103680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3644004940 tx=0x7f3644009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 -- 172.21.15.60:0/3689024811 shutdown_connections 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 --2- 172.21.15.60:0/3689024811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650104520 0x7f3650104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 --2- 172.21.15.60:0/3689024811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650103270 0x7f3650103680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 -- 172.21.15.60:0/3689024811 >> 172.21.15.60:0/3689024811 conn(0x7f3650072530 msgr2=0x7f3650074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 -- 172.21.15.60:0/3689024811 shutdown_connections 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.296+0000 7f3656400700 1 -- 172.21.15.60:0/3689024811 wait complete. 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.297+0000 7f3656400700 1 Processor -- start 2024-04-12T13:37:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.297+0000 7f3656400700 1 -- start start 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f3656400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650103270 0x7f3650113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f3656400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f3656400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3650115150 con 0x7f3650104520 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f3656400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501152c0 con 0x7f3650103270 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f364fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f364fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37840/0 (socket says 172.21.15.60:37840) 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f364fe00700 1 -- 172.21.15.60:0/3413356567 learned_addr learned my addr 172.21.15.60:0/3413356567 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.298+0000 7f3655000700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650103270 0x7f3650113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364fe00700 1 -- 172.21.15.60:0/3413356567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650103270 msgr2=0x7f3650113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364fe00700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650103270 0x7f3650113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364fe00700 1 -- 172.21.15.60:0/3413356567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644005040 con 0x7f3650104520 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364fe00700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b790 tx=0x7f363c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c00f770 con 0x7f3650104520 2024-04-12T13:37:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650115540 con 0x7f3650104520 2024-04-12T13:37:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f363c00fda0 con 0x7f3650104520 2024-04-12T13:37:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.299+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c00d310 con 0x7f3650104520 2024-04-12T13:37:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.300+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3650115b00 con 0x7f3650104520 2024-04-12T13:37:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.301+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500760a0 con 0x7f3650104520 2024-04-12T13:37:53.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.302+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f363c010420 con 0x7f3650104520 2024-04-12T13:37:53.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.303+0000 7f364cc00700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 0x7f363806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:53.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.303+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f363c086d70 con 0x7f3650104520 2024-04-12T13:37:53.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.303+0000 7f3655000700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 0x7f363806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:53.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.304+0000 7f3655000700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 0x7f363806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364400b3b0 tx=0x7f3644009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:53.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.307+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f363c053480 con 0x7f3650104520 2024-04-12T13:37:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:53 smithi110 ceph-mon[36055]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:53.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.537+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3650115e40 con 0x7f36380692a0 2024-04-12T13:37:53.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.539+0000 7f364cc00700 1 -- 172.21.15.60:0/3413356567 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3650115e40 con 0x7f36380692a0 2024-04-12T13:37:53.542 INFO:teuthology.orchestra.run.smithi060.stdout:Backend: cephadm 2024-04-12T13:37:53.542 INFO:teuthology.orchestra.run.smithi060.stdout:Available: Yes 2024-04-12T13:37:53.542 INFO:teuthology.orchestra.run.smithi060.stdout:Paused: No 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.542+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 msgr2=0x7f363806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.542+0000 7f3656400700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 0x7f363806b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364400b3b0 tx=0x7f3644009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.542+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 msgr2=0x7f36501144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.542+0000 7f3656400700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b790 tx=0x7f363c009250 comp rx=0 tx=0).stop 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 shutdown_connections 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f36380692a0 0x7f363806b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3650103270 0x7f3650113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 --2- 172.21.15.60:0/3413356567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3650104520 0x7f36501144a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:53.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 >> 172.21.15.60:0/3413356567 conn(0x7f3650072530 msgr2=0x7f3650074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:53.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 shutdown_connections 2024-04-12T13:37:53.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:53.543+0000 7f3656400700 1 -- 172.21.15.60:0/3413356567 wait complete. 2024-04-12T13:37:54.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-12T13:37:54.998 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:55.330 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:55 smithi060 ceph-mon[29097]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:37:55.331 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:55 smithi060 ceph-mon[29097]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:55 smithi110 ceph-mon[36055]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:37:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:55 smithi110 ceph-mon[36055]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.203+0000 7f2533600700 1 -- 172.21.15.60:0/2736629350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c1046d0 msgr2=0x7f252c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.203+0000 7f2533600700 1 --2- 172.21.15.60:0/2736629350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c1046d0 0x7f252c104b40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2518004940 tx=0x7f2518009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 -- 172.21.15.60:0/2736629350 shutdown_connections 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 --2- 172.21.15.60:0/2736629350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c1046d0 0x7f252c104b40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 --2- 172.21.15.60:0/2736629350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c103420 0x7f252c103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 -- 172.21.15.60:0/2736629350 >> 172.21.15.60:0/2736629350 conn(0x7f252c072640 msgr2=0x7f252c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 -- 172.21.15.60:0/2736629350 shutdown_connections 2024-04-12T13:37:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.204+0000 7f2533600700 1 -- 172.21.15.60:0/2736629350 wait complete. 2024-04-12T13:37:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.205+0000 7f2533600700 1 Processor -- start 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.205+0000 7f2533600700 1 -- start start 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.205+0000 7f2533600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2533600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 0x7f252c114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2533600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c114a90 con 0x7f252c103420 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2533600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c114c00 con 0x7f252c1046d0 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37854/0 (socket says 172.21.15.60:37854) 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 -- 172.21.15.60:0/957556737 learned_addr learned my addr 172.21.15.60:0/957556737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2523e00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 0x7f252c114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 -- 172.21.15.60:0/957556737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 msgr2=0x7f252c114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 0x7f252c114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2530c00700 1 -- 172.21.15.60:0/957556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518005040 con 0x7f252c103420 2024-04-12T13:37:57.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.206+0000 7f2523e00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 0x7f252c114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:37:57.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2530c00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f251000c830 tx=0x7f2510004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:57.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251000a760 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f251000ad90 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25100113a0 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c119660 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.207+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c119c20 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.208+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c04c710 con 0x7f252c103420 2024-04-12T13:37:57.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.209+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2510012400 con 0x7f252c103420 2024-04-12T13:37:57.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.210+0000 7f2529600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 0x7f250806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:37:57.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.211+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2510086ed0 con 0x7f252c103420 2024-04-12T13:37:57.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.211+0000 7f2523e00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 0x7f250806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:37:57.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.212+0000 7f2523e00700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 0x7f250806b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f251800b7a0 tx=0x7f2518009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:37:57.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.215+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2510056fb0 con 0x7f252c103420 2024-04-12T13:37:57.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:57 smithi060 ceph-mon[29097]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:57.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.444+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f252c108a10 con 0x7f25080692a0 2024-04-12T13:37:57.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.454+0000 7f2529600700 1 -- 172.21.15.60:0/957556737 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f252c108a10 con 0x7f25080692a0 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (4m) 2m ago 6m 13.8M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (7m) 2m ago 7m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (5m) 81s ago 5m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (4m) 2m ago 6m 74.2M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (8m) 2m ago 8m 473M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (5m) 81s ago 5m 431M - 17.2.7-845-g730340d7 036a68d49952 ed3d7d27e5fe 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (8m) 2m ago 8m 41.0M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:37:57.457 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (5m) 81s ago 5m 37.8M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 2m ago 7m 7713k - 1.5.0 0da6a335fe13 5baa779bb80b 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 81s ago 5m 7822k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 2m ago 4m 37.3M 4290M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (3m) 2m ago 3m 38.4M 4290M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 2m ago 3m 37.2M 4290M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (2m) 81s ago 2m 39.9M 5312M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (2m) 81s ago 2m 37.9M 5312M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (88s) 81s ago 87s 10.5M 5312M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:37:57.458 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 2m ago 6m 34.8M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:37:57.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.457+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 msgr2=0x7f250806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:57.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.457+0000 7f2533600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 0x7f250806b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f251800b7a0 tx=0x7f2518009e30 comp rx=0 tx=0).stop 2024-04-12T13:37:57.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.457+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 msgr2=0x7f252c113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:37:57.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.457+0000 7f2533600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f251000c830 tx=0x7f2510004470 comp rx=0 tx=0).stop 2024-04-12T13:37:57.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 shutdown_connections 2024-04-12T13:37:57.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25080692a0 0x7f250806b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f252c103420 0x7f252c113f50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 --2- 172.21.15.60:0/957556737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f252c1046d0 0x7f252c114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:37:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 >> 172.21.15.60:0/957556737 conn(0x7f252c072640 msgr2=0x7f252c073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:37:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 shutdown_connections 2024-04-12T13:37:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:37:57.458+0000 7f2533600700 1 -- 172.21.15.60:0/957556737 wait complete. 2024-04-12T13:37:57.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:57 smithi110 ceph-mon[36055]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:58.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-12T13:37:58.820 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:37:59.293 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:59 smithi060 ceph-mon[29097]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:37:59.293 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:37:59 smithi060 ceph-mon[29097]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:37:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:59 smithi110 ceph-mon[36055]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:37:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:37:59 smithi110 ceph-mon[36055]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:00.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:01.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 -- 172.21.15.60:0/3951106200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 msgr2=0x7f344c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:01.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 --2- 172.21.15.60:0/3951106200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c102390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3434004940 tx=0x7f3434009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 -- 172.21.15.60:0/3951106200 shutdown_connections 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 --2- 172.21.15.60:0/3951106200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c102390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 --2- 172.21.15.60:0/3951106200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 0x7f344c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 -- 172.21.15.60:0/3951106200 >> 172.21.15.60:0/3951106200 conn(0x7f344c0f74c0 msgr2=0x7f344c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 -- 172.21.15.60:0/3951106200 shutdown_connections 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.023+0000 7f3453200700 1 -- 172.21.15.60:0/3951106200 wait complete. 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.024+0000 7f3453200700 1 Processor -- start 2024-04-12T13:38:01.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.024+0000 7f3453200700 1 -- start start 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3453200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 0x7f344c114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3453200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3453200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c114bc0 con 0x7f344c0fff70 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3453200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c115410 con 0x7f344c0662f0 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3443e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3443e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45208/0 (socket says 172.21.15.60:45208) 2024-04-12T13:38:01.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f3443e00700 1 -- 172.21.15.60:0/2026609448 learned_addr learned my addr 172.21.15.60:0/2026609448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.025+0000 7f344be00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 0x7f344c114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3443e00700 1 -- 172.21.15.60:0/2026609448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 msgr2=0x7f344c114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3443e00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 0x7f344c114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3443e00700 1 -- 172.21.15.60:0/2026609448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434005040 con 0x7f344c0fff70 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3443e00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f343400b3b0 tx=0x7f3434009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:01.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343400e040 con 0x7f344c0fff70 2024-04-12T13:38:01.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3434004290 con 0x7f344c0fff70 2024-04-12T13:38:01.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343401c630 con 0x7f344c0fff70 2024-04-12T13:38:01.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.026+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c115690 con 0x7f344c0fff70 2024-04-12T13:38:01.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.027+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c115bd0 con 0x7f344c0fff70 2024-04-12T13:38:01.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.028+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c0f8ff0 con 0x7f344c0fff70 2024-04-12T13:38:01.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.029+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f343400bbf0 con 0x7f344c0fff70 2024-04-12T13:38:01.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.030+0000 7f3448c00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 0x7f343006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:01.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.030+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f34340882d0 con 0x7f344c0fff70 2024-04-12T13:38:01.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.030+0000 7f344be00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 0x7f343006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:01.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.031+0000 7f344be00700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 0x7f343006b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f343c007fd0 tx=0x7f343c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:01.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.035+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f34340583b0 con 0x7f344c0fff70 2024-04-12T13:38:01.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.264+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f344c115e40 con 0x7f34300692b0 2024-04-12T13:38:01.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.272+0000 7f3448c00700 1 -- 172.21.15.60:0/2026609448 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f344c115e40 con 0x7f34300692b0 2024-04-12T13:38:01.274 INFO:teuthology.orchestra.run.smithi060.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-12T13:38:01.274 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-04-12T13:38:01.274 INFO:teuthology.orchestra.run.smithi060.stdout:crash 2/2 2m ago 7m * 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:mgr 2/2 2m ago 7m count:2 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:mon 2/2 2m ago 6m smithi060:172.21.15.60=smithi060;smithi110:172.21.15.110=smithi110;count:2 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:osd 6 2m ago - 2024-04-12T13:38:01.275 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-04-12T13:38:01.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 msgr2=0x7f343006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:01.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 0x7f343006b760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f343c007fd0 tx=0x7f343c009040 comp rx=0 tx=0).stop 2024-04-12T13:38:01.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 msgr2=0x7f344c1145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:01.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f343400b3b0 tx=0x7f3434009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:01.278 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:01 smithi060 ceph-mon[29097]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:01.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 shutdown_connections 2024-04-12T13:38:01.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f34300692b0 0x7f343006b760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0662f0 0x7f344c114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 --2- 172.21.15.60:0/2026609448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f344c0fff70 0x7f344c1145c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:01.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.275+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 >> 172.21.15.60:0/2026609448 conn(0x7f344c0f74c0 msgr2=0x7f344c0fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:01.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.276+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 shutdown_connections 2024-04-12T13:38:01.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:01.276+0000 7f3453200700 1 -- 172.21.15.60:0/2026609448 wait complete. 2024-04-12T13:38:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:01 smithi110 ceph-mon[36055]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:02.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-12T13:38:02.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:02 smithi060 ceph-mon[29097]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:02 smithi110 ceph-mon[36055]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:02.544 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:03 smithi060 ceph-mon[29097]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:03 smithi110 ceph-mon[36055]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 -- 172.21.15.60:0/919343340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 msgr2=0x7fa28c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 --2- 172.21.15.60:0/919343340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c100720 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa274004940 tx=0x7fa274009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 -- 172.21.15.60:0/919343340 shutdown_connections 2024-04-12T13:38:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 --2- 172.21.15.60:0/919343340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c100720 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 --2- 172.21.15.60:0/919343340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 0x7fa28c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:04.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 -- 172.21.15.60:0/919343340 >> 172.21.15.60:0/919343340 conn(0x7fa28c0fa950 msgr2=0x7fa28c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:04.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 -- 172.21.15.60:0/919343340 shutdown_connections 2024-04-12T13:38:04.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.830+0000 7fa292000700 1 -- 172.21.15.60:0/919343340 wait complete. 2024-04-12T13:38:04.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.831+0000 7fa292000700 1 Processor -- start 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.831+0000 7fa292000700 1 -- start start 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa292000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 0x7fa28c10fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa292000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa292000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c110650 con 0x7fa28c1002b0 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa292000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1107c0 con 0x7fa28c0ff000 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa283e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa283e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45228/0 (socket says 172.21.15.60:45228) 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa283e00700 1 -- 172.21.15.60:0/2779870660 learned_addr learned my addr 172.21.15.60:0/2779870660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.832+0000 7fa28b400700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 0x7fa28c10fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283e00700 1 -- 172.21.15.60:0/2779870660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 msgr2=0x7fa28c10fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283e00700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 0x7fa28c10fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283e00700 1 -- 172.21.15.60:0/2779870660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274005040 con 0x7fa28c1002b0 2024-04-12T13:38:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283e00700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b3b0 tx=0x7fa274009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27400e040 con 0x7fa28c1002b0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa274004290 con 0x7fa28c1002b0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27401c630 con 0x7fa28c1002b0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c1151c0 con 0x7fa28c1002b0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.833+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c115780 con 0x7fa28c1002b0 2024-04-12T13:38:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.835+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c04c710 con 0x7fa28c1002b0 2024-04-12T13:38:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.836+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa27400bbf0 con 0x7fa28c1002b0 2024-04-12T13:38:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.836+0000 7fa283400700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 0x7fa27006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.837+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa2740882d0 con 0x7fa28c1002b0 2024-04-12T13:38:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.837+0000 7fa28b400700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 0x7fa27006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.837+0000 7fa28b400700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 0x7fa27006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa27c004990 tx=0x7fa27c009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:04.841+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa2740583b0 con 0x7fa28c1002b0 2024-04-12T13:38:05.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.065+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa28c104590 con 0x7fa2700692a0 2024-04-12T13:38:05.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.068+0000 7fa283400700 1 -- 172.21.15.60:0/2779870660 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fa28c104590 con 0x7fa2700692a0 2024-04-12T13:38:05.070 INFO:teuthology.orchestra.run.smithi060.stdout:HOST ADDR LABELS STATUS 2024-04-12T13:38:05.070 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 172.21.15.60 2024-04-12T13:38:05.071 INFO:teuthology.orchestra.run.smithi060.stdout:smithi110 172.21.15.110 2024-04-12T13:38:05.071 INFO:teuthology.orchestra.run.smithi060.stdout:2 hosts in cluster 2024-04-12T13:38:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 msgr2=0x7fa27006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 0x7fa27006b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa27c004990 tx=0x7fa27c009ee0 comp rx=0 tx=0).stop 2024-04-12T13:38:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 msgr2=0x7fa28c110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b3b0 tx=0x7fa274009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 shutdown_connections 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fa2700692a0 0x7fa27006b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa28c0ff000 0x7fa28c10fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 --2- 172.21.15.60:0/2779870660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1002b0 0x7fa28c110050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 >> 172.21.15.60:0/2779870660 conn(0x7fa28c0fa950 msgr2=0x7fa28c0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 shutdown_connections 2024-04-12T13:38:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:05.071+0000 7fa292000700 1 -- 172.21.15.60:0/2779870660 wait complete. 2024-04-12T13:38:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:05 smithi060 ceph-mon[29097]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:05 smithi110 ceph-mon[36055]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:05.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-12T13:38:06.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:06 smithi060 ceph-mon[29097]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:06.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:06 smithi110 ceph-mon[36055]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:07.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:07 smithi060 ceph-mon[29097]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:07 smithi110 ceph-mon[36055]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 -- 172.21.15.60:0/2336653323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fded0 msgr2=0x7f7ab40fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/2336653323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fded0 0x7f7ab40fe340 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c004940 tx=0x7f7a9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 -- 172.21.15.60:0/2336653323 shutdown_connections 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/2336653323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fded0 0x7f7ab40fe340 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/2336653323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fcc20 0x7f7ab40fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 -- 172.21.15.60:0/2336653323 >> 172.21.15.60:0/2336653323 conn(0x7f7ab40f83a0 msgr2=0x7f7ab40fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 -- 172.21.15.60:0/2336653323 shutdown_connections 2024-04-12T13:38:08.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.656+0000 7f7ab9a00700 1 -- 172.21.15.60:0/2336653323 wait complete. 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.657+0000 7f7ab9a00700 1 Processor -- start 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.657+0000 7f7ab9a00700 1 -- start start 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab9a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab9a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fded0 0x7f7ab410ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab9a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4110590 con 0x7f7ab40fcc20 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab9a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4110de0 con 0x7f7ab40fded0 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:08.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45242/0 (socket says 172.21.15.60:45242) 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab3e00700 1 -- 172.21.15.60:0/3590273772 learned_addr learned my addr 172.21.15.60:0/3590273772 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.658+0000 7f7ab3400700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fded0 0x7f7ab410ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7ab3e00700 1 -- 172.21.15.60:0/3590273772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fded0 msgr2=0x7f7ab410ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7ab3e00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fded0 0x7f7ab410ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7ab3e00700 1 -- 172.21.15.60:0/3590273772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c005040 con 0x7f7ab40fcc20 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7ab3e00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c830 tx=0x7f7aa4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa400a760 con 0x7f7ab40fcc20 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aa400ad90 con 0x7f7ab40fcc20 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa40113a0 con 0x7f7ab40fcc20 2024-04-12T13:38:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.659+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab41110c0 con 0x7f7ab40fcc20 2024-04-12T13:38:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.660+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4111600 con 0x7f7ab40fcc20 2024-04-12T13:38:08.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.661+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4101860 con 0x7f7ab40fcc20 2024-04-12T13:38:08.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.662+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7aa4012400 con 0x7f7ab40fcc20 2024-04-12T13:38:08.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.662+0000 7f7aabe00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 0x7f7a9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:08.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.663+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7aa4086ed0 con 0x7f7ab40fcc20 2024-04-12T13:38:08.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.663+0000 7f7ab3400700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 0x7f7a9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:08.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.663+0000 7f7ab3400700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 0x7f7a9806b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c004f90 tx=0x7f7a9c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:08.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.667+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7aa4056fb0 con 0x7f7ab40fcc20 2024-04-12T13:38:08.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.892+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ab41118d0 con 0x7f7a980692a0 2024-04-12T13:38:08.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.896+0000 7f7aabe00700 1 -- 172.21.15.60:0/3590273772 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7ab41118d0 con 0x7f7a980692a0 2024-04-12T13:38:08.899 INFO:teuthology.orchestra.run.smithi060.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-12T13:38:08.899 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-12T13:38:08.899 INFO:teuthology.orchestra.run.smithi060.stdout:smithi110 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002T480DGN 447G No 87s ago Has a FileSystem, LVM detected 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 msgr2=0x7f7a9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 0x7f7a9806b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c004f90 tx=0x7f7a9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 msgr2=0x7f7ab410fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c830 tx=0x7f7aa4004470 comp rx=0 tx=0).stop 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 shutdown_connections 2024-04-12T13:38:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f7a980692a0 0x7f7a9806b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab40fcc20 0x7f7ab410fa50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 --2- 172.21.15.60:0/3590273772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ab40fded0 0x7f7ab410ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.900+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 >> 172.21.15.60:0/3590273772 conn(0x7f7ab40f83a0 msgr2=0x7f7ab40f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.901+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 shutdown_connections 2024-04-12T13:38:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:08.901+0000 7f7ab9a00700 1 -- 172.21.15.60:0/3590273772 wait complete. 2024-04-12T13:38:09.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:09 smithi060 ceph-mon[29097]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:09 smithi110 ceph-mon[36055]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:09.828 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:38:09.840 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:38:09.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-12T13:38:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:10 smithi060 ceph-mon[29097]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:10.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:10 smithi110 ceph-mon[36055]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:11.394 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:11 smithi060 ceph-mon[29097]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:11 smithi110 ceph-mon[36055]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:12.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.642+0000 7fe436600700 1 -- 172.21.15.60:0/502246337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4300fffd0 msgr2=0x7fe4301023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:12.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.642+0000 7fe436600700 1 --2- 172.21.15.60:0/502246337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4300fffd0 0x7fe4301023b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe41c004940 tx=0x7fe41c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:12.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 -- 172.21.15.60:0/502246337 shutdown_connections 2024-04-12T13:38:12.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 --2- 172.21.15.60:0/502246337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4300fffd0 0x7fe4301023b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 --2- 172.21.15.60:0/502246337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe430066290 0x7fe4300ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 -- 172.21.15.60:0/502246337 >> 172.21.15.60:0/502246337 conn(0x7fe4300f74c0 msgr2=0x7fe4300f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 -- 172.21.15.60:0/502246337 shutdown_connections 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.643+0000 7fe436600700 1 -- 172.21.15.60:0/502246337 wait complete. 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 Processor -- start 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 -- start start 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4300fffd0 0x7fe430110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430110790 con 0x7fe430066290 2024-04-12T13:38:12.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe436600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430110fe0 con 0x7fe4300fffd0 2024-04-12T13:38:12.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe42f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:12.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.644+0000 7fe42f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42512/0 (socket says 172.21.15.60:42512) 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42f400700 1 -- 172.21.15.60:0/3295431595 learned_addr learned my addr 172.21.15.60:0/3295431595 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42ea00700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4300fffd0 0x7fe430110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42f400700 1 -- 172.21.15.60:0/3295431595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4300fffd0 msgr2=0x7fe430110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42f400700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4300fffd0 0x7fe430110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42f400700 1 -- 172.21.15.60:0/3295431595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c005040 con 0x7fe430066290 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.645+0000 7fe42f400700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe420002a50 tx=0x7fe420004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.646+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe420007cc0 con 0x7fe430066290 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.646+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe42000f040 con 0x7fe430066290 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.646+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4301112c0 con 0x7fe430066290 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.646+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42000da40 con 0x7fe430066290 2024-04-12T13:38:12.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.646+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430111800 con 0x7fe430066290 2024-04-12T13:38:12.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.647+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43005f5f0 con 0x7fe430066290 2024-04-12T13:38:12.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.648+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe4200097c0 con 0x7fe430066290 2024-04-12T13:38:12.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.649+0000 7fe427400700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 0x7fe41406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:12.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.649+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe420086bf0 con 0x7fe430066290 2024-04-12T13:38:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.650+0000 7fe42ea00700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 0x7fe41406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:12.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.650+0000 7fe42ea00700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 0x7fe41406b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b3b0 tx=0x7fe41c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:12.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.654+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe4200569e0 con 0x7fe430066290 2024-04-12T13:38:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:12.907+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe430111c00 con 0x7fe4140692b0 2024-04-12T13:38:13.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:13 smithi060 ceph-mon[29097]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:13 smithi110 ceph-mon[36055]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.601+0000 7fe427400700 1 -- 172.21.15.60:0/3295431595 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe430111c00 con 0x7fe4140692b0 2024-04-12T13:38:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 msgr2=0x7fe41406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 0x7fe41406b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b3b0 tx=0x7fe41c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 msgr2=0x7fe43010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe420002a50 tx=0x7fe420004600 comp rx=0 tx=0).stop 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 shutdown_connections 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe4140692b0 0x7fe41406b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe430066290 0x7fe43010fc50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 --2- 172.21.15.60:0/3295431595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4300fffd0 0x7fe430110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 >> 172.21.15.60:0/3295431595 conn(0x7fe4300f74c0 msgr2=0x7fe4300fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 shutdown_connections 2024-04-12T13:38:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:14.608+0000 7fe436600700 1 -- 172.21.15.60:0/3295431595 wait complete. 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: osdmap e42: 6 total, 6 up, 6 in 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-mon[29097]: pgmap v217: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:14 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[29092]: 2024-04-12T13:38:14.569+0000 7f6d74800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:38:14.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:38:14.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-12T13:38:14.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-12T13:38:14.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: osdmap e42: 6 total, 6 up, 6 in 2024-04-12T13:38:14.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-12T13:38:14.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:14 smithi110 ceph-mon[36055]: pgmap v217: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:15.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: osdmap e43: 6 total, 6 up, 6 in 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: osdmap e44: 6 total, 6 up, 6 in 2024-04-12T13:38:15.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: fsmap cephfs:0 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: Saving service mds.cephfs spec with placement count:4 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: Deploying daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: osdmap e43: 6 total, 6 up, 6 in 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: osdmap e44: 6 total, 6 up, 6 in 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: fsmap cephfs:0 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: Saving service mds.cephfs spec with placement count:4 2024-04-12T13:38:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: Deploying daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:15.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:16.909 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:16 smithi060 ceph-mon[29097]: osdmap e45: 6 total, 6 up, 6 in 2024-04-12T13:38:16.909 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:16 smithi060 ceph-mon[29097]: pgmap v221: 65 pgs: 5 creating+peering, 8 active+clean, 52 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:16.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:16 smithi110 ceph-mon[36055]: osdmap e45: 6 total, 6 up, 6 in 2024-04-12T13:38:16.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:16 smithi110 ceph-mon[36055]: pgmap v221: 65 pgs: 5 creating+peering, 8 active+clean, 52 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:17 smithi060 ceph-mon[29097]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-12T13:38:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:17 smithi060 ceph-mon[29097]: osdmap e46: 6 total, 6 up, 6 in 2024-04-12T13:38:17.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:17 smithi110 ceph-mon[36055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-12T13:38:17.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:17 smithi110 ceph-mon[36055]: osdmap e46: 6 total, 6 up, 6 in 2024-04-12T13:38:18.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:18 smithi060 ceph-mon[29097]: pgmap v223: 65 pgs: 3 creating+activating, 5 creating+peering, 39 active+clean, 18 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:18.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:18 smithi110 ceph-mon[36055]: pgmap v223: 65 pgs: 3 creating+activating, 5 creating+peering, 39 active+clean, 18 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:19.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 -- 172.21.15.60:0/1324506962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80662f0 msgr2=0x7f18f80ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 --2- 172.21.15.60:0/1324506962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80662f0 0x7f18f80ffa30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f18e8004940 tx=0x7f18e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 -- 172.21.15.60:0/1324506962 shutdown_connections 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 --2- 172.21.15.60:0/1324506962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80fff70 0x7f18f8102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 --2- 172.21.15.60:0/1324506962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80662f0 0x7f18f80ffa30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.569+0000 7f18fec00700 1 -- 172.21.15.60:0/1324506962 >> 172.21.15.60:0/1324506962 conn(0x7f18f80f74c0 msgr2=0x7f18f80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.570+0000 7f18fec00700 1 -- 172.21.15.60:0/1324506962 shutdown_connections 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.570+0000 7f18fec00700 1 -- 172.21.15.60:0/1324506962 wait complete. 2024-04-12T13:38:19.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.570+0000 7f18fec00700 1 Processor -- start 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18fec00700 1 -- start start 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18fec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80662f0 0x7f18f810fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18fec00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18fec00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81107c0 con 0x7f18f80fff70 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18fec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8110fc0 con 0x7f18f80662f0 2024-04-12T13:38:19.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18efe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42624/0 (socket says 172.21.15.60:42624) 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.571+0000 7f18efe00700 1 -- 172.21.15.60:0/1035811629 learned_addr learned my addr 172.21.15.60:0/1035811629 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18f7e00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80662f0 0x7f18f810fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18efe00700 1 -- 172.21.15.60:0/1035811629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80662f0 msgr2=0x7f18f810fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18efe00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80662f0 0x7f18f810fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18efe00700 1 -- 172.21.15.60:0/1035811629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8005040 con 0x7f18f80fff70 2024-04-12T13:38:19.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18efe00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18e000eb70 tx=0x7f18e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.572+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e0007cc0 con 0x7f18f80fff70 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.573+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18e000f040 con 0x7f18f80fff70 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.573+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8111240 con 0x7f18f80fff70 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.573+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e000ca90 con 0x7f18f80fff70 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.573+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f8111780 con 0x7f18f80fff70 2024-04-12T13:38:19.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.574+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f805f5f0 con 0x7f18f80fff70 2024-04-12T13:38:19.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.575+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f18e000cbf0 con 0x7f18f80fff70 2024-04-12T13:38:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.576+0000 7f18f4c00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 0x7f18dc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.576+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f18e0086dd0 con 0x7f18f80fff70 2024-04-12T13:38:19.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.576+0000 7f18f7e00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 0x7f18dc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:19.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.577+0000 7f18f7e00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 0x7f18dc06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18e8013870 tx=0x7f18e8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:19.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.581+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f18e0056a70 con 0x7f18f80fff70 2024-04-12T13:38:19.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.868+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18f804bed0 con 0x7f18f80fff70 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.869+0000 7f18f4c00700 1 -- 172.21.15.60:0/1035811629 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1247 (secure 0 0 0) 0x7f18e0056600 con 0x7f18f80fff70 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:e4 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:38:19.871 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 4 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:19.611265+0000 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:38:19.872 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 0 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:creating seq 1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:19.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 msgr2=0x7f18dc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 0x7f18dc06b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18e8013870 tx=0x7f18e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 msgr2=0x7f18f81101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18e000eb70 tx=0x7f18e000b040 comp rx=0 tx=0).stop 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 shutdown_connections 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f18dc0692b0 0x7f18dc06b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18f80662f0 0x7f18f810fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 --2- 172.21.15.60:0/1035811629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18f80fff70 0x7f18f81101c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.872+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 >> 172.21.15.60:0/1035811629 conn(0x7f18f80f74c0 msgr2=0x7f18f80fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.873+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 shutdown_connections 2024-04-12T13:38:19.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:19.873+0000 7f18fec00700 1 -- 172.21.15.60:0/1035811629 wait complete. 2024-04-12T13:38:19.875 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 4 2024-04-12T13:38:20.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: Deploying daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:boot 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: daemon mds.cephfs.smithi060.mwwohl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: Cluster is now healthy 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: fsmap cephfs:0 1 up:standby 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:creating} 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: daemon mds.cephfs.smithi060.mwwohl is now active in filesystem cephfs as rank 0 2024-04-12T13:38:20.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1035811629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:38:20.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:20 smithi110 ceph-mon[36055]: pgmap v224: 65 pgs: 3 creating+activating, 5 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: Deploying daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:boot 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: daemon mds.cephfs.smithi060.mwwohl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: Cluster is now healthy 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: fsmap cephfs:0 1 up:standby 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:creating} 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: daemon mds.cephfs.smithi060.mwwohl is now active in filesystem cephfs as rank 0 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1035811629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:38:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:20 smithi060 ceph-mon[29097]: pgmap v224: 65 pgs: 3 creating+activating, 5 creating+peering, 57 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:20.820 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:38:20.830 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:38:20.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-12T13:38:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:21.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:21 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:active 2024-04-12T13:38:21.755 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:21 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2024-04-12T13:38:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:21 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:active 2024-04-12T13:38:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:21 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2024-04-12T13:38:22.861 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:22 smithi060 ceph-mon[29097]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 275 B/s wr, 0 op/s 2024-04-12T13:38:22.898 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:22 smithi110 ceph-mon[36055]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 275 B/s wr, 0 op/s 2024-04-12T13:38:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 -- 172.21.15.60:0/1126257003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 msgr2=0x7fe5a40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 --2- 172.21.15.60:0/1126257003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a40fe550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe590004940 tx=0x7fe590009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 -- 172.21.15.60:0/1126257003 shutdown_connections 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 --2- 172.21.15.60:0/1126257003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a40fe550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 --2- 172.21.15.60:0/1126257003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 0x7fe5a40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 -- 172.21.15.60:0/1126257003 >> 172.21.15.60:0/1126257003 conn(0x7fe5a40f8530 msgr2=0x7fe5a40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.380+0000 7fe5aa000700 1 -- 172.21.15.60:0/1126257003 shutdown_connections 2024-04-12T13:38:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.381+0000 7fe5aa000700 1 -- 172.21.15.60:0/1126257003 wait complete. 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.381+0000 7fe5aa000700 1 Processor -- start 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5aa000700 1 -- start start 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5aa000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 0x7fe5a410fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5aa000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5aa000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41107a0 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5aa000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4110ff0 con 0x7fe5a40fcef0 2024-04-12T13:38:23.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5a2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5a2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42628/0 (socket says 172.21.15.60:42628) 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.382+0000 7fe5a2a00700 1 -- 172.21.15.60:0/2346331131 learned_addr learned my addr 172.21.15.60:0/2346331131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5a3400700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 0x7fe5a410fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5a2a00700 1 -- 172.21.15.60:0/2346331131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 msgr2=0x7fe5a410fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5a2a00700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 0x7fe5a410fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5a2a00700 1 -- 172.21.15.60:0/2346331131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590005040 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5a2a00700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe59000b970 tx=0x7fe590009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59000e040 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe590004290 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4111270 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.383+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe59001c630 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.384+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a41117b0 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.385+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a4101a70 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.386+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe5900139f0 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.387+0000 7fe59b400700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 0x7fe58806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.387+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe590088580 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.387+0000 7fe5a3400700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 0x7fe58806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:23.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.388+0000 7fe5a3400700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 0x7fe58806b760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe594009fd0 tx=0x7fe594009f00 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.392+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe5900582a0 con 0x7fe5a40fe0e0 2024-04-12T13:38:23.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:23.676+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe5a4111a90 con 0x7fe5a40fe0e0 2024-04-12T13:38:24.317 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.317 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: Deploying daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:boot 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:24.318 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:24 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2346331131' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: Deploying daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:boot 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:24 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2346331131' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-12T13:38:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.660+0000 7fe59b400700 1 -- 172.21.15.60:0/2346331131 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe590057e30 con 0x7fe5a40fe0e0 2024-04-12T13:38:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.663+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 msgr2=0x7fe58806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.663+0000 7fe5aa000700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 0x7fe58806b760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe594009fd0 tx=0x7fe594009f00 comp rx=0 tx=0).stop 2024-04-12T13:38:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.663+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 msgr2=0x7fe5a41101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.663+0000 7fe5aa000700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe59000b970 tx=0x7fe590009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 shutdown_connections 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fe5880692b0 0x7fe58806b760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5a40fcef0 0x7fe5a410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 --2- 172.21.15.60:0/2346331131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a40fe0e0 0x7fe5a41101a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 >> 172.21.15.60:0/2346331131 conn(0x7fe5a40f8530 msgr2=0x7fe5a40f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 shutdown_connections 2024-04-12T13:38:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:24.664+0000 7fe5aa000700 1 -- 172.21.15.60:0/2346331131 wait complete. 2024-04-12T13:38:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:25 smithi060 ceph-mon[29097]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-12T13:38:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:25 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2346331131' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-12T13:38:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:25 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:25 smithi110 ceph-mon[36055]: pgmap v226: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-12T13:38:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:25 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2346331131' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-12T13:38:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:25 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 1 up:standby 2024-04-12T13:38:26.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:38:26.151 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:38:26.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-12T13:38:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:27.408 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:27 smithi060 ceph-mon[29097]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-12T13:38:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:27 smithi110 ceph-mon[36055]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-12T13:38:28.349 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:boot 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2 up:standby 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:28.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:28 smithi110 ceph-mon[36055]: Deploying daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:boot 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2 up:standby 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:28.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:28 smithi060 ceph-mon[29097]: Deploying daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 -- 172.21.15.60:0/3750324994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fcc20 msgr2=0x7fb60c0fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 --2- 172.21.15.60:0/3750324994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fcc20 0x7fb60c0fd030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb600004940 tx=0x7fb600009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 -- 172.21.15.60:0/3750324994 shutdown_connections 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 --2- 172.21.15.60:0/3750324994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fded0 0x7fb60c0fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 --2- 172.21.15.60:0/3750324994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fcc20 0x7fb60c0fd030 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 -- 172.21.15.60:0/3750324994 >> 172.21.15.60:0/3750324994 conn(0x7fb60c0f83a0 msgr2=0x7fb60c0fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 -- 172.21.15.60:0/3750324994 shutdown_connections 2024-04-12T13:38:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.359+0000 7fb612800700 1 -- 172.21.15.60:0/3750324994 wait complete. 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.360+0000 7fb612800700 1 Processor -- start 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.360+0000 7fb612800700 1 -- start start 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.360+0000 7fb612800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 0x7fb60c10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb612800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb612800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c1105a0 con 0x7fb60c0fded0 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb612800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c110df0 con 0x7fb60c0fcc20 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44566/0 (socket says 172.21.15.60:44566) 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 -- 172.21.15.60:0/2396156909 learned_addr learned my addr 172.21.15.60:0/2396156909 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb611400700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 0x7fb60c10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 -- 172.21.15.60:0/2396156909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 msgr2=0x7fb60c10fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 0x7fb60c10fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb610a00700 1 -- 172.21.15.60:0/2396156909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600005040 con 0x7fb60c0fded0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.361+0000 7fb611400700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 0x7fb60c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb610a00700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8002a50 tx=0x7fb5f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f8007cc0 con 0x7fb60c0fded0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5f800f040 con 0x7fb60c0fded0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c1110d0 con 0x7fb60c0fded0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f8009640 con 0x7fb60c0fded0 2024-04-12T13:38:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.362+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c111610 con 0x7fb60c0fded0 2024-04-12T13:38:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.364+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c101860 con 0x7fb60c0fded0 2024-04-12T13:38:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.365+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb5f80097a0 con 0x7fb60c0fded0 2024-04-12T13:38:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.366+0000 7fb609600700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.366+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb5f8086f60 con 0x7fb60c0fded0 2024-04-12T13:38:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.366+0000 7fb611400700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:29.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.367+0000 7fb611400700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 0x7fb5f406b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb60000b3b0 tx=0x7fb600009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:29.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.370+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb5f8056c80 con 0x7fb60c0fded0 2024-04-12T13:38:29.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:29.643+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb60c105710 con 0x7fb60c0fded0 2024-04-12T13:38:29.645 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:29 smithi060 ceph-mon[29097]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:29 smithi110 ceph-mon[36055]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.332+0000 7fb609600700 1 -- 172.21.15.60:0/2396156909 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb5f8056810 con 0x7fb60c0fded0 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 msgr2=0x7fb5f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 0x7fb5f406b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb60000b3b0 tx=0x7fb600009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 msgr2=0x7fb60c10ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8002a50 tx=0x7fb5f80046b0 comp rx=0 tx=0).stop 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 shutdown_connections 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb5f40692a0 0x7fb5f406b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb60c0fcc20 0x7fb60c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 --2- 172.21.15.60:0/2396156909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c0fded0 0x7fb60c10ffa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.336+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 >> 172.21.15.60:0/2396156909 conn(0x7fb60c0f83a0 msgr2=0x7fb60c0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.337+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 shutdown_connections 2024-04-12T13:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:30.337+0000 7fb612800700 1 -- 172.21.15.60:0/2396156909 wait complete. 2024-04-12T13:38:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:30 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2396156909' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-12T13:38:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:30 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2396156909' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-12T13:38:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.129 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:38:31.139 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:38:31.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-12T13:38:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:31.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:31.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2396156909' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2 up:standby 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2396156909' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 2 up:standby 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:32 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:boot 2024-04-12T13:38:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:32 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:38:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:32 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:32 smithi060 ceph-mon[29097]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:32.690 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:32 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:boot 2024-04-12T13:38:32.690 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:32 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:32.690 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:38:32.690 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:32 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:32.690 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:32 smithi110 ceph-mon[36055]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T13:38:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:33 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:active 2024-04-12T13:38:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:33 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:33 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] up:active 2024-04-12T13:38:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:33 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 -- 172.21.15.60:0/2949650846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 msgr2=0x7fda9c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 --2- 172.21.15.60:0/2949650846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c0703b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fda8c004940 tx=0x7fda8c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 -- 172.21.15.60:0/2949650846 shutdown_connections 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 --2- 172.21.15.60:0/2949650846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 0x7fda9c070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 --2- 172.21.15.60:0/2949650846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c0703b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 -- 172.21.15.60:0/2949650846 >> 172.21.15.60:0/2949650846 conn(0x7fda9c0f83d0 msgr2=0x7fda9c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 -- 172.21.15.60:0/2949650846 shutdown_connections 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.222+0000 7fda9be00700 1 -- 172.21.15.60:0/2949650846 wait complete. 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.223+0000 7fda9be00700 1 Processor -- start 2024-04-12T13:38:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.223+0000 7fda9be00700 1 -- start start 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 0x7fda9c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9be00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c115150 con 0x7fda9c071ea0 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1152c0 con 0x7fda9c0708f0 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44578/0 (socket says 172.21.15.60:44578) 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9a000700 1 -- 172.21.15.60:0/3838451944 learned_addr learned my addr 172.21.15.60:0/3838451944 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.224+0000 7fda9aa00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 0x7fda9c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:34.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9a000700 1 -- 172.21.15.60:0/3838451944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 msgr2=0x7fda9c113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9a000700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 0x7fda9c113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9a000700 1 -- 172.21.15.60:0/3838451944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c005040 con 0x7fda9c071ea0 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9a000700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda8800eb40 tx=0x7fda8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda88007cc0 con 0x7fda9c071ea0 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda8800f040 con 0x7fda9c071ea0 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8800ca10 con 0x7fda9c071ea0 2024-04-12T13:38:34.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c1154e0 con 0x7fda9c071ea0 2024-04-12T13:38:34.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.225+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c115aa0 con 0x7fda9c071ea0 2024-04-12T13:38:34.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.227+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c05f5f0 con 0x7fda9c071ea0 2024-04-12T13:38:34.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.228+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fda8800cb70 con 0x7fda9c071ea0 2024-04-12T13:38:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.229+0000 7fda92a00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 0x7fda8006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.229+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fda88086f70 con 0x7fda9c071ea0 2024-04-12T13:38:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.230+0000 7fda9aa00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 0x7fda8006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.230+0000 7fda9aa00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 0x7fda8006b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda9c113c10 tx=0x7fda8c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:34.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.233+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fda88053330 con 0x7fda9c071ea0 2024-04-12T13:38:34.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:34.517+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fda9c04bed0 con 0x7fda9c071ea0 2024-04-12T13:38:34.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:34 smithi060 ceph-mon[29097]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-12T13:38:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:34 smithi110 ceph-mon[36055]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-04-12T13:38:35.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.361+0000 7fda92a00700 1 -- 172.21.15.60:0/3838451944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7fda88056950 con 0x7fda9c071ea0 2024-04-12T13:38:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 msgr2=0x7fda8006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 0x7fda8006b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda9c113c10 tx=0x7fda8c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 msgr2=0x7fda9c1143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:35.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda8800eb40 tx=0x7fda8800b040 comp rx=0 tx=0).stop 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 shutdown_connections 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fda800692b0 0x7fda8006b760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda9c0708f0 0x7fda9c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 --2- 172.21.15.60:0/3838451944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda9c071ea0 0x7fda9c1143e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 >> 172.21.15.60:0/3838451944 conn(0x7fda9c0f83d0 msgr2=0x7fda9c0f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 shutdown_connections 2024-04-12T13:38:35.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:35.364+0000 7fda9be00700 1 -- 172.21.15.60:0/3838451944 wait complete. 2024-04-12T13:38:35.367 INFO:teuthology.orchestra.run.smithi060.stderr:inline data disabled 2024-04-12T13:38:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:35 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3838451944' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-12T13:38:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:35 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:35 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3838451944' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-12T13:38:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:35 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:36.579 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:38:36.589 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:38:36.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3838451944' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:standby 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:standby 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:standby 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:36.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:36 smithi060 ceph-mon[29097]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T13:38:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3838451944' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-12T13:38:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:standby 2024-04-12T13:38:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:standby 2024-04-12T13:38:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:standby 2024-04-12T13:38:36.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:38:36.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:36 smithi110 ceph-mon[36055]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T13:38:37.095 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:39.325 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:39 smithi060 ceph-mon[29097]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:39 smithi110 ceph-mon[36055]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.483+0000 7fd23d400700 1 -- 172.21.15.60:0/3909661530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd238066ae0 msgr2=0x7fd2380ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:40.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.483+0000 7fd23d400700 1 --2- 172.21.15.60:0/3909661530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd238066ae0 0x7fd2380ffa80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd228004940 tx=0x7fd228009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 -- 172.21.15.60:0/3909661530 shutdown_connections 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 --2- 172.21.15.60:0/3909661530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2380fffc0 0x7fd2381023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 --2- 172.21.15.60:0/3909661530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd238066ae0 0x7fd2380ffa80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 -- 172.21.15.60:0/3909661530 >> 172.21.15.60:0/3909661530 conn(0x7fd2380f7450 msgr2=0x7fd2380f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 -- 172.21.15.60:0/3909661530 shutdown_connections 2024-04-12T13:38:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.484+0000 7fd23d400700 1 -- 172.21.15.60:0/3909661530 wait complete. 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.485+0000 7fd23d400700 1 Processor -- start 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.485+0000 7fd23d400700 1 -- start start 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd23d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238066ae0 0x7fd23810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd23d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd23d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238110790 con 0x7fd2380fffc0 2024-04-12T13:38:40.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd23d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238110fe0 con 0x7fd238066ae0 2024-04-12T13:38:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd235e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd235e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45370/0 (socket says 172.21.15.60:45370) 2024-04-12T13:38:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd235e00700 1 -- 172.21.15.60:0/1209519052 learned_addr learned my addr 172.21.15.60:0/1209519052 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.486+0000 7fd236800700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238066ae0 0x7fd23810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:40.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd235e00700 1 -- 172.21.15.60:0/1209519052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238066ae0 msgr2=0x7fd23810fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd235e00700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238066ae0 0x7fd23810fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd235e00700 1 -- 172.21.15.60:0/1209519052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228005040 con 0x7fd2380fffc0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd235e00700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd224002a50 tx=0x7fd2240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd224007cc0 con 0x7fd2380fffc0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd22400f040 con 0x7fd2380fffc0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd224009640 con 0x7fd2380fffc0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.487+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2381112c0 con 0x7fd2380fffc0 2024-04-12T13:38:40.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.488+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd238111800 con 0x7fd2380fffc0 2024-04-12T13:38:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.489+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23805f5f0 con 0x7fd2380fffc0 2024-04-12T13:38:40.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.490+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd2240097c0 con 0x7fd2380fffc0 2024-04-12T13:38:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.491+0000 7fd22ea00700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 0x7fd21c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.491+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd224086ff0 con 0x7fd2380fffc0 2024-04-12T13:38:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.491+0000 7fd236800700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 0x7fd21c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:40.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.492+0000 7fd236800700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 0x7fd21c06b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd228009fd0 tx=0x7fd228009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:40.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.496+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd224056cf0 con 0x7fd2380fffc0 2024-04-12T13:38:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.787+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd2381058e0 con 0x7fd2380fffc0 2024-04-12T13:38:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.787+0000 7fd22ea00700 1 -- 172.21.15.60:0/1209519052 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7fd224056880 con 0x7fd2380fffc0 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:38:40.789 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:38:40.790 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:38:40.791 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 msgr2=0x7fd21c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 0x7fd21c06b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd228009fd0 tx=0x7fd228009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 msgr2=0x7fd238110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd224002a50 tx=0x7fd2240046b0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 shutdown_connections 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd21c0692b0 0x7fd21c06b760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238066ae0 0x7fd23810fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 --2- 172.21.15.60:0/1209519052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2380fffc0 0x7fd238110190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:40.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.791+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 >> 172.21.15.60:0/1209519052 conn(0x7fd2380f7450 msgr2=0x7fd2380fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:40.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.792+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 shutdown_connections 2024-04-12T13:38:40.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:40.792+0000 7fd23d400700 1 -- 172.21.15.60:0/1209519052 wait complete. 2024-04-12T13:38:40.794 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:38:41.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:41.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1209519052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:38:41.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:41.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:41.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:41 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1209519052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:38:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:41 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:41.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-12T13:38:42.161 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:42 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:42.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:42 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:38:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:43.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:43 smithi060 ceph-mon[29097]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:43 smithi110 ceph-mon[36055]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:45.155 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:45 smithi060 ceph-mon[29097]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:45.155 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:45.155 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:45.155 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 -- 172.21.15.60:0/2345696560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c071e20 msgr2=0x7f0c5c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 --2- 172.21.15.60:0/2345696560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c071e20 0x7f0c5c070330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c004940 tx=0x7f0c4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 -- 172.21.15.60:0/2345696560 shutdown_connections 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 --2- 172.21.15.60:0/2345696560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c070870 0x7f0c5c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 --2- 172.21.15.60:0/2345696560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c071e20 0x7f0c5c070330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 -- 172.21.15.60:0/2345696560 >> 172.21.15.60:0/2345696560 conn(0x7f0c5c0f8580 msgr2=0x7f0c5c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 -- 172.21.15.60:0/2345696560 shutdown_connections 2024-04-12T13:38:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.318+0000 7f0c62200700 1 -- 172.21.15.60:0/2345696560 wait complete. 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 Processor -- start 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 -- start start 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 0x7f0c5c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c1106e0 con 0x7f0c5c070870 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.319+0000 7f0c62200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c110850 con 0x7f0c5c071e20 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45374/0 (socket says 172.21.15.60:45374) 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 -- 172.21.15.60:0/3032475794 learned_addr learned my addr 172.21.15.60:0/3032475794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5aa00700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 0x7f0c5c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 -- 172.21.15.60:0/3032475794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 msgr2=0x7f0c5c1100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 0x7f0c5c1100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 -- 172.21.15.60:0/3032475794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c005040 con 0x7f0c5c070870 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5aa00700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 0x7f0c5c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.320+0000 7f0c5b400700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00b970 tx=0x7f0c4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:45.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.321+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c00e040 con 0x7f0c5c070870 2024-04-12T13:38:45.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.321+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c4c004290 con 0x7f0c5c070870 2024-04-12T13:38:45.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.321+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c01c630 con 0x7f0c5c070870 2024-04-12T13:38:45.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.321+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c115250 con 0x7f0c5c070870 2024-04-12T13:38:45.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.321+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c115810 con 0x7f0c5c070870 2024-04-12T13:38:45.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.322+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c04c710 con 0x7f0c5c070870 2024-04-12T13:38:45.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.323+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0c4c00bbf0 con 0x7f0c5c070870 2024-04-12T13:38:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.325+0000 7f0c53400700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 0x7f0c4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.325+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c4c088460 con 0x7f0c5c070870 2024-04-12T13:38:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.325+0000 7f0c5aa00700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 0x7f0c4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.326+0000 7f0c5aa00700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 0x7f0c4006b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fd0 tx=0x7f0c48009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:45.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.330+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0c4c0582c0 con 0x7f0c5c070870 2024-04-12T13:38:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:45 smithi110 ceph-mon[36055]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:45.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:38:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.603+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c5c107ae0 con 0x7f0c5c070870 2024-04-12T13:38:45.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.603+0000 7f0c53400700 1 -- 172.21.15.60:0/3032475794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4689 (secure 0 0 0) 0x7f0c4c013e60 con 0x7f0c5c070870 2024-04-12T13:38:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 msgr2=0x7f0c4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 0x7f0c4006b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fd0 tx=0x7f0c48009ee0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 msgr2=0x7f0c5c10fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00b970 tx=0x7f0c4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 shutdown_connections 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0c400692a0 0x7f0c4006b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c5c070870 0x7f0c5c10fba0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 --2- 172.21.15.60:0/3032475794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c5c071e20 0x7f0c5c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.606+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 >> 172.21.15.60:0/3032475794 conn(0x7f0c5c0f8580 msgr2=0x7f0c5c0f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.607+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 shutdown_connections 2024-04-12T13:38:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:45.607+0000 7f0c62200700 1 -- 172.21.15.60:0/3032475794 wait complete. 2024-04-12T13:38:45.610 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:38:45.625 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:38:46.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:46 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3032475794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:38:46.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:46 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3032475794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:38:46.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-12T13:38:47.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:47 smithi060 ceph-mon[29097]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:47 smithi110 ceph-mon[36055]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:49.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:49 smithi060 ceph-mon[29097]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:49 smithi110 ceph-mon[36055]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 -- 172.21.15.60:0/851722479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 msgr2=0x7ff6d80fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 --2- 172.21.15.60:0/851722479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d80fd250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc004940 tx=0x7ff6cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 -- 172.21.15.60:0/851722479 shutdown_connections 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 --2- 172.21.15.60:0/851722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 0x7ff6d80fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 --2- 172.21.15.60:0/851722479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d80fd250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 -- 172.21.15.60:0/851722479 >> 172.21.15.60:0/851722479 conn(0x7ff6d80f8530 msgr2=0x7ff6d80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 -- 172.21.15.60:0/851722479 shutdown_connections 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.733+0000 7ff6e0200700 1 -- 172.21.15.60:0/851722479 wait complete. 2024-04-12T13:38:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.734+0000 7ff6e0200700 1 Processor -- start 2024-04-12T13:38:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.734+0000 7ff6e0200700 1 -- start start 2024-04-12T13:38:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6e0200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6e0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 0x7ff6d8110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6e0200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8110850 con 0x7ff6d80fce40 2024-04-12T13:38:50.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6e0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8110f90 con 0x7ff6d80fe040 2024-04-12T13:38:50.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6dd800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:50.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6dd800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57366/0 (socket says 172.21.15.60:57366) 2024-04-12T13:38:50.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.735+0000 7ff6dd800700 1 -- 172.21.15.60:0/242965955 learned_addr learned my addr 172.21.15.60:0/242965955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6dce00700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 0x7ff6d8110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6dd800700 1 -- 172.21.15.60:0/242965955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 msgr2=0x7ff6d8110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6dd800700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 0x7ff6d8110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6dd800700 1 -- 172.21.15.60:0/242965955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc005040 con 0x7ff6d80fce40 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6dd800700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b970 tx=0x7ff6cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6cc00e040 con 0x7ff6d80fce40 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6cc004290 con 0x7ff6d80fce40 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.736+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d8111210 con 0x7ff6d80fce40 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.737+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6cc01c630 con 0x7ff6d80fce40 2024-04-12T13:38:50.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.737+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d81117d0 con 0x7ff6d80fce40 2024-04-12T13:38:50.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.738+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d81019d0 con 0x7ff6d80fce40 2024-04-12T13:38:50.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.740+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff6cc00bbf0 con 0x7ff6d80fce40 2024-04-12T13:38:50.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.741+0000 7ff6d5600700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 0x7ff6c006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:50.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.741+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff6cc088ff0 con 0x7ff6d80fce40 2024-04-12T13:38:50.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.742+0000 7ff6dce00700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 0x7ff6c006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:50.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.742+0000 7ff6dce00700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 0x7ff6c006b760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4004990 tx=0x7ff6c4009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:50.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:50.744+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff6cc058df0 con 0x7ff6d80fce40 2024-04-12T13:38:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.084+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7ff6d805f5f0 con 0x7ff6d80fce40 2024-04-12T13:38:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.085+0000 7ff6d5600700 1 -- 172.21.15.60:0/242965955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7ff6cc013e60 con 0x7ff6d80fce40 2024-04-12T13:38:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 msgr2=0x7ff6c006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 0x7ff6c006b760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4004990 tx=0x7ff6c4009ee0 comp rx=0 tx=0).stop 2024-04-12T13:38:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 msgr2=0x7ff6d810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b970 tx=0x7ff6cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 shutdown_connections 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff6c00692b0 0x7ff6c006b760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d80fce40 0x7ff6d810fd10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 --2- 172.21.15.60:0/242965955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fe040 0x7ff6d8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 >> 172.21.15.60:0/242965955 conn(0x7ff6d80f8530 msgr2=0x7ff6d80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 shutdown_connections 2024-04-12T13:38:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:51.088+0000 7ff6e0200700 1 -- 172.21.15.60:0/242965955 wait complete. 2024-04-12T13:38:51.105 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:38:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:51 smithi060 ceph-mon[29097]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:51 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/242965955' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-12T13:38:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:51 smithi110 ceph-mon[36055]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:51.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:51 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/242965955' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-12T13:38:51.829 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-12T13:38:51.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T13:38:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 -- 172.21.15.60:0/447950273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c8066220 msgr2=0x7f65c80fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 --2- 172.21.15.60:0/447950273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c8066220 0x7f65c80fedb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f65b80048d0 tx=0x7f65b8009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 -- 172.21.15.60:0/447950273 shutdown_connections 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 --2- 172.21.15.60:0/447950273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c80ff2f0 0x7f65c81016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 --2- 172.21.15.60:0/447950273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c8066220 0x7f65c80fedb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 -- 172.21.15.60:0/447950273 >> 172.21.15.60:0/447950273 conn(0x7f65c80f6880 msgr2=0x7f65c80f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 -- 172.21.15.60:0/447950273 shutdown_connections 2024-04-12T13:38:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.069+0000 7f65cda00640 1 -- 172.21.15.60:0/447950273 wait complete. 2024-04-12T13:38:52.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 Processor -- start 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 -- start start 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c8066220 0x7f65c810ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c810fab0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.070+0000 7f65cda00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81144b0 con 0x7f65c8066220 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57382/0 (socket says 172.21.15.60:57382) 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 -- 172.21.15.60:0/3868616364 learned_addr learned my addr 172.21.15.60:0/3868616364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6a00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c8066220 0x7f65c810ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 -- 172.21.15.60:0/3868616364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c8066220 msgr2=0x7f65c810ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c8066220 0x7f65c810ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 -- 172.21.15.60:0/3868616364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8005040 con 0x7f65c80ff2f0 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.071+0000 7f65c6000640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c830 tx=0x7f65b4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.072+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b400a7d0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.072+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65b400ae00 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.072+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c8114650 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.072+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b40113a0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.072+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c8114b40 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.074+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c804bcc0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.074+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f65b4012400 con 0x7f65c80ff2f0 2024-04-12T13:38:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.076+0000 7f65bea00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 0x7f65ac06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.076+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f65b40872c0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.076+0000 7f65c6a00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 0x7f65ac06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.077+0000 7f65c6a00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 0x7f65ac06b6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65b802bda0 tx=0x7f65b8009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.081+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f65b4053690 con 0x7f65c80ff2f0 2024-04-12T13:38:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.285+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c8104cf0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.287+0000 7f65bea00640 1 -- 172.21.15.60:0/3868616364 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14266 (secure 0 0 0) 0x7f65b4056cb0 con 0x7f65c80ff2f0 2024-04-12T13:38:52.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:52.290 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":46,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:38:16.583240+0000","last_up_change":"2024-04-12T13:36:36.056011+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T13:38:13.485475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T13:38:14.117573+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6803","nonce":3056794206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6805","nonce":3056794206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6809","nonce":3056794206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3056794206},{"type":"v1","addr":"172.21.15.60:6807","nonce":3056794206}]},"public_addr":"172.21.15.60:6803/3056794206","cluster_addr":"172.21.15.60:6805/3056794206","heartbeat_back_addr":"172.21.15.60:6809/3056794206","heartbeat_front_addr":"172.21.15.60:6807/3056794206","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6811","nonce":2736571111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6813","nonce":2736571111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6817","nonce":2736571111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2736571111},{"type":"v1","addr":"172.21.15.60:6815","nonce":2736571111}]},"public_addr":"172.21.15.60:6811/2736571111","cluster_addr":"172.21.15.60:6813/2736571111","heartbeat_back_addr":"172.21.15.60:6817/2736571111","heartbeat_front_addr":"172.21.15.60:6815/2736571111","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6819","nonce":4220724942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6821","nonce":4220724942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6825","nonce":4220724942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4220724942},{"type":"v1","addr":"172.21.15.60:6823","nonce":4220724942}]},"public_addr":"172.21.15.60:6819/4220724942","cluster_addr":"172.21.15.60:6821/4220724942","heartbeat_back_addr":"172.21.15.60:6825/4220724942","heartbeat_front_addr":"172.21.15.60:6823/4220724942","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6801","nonce":552736156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6803","nonce":552736156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6807","nonce":552736156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":552736156},{"type":"v1","addr":"172.21.15.110:6805","nonce":552736156}]},"public_addr":"172.21.15.110:6801/552736156","cluster_addr":"172.21.15.110:6803/552736156","heartbeat_back_addr":"172.21.15.110:6807/552736156","heartbeat_front_addr":"172.21.15.110:6805/552736156","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6809","nonce":4183773215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6811","nonce":4183773215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6815","nonce":4183773215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4183773215},{"type":"v1","addr":"172.21.15.110:6813","nonce":4183773215}]},"public_addr":"172.21.15.110:6809/4183773215","cluster_addr":"172.21.15.110:6811/4183773215","heartbeat_back_addr":"172.21.15.110:6815/4183773215","heartbeat_front_addr":"172.21.15.110:6813/4183773215","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6817","nonce":2823620341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6819","nonce":2823620341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6823","nonce":2823620341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2823620341},{"type":"v1","addr":"172.21.15.110:6821","nonce":2823620341}]},"public_addr":"172.21.15.110:6817/2823620341","cluster_addr":"172.21.15.110:6819/2823620341","heartbeat_back_addr":"172.21.15.110:6823/2823620341","heartbeat_front_addr":"172.21.15.110:6821/2823620341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:38:52.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 msgr2=0x7f65ac06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 0x7f65ac06b6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65b802bda0 tx=0x7f65b8009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 msgr2=0x7f65c810f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c830 tx=0x7f65b4004430 comp rx=0 tx=0).stop 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 shutdown_connections 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f65ac069210 0x7f65ac06b6c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c80ff2f0 0x7f65c810f460 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 --2- 172.21.15.60:0/3868616364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65c8066220 0x7f65c810ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.289+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 >> 172.21.15.60:0/3868616364 conn(0x7f65c80f6880 msgr2=0x7f65c80fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.290+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 shutdown_connections 2024-04-12T13:38:52.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.290+0000 7f65cda00640 1 -- 172.21.15.60:0/3868616364 wait complete. 2024-04-12T13:38:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T13:34:54.600821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T13:38:13.485475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T13:38:14.117573+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T13:38:52.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T13:38:52.399 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:52.399 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:52.399 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:52 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:38:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:38:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:52 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 -- 172.21.15.60:0/4049176322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29680ff150 msgr2=0x7f2968101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 --2- 172.21.15.60:0/4049176322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29680ff150 0x7f2968101530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2950009c50 tx=0x7f2950004d10 comp rx=0 tx=0).stop 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 -- 172.21.15.60:0/4049176322 shutdown_connections 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 --2- 172.21.15.60:0/4049176322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29680ff150 0x7f2968101530 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 --2- 172.21.15.60:0/4049176322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2968066200 0x7f29680fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.539+0000 7f2967e00640 1 -- 172.21.15.60:0/4049176322 >> 172.21.15.60:0/4049176322 conn(0x7f29680f66e0 msgr2=0x7f29680f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.540+0000 7f2967e00640 1 -- 172.21.15.60:0/4049176322 shutdown_connections 2024-04-12T13:38:52.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.540+0000 7f2967e00640 1 -- 172.21.15.60:0/4049176322 wait complete. 2024-04-12T13:38:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.540+0000 7f2967e00640 1 Processor -- start 2024-04-12T13:38:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.540+0000 7f2967e00640 1 -- start start 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2967e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2967e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29680ff150 0x7f296810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2967e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296810d720 con 0x7f2968066200 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2967e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968112120 con 0x7f29680ff150 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57406/0 (socket says 172.21.15.60:57406) 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 -- 172.21.15.60:0/161554721 learned_addr learned my addr 172.21.15.60:0/161554721 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 -- 172.21.15.60:0/161554721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29680ff150 msgr2=0x7f296810d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29680ff150 0x7f296810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.541+0000 7f2966a00640 1 -- 172.21.15.60:0/161554721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500098b0 con 0x7f2968066200 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f2966a00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2958002840 tx=0x7f2958004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2958007c30 con 0x7f2968066200 2024-04-12T13:38:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f295800f040 con 0x7f2968066200 2024-04-12T13:38:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681122c0 con 0x7f2968066200 2024-04-12T13:38:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2958009590 con 0x7f2968066200 2024-04-12T13:38:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.542+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968112830 con 0x7f2968066200 2024-04-12T13:38:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.543+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296804bcc0 con 0x7f2968066200 2024-04-12T13:38:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.544+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f295800d6b0 con 0x7f2968066200 2024-04-12T13:38:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.545+0000 7f295f400640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 0x7f294c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.545+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2958087180 con 0x7f2968066200 2024-04-12T13:38:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.545+0000 7f295e000640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 0x7f294c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.546+0000 7f295e000640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 0x7f294c06b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2950004a30 tx=0x7f2950004d10 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:52.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.549+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2958053390 con 0x7f2968066200 2024-04-12T13:38:52.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.743+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2968112b20 con 0x7f2968066200 2024-04-12T13:38:52.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.744+0000 7f295f400640 1 -- 172.21.15.60:0/161554721 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29580569b0 con 0x7f2968066200 2024-04-12T13:38:52.747 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-04-12T13:38:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 msgr2=0x7f294c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 0x7f294c06b6c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2950004a30 tx=0x7f2950004d10 comp rx=0 tx=0).stop 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 msgr2=0x7f296810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2958002840 tx=0x7f2958004570 comp rx=0 tx=0).stop 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 shutdown_connections 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f294c069210 0x7f294c06b6c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29680ff150 0x7f296810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 --2- 172.21.15.60:0/161554721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2968066200 0x7f296810cb90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.747+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 >> 172.21.15.60:0/161554721 conn(0x7f29680f66e0 msgr2=0x7f29680f6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.748+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 shutdown_connections 2024-04-12T13:38:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.748+0000 7f2967e00640 1 -- 172.21.15.60:0/161554721 wait complete. 2024-04-12T13:38:52.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 -- 172.21.15.60:0/2633828579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 msgr2=0x7f6c540fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 --2- 172.21.15.60:0/2633828579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c540fcba0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c440048d0 tx=0x7f6c44009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 -- 172.21.15.60:0/2633828579 shutdown_connections 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 --2- 172.21.15.60:0/2633828579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 0x7f6c540ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 --2- 172.21.15.60:0/2633828579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c540fcba0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.991+0000 7f6c59400640 1 -- 172.21.15.60:0/2633828579 >> 172.21.15.60:0/2633828579 conn(0x7f6c540f6880 msgr2=0x7f6c540f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.992+0000 7f6c59400640 1 -- 172.21.15.60:0/2633828579 shutdown_connections 2024-04-12T13:38:52.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.992+0000 7f6c59400640 1 -- 172.21.15.60:0/2633828579 wait complete. 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.992+0000 7f6c59400640 1 Processor -- start 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.992+0000 7f6c59400640 1 -- start start 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c59400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c59400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 0x7f6c54113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c59400640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54113ea0 con 0x7f6c54066220 2024-04-12T13:38:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c59400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541188a0 con 0x7f6c540fd0e0 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57414/0 (socket says 172.21.15.60:57414) 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 -- 172.21.15.60:0/3715410821 learned_addr learned my addr 172.21.15.60:0/3715410821 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c51e00640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 0x7f6c54113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 -- 172.21.15.60:0/3715410821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 msgr2=0x7f6c54113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 0x7f6c54113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.993+0000 7f6c52800640 1 -- 172.21.15.60:0/3715410821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44005040 con 0x7f6c54066220 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c52800640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c4402bda0 tx=0x7f6c44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c44009590 con 0x7f6c54066220 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c440096f0 con 0x7f6c54066220 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4403b640 con 0x7f6c54066220 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c541189e0 con 0x7f6c54066220 2024-04-12T13:38:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.994+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54118ed0 con 0x7f6c54066220 2024-04-12T13:38:52.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.995+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5404bcc0 con 0x7f6c54066220 2024-04-12T13:38:52.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.996+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6c4402f070 con 0x7f6c54066220 2024-04-12T13:38:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.997+0000 7f6c4aa00640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 0x7f6c3806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.997+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c440a98d0 con 0x7f6c54066220 2024-04-12T13:38:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.998+0000 7f6c51e00640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 0x7f6c3806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:52.998+0000 7f6c51e00640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 0x7f6c3806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c54114810 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.002+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c44075b60 con 0x7f6c54066220 2024-04-12T13:38:53.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.197+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6c5410b2f0 con 0x7f6c54066220 2024-04-12T13:38:53.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.198+0000 7f6c4aa00640 1 -- 172.21.15.60:0/3715410821 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6c44079180 con 0x7f6c54066220 2024-04-12T13:38:53.200 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:38:53.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 msgr2=0x7f6c3806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 0x7f6c3806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c54114810 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2024-04-12T13:38:53.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 msgr2=0x7f6c54113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c4402bda0 tx=0x7f6c44009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 shutdown_connections 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6c38069210 0x7f6c3806b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c540fd0e0 0x7f6c54113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 --2- 172.21.15.60:0/3715410821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c54066220 0x7f6c54113310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 >> 172.21.15.60:0/3715410821 conn(0x7f6c540f6880 msgr2=0x7f6c540f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 shutdown_connections 2024-04-12T13:38:53.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.201+0000 7f6c59400640 1 -- 172.21.15.60:0/3715410821 wait complete. 2024-04-12T13:38:53.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T13:38:53.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:53 smithi060 ceph-mon[29097]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:53 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3868616364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:38:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:53 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/161554721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:38:53.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 -- 172.21.15.60:0/4271617841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0ff450 msgr2=0x7f8d5c0ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 --2- 172.21.15.60:0/4271617841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c0ff8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d480048d0 tx=0x7f8d48009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 -- 172.21.15.60:0/4271617841 shutdown_connections 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 --2- 172.21.15.60:0/4271617841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c0ff8c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 --2- 172.21.15.60:0/4271617841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 -- 172.21.15.60:0/4271617841 >> 172.21.15.60:0/4271617841 conn(0x7f8d5c0f9ae0 msgr2=0x7f8d5c0fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 -- 172.21.15.60:0/4271617841 shutdown_connections 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.445+0000 7f8d62800640 1 -- 172.21.15.60:0/4271617841 wait complete. 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.446+0000 7f8d62800640 1 Processor -- start 2024-04-12T13:38:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d62800640 1 -- start start 2024-04-12T13:38:53.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d62800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d62800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c10f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d62800640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c10f8e0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d62800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c1142a0 con 0x7f8d5c0ff450 2024-04-12T13:38:53.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d61400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d61400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57430/0 (socket says 172.21.15.60:57430) 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.447+0000 7f8d61400640 1 -- 172.21.15.60:0/2095070768 learned_addr learned my addr 172.21.15.60:0/2095070768 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d60a00640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d61400640 1 -- 172.21.15.60:0/2095070768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0ff450 msgr2=0x7f8d5c10f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d61400640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c10f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d61400640 1 -- 172.21.15.60:0/2095070768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48005040 con 0x7f8d5c0fe220 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d61400640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000eb70 tx=0x7f8d5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.448+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d50007c30 con 0x7f8d5c0fe220 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.449+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d5000f040 con 0x7f8d5c0fe220 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.449+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c114440 con 0x7f8d5c0fe220 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.449+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5000cbb0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.449+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c114910 con 0x7f8d5c0fe220 2024-04-12T13:38:53.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.450+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c04bcc0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.451+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8d50009110 con 0x7f8d5c0fe220 2024-04-12T13:38:53.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.452+0000 7f8d59600640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 0x7f8d4406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.452+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d500874e0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.452+0000 7f8d60a00640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 0x7f8d4406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.453+0000 7f8d60a00640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 0x7f8d4406b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d480048a0 tx=0x7f8d48009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:53.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.456+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8d500537b0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:53 smithi110 ceph-mon[36055]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:53 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3868616364' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:38:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:53 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/161554721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:38:53.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.649+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f8d5c114b90 con 0x7f8d5c0fe220 2024-04-12T13:38:53.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.650+0000 7f8d59600640 1 -- 172.21.15.60:0/2095070768 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8d50056dd0 con 0x7f8d5c0fe220 2024-04-12T13:38:53.652 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:38:53.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 msgr2=0x7f8d4406b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 0x7f8d4406b6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d480048a0 tx=0x7f8d48009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 msgr2=0x7f8d5c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000eb70 tx=0x7f8d5000b040 comp rx=0 tx=0).stop 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 shutdown_connections 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f8d44069220 0x7f8d4406b6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d5c0ff450 0x7f8d5c10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 --2- 172.21.15.60:0/2095070768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d5c0fe220 0x7f8d5c10ed50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.653+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 >> 172.21.15.60:0/2095070768 conn(0x7f8d5c0f9ae0 msgr2=0x7f8d5c0fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.654+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 shutdown_connections 2024-04-12T13:38:53.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.654+0000 7f8d62800640 1 -- 172.21.15.60:0/2095070768 wait complete. 2024-04-12T13:38:53.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 -- 172.21.15.60:0/3872076394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fd2d0 msgr2=0x7fc5800fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 --2- 172.21.15.60:0/3872076394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fd2d0 0x7fc5800fd740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0048d0 tx=0x7fc56c009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 -- 172.21.15.60:0/3872076394 shutdown_connections 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 --2- 172.21.15.60:0/3872076394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fd2d0 0x7fc5800fd740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 --2- 172.21.15.60:0/3872076394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fc000 0x7fc5800fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 -- 172.21.15.60:0/3872076394 >> 172.21.15.60:0/3872076394 conn(0x7fc5800f77e0 msgr2=0x7fc5800f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 -- 172.21.15.60:0/3872076394 shutdown_connections 2024-04-12T13:38:53.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.890+0000 7fc586200640 1 -- 172.21.15.60:0/3872076394 wait complete. 2024-04-12T13:38:53.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.891+0000 7fc586200640 1 Processor -- start 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc586200640 1 -- start start 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc586200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc586200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fd2d0 0x7fc58010f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc586200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58010f950 con 0x7fc5800fc000 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc586200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580114310 con 0x7fc5800fd2d0 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.892+0000 7fc584e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57458/0 (socket says 172.21.15.60:57458) 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 -- 172.21.15.60:0/3642345301 learned_addr learned my addr 172.21.15.60:0/3642345301 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:53.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc57fe00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fd2d0 0x7fc58010f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 -- 172.21.15.60:0/3642345301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fd2d0 msgr2=0x7fc58010f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:53.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fd2d0 0x7fc58010f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:53.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 -- 172.21.15.60:0/3642345301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c005040 con 0x7fc5800fc000 2024-04-12T13:38:53.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.893+0000 7fc584e00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc574002a50 tx=0x7fc574004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.894+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc574007c30 con 0x7fc5800fc000 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.894+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5801144b0 con 0x7fc5800fc000 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.894+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc57400f040 con 0x7fc5800fc000 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.894+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57400dad0 con 0x7fc5800fc000 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.894+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc580114980 con 0x7fc5800fc000 2024-04-12T13:38:53.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.895+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58004bcc0 con 0x7fc5800fc000 2024-04-12T13:38:53.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.896+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc57400dd40 con 0x7fc5800fc000 2024-04-12T13:38:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.897+0000 7fc57cc00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 0x7fc56806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.897+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc574086a70 con 0x7fc5800fc000 2024-04-12T13:38:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.897+0000 7fc57fe00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 0x7fc56806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.898+0000 7fc57fe00640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 0x7fc56806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0048a0 tx=0x7fc56c009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:53.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:53.902+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc574052d30 con 0x7fc5800fc000 2024-04-12T13:38:54.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.142+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc580100bd0 con 0x7fc5800fc000 2024-04-12T13:38:54.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.143+0000 7fc57cc00640 1 -- 172.21.15.60:0/3642345301 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4689 (secure 0 0 0) 0x7fc574056350 con 0x7fc5800fc000 2024-04-12T13:38:54.146 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:38:54.146 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:38:35.348866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi060.mwwohl","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6827/3800124536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3800124536},{"type":"v1","addr":"172.21.15.60:6827","nonce":3800124536}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-12T13:38:54.146 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:38:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 msgr2=0x7fc56806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 0x7fc56806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0048a0 tx=0x7fc56c009da0 comp rx=0 tx=0).stop 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 msgr2=0x7fc58010edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc574002a50 tx=0x7fc574004600 comp rx=0 tx=0).stop 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 shutdown_connections 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fc568069210 0x7fc56806b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5800fd2d0 0x7fc58010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 --2- 172.21.15.60:0/3642345301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5800fc000 0x7fc58010edc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.146+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 >> 172.21.15.60:0/3642345301 conn(0x7fc5800f77e0 msgr2=0x7fc5800f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.147+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 shutdown_connections 2024-04-12T13:38:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:54.147+0000 7fc586200640 1 -- 172.21.15.60:0/3642345301 wait complete. 2024-04-12T13:38:54.167 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-04-12T13:38:54.167 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-12T13:38:54.194 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-12T13:38:54.195 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-12T13:38:54.195 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-12T13:38:54.195 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T13:38:54.195 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T13:38:54.195 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-12T13:38:54.195 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T13:38:54.195 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-12T13:38:54.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:54.196 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-04-12T13:38:54.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:54.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-04-12T13:38:54.357 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-04-12T13:38:54.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:38:54.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:54.362 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-12T13:38:54.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:54.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-04-12T13:38:54.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:54 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3715410821' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:38:54.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:54 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2095070768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:38:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:54 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3715410821' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:38:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:54 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2095070768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:38:54.519 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-04-12T13:38:54.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T13:38:54.522 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-12T13:38:54.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph fs ls 2024-04-12T13:38:55.050 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:38:55.381 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:55 smithi060 ceph-mon[29097]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:55.381 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:55 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3642345301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:38:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:55 smithi110 ceph-mon[36055]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:55 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3642345301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:38:57.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 -- 172.21.15.60:0/1594060880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6168105030 msgr2=0x7f6168105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:57.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 --2- 172.21.15.60:0/1594060880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6168105030 0x7f6168105400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f615c004940 tx=0x7f615c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 -- 172.21.15.60:0/1594060880 shutdown_connections 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 --2- 172.21.15.60:0/1594060880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61681059d0 0x7f61680ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 --2- 172.21.15.60:0/1594060880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6168105030 0x7f6168105400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 -- 172.21.15.60:0/1594060880 >> 172.21.15.60:0/1594060880 conn(0x7f61680fabd0 msgr2=0x7f61680fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 -- 172.21.15.60:0/1594060880 shutdown_connections 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.333+0000 7f6170600700 1 -- 172.21.15.60:0/1594060880 wait complete. 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.334+0000 7f6170600700 1 Processor -- start 2024-04-12T13:38:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.334+0000 7f6170600700 1 -- start start 2024-04-12T13:38:57.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f6170600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:57.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f6170600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6168116230 0x7f616810fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f6170600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681167b0 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f6170600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168116920 con 0x7f6168116230 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57472/0 (socket says 172.21.15.60:57472) 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 -- 172.21.15.60:0/1234890574 learned_addr learned my addr 172.21.15.60:0/1234890574 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 -- 172.21.15.60:0/1234890574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6168116230 msgr2=0x7f616810fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6168116230 0x7f616810fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.335+0000 7f616dc00700 1 -- 172.21.15.60:0/1234890574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c005040 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f616dc00700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b3b0 tx=0x7f615c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615c00e040 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f615c009430 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6168110460 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615c013e90 con 0x7f61681059d0 2024-04-12T13:38:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.336+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6168110a20 con 0x7f61681059d0 2024-04-12T13:38:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.337+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168100780 con 0x7f61681059d0 2024-04-12T13:38:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.338+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f615c013640 con 0x7f61681059d0 2024-04-12T13:38:57.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.339+0000 7f6165600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 0x7f615006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:38:57.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.339+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f615c088580 con 0x7f61681059d0 2024-04-12T13:38:57.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.339+0000 7f616d200700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 0x7f615006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:38:57.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.340+0000 7f616d200700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 0x7f615006b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6168067370 tx=0x7f6158007d40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:38:57.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.344+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f615c0582a0 con 0x7f61681059d0 2024-04-12T13:38:57.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:57 smithi060 ceph-mon[29097]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:57.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:57 smithi110 ceph-mon[36055]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:57.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.617+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6168111370 con 0x7f61681059d0 2024-04-12T13:38:57.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.617+0000 7f6165600700 1 -- 172.21.15.60:0/1234890574 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f615c057e30 con 0x7f61681059d0 2024-04-12T13:38:57.620 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 msgr2=0x7f615006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 0x7f615006b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6168067370 tx=0x7f6158007d40 comp rx=0 tx=0).stop 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 msgr2=0x7f6168115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b3b0 tx=0x7f615c009e30 comp rx=0 tx=0).stop 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 shutdown_connections 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f61500692a0 0x7f615006b750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681059d0 0x7f6168115cf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 --2- 172.21.15.60:0/1234890574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6168116230 0x7f616810fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:38:57.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 >> 172.21.15.60:0/1234890574 conn(0x7f61680fabd0 msgr2=0x7f61680fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:38:57.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 shutdown_connections 2024-04-12T13:38:57.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:57.621+0000 7f6170600700 1 -- 172.21.15.60:0/1234890574 wait complete. 2024-04-12T13:38:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:58 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1234890574' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T13:38:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:58 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1234890574' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T13:38:58.527 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-12T13:38:58.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:58.528 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-04-12T13:38:58.586 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T13:38:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T13:38:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T13:38:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-12T13:38:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 41741sec preferred_lft 41741sec 2024-04-12T13:38:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link noprefixroute 2024-04-12T13:38:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:38:58.588 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:38:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:38:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-04-12T13:38:58.589 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T13:38:58.589 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:38:58.589 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-04-12T13:38:58.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-04-12T13:38:58.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-04-12T13:38:58.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-04-12T13:38:58.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T13:38:58.590 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-04-12T13:38:58.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:38:59.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:59.156 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T13:38:59.244 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-04-12T13:38:59.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:38:59.248 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-04-12T13:38:59.307 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-04-12T13:38:59.307 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T13:38:59.307 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-12T13:38:59.307 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-12T13:38:59.307 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-12T13:38:59.308 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-04-12T13:38:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:38:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:38:59.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:38:59 smithi060 ceph-mon[29097]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:38:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:38:59 smithi110 ceph-mon[36055]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:00.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:00.210 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-04-12T13:39:00.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:00.272 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-04-12T13:39:00.332 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:00.332 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-04-12T13:39:00.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:00.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-12T13:39:00.332 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-04-12T13:39:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:00.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:00.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:00.556 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-12T13:39:00.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-12T13:39:00.557 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-04-12T13:39:00.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:00.905 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:00.905 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-04-12T13:39:00.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-04-12T13:39:00.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T13:39:00.906 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-04-12T13:39:01.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:01.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:01.149 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-12T13:39:01.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T13:39:01.150 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:01.196 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-12T13:39:01.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T13:39:01.196 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:01.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2024-04-12T13:39:01.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:01 smithi060 ceph-mon[29097]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:01.389 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2024-04-12T13:39:01.449 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T13:39:01.450 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/4c86ccd66eb326254dec1c2d30fad09c69ecb12930f13e8620978fff7c5ec32b/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/58466434fc8f0ed4a20f85dd31fad85a48e3fbc966dd78c5ef601fa4eadb2c41/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/0 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/7ec9e784dfa120113752472fef0ade9406a5d1c71fcc7a134fa1f1f38d233f21/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/464f6433caf81b3d0844f98e53df8a50a6daf70590baad7fd3bb155553c0d450/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/9155771e438930f3b58c3ccb6b9eb774195b9aa12bec597dc3580e2900c5d55a/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/376aab7dbb9744ea22786d4883301003e55a9c26a7d46ccc77a1ba3d95e289b3/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/d3cf44cbb665b48ae1f386eff4ca670c85931cd1fd5a61bd0534396c07b14b3f/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/74f7b09ed076ccdabcea0f4dc78ae27c263a5b22a1badd81a130880b3472021c/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/33b2f45e4931530e9f9c2195c52c49de4c015c5a4f76ceadde62b6f86639d2fe/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/c1ed245f1ba6cca47a14e1c9322c5efd6190219dc7bc0bf9b9ce25868fe9a5d5/merged 2024-04-12T13:39:01.451 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/f7cf48fffc9e27c9de07d1132ab9d3bd038660380dbf0b131b5713ad212fc0a5/merged 2024-04-12T13:39:01.452 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/ddf04af0cfd4dc7ee3988afcaf75df6c05d6d23d3788da2024815da981824411/merged 2024-04-12T13:39:01.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2024-04-12T13:39:01.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:01.452 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:01.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:01.453 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2024-04-12T13:39:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:01 smithi110 ceph-mon[36055]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:01.507 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T13:39:01.507 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-12T13:39:01.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2024-04-12T13:39:01.594 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2024-04-12T13:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T13:39:01.651 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/4c86ccd66eb326254dec1c2d30fad09c69ecb12930f13e8620978fff7c5ec32b/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/58466434fc8f0ed4a20f85dd31fad85a48e3fbc966dd78c5ef601fa4eadb2c41/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/0 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/7ec9e784dfa120113752472fef0ade9406a5d1c71fcc7a134fa1f1f38d233f21/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/464f6433caf81b3d0844f98e53df8a50a6daf70590baad7fd3bb155553c0d450/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/9155771e438930f3b58c3ccb6b9eb774195b9aa12bec597dc3580e2900c5d55a/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/376aab7dbb9744ea22786d4883301003e55a9c26a7d46ccc77a1ba3d95e289b3/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/d3cf44cbb665b48ae1f386eff4ca670c85931cd1fd5a61bd0534396c07b14b3f/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/74f7b09ed076ccdabcea0f4dc78ae27c263a5b22a1badd81a130880b3472021c/merged 2024-04-12T13:39:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/33b2f45e4931530e9f9c2195c52c49de4c015c5a4f76ceadde62b6f86639d2fe/merged 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/c1ed245f1ba6cca47a14e1c9322c5efd6190219dc7bc0bf9b9ce25868fe9a5d5/merged 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/f7cf48fffc9e27c9de07d1132ab9d3bd038660380dbf0b131b5713ad212fc0a5/merged 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/ddf04af0cfd4dc7ee3988afcaf75df6c05d6d23d3788da2024815da981824411/merged 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:01.653 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:01.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:01.654 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2024-04-12T13:39:01.738 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:2024-04-12T13:39:01.736+0000 7fd910abf300 -1 init, newargv = 0x55ed05c2b0c0 newargc=15 2024-04-12T13:39:01.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[76337]: starting ceph client 2024-04-12T13:39:01.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[76337]: starting fuse 2024-04-12T13:39:01.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stdout:ceph_fuse: starting fuse loop 2024-04-12T13:39:01.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:2024-04-12T13:39:01.750+0000 7fd910abf300 -1 multithreaded fuse 2024-04-12T13:39:02.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2024-04-12T13:39:02.914 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T13:39:02.973 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2024-04-12T13:39:02.973 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2024-04-12T13:39:02.973 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2024-04-12T13:39:02.973 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2024-04-12T13:39:02.973 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2024-04-12T13:39:02.974 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/4c86ccd66eb326254dec1c2d30fad09c69ecb12930f13e8620978fff7c5ec32b/merged 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/58466434fc8f0ed4a20f85dd31fad85a48e3fbc966dd78c5ef601fa4eadb2c41/merged 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/0 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/7ec9e784dfa120113752472fef0ade9406a5d1c71fcc7a134fa1f1f38d233f21/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/464f6433caf81b3d0844f98e53df8a50a6daf70590baad7fd3bb155553c0d450/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/9155771e438930f3b58c3ccb6b9eb774195b9aa12bec597dc3580e2900c5d55a/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/376aab7dbb9744ea22786d4883301003e55a9c26a7d46ccc77a1ba3d95e289b3/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/d3cf44cbb665b48ae1f386eff4ca670c85931cd1fd5a61bd0534396c07b14b3f/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/74f7b09ed076ccdabcea0f4dc78ae27c263a5b22a1badd81a130880b3472021c/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/33b2f45e4931530e9f9c2195c52c49de4c015c5a4f76ceadde62b6f86639d2fe/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/c1ed245f1ba6cca47a14e1c9322c5efd6190219dc7bc0bf9b9ce25868fe9a5d5/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/f7cf48fffc9e27c9de07d1132ab9d3bd038660380dbf0b131b5713ad212fc0a5/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/containers/storage/overlay/ddf04af0cfd4dc7ee3988afcaf75df6c05d6d23d3788da2024815da981824411/merged 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T13:39:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:02.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:02.977 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2024-04-12T13:39:03.032 INFO:teuthology.orchestra.run.smithi060.stdout:148 2024-04-12T13:39:03.033 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [148] 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo stdin-killer -- python3 -c ' 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> import re 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-12T13:39:03.033 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> return f 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T13:39:03.034 DEBUG:teuthology.orchestra.run.smithi060:> 2024-04-12T13:39:03.035 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.0")) 2024-04-12T13:39:03.035 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-04-12T13:39:03.223 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.0.76337.asok 2024-04-12T13:39:03.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:03.241 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76337.asok 2024-04-12T13:39:03.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:03.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76337.asok status 2024-04-12T13:39:03.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:03 smithi060 ceph-mon[29097]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "730340d76f41e9c8e5e38d06015fbcce8efa14be", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "0", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "76337", 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2024-04-12T13:39:03.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 14510, 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 14510 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 46605736 2024-04-12T13:39:03.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 46605736 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.14510 192.168.0.1:0/46605736", 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.1:0/46605736", 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 13, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 46, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs" 2024-04-12T13:39:03.479 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:39:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:03 smithi110 ceph-mon[36055]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:03.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- ceph fs ls 2024-04-12T13:39:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:05 smithi060 ceph-mon[29097]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:05 smithi110 ceph-mon[36055]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.376+0000 7f6409200700 1 -- 172.21.15.60:0/3549468004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6404105030 msgr2=0x7f6404105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.376+0000 7f6409200700 1 --2- 172.21.15.60:0/3549468004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6404105030 0x7f6404105400 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f63f4004940 tx=0x7f63f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 -- 172.21.15.60:0/3549468004 shutdown_connections 2024-04-12T13:39:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 --2- 172.21.15.60:0/3549468004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64041059d0 0x7f64040ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 --2- 172.21.15.60:0/3549468004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6404105030 0x7f6404105400 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 -- 172.21.15.60:0/3549468004 >> 172.21.15.60:0/3549468004 conn(0x7f64040fabd0 msgr2=0x7f64040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 -- 172.21.15.60:0/3549468004 shutdown_connections 2024-04-12T13:39:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.377+0000 7f6409200700 1 -- 172.21.15.60:0/3549468004 wait complete. 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.378+0000 7f6409200700 1 Processor -- start 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.378+0000 7f6409200700 1 -- start start 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6409200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6404105030 0x7f6404115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6409200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6409200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404116720 con 0x7f64041059d0 2024-04-12T13:39:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6409200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640410fd00 con 0x7f6404105030 2024-04-12T13:39:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59146/0 (socket says 172.21.15.60:59146) 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 -- 172.21.15.60:0/1521346000 learned_addr learned my addr 172.21.15.60:0/1521346000 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401e00700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6404105030 0x7f6404115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 -- 172.21.15.60:0/1521346000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6404105030 msgr2=0x7f6404115b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6404105030 0x7f6404115b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.379+0000 7f6401400700 1 -- 172.21.15.60:0/1521346000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4005040 con 0x7f64041059d0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f6401400700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f63f0002a50 tx=0x7f63f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f0007cc0 con 0x7f64041059d0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63f000f040 con 0x7f64041059d0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f0009630 con 0x7f64041059d0 2024-04-12T13:39:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640410ffe0 con 0x7f64041059d0 2024-04-12T13:39:06.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.380+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6404110520 con 0x7f64041059d0 2024-04-12T13:39:06.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.382+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404100780 con 0x7f64041059d0 2024-04-12T13:39:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.383+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f63f0009790 con 0x7f64041059d0 2024-04-12T13:39:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.384+0000 7f63fa000700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 0x7f63e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.384+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f63f0086e40 con 0x7f64041059d0 2024-04-12T13:39:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.384+0000 7f6401e00700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 0x7f63e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.385+0000 7f6401e00700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 0x7f63e806b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63f400b020 tx=0x7f63f4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.389+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f63f0056c10 con 0x7f64041059d0 2024-04-12T13:39:06.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.654+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f640410c160 con 0x7f64041059d0 2024-04-12T13:39:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.655+0000 7f63fa000700 1 -- 172.21.15.60:0/1521346000 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f63f00567a0 con 0x7f64041059d0 2024-04-12T13:39:06.657 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-12T13:39:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 msgr2=0x7f63e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 0x7f63e806b750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63f400b020 tx=0x7f63f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 msgr2=0x7f64041160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:06.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f63f0002a50 tx=0x7f63f00046b0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 shutdown_connections 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f63e80692a0 0x7f63e806b750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6404105030 0x7f6404115b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 --2- 172.21.15.60:0/1521346000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64041059d0 0x7f64041160d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.658+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 >> 172.21.15.60:0/1521346000 conn(0x7f64040fabd0 msgr2=0x7f64040fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.659+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 shutdown_connections 2024-04-12T13:39:06.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:06.659+0000 7f6409200700 1 -- 172.21.15.60:0/1521346000 wait complete. 2024-04-12T13:39:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:07 smithi060 ceph-mon[29097]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:07 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1521346000' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T13:39:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:07 smithi110 ceph-mon[36055]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:07 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1521346000' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T13:39:07.546 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-12T13:39:07.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T13:39:07.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T13:39:07.547 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-12T13:39:07.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:07.547 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-04-12T13:39:07.606 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T13:39:07.607 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-04-12T13:39:07.608 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-12T13:39:07.608 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 41911sec preferred_lft 41911sec 2024-04-12T13:39:07.608 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-04-12T13:39:07.608 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-12T13:39:07.608 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T13:39:07.608 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:07.608 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-12T13:39:07.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-04-12T13:39:07.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-04-12T13:39:07.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-04-12T13:39:07.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T13:39:07.609 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-12T13:39:07.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:08.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:08.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:08.118 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T13:39:08.194 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-04-12T13:39:08.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:08.198 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-04-12T13:39:08.254 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-04-12T13:39:08.254 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T13:39:08.254 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-12T13:39:08.254 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-12T13:39:08.254 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-12T13:39:08.255 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-12T13:39:08.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:09.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:09.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:09.104 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-12T13:39:09.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:09.150 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-04-12T13:39:09.243 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:09.244 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-12T13:39:09.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T13:39:09.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-12T13:39:09.244 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-12T13:39:09.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:09.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:09 smithi110 ceph-mon[36055]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:09.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:09.433 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-12T13:39:09.433 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-12T13:39:09.434 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-12T13:39:09.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:09.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:09 smithi060 ceph-mon[29097]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:09.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:09.766 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T13:39:09.766 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-12T13:39:09.766 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-04-12T13:39:09.766 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T13:39:09.766 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-12T13:39:09.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T13:39:09.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:09.982 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-12T13:39:09.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T13:39:09.982 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:10.026 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-12T13:39:10.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T13:39:10.026 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:10.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-12T13:39:10.246 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T13:39:10.303 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-12T13:39:10.304 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T13:39:10.305 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/85c7cc3efeae38faa436f44e297aba5be76928ed2a5a71fa8bf7b5894eb1a584/merged 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/9bf0d441a3bccf66b8ea82da8a28283fa866d23c291656652d4d48501e6866c3/merged 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/902afb298b8eb833a6201ba41d91b41d703afd97f34795ddce86df5f1820e9ed/merged 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/22291de05ea46c445cf43c4dec23d91d0207e68a81887c07b568140ac416ff9e/merged 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d363ec3211abe95c36289b3ace142c4a9c706c9b386d29c986520aa2c339e4a3/merged 2024-04-12T13:39:10.306 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/a4b4ee100a0814d0b8eae78c5b628382fe80a86712744f81feb5d9b01327acef/merged 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/f889b2044b3f959398e3ccb37c7e21e7bd1dfe5e9dad11588b9c9e93d548fb83/merged 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d9b7367568b146b05c0f4c8d6b53ae973f2da8978c2b778c1399ada97df4459d/merged 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/0e66621669eb0f885d30fc26e5f0a0e8e8782695997b337c0f394196f6c42041/merged 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T13:39:10.307 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T13:39:10.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:10.308 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-12T13:39:10.361 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T13:39:10.362 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-12T13:39:10.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-04-12T13:39:10.446 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T13:39:10.489 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-04-12T13:39:10.489 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-04-12T13:39:10.489 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-04-12T13:39:10.489 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-04-12T13:39:10.489 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-04-12T13:39:10.490 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/85c7cc3efeae38faa436f44e297aba5be76928ed2a5a71fa8bf7b5894eb1a584/merged 2024-04-12T13:39:10.491 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/9bf0d441a3bccf66b8ea82da8a28283fa866d23c291656652d4d48501e6866c3/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/902afb298b8eb833a6201ba41d91b41d703afd97f34795ddce86df5f1820e9ed/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/22291de05ea46c445cf43c4dec23d91d0207e68a81887c07b568140ac416ff9e/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d363ec3211abe95c36289b3ace142c4a9c706c9b386d29c986520aa2c339e4a3/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/a4b4ee100a0814d0b8eae78c5b628382fe80a86712744f81feb5d9b01327acef/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/f889b2044b3f959398e3ccb37c7e21e7bd1dfe5e9dad11588b9c9e93d548fb83/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d9b7367568b146b05c0f4c8d6b53ae973f2da8978c2b778c1399ada97df4459d/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/0e66621669eb0f885d30fc26e5f0a0e8e8782695997b337c0f394196f6c42041/merged 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T13:39:10.492 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T13:39:10.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:10.493 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-04-12T13:39:10.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:2024-04-12T13:39:10.565+0000 7f4b26ec8300 -1 init, newargv = 0x55db64f79db0 newargc=15 2024-04-12T13:39:10.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:ceph-fuse[61881]: starting ceph client 2024-04-12T13:39:10.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:ceph-fuse[61881]: starting fuse 2024-04-12T13:39:10.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stdout:ceph_fuse: starting fuse loop 2024-04-12T13:39:10.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi110.stderr:2024-04-12T13:39:10.577+0000 7f4b26ec8300 -1 multithreaded fuse 2024-04-12T13:39:10.580 INFO:teuthology.orchestra.run.smithi110.stdout:115 2024-04-12T13:39:10.581 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-12T13:39:10.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2024-04-12T13:39:10.581 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2024-04-12T13:39:10.581 DEBUG:teuthology.orchestra.run.smithi110:> import re 2024-04-12T13:39:10.581 DEBUG:teuthology.orchestra.run.smithi110:> import os 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2024-04-12T13:39:10.582 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> return f 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.1")) 2024-04-12T13:39:10.583 DEBUG:teuthology.orchestra.run.smithi110:> ' 2024-04-12T13:39:10.783 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.1.61881.asok 2024-04-12T13:39:10.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-12T13:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T13:39:10.800 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61881.asok 2024-04-12T13:39:10.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:10.800 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61881.asok status 2024-04-12T13:39:11.029 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "730340d76f41e9c8e5e38d06015fbcce8efa14be", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "1", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "61881", 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-12T13:39:11.030 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24331, 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 24331 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 2685587643 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-12T13:39:11.031 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 2685587643 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.24331 192.168.0.1:0/2685587643", 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.1:0/2685587643", 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 13, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 46, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2024-04-12T13:39:11.032 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-12T13:39:11.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:11.044 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2024-04-12T13:39:11.045 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.108 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2024-04-12T13:39:11.109 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:11.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:11.221 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2024-04-12T13:39:11.221 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.272 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2024-04-12T13:39:11.273 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:39:11.273 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.369 INFO:teuthology.run_tasks:Running task print... 2024-04-12T13:39:11.379 INFO:teuthology.task.print:**** done client 2024-04-12T13:39:11.380 INFO:teuthology.run_tasks:Running task parallel... 2024-04-12T13:39:11.402 INFO:teuthology.task.parallel:starting parallel... 2024-04-12T13:39:11.403 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-12T13:39:11.403 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T13:39:11.404 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:39:11.404 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-12T13:39:11.404 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-12T13:39:11.404 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-12T13:39:11.408 INFO:tasks.workunit:Pulling workunits from ref 35087f9f8bbf4292364e0bbb9a4062d5cd47de0a 2024-04-12T13:39:11.408 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-12T13:39:11.408 INFO:tasks.workunit:timeout=3h 2024-04-12T13:39:11.408 INFO:tasks.workunit:cleanup=True 2024-04-12T13:39:11.408 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.470 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-12 13:38:19.618841123 +0000 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-12 13:39:11.212865021 +0000 2024-04-12T13:39:11.471 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2024-04-12T13:39:11.471 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-12T13:39:11.471 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-12T13:39:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:11 smithi110 ceph-mon[36055]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:11.488 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:11 smithi060 ceph-mon[29097]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:11.587 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T13:39:11.646 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-12T13:39:11.647 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-12 13:39:11.572415863 +0000 2024-04-12T13:39:11.647 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-12 13:39:11.572415863 +0000 2024-04-12T13:39:11.647 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-04-12T13:39:11.647 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-12T13:39:11.647 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-12T13:39:11.757 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 35087f9f8bbf4292364e0bbb9a4062d5cd47de0a 2024-04-12T13:39:11.758 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 35087f9f8bbf4292364e0bbb9a4062d5cd47de0a 2024-04-12T13:39:11.801 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-12T13:39:11.817 INFO:tasks.workunit.client.1.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-12T13:39:11.910 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:13 smithi110 ceph-mon[36055]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:13.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:13 smithi060 ceph-mon[29097]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 -- 172.21.15.60:0/1313876758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c0709a0 msgr2=0x7feb1c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 --2- 172.21.15.60:0/1313876758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c0709a0 0x7feb1c070e10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb08004940 tx=0x7feb08009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 -- 172.21.15.60:0/1313876758 shutdown_connections 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 --2- 172.21.15.60:0/1313876758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c0709a0 0x7feb1c070e10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 --2- 172.21.15.60:0/1313876758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c071f50 0x7feb1c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 -- 172.21.15.60:0/1313876758 >> 172.21.15.60:0/1313876758 conn(0x7feb1c0f8530 msgr2=0x7feb1c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 -- 172.21.15.60:0/1313876758 shutdown_connections 2024-04-12T13:39:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.132+0000 7feb22000700 1 -- 172.21.15.60:0/1313876758 wait complete. 2024-04-12T13:39:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.133+0000 7feb22000700 1 Processor -- start 2024-04-12T13:39:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.133+0000 7feb22000700 1 -- start start 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb22000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c0709a0 0x7feb1c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb22000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c071f50 0x7feb1c110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb22000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c110780 con 0x7feb1c071f50 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb22000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c110fd0 con 0x7feb1c0709a0 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb1aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c071f50 0x7feb1c110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb1aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c071f50 0x7feb1c110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45196/0 (socket says 172.21.15.60:45196) 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb1aa00700 1 -- 172.21.15.60:0/542685874 learned_addr learned my addr 172.21.15.60:0/542685874 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.134+0000 7feb1b400700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c0709a0 0x7feb1c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.135+0000 7feb1aa00700 1 -- 172.21.15.60:0/542685874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c0709a0 msgr2=0x7feb1c10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.135+0000 7feb1aa00700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c0709a0 0x7feb1c10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.135+0000 7feb1aa00700 1 -- 172.21.15.60:0/542685874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08005040 con 0x7feb1c071f50 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.135+0000 7feb1aa00700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb1c071f50 0x7feb1c110180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb08009150 tx=0x7feb08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.136+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb0800e040 con 0x7feb1c071f50 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.136+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb08004290 con 0x7feb1c071f50 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.136+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb0801c630 con 0x7feb1c071f50 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.136+0000 7feb22000700 1 -- 172.21.15.60:0/542685874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c111250 con 0x7feb1c071f50 2024-04-12T13:39:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.136+0000 7feb22000700 1 -- 172.21.15.60:0/542685874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c111790 con 0x7feb1c071f50 2024-04-12T13:39:14.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.137+0000 7feb22000700 1 -- 172.21.15.60:0/542685874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c05f5f0 con 0x7feb1c071f50 2024-04-12T13:39:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.139+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7feb0800bbf0 con 0x7feb1c071f50 2024-04-12T13:39:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.140+0000 7feb13400700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7feb000692a0 0x7feb0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.140+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7feb08087e30 con 0x7feb1c071f50 2024-04-12T13:39:14.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.140+0000 7feb1b400700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7feb000692a0 0x7feb0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:14.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.141+0000 7feb1b400700 1 --2- 172.21.15.60:0/542685874 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7feb000692a0 0x7feb0006b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feb1c071c90 tx=0x7feb0c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:14.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.146+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feb08057bd0 con 0x7feb1c071f50 2024-04-12T13:39:14.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.363+0000 7feb22000700 1 -- 172.21.15.60:0/542685874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7feb1c107b90 con 0x7feb1c071f50 2024-04-12T13:39:14.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:14.363+0000 7feb13400700 1 -- 172.21.15.60:0/542685874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7feb08057760 con 0x7feb1c071f50 2024-04-12T13:39:14.368 INFO:teuthology.orchestra.run.smithi060.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-12T13:39:15.178 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T13:39:15.179 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:39:15.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-12T13:39:15.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:15 smithi060 ceph-mon[29097]: pgmap v251: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T13:39:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:15 smithi110 ceph-mon[36055]: pgmap v251: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T13:39:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:15.768 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:17 smithi110 ceph-mon[36055]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:17.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:17 smithi060 ceph-mon[29097]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 -- 172.21.15.60:0/557572794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fcc20 msgr2=0x7fcf280fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 --2- 172.21.15.60:0/557572794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fcc20 0x7fcf280fd030 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c004940 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 -- 172.21.15.60:0/557572794 shutdown_connections 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 --2- 172.21.15.60:0/557572794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fded0 0x7fcf280fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 --2- 172.21.15.60:0/557572794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fcc20 0x7fcf280fd030 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 -- 172.21.15.60:0/557572794 >> 172.21.15.60:0/557572794 conn(0x7fcf280f83a0 msgr2=0x7fcf280fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 -- 172.21.15.60:0/557572794 shutdown_connections 2024-04-12T13:39:18.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.183+0000 7fcf2de00700 1 -- 172.21.15.60:0/557572794 wait complete. 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.184+0000 7fcf2de00700 1 Processor -- start 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.184+0000 7fcf2de00700 1 -- start start 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf2de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fcc20 0x7fcf2810fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf2de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf2de00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28110610 con 0x7fcf280fded0 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf2de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28110e60 con 0x7fcf280fcc20 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf27e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf27e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45216/0 (socket says 172.21.15.60:45216) 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf27e00700 1 -- 172.21.15.60:0/2413606179 learned_addr learned my addr 172.21.15.60:0/2413606179 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.185+0000 7fcf2ca00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fcc20 0x7fcf2810fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf27e00700 1 -- 172.21.15.60:0/2413606179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fcc20 msgr2=0x7fcf2810fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf27e00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fcc20 0x7fcf2810fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf27e00700 1 -- 172.21.15.60:0/2413606179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c005040 con 0x7fcf280fded0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf27e00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf14002a50 tx=0x7fcf140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf14007cc0 con 0x7fcf280fded0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf1400f040 con 0x7fcf280fded0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1400da70 con 0x7fcf280fded0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.186+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf28111140 con 0x7fcf280fded0 2024-04-12T13:39:18.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.187+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28111680 con 0x7fcf280fded0 2024-04-12T13:39:18.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.188+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28101860 con 0x7fcf280fded0 2024-04-12T13:39:18.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.189+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcf1400dc10 con 0x7fcf280fded0 2024-04-12T13:39:18.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.190+0000 7fcf24c00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 0x7fcf1006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:18.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.191+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcf14086830 con 0x7fcf280fded0 2024-04-12T13:39:18.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.191+0000 7fcf2ca00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 0x7fcf1006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:18.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.192+0000 7fcf2ca00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 0x7fcf1006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b3b0 tx=0x7fcf1c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:18.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.196+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcf14056550 con 0x7fcf280fded0 2024-04-12T13:39:18.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.402+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fcf281058c0 con 0x7fcf280fded0 2024-04-12T13:39:18.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.403+0000 7fcf24c00700 1 -- 172.21.15.60:0/2413606179 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fcf281058c0 con 0x7fcf280fded0 2024-04-12T13:39:18.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 msgr2=0x7fcf1006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 0x7fcf1006b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b3b0 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 msgr2=0x7fcf28110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcf14002a50 tx=0x7fcf140046b0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 shutdown_connections 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fcf100692a0 0x7fcf1006b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf280fcc20 0x7fcf2810fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 --2- 172.21.15.60:0/2413606179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf280fded0 0x7fcf28110010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 >> 172.21.15.60:0/2413606179 conn(0x7fcf280f83a0 msgr2=0x7fcf280f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 shutdown_connections 2024-04-12T13:39:18.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:18.407+0000 7fcf2de00700 1 -- 172.21.15.60:0/2413606179 wait complete. 2024-04-12T13:39:19.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-12T13:39:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:19 smithi110 ceph-mon[36055]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:19.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:19 smithi060 ceph-mon[29097]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:19.900 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:21 smithi060 ceph-mon[29097]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:21.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:21 smithi110 ceph-mon[36055]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:22.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 -- 172.21.15.60:0/2470368078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 msgr2=0x7f35b40fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:22.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 --2- 172.21.15.60:0/2470368078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b40fe4b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35a0004940 tx=0x7f35a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:22.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 -- 172.21.15.60:0/2470368078 shutdown_connections 2024-04-12T13:39:22.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 --2- 172.21.15.60:0/2470368078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b40fe4b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 --2- 172.21.15.60:0/2470368078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 0x7f35b40fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.324+0000 7f35b9200700 1 -- 172.21.15.60:0/2470368078 >> 172.21.15.60:0/2470368078 conn(0x7f35b40f8530 msgr2=0x7f35b40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:22.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.325+0000 7f35b9200700 1 -- 172.21.15.60:0/2470368078 shutdown_connections 2024-04-12T13:39:22.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.325+0000 7f35b9200700 1 -- 172.21.15.60:0/2470368078 wait complete. 2024-04-12T13:39:22.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 Processor -- start 2024-04-12T13:39:22.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 -- start start 2024-04-12T13:39:22.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 0x7f35b410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:22.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:22.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4110fa0 con 0x7f35b40fe040 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.326+0000 7f35b9200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4111110 con 0x7f35b40fce40 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58946/0 (socket says 172.21.15.60:58946) 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 -- 172.21.15.60:0/2112872744 learned_addr learned my addr 172.21.15.60:0/2112872744 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1e00700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 0x7f35b410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 -- 172.21.15.60:0/2112872744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 msgr2=0x7f35b410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 0x7f35b410fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 -- 172.21.15.60:0/2112872744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0005040 con 0x7f35b40fe040 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.327+0000 7f35b1400700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009150 tx=0x7f35a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.328+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35a000e040 con 0x7f35b40fe040 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.328+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35a000bbf0 con 0x7f35b40fe040 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.328+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b4111390 con 0x7f35b40fe040 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.328+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35a001c630 con 0x7f35b40fe040 2024-04-12T13:39:22.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.328+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b4111950 con 0x7f35b40fe040 2024-04-12T13:39:22.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.329+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b41019d0 con 0x7f35b40fe040 2024-04-12T13:39:22.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.331+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f35a000bd60 con 0x7f35b40fe040 2024-04-12T13:39:22.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.333+0000 7f35aa000700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 0x7f359806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:22.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.333+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f35a00885c0 con 0x7f35b40fe040 2024-04-12T13:39:22.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.333+0000 7f35b1e00700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 0x7f359806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:22.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.334+0000 7f35b1e00700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 0x7f359806b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35a4006fd0 tx=0x7f35a4008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:22.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.338+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f35a0058410 con 0x7f35b40fe040 2024-04-12T13:39:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.555+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f35b405f5f0 con 0x7f35b40fe040 2024-04-12T13:39:22.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.556+0000 7f35aa000700 1 -- 172.21.15.60:0/2112872744 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f35a0057fa0 con 0x7f35b40fe040 2024-04-12T13:39:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 msgr2=0x7f359806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 0x7f359806b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35a4006fd0 tx=0x7f35a4008040 comp rx=0 tx=0).stop 2024-04-12T13:39:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 msgr2=0x7f35b4110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009150 tx=0x7f35a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 shutdown_connections 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f35980692b0 0x7f359806b760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b40fce40 0x7f35b410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 --2- 172.21.15.60:0/2112872744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35b40fe040 0x7f35b4110290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.559+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 >> 172.21.15.60:0/2112872744 conn(0x7f35b40f8530 msgr2=0x7f35b40f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.560+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 shutdown_connections 2024-04-12T13:39:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:22.560+0000 7f35b9200700 1 -- 172.21.15.60:0/2112872744 wait complete. 2024-04-12T13:39:23.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-12T13:39:23.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:23 smithi060 ceph-mon[29097]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T13:39:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:23 smithi110 ceph-mon[36055]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T13:39:24.029 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:25 smithi060 ceph-mon[29097]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-12T13:39:25.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:25 smithi110 ceph-mon[36055]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 -- 172.21.15.60:0/4106941115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 msgr2=0x7f30140fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 --2- 172.21.15.60:0/4106941115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f30140fe350 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3000004940 tx=0x7f3000009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 -- 172.21.15.60:0/4106941115 shutdown_connections 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 --2- 172.21.15.60:0/4106941115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f30140fe350 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 --2- 172.21.15.60:0/4106941115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 0x7f30140fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 -- 172.21.15.60:0/4106941115 >> 172.21.15.60:0/4106941115 conn(0x7f30140f83d0 msgr2=0x7f30140fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 -- 172.21.15.60:0/4106941115 shutdown_connections 2024-04-12T13:39:26.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.423+0000 7f3019600700 1 -- 172.21.15.60:0/4106941115 wait complete. 2024-04-12T13:39:26.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 Processor -- start 2024-04-12T13:39:26.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 -- start start 2024-04-12T13:39:26.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 0x7f301410fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:26.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:26.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141105d0 con 0x7f30140fdee0 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.424+0000 7f3019600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3014110e20 con 0x7f30140fcc30 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.425+0000 7f3013400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.425+0000 7f3013400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58964/0 (socket says 172.21.15.60:58964) 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.425+0000 7f3013400700 1 -- 172.21.15.60:0/2509953221 learned_addr learned my addr 172.21.15.60:0/2509953221 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.425+0000 7f3013e00700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 0x7f301410fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.426+0000 7f3013400700 1 -- 172.21.15.60:0/2509953221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 msgr2=0x7f301410fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:26.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.426+0000 7f3013400700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 0x7f301410fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.426+0000 7f3013400700 1 -- 172.21.15.60:0/2509953221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000005040 con 0x7f30140fdee0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.426+0000 7f3013400700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f300000b3b0 tx=0x7f3000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.427+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300000e040 con 0x7f30140fdee0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.427+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3000004290 con 0x7f30140fdee0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.427+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30141110a0 con 0x7f30140fdee0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.427+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300001c3f0 con 0x7f30140fdee0 2024-04-12T13:39:26.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.427+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30141115e0 con 0x7f30140fdee0 2024-04-12T13:39:26.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.429+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3014101870 con 0x7f30140fdee0 2024-04-12T13:39:26.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.429+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f300000bbf0 con 0x7f30140fdee0 2024-04-12T13:39:26.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.431+0000 7f300be00700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 0x7f2ff806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:26.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.431+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3000088400 con 0x7f30140fdee0 2024-04-12T13:39:26.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.431+0000 7f3013e00700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 0x7f2ff806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:26.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.432+0000 7f3013e00700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 0x7f2ff806b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30040041d0 tx=0x7f30040043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:26.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.436+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3000058260 con 0x7f30140fdee0 2024-04-12T13:39:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.682+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f3014105890 con 0x7f30140fdee0 2024-04-12T13:39:26.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.683+0000 7f300be00700 1 -- 172.21.15.60:0/2509953221 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3000057df0 con 0x7f30140fdee0 2024-04-12T13:39:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.685+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 msgr2=0x7f2ff806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.685+0000 7f3019600700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 0x7f2ff806b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30040041d0 tx=0x7f30040043c0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.685+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 msgr2=0x7f301410ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.685+0000 7f3019600700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f300000b3b0 tx=0x7f3000009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 shutdown_connections 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f2ff80692b0 0x7f2ff806b760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30140fcc30 0x7f301410fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 --2- 172.21.15.60:0/2509953221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30140fdee0 0x7f301410ffd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 >> 172.21.15.60:0/2509953221 conn(0x7f30140f83d0 msgr2=0x7f30140f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 shutdown_connections 2024-04-12T13:39:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:26.686+0000 7f3019600700 1 -- 172.21.15.60:0/2509953221 wait complete. 2024-04-12T13:39:27.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:27 smithi060 ceph-mon[29097]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:27.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-12T13:39:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:27 smithi110 ceph-mon[36055]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T13:39:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:29.406 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:29 smithi060 ceph-mon[29097]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:29 smithi110 ceph-mon[36055]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.272+0000 7f6904600700 1 -- 172.21.15.60:0/563166817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 msgr2=0x7f68fc0ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.272+0000 7f6904600700 1 --2- 172.21.15.60:0/563166817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc0ffab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009ce0 tx=0x7f68f0004d10 comp rx=0 tx=0).stop 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 -- 172.21.15.60:0/563166817 shutdown_connections 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 --2- 172.21.15.60:0/563166817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 0x7f68fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 --2- 172.21.15.60:0/563166817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc0ffab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 -- 172.21.15.60:0/563166817 >> 172.21.15.60:0/563166817 conn(0x7f68fc0f74e0 msgr2=0x7f68fc0f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 -- 172.21.15.60:0/563166817 shutdown_connections 2024-04-12T13:39:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.273+0000 7f6904600700 1 -- 172.21.15.60:0/563166817 wait complete. 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 Processor -- start 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 -- start start 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 0x7f68fc110440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc111160 con 0x7f68fc066b40 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.274+0000 7f6904600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc1112d0 con 0x7f68fc0ffff0 2024-04-12T13:39:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56412/0 (socket says 172.21.15.60:56412) 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 -- 172.21.15.60:0/3644264601 learned_addr learned my addr 172.21.15.60:0/3644264601 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901200700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 0x7f68fc110440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 -- 172.21.15.60:0/3644264601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 msgr2=0x7f68fc110440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 0x7f68fc110440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 -- 172.21.15.60:0/3644264601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0009940 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.275+0000 7f6901c00700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009910 tx=0x7f68f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.276+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68f000e040 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.276+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68f0008e20 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.276+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68f001c740 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.276+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc1114f0 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.276+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc111ab0 con 0x7f68fc066b40 2024-04-12T13:39:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.277+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc106100 con 0x7f68fc066b40 2024-04-12T13:39:30.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.278+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f68f0012b70 con 0x7f68fc066b40 2024-04-12T13:39:30.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.279+0000 7f68f9600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 0x7f68e406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:30.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.279+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f68f0088d60 con 0x7f68fc066b40 2024-04-12T13:39:30.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.280+0000 7f6901200700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 0x7f68e406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:30.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.281+0000 7f6901200700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 0x7f68e406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68e8004990 tx=0x7f68e8009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:30.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.284+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f68f0055010 con 0x7f68fc066b40 2024-04-12T13:39:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:30.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.527+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888", "target": ["mon-mgr", ""]}) v1 -- 0x7f68fc111d90 con 0x7f68e40692b0 2024-04-12T13:39:30.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.537+0000 7f68f9600700 1 -- 172.21.15.60:0/3644264601 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f68fc111d90 con 0x7f68e40692b0 2024-04-12T13:39:30.539 INFO:teuthology.orchestra.run.smithi060.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:39:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 msgr2=0x7f68e406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 0x7f68e406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68e8004990 tx=0x7f68e8009ee0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 msgr2=0x7f68fc10ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009910 tx=0x7f68f0004d10 comp rx=0 tx=0).stop 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 shutdown_connections 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f68e40692b0 0x7f68e406b760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68fc066b40 0x7f68fc10ff00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 --2- 172.21.15.60:0/3644264601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0ffff0 0x7f68fc110440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 >> 172.21.15.60:0/3644264601 conn(0x7f68fc0f74e0 msgr2=0x7f68fc0fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 shutdown_connections 2024-04-12T13:39:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:30.540+0000 7f6904600700 1 -- 172.21.15.60:0/3644264601 wait complete. 2024-04-12T13:39:30.601 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:31.377 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T13:39:31.377 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:39:31.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:39:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:31 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:39:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:39:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:39:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:39:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:39:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:31 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:39:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:39:32.311 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:32 smithi060 ceph-mon[29097]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:32.311 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:32 smithi060 ceph-mon[29097]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:39:32.312 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:32 smithi060 ceph-mon[29097]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:39:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:32 smithi110 ceph-mon[36055]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:32 smithi110 ceph-mon[36055]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:39:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:32 smithi110 ceph-mon[36055]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 2024-04-12T13:39:33.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:33 smithi060 ceph-mon[29097]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:33 smithi110 ceph-mon[36055]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 -- 172.21.15.60:0/3689296789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 msgr2=0x7fd310070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 --2- 172.21.15.60:0/3689296789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310070330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd300004940 tx=0x7fd300009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 -- 172.21.15.60:0/3689296789 shutdown_connections 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 --2- 172.21.15.60:0/3689296789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 0x7fd310070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 --2- 172.21.15.60:0/3689296789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310070330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 -- 172.21.15.60:0/3689296789 >> 172.21.15.60:0/3689296789 conn(0x7fd3100f8540 msgr2=0x7fd3100fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 -- 172.21.15.60:0/3689296789 shutdown_connections 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.458+0000 7fd315600700 1 -- 172.21.15.60:0/3689296789 wait complete. 2024-04-12T13:39:34.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.459+0000 7fd315600700 1 Processor -- start 2024-04-12T13:39:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.460+0000 7fd315600700 1 -- start start 2024-04-12T13:39:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.460+0000 7fd315600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 0x7fd31010fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.460+0000 7fd315600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.460+0000 7fd315600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310110860 con 0x7fd310071e30 2024-04-12T13:39:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.460+0000 7fd315600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd310110fa0 con 0x7fd310070870 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56430/0 (socket says 172.21.15.60:56430) 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 -- 172.21.15.60:0/1842933219 learned_addr learned my addr 172.21.15.60:0/1842933219 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30ea00700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 0x7fd31010fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 -- 172.21.15.60:0/1842933219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 msgr2=0x7fd31010fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 0x7fd31010fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.461+0000 7fd30e000700 1 -- 172.21.15.60:0/1842933219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300005040 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.462+0000 7fd30e000700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc002a50 tx=0x7fd2fc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.462+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc007cc0 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.462+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2fc00f040 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.462+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd310111280 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.462+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd310111840 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.463+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc00da60 con 0x7fd310071e30 2024-04-12T13:39:34.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.464+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f00052e0 con 0x7fd310071e30 2024-04-12T13:39:34.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.465+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd2fc00dbc0 con 0x7fd310071e30 2024-04-12T13:39:34.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.467+0000 7fd306a00700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 0x7fd2f406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:34.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.467+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd2fc086d30 con 0x7fd310071e30 2024-04-12T13:39:34.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.468+0000 7fd30ea00700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 0x7fd2f406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:34.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.469+0000 7fd30ea00700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 0x7fd2f406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd30000b3b0 tx=0x7fd300009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.473+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd2fc056af0 con 0x7fd310071e30 2024-04-12T13:39:34.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.840+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f0000bf0 con 0x7fd2f40692b0 2024-04-12T13:39:34.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.841+0000 7fd306a00700 1 -- 172.21.15.60:0/1842933219 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd2f0000bf0 con 0x7fd2f40692b0 2024-04-12T13:39:34.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.844+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 msgr2=0x7fd2f406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.844+0000 7fd315600700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 0x7fd2f406b760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd30000b3b0 tx=0x7fd300009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.844+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 msgr2=0x7fd310110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.844+0000 7fd315600700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc002a50 tx=0x7fd2fc0046b0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 shutdown_connections 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fd2f40692b0 0x7fd2f406b760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd310070870 0x7fd31010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 --2- 172.21.15.60:0/1842933219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310071e30 0x7fd310110260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:34.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 >> 172.21.15.60:0/1842933219 conn(0x7fd3100f8540 msgr2=0x7fd3100f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:34.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 shutdown_connections 2024-04-12T13:39:34.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:34.845+0000 7fd315600700 1 -- 172.21.15.60:0/1842933219 wait complete. 2024-04-12T13:39:34.866 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:39:35.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.062+0000 7f59c1e00700 1 -- 172.21.15.60:0/3946500666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06e9b0 msgr2=0x7f59bc06ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.062+0000 7f59c1e00700 1 --2- 172.21.15.60:0/3946500666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06e9b0 0x7f59bc06ee20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f59a8004940 tx=0x7f59a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:35.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 -- 172.21.15.60:0/3946500666 shutdown_connections 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 --2- 172.21.15.60:0/3946500666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06e9b0 0x7f59bc06ee20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 --2- 172.21.15.60:0/3946500666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06f9c0 0x7f59bc06e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 -- 172.21.15.60:0/3946500666 >> 172.21.15.60:0/3946500666 conn(0x7f59bc069df0 msgr2=0x7f59bc06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 -- 172.21.15.60:0/3946500666 shutdown_connections 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.063+0000 7f59c1e00700 1 -- 172.21.15.60:0/3946500666 wait complete. 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.064+0000 7f59c1e00700 1 Processor -- start 2024-04-12T13:39:35.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.064+0000 7f59c1e00700 1 -- start start 2024-04-12T13:39:35.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59c1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06e9b0 0x7f59bc113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59c1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59c1e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1149a0 con 0x7f59bc06f9c0 2024-04-12T13:39:35.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59c1e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc114b10 con 0x7f59bc06e9b0 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59ba000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59ba000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56454/0 (socket says 172.21.15.60:56454) 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59ba000700 1 -- 172.21.15.60:0/2691703087 learned_addr learned my addr 172.21.15.60:0/2691703087 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.065+0000 7f59baa00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06e9b0 0x7f59bc113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.066+0000 7f59ba000700 1 -- 172.21.15.60:0/2691703087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06e9b0 msgr2=0x7f59bc113e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.066+0000 7f59ba000700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06e9b0 0x7f59bc113e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.066+0000 7f59ba000700 1 -- 172.21.15.60:0/2691703087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8005040 con 0x7f59bc06f9c0 2024-04-12T13:39:35.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.066+0000 7f59ba000700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59a8013870 tx=0x7f59a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:35.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.067+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a800e070 con 0x7f59bc06f9c0 2024-04-12T13:39:35.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.067+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59a800b410 con 0x7f59bc06f9c0 2024-04-12T13:39:35.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.067+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc119510 con 0x7f59bc06f9c0 2024-04-12T13:39:35.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.067+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a80125c0 con 0x7f59bc06f9c0 2024-04-12T13:39:35.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.067+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc119ad0 con 0x7f59bc06f9c0 2024-04-12T13:39:35.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.068+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc04c710 con 0x7f59bc06f9c0 2024-04-12T13:39:35.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.070+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f59a800b580 con 0x7f59bc06f9c0 2024-04-12T13:39:35.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.072+0000 7f59b2a00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 0x7f59a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.072+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f59a8087ec0 con 0x7f59bc06f9c0 2024-04-12T13:39:35.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.072+0000 7f59baa00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 0x7f59a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.073+0000 7f59baa00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 0x7f59a006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59ac004600 tx=0x7f59ac011040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.078+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f59a8057c60 con 0x7f59bc06f9c0 2024-04-12T13:39:35.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.431+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59bc10a250 con 0x7f59a00692a0 2024-04-12T13:39:35.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.432+0000 7f59b2a00700 1 -- 172.21.15.60:0/2691703087 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f59bc10a250 con 0x7f59a00692a0 2024-04-12T13:39:35.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.435+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 msgr2=0x7f59a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.435+0000 7f59c1e00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 0x7f59a006b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59ac004600 tx=0x7f59ac011040 comp rx=0 tx=0).stop 2024-04-12T13:39:35.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.435+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 msgr2=0x7f59bc1143a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.435+0000 7f59c1e00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59a8013870 tx=0x7f59a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:35.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 shutdown_connections 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f59a00692a0 0x7f59a006b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59bc06e9b0 0x7f59bc113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 --2- 172.21.15.60:0/2691703087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59bc06f9c0 0x7f59bc1143a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 >> 172.21.15.60:0/2691703087 conn(0x7f59bc069df0 msgr2=0x7f59bc06b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 shutdown_connections 2024-04-12T13:39:35.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.436+0000 7f59c1e00700 1 -- 172.21.15.60:0/2691703087 wait complete. 2024-04-12T13:39:35.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.640+0000 7f651aa00700 1 -- 172.21.15.60:0/1085523379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 msgr2=0x7f65140fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.640+0000 7f651aa00700 1 --2- 172.21.15.60:0/1085523379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f65140fd320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6504004940 tx=0x7f6504009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:35.643 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:35 smithi060 ceph-mon[29097]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-12T13:39:35.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.641+0000 7f651aa00700 1 -- 172.21.15.60:0/1085523379 shutdown_connections 2024-04-12T13:39:35.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.641+0000 7f651aa00700 1 --2- 172.21.15.60:0/1085523379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f65140fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.641+0000 7f651aa00700 1 --2- 172.21.15.60:0/1085523379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f65140fd320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.641+0000 7f651aa00700 1 -- 172.21.15.60:0/1085523379 >> 172.21.15.60:0/1085523379 conn(0x7f65140f8530 msgr2=0x7f65140fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:35.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.642+0000 7f651aa00700 1 -- 172.21.15.60:0/1085523379 shutdown_connections 2024-04-12T13:39:35.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.642+0000 7f651aa00700 1 -- 172.21.15.60:0/1085523379 wait complete. 2024-04-12T13:39:35.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.643+0000 7f651aa00700 1 Processor -- start 2024-04-12T13:39:35.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.643+0000 7f651aa00700 1 -- start start 2024-04-12T13:39:35.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f651aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f651aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f651406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f651aa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651406ffd0 con 0x7f65140fcef0 2024-04-12T13:39:35.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f651aa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651406ee10 con 0x7f65140fe0e0 2024-04-12T13:39:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f6513e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f6513e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56458/0 (socket says 172.21.15.60:56458) 2024-04-12T13:39:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f6513400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f651406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.644+0000 7f6513e00700 1 -- 172.21.15.60:0/381933063 learned_addr learned my addr 172.21.15.60:0/381933063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.645+0000 7f6513400700 1 -- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 msgr2=0x7f651406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.645+0000 7f6513400700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.645+0000 7f6513400700 1 -- 172.21.15.60:0/381933063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504005040 con 0x7f65140fe0e0 2024-04-12T13:39:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.645+0000 7f6513e00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:39:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.646+0000 7f6513400700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f651406e8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6500011d00 tx=0x7f6500004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:35.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.647+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6500007ea0 con 0x7f65140fe0e0 2024-04-12T13:39:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.647+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651406f0f0 con 0x7f65140fe0e0 2024-04-12T13:39:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.647+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6514070460 con 0x7f65140fe0e0 2024-04-12T13:39:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.647+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6500011e60 con 0x7f65140fe0e0 2024-04-12T13:39:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.647+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65000185d0 con 0x7f65140fe0e0 2024-04-12T13:39:35.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.649+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f40052e0 con 0x7f65140fe0e0 2024-04-12T13:39:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.650+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f65000028d0 con 0x7f65140fe0e0 2024-04-12T13:39:35.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.651+0000 7f650be00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 0x7f64f806b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.651+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f650008af60 con 0x7f65140fe0e0 2024-04-12T13:39:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.652+0000 7f6513e00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 0x7f64f806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:35.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.653+0000 7f6513e00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 0x7f64f806b830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fd0 tx=0x7f6504009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:35.669+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f650005ac80 con 0x7f65140fe0e0 2024-04-12T13:39:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:35 smithi110 ceph-mon[36055]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-12T13:39:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.010+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f4000bf0 con 0x7f64f8069380 2024-04-12T13:39:36.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.025+0000 7f650be00700 1 -- 172.21.15.60:0/381933063 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f64f4000bf0 con 0x7f64f8069380 2024-04-12T13:39:36.027 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (6m) 45s ago 8m 13.2M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (8m) 45s ago 8m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (7m) 51s ago 7m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (6m) 45s ago 8m 74.9M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (69s) 45s ago 68s 10.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (77s) 45s ago 76s 13.2M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (73s) 51s ago 73s 10.5M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (65s) 51s ago 65s 10.5M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (10m) 45s ago 10m 483M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (7m) 51s ago 7m 432M - 17.2.7-845-g730340d7 036a68d49952 ed3d7d27e5fe 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (10m) 45s ago 10m 41.1M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (7m) 51s ago 7m 34.5M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 45s ago 8m 7625k - 1.5.0 0da6a335fe13 5baa779bb80b 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 51s ago 7m 7684k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:39:36.028 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 45s ago 6m 44.4M 4290M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 45s ago 5m 45.0M 4290M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 45s ago 4m 43.3M 4290M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (4m) 51s ago 4m 44.7M 5312M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (3m) 51s ago 3m 42.7M 5312M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (3m) 51s ago 3m 40.5M 5312M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:39:36.029 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 45s ago 7m 45.1M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:39:36.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 msgr2=0x7f64f806b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 0x7f64f806b830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fd0 tx=0x7f6504009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 msgr2=0x7f651406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f651406e8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6500011d00 tx=0x7f6500004570 comp rx=0 tx=0).stop 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 shutdown_connections 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f64f8069380 0x7f64f806b830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65140fcef0 0x7f651406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 --2- 172.21.15.60:0/381933063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65140fe0e0 0x7f651406e8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.028+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 >> 172.21.15.60:0/381933063 conn(0x7f65140f8530 msgr2=0x7f65140f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.029+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 shutdown_connections 2024-04-12T13:39:36.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.029+0000 7f651aa00700 1 -- 172.21.15.60:0/381933063 wait complete. 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 -- 172.21.15.60:0/3046179044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d4103400 msgr2=0x7f97d4103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 --2- 172.21.15.60:0/3046179044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d4103400 0x7f97d4103810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97c4004940 tx=0x7f97c4009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 -- 172.21.15.60:0/3046179044 shutdown_connections 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 --2- 172.21.15.60:0/3046179044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d41046b0 0x7f97d4104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 --2- 172.21.15.60:0/3046179044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d4103400 0x7f97d4103810 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 -- 172.21.15.60:0/3046179044 >> 172.21.15.60:0/3046179044 conn(0x7f97d40725e0 msgr2=0x7f97d4074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:36.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 -- 172.21.15.60:0/3046179044 shutdown_connections 2024-04-12T13:39:36.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.238+0000 7f97da400700 1 -- 172.21.15.60:0/3046179044 wait complete. 2024-04-12T13:39:36.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.239+0000 7f97da400700 1 Processor -- start 2024-04-12T13:39:36.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.240+0000 7f97da400700 1 -- start start 2024-04-12T13:39:36.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.240+0000 7f97da400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.240+0000 7f97da400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4114590 0x7f97d41195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.240+0000 7f97da400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4114a50 con 0x7f97d41046b0 2024-04-12T13:39:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.240+0000 7f97da400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4114b90 con 0x7f97d4114590 2024-04-12T13:39:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4114590 0x7f97d41195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56476/0 (socket says 172.21.15.60:56476) 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 -- 172.21.15.60:0/3637235476 learned_addr learned my addr 172.21.15.60:0/3637235476 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 -- 172.21.15.60:0/3637235476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4114590 msgr2=0x7f97d41195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4114590 0x7f97d41195c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.241+0000 7f97d3400700 1 -- 172.21.15.60:0/3637235476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4005040 con 0x7f97d41046b0 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.242+0000 7f97d3400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.242+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c400e070 con 0x7f97d41046b0 2024-04-12T13:39:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.242+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d4119b00 con 0x7f97d41046b0 2024-04-12T13:39:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.242+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97c4013de0 con 0x7f97d41046b0 2024-04-12T13:39:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.243+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4119f50 con 0x7f97d41046b0 2024-04-12T13:39:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.243+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c401cd70 con 0x7f97d41046b0 2024-04-12T13:39:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.245+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b00052e0 con 0x7f97d41046b0 2024-04-12T13:39:36.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.246+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f97c4013910 con 0x7f97d41046b0 2024-04-12T13:39:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.247+0000 7f97cb400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 0x7f97b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.247+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f97c4088670 con 0x7f97d41046b0 2024-04-12T13:39:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.248+0000 7f97d2a00700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 0x7f97b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.249+0000 7f97d2a00700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 0x7f97b806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009b80 tx=0x7f97bc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:36.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.252+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f97c4058410 con 0x7f97d41046b0 2024-04-12T13:39:36.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:36 smithi060 ceph-mon[29097]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:36 smithi110 ceph-mon[36055]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:36.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.753+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97b0005da0 con 0x7f97d41046b0 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.754+0000 7f97cb400700 1 -- 172.21.15.60:0/3637235476 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f97c4057fa0 con 0x7f97d41046b0 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:36.756 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 14 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:39:36.757 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:39:36.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 msgr2=0x7f97b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 0x7f97b806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009b80 tx=0x7f97bc00b040 comp rx=0 tx=0).stop 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 msgr2=0x7f97d4114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 shutdown_connections 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f97b80692a0 0x7f97b806b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97d41046b0 0x7f97d4114050 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f97c4000c00 tx=0x7f97c4009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 --2- 172.21.15.60:0/3637235476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97d4114590 0x7f97d41195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.757+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 >> 172.21.15.60:0/3637235476 conn(0x7f97d40725e0 msgr2=0x7f97d4073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.761+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 shutdown_connections 2024-04-12T13:39:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.761+0000 7f97da400700 1 -- 172.21.15.60:0/3637235476 wait complete. 2024-04-12T13:39:36.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 -- 172.21.15.60:0/2528584063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840662d0 msgr2=0x7f93840ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 --2- 172.21.15.60:0/2528584063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840662d0 0x7f93840ff820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9378004940 tx=0x7f9378009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:36.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 -- 172.21.15.60:0/2528584063 shutdown_connections 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 --2- 172.21.15.60:0/2528584063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840ffd60 0x7f9384102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 --2- 172.21.15.60:0/2528584063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840662d0 0x7f93840ff820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 -- 172.21.15.60:0/2528584063 >> 172.21.15.60:0/2528584063 conn(0x7f93840f7270 msgr2=0x7f93840f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 -- 172.21.15.60:0/2528584063 shutdown_connections 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.957+0000 7f938b000700 1 -- 172.21.15.60:0/2528584063 wait complete. 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.958+0000 7f938b000700 1 Processor -- start 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.958+0000 7f938b000700 1 -- start start 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f938b000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840662d0 0x7f938410fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f938b000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f938b000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93841105f0 con 0x7f93840ffd60 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f938b000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384110e40 con 0x7f93840662d0 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f9389200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f9389200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56492/0 (socket says 172.21.15.60:56492) 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f9389200700 1 -- 172.21.15.60:0/2906673307 learned_addr learned my addr 172.21.15.60:0/2906673307 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:36.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.959+0000 7f9389c00700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840662d0 0x7f938410fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.960+0000 7f9389200700 1 -- 172.21.15.60:0/2906673307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840662d0 msgr2=0x7f938410fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:36.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.960+0000 7f9389200700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840662d0 0x7f938410fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:36.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.960+0000 7f9389200700 1 -- 172.21.15.60:0/2906673307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378005040 con 0x7f93840ffd60 2024-04-12T13:39:36.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.960+0000 7f9389200700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9370002a50 tx=0x7f93700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:36.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.960+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9370007cc0 con 0x7f93840ffd60 2024-04-12T13:39:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.961+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937000f040 con 0x7f93840ffd60 2024-04-12T13:39:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.961+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937000da30 con 0x7f93840ffd60 2024-04-12T13:39:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.961+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384111120 con 0x7f93840ffd60 2024-04-12T13:39:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.961+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9384111660 con 0x7f93840ffd60 2024-04-12T13:39:36.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.962+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938405f5f0 con 0x7f93840ffd60 2024-04-12T13:39:36.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.963+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f937000dbb0 con 0x7f93840ffd60 2024-04-12T13:39:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.966+0000 7f9381600700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 0x7f936c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.966+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9370086f30 con 0x7f93840ffd60 2024-04-12T13:39:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.968+0000 7f9389c00700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 0x7f936c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:36.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.969+0000 7f9389c00700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 0x7f936c06b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:36.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:36.974+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f93700569c0 con 0x7f93840ffd60 2024-04-12T13:39:37.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.364+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f938404bed0 con 0x7f93840ffd60 2024-04-12T13:39:37.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.365+0000 7f9381600700 1 -- 172.21.15.60:0/2906673307 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f93700567e0 con 0x7f93840ffd60 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:39:37.368 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:39:37.369 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:39:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.368+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 msgr2=0x7f936c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.368+0000 7f938b000700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 0x7f936c06b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9378000c00 tx=0x7f9378009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.368+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 msgr2=0x7f938410fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.368+0000 7f938b000700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9370002a50 tx=0x7f93700046b0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 shutdown_connections 2024-04-12T13:39:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f936c0692b0 0x7f936c06b760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93840662d0 0x7f938410fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 --2- 172.21.15.60:0/2906673307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93840ffd60 0x7f938410fff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 >> 172.21.15.60:0/2906673307 conn(0x7f93840f7270 msgr2=0x7f93840fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 shutdown_connections 2024-04-12T13:39:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.369+0000 7f938b000700 1 -- 172.21.15.60:0/2906673307 wait complete. 2024-04-12T13:39:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:39:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 -- 172.21.15.60:0/600546906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 msgr2=0x7f26080fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 --2- 172.21.15.60:0/600546906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f26080fd1d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25fc004940 tx=0x7f25fc009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:37.552 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:37 smithi060 ceph-mon[29097]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:37.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:37 smithi060 ceph-mon[29097]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:37.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:37 smithi060 ceph-mon[29097]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:37.553 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:37 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3637235476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:39:37.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 -- 172.21.15.60:0/600546906 shutdown_connections 2024-04-12T13:39:37.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 --2- 172.21.15.60:0/600546906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 0x7f26080fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 --2- 172.21.15.60:0/600546906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f26080fd1d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.549+0000 7f2610000700 1 -- 172.21.15.60:0/600546906 >> 172.21.15.60:0/600546906 conn(0x7f26080f8540 msgr2=0x7f26080fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:37.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.550+0000 7f2610000700 1 -- 172.21.15.60:0/600546906 shutdown_connections 2024-04-12T13:39:37.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.550+0000 7f2610000700 1 -- 172.21.15.60:0/600546906 wait complete. 2024-04-12T13:39:37.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 Processor -- start 2024-04-12T13:39:37.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 -- start start 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 0x7f2608110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608110750 con 0x7f26080fcdc0 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.551+0000 7f2610000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608110fa0 con 0x7f26080fd710 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56520/0 (socket says 172.21.15.60:56520) 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 -- 172.21.15.60:0/1863432563 learned_addr learned my addr 172.21.15.60:0/1863432563 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260cc00700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 0x7f2608110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 -- 172.21.15.60:0/1863432563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 msgr2=0x7f2608110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 0x7f2608110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.552+0000 7f260d600700 1 -- 172.21.15.60:0/1863432563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc005040 con 0x7f26080fcdc0 2024-04-12T13:39:37.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.553+0000 7f260d600700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f25fc004090 tx=0x7f25fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:37.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.553+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25fc021070 con 0x7f26080fcdc0 2024-04-12T13:39:37.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.553+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25fc01c400 con 0x7f26080fcdc0 2024-04-12T13:39:37.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.553+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25fc00e070 con 0x7f26080fcdc0 2024-04-12T13:39:37.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.553+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2608111220 con 0x7f26080fcdc0 2024-04-12T13:39:37.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.554+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26081116b0 con 0x7f26080fcdc0 2024-04-12T13:39:37.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.556+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2608101a60 con 0x7f26080fcdc0 2024-04-12T13:39:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.558+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f25fc01ca50 con 0x7f26080fcdc0 2024-04-12T13:39:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.559+0000 7f2605600700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 0x7f25f006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:37.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.560+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f25fc089d60 con 0x7f26080fcdc0 2024-04-12T13:39:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.560+0000 7f260cc00700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 0x7f25f006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.562+0000 7f260cc00700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 0x7f25f006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009b80 tx=0x7f25f400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.566+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f25fc08d060 con 0x7f26080fcdc0 2024-04-12T13:39:37.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:37 smithi110 ceph-mon[36055]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:37.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:37 smithi110 ceph-mon[36055]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:37.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:37 smithi110 ceph-mon[36055]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:37.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:37 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3637235476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:39:37.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.902+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2608111920 con 0x7f25f00692b0 2024-04-12T13:39:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.904+0000 7f2605600700 1 -- 172.21.15.60:0/1863432563 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2608111920 con 0x7f25f00692b0 2024-04-12T13:39:37.906 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:39:37.906 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888", 2024-04-12T13:39:37.906 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:39:37.906 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:39:37.907 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:39:37.907 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "", 2024-04-12T13:39:37.907 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 image", 2024-04-12T13:39:37.907 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:39:37.907 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.906+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 msgr2=0x7f25f006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.906+0000 7f2610000700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 0x7f25f006b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009b80 tx=0x7f25f400b040 comp rx=0 tx=0).stop 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 msgr2=0x7f260810fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f25fc004090 tx=0x7f25fc009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 shutdown_connections 2024-04-12T13:39:37.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f25f00692b0 0x7f25f006b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26080fcdc0 0x7f260810fc10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 --2- 172.21.15.60:0/1863432563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080fd710 0x7f2608110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:37.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 >> 172.21.15.60:0/1863432563 conn(0x7f26080f8540 msgr2=0x7f26080f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:37.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 shutdown_connections 2024-04-12T13:39:37.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:37.907+0000 7f2610000700 1 -- 172.21.15.60:0/1863432563 wait complete. 2024-04-12T13:39:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.078+0000 7f5e14c00700 1 -- 172.21.15.60:0/445281763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 msgr2=0x7f5e100ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.078+0000 7f5e14c00700 1 --2- 172.21.15.60:0/445281763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e100ffa90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e00004940 tx=0x7f5e00009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:38.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 -- 172.21.15.60:0/445281763 shutdown_connections 2024-04-12T13:39:38.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 --2- 172.21.15.60:0/445281763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 0x7f5e101023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:38.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 --2- 172.21.15.60:0/445281763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e100ffa90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:38.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 -- 172.21.15.60:0/445281763 >> 172.21.15.60:0/445281763 conn(0x7f5e100f74c0 msgr2=0x7f5e100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:38.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 -- 172.21.15.60:0/445281763 shutdown_connections 2024-04-12T13:39:38.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.080+0000 7f5e14c00700 1 -- 172.21.15.60:0/445281763 wait complete. 2024-04-12T13:39:38.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.081+0000 7f5e14c00700 1 Processor -- start 2024-04-12T13:39:38.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.082+0000 7f5e14c00700 1 -- start start 2024-04-12T13:39:38.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.082+0000 7f5e14c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.082+0000 7f5e14c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 0x7f5e1010df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.082+0000 7f5e14c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1010e580 con 0x7f5e10066290 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.082+0000 7f5e14c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1010ed80 con 0x7f5e100fffd0 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56534/0 (socket says 172.21.15.60:56534) 2024-04-12T13:39:38.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 -- 172.21.15.60:0/1428307680 learned_addr learned my addr 172.21.15.60:0/1428307680 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:39:38.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0d400700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 0x7f5e1010df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:38.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 -- 172.21.15.60:0/1428307680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 msgr2=0x7f5e1010df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:38.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 0x7f5e1010df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:38.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.083+0000 7f5e0de00700 1 -- 172.21.15.60:0/1428307680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00005040 con 0x7f5e10066290 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.084+0000 7f5e0de00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000b0d0 tx=0x7f5e00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.085+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0000e070 con 0x7f5e10066290 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.085+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e00013de0 con 0x7f5e10066290 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.085+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0000be30 con 0x7f5e10066290 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.085+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1010f000 con 0x7f5e10066290 2024-04-12T13:39:38.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.085+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1010f4f0 con 0x7f5e10066290 2024-04-12T13:39:38.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.086+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1005f5f0 con 0x7f5e10066290 2024-04-12T13:39:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.088+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5e0000b680 con 0x7f5e10066290 2024-04-12T13:39:38.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.090+0000 7f5e06000700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 0x7f5df406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:39:38.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.091+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5e00087f10 con 0x7f5e10066290 2024-04-12T13:39:38.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.092+0000 7f5e0d400700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 0x7f5df406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:39:38.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.093+0000 7f5e0d400700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 0x7f5df406fc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009b80 tx=0x7f5dfc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:39:38.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.096+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5e00057cb0 con 0x7f5e10066290 2024-04-12T13:39:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.615+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5e1004bed0 con 0x7f5e10066290 2024-04-12T13:39:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.616+0000 7f5e06000700 1 -- 172.21.15.60:0/1428307680 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5e00057840 con 0x7f5e10066290 2024-04-12T13:39:38.619 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:38 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2906673307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:39:38.619 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.619+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 msgr2=0x7f5df406fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.619+0000 7f5e14c00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 0x7f5df406fc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009b80 tx=0x7f5dfc00b040 comp rx=0 tx=0).stop 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.619+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 msgr2=0x7f5e1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.619+0000 7f5e14c00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000b0d0 tx=0x7f5e00009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.620+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 shutdown_connections 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.620+0000 7f5e14c00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5df406d770 0x7f5df406fc20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.620+0000 7f5e14c00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e10066290 0x7f5e1010da40 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000b0d0 tx=0x7f5e00009e30 comp rx=0 tx=0).stop 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.620+0000 7f5e14c00700 1 --2- 172.21.15.60:0/1428307680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e100fffd0 0x7f5e1010df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:39:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.620+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 >> 172.21.15.60:0/1428307680 conn(0x7f5e100f74c0 msgr2=0x7f5e100f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:39:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.621+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 shutdown_connections 2024-04-12T13:39:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:39:38.621+0000 7f5e14c00700 1 -- 172.21.15.60:0/1428307680 wait complete. 2024-04-12T13:39:38.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:38 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2906673307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:39:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:39 smithi060 ceph-mon[29097]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:39 smithi060 ceph-mon[29097]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:39 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1428307680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:39:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:39 smithi110 ceph-mon[36055]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:39:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:39 smithi110 ceph-mon[36055]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:39 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1428307680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:39:41.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:41 smithi060 ceph-mon[29097]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:41 smithi110 ceph-mon[36055]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:43.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:43 smithi060 ceph-mon[29097]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:43.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:43 smithi110 ceph-mon[36055]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:45.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:45 smithi060 ceph-mon[29097]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:45.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:45 smithi110 ceph-mon[36055]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:39:47.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:47 smithi060 ceph-mon[29097]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:47 smithi110 ceph-mon[36055]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:48.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:48 smithi060 ceph-mon[29097]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:48.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:48 smithi110 ceph-mon[36055]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:51.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:51 smithi060 ceph-mon[29097]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:51 smithi110 ceph-mon[36055]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:53 smithi060 ceph-mon[29097]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:53 smithi110 ceph-mon[36055]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:55.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:55 smithi060 ceph-mon[29097]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:55 smithi110 ceph-mon[36055]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:57.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:57 smithi060 ceph-mon[29097]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:57.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:57 smithi110 ceph-mon[36055]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:59.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:39:59 smithi060 ceph-mon[29097]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:39:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:39:59 smithi110 ceph-mon[36055]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:00 smithi060 ceph-mon[29097]: overall HEALTH_OK 2024-04-12T13:40:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:00 smithi110 ceph-mon[36055]: overall HEALTH_OK 2024-04-12T13:40:01.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:01 smithi060 ceph-mon[29097]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:01 smithi110 ceph-mon[36055]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:03.117 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:03 smithi060 ceph-mon[29097]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:03 smithi110 ceph-mon[36055]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:05.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:05 smithi060 ceph-mon[29097]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:05 smithi110 ceph-mon[36055]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:07.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:07 smithi060 ceph-mon[29097]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:07 smithi110 ceph-mon[36055]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:07.694 INFO:tasks.workunit.client.1.smithi110.stderr:Updating files: 75% (8565/11369) Updating files: 76% (8641/11369) Updating files: 77% (8755/11369) Updating files: 78% (8868/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-04-12T13:40:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 -- 172.21.15.60:0/1922912455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fdee0 msgr2=0x7fdff40fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 --2- 172.21.15.60:0/1922912455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fdee0 0x7fdff40fe350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0004940 tx=0x7fdfe0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 -- 172.21.15.60:0/1922912455 shutdown_connections 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 --2- 172.21.15.60:0/1922912455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fdee0 0x7fdff40fe350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 --2- 172.21.15.60:0/1922912455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fcc30 0x7fdff40fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 -- 172.21.15.60:0/1922912455 >> 172.21.15.60:0/1922912455 conn(0x7fdff40f83d0 msgr2=0x7fdff40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 -- 172.21.15.60:0/1922912455 shutdown_connections 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.826+0000 7fdffaa00700 1 -- 172.21.15.60:0/1922912455 wait complete. 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.827+0000 7fdffaa00700 1 Processor -- start 2024-04-12T13:40:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.827+0000 7fdffaa00700 1 -- start start 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdffaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdffaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fdee0 0x7fdff4070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdffaa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40708c0 con 0x7fdff40fcc30 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdffaa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4070a30 con 0x7fdff40fdee0 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdff9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdff9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53712/0 (socket says 172.21.15.60:53712) 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdff9600700 1 -- 172.21.15.60:0/3295620370 learned_addr learned my addr 172.21.15.60:0/3295620370 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.828+0000 7fdff8c00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fdee0 0x7fdff4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff9600700 1 -- 172.21.15.60:0/3295620370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fdee0 msgr2=0x7fdff4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff9600700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fdee0 0x7fdff4070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff9600700 1 -- 172.21.15.60:0/3295620370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0005040 con 0x7fdff40fcc30 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff9600700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c830 tx=0x7fdfe8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe800a760 con 0x7fdff40fcc30 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfe800ad90 con 0x7fdff40fcc30 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.829+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff4070d10 con 0x7fdff40fcc30 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.830+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe80113a0 con 0x7fdff40fcc30 2024-04-12T13:40:08.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.830+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4115870 con 0x7fdff40fcc30 2024-04-12T13:40:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.831+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40052e0 con 0x7fdff40fcc30 2024-04-12T13:40:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.833+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdfe800a8c0 con 0x7fdff40fcc30 2024-04-12T13:40:08.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.834+0000 7fdff1600700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 0x7fdfdc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:08.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.834+0000 7fdff8c00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 0x7fdfdc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:08.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.835+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdfe8012770 con 0x7fdff40fcc30 2024-04-12T13:40:08.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.835+0000 7fdff8c00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 0x7fdfdc06b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000b3b0 tx=0x7fdfe0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:08.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:08.839+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdfe8052c20 con 0x7fdff40fcc30 2024-04-12T13:40:09.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.091+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfd4000bf0 con 0x7fdfdc0692b0 2024-04-12T13:40:09.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.093+0000 7fdff1600700 1 -- 172.21.15.60:0/3295620370 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fdfd4000bf0 con 0x7fdfdc0692b0 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 msgr2=0x7fdfdc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 0x7fdfdc06b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000b3b0 tx=0x7fdfe0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 msgr2=0x7fdff4071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c830 tx=0x7fdfe8004470 comp rx=0 tx=0).stop 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 shutdown_connections 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fdfdc0692b0 0x7fdfdc06b760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff40fcc30 0x7fdff4071e40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 --2- 172.21.15.60:0/3295620370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff40fdee0 0x7fdff4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 >> 172.21.15.60:0/3295620370 conn(0x7fdff40f83d0 msgr2=0x7fdff40f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 shutdown_connections 2024-04-12T13:40:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.096+0000 7fdffaa00700 1 -- 172.21.15.60:0/3295620370 wait complete. 2024-04-12T13:40:09.111 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:Note: switching to '35087f9f8bbf4292364e0bbb9a4062d5cd47de0a'. 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-12T13:40:09.190 INFO:tasks.workunit.client.1.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: git switch -c 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr:Or undo this operation with: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: git switch - 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr: 2024-04-12T13:40:09.191 INFO:tasks.workunit.client.1.smithi110.stderr:HEAD is now at 35087f9f8bb qa: use custom quincy build for testing 2024-04-12T13:40:09.201 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-12T13:40:09.263 INFO:tasks.workunit.client.1.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-12T13:40:09.271 INFO:tasks.workunit.client.1.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-12T13:40:09.271 INFO:tasks.workunit.client.1.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.297+0000 7f5139a00700 1 -- 172.21.15.60:0/4118548691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fcef0 msgr2=0x7f51340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.297+0000 7f5139a00700 1 --2- 172.21.15.60:0/4118548691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fcef0 0x7f51340fd320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5124004940 tx=0x7f5124009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 -- 172.21.15.60:0/4118548691 shutdown_connections 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 --2- 172.21.15.60:0/4118548691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fe0e0 0x7f51340fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 --2- 172.21.15.60:0/4118548691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fcef0 0x7f51340fd320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 -- 172.21.15.60:0/4118548691 >> 172.21.15.60:0/4118548691 conn(0x7f51340f8530 msgr2=0x7f51340fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 -- 172.21.15.60:0/4118548691 shutdown_connections 2024-04-12T13:40:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.298+0000 7f5139a00700 1 -- 172.21.15.60:0/4118548691 wait complete. 2024-04-12T13:40:09.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.299+0000 7f5139a00700 1 Processor -- start 2024-04-12T13:40:09.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.299+0000 7f5139a00700 1 -- start start 2024-04-12T13:40:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5139a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fcef0 0x7f513410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5139a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5139a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134110730 con 0x7f51340fe0e0 2024-04-12T13:40:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5139a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134110f80 con 0x7f51340fcef0 2024-04-12T13:40:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5132000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5132000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42080/0 (socket says 172.21.15.60:42080) 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5132000700 1 -- 172.21.15.60:0/751082602 learned_addr learned my addr 172.21.15.60:0/751082602 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.300+0000 7f5132a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fcef0 0x7f513410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.301+0000 7f5132000700 1 -- 172.21.15.60:0/751082602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fcef0 msgr2=0x7f513410fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.301+0000 7f5132000700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fcef0 0x7f513410fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.301+0000 7f5132000700 1 -- 172.21.15.60:0/751082602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124005040 con 0x7f51340fe0e0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.301+0000 7f5132000700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f512000eb40 tx=0x7f512000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.302+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5120007cc0 con 0x7f51340fe0e0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.302+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f512000f040 con 0x7f51340fe0e0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.302+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5134111200 con 0x7f51340fe0e0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.302+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5134111740 con 0x7f51340fe0e0 2024-04-12T13:40:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.302+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512000ca10 con 0x7f51340fe0e0 2024-04-12T13:40:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.303+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51140052e0 con 0x7f51340fe0e0 2024-04-12T13:40:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.304+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f512000cb70 con 0x7f51340fe0e0 2024-04-12T13:40:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.306+0000 7f512aa00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 0x7f511806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.306+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5120086c70 con 0x7f51340fe0e0 2024-04-12T13:40:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.307+0000 7f5132a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 0x7f511806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.308+0000 7f5132a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 0x7f511806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5124013870 tx=0x7f5124009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:09.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.312+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f512004e250 con 0x7f51340fe0e0 2024-04-12T13:40:09.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:09 smithi060 ceph-mon[29097]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:09 smithi110 ceph-mon[36055]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:09.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.566+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5114000bf0 con 0x7f51180692b0 2024-04-12T13:40:09.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.567+0000 7f512aa00700 1 -- 172.21.15.60:0/751082602 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5114000bf0 con 0x7f51180692b0 2024-04-12T13:40:09.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 msgr2=0x7f511806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 0x7f511806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5124013870 tx=0x7f5124009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:09.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 msgr2=0x7f5134110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f512000eb40 tx=0x7f512000b040 comp rx=0 tx=0).stop 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 shutdown_connections 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f51180692b0 0x7f511806b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51340fcef0 0x7f513410fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 --2- 172.21.15.60:0/751082602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340fe0e0 0x7f5134110130 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 >> 172.21.15.60:0/751082602 conn(0x7f51340f8530 msgr2=0x7f51340f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 shutdown_connections 2024-04-12T13:40:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.571+0000 7f5139a00700 1 -- 172.21.15.60:0/751082602 wait complete. 2024-04-12T13:40:09.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 -- 172.21.15.60:0/3558759399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0864066290 msgr2=0x7f08640ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 --2- 172.21.15.60:0/3558759399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0864066290 0x7f08640ffa90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0854004940 tx=0x7f0854009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:09.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 -- 172.21.15.60:0/3558759399 shutdown_connections 2024-04-12T13:40:09.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 --2- 172.21.15.60:0/3558759399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08640fffd0 0x7f08641023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 --2- 172.21.15.60:0/3558759399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0864066290 0x7f08640ffa90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 -- 172.21.15.60:0/3558759399 >> 172.21.15.60:0/3558759399 conn(0x7f08640f74c0 msgr2=0x7f08640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 -- 172.21.15.60:0/3558759399 shutdown_connections 2024-04-12T13:40:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.775+0000 7f086a800700 1 -- 172.21.15.60:0/3558759399 wait complete. 2024-04-12T13:40:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.776+0000 7f086a800700 1 Processor -- start 2024-04-12T13:40:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.777+0000 7f086a800700 1 -- start start 2024-04-12T13:40:09.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.777+0000 7f086a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0864066290 0x7f08640fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.777+0000 7f086a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.777+0000 7f086a800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641117c0 con 0x7f08640fffd0 2024-04-12T13:40:09.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.777+0000 7f086a800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0864111900 con 0x7f0864066290 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0863400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0864066290 0x7f08640fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0862a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0862a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42098/0 (socket says 172.21.15.60:42098) 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0862a00700 1 -- 172.21.15.60:0/3832801252 learned_addr learned my addr 172.21.15.60:0/3832801252 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0862a00700 1 -- 172.21.15.60:0/3832801252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0864066290 msgr2=0x7f08640fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.778+0000 7f0862a00700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0864066290 0x7f08640fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:09.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.779+0000 7f0862a00700 1 -- 172.21.15.60:0/3832801252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854005040 con 0x7f08640fffd0 2024-04-12T13:40:09.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.779+0000 7f0862a00700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f085000b7c0 tx=0x7f0850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:09.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.779+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085000f6f0 con 0x7f08640fffd0 2024-04-12T13:40:09.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.779+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f085000fd20 con 0x7f08640fffd0 2024-04-12T13:40:09.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.779+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08640fbff0 con 0x7f08640fffd0 2024-04-12T13:40:09.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.780+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08500103a0 con 0x7f08640fffd0 2024-04-12T13:40:09.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.780+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08640fc5b0 con 0x7f08640fffd0 2024-04-12T13:40:09.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.781+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086405f5f0 con 0x7f08640fffd0 2024-04-12T13:40:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.783+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0850011400 con 0x7f08640fffd0 2024-04-12T13:40:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.784+0000 7f085b400700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 0x7f084806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:09.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.784+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0850086e20 con 0x7f08640fffd0 2024-04-12T13:40:09.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.784+0000 7f0863400700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 0x7f084806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:09.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.785+0000 7f0863400700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 0x7f084806b810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0854000c00 tx=0x7f0854009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:09.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:09.789+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0850056c80 con 0x7f08640fffd0 2024-04-12T13:40:10.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.174+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08640f8fb0 con 0x7f0848069360 2024-04-12T13:40:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.188+0000 7f085b400700 1 -- 172.21.15.60:0/3832801252 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f08640f8fb0 con 0x7f0848069360 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 79s ago 8m 13.2M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (9m) 79s ago 9m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (7m) 85s ago 7m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (6m) 79s ago 8m 74.9M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (103s) 79s ago 103s 10.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (111s) 79s ago 110s 13.2M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (107s) 85s ago 107s 10.5M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:40:10.190 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (99s) 85s ago 99s 10.5M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (10m) 79s ago 10m 483M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (7m) 85s ago 7m 432M - 17.2.7-845-g730340d7 036a68d49952 ed3d7d27e5fe 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (10m) 79s ago 10m 41.1M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (7m) 85s ago 7m 34.5M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 79s ago 9m 7625k - 1.5.0 0da6a335fe13 5baa779bb80b 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 85s ago 7m 7684k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 79s ago 6m 44.4M 4290M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (6m) 79s ago 6m 45.0M 4290M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 79s ago 5m 43.3M 4290M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (4m) 85s ago 4m 44.7M 5312M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (4m) 85s ago 4m 42.7M 5312M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (3m) 85s ago 3m 40.5M 5312M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:40:10.191 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 79s ago 8m 45.1M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:40:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 msgr2=0x7f084806b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 0x7f084806b810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0854000c00 tx=0x7f0854009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 msgr2=0x7f08640fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f085000b7c0 tx=0x7f0850009250 comp rx=0 tx=0).stop 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 shutdown_connections 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f0848069360 0x7f084806b810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0864066290 0x7f08640fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 --2- 172.21.15.60:0/3832801252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08640fffd0 0x7f08640fb990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 >> 172.21.15.60:0/3832801252 conn(0x7f08640f74c0 msgr2=0x7f08640f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 shutdown_connections 2024-04-12T13:40:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.191+0000 7f086a800700 1 -- 172.21.15.60:0/3832801252 wait complete. 2024-04-12T13:40:10.328 INFO:tasks.workunit.client.1.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 -- 172.21.15.60:0/1790391604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 msgr2=0x7f01c00ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 --2- 172.21.15.60:0/1790391604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c00ffa10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01b0004940 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 -- 172.21.15.60:0/1790391604 shutdown_connections 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 --2- 172.21.15.60:0/1790391604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 0x7f01c0102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 --2- 172.21.15.60:0/1790391604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c00ffa10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.389+0000 7f01c6c00700 1 -- 172.21.15.60:0/1790391604 >> 172.21.15.60:0/1790391604 conn(0x7f01c00f7440 msgr2=0x7f01c00f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.390+0000 7f01c6c00700 1 -- 172.21.15.60:0/1790391604 shutdown_connections 2024-04-12T13:40:10.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.390+0000 7f01c6c00700 1 -- 172.21.15.60:0/1790391604 wait complete. 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.390+0000 7f01c6c00700 1 Processor -- start 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01c6c00700 1 -- start start 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01c6c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01c6c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 0x7f01c01100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01c6c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01106d0 con 0x7f01c0066ee0 2024-04-12T13:40:10.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01c6c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0110840 con 0x7f01c00fff50 2024-04-12T13:40:10.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01bfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01bfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42112/0 (socket says 172.21.15.60:42112) 2024-04-12T13:40:10.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.391+0000 7f01bfe00700 1 -- 172.21.15.60:0/3615262925 learned_addr learned my addr 172.21.15.60:0/3615262925 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:10.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.392+0000 7f01bf400700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 0x7f01c01100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.392+0000 7f01bfe00700 1 -- 172.21.15.60:0/3615262925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 msgr2=0x7f01c01100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.392+0000 7f01bfe00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 0x7f01c01100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.392+0000 7f01bfe00700 1 -- 172.21.15.60:0/3615262925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0005040 con 0x7f01c0066ee0 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.392+0000 7f01bfe00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b970 tx=0x7f01b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.393+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b000e040 con 0x7f01c0066ee0 2024-04-12T13:40:10.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.393+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b0004290 con 0x7f01c0066ee0 2024-04-12T13:40:10.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.393+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b001c630 con 0x7f01c0066ee0 2024-04-12T13:40:10.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.393+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0115240 con 0x7f01c0066ee0 2024-04-12T13:40:10.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.393+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c0115800 con 0x7f01c0066ee0 2024-04-12T13:40:10.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.394+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c004c710 con 0x7f01c0066ee0 2024-04-12T13:40:10.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.396+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f01b000bbf0 con 0x7f01c0066ee0 2024-04-12T13:40:10.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.397+0000 7f01b7e00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.398 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:10 smithi060 ceph-mon[29097]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:10.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.397+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f01b00884d0 con 0x7f01c0066ee0 2024-04-12T13:40:10.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.398+0000 7f01bf400700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.399+0000 7f01bf400700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 0x7f01a406b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004d60 tx=0x7f01ac00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:10.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.405+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f01b0058320 con 0x7f01c0066ee0 2024-04-12T13:40:10.467 INFO:tasks.workunit.client.1.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-12T13:40:10.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:10 smithi110 ceph-mon[36055]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:10.553 INFO:tasks.workunit.client.1.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-12T13:40:10.559 INFO:tasks.workunit.client.1.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-12T13:40:10.559 INFO:tasks.workunit.client.1.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-12T13:40:10.639 INFO:tasks.workunit.client.1.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-12T13:40:10.649 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-12T13:40:10.649 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-12T13:40:10.699 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-12T13:40:10.702 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-12T13:40:10.702 DEBUG:teuthology.orchestra.run.smithi110:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35087f9f8bbf4292364e0bbb9a4062d5cd47de0a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-12T13:40:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.722+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01c0115c20 con 0x7f01c0066ee0 2024-04-12T13:40:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.722+0000 7f01b7e00700 1 -- 172.21.15.60:0/3615262925 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f01b0057eb0 con 0x7f01c0066ee0 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:40:10.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:40:10.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:10.727 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:40:10.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 14 2024-04-12T13:40:10.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:40:10.727 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.725+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 msgr2=0x7f01a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.725+0000 7f01c6c00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 0x7f01a406b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004d60 tx=0x7f01ac00b040 comp rx=0 tx=0).stop 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.725+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 msgr2=0x7f01c010fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.725+0000 7f01c6c00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b970 tx=0x7f01b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.725+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 shutdown_connections 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0066ee0 0x7f01c010fb90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 --2- 172.21.15.60:0/3615262925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01c00fff50 0x7f01c01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 >> 172.21.15.60:0/3615262925 conn(0x7f01c00f7440 msgr2=0x7f01c00fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 shutdown_connections 2024-04-12T13:40:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.726+0000 7f01c6c00700 1 -- 172.21.15.60:0/3615262925 wait complete. 2024-04-12T13:40:10.795 INFO:tasks.workunit.client.1.smithi110.stderr:+ mkdir -p fsstress 2024-04-12T13:40:10.802 INFO:tasks.workunit.client.1.smithi110.stderr:+ pushd fsstress 2024-04-12T13:40:10.808 INFO:tasks.workunit.client.1.smithi110.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T13:40:10.809 INFO:tasks.workunit.client.1.smithi110.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-12T13:40:10.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 -- 172.21.15.60:0/221504107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fcdc0 msgr2=0x7f6dac0fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 --2- 172.21.15.60:0/221504107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac0fd1d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c004940 tx=0x7f6d9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 -- 172.21.15.60:0/221504107 shutdown_connections 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 --2- 172.21.15.60:0/221504107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fd710 0x7f6dac0fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 --2- 172.21.15.60:0/221504107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac0fd1d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 -- 172.21.15.60:0/221504107 >> 172.21.15.60:0/221504107 conn(0x7f6dac0f8540 msgr2=0x7f6dac0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.934+0000 7f6db2400700 1 -- 172.21.15.60:0/221504107 shutdown_connections 2024-04-12T13:40:10.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.935+0000 7f6db2400700 1 -- 172.21.15.60:0/221504107 wait complete. 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.935+0000 7f6db2400700 1 Processor -- start 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6db2400700 1 -- start start 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6db2400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6db2400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 0x7f6dac110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6db2400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac110780 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6db2400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac110fd0 con 0x7f6dac0fd710 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.936+0000 7f6dab400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42138/0 (socket says 172.21.15.60:42138) 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 -- 172.21.15.60:0/3498406133 learned_addr learned my addr 172.21.15.60:0/3498406133 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6daaa00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 0x7f6dac110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 -- 172.21.15.60:0/3498406133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 msgr2=0x7f6dac110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 0x7f6dac110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 -- 172.21.15.60:0/3498406133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c005040 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6daaa00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 0x7f6dac110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:40:10.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.937+0000 7f6dab400700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00b0d0 tx=0x7f6d9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:10.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.938+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c00e070 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.938+0000 7f6db2400700 1 -- 172.21.15.60:0/3498406133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac111250 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.938+0000 7f6db2400700 1 -- 172.21.15.60:0/3498406133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac111790 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.938+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d9c00b410 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.938+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c012600 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.940+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac05f5f0 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.941+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6d9c00ba60 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.942+0000 7f6da3400700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 0x7f6d9006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:10.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.942+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6d9c087ed0 con 0x7f6dac0fcdc0 2024-04-12T13:40:10.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.943+0000 7f6daaa00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 0x7f6d9006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:10.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.945+0000 7f6daaa00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 0x7f6d9006b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d98004600 tx=0x7f6d9800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:10.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:10.948+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6d9c057d20 con 0x7f6dac0fcdc0 2024-04-12T13:40:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.415+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6dac04bed0 con 0x7f6dac0fcdc0 2024-04-12T13:40:11.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:11 smithi060 ceph-mon[29097]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:11.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:11 smithi060 ceph-mon[29097]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:11.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:11 smithi060 ceph-mon[29097]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:11.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:11 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3615262925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:40:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.417+0000 7f6da3400700 1 -- 172.21.15.60:0/3498406133 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f6d9c022070 con 0x7f6dac0fcdc0 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:40:11.419 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:40:11.420 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:11.421 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:40:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:11.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:11.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:11.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 msgr2=0x7f6d9006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 0x7f6d9006b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d98004600 tx=0x7f6d9800b040 comp rx=0 tx=0).stop 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 msgr2=0x7f6dac10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00b0d0 tx=0x7f6d9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 shutdown_connections 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f6d900692b0 0x7f6d9006b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dac0fcdc0 0x7f6dac10fc40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 --2- 172.21.15.60:0/3498406133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac0fd710 0x7f6dac110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 >> 172.21.15.60:0/3498406133 conn(0x7f6dac0f8540 msgr2=0x7f6dac0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.420+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 shutdown_connections 2024-04-12T13:40:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.421+0000 7f6da0c00700 1 -- 172.21.15.60:0/3498406133 wait complete. 2024-04-12T13:40:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:40:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:11 smithi110 ceph-mon[36055]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:11 smithi110 ceph-mon[36055]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:11 smithi110 ceph-mon[36055]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:11.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:11 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3615262925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:40:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.579+0000 7ff974200700 1 -- 172.21.15.60:0/3831637596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fcef0 msgr2=0x7ff96c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.579+0000 7ff974200700 1 --2- 172.21.15.60:0/3831637596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fcef0 0x7ff96c0fd320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff960004940 tx=0x7ff960009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 -- 172.21.15.60:0/3831637596 shutdown_connections 2024-04-12T13:40:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 --2- 172.21.15.60:0/3831637596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 --2- 172.21.15.60:0/3831637596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fcef0 0x7ff96c0fd320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 -- 172.21.15.60:0/3831637596 >> 172.21.15.60:0/3831637596 conn(0x7ff96c0f8530 msgr2=0x7ff96c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 -- 172.21.15.60:0/3831637596 shutdown_connections 2024-04-12T13:40:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.580+0000 7ff974200700 1 -- 172.21.15.60:0/3831637596 wait complete. 2024-04-12T13:40:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.581+0000 7ff974200700 1 Processor -- start 2024-04-12T13:40:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.582+0000 7ff974200700 1 -- start start 2024-04-12T13:40:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.582+0000 7ff974200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fcef0 0x7ff96c114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.582+0000 7ff974200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.582+0000 7ff974200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c114bd0 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.582+0000 7ff974200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c115420 con 0x7ff96c0fcef0 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.583+0000 7ff970e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.583+0000 7ff970e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42158/0 (socket says 172.21.15.60:42158) 2024-04-12T13:40:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.583+0000 7ff970e00700 1 -- 172.21.15.60:0/1988790460 learned_addr learned my addr 172.21.15.60:0/1988790460 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.583+0000 7ff971800700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fcef0 0x7ff96c114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.584+0000 7ff970e00700 1 -- 172.21.15.60:0/1988790460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fcef0 msgr2=0x7ff96c114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.584+0000 7ff970e00700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fcef0 0x7ff96c114090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.584+0000 7ff970e00700 1 -- 172.21.15.60:0/1988790460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960005040 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.584+0000 7ff970e00700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c8c0 tx=0x7ff9580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.585+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff95800a760 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.585+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff95800ad90 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.585+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9580113a0 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.585+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c115700 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.585+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c115c40 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.587+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c101a70 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.590+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff958012400 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.592+0000 7ff969600700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 0x7ff95406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:11.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.592+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff9580871e0 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.592+0000 7ff971800700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 0x7ff95406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:11.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.594+0000 7ff971800700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 0x7ff95406b820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff96000b3b0 tx=0x7ff960009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.595+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff958056f80 con 0x7ff96c0fe0e0 2024-04-12T13:40:11.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.898+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff96c105b50 con 0x7ff954069370 2024-04-12T13:40:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.900+0000 7ff969600700 1 -- 172.21.15.60:0/1988790460 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff960007d50 con 0x7ff954069370 2024-04-12T13:40:11.901 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:40:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888", 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "", 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:a971fd5f5719038c70b817bafacd6d5400b1d888 image", 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:40:11.902 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 msgr2=0x7ff95406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 0x7ff95406b820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff96000b3b0 tx=0x7ff960009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 msgr2=0x7ff96c1145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c8c0 tx=0x7ff9580044c0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 shutdown_connections 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff954069370 0x7ff95406b820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff96c0fcef0 0x7ff96c114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 --2- 172.21.15.60:0/1988790460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff96c0fe0e0 0x7ff96c1145d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.903+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 >> 172.21.15.60:0/1988790460 conn(0x7ff96c0f8530 msgr2=0x7ff96c0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.904+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 shutdown_connections 2024-04-12T13:40:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:11.904+0000 7ff974200700 1 -- 172.21.15.60:0/1988790460 wait complete. 2024-04-12T13:40:12.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 -- 172.21.15.60:0/1285587933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300ff750 msgr2=0x7ff1301000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 --2- 172.21.15.60:0/1285587933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300ff750 0x7ff1301000b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff11c004940 tx=0x7ff11c009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 -- 172.21.15.60:0/1285587933 shutdown_connections 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 --2- 172.21.15.60:0/1285587933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300ff750 0x7ff1301000b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 --2- 172.21.15.60:0/1285587933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300fee00 0x7ff1300ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.068+0000 7ff135a00700 1 -- 172.21.15.60:0/1285587933 >> 172.21.15.60:0/1285587933 conn(0x7ff1300fa5d0 msgr2=0x7ff1300fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.069+0000 7ff135a00700 1 -- 172.21.15.60:0/1285587933 shutdown_connections 2024-04-12T13:40:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.069+0000 7ff135a00700 1 -- 172.21.15.60:0/1285587933 wait complete. 2024-04-12T13:40:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.069+0000 7ff135a00700 1 Processor -- start 2024-04-12T13:40:12.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff135a00700 1 -- start start 2024-04-12T13:40:12.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff135a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff135a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300ff750 0x7ff130114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff135a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130114a00 con 0x7ff1300fee00 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff135a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130115250 con 0x7ff1300ff750 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42180/0 (socket says 172.21.15.60:42180) 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.070+0000 7ff12fe00700 1 -- 172.21.15.60:0/3894034558 learned_addr learned my addr 172.21.15.60:0/3894034558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.071+0000 7ff12f400700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300ff750 0x7ff130114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.071+0000 7ff12fe00700 1 -- 172.21.15.60:0/3894034558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300ff750 msgr2=0x7ff130114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.071+0000 7ff12fe00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300ff750 0x7ff130114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.071+0000 7ff12fe00700 1 -- 172.21.15.60:0/3894034558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c005040 con 0x7ff1300fee00 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.072+0000 7ff12fe00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c8b0 tx=0x7ff120004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.073+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12000a760 con 0x7ff1300fee00 2024-04-12T13:40:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.073+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff130115530 con 0x7ff1300fee00 2024-04-12T13:40:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.073+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff130115a70 con 0x7ff1300fee00 2024-04-12T13:40:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.073+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff12000ad90 con 0x7ff1300fee00 2024-04-12T13:40:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.073+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1200113a0 con 0x7ff1300fee00 2024-04-12T13:40:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.074+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100052e0 con 0x7ff1300fee00 2024-04-12T13:40:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.076+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff120012400 con 0x7ff1300fee00 2024-04-12T13:40:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.076+0000 7ff127e00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 0x7ff11406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.076+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff120087bc0 con 0x7ff1300fee00 2024-04-12T13:40:12.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.077+0000 7ff12f400700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 0x7ff11406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:12.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.078+0000 7ff12f400700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 0x7ff11406b810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009fd0 tx=0x7ff11c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:12.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.083+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff120057a20 con 0x7ff1300fee00 2024-04-12T13:40:12.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:12 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3498406133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:40:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:12 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3498406133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:40:12.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.588+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff110005860 con 0x7ff1300fee00 2024-04-12T13:40:12.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.588+0000 7ff127e00700 1 -- 172.21.15.60:0/3894034558 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff1200575b0 con 0x7ff1300fee00 2024-04-12T13:40:12.590 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:40:12.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.591+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 msgr2=0x7ff11406b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:12.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 0x7ff11406b810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009fd0 tx=0x7ff11c009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:12.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 msgr2=0x7ff130113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c8b0 tx=0x7ff120004470 comp rx=0 tx=0).stop 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 shutdown_connections 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff114069360 0x7ff11406b810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1300fee00 0x7ff130113ec0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 --2- 172.21.15.60:0/3894034558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1300ff750 0x7ff130114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 >> 172.21.15.60:0/3894034558 conn(0x7ff1300fa5d0 msgr2=0x7ff1300fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 shutdown_connections 2024-04-12T13:40:12.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:12.592+0000 7ff135a00700 1 -- 172.21.15.60:0/3894034558 wait complete. 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:13 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3894034558' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:40:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:40:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:13 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3894034558' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:40:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:14 smithi060 ceph-mon[29097]: Upgrade: Target is version 19.0.0-2778-ga971fd5f (unknown) 2024-04-12T13:40:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:14 smithi060 ceph-mon[29097]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, digests ['quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608'] 2024-04-12T13:40:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:14 smithi060 ceph-mon[29097]: Upgrade: Need to upgrade myself (mgr.smithi060.bpzacg) 2024-04-12T13:40:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:14 smithi060 ceph-mon[29097]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 on smithi110 2024-04-12T13:40:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:14 smithi110 ceph-mon[36055]: Upgrade: Target is version 19.0.0-2778-ga971fd5f (unknown) 2024-04-12T13:40:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:14 smithi110 ceph-mon[36055]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, digests ['quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608'] 2024-04-12T13:40:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:14 smithi110 ceph-mon[36055]: Upgrade: Need to upgrade myself (mgr.smithi060.bpzacg) 2024-04-12T13:40:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:14 smithi110 ceph-mon[36055]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 on smithi110 2024-04-12T13:40:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:15 smithi060 ceph-mon[29097]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:15 smithi110 ceph-mon[36055]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:40:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:15.968 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 68% (7757/11369) Updating files: 69% (7845/11369) Updating files: 70% (7959/11369) Updating files: 71% (8072/11369) Updating files: 72% (8186/11369) Updating files: 73% (8300/11369) Updating files: 74% (8414/11369) Updating files: 75% (8527/11369) Updating files: 76% (8641/11369) Updating files: 77% (8755/11369) Updating files: 78% (8868/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-04-12T13:40:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:17 smithi110 ceph-mon[36055]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '35087f9f8bbf4292364e0bbb9a4062d5cd47de0a'. 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.631 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-04-12T13:40:17.632 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 35087f9f8bb qa: use custom quincy build for testing 2024-04-12T13:40:17.643 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-12T13:40:17.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:17 smithi060 ceph-mon[29097]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T13:40:17.701 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-12T13:40:17.709 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T13:40:17.709 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-12T13:40:18.739 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-12T13:40:18.856 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-12T13:40:18.943 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T13:40:18.951 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T13:40:18.951 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-12T13:40:19.043 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T13:40:19.052 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:40:19.053 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-12T13:40:19.151 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-12T13:40:19.152 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-12T13:40:19.152 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35087f9f8bbf4292364e0bbb9a4062d5cd47de0a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-12T13:40:19.237 INFO:tasks.workunit.client.0.smithi060.stderr:+ mkdir -p fsstress 2024-04-12T13:40:19.245 INFO:tasks.workunit.client.0.smithi060.stderr:+ pushd fsstress 2024-04-12T13:40:19.252 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T13:40:19.252 INFO:tasks.workunit.client.0.smithi060.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-12T13:40:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:19 smithi110 ceph-mon[36055]: pgmap v283: 65 pgs: 65 active+clean; 599 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-12T13:40:19.514 INFO:tasks.workunit.client.1.smithi110.stderr:+ tar xzf ltp-full.tgz 2024-04-12T13:40:19.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:19 smithi060 ceph-mon[29097]: pgmap v283: 65 pgs: 65 active+clean; 599 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-12T13:40:21.068 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar xzf ltp-full.tgz 2024-04-12T13:40:21.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:21 smithi110 ceph-mon[36055]: pgmap v284: 65 pgs: 65 active+clean; 599 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-12T13:40:21.482 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:21 smithi060 ceph-mon[29097]: pgmap v284: 65 pgs: 65 active+clean; 599 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-12T13:40:23.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:23 smithi110 ceph-mon[36055]: pgmap v285: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 907 KiB/s wr, 7 op/s 2024-04-12T13:40:23.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:23 smithi060 ceph-mon[29097]: pgmap v285: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 907 KiB/s wr, 7 op/s 2024-04-12T13:40:25.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:25 smithi060 ceph-mon[29097]: pgmap v286: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 44 op/s 2024-04-12T13:40:25.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:25 smithi110 ceph-mon[36055]: pgmap v286: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 44 op/s 2024-04-12T13:40:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:27 smithi110 ceph-mon[36055]: pgmap v287: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 62 op/s 2024-04-12T13:40:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:27 smithi060 ceph-mon[29097]: pgmap v287: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 62 op/s 2024-04-12T13:40:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:29 smithi110 ceph-mon[36055]: pgmap v288: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 118 op/s 2024-04-12T13:40:29.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:29 smithi060 ceph-mon[29097]: pgmap v288: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 118 op/s 2024-04-12T13:40:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:30 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:30.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:30 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:31.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:31 smithi110 ceph-mon[36055]: pgmap v289: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 146 op/s 2024-04-12T13:40:31.582 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:31 smithi060 ceph-mon[29097]: pgmap v289: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s wr, 146 op/s 2024-04-12T13:40:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:33 smithi110 ceph-mon[36055]: pgmap v290: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 175 op/s 2024-04-12T13:40:33.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:33 smithi060 ceph-mon[29097]: pgmap v290: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 175 op/s 2024-04-12T13:40:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:35 smithi060 ceph-mon[29097]: pgmap v291: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s wr, 213 op/s 2024-04-12T13:40:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:35 smithi110 ceph-mon[36055]: pgmap v291: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s wr, 213 op/s 2024-04-12T13:40:37.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:37 smithi060 ceph-mon[29097]: pgmap v292: 65 pgs: 65 active+clean; 39 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 191 op/s 2024-04-12T13:40:37.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:37 smithi110 ceph-mon[36055]: pgmap v292: 65 pgs: 65 active+clean; 39 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 191 op/s 2024-04-12T13:40:39.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:39 smithi060 ceph-mon[29097]: pgmap v293: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 226 op/s 2024-04-12T13:40:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:39 smithi110 ceph-mon[36055]: pgmap v293: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 226 op/s 2024-04-12T13:40:41.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:41 smithi060 ceph-mon[29097]: pgmap v294: 65 pgs: 65 active+clean; 46 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s wr, 207 op/s 2024-04-12T13:40:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:41 smithi110 ceph-mon[36055]: pgmap v294: 65 pgs: 65 active+clean; 46 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s wr, 207 op/s 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.801+0000 7f4658400700 1 -- 172.21.15.60:0/3682643032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46500662f0 msgr2=0x7f4650101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.801+0000 7f4658400700 1 --2- 172.21.15.60:0/3682643032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46500662f0 0x7f4650101e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4644004940 tx=0x7f4644009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 -- 172.21.15.60:0/3682643032 shutdown_connections 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 --2- 172.21.15.60:0/3682643032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4650102370 0x7f4650104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 --2- 172.21.15.60:0/3682643032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46500662f0 0x7f4650101e30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:42.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 -- 172.21.15.60:0/3682643032 >> 172.21.15.60:0/3682643032 conn(0x7f46500f74c0 msgr2=0x7f46500f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 -- 172.21.15.60:0/3682643032 shutdown_connections 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.802+0000 7f4658400700 1 -- 172.21.15.60:0/3682643032 wait complete. 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 Processor -- start 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 -- start start 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650102370 0x7f4650114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4650114b00 con 0x7f46500662f0 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.803+0000 7f4658400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4650115350 con 0x7f4650102370 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650102370 0x7f4650114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44126/0 (socket says 172.21.15.60:44126) 2024-04-12T13:40:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 -- 172.21.15.60:0/3032237282 learned_addr learned my addr 172.21.15.60:0/3032237282 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 -- 172.21.15.60:0/3032237282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650102370 msgr2=0x7f4650114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650102370 0x7f4650114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.804+0000 7f4655a00700 1 -- 172.21.15.60:0/3032237282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644005040 con 0x7f46500662f0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.805+0000 7f4655a00700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f464400b0d0 tx=0x7f4644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.805+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f464400e070 con 0x7f46500662f0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.805+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4644013de0 con 0x7f46500662f0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.805+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f464400be30 con 0x7f46500662f0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.806+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46501155d0 con 0x7f46500662f0 2024-04-12T13:40:42.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.806+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4650115ac0 con 0x7f46500662f0 2024-04-12T13:40:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.808+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46500f8ff0 con 0x7f46500662f0 2024-04-12T13:40:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.809+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f464400b680 con 0x7f46500662f0 2024-04-12T13:40:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.810+0000 7f464d600700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 0x7f463806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.810+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4644087f10 con 0x7f46500662f0 2024-04-12T13:40:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.811+0000 7f4655000700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 0x7f463806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.812+0000 7f4655000700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 0x7f463806b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f463c009b80 tx=0x7f463c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:42.816+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4644057cb0 con 0x7f46500662f0 2024-04-12T13:40:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.165+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46500fe970 con 0x7f46380692b0 2024-04-12T13:40:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.167+0000 7f464d600700 1 -- 172.21.15.60:0/3032237282 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f46500fe970 con 0x7f46380692b0 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 msgr2=0x7f463806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 0x7f463806b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f463c009b80 tx=0x7f463c00b040 comp rx=0 tx=0).stop 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 msgr2=0x7f4650113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f464400b0d0 tx=0x7f4644009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 shutdown_connections 2024-04-12T13:40:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f46380692b0 0x7f463806b760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46500662f0 0x7f4650113fc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 --2- 172.21.15.60:0/3032237282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650102370 0x7f4650114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 >> 172.21.15.60:0/3032237282 conn(0x7f46500f74c0 msgr2=0x7f4650102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 shutdown_connections 2024-04-12T13:40:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.171+0000 7f4658400700 1 -- 172.21.15.60:0/3032237282 wait complete. 2024-04-12T13:40:43.193 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1572230475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 msgr2=0x7ff0cc1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1572230475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc1023b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8004940 tx=0x7ff0b8009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1572230475 shutdown_connections 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1572230475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc1023b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1572230475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1572230475 >> 172.21.15.60:0/1572230475 conn(0x7ff0cc0f74c0 msgr2=0x7ff0cc0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1572230475 shutdown_connections 2024-04-12T13:40:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.374+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1572230475 wait complete. 2024-04-12T13:40:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.376+0000 7ff0d0c00700 1 Processor -- start 2024-04-12T13:40:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.376+0000 7ff0d0c00700 1 -- start start 2024-04-12T13:40:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.376+0000 7ff0d0c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.376+0000 7ff0d0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.377+0000 7ff0d0c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc110710 con 0x7ff0cc066290 2024-04-12T13:40:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.377+0000 7ff0d0c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc110f10 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.377+0000 7ff0c9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:51362/0 (socket says 172.21.15.60:51362) 2024-04-12T13:40:43.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9400700 1 -- 172.21.15.60:0/1727341244 learned_addr learned my addr 172.21.15.60:0/1727341244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:43.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9e00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9400700 1 -- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 msgr2=0x7ff0cc10fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9400700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc10fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.378+0000 7ff0c9400700 1 -- 172.21.15.60:0/1727341244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc005040 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.379+0000 7ff0c9e00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:40:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.379+0000 7ff0c9400700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b0d0 tx=0x7ff0b8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:43.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.379+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b800e070 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.379+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0b800b410 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.379+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b8005040 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.380+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b8012600 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.380+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc111540 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.381+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc05f5f0 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.383+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff0b800ba80 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.384+0000 7ff0c2000700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 0x7ff0b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.384+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff0b8087e10 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.384+0000 7ff0c9e00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 0x7ff0b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.385+0000 7ff0c9e00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 0x7ff0b006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc065fd0 tx=0x7ff0bc009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:43.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.392+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff0b8057c60 con 0x7ff0cc0fffd0 2024-04-12T13:40:43.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:43 smithi060 ceph-mon[29097]: pgmap v295: 65 pgs: 65 active+clean; 49 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s wr, 228 op/s 2024-04-12T13:40:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:43 smithi110 ceph-mon[36055]: pgmap v295: 65 pgs: 65 active+clean; 49 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s wr, 228 op/s 2024-04-12T13:40:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.734+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0cc1118c0 con 0x7ff0b00692b0 2024-04-12T13:40:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.736+0000 7ff0c2000700 1 -- 172.21.15.60:0/1727341244 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7ff0cc1118c0 con 0x7ff0b00692b0 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.739+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 msgr2=0x7ff0b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.739+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 0x7ff0b006b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc065fd0 tx=0x7ff0bc009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 msgr2=0x7ff0cc110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b0d0 tx=0x7ff0b8009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 shutdown_connections 2024-04-12T13:40:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7ff0b00692b0 0x7ff0b006b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc066290 0x7ff0cc10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 --2- 172.21.15.60:0/1727341244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0cc0fffd0 0x7ff0cc110110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 >> 172.21.15.60:0/1727341244 conn(0x7ff0cc0f74c0 msgr2=0x7ff0cc0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 shutdown_connections 2024-04-12T13:40:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.740+0000 7ff0d0c00700 1 -- 172.21.15.60:0/1727341244 wait complete. 2024-04-12T13:40:43.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.953+0000 7f3aca200700 1 -- 172.21.15.60:0/965083975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 msgr2=0x7f3ac41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.953+0000 7f3aca200700 1 --2- 172.21.15.60:0/965083975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac41047a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0004940 tx=0x7f3ab0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 -- 172.21.15.60:0/965083975 shutdown_connections 2024-04-12T13:40:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 --2- 172.21.15.60:0/965083975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac41047a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 --2- 172.21.15.60:0/965083975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 -- 172.21.15.60:0/965083975 >> 172.21.15.60:0/965083975 conn(0x7f3ac40f7490 msgr2=0x7f3ac40f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 -- 172.21.15.60:0/965083975 shutdown_connections 2024-04-12T13:40:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.954+0000 7f3aca200700 1 -- 172.21.15.60:0/965083975 wait complete. 2024-04-12T13:40:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.955+0000 7f3aca200700 1 Processor -- start 2024-04-12T13:40:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.955+0000 7f3aca200700 1 -- start start 2024-04-12T13:40:43.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3aca200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3aca200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3aca200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4110940 con 0x7f3ac41023c0 2024-04-12T13:40:43.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3aca200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4110ab0 con 0x7f3ac4066f00 2024-04-12T13:40:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3ac2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3ac2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44156/0 (socket says 172.21.15.60:44156) 2024-04-12T13:40:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3ac3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:51374/0 (socket says 172.21.15.60:51374) 2024-04-12T13:40:43.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.956+0000 7f3ac2a00700 1 -- 172.21.15.60:0/3405696768 learned_addr learned my addr 172.21.15.60:0/3405696768 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.957+0000 7f3ac3400700 1 -- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 msgr2=0x7f3ac4110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.957+0000 7f3ac3400700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.957+0000 7f3ac3400700 1 -- 172.21.15.60:0/3405696768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0005040 con 0x7f3ac4066f00 2024-04-12T13:40:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.957+0000 7f3ac2a00700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:40:43.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.957+0000 7f3ac3400700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4066c40 tx=0x7f3ab400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:43.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.958+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab4004e90 con 0x7f3ac4066f00 2024-04-12T13:40:43.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.958+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ab400f040 con 0x7f3ac4066f00 2024-04-12T13:40:43.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.958+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab400c8e0 con 0x7f3ac4066f00 2024-04-12T13:40:43.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.959+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac41154b0 con 0x7f3ac4066f00 2024-04-12T13:40:43.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.959+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac41159f0 con 0x7f3ac4066f00 2024-04-12T13:40:43.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.960+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac404c710 con 0x7f3ac4066f00 2024-04-12T13:40:43.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.961+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3ab4007cc0 con 0x7f3ac4066f00 2024-04-12T13:40:43.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.962+0000 7f3abb400700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 0x7f3aa806b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:43.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.962+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3ab4086af0 con 0x7f3ac4066f00 2024-04-12T13:40:43.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.963+0000 7f3ac2a00700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 0x7f3aa806b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:43.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.964+0000 7f3ac2a00700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 0x7f3aa806b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b0d0 tx=0x7f3ab0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:43.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:43.970+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3ab404e250 con 0x7f3ac4066f00 2024-04-12T13:40:44.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.260+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac4103d00 con 0x7f3aa80692e0 2024-04-12T13:40:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.275+0000 7f3abb400700 1 -- 172.21.15.60:0/3405696768 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f3ac4103d00 con 0x7f3aa80692e0 2024-04-12T13:40:44.278 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:40:44.278 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 113s ago 9m 13.2M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:40:44.278 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (9m) 113s ago 9m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (8m) 119s ago 8m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (7m) 113s ago 9m 74.9M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (2m) 113s ago 2m 10.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (2m) 113s ago 2m 13.2M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (2m) 119s ago 2m 10.5M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (2m) 119s ago 2m 10.5M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (11m) 113s ago 11m 483M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (8m) 119s ago 8m 432M - 17.2.7-845-g730340d7 036a68d49952 ed3d7d27e5fe 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (11m) 113s ago 11m 41.1M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (8m) 119s ago 8m 34.5M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 113s ago 9m 7625k - 1.5.0 0da6a335fe13 5baa779bb80b 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 119s ago 8m 7684k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 113s ago 7m 44.4M 4290M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:40:44.279 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (6m) 113s ago 6m 45.0M 4290M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:40:44.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 113s ago 5m 43.3M 4290M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:40:44.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (5m) 119s ago 5m 44.7M 5312M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:40:44.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (4m) 119s ago 4m 42.7M 5312M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:40:44.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (4m) 119s ago 4m 40.5M 5312M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:40:44.280 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (7m) 113s ago 8m 45.1M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:40:44.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 msgr2=0x7f3aa806b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 0x7f3aa806b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b0d0 tx=0x7f3ab0009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 msgr2=0x7f3ac410fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4066c40 tx=0x7f3ab400b040 comp rx=0 tx=0).stop 2024-04-12T13:40:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 shutdown_connections 2024-04-12T13:40:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f3aa80692e0 0x7f3aa806b790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ac4066f00 0x7f3ac410fe00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 --2- 172.21.15.60:0/3405696768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac41023c0 0x7f3ac4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.279+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 >> 172.21.15.60:0/3405696768 conn(0x7f3ac40f7490 msgr2=0x7f3ac40f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:44.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.280+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 shutdown_connections 2024-04-12T13:40:44.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.280+0000 7f3aca200700 1 -- 172.21.15.60:0/3405696768 wait complete. 2024-04-12T13:40:44.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 -- 172.21.15.60:0/733818725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fd710 msgr2=0x7f16680fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:44.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 --2- 172.21.15.60:0/733818725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fd710 0x7f16680fe070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1654004940 tx=0x7f1654009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:44.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 -- 172.21.15.60:0/733818725 shutdown_connections 2024-04-12T13:40:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 --2- 172.21.15.60:0/733818725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fd710 0x7f16680fe070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 --2- 172.21.15.60:0/733818725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fcdc0 0x7f16680fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.493+0000 7f166d400700 1 -- 172.21.15.60:0/733818725 >> 172.21.15.60:0/733818725 conn(0x7f16680f8540 msgr2=0x7f16680fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.494+0000 7f166d400700 1 -- 172.21.15.60:0/733818725 shutdown_connections 2024-04-12T13:40:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.494+0000 7f166d400700 1 -- 172.21.15.60:0/733818725 wait complete. 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.494+0000 7f166d400700 1 Processor -- start 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f166d400700 1 -- start start 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f166d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f166d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fd710 0x7f16681102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f166d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166810b770 con 0x7f16680fcdc0 2024-04-12T13:40:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f166d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166810b8b0 con 0x7f16680fd710 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f1666800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f1666800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44186/0 (socket says 172.21.15.60:44186) 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.495+0000 7f1666800700 1 -- 172.21.15.60:0/3332675465 learned_addr learned my addr 172.21.15.60:0/3332675465 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.496+0000 7f1665e00700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fd710 0x7f16681102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.496+0000 7f1666800700 1 -- 172.21.15.60:0/3332675465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fd710 msgr2=0x7f16681102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.496+0000 7f1666800700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fd710 0x7f16681102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:44.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.496+0000 7f1666800700 1 -- 172.21.15.60:0/3332675465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654005040 con 0x7f16680fcdc0 2024-04-12T13:40:44.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f1666800700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f165800eb70 tx=0x7f165800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:44.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1658007cc0 con 0x7f16680fcdc0 2024-04-12T13:40:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f165800f040 con 0x7f16680fcdc0 2024-04-12T13:40:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f165800ca60 con 0x7f16680fcdc0 2024-04-12T13:40:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166810bb30 con 0x7f16680fcdc0 2024-04-12T13:40:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.497+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166810c0f0 con 0x7f16680fcdc0 2024-04-12T13:40:44.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.500+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f165800cbc0 con 0x7f16680fcdc0 2024-04-12T13:40:44.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:44 smithi060 ceph-mon[29097]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:44.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.501+0000 7f165ea00700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 0x7f164c06b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.501+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1658086b20 con 0x7f16680fcdc0 2024-04-12T13:40:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.502+0000 7f1665e00700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 0x7f164c06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.502+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166805f5f0 con 0x7f16680fcdc0 2024-04-12T13:40:44.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.505+0000 7f1665e00700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 0x7f164c06b860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1654013870 tx=0x7f1654009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:44.511+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f165804e250 con 0x7f16680fcdc0 2024-04-12T13:40:44.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:44 smithi110 ceph-mon[36055]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:45.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.036+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16680008d0 con 0x7f16680fcdc0 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.037+0000 7f165ea00700 1 -- 172.21.15.60:0/3332675465 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f1658019020 con 0x7f16680fcdc0 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:45.039 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 14 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:40:45.040 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:40:45.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 msgr2=0x7f164c06b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 0x7f164c06b860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1654013870 tx=0x7f1654009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:45.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 msgr2=0x7f166810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f165800eb70 tx=0x7f165800b040 comp rx=0 tx=0).stop 2024-04-12T13:40:45.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 shutdown_connections 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f164c0693b0 0x7f164c06b860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16680fcdc0 0x7f166810fda0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 --2- 172.21.15.60:0/3332675465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16680fd710 0x7f16681102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 >> 172.21.15.60:0/3332675465 conn(0x7f16680f8540 msgr2=0x7f1668101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 shutdown_connections 2024-04-12T13:40:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.040+0000 7f166d400700 1 -- 172.21.15.60:0/3332675465 wait complete. 2024-04-12T13:40:45.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.231+0000 7fb1bf600700 1 -- 172.21.15.60:0/3838285091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fc700 msgr2=0x7fb1b80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.231+0000 7fb1bf600700 1 --2- 172.21.15.60:0/3838285091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fc700 0x7fb1b80fcb70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4004a50 tx=0x7fb1a400af40 comp rx=0 tx=0).stop 2024-04-12T13:40:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 -- 172.21.15.60:0/3838285091 shutdown_connections 2024-04-12T13:40:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 --2- 172.21.15.60:0/3838285091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fc700 0x7fb1b80fcb70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 --2- 172.21.15.60:0/3838285091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fb450 0x7fb1b80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 -- 172.21.15.60:0/3838285091 >> 172.21.15.60:0/3838285091 conn(0x7fb1b80f6bd0 msgr2=0x7fb1b80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 -- 172.21.15.60:0/3838285091 shutdown_connections 2024-04-12T13:40:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.232+0000 7fb1bf600700 1 -- 172.21.15.60:0/3838285091 wait complete. 2024-04-12T13:40:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.233+0000 7fb1bf600700 1 Processor -- start 2024-04-12T13:40:45.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.233+0000 7fb1bf600700 1 -- start start 2024-04-12T13:40:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.235+0000 7fb1bf600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fb450 0x7fb1b810fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.235+0000 7fb1bf600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1bf600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8110730 con 0x7fb1b80fb450 2024-04-12T13:40:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1bf600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8110f80 con 0x7fb1b80fc700 2024-04-12T13:40:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:51400/0 (socket says 172.21.15.60:51400) 2024-04-12T13:40:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 -- 172.21.15.60:0/1753645574 learned_addr learned my addr 172.21.15.60:0/1753645574 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 -- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fb450 msgr2=0x7fb1b810fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fb450 0x7fb1b810fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.236+0000 7fb1b7e00700 1 -- 172.21.15.60:0/1753645574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4005040 con 0x7fb1b80fc700 2024-04-12T13:40:45.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.237+0000 7fb1b7e00700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4008b90 tx=0x7fb1a400af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:45.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.237+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a400f050 con 0x7fb1b80fc700 2024-04-12T13:40:45.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.237+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1a401d950 con 0x7fb1b80fc700 2024-04-12T13:40:45.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.238+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8111200 con 0x7fb1b80fc700 2024-04-12T13:40:45.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.238+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b81116e0 con 0x7fb1b80fc700 2024-04-12T13:40:45.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.238+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a40148e0 con 0x7fb1b80fc700 2024-04-12T13:40:45.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.239+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b805f5f0 con 0x7fb1b80fc700 2024-04-12T13:40:45.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.241+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb1a401dac0 con 0x7fb1b80fc700 2024-04-12T13:40:45.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.243+0000 7fb1b4c00700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 0x7fb1a006b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.243+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb1a4089690 con 0x7fb1b80fc700 2024-04-12T13:40:45.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.244+0000 7fb1bcc00700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 0x7fb1a006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:45.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.245+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb1a4059430 con 0x7fb1b80fc700 2024-04-12T13:40:45.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.246+0000 7fb1bcc00700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 0x7fb1a006b830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009fd0 tx=0x7fb1ac00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:45 smithi060 ceph-mon[29097]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:45 smithi060 ceph-mon[29097]: pgmap v296: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 275 op/s 2024-04-12T13:40:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:45 smithi060 ceph-mon[29097]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:45 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:45 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3332675465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:40:45.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.671+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb1b81031a0 con 0x7fb1b80fc700 2024-04-12T13:40:45.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.672+0000 7fb1b4c00700 1 -- 172.21.15.60:0/1753645574 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7fb1a4058fc0 con 0x7fb1b80fc700 2024-04-12T13:40:45.675 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:40:45.675 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:40:45.675 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:40:45.675 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:40:45.675 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:40:45.676 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:40:45.677 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:40:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:40:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:40:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:40:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:40:45.678 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:45.679 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:45.680 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:40:45.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 msgr2=0x7fb1a006b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 0x7fb1a006b830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009fd0 tx=0x7fb1ac00b040 comp rx=0 tx=0).stop 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 msgr2=0x7fb1b8110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4008b90 tx=0x7fb1a400af40 comp rx=0 tx=0).stop 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 shutdown_connections 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7fb1a0069380 0x7fb1a006b830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b80fb450 0x7fb1b810fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 --2- 172.21.15.60:0/1753645574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1b80fc700 0x7fb1b8110130 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 >> 172.21.15.60:0/1753645574 conn(0x7fb1b80f6bd0 msgr2=0x7fb1b80f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 shutdown_connections 2024-04-12T13:40:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.676+0000 7fb1bf600700 1 -- 172.21.15.60:0/1753645574 wait complete. 2024-04-12T13:40:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:40:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:45 smithi110 ceph-mon[36055]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:45 smithi110 ceph-mon[36055]: pgmap v296: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 275 op/s 2024-04-12T13:40:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:45 smithi110 ceph-mon[36055]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:45 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:40:45.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:45 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3332675465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:40:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.883+0000 7f1431600700 1 -- 172.21.15.60:0/2599571065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c1002b0 msgr2=0x7f142c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.883+0000 7f1431600700 1 --2- 172.21.15.60:0/2599571065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c1002b0 0x7f142c100720 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1418004940 tx=0x7f1418009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.883+0000 7f1431600700 1 -- 172.21.15.60:0/2599571065 shutdown_connections 2024-04-12T13:40:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.883+0000 7f1431600700 1 --2- 172.21.15.60:0/2599571065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c1002b0 0x7f142c100720 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.883+0000 7f1431600700 1 --2- 172.21.15.60:0/2599571065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c0ff000 0x7f142c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.884+0000 7f1431600700 1 -- 172.21.15.60:0/2599571065 >> 172.21.15.60:0/2599571065 conn(0x7f142c0fa950 msgr2=0x7f142c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.884+0000 7f1431600700 1 -- 172.21.15.60:0/2599571065 shutdown_connections 2024-04-12T13:40:45.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.884+0000 7f1431600700 1 -- 172.21.15.60:0/2599571065 wait complete. 2024-04-12T13:40:45.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.885+0000 7f1431600700 1 Processor -- start 2024-04-12T13:40:45.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.886+0000 7f1431600700 1 -- start start 2024-04-12T13:40:45.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.886+0000 7f1431600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.886+0000 7f1431600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 0x7f142c10bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.886+0000 7f1431600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c10c280 con 0x7f142c0ff000 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.886+0000 7f1431600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c10c3f0 con 0x7f142c1002b0 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 0x7f142c10bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44226/0 (socket says 172.21.15.60:44226) 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 0x7f142c10bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:51416/0 (socket says 172.21.15.60:51416) 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 -- 172.21.15.60:0/1726857816 learned_addr learned my addr 172.21.15.60:0/1726857816 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 -- 172.21.15.60:0/1726857816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 msgr2=0x7f142c10bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 0x7f142c10bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:45.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.887+0000 7f142aa00700 1 -- 172.21.15.60:0/1726857816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418005040 con 0x7f142c0ff000 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f142aa00700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f141c002a50 tx=0x7f141c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c007cc0 con 0x7f142c0ff000 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f141c00f040 con 0x7f142c0ff000 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c00da30 con 0x7f142c0ff000 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c110e50 con 0x7f142c0ff000 2024-04-12T13:40:45.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.888+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c111410 con 0x7f142c0ff000 2024-04-12T13:40:45.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.890+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c04c710 con 0x7f142c0ff000 2024-04-12T13:40:45.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.891+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f141c00dbb0 con 0x7f142c0ff000 2024-04-12T13:40:45.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.892+0000 7f1422a00700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 0x7f141006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:45.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.893+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f141c086f30 con 0x7f142c0ff000 2024-04-12T13:40:45.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.893+0000 7f142a000700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 0x7f141006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:45.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.894+0000 7f142a000700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 0x7f141006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f141800b3b0 tx=0x7f1418009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:45.899+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f141c0569c0 con 0x7f142c0ff000 2024-04-12T13:40:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.242+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 --> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f142c1045d0 con 0x7f14100692a0 2024-04-12T13:40:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.244+0000 7f1422a00700 1 -- 172.21.15.60:0/1726857816 <== mgr.14212 v2:172.21.15.60:6800/673590403 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f142c1045d0 con 0x7f14100692a0 2024-04-12T13:40:46.246 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:40:46.246 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:40:46.246 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:40:46.246 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:40:46.247 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:40:46.247 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "0/21 daemons upgraded", 2024-04-12T13:40:46.247 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 image on host smithi110", 2024-04-12T13:40:46.247 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:40:46.247 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:40:46.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 msgr2=0x7f141006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 0x7f141006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f141800b3b0 tx=0x7f1418009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 msgr2=0x7f142c10b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f141c002a50 tx=0x7f141c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 shutdown_connections 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f14100692a0 0x7f141006b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f142c0ff000 0x7f142c10b740 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 --2- 172.21.15.60:0/1726857816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c1002b0 0x7f142c10bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 >> 172.21.15.60:0/1726857816 conn(0x7f142c0fa950 msgr2=0x7f142c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 shutdown_connections 2024-04-12T13:40:46.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.247+0000 7f1431600700 1 -- 172.21.15.60:0/1726857816 wait complete. 2024-04-12T13:40:46.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 -- 172.21.15.60:0/1179565875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0100010 msgr2=0x7f5bf01023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/1179565875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0100010 0x7f5bf01023f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc004940 tx=0x7f5bdc009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 -- 172.21.15.60:0/1179565875 shutdown_connections 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/1179565875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0100010 0x7f5bf01023f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/1179565875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0066250 0x7f5bf00ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.428+0000 7f5bf6c00700 1 -- 172.21.15.60:0/1179565875 >> 172.21.15.60:0/1179565875 conn(0x7f5bf00f74c0 msgr2=0x7f5bf00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.429+0000 7f5bf6c00700 1 -- 172.21.15.60:0/1179565875 shutdown_connections 2024-04-12T13:40:46.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.429+0000 7f5bf6c00700 1 -- 172.21.15.60:0/1179565875 wait complete. 2024-04-12T13:40:46.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 Processor -- start 2024-04-12T13:40:46.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 -- start start 2024-04-12T13:40:46.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0066250 0x7f5bf010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:46.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:46.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0110740 con 0x7f5bf0066250 2024-04-12T13:40:46.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.430+0000 7f5bf6c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0110f40 con 0x7f5bf0100010 2024-04-12T13:40:46.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5befe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0066250 0x7f5bf010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:51440/0 (socket says 172.21.15.60:51440) 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 -- 172.21.15.60:0/3164506292 learned_addr learned my addr 172.21.15.60:0/3164506292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 -- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0066250 msgr2=0x7f5bf010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0066250 0x7f5bf010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.431+0000 7f5bef400700 1 -- 172.21.15.60:0/3164506292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc005040 con 0x7f5bf0100010 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.432+0000 7f5bef400700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00b0d0 tx=0x7f5bdc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.432+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc00e070 con 0x7f5bf0100010 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.432+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bdc00b410 con 0x7f5bf0100010 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.432+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf01111c0 con 0x7f5bf0100010 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.433+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf0111700 con 0x7f5bf0100010 2024-04-12T13:40:46.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.433+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc0125e0 con 0x7f5bf0100010 2024-04-12T13:40:46.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.434+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd00052e0 con 0x7f5bf0100010 2024-04-12T13:40:46.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.435+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5bdc013af0 con 0x7f5bf0100010 2024-04-12T13:40:46.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.436+0000 7f5be7e00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 0x7f5bd406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:40:46.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.437+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5bdc087eb0 con 0x7f5bf0100010 2024-04-12T13:40:46.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.437+0000 7f5befe00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 0x7f5bd406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:40:46.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.439+0000 7f5befe00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 0x7f5bd406b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009b80 tx=0x7f5be000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:40:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.442+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5bdc057c50 con 0x7f5bf0100010 2024-04-12T13:40:46.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:46 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1753645574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:40:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:46 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1753645574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:40:46.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.866+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5bd0005590 con 0x7f5bf0100010 2024-04-12T13:40:46.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.866+0000 7f5be7e00700 1 -- 172.21.15.60:0/3164506292 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5bdc022090 con 0x7f5bf0100010 2024-04-12T13:40:46.869 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:40:46.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 msgr2=0x7f5bd406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 0x7f5bd406b760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009b80 tx=0x7f5be000b040 comp rx=0 tx=0).stop 2024-04-12T13:40:46.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 msgr2=0x7f5bf0110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:40:46.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00b0d0 tx=0x7f5bdc009e30 comp rx=0 tx=0).stop 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 shutdown_connections 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:6800/673590403,v1:172.21.15.60:6801/673590403] conn(0x7f5bd40692b0 0x7f5bd406b760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf0066250 0x7f5bf010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 --2- 172.21.15.60:0/3164506292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5bf0100010 0x7f5bf0110140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 >> 172.21.15.60:0/3164506292 conn(0x7f5bf00f74c0 msgr2=0x7f5bf00fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 shutdown_connections 2024-04-12T13:40:46.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:40:46.870+0000 7f5bf6c00700 1 -- 172.21.15.60:0/3164506292 wait complete. 2024-04-12T13:40:47.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:47 smithi060 ceph-mon[29097]: pgmap v297: 65 pgs: 65 active+clean; 60 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 251 op/s 2024-04-12T13:40:47.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:47 smithi060 ceph-mon[29097]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:47.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:47 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3164506292' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:40:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:47 smithi110 ceph-mon[36055]: pgmap v297: 65 pgs: 65 active+clean; 60 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 251 op/s 2024-04-12T13:40:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:47 smithi110 ceph-mon[36055]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:40:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:47 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3164506292' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:40:49.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:49 smithi110 ceph-mon[36055]: pgmap v298: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s wr, 312 op/s 2024-04-12T13:40:49.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:49 smithi060 ceph-mon[29097]: pgmap v298: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s wr, 312 op/s 2024-04-12T13:40:51.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:51 smithi060 ceph-mon[29097]: pgmap v299: 65 pgs: 65 active+clean; 78 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s wr, 306 op/s 2024-04-12T13:40:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:40:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:40:51.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:51 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:40:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:51 smithi110 ceph-mon[36055]: pgmap v299: 65 pgs: 65 active+clean; 78 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s wr, 306 op/s 2024-04-12T13:40:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:40:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:40:51.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:51 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:40:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:52 smithi110 ceph-mon[36055]: Upgrade: Updating mgr.smithi110.ezwdax 2024-04-12T13:40:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:52 smithi110 ceph-mon[36055]: Deploying daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:40:52.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:52 smithi060 ceph-mon[29097]: Upgrade: Updating mgr.smithi110.ezwdax 2024-04-12T13:40:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:52 smithi060 ceph-mon[29097]: Deploying daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:40:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:53 smithi110 ceph-mon[36055]: pgmap v300: 65 pgs: 65 active+clean; 83 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 315 op/s 2024-04-12T13:40:53.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:53 smithi060 ceph-mon[29097]: pgmap v300: 65 pgs: 65 active+clean; 83 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 315 op/s 2024-04-12T13:40:55.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:55 smithi110 ceph-mon[36055]: pgmap v301: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 329 op/s 2024-04-12T13:40:55.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:55 smithi060 ceph-mon[29097]: pgmap v301: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 329 op/s 2024-04-12T13:40:57.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:57 smithi060 ceph-mon[29097]: pgmap v302: 65 pgs: 65 active+clean; 95 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 270 op/s 2024-04-12T13:40:57.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:57 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:57.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:57 smithi110 ceph-mon[36055]: pgmap v302: 65 pgs: 65 active+clean; 95 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 270 op/s 2024-04-12T13:40:57.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:57 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:40:58.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:58 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:40:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:58 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:40:59.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:40:59 smithi110 ceph-mon[36055]: pgmap v303: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 315 op/s 2024-04-12T13:40:59.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:40:59 smithi060 ceph-mon[29097]: pgmap v303: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 315 op/s 2024-04-12T13:41:00.622 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:00 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:00.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:00 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:01.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:01 smithi060 ceph-mon[29097]: pgmap v304: 65 pgs: 65 active+clean; 104 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s wr, 277 op/s 2024-04-12T13:41:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:01 smithi110 ceph-mon[36055]: pgmap v304: 65 pgs: 65 active+clean; 104 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s wr, 277 op/s 2024-04-12T13:41:03.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:03 smithi060 ceph-mon[29097]: pgmap v305: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 283 op/s 2024-04-12T13:41:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:03 smithi110 ceph-mon[36055]: pgmap v305: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s wr, 283 op/s 2024-04-12T13:41:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:05 smithi060 ceph-mon[29097]: pgmap v306: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s wr, 303 op/s 2024-04-12T13:41:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:05 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:05 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:05 smithi110 ceph-mon[36055]: pgmap v306: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s wr, 303 op/s 2024-04-12T13:41:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:05 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:05 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:06 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:06 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:06 smithi110 ceph-mon[36055]: pgmap v307: 65 pgs: 65 active+clean; 113 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 258 op/s 2024-04-12T13:41:07.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:06 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:06 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:06 smithi060 ceph-mon[29097]: pgmap v307: 65 pgs: 65 active+clean; 113 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 258 op/s 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: pgmap v308: 65 pgs: 65 active+clean; 121 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s wr, 302 op/s 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:41:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:41:09.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:09 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:41:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: pgmap v308: 65 pgs: 65 active+clean; 121 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s wr, 302 op/s 2024-04-12T13:41:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:41:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:41:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:41:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:41:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:41:09.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:09 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:41:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:10 smithi060 ceph-mon[29097]: mgrmap e20: smithi060.bpzacg(active, since 9m), standbys: smithi110.ezwdax 2024-04-12T13:41:10.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:10 smithi110 ceph-mon[36055]: mgrmap e20: smithi060.bpzacg(active, since 9m), standbys: smithi110.ezwdax 2024-04-12T13:41:11.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:11 smithi060 ceph-mon[29097]: pgmap v309: 65 pgs: 65 active+clean; 121 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 266 op/s 2024-04-12T13:41:11.475 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:11 smithi110 ceph-mon[36055]: pgmap v309: 65 pgs: 65 active+clean; 121 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 266 op/s 2024-04-12T13:41:13.346 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:13 smithi110 ceph-mon[36055]: pgmap v310: 65 pgs: 65 active+clean; 123 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 269 op/s 2024-04-12T13:41:13.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:13 smithi060 ceph-mon[29097]: pgmap v310: 65 pgs: 65 active+clean; 123 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s wr, 269 op/s 2024-04-12T13:41:15.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:15 smithi060 ceph-mon[29097]: pgmap v311: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 267 op/s 2024-04-12T13:41:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:15 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:15 smithi110 ceph-mon[36055]: pgmap v311: 65 pgs: 65 active+clean; 128 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s wr, 267 op/s 2024-04-12T13:41:15.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:15 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:17.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.107+0000 7f7e70200700 1 -- 172.21.15.60:0/1981745913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 msgr2=0x7f7e68104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.107+0000 7f7e70200700 1 --2- 172.21.15.60:0/1981745913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e68104750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e54004940 tx=0x7f7e54009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 -- 172.21.15.60:0/1981745913 shutdown_connections 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 --2- 172.21.15.60:0/1981745913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e68104750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 --2- 172.21.15.60:0/1981745913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e68101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 -- 172.21.15.60:0/1981745913 >> 172.21.15.60:0/1981745913 conn(0x7f7e680f74c0 msgr2=0x7f7e680f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 -- 172.21.15.60:0/1981745913 shutdown_connections 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.109+0000 7f7e70200700 1 -- 172.21.15.60:0/1981745913 wait complete. 2024-04-12T13:41:17.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.110+0000 7f7e70200700 1 Processor -- start 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.110+0000 7f7e70200700 1 -- start start 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e70200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e6810b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e70200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e70200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6810c2e0 con 0x7f7e680662f0 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e70200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6810cb30 con 0x7f7e68102370 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e6ce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e6ce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:44946/0 (socket says 172.21.15.60:44946) 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e6ce00700 1 -- 172.21.15.60:0/2994066025 learned_addr learned my addr 172.21.15.60:0/2994066025 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.111+0000 7f7e6d800700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e6810b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.112+0000 7f7e6ce00700 1 -- 172.21.15.60:0/2994066025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 msgr2=0x7f7e6810b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.112+0000 7f7e6ce00700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e6810b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.112+0000 7f7e6ce00700 1 -- 172.21.15.60:0/2994066025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54005040 con 0x7f7e68102370 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.112+0000 7f7e6d800700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e6810b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.112+0000 7f7e6ce00700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e54013870 tx=0x7f7e54009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.113+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5400e070 con 0x7f7e68102370 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.113+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6810cdb0 con 0x7f7e68102370 2024-04-12T13:41:17.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.114+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6810d290 con 0x7f7e68102370 2024-04-12T13:41:17.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.115+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e54026460 con 0x7f7e68102370 2024-04-12T13:41:17.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.116+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e480052e0 con 0x7f7e68102370 2024-04-12T13:41:17.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.118+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5401c640 con 0x7f7e68102370 2024-04-12T13:41:17.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.118+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 21) v1 ==== 46089+0+0 (secure 0 0 0) 0x7f7e54013af0 con 0x7f7e68102370 2024-04-12T13:41:17.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.119+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7e5404e0a0 con 0x7f7e68102370 2024-04-12T13:41:17.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.130+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7e540265d0 con 0x7f7e68102370 2024-04-12T13:41:17.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: pgmap v312: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s wr, 216 op/s 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr fail", "who": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: Activating manager daemon smithi110.ezwdax 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: osdmap e47: 6 total, 6 up, 6 in 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "mgr fail", "who": "smithi060.bpzacg"}]': finished 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: mgrmap e21: smithi110.ezwdax(active, starting, since 0.0110234s) 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:41:17.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:41:17.432 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: Manager daemon smithi110.ezwdax is now available 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.ezwdax/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.ezwdax/trash_purge_schedule"}]: dispatch 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:17.433 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:17.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.452+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 22) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f7e5402ccd0 con 0x7f7e68102370 2024-04-12T13:41:17.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.452+0000 7f7e65600700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 0x7f7e500406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.461+0000 7f7e6d800700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 0x7f7e500406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.463+0000 7f7e6d800700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 0x7f7e500406b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7e68066030 tx=0x7f7e5c0048d0 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: pgmap v312: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s wr, 216 op/s 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' 2024-04-12T13:41:17.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr fail", "who": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: Activating manager daemon smithi110.ezwdax 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: osdmap e47: 6 total, 6 up, 6 in 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.14212 172.21.15.60:0/1959648269' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "mgr fail", "who": "smithi060.bpzacg"}]': finished 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: mgrmap e21: smithi110.ezwdax(active, starting, since 0.0110234s) 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:41:17.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: Manager daemon smithi110.ezwdax is now available 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.ezwdax/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.ezwdax/trash_purge_schedule"}]: dispatch 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:17.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.521+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e48000bf0 con 0x7f7e5003e2d0 2024-04-12T13:41:17.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.524+0000 7f7e65600700 1 -- 172.21.15.60:0/2994066025 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7e48000bf0 con 0x7f7e5003e2d0 2024-04-12T13:41:17.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 msgr2=0x7f7e500406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 0x7f7e500406b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7e68066030 tx=0x7f7e5c0048d0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 msgr2=0x7f7e6810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e54013870 tx=0x7f7e54009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 shutdown_connections 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7e5003e2d0 0x7f7e500406b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e680662f0 0x7f7e6810b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 --2- 172.21.15.60:0/2994066025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e68102370 0x7f7e6810bce0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.526+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 >> 172.21.15.60:0/2994066025 conn(0x7f7e680f74c0 msgr2=0x7f7e680f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.527+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 shutdown_connections 2024-04-12T13:41:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.527+0000 7f7e70200700 1 -- 172.21.15.60:0/2994066025 wait complete. 2024-04-12T13:41:17.551 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:41:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.726+0000 7f09fa600700 1 -- 172.21.15.60:0/2490701753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 msgr2=0x7f09f40fd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.726+0000 7f09fa600700 1 --2- 172.21.15.60:0/2490701753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f40fd5f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f09e8004940 tx=0x7f09e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.727+0000 7f09fa600700 1 -- 172.21.15.60:0/2490701753 shutdown_connections 2024-04-12T13:41:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.727+0000 7f09fa600700 1 --2- 172.21.15.60:0/2490701753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.727+0000 7f09fa600700 1 --2- 172.21.15.60:0/2490701753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f40fd5f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.727+0000 7f09fa600700 1 -- 172.21.15.60:0/2490701753 >> 172.21.15.60:0/2490701753 conn(0x7f09f40f7270 msgr2=0x7f09f40f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.727+0000 7f09fa600700 1 -- 172.21.15.60:0/2490701753 shutdown_connections 2024-04-12T13:41:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.729+0000 7f09fa600700 1 -- 172.21.15.60:0/2490701753 wait complete. 2024-04-12T13:41:17.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 Processor -- start 2024-04-12T13:41:17.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 -- start start 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f41143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4115130 con 0x7f09f40662f0 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.730+0000 7f09fa600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f41152a0 con 0x7f09f40fdb30 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.731+0000 7f09f9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.731+0000 7f09f3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f41143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.731+0000 7f09f9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52024/0 (socket says 172.21.15.60:52024) 2024-04-12T13:41:17.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.731+0000 7f09f9200700 1 -- 172.21.15.60:0/2792766201 learned_addr learned my addr 172.21.15.60:0/2792766201 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.732+0000 7f09f3e00700 1 -- 172.21.15.60:0/2792766201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 msgr2=0x7f09f4113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.732+0000 7f09f3e00700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.732+0000 7f09f3e00700 1 -- 172.21.15.60:0/2792766201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8005040 con 0x7f09f40fdb30 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.732+0000 7f09f9200700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.732+0000 7f09f3e00700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f41143c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009fd0 tx=0x7f09e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.733+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e0004e90 con 0x7f09f40fdb30 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.733+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f41154c0 con 0x7f09f40fdb30 2024-04-12T13:41:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.733+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09e000f040 con 0x7f09f40fdb30 2024-04-12T13:41:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.733+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f4115a80 con 0x7f09f40fdb30 2024-04-12T13:41:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.733+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e000ca50 con 0x7f09f40fdb30 2024-04-12T13:41:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.734+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f405f5f0 con 0x7f09f40fdb30 2024-04-12T13:41:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.735+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 22) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f09e0007cc0 con 0x7f09f40fdb30 2024-04-12T13:41:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.736+0000 7f09f0c00700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 0x7f09dc03b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.736+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f09e004c940 con 0x7f09f40fdb30 2024-04-12T13:41:17.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.737+0000 7f09f9200700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 0x7f09dc03b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:17.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.738+0000 7f09f9200700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 0x7f09dc03b770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09e80136a0 tx=0x7f09e8009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:17.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:17.742+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f09e0012de0 con 0x7f09f40fdb30 2024-04-12T13:41:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.123+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f4115dd0 con 0x7f09dc0392c0 2024-04-12T13:41:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.127+0000 7f09f0c00700 1 -- 172.21.15.60:0/2792766201 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f09f4115dd0 con 0x7f09dc0392c0 2024-04-12T13:41:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 msgr2=0x7f09dc03b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 0x7f09dc03b770 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f09e80136a0 tx=0x7f09e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 msgr2=0x7f09f41143c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f41143c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009fd0 tx=0x7f09e000b040 comp rx=0 tx=0).stop 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 shutdown_connections 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f09dc0392c0 0x7f09dc03b770 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09f40662f0 0x7f09f4113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 --2- 172.21.15.60:0/2792766201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f40fdb30 0x7f09f41143c0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009fd0 tx=0x7f09e000b040 comp rx=0 tx=0).stop 2024-04-12T13:41:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.130+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 >> 172.21.15.60:0/2792766201 conn(0x7f09f40f7270 msgr2=0x7f09f40f7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.131+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 shutdown_connections 2024-04-12T13:41:18.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.131+0000 7f09fa600700 1 -- 172.21.15.60:0/2792766201 wait complete. 2024-04-12T13:41:18.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 -- 172.21.15.60:0/4112859197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 msgr2=0x7f98e00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 --2- 172.21.15.60:0/4112859197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e00fe550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004940 tx=0x7f98cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 -- 172.21.15.60:0/4112859197 shutdown_connections 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 --2- 172.21.15.60:0/4112859197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e00fe550 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 --2- 172.21.15.60:0/4112859197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 0x7f98e00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 -- 172.21.15.60:0/4112859197 >> 172.21.15.60:0/4112859197 conn(0x7f98e00f8530 msgr2=0x7f98e00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 -- 172.21.15.60:0/4112859197 shutdown_connections 2024-04-12T13:41:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.329+0000 7f98e6800700 1 -- 172.21.15.60:0/4112859197 wait complete. 2024-04-12T13:41:18.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.330+0000 7f98e6800700 1 Processor -- start 2024-04-12T13:41:18.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.330+0000 7f98e6800700 1 -- start start 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.331+0000 7f98e6800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 0x7f98e0113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.331+0000 7f98e6800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.331+0000 7f98e6800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0115120 con 0x7f98e00fe0e0 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.331+0000 7f98e6800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0115290 con 0x7f98e00fcef0 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.332+0000 7f98dea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.332+0000 7f98dea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52048/0 (socket says 172.21.15.60:52048) 2024-04-12T13:41:18.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.332+0000 7f98dea00700 1 -- 172.21.15.60:0/3440924829 learned_addr learned my addr 172.21.15.60:0/3440924829 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:18.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.332+0000 7f98df400700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 0x7f98e0113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:18.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.333+0000 7f98dea00700 1 -- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 msgr2=0x7f98e0113e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.333+0000 7f98dea00700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 0x7f98e0113e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.333+0000 7f98dea00700 1 -- 172.21.15.60:0/3440924829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc005040 con 0x7f98e00fe0e0 2024-04-12T13:41:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.334+0000 7f98dea00700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.335+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc020070 con 0x7f98e00fe0e0 2024-04-12T13:41:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.335+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e01154b0 con 0x7f98e00fe0e0 2024-04-12T13:41:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.335+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e0115990 con 0x7f98e00fe0e0 2024-04-12T13:41:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.335+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98cc013d00 con 0x7f98e00fe0e0 2024-04-12T13:41:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.335+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc00e070 con 0x7f98e00fe0e0 2024-04-12T13:41:18.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.337+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f98cc01c960 con 0x7f98e00fe0e0 2024-04-12T13:41:18.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.337+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c00052e0 con 0x7f98e00fe0e0 2024-04-12T13:41:18.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.338+0000 7f98d7400700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 0x7f98c403b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:18.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.338+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f98cc04e280 con 0x7f98e00fe0e0 2024-04-12T13:41:18.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.339+0000 7f98df400700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 0x7f98c403b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:18.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.341+0000 7f98df400700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 0x7f98c403b770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e0113be0 tx=0x7f98d000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:18.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.347+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f98cc01c400 con 0x7f98e00fe0e0 2024-04-12T13:41:18.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:18 smithi110 ceph-mon[36055]: Deploying cephadm binary to smithi110 2024-04-12T13:41:18.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:18 smithi110 ceph-mon[36055]: Deploying cephadm binary to smithi060 2024-04-12T13:41:18.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:18 smithi110 ceph-mon[36055]: mgrmap e22: smithi110.ezwdax(active, since 1.01854s) 2024-04-12T13:41:18.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:18 smithi110 ceph-mon[36055]: pgmap v3: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:18.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:18 smithi110 ceph-mon[36055]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:18.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.755+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98c0000bf0 con 0x7f98c40392c0 2024-04-12T13:41:18.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:18 smithi060 ceph-mon[29097]: Deploying cephadm binary to smithi110 2024-04-12T13:41:18.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:18 smithi060 ceph-mon[29097]: Deploying cephadm binary to smithi060 2024-04-12T13:41:18.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:18 smithi060 ceph-mon[29097]: mgrmap e22: smithi110.ezwdax(active, since 1.01854s) 2024-04-12T13:41:18.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:18 smithi060 ceph-mon[29097]: pgmap v3: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:18.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:18 smithi060 ceph-mon[29097]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.792+0000 7f98d7400700 1 -- 172.21.15.60:0/3440924829 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f98c0000bf0 con 0x7f98c40392c0 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 2m ago 10m 13.2M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (10m) 2m ago 10m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (9m) 14s ago 9m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:41:18.795 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (8m) 2m ago 9m 74.9M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (2m) 2m ago 2m 10.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (3m) 2m ago 2m 13.2M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (2m) 14s ago 2m 11.2M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (2m) 14s ago 2m 11.3M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (11m) 2m ago 11m 483M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (22s) 14s ago 8m 55.7M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (11m) 2m ago 12m 41.1M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (8m) 14s ago 8m 35.8M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (10m) 2m ago 10m 7625k - 1.5.0 0da6a335fe13 5baa779bb80b 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 14s ago 8m 7968k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 2m ago 7m 44.4M 4290M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 2m ago 7m 45.0M 4290M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (6m) 2m ago 6m 43.3M 4290M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (5m) 14s ago 5m 94.0M 5312M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:41:18.796 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (5m) 14s ago 5m 89.6M 5312M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:41:18.797 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (4m) 14s ago 4m 83.1M 5312M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:41:18.797 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (7m) 2m ago 9m 45.1M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 msgr2=0x7f98c403b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 0x7f98c403b770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e0113be0 tx=0x7f98d000b040 comp rx=0 tx=0).stop 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 msgr2=0x7f98e01143b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 shutdown_connections 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98c40392c0 0x7f98c403b770 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98e00fcef0 0x7f98e0113e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 --2- 172.21.15.60:0/3440924829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e00fe0e0 0x7f98e01143b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.795+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 >> 172.21.15.60:0/3440924829 conn(0x7f98e00f8530 msgr2=0x7f98e00f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.796+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 shutdown_connections 2024-04-12T13:41:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:18.796+0000 7f98e6800700 1 -- 172.21.15.60:0/3440924829 wait complete. 2024-04-12T13:41:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 -- 172.21.15.60:0/3459488308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e8104fc0 msgr2=0x7f51e81073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 --2- 172.21.15.60:0/3459488308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e8104fc0 0x7f51e81073a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f51d8004940 tx=0x7f51d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 -- 172.21.15.60:0/3459488308 shutdown_connections 2024-04-12T13:41:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 --2- 172.21.15.60:0/3459488308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e81078e0 0x7f51e8109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 --2- 172.21.15.60:0/3459488308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e8104fc0 0x7f51e81073a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 -- 172.21.15.60:0/3459488308 >> 172.21.15.60:0/3459488308 conn(0x7f51e8069df0 msgr2=0x7f51e806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 -- 172.21.15.60:0/3459488308 shutdown_connections 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.009+0000 7f51ee000700 1 -- 172.21.15.60:0/3459488308 wait complete. 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.010+0000 7f51ee000700 1 Processor -- start 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.010+0000 7f51ee000700 1 -- start start 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.011+0000 7f51ee000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 0x7f51e811c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.011+0000 7f51ee000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 0x7f51e811ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.011+0000 7f51ee000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e811d2f0 con 0x7f51e81078e0 2024-04-12T13:41:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.011+0000 7f51ee000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e811d460 con 0x7f51e8104fc0 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.011+0000 7f51e7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 0x7f51e811c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.012+0000 7f51e6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 0x7f51e811ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.012+0000 7f51e7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 0x7f51e811c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:45014/0 (socket says 172.21.15.60:45014) 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.012+0000 7f51e7400700 1 -- 172.21.15.60:0/2855024491 learned_addr learned my addr 172.21.15.60:0/2855024491 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.013+0000 7f51e6a00700 1 -- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 msgr2=0x7f51e811c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.013+0000 7f51e6a00700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 0x7f51e811c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.013+0000 7f51e6a00700 1 -- 172.21.15.60:0/2855024491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8005040 con 0x7f51e81078e0 2024-04-12T13:41:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.014+0000 7f51e6a00700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 0x7f51e811ccf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f51d4004fd0 tx=0x7f51d4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.014+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51d4007cc0 con 0x7f51e81078e0 2024-04-12T13:41:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.014+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8121e70 con 0x7f51e81078e0 2024-04-12T13:41:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.014+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e8122430 con 0x7f51e81078e0 2024-04-12T13:41:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.016+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51d400f040 con 0x7f51e81078e0 2024-04-12T13:41:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.016+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51d4013920 con 0x7f51e81078e0 2024-04-12T13:41:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.017+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c80052e0 con 0x7f51e81078e0 2024-04-12T13:41:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.017+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) v1 ==== 46410+0+0 (secure 0 0 0) 0x7f51d4013b20 con 0x7f51e81078e0 2024-04-12T13:41:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.018+0000 7f51df400700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 0x7f51cc03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.018+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f51d404c9f0 con 0x7f51e81078e0 2024-04-12T13:41:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.020+0000 7f51e7400700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 0x7f51cc03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.021+0000 7f51e7400700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 0x7f51cc03b780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51d800b020 tx=0x7f51d8009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.025+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f51d4009830 con 0x7f51e81078e0 2024-04-12T13:41:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.467+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 23) v1 ==== 46568+0+0 (secure 0 0 0) 0x7f51d401a300 con 0x7f51e81078e0 2024-04-12T13:41:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.518+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51c8005da0 con 0x7f51e81078e0 2024-04-12T13:41:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.519+0000 7f51df400700 1 -- 172.21.15.60:0/2855024491 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f51d4009830 con 0x7f51e81078e0 2024-04-12T13:41:19.521 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:41:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:41:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:41:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 12, 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:41:19.522 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 msgr2=0x7f51cc03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 0x7f51cc03b780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51d800b020 tx=0x7f51d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 msgr2=0x7f51e811ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 0x7f51e811ccf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f51d4004fd0 tx=0x7f51d4004570 comp rx=0 tx=0).stop 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 shutdown_connections 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f51cc0392d0 0x7f51cc03b780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e8104fc0 0x7f51e811c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 --2- 172.21.15.60:0/2855024491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51e81078e0 0x7f51e811ccf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 >> 172.21.15.60:0/2855024491 conn(0x7f51e8069df0 msgr2=0x7f51e806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 shutdown_connections 2024-04-12T13:41:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.522+0000 7f51ee000700 1 -- 172.21.15.60:0/2855024491 wait complete. 2024-04-12T13:41:19.571 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:19.571 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: [12/Apr/2024:13:41:18] ENGINE Bus STARTING 2024-04-12T13:41:19.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: pgmap v4: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:19.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: [12/Apr/2024:13:41:18] ENGINE Serving on http://172.21.15.110:8765 2024-04-12T13:41:19.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: [12/Apr/2024:13:41:18] ENGINE Serving on https://172.21.15.110:7150 2024-04-12T13:41:19.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: [12/Apr/2024:13:41:18] ENGINE Bus STARTED 2024-04-12T13:41:19.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:19 smithi060 ceph-mon[29097]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 -- 172.21.15.60:0/2902686709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 msgr2=0x7f54a80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 --2- 172.21.15.60:0/2902686709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a80fe550 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5494004ae0 tx=0x7f5494009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 -- 172.21.15.60:0/2902686709 shutdown_connections 2024-04-12T13:41:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 --2- 172.21.15.60:0/2902686709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a80fe550 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 --2- 172.21.15.60:0/2902686709 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.716+0000 7f54adc00700 1 -- 172.21.15.60:0/2902686709 >> 172.21.15.60:0/2902686709 conn(0x7f54a80f8530 msgr2=0x7f54a80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.717+0000 7f54adc00700 1 -- 172.21.15.60:0/2902686709 shutdown_connections 2024-04-12T13:41:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.717+0000 7f54adc00700 1 -- 172.21.15.60:0/2902686709 wait complete. 2024-04-12T13:41:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 Processor -- start 2024-04-12T13:41:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 -- start start 2024-04-12T13:41:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a810b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a810bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a810c3c0 con 0x7f54a80fe0e0 2024-04-12T13:41:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.718+0000 7f54adc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a810fe60 con 0x7f54a80fcef0 2024-04-12T13:41:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.719+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a810b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.719+0000 7f54a6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a810b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:45086/0 (socket says 172.21.15.60:45086) 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.719+0000 7f54a6a00700 1 -- 172.21.15.60:0/1971222040 learned_addr learned my addr 172.21.15.60:0/1971222040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.719+0000 7f54a6000700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a810bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.720+0000 7f54a6000700 1 -- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 msgr2=0x7f54a810b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.720+0000 7f54a6000700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a810b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.720+0000 7f54a6000700 1 -- 172.21.15.60:0/1971222040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494005040 con 0x7f54a80fe0e0 2024-04-12T13:41:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.720+0000 7f54a6000700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a810bd70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5494005010 tx=0x7f5494009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.721+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549400e070 con 0x7f54a80fe0e0 2024-04-12T13:41:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.721+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5494009850 con 0x7f54a80fe0e0 2024-04-12T13:41:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.721+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549401de90 con 0x7f54a80fe0e0 2024-04-12T13:41:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.721+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a81100e0 con 0x7f54a80fe0e0 2024-04-12T13:41:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.721+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a8110640 con 0x7f54a80fe0e0 2024-04-12T13:41:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.723+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) v1 ==== 46568+0+0 (secure 0 0 0) 0x7f5494013420 con 0x7f54a80fe0e0 2024-04-12T13:41:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.723+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a805f5f0 con 0x7f54a80fe0e0 2024-04-12T13:41:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.723+0000 7f549ea00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 0x7f548c03b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.723+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f549404f2c0 con 0x7f54a80fe0e0 2024-04-12T13:41:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.724+0000 7f54a6a00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 0x7f548c03b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:19.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.725+0000 7f54a6a00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 0x7f548c03b970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54a810b5c0 tx=0x7f549800b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: [12/Apr/2024:13:41:18] ENGINE Bus STARTING 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: pgmap v4: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: [12/Apr/2024:13:41:18] ENGINE Serving on http://172.21.15.110:8765 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: [12/Apr/2024:13:41:18] ENGINE Serving on https://172.21.15.110:7150 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: [12/Apr/2024:13:41:18] ENGINE Bus STARTED 2024-04-12T13:41:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:19 smithi110 ceph-mon[36055]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:19.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:19.731+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f5494011740 con 0x7f54a80fe0e0 2024-04-12T13:41:20.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.190+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54a8110920 con 0x7f54a80fe0e0 2024-04-12T13:41:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.191+0000 7f549ea00700 1 -- 172.21.15.60:0/1971222040 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f54940263b0 con 0x7f54a80fe0e0 2024-04-12T13:41:20.193 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:41:20.193 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:41:20.193 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:41:20.193 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:41:20.194 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:41:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:20.196 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 msgr2=0x7f548c03b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 0x7f548c03b970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54a810b5c0 tx=0x7f549800b040 comp rx=0 tx=0).stop 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 msgr2=0x7f54a810bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a810bd70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5494005010 tx=0x7f5494009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 shutdown_connections 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f548c0394c0 0x7f548c03b970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a80fcef0 0x7f54a810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 --2- 172.21.15.60:0/1971222040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54a80fe0e0 0x7f54a810bd70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.194+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 >> 172.21.15.60:0/1971222040 conn(0x7f54a80f8530 msgr2=0x7f54a80f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.195+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 shutdown_connections 2024-04-12T13:41:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.195+0000 7f54adc00700 1 -- 172.21.15.60:0/1971222040 wait complete. 2024-04-12T13:41:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.387+0000 7fc796a00700 1 -- 172.21.15.60:0/3600666688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 msgr2=0x7fc790070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.387+0000 7fc796a00700 1 --2- 172.21.15.60:0/3600666688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790070e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc77c004940 tx=0x7fc77c009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.388+0000 7fc796a00700 1 -- 172.21.15.60:0/3600666688 shutdown_connections 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.388+0000 7fc796a00700 1 --2- 172.21.15.60:0/3600666688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790070e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.388+0000 7fc796a00700 1 --2- 172.21.15.60:0/3600666688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.388+0000 7fc796a00700 1 -- 172.21.15.60:0/3600666688 >> 172.21.15.60:0/3600666688 conn(0x7fc7900f8530 msgr2=0x7fc7900fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.389+0000 7fc796a00700 1 -- 172.21.15.60:0/3600666688 shutdown_connections 2024-04-12T13:41:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.389+0000 7fc796a00700 1 -- 172.21.15.60:0/3600666688 wait complete. 2024-04-12T13:41:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.390+0000 7fc796a00700 1 Processor -- start 2024-04-12T13:41:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.390+0000 7fc796a00700 1 -- start start 2024-04-12T13:41:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.391+0000 7fc796a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790114040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.391+0000 7fc796a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.391+0000 7fc796a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790114b80 con 0x7fc7900709a0 2024-04-12T13:41:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.391+0000 7fc796a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901153d0 con 0x7fc790071f50 2024-04-12T13:41:20.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.391+0000 7fc78fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790114040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.392+0000 7fc78f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.392+0000 7fc78f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:45108/0 (socket says 172.21.15.60:45108) 2024-04-12T13:41:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.392+0000 7fc78f400700 1 -- 172.21.15.60:0/2892896620 learned_addr learned my addr 172.21.15.60:0/2892896620 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.392+0000 7fc78fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790114040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58900/0 (socket says 172.21.15.60:58900) 2024-04-12T13:41:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.393+0000 7fc78f400700 1 -- 172.21.15.60:0/2892896620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 msgr2=0x7fc790114040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.393+0000 7fc78f400700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790114040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.393+0000 7fc78f400700 1 -- 172.21.15.60:0/2892896620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c005040 con 0x7fc790071f50 2024-04-12T13:41:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.394+0000 7fc78f400700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00b3b0 tx=0x7fc77c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.394+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77c00e040 con 0x7fc790071f50 2024-04-12T13:41:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.395+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc77c004290 con 0x7fc790071f50 2024-04-12T13:41:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.395+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77c01c3f0 con 0x7fc790071f50 2024-04-12T13:41:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.395+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc790115650 con 0x7fc790071f50 2024-04-12T13:41:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.395+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc790115b90 con 0x7fc790071f50 2024-04-12T13:41:20.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.397+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79005f5f0 con 0x7fc790071f50 2024-04-12T13:41:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.398+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 23) v1 ==== 46568+0+0 (secure 0 0 0) 0x7fc77c00bbf0 con 0x7fc790071f50 2024-04-12T13:41:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.399+0000 7fc787e00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 0x7fc77403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.399+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc77c04eae0 con 0x7fc790071f50 2024-04-12T13:41:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.400+0000 7fc78fe00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 0x7fc77403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.401+0000 7fc78fe00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 0x7fc77403b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc790071c90 tx=0x7fc78000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:20.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.420+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fc77c024c30 con 0x7fc790071f50 2024-04-12T13:41:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:20 smithi060 ceph-mon[29097]: mgrmap e23: smithi110.ezwdax(active, since 3s) 2024-04-12T13:41:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:20 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2855024491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:41:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:20 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1971222040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:41:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:20 smithi110 ceph-mon[36055]: mgrmap e23: smithi110.ezwdax(active, since 3s) 2024-04-12T13:41:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:20 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2855024491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:41:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:20 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1971222040' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:41:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.755+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc790115f80 con 0x7fc774039480 2024-04-12T13:41:20.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.761+0000 7fc787e00700 1 -- 172.21.15.60:0/2892896620 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc790115f80 con 0x7fc774039480 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/21 daemons upgraded", 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:41:20.766 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.764+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 msgr2=0x7fc77403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.764+0000 7fc796a00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 0x7fc77403b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc790071c90 tx=0x7fc78000b040 comp rx=0 tx=0).stop 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.764+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 msgr2=0x7fc790114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.764+0000 7fc796a00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00b3b0 tx=0x7fc77c009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 shutdown_connections 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc774039480 0x7fc77403b930 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc790071c90 tx=0x7fc78000b040 comp rx=0 tx=0).stop 2024-04-12T13:41:20.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7900709a0 0x7fc790114040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 --2- 172.21.15.60:0/2892896620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc790071f50 0x7fc790114580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 >> 172.21.15.60:0/2892896620 conn(0x7fc7900f8530 msgr2=0x7fc7900f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 shutdown_connections 2024-04-12T13:41:20.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.765+0000 7fc796a00700 1 -- 172.21.15.60:0/2892896620 wait complete. 2024-04-12T13:41:20.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.963+0000 7fd5c8c00700 1 -- 172.21.15.60:0/4277972794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c4100320 msgr2=0x7fd5c4100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.963+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/4277972794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c4100320 0x7fd5c4100790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0004940 tx=0x7fd5b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:20.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 -- 172.21.15.60:0/4277972794 shutdown_connections 2024-04-12T13:41:20.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/4277972794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c4100320 0x7fd5c4100790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/4277972794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c40ff070 0x7fd5c40ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 -- 172.21.15.60:0/4277972794 >> 172.21.15.60:0/4277972794 conn(0x7fd5c40fa950 msgr2=0x7fd5c40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:20.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 -- 172.21.15.60:0/4277972794 shutdown_connections 2024-04-12T13:41:20.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.965+0000 7fd5c8c00700 1 -- 172.21.15.60:0/4277972794 wait complete. 2024-04-12T13:41:20.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.966+0000 7fd5c8c00700 1 Processor -- start 2024-04-12T13:41:20.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.966+0000 7fd5c8c00700 1 -- start start 2024-04-12T13:41:20.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.967+0000 7fd5c8c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.967+0000 7fd5c8c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c4100320 0x7fd5c4110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.967+0000 7fd5c8c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4110770 con 0x7fd5c4100320 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.967+0000 7fd5c8c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4110fc0 con 0x7fd5c40ff070 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.968+0000 7fd5c1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.968+0000 7fd5c1400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c4100320 0x7fd5c4110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.968+0000 7fd5c1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:45124/0 (socket says 172.21.15.60:45124) 2024-04-12T13:41:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.968+0000 7fd5c1e00700 1 -- 172.21.15.60:0/659522149 learned_addr learned my addr 172.21.15.60:0/659522149 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.969+0000 7fd5c1e00700 1 -- 172.21.15.60:0/659522149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c4100320 msgr2=0x7fd5c4110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.969+0000 7fd5c1e00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c4100320 0x7fd5c4110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.969+0000 7fd5c1e00700 1 -- 172.21.15.60:0/659522149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b0005040 con 0x7fd5c40ff070 2024-04-12T13:41:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.970+0000 7fd5c1e00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c8c0 tx=0x7fd5b40044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.970+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b400a760 con 0x7fd5c40ff070 2024-04-12T13:41:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.970+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5b400ad90 con 0x7fd5c40ff070 2024-04-12T13:41:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.970+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c41112a0 con 0x7fd5c40ff070 2024-04-12T13:41:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.970+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b40113a0 con 0x7fd5c40ff070 2024-04-12T13:41:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.971+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c41117e0 con 0x7fd5c40ff070 2024-04-12T13:41:20.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.972+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 23) v1 ==== 46568+0+0 (secure 0 0 0) 0x7fd5b4012400 con 0x7fd5c40ff070 2024-04-12T13:41:20.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.973+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c405f5f0 con 0x7fd5c40ff070 2024-04-12T13:41:20.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.973+0000 7fd5ba000700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 0x7fd5a803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:20.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.973+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd5b404d1e0 con 0x7fd5c40ff070 2024-04-12T13:41:20.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.974+0000 7fd5c1400700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 0x7fd5a803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:20.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.975+0000 7fd5c1400700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 0x7fd5a803b930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b3b0 tx=0x7fd5b0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:20.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:20.981+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fd5b4012770 con 0x7fd5c40ff070 2024-04-12T13:41:21.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.465+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd5c404bed0 con 0x7fd5c40ff070 2024-04-12T13:41:21.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.466+0000 7fd5ba000700 1 -- 172.21.15.60:0/659522149 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd5b4010b90 con 0x7fd5c40ff070 2024-04-12T13:41:21.468 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.469+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 msgr2=0x7fd5a803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.469+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 0x7fd5a803b930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000b3b0 tx=0x7fd5b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.469+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 msgr2=0x7fd5c410fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.469+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c8c0 tx=0x7fd5b40044c0 comp rx=0 tx=0).stop 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 shutdown_connections 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fd5a8039480 0x7fd5a803b930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:21.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c40ff070 0x7fd5c410fc30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:21.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 --2- 172.21.15.60:0/659522149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5c4100320 0x7fd5c4110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:21.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 >> 172.21.15.60:0/659522149 conn(0x7fd5c40fa950 msgr2=0x7fd5c40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:21.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 shutdown_connections 2024-04-12T13:41:21.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:21.470+0000 7fd5c8c00700 1 -- 172.21.15.60:0/659522149 wait complete. 2024-04-12T13:41:21.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:21 smithi060 ceph-mon[29097]: pgmap v5: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:21.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:21 smithi060 ceph-mon[29097]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:21.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:21 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/659522149' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:41:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:21 smithi110 ceph-mon[36055]: pgmap v5: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:41:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:21 smithi110 ceph-mon[36055]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:21 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/659522149' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:41:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:23 smithi110 ceph-mon[36055]: pgmap v6: 65 pgs: 65 active+clean; 146 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 224 KiB/s wr, 34 op/s 2024-04-12T13:41:23.808 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:23 smithi060 ceph-mon[29097]: pgmap v6: 65 pgs: 65 active+clean; 146 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 224 KiB/s wr, 34 op/s 2024-04-12T13:41:25.895 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:25 smithi060 ceph-mon[29097]: pgmap v7: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 221 op/s 2024-04-12T13:41:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:25 smithi110 ceph-mon[36055]: pgmap v7: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 221 op/s 2024-04-12T13:41:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:27 smithi110 ceph-mon[36055]: pgmap v8: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 171 op/s 2024-04-12T13:41:27.906 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:27 smithi060 ceph-mon[29097]: pgmap v8: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 171 op/s 2024-04-12T13:41:29.864 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: pgmap v9: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 236 op/s 2024-04-12T13:41:29.864 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: Standby manager daemon smithi060.bpzacg started 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/crt"}]: dispatch 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/key"}]: dispatch 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:29.865 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:29 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: pgmap v9: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 236 op/s 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: Standby manager daemon smithi060.bpzacg started 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/crt"}]: dispatch 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/key"}]: dispatch 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/604869907' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:29.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:29 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:30.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:30 smithi060 ceph-mon[29097]: mgrmap e24: smithi110.ezwdax(active, since 13s), standbys: smithi060.bpzacg 2024-04-12T13:41:30.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:30 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:41:30.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:30 smithi110 ceph-mon[36055]: mgrmap e24: smithi110.ezwdax(active, since 13s), standbys: smithi060.bpzacg 2024-04-12T13:41:30.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:30 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:41:31.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:31 smithi060 ceph-mon[29097]: pgmap v10: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1.9 MiB/s wr, 216 op/s 2024-04-12T13:41:31.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:31 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:31.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:31 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:31.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:31 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:32.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:31 smithi110 ceph-mon[36055]: pgmap v10: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 1.9 MiB/s wr, 216 op/s 2024-04-12T13:41:32.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:31 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:32.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:31 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:32.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:31 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:33.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:33 smithi110 ceph-mon[36055]: pgmap v11: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 233 op/s 2024-04-12T13:41:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:33 smithi060 ceph-mon[29097]: pgmap v11: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 233 op/s 2024-04-12T13:41:36.141 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:35 smithi110 ceph-mon[36055]: pgmap v12: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 314 op/s 2024-04-12T13:41:36.141 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:36.141 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:35 smithi060 ceph-mon[29097]: pgmap v12: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 314 op/s 2024-04-12T13:41:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: pgmap v13: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s wr, 200 op/s 2024-04-12T13:41:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi110 to 2581M 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:41:38.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:37 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: pgmap v13: 65 pgs: 65 active+clean; 178 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s wr, 200 op/s 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi110 to 2581M 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:41:38.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:37 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:41:39.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:38 smithi060 ceph-mon[29097]: Adjusting osd_memory_target on smithi060 to 1559M 2024-04-12T13:41:39.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:38 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:41:39.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:38 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:41:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:38 smithi110 ceph-mon[36055]: Adjusting osd_memory_target on smithi060 to 1559M 2024-04-12T13:41:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:38 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:41:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:38 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:41:40.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:39 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:41:40.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:39 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:41:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:39 smithi060 ceph-mon[29097]: pgmap v14: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s wr, 299 op/s 2024-04-12T13:41:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:39 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:41:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:39 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:41:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:39 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:41:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:39 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:41:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:39 smithi110 ceph-mon[36055]: pgmap v14: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s wr, 299 op/s 2024-04-12T13:41:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:39 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:41:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:39 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:41:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:41:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:41:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:40 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:40 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: pgmap v15: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s wr, 212 op/s 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: Reconfiguring node-exporter.smithi060 (dependencies changed)... 2024-04-12T13:41:42.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:41 smithi060 ceph-mon[29097]: Reconfiguring daemon node-exporter.smithi060 on smithi060 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: pgmap v15: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s wr, 212 op/s 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: Reconfiguring node-exporter.smithi060 (dependencies changed)... 2024-04-12T13:41:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:41 smithi110 ceph-mon[36055]: Reconfiguring daemon node-exporter.smithi060 on smithi060 2024-04-12T13:41:42.690 INFO:tasks.workunit.client.0.smithi060.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-12T13:41:42.701 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T13:41:42.701 INFO:tasks.workunit.client.0.smithi060.stderr:+ make 2024-04-12T13:41:43.424 INFO:tasks.workunit.client.0.smithi060.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-12T13:41:44.117 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:43 smithi060 ceph-mon[29097]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s wr, 227 op/s 2024-04-12T13:41:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:43 smithi110 ceph-mon[36055]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s wr, 227 op/s 2024-04-12T13:41:46.132 INFO:tasks.workunit.client.1.smithi110.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-12T13:41:46.162 INFO:tasks.workunit.client.1.smithi110.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T13:41:46.162 INFO:tasks.workunit.client.1.smithi110.stderr:+ make 2024-04-12T13:41:46.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:45 smithi060 ceph-mon[29097]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 325 op/s 2024-04-12T13:41:46.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:45 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:46.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:45 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:45 smithi110 ceph-mon[36055]: pgmap v17: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 325 op/s 2024-04-12T13:41:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:45 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:45 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:41:46.368 INFO:tasks.workunit.client.0.smithi060.stderr:++ readlink -f fsstress 2024-04-12T13:41:46.373 INFO:tasks.workunit.client.0.smithi060.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-12T13:41:46.373 INFO:tasks.workunit.client.0.smithi060.stderr:+ popd 2024-04-12T13:41:46.377 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T13:41:46.377 INFO:tasks.workunit.client.0.smithi060.stderr:+ popd 2024-04-12T13:41:46.379 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-12T13:41:46.381 INFO:tasks.workunit.client.0.smithi060.stderr:++ mktemp -d -p . 2024-04-12T13:41:46.386 INFO:tasks.workunit.client.0.smithi060.stderr:+ T=./tmp.ipk6qCJ9YZ 2024-04-12T13:41:46.386 INFO:tasks.workunit.client.0.smithi060.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ipk6qCJ9YZ -l 1 -n 1000 -p 10 -v 2024-04-12T13:41:46.393 INFO:tasks.workunit.client.0.smithi060.stdout:seed = 1713162226 2024-04-12T13:41:46.399 INFO:tasks.workunit.client.0.smithi060.stdout:0/0: dread - no filename 2024-04-12T13:41:46.399 INFO:tasks.workunit.client.0.smithi060.stdout:0/1: chown . 32850 1 2024-04-12T13:41:46.399 INFO:tasks.workunit.client.0.smithi060.stdout:0/2: chown . 25 1 2024-04-12T13:41:46.399 INFO:tasks.workunit.client.0.smithi060.stdout:0/3: readlink - no filename 2024-04-12T13:41:46.400 INFO:tasks.workunit.client.0.smithi060.stdout:0/4: chown . 165 1 2024-04-12T13:41:46.401 INFO:tasks.workunit.client.0.smithi060.stdout:9/0: link - no file 2024-04-12T13:41:46.401 INFO:tasks.workunit.client.0.smithi060.stdout:9/1: chown . 252310 1 2024-04-12T13:41:46.405 INFO:tasks.workunit.client.0.smithi060.stdout:0/5: mknod c0 0 2024-04-12T13:41:46.407 INFO:tasks.workunit.client.0.smithi060.stdout:9/2: getdents . 0 2024-04-12T13:41:46.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/0: rmdir - no directory 2024-04-12T13:41:46.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/1: chown . 85937 1 2024-04-12T13:41:46.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/2: readlink - no filename 2024-04-12T13:41:46.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/3: fsync - no filename 2024-04-12T13:41:46.410 INFO:tasks.workunit.client.0.smithi060.stdout:0/6: rename c0 to c1 0 2024-04-12T13:41:46.410 INFO:tasks.workunit.client.0.smithi060.stdout:0/7: dread - no filename 2024-04-12T13:41:46.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/0: mknod c0 0 2024-04-12T13:41:46.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/1: fdatasync - no filename 2024-04-12T13:41:46.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/8: creat f2 x:0 0 0 2024-04-12T13:41:46.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/9: write f2 [246456,56768] 0 2024-04-12T13:41:46.416 INFO:tasks.workunit.client.0.smithi060.stdout:4/0: link - no file 2024-04-12T13:41:46.416 INFO:tasks.workunit.client.0.smithi060.stdout:4/1: write - no filename 2024-04-12T13:41:46.416 INFO:tasks.workunit.client.0.smithi060.stdout:4/2: rename - no filename 2024-04-12T13:41:46.416 INFO:tasks.workunit.client.0.smithi060.stdout:9/3: creat f0 x:0 0 0 2024-04-12T13:41:46.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/10: write f2 [338199,48059] 0 2024-04-12T13:41:46.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/2: symlink l1 0 2024-04-12T13:41:46.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/3: dwrite - no filename 2024-04-12T13:41:46.419 INFO:tasks.workunit.client.0.smithi060.stdout:2/4: mknod c0 0 2024-04-12T13:41:46.419 INFO:tasks.workunit.client.0.smithi060.stdout:2/5: dread - no filename 2024-04-12T13:41:46.422 INFO:tasks.workunit.client.0.smithi060.stdout:5/0: chown . 0 1 2024-04-12T13:41:46.422 INFO:tasks.workunit.client.0.smithi060.stdout:5/1: dread - no filename 2024-04-12T13:41:46.424 INFO:tasks.workunit.client.0.smithi060.stdout:3/0: creat f0 x:0 0 0 2024-04-12T13:41:46.425 INFO:tasks.workunit.client.0.smithi060.stdout:1/4: creat f2 x:0 0 0 2024-04-12T13:41:46.425 INFO:tasks.workunit.client.0.smithi060.stdout:1/5: rmdir - no directory 2024-04-12T13:41:46.426 INFO:tasks.workunit.client.0.smithi060.stdout:0/11: symlink l3 0 2024-04-12T13:41:46.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/3: mknod c0 0 2024-04-12T13:41:46.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/4: write - no filename 2024-04-12T13:41:46.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/5: fdatasync - no filename 2024-04-12T13:41:46.430 INFO:tasks.workunit.client.0.smithi060.stdout:3/1: mknod c1 0 2024-04-12T13:41:46.432 INFO:tasks.workunit.client.0.smithi060.stdout:1/6: creat f3 x:0 0 0 2024-04-12T13:41:46.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/2: fdatasync f0 0 2024-04-12T13:41:46.434 INFO:tasks.workunit.client.0.smithi060.stdout:5/2: getdents . 0 2024-04-12T13:41:46.439 INFO:tasks.workunit.client.0.smithi060.stdout:7/0: read - no filename 2024-04-12T13:41:46.439 INFO:tasks.workunit.client.0.smithi060.stdout:7/1: write - no filename 2024-04-12T13:41:46.439 INFO:tasks.workunit.client.0.smithi060.stdout:7/2: rename - no filename 2024-04-12T13:41:46.441 INFO:tasks.workunit.client.0.smithi060.stdout:4/6: rename c0 to c1 0 2024-04-12T13:41:46.443 INFO:tasks.workunit.client.0.smithi060.stdout:2/6: link c0 c1 0 2024-04-12T13:41:46.444 INFO:tasks.workunit.client.0.smithi060.stdout:6/0: mknod c0 0 2024-04-12T13:41:46.444 INFO:tasks.workunit.client.0.smithi060.stdout:6/1: fdatasync - no filename 2024-04-12T13:41:46.445 INFO:tasks.workunit.client.0.smithi060.stdout:9/4: dwrite f0 [0,4194304] 0 2024-04-12T13:41:46.445 INFO:tasks.workunit.client.0.smithi060.stdout:6/2: stat c0 0 2024-04-12T13:41:46.445 INFO:tasks.workunit.client.0.smithi060.stdout:6/3: truncate - no filename 2024-04-12T13:41:46.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/4: read - no filename 2024-04-12T13:41:46.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/5: rmdir - no directory 2024-04-12T13:41:46.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/6: dread - no filename 2024-04-12T13:41:46.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/7: fsync - no filename 2024-04-12T13:41:46.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/7: link f3 f4 0 2024-04-12T13:41:46.448 INFO:tasks.workunit.client.0.smithi060.stdout:4/7: creat f2 x:0 0 0 2024-04-12T13:41:46.451 INFO:tasks.workunit.client.0.smithi060.stdout:8/0: readlink - no filename 2024-04-12T13:41:46.451 INFO:tasks.workunit.client.0.smithi060.stdout:8/1: dwrite - no filename 2024-04-12T13:41:46.451 INFO:tasks.workunit.client.0.smithi060.stdout:8/2: link - no file 2024-04-12T13:41:46.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/7: mknod c2 0 2024-04-12T13:41:46.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/3: creat f0 x:0 0 0 2024-04-12T13:41:46.455 INFO:tasks.workunit.client.0.smithi060.stdout:5/4: write f0 [608371,16382] 0 2024-04-12T13:41:46.457 INFO:tasks.workunit.client.0.smithi060.stdout:5/5: write f0 [321960,100812] 0 2024-04-12T13:41:46.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/6: rmdir - no directory 2024-04-12T13:41:46.459 INFO:tasks.workunit.client.0.smithi060.stdout:7/3: mkdir d0 0 2024-04-12T13:41:46.459 INFO:tasks.workunit.client.0.smithi060.stdout:7/4: dwrite - no filename 2024-04-12T13:41:46.461 INFO:tasks.workunit.client.0.smithi060.stdout:6/8: mkdir d1 0 2024-04-12T13:41:46.463 INFO:tasks.workunit.client.0.smithi060.stdout:9/5: symlink l1 0 2024-04-12T13:41:46.470 INFO:tasks.workunit.client.0.smithi060.stdout:2/8: creat f3 x:0 0 0 2024-04-12T13:41:46.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/7: rename f0 to f1 0 2024-04-12T13:41:46.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/8: rmdir - no directory 2024-04-12T13:41:46.479 INFO:tasks.workunit.client.0.smithi060.stdout:1/8: dwrite f2 [0,4194304] 0 2024-04-12T13:41:46.479 INFO:tasks.workunit.client.0.smithi060.stdout:8/3: symlink l0 0 2024-04-12T13:41:46.479 INFO:tasks.workunit.client.0.smithi060.stdout:8/4: write - no filename 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:9/6: unlink f0 0 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/5: mkdir d0/d1 0 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/6: read - no filename 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/7: dread - no filename 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/8: readlink - no filename 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/9: dread - no filename 2024-04-12T13:41:46.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/10: truncate - no filename 2024-04-12T13:41:46.482 INFO:tasks.workunit.client.0.smithi060.stdout:7/11: fsync - no filename 2024-04-12T13:41:46.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/7: chown l1 128142691 1 2024-04-12T13:41:46.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/8: write - no filename 2024-04-12T13:41:46.506 INFO:tasks.workunit.client.0.smithi060.stdout:6/9: symlink d1/l2 0 2024-04-12T13:41:46.506 INFO:tasks.workunit.client.0.smithi060.stdout:1/9: symlink l5 0 2024-04-12T13:41:46.506 INFO:tasks.workunit.client.0.smithi060.stdout:8/5: creat f1 x:0 0 0 2024-04-12T13:41:46.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/10: mknod d1/c3 0 2024-04-12T13:41:46.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/11: dread - no filename 2024-04-12T13:41:46.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/12: write - no filename 2024-04-12T13:41:46.510 INFO:tasks.workunit.client.0.smithi060.stdout:9/9: creat f2 x:0 0 0 2024-04-12T13:41:46.511 INFO:tasks.workunit.client.0.smithi060.stdout:1/10: rename c0 to c6 0 2024-04-12T13:41:46.514 INFO:tasks.workunit.client.0.smithi060.stdout:6/13: mknod d1/c4 0 2024-04-12T13:41:46.518 INFO:tasks.workunit.client.0.smithi060.stdout:6/14: mknod d1/c5 0 2024-04-12T13:41:46.518 INFO:tasks.workunit.client.0.smithi060.stdout:6/15: dread - no filename 2024-04-12T13:41:46.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/16: link d1/c4 d1/c6 0 2024-04-12T13:41:46.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/17: truncate - no filename 2024-04-12T13:41:46.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/18: dwrite - no filename 2024-04-12T13:41:46.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/19: dread - no filename 2024-04-12T13:41:46.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/20: write - no filename 2024-04-12T13:41:46.529 INFO:tasks.workunit.client.0.smithi060.stdout:6/21: chown d1/c4 494788672 1 2024-04-12T13:41:46.531 INFO:tasks.workunit.client.0.smithi060.stdout:8/6: dwrite f1 [0,4194304] 0 2024-04-12T13:41:46.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/22: mkdir d1/d7 0 2024-04-12T13:41:46.533 INFO:tasks.workunit.client.0.smithi060.stdout:8/7: read f1 [3693718,102151] 0 2024-04-12T13:41:46.539 INFO:tasks.workunit.client.0.smithi060.stdout:6/23: creat d1/f8 x:0 0 0 2024-04-12T13:41:46.540 INFO:tasks.workunit.client.0.smithi060.stdout:6/24: stat d1/f8 0 2024-04-12T13:41:46.545 INFO:tasks.workunit.client.0.smithi060.stdout:6/25: unlink d1/l2 0 2024-04-12T13:41:46.549 INFO:tasks.workunit.client.0.smithi060.stdout:8/8: dread f1 [0,4194304] 0 2024-04-12T13:41:46.551 INFO:tasks.workunit.client.0.smithi060.stdout:6/26: rename c0 to d1/c9 0 2024-04-12T13:41:46.552 INFO:tasks.workunit.client.0.smithi060.stdout:6/27: fdatasync d1/f8 0 2024-04-12T13:41:46.555 INFO:tasks.workunit.client.0.smithi060.stdout:6/28: getdents d1/d7 0 2024-04-12T13:41:46.557 INFO:tasks.workunit.client.0.smithi060.stdout:6/29: truncate d1/f8 991194 0 2024-04-12T13:41:46.561 INFO:tasks.workunit.client.0.smithi060.stdout:6/30: getdents d1/d7 0 2024-04-12T13:41:46.562 INFO:tasks.workunit.client.0.smithi060.stdout:6/31: mkdir d1/d7/da 0 2024-04-12T13:41:46.565 INFO:tasks.workunit.client.0.smithi060.stdout:6/32: mknod d1/d7/da/cb 0 2024-04-12T13:41:46.572 INFO:tasks.workunit.client.0.smithi060.stdout:6/33: dread d1/f8 [0,4194304] 0 2024-04-12T13:41:46.590 INFO:tasks.workunit.client.0.smithi060.stdout:6/34: dwrite d1/f8 [0,4194304] 0 2024-04-12T13:41:46.592 INFO:tasks.workunit.client.0.smithi060.stdout:6/35: write d1/f8 [482935,51662] 0 2024-04-12T13:41:46.597 INFO:tasks.workunit.client.0.smithi060.stdout:6/36: unlink d1/f8 0 2024-04-12T13:41:46.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/37: mkdir d1/d7/da/dc 0 2024-04-12T13:41:46.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/38: dwrite - no filename 2024-04-12T13:41:46.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/39: truncate - no filename 2024-04-12T13:41:46.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/40: write - no filename 2024-04-12T13:41:46.604 INFO:tasks.workunit.client.0.smithi060.stdout:6/41: creat d1/d7/fd x:0 0 0 2024-04-12T13:41:46.605 INFO:tasks.workunit.client.0.smithi060.stdout:0/12: rename c1 to c4 0 2024-04-12T13:41:46.606 INFO:tasks.workunit.client.0.smithi060.stdout:6/42: mknod d1/d7/ce 0 2024-04-12T13:41:46.609 INFO:tasks.workunit.client.0.smithi060.stdout:6/43: creat d1/d7/da/ff x:0 0 0 2024-04-12T13:41:46.609 INFO:tasks.workunit.client.0.smithi060.stdout:6/44: readlink - no filename 2024-04-12T13:41:46.612 INFO:tasks.workunit.client.0.smithi060.stdout:6/45: symlink d1/l10 0 2024-04-12T13:41:46.614 INFO:tasks.workunit.client.0.smithi060.stdout:0/13: dread f2 [0,4194304] 0 2024-04-12T13:41:46.614 INFO:tasks.workunit.client.0.smithi060.stdout:6/46: creat d1/f11 x:0 0 0 2024-04-12T13:41:46.616 INFO:tasks.workunit.client.0.smithi060.stdout:6/47: truncate d1/d7/fd 712156 0 2024-04-12T13:41:46.617 INFO:tasks.workunit.client.0.smithi060.stdout:0/14: rename f2 to f5 0 2024-04-12T13:41:46.617 INFO:tasks.workunit.client.0.smithi060.stdout:6/48: readlink d1/l10 0 2024-04-12T13:41:46.617 INFO:tasks.workunit.client.0.smithi060.stdout:3/3: getdents . 0 2024-04-12T13:41:46.619 INFO:tasks.workunit.client.0.smithi060.stdout:3/4: truncate f0 119003 0 2024-04-12T13:41:46.619 INFO:tasks.workunit.client.0.smithi060.stdout:3/5: fdatasync f0 0 2024-04-12T13:41:46.621 INFO:tasks.workunit.client.0.smithi060.stdout:3/6: write f0 [869022,12591] 0 2024-04-12T13:41:46.623 INFO:tasks.workunit.client.0.smithi060.stdout:4/8: chown c1 2615567 1 2024-04-12T13:41:46.625 INFO:tasks.workunit.client.0.smithi060.stdout:4/9: truncate f2 613745 0 2024-04-12T13:41:46.626 INFO:tasks.workunit.client.0.smithi060.stdout:3/7: symlink l2 0 2024-04-12T13:41:46.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/10: fsync f2 0 2024-04-12T13:41:46.631 INFO:tasks.workunit.client.0.smithi060.stdout:2/9: getdents . 0 2024-04-12T13:41:46.633 INFO:tasks.workunit.client.0.smithi060.stdout:3/8: creat f3 x:0 0 0 2024-04-12T13:41:46.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/11: symlink l3 0 2024-04-12T13:41:46.635 INFO:tasks.workunit.client.1.smithi110.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-12T13:41:46.640 INFO:tasks.workunit.client.0.smithi060.stdout:4/12: read f2 [147708,83864] 0 2024-04-12T13:41:46.640 INFO:tasks.workunit.client.0.smithi060.stdout:3/9: symlink l4 0 2024-04-12T13:41:46.642 INFO:tasks.workunit.client.0.smithi060.stdout:8/9: fsync f1 0 2024-04-12T13:41:46.645 INFO:tasks.workunit.client.0.smithi060.stdout:9/10: getdents . 0 2024-04-12T13:41:46.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/11: getdents . 0 2024-04-12T13:41:46.649 INFO:tasks.workunit.client.0.smithi060.stdout:8/10: chown f1 1 1 2024-04-12T13:41:46.653 INFO:tasks.workunit.client.0.smithi060.stdout:6/49: dwrite d1/f11 [0,4194304] 0 2024-04-12T13:41:46.653 INFO:tasks.workunit.client.0.smithi060.stdout:1/12: chown f3 1065106287 1 2024-04-12T13:41:46.655 INFO:tasks.workunit.client.0.smithi060.stdout:4/13: creat f4 x:0 0 0 2024-04-12T13:41:46.659 INFO:tasks.workunit.client.0.smithi060.stdout:9/11: symlink l3 0 2024-04-12T13:41:46.659 INFO:tasks.workunit.client.0.smithi060.stdout:0/15: dwrite f5 [0,4194304] 0 2024-04-12T13:41:46.660 INFO:tasks.workunit.client.0.smithi060.stdout:8/11: creat f2 x:0 0 0 2024-04-12T13:41:46.660 INFO:tasks.workunit.client.0.smithi060.stdout:3/10: dread f0 [0,4194304] 0 2024-04-12T13:41:46.661 INFO:tasks.workunit.client.0.smithi060.stdout:1/13: rename f4 to f7 0 2024-04-12T13:41:46.661 INFO:tasks.workunit.client.0.smithi060.stdout:1/14: rmdir - no directory 2024-04-12T13:41:46.662 INFO:tasks.workunit.client.0.smithi060.stdout:8/12: write f2 [846546,112456] 0 2024-04-12T13:41:46.664 INFO:tasks.workunit.client.0.smithi060.stdout:8/13: write f2 [1948945,54442] 0 2024-04-12T13:41:46.665 INFO:tasks.workunit.client.0.smithi060.stdout:8/14: read f1 [1042505,46643] 0 2024-04-12T13:41:46.666 INFO:tasks.workunit.client.0.smithi060.stdout:8/15: chown l0 8930617 1 2024-04-12T13:41:46.667 INFO:tasks.workunit.client.0.smithi060.stdout:4/14: mkdir d5 0 2024-04-12T13:41:46.674 INFO:tasks.workunit.client.0.smithi060.stdout:9/12: mkdir d4 0 2024-04-12T13:41:46.677 INFO:tasks.workunit.client.0.smithi060.stdout:9/13: chown l1 0 1 2024-04-12T13:41:46.677 INFO:tasks.workunit.client.0.smithi060.stdout:0/16: mknod c6 0 2024-04-12T13:41:46.688 INFO:tasks.workunit.client.0.smithi060.stdout:0/17: mkdir d7 0 2024-04-12T13:41:46.689 INFO:tasks.workunit.client.0.smithi060.stdout:9/14: write f2 [996807,94896] 0 2024-04-12T13:41:46.702 INFO:tasks.workunit.client.0.smithi060.stdout:1/15: link l5 l8 0 2024-04-12T13:41:46.710 INFO:tasks.workunit.client.0.smithi060.stdout:8/16: dread f2 [0,4194304] 0 2024-04-12T13:41:46.714 INFO:tasks.workunit.client.0.smithi060.stdout:3/11: dwrite f3 [0,4194304] 0 2024-04-12T13:41:46.717 INFO:tasks.workunit.client.0.smithi060.stdout:6/50: dwrite d1/d7/fd [0,4194304] 0 2024-04-12T13:41:46.719 INFO:tasks.workunit.client.0.smithi060.stdout:0/18: symlink d7/l8 0 2024-04-12T13:41:46.724 INFO:tasks.workunit.client.0.smithi060.stdout:8/17: write f1 [2107381,81019] 0 2024-04-12T13:41:46.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/12: dread f0 [0,4194304] 0 2024-04-12T13:41:46.729 INFO:tasks.workunit.client.0.smithi060.stdout:0/19: fdatasync f5 0 2024-04-12T13:41:46.730 INFO:tasks.workunit.client.0.smithi060.stdout:4/15: dwrite f2 [0,4194304] 0 2024-04-12T13:41:46.732 INFO:tasks.workunit.client.0.smithi060.stdout:8/18: mknod c3 0 2024-04-12T13:41:46.739 INFO:tasks.workunit.client.0.smithi060.stdout:3/13: fsync f0 0 2024-04-12T13:41:46.743 INFO:tasks.workunit.client.0.smithi060.stdout:8/19: creat f4 x:0 0 0 2024-04-12T13:41:46.746 INFO:tasks.workunit.client.0.smithi060.stdout:3/14: write f3 [799628,91493] 0 2024-04-12T13:41:46.746 INFO:tasks.workunit.client.0.smithi060.stdout:9/15: dwrite f2 [0,4194304] 0 2024-04-12T13:41:46.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/16: dread f2 [0,4194304] 0 2024-04-12T13:41:46.752 INFO:tasks.workunit.client.0.smithi060.stdout:8/20: rename l0 to l5 0 2024-04-12T13:41:46.753 INFO:tasks.workunit.client.0.smithi060.stdout:8/21: dread - f4 zero size 2024-04-12T13:41:46.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/16: rmdir d5 0 2024-04-12T13:41:46.755 INFO:tasks.workunit.client.0.smithi060.stdout:4/17: dread - f4 zero size 2024-04-12T13:41:46.755 INFO:tasks.workunit.client.0.smithi060.stdout:0/20: dread f5 [0,4194304] 0 2024-04-12T13:41:46.757 INFO:tasks.workunit.client.0.smithi060.stdout:1/17: symlink l9 0 2024-04-12T13:41:46.758 INFO:tasks.workunit.client.0.smithi060.stdout:8/22: symlink l6 0 2024-04-12T13:41:46.762 INFO:tasks.workunit.client.0.smithi060.stdout:8/23: chown c3 14 1 2024-04-12T13:41:46.762 INFO:tasks.workunit.client.0.smithi060.stdout:4/18: mkdir d6 0 2024-04-12T13:41:46.764 INFO:tasks.workunit.client.0.smithi060.stdout:1/18: creat fa x:0 0 0 2024-04-12T13:41:46.766 INFO:tasks.workunit.client.0.smithi060.stdout:0/21: mkdir d7/d9 0 2024-04-12T13:41:46.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/19: dread - f3 zero size 2024-04-12T13:41:46.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/20: chown l1 260862106 1 2024-04-12T13:41:46.773 INFO:tasks.workunit.client.0.smithi060.stdout:1/21: chown f3 8 1 2024-04-12T13:41:46.776 INFO:tasks.workunit.client.0.smithi060.stdout:1/22: dread - fa zero size 2024-04-12T13:41:46.777 INFO:tasks.workunit.client.0.smithi060.stdout:3/15: dwrite f0 [0,4194304] 0 2024-04-12T13:41:46.779 INFO:tasks.workunit.client.0.smithi060.stdout:1/23: dread - f7 zero size 2024-04-12T13:41:46.780 INFO:tasks.workunit.client.0.smithi060.stdout:4/19: mkdir d6/d7 0 2024-04-12T13:41:46.782 INFO:tasks.workunit.client.0.smithi060.stdout:4/20: chown f2 6817372 1 2024-04-12T13:41:46.782 INFO:tasks.workunit.client.0.smithi060.stdout:1/24: chown f7 0 1 2024-04-12T13:41:46.785 INFO:tasks.workunit.client.0.smithi060.stdout:3/16: symlink l5 0 2024-04-12T13:41:46.789 INFO:tasks.workunit.client.0.smithi060.stdout:8/24: dwrite f1 [0,4194304] 0 2024-04-12T13:41:46.791 INFO:tasks.workunit.client.0.smithi060.stdout:0/22: getdents d7/d9 0 2024-04-12T13:41:46.805 INFO:tasks.workunit.client.0.smithi060.stdout:4/21: mknod d6/d7/c8 0 2024-04-12T13:41:46.810 INFO:tasks.workunit.client.0.smithi060.stdout:3/17: dread f0 [0,4194304] 0 2024-04-12T13:41:46.811 INFO:tasks.workunit.client.0.smithi060.stdout:4/22: mknod d6/c9 0 2024-04-12T13:41:46.812 INFO:tasks.workunit.client.0.smithi060.stdout:4/23: chown d6 12191959 1 2024-04-12T13:41:46.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/24: fdatasync f4 0 2024-04-12T13:41:46.815 INFO:tasks.workunit.client.0.smithi060.stdout:3/18: write f0 [3908517,31699] 0 2024-04-12T13:41:46.816 INFO:tasks.workunit.client.0.smithi060.stdout:0/23: dwrite f5 [0,4194304] 0 2024-04-12T13:41:46.818 INFO:tasks.workunit.client.0.smithi060.stdout:0/24: write f5 [2242418,21877] 0 2024-04-12T13:41:46.819 INFO:tasks.workunit.client.0.smithi060.stdout:4/25: rmdir d6/d7 39 2024-04-12T13:41:46.823 INFO:tasks.workunit.client.0.smithi060.stdout:3/19: symlink l6 0 2024-04-12T13:41:46.824 INFO:tasks.workunit.client.0.smithi060.stdout:3/20: chown f0 3363 1 2024-04-12T13:41:46.828 INFO:tasks.workunit.client.0.smithi060.stdout:0/25: creat d7/fa x:0 0 0 2024-04-12T13:41:46.837 INFO:tasks.workunit.client.0.smithi060.stdout:4/26: rename d6/d7/c8 to d6/ca 0 2024-04-12T13:41:46.840 INFO:tasks.workunit.client.0.smithi060.stdout:4/27: rmdir d6 39 2024-04-12T13:41:46.843 INFO:tasks.workunit.client.0.smithi060.stdout:4/28: write f4 [990604,7381] 0 2024-04-12T13:41:46.846 INFO:tasks.workunit.client.0.smithi060.stdout:3/21: dwrite f3 [0,4194304] 0 2024-04-12T13:41:46.846 INFO:tasks.workunit.client.0.smithi060.stdout:3/22: rmdir - no directory 2024-04-12T13:41:46.848 INFO:tasks.workunit.client.0.smithi060.stdout:0/26: dwrite f5 [0,4194304] 0 2024-04-12T13:41:46.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/23: mkdir d7 0 2024-04-12T13:41:46.850 INFO:tasks.workunit.client.0.smithi060.stdout:3/24: write f0 [3522143,48509] 0 2024-04-12T13:41:46.851 INFO:tasks.workunit.client.0.smithi060.stdout:4/29: mkdir d6/d7/db 0 2024-04-12T13:41:46.865 INFO:tasks.workunit.client.0.smithi060.stdout:3/25: dread f3 [0,4194304] 0 2024-04-12T13:41:46.866 INFO:tasks.workunit.client.0.smithi060.stdout:3/26: chown f3 0 1 2024-04-12T13:41:46.867 INFO:tasks.workunit.client.0.smithi060.stdout:4/30: link c1 d6/d7/db/cc 0 2024-04-12T13:41:46.872 INFO:tasks.workunit.client.0.smithi060.stdout:4/31: mkdir d6/d7/dd 0 2024-04-12T13:41:46.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/27: creat d7/f8 x:0 0 0 2024-04-12T13:41:46.878 INFO:tasks.workunit.client.0.smithi060.stdout:3/28: creat d7/f9 x:0 0 0 2024-04-12T13:41:46.882 INFO:tasks.workunit.client.0.smithi060.stdout:3/29: mkdir d7/da 0 2024-04-12T13:41:46.884 INFO:tasks.workunit.client.0.smithi060.stdout:4/32: dread f2 [0,4194304] 0 2024-04-12T13:41:46.885 INFO:tasks.workunit.client.0.smithi060.stdout:4/33: fsync f4 0 2024-04-12T13:41:46.885 INFO:tasks.workunit.client.0.smithi060.stdout:3/30: fdatasync f3 0 2024-04-12T13:41:46.890 INFO:tasks.workunit.client.0.smithi060.stdout:3/31: rename l2 to d7/da/lb 0 2024-04-12T13:41:46.891 INFO:tasks.workunit.client.0.smithi060.stdout:3/32: dread - d7/f8 zero size 2024-04-12T13:41:46.907 INFO:tasks.workunit.client.0.smithi060.stdout:0/27: truncate f5 478209 0 2024-04-12T13:41:46.912 INFO:tasks.workunit.client.0.smithi060.stdout:0/28: symlink d7/d9/lb 0 2024-04-12T13:41:46.924 INFO:tasks.workunit.client.0.smithi060.stdout:0/29: write f5 [1182092,56083] 0 2024-04-12T13:41:46.926 INFO:tasks.workunit.client.0.smithi060.stdout:0/30: write f5 [23216,2221] 0 2024-04-12T13:41:46.929 INFO:tasks.workunit.client.0.smithi060.stdout:0/31: symlink d7/lc 0 2024-04-12T13:41:46.935 INFO:tasks.workunit.client.0.smithi060.stdout:0/32: read f5 [515287,91366] 0 2024-04-12T13:41:46.960 INFO:tasks.workunit.client.0.smithi060.stdout:0/33: dwrite f5 [0,4194304] 0 2024-04-12T13:41:46.962 INFO:tasks.workunit.client.0.smithi060.stdout:0/34: write d7/fa [619831,59544] 0 2024-04-12T13:41:47.051 INFO:tasks.workunit.client.0.smithi060.stdout:0/35: creat d7/fd x:0 0 0 2024-04-12T13:41:47.051 INFO:tasks.workunit.client.0.smithi060.stdout:0/36: readlink l3 0 2024-04-12T13:41:47.054 INFO:tasks.workunit.client.0.smithi060.stdout:0/37: dread - d7/fd zero size 2024-04-12T13:41:47.057 INFO:tasks.workunit.client.0.smithi060.stdout:0/38: mkdir d7/d9/de 0 2024-04-12T13:41:47.058 INFO:tasks.workunit.client.0.smithi060.stdout:0/39: chown d7/fa 4 1 2024-04-12T13:41:47.061 INFO:tasks.workunit.client.0.smithi060.stdout:0/40: truncate d7/fd 450960 0 2024-04-12T13:41:47.063 INFO:tasks.workunit.client.0.smithi060.stdout:0/41: rename d7/d9 to d7/d9/de/df 22 2024-04-12T13:41:47.065 INFO:tasks.workunit.client.0.smithi060.stdout:0/42: symlink d7/l10 0 2024-04-12T13:41:47.068 INFO:tasks.workunit.client.0.smithi060.stdout:0/43: creat d7/f11 x:0 0 0 2024-04-12T13:41:47.174 INFO:tasks.workunit.client.0.smithi060.stdout:0/44: fsync d7/f11 0 2024-04-12T13:41:47.175 INFO:tasks.workunit.client.0.smithi060.stdout:0/45: fsync d7/f11 0 2024-04-12T13:41:47.176 INFO:tasks.workunit.client.0.smithi060.stdout:0/46: rename d7 to d7/d9/de/d12 22 2024-04-12T13:41:47.179 INFO:tasks.workunit.client.0.smithi060.stdout:0/47: symlink d7/d9/l13 0 2024-04-12T13:41:47.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:46 smithi060 ceph-mon[29097]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-04-12T13:41:47.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:46 smithi060 ceph-mon[29097]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-04-12T13:41:47.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:46 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:47.182 INFO:tasks.workunit.client.0.smithi060.stdout:0/48: mkdir d7/d9/d14 0 2024-04-12T13:41:47.187 INFO:tasks.workunit.client.0.smithi060.stdout:0/49: symlink d7/d9/de/l15 0 2024-04-12T13:41:47.188 INFO:tasks.workunit.client.0.smithi060.stdout:0/50: truncate d7/fd 944751 0 2024-04-12T13:41:47.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/51: write d7/fa [856923,41931] 0 2024-04-12T13:41:47.201 INFO:tasks.workunit.client.0.smithi060.stdout:0/52: rmdir d7 39 2024-04-12T13:41:47.205 INFO:tasks.workunit.client.0.smithi060.stdout:0/53: write d7/fd [1413549,87227] 0 2024-04-12T13:41:47.209 INFO:tasks.workunit.client.0.smithi060.stdout:0/54: symlink d7/l16 0 2024-04-12T13:41:47.214 INFO:tasks.workunit.client.0.smithi060.stdout:0/55: creat d7/d9/f17 x:0 0 0 2024-04-12T13:41:47.216 INFO:tasks.workunit.client.0.smithi060.stdout:0/56: chown d7/fa 258877 1 2024-04-12T13:41:47.221 INFO:tasks.workunit.client.0.smithi060.stdout:0/57: symlink d7/d9/l18 0 2024-04-12T13:41:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:46 smithi110 ceph-mon[36055]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-04-12T13:41:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:46 smithi110 ceph-mon[36055]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-04-12T13:41:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:46 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:41:47.238 INFO:tasks.workunit.client.0.smithi060.stdout:0/58: dread d7/fd [0,4194304] 0 2024-04-12T13:41:47.245 INFO:tasks.workunit.client.0.smithi060.stdout:0/59: mknod d7/c19 0 2024-04-12T13:41:47.247 INFO:tasks.workunit.client.0.smithi060.stdout:0/60: write d7/fa [852333,64144] 0 2024-04-12T13:41:47.265 INFO:tasks.workunit.client.0.smithi060.stdout:0/61: getdents d7/d9 0 2024-04-12T13:41:47.272 INFO:tasks.workunit.client.0.smithi060.stdout:0/62: creat d7/d9/f1a x:0 0 0 2024-04-12T13:41:47.276 INFO:tasks.workunit.client.0.smithi060.stdout:0/63: write d7/d9/f17 [317008,67291] 0 2024-04-12T13:41:47.283 INFO:tasks.workunit.client.0.smithi060.stdout:0/64: mkdir d7/d9/d14/d1b 0 2024-04-12T13:41:47.289 INFO:tasks.workunit.client.0.smithi060.stdout:0/65: creat d7/d9/f1c x:0 0 0 2024-04-12T13:41:47.290 INFO:tasks.workunit.client.0.smithi060.stdout:0/66: readlink l3 0 2024-04-12T13:41:47.295 INFO:tasks.workunit.client.0.smithi060.stdout:0/67: write d7/d9/f1c [15596,129199] 0 2024-04-12T13:41:47.303 INFO:tasks.workunit.client.0.smithi060.stdout:0/68: dread d7/d9/f1c [0,4194304] 0 2024-04-12T13:41:47.344 INFO:tasks.workunit.client.0.smithi060.stdout:0/69: dwrite d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:47.367 INFO:tasks.workunit.client.0.smithi060.stdout:0/70: link d7/d9/l18 d7/d9/l1d 0 2024-04-12T13:41:47.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/71: dwrite d7/f11 [0,4194304] 0 2024-04-12T13:41:47.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/72: write d7/fa [1302750,84872] 0 2024-04-12T13:41:47.432 INFO:tasks.workunit.client.0.smithi060.stdout:0/73: creat d7/d9/f1e x:0 0 0 2024-04-12T13:41:47.434 INFO:tasks.workunit.client.0.smithi060.stdout:0/74: stat d7/d9/l13 0 2024-04-12T13:41:47.440 INFO:tasks.workunit.client.0.smithi060.stdout:0/75: unlink f5 0 2024-04-12T13:41:47.468 INFO:tasks.workunit.client.0.smithi060.stdout:0/76: dread d7/f11 [0,4194304] 0 2024-04-12T13:41:47.472 INFO:tasks.workunit.client.0.smithi060.stdout:0/77: chown d7/d9/l13 4720279 1 2024-04-12T13:41:47.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/78: chown d7/d9/l1d 180 1 2024-04-12T13:41:47.478 INFO:tasks.workunit.client.0.smithi060.stdout:0/79: stat c6 0 2024-04-12T13:41:47.996 INFO:tasks.workunit.client.1.smithi110.stderr:++ readlink -f fsstress 2024-04-12T13:41:48.002 INFO:tasks.workunit.client.1.smithi110.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-12T13:41:48.002 INFO:tasks.workunit.client.1.smithi110.stderr:+ popd 2024-04-12T13:41:48.008 INFO:tasks.workunit.client.1.smithi110.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T13:41:48.008 INFO:tasks.workunit.client.1.smithi110.stderr:+ popd 2024-04-12T13:41:48.011 INFO:tasks.workunit.client.1.smithi110.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-12T13:41:48.013 INFO:tasks.workunit.client.1.smithi110.stderr:++ mktemp -d -p . 2024-04-12T13:41:48.021 INFO:tasks.workunit.client.1.smithi110.stderr:+ T=./tmp.XI49Bfav7C 2024-04-12T13:41:48.021 INFO:tasks.workunit.client.1.smithi110.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.XI49Bfav7C -l 1 -n 1000 -p 10 -v 2024-04-12T13:41:48.039 INFO:tasks.workunit.client.1.smithi110.stdout:seed = 1712956058 2024-04-12T13:41:48.057 INFO:tasks.workunit.client.1.smithi110.stdout:0/0: getdents . 0 2024-04-12T13:41:48.057 INFO:tasks.workunit.client.1.smithi110.stdout:0/1: truncate - no filename 2024-04-12T13:41:48.058 INFO:tasks.workunit.client.1.smithi110.stdout:0/2: chown . 129 1 2024-04-12T13:41:48.058 INFO:tasks.workunit.client.1.smithi110.stdout:0/3: dread - no filename 2024-04-12T13:41:48.061 INFO:tasks.workunit.client.1.smithi110.stdout:1/0: creat f0 x:0 0 0 2024-04-12T13:41:48.061 INFO:tasks.workunit.client.1.smithi110.stdout:1/1: readlink - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/0: dwrite - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/1: dwrite - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/2: read - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/3: dwrite - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/4: write - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/5: dwrite - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/6: rename - no filename 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/7: chown . 2 1 2024-04-12T13:41:48.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/8: write - no filename 2024-04-12T13:41:48.066 INFO:tasks.workunit.client.1.smithi110.stdout:4/9: chown . 1849 1 2024-04-12T13:41:48.066 INFO:tasks.workunit.client.1.smithi110.stdout:4/10: dwrite - no filename 2024-04-12T13:41:48.066 INFO:tasks.workunit.client.1.smithi110.stdout:4/11: dread - no filename 2024-04-12T13:41:48.066 INFO:tasks.workunit.client.1.smithi110.stdout:2/0: creat f0 x:0 0 0 2024-04-12T13:41:48.068 INFO:tasks.workunit.client.1.smithi110.stdout:0/4: creat f0 x:0 0 0 2024-04-12T13:41:48.070 INFO:tasks.workunit.client.1.smithi110.stdout:1/2: rename f0 to f1 0 2024-04-12T13:41:48.071 INFO:tasks.workunit.client.1.smithi110.stdout:3/0: mkdir d0 0 2024-04-12T13:41:48.074 INFO:tasks.workunit.client.1.smithi110.stdout:5/0: stat - no entries 2024-04-12T13:41:48.074 INFO:tasks.workunit.client.1.smithi110.stdout:5/1: dread - no filename 2024-04-12T13:41:48.074 INFO:tasks.workunit.client.1.smithi110.stdout:5/2: write - no filename 2024-04-12T13:41:48.074 INFO:tasks.workunit.client.1.smithi110.stdout:5/3: write - no filename 2024-04-12T13:41:48.074 INFO:tasks.workunit.client.1.smithi110.stdout:5/4: link - no file 2024-04-12T13:41:48.076 INFO:tasks.workunit.client.1.smithi110.stdout:2/1: mknod c1 0 2024-04-12T13:41:48.082 INFO:tasks.workunit.client.1.smithi110.stdout:4/12: mkdir d0 0 2024-04-12T13:41:48.085 INFO:tasks.workunit.client.1.smithi110.stdout:6/0: write - no filename 2024-04-12T13:41:48.085 INFO:tasks.workunit.client.1.smithi110.stdout:6/1: dwrite - no filename 2024-04-12T13:41:48.086 INFO:tasks.workunit.client.1.smithi110.stdout:2/2: creat f2 x:0 0 0 2024-04-12T13:41:48.088 INFO:tasks.workunit.client.1.smithi110.stdout:2/3: read - f2 zero size 2024-04-12T13:41:48.091 INFO:tasks.workunit.client.1.smithi110.stdout:5/5: creat f0 x:0 0 0 2024-04-12T13:41:48.094 INFO:tasks.workunit.client.1.smithi110.stdout:3/1: rmdir d0 0 2024-04-12T13:41:48.096 INFO:tasks.workunit.client.1.smithi110.stdout:4/13: creat d0/f1 x:0 0 0 2024-04-12T13:41:48.096 INFO:tasks.workunit.client.1.smithi110.stdout:2/4: creat f3 x:0 0 0 2024-04-12T13:41:48.097 INFO:tasks.workunit.client.1.smithi110.stdout:6/2: symlink l0 0 2024-04-12T13:41:48.097 INFO:tasks.workunit.client.1.smithi110.stdout:6/3: write - no filename 2024-04-12T13:41:48.097 INFO:tasks.workunit.client.1.smithi110.stdout:6/4: fdatasync - no filename 2024-04-12T13:41:48.099 INFO:tasks.workunit.client.1.smithi110.stdout:2/5: read - f2 zero size 2024-04-12T13:41:48.100 INFO:tasks.workunit.client.1.smithi110.stdout:6/5: chown l0 57293086 1 2024-04-12T13:41:48.100 INFO:tasks.workunit.client.1.smithi110.stdout:4/14: write d0/f1 [1015361,34192] 0 2024-04-12T13:41:48.104 INFO:tasks.workunit.client.1.smithi110.stdout:3/2: symlink l1 0 2024-04-12T13:41:48.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/0: dwrite - no filename 2024-04-12T13:41:48.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/1: fdatasync - no filename 2024-04-12T13:41:48.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/2: dwrite - no filename 2024-04-12T13:41:48.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/3: write - no filename 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/0: mknod c0 0 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/1: fsync - no filename 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/2: write - no filename 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/3: dwrite - no filename 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/4: dwrite - no filename 2024-04-12T13:41:48.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/5: dwrite - no filename 2024-04-12T13:41:48.108 INFO:tasks.workunit.client.1.smithi110.stdout:7/6: write - no filename 2024-04-12T13:41:48.108 INFO:tasks.workunit.client.1.smithi110.stdout:7/7: rmdir - no directory 2024-04-12T13:41:48.108 INFO:tasks.workunit.client.1.smithi110.stdout:1/3: dwrite f1 [0,4194304] 0 2024-04-12T13:41:48.108 INFO:tasks.workunit.client.1.smithi110.stdout:3/3: chown l1 788 1 2024-04-12T13:41:48.111 INFO:tasks.workunit.client.1.smithi110.stdout:3/4: chown l1 1 1 2024-04-12T13:41:48.111 INFO:tasks.workunit.client.1.smithi110.stdout:3/5: truncate - no filename 2024-04-12T13:41:48.116 INFO:tasks.workunit.client.1.smithi110.stdout:3/6: chown l1 172 1 2024-04-12T13:41:48.116 INFO:tasks.workunit.client.1.smithi110.stdout:3/7: write - no filename 2024-04-12T13:41:48.125 INFO:tasks.workunit.client.1.smithi110.stdout:5/6: dwrite f0 [0,4194304] 0 2024-04-12T13:41:48.130 INFO:tasks.workunit.client.1.smithi110.stdout:2/6: dwrite f3 [0,4194304] 0 2024-04-12T13:41:48.132 INFO:tasks.workunit.client.1.smithi110.stdout:6/6: symlink l1 0 2024-04-12T13:41:48.132 INFO:tasks.workunit.client.1.smithi110.stdout:6/7: truncate - no filename 2024-04-12T13:41:48.132 INFO:tasks.workunit.client.1.smithi110.stdout:2/7: write f3 [1614190,32084] 0 2024-04-12T13:41:48.134 INFO:tasks.workunit.client.1.smithi110.stdout:2/8: stat f2 0 2024-04-12T13:41:48.135 INFO:tasks.workunit.client.1.smithi110.stdout:2/9: write f0 [334694,109296] 0 2024-04-12T13:41:48.136 INFO:tasks.workunit.client.1.smithi110.stdout:4/15: symlink d0/l2 0 2024-04-12T13:41:48.141 INFO:tasks.workunit.client.1.smithi110.stdout:7/8: mkdir d1 0 2024-04-12T13:41:48.141 INFO:tasks.workunit.client.1.smithi110.stdout:5/7: dread f0 [0,4194304] 0 2024-04-12T13:41:48.142 INFO:tasks.workunit.client.1.smithi110.stdout:7/9: chown d1 1 1 2024-04-12T13:41:48.142 INFO:tasks.workunit.client.1.smithi110.stdout:7/10: dwrite - no filename 2024-04-12T13:41:48.142 INFO:tasks.workunit.client.1.smithi110.stdout:7/11: write - no filename 2024-04-12T13:41:48.142 INFO:tasks.workunit.client.1.smithi110.stdout:7/12: dread - no filename 2024-04-12T13:41:48.147 INFO:tasks.workunit.client.1.smithi110.stdout:1/4: creat f2 x:0 0 0 2024-04-12T13:41:48.147 INFO:tasks.workunit.client.1.smithi110.stdout:2/10: dread f3 [0,4194304] 0 2024-04-12T13:41:48.170 INFO:tasks.workunit.client.1.smithi110.stdout:6/8: symlink l2 0 2024-04-12T13:41:48.171 INFO:tasks.workunit.client.1.smithi110.stdout:2/11: dwrite f2 [0,4194304] 0 2024-04-12T13:41:48.174 INFO:tasks.workunit.client.1.smithi110.stdout:4/16: rename d0/l2 to d0/l3 0 2024-04-12T13:41:48.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:47 smithi060 ceph-mon[29097]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s wr, 229 op/s 2024-04-12T13:41:48.179 INFO:tasks.workunit.client.1.smithi110.stdout:7/13: rename c0 to d1/c2 0 2024-04-12T13:41:48.180 INFO:tasks.workunit.client.1.smithi110.stdout:7/14: write - no filename 2024-04-12T13:41:48.180 INFO:tasks.workunit.client.1.smithi110.stdout:7/15: write - no filename 2024-04-12T13:41:48.181 INFO:tasks.workunit.client.1.smithi110.stdout:1/5: mkdir d3 0 2024-04-12T13:41:48.184 INFO:tasks.workunit.client.1.smithi110.stdout:9/0: creat f0 x:0 0 0 2024-04-12T13:41:48.193 INFO:tasks.workunit.client.1.smithi110.stdout:6/9: rename l1 to l3 0 2024-04-12T13:41:48.204 INFO:tasks.workunit.client.1.smithi110.stdout:9/1: creat f1 x:0 0 0 2024-04-12T13:41:48.205 INFO:tasks.workunit.client.1.smithi110.stdout:9/2: dread - f1 zero size 2024-04-12T13:41:48.205 INFO:tasks.workunit.client.1.smithi110.stdout:3/8: link l1 l2 0 2024-04-12T13:41:48.206 INFO:tasks.workunit.client.1.smithi110.stdout:6/10: mknod c4 0 2024-04-12T13:41:48.214 INFO:tasks.workunit.client.1.smithi110.stdout:9/3: mknod c2 0 2024-04-12T13:41:48.216 INFO:tasks.workunit.client.1.smithi110.stdout:3/9: symlink l3 0 2024-04-12T13:41:48.216 INFO:tasks.workunit.client.1.smithi110.stdout:9/4: truncate f0 1004091 0 2024-04-12T13:41:48.222 INFO:tasks.workunit.client.1.smithi110.stdout:1/6: rmdir d3 0 2024-04-12T13:41:48.223 INFO:tasks.workunit.client.1.smithi110.stdout:1/7: dread - f2 zero size 2024-04-12T13:41:48.225 INFO:tasks.workunit.client.1.smithi110.stdout:3/10: rename l3 to l4 0 2024-04-12T13:41:48.225 INFO:tasks.workunit.client.1.smithi110.stdout:3/11: dwrite - no filename 2024-04-12T13:41:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:47 smithi110 ceph-mon[36055]: pgmap v18: 65 pgs: 65 active+clean; 213 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s wr, 229 op/s 2024-04-12T13:41:48.231 INFO:tasks.workunit.client.1.smithi110.stdout:3/12: mkdir d5 0 2024-04-12T13:41:48.231 INFO:tasks.workunit.client.1.smithi110.stdout:3/13: dread - no filename 2024-04-12T13:41:48.237 INFO:tasks.workunit.client.1.smithi110.stdout:3/14: symlink d5/l6 0 2024-04-12T13:41:48.238 INFO:tasks.workunit.client.1.smithi110.stdout:3/15: dwrite - no filename 2024-04-12T13:41:48.238 INFO:tasks.workunit.client.1.smithi110.stdout:3/16: dread - no filename 2024-04-12T13:41:48.243 INFO:tasks.workunit.client.1.smithi110.stdout:3/17: unlink d5/l6 0 2024-04-12T13:41:48.243 INFO:tasks.workunit.client.1.smithi110.stdout:3/18: dwrite - no filename 2024-04-12T13:41:48.243 INFO:tasks.workunit.client.1.smithi110.stdout:3/19: write - no filename 2024-04-12T13:41:48.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/20: rename l1 to d5/l7 0 2024-04-12T13:41:48.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/21: truncate - no filename 2024-04-12T13:41:48.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/22: write - no filename 2024-04-12T13:41:48.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/23: dread - no filename 2024-04-12T13:41:48.256 INFO:tasks.workunit.client.1.smithi110.stdout:3/24: chown l2 6005177 1 2024-04-12T13:41:48.256 INFO:tasks.workunit.client.1.smithi110.stdout:3/25: truncate - no filename 2024-04-12T13:41:48.261 INFO:tasks.workunit.client.1.smithi110.stdout:3/26: symlink d5/l8 0 2024-04-12T13:41:48.261 INFO:tasks.workunit.client.1.smithi110.stdout:3/27: dread - no filename 2024-04-12T13:41:48.265 INFO:tasks.workunit.client.1.smithi110.stdout:3/28: creat d5/f9 x:0 0 0 2024-04-12T13:41:48.268 INFO:tasks.workunit.client.1.smithi110.stdout:3/29: symlink d5/la 0 2024-04-12T13:41:48.270 INFO:tasks.workunit.client.1.smithi110.stdout:3/30: readlink d5/l8 0 2024-04-12T13:41:48.300 INFO:tasks.workunit.client.1.smithi110.stdout:0/5: getdents . 0 2024-04-12T13:41:48.302 INFO:tasks.workunit.client.1.smithi110.stdout:0/6: mkdir d1 0 2024-04-12T13:41:48.308 INFO:tasks.workunit.client.1.smithi110.stdout:0/7: creat d1/f2 x:0 0 0 2024-04-12T13:41:48.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/8: getdents . 0 2024-04-12T13:41:48.321 INFO:tasks.workunit.client.1.smithi110.stdout:5/9: rename f0 to f1 0 2024-04-12T13:41:48.324 INFO:tasks.workunit.client.1.smithi110.stdout:2/12: getdents . 0 2024-04-12T13:41:48.327 INFO:tasks.workunit.client.1.smithi110.stdout:2/13: write f0 [90832,5445] 0 2024-04-12T13:41:48.344 INFO:tasks.workunit.client.1.smithi110.stdout:9/5: fsync f0 0 2024-04-12T13:41:48.347 INFO:tasks.workunit.client.1.smithi110.stdout:4/17: chown d0/l3 681 1 2024-04-12T13:41:48.349 INFO:tasks.workunit.client.1.smithi110.stdout:7/16: unlink d1/c2 0 2024-04-12T13:41:48.349 INFO:tasks.workunit.client.1.smithi110.stdout:7/17: dwrite - no filename 2024-04-12T13:41:48.349 INFO:tasks.workunit.client.1.smithi110.stdout:7/18: write - no filename 2024-04-12T13:41:48.353 INFO:tasks.workunit.client.1.smithi110.stdout:9/6: creat f3 x:0 0 0 2024-04-12T13:41:48.361 INFO:tasks.workunit.client.1.smithi110.stdout:6/11: link l3 l5 0 2024-04-12T13:41:48.361 INFO:tasks.workunit.client.1.smithi110.stdout:6/12: dwrite - no filename 2024-04-12T13:41:48.361 INFO:tasks.workunit.client.1.smithi110.stdout:5/10: dread f1 [0,4194304] 0 2024-04-12T13:41:48.362 INFO:tasks.workunit.client.1.smithi110.stdout:9/7: dread - f3 zero size 2024-04-12T13:41:48.366 INFO:tasks.workunit.client.1.smithi110.stdout:7/19: mkdir d1/d3 0 2024-04-12T13:41:48.371 INFO:tasks.workunit.client.1.smithi110.stdout:0/8: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:48.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/20: chown d1 297590841 1 2024-04-12T13:41:48.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/21: dread - no filename 2024-04-12T13:41:48.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/22: dread - no filename 2024-04-12T13:41:48.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/23: write - no filename 2024-04-12T13:41:48.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/24: unlink - no file 2024-04-12T13:41:48.380 INFO:tasks.workunit.client.1.smithi110.stdout:4/18: dread d0/f1 [0,4194304] 0 2024-04-12T13:41:48.381 INFO:tasks.workunit.client.1.smithi110.stdout:6/13: symlink l6 0 2024-04-12T13:41:48.382 INFO:tasks.workunit.client.1.smithi110.stdout:9/8: read f0 [548447,97417] 0 2024-04-12T13:41:48.385 INFO:tasks.workunit.client.1.smithi110.stdout:6/14: mkdir d7 0 2024-04-12T13:41:48.385 INFO:tasks.workunit.client.1.smithi110.stdout:6/15: dwrite - no filename 2024-04-12T13:41:48.387 INFO:tasks.workunit.client.1.smithi110.stdout:4/19: chown d0/l3 923125351 1 2024-04-12T13:41:48.387 INFO:tasks.workunit.client.1.smithi110.stdout:7/25: mkdir d1/d3/d4 0 2024-04-12T13:41:48.387 INFO:tasks.workunit.client.1.smithi110.stdout:7/26: truncate - no filename 2024-04-12T13:41:48.387 INFO:tasks.workunit.client.1.smithi110.stdout:7/27: dread - no filename 2024-04-12T13:41:48.390 INFO:tasks.workunit.client.1.smithi110.stdout:9/9: unlink f1 0 2024-04-12T13:41:48.390 INFO:tasks.workunit.client.1.smithi110.stdout:2/14: dwrite f3 [0,4194304] 0 2024-04-12T13:41:48.392 INFO:tasks.workunit.client.1.smithi110.stdout:9/10: read f0 [232330,111745] 0 2024-04-12T13:41:48.393 INFO:tasks.workunit.client.1.smithi110.stdout:2/15: write f0 [964386,122403] 0 2024-04-12T13:41:48.394 INFO:tasks.workunit.client.1.smithi110.stdout:9/11: chown f3 14090 1 2024-04-12T13:41:48.394 INFO:tasks.workunit.client.1.smithi110.stdout:3/31: fsync d5/f9 0 2024-04-12T13:41:48.396 INFO:tasks.workunit.client.1.smithi110.stdout:7/28: creat d1/f5 x:0 0 0 2024-04-12T13:41:48.397 INFO:tasks.workunit.client.1.smithi110.stdout:9/12: chown c2 5 1 2024-04-12T13:41:48.397 INFO:tasks.workunit.client.1.smithi110.stdout:3/32: chown d5/l8 0 1 2024-04-12T13:41:48.401 INFO:tasks.workunit.client.1.smithi110.stdout:0/9: rmdir d1 39 2024-04-12T13:41:48.401 INFO:tasks.workunit.client.1.smithi110.stdout:3/33: fdatasync d5/f9 0 2024-04-12T13:41:48.401 INFO:tasks.workunit.client.1.smithi110.stdout:7/29: truncate d1/f5 941379 0 2024-04-12T13:41:48.402 INFO:tasks.workunit.client.1.smithi110.stdout:5/11: fsync f1 0 2024-04-12T13:41:48.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/34: truncate d5/f9 310127 0 2024-04-12T13:41:48.407 INFO:tasks.workunit.client.1.smithi110.stdout:6/16: mknod d7/c8 0 2024-04-12T13:41:48.407 INFO:tasks.workunit.client.1.smithi110.stdout:6/17: fdatasync - no filename 2024-04-12T13:41:48.409 INFO:tasks.workunit.client.1.smithi110.stdout:2/16: dread f0 [0,4194304] 0 2024-04-12T13:41:48.411 INFO:tasks.workunit.client.1.smithi110.stdout:9/13: creat f4 x:0 0 0 2024-04-12T13:41:48.413 INFO:tasks.workunit.client.1.smithi110.stdout:0/10: chown d1/f2 6612 1 2024-04-12T13:41:48.415 INFO:tasks.workunit.client.1.smithi110.stdout:6/18: stat l5 0 2024-04-12T13:41:48.415 INFO:tasks.workunit.client.1.smithi110.stdout:6/19: write - no filename 2024-04-12T13:41:48.417 INFO:tasks.workunit.client.1.smithi110.stdout:2/17: creat f4 x:0 0 0 2024-04-12T13:41:48.419 INFO:tasks.workunit.client.1.smithi110.stdout:5/12: dread f1 [0,4194304] 0 2024-04-12T13:41:48.419 INFO:tasks.workunit.client.1.smithi110.stdout:9/14: rename f4 to f5 0 2024-04-12T13:41:48.419 INFO:tasks.workunit.client.1.smithi110.stdout:3/35: dread d5/f9 [0,4194304] 0 2024-04-12T13:41:48.420 INFO:tasks.workunit.client.1.smithi110.stdout:9/15: chown f5 19948 1 2024-04-12T13:41:48.420 INFO:tasks.workunit.client.1.smithi110.stdout:7/30: link d1/f5 d1/d3/d4/f6 0 2024-04-12T13:41:48.422 INFO:tasks.workunit.client.1.smithi110.stdout:3/36: dread d5/f9 [0,4194304] 0 2024-04-12T13:41:48.423 INFO:tasks.workunit.client.1.smithi110.stdout:0/11: symlink d1/l3 0 2024-04-12T13:41:48.423 INFO:tasks.workunit.client.1.smithi110.stdout:4/20: getdents d0 0 2024-04-12T13:41:48.426 INFO:tasks.workunit.client.1.smithi110.stdout:2/18: unlink f2 0 2024-04-12T13:41:48.426 INFO:tasks.workunit.client.1.smithi110.stdout:2/19: rmdir - no directory 2024-04-12T13:41:48.427 INFO:tasks.workunit.client.1.smithi110.stdout:5/13: mknod c2 0 2024-04-12T13:41:48.427 INFO:tasks.workunit.client.1.smithi110.stdout:2/20: write f3 [692974,84609] 0 2024-04-12T13:41:48.429 INFO:tasks.workunit.client.1.smithi110.stdout:9/16: creat f6 x:0 0 0 2024-04-12T13:41:48.430 INFO:tasks.workunit.client.1.smithi110.stdout:0/12: mknod d1/c4 0 2024-04-12T13:41:48.431 INFO:tasks.workunit.client.1.smithi110.stdout:3/37: mkdir d5/db 0 2024-04-12T13:41:48.433 INFO:tasks.workunit.client.1.smithi110.stdout:4/21: creat d0/f4 x:0 0 0 2024-04-12T13:41:48.436 INFO:tasks.workunit.client.1.smithi110.stdout:9/17: rename f6 to f7 0 2024-04-12T13:41:48.436 INFO:tasks.workunit.client.1.smithi110.stdout:0/13: mknod d1/c5 0 2024-04-12T13:41:48.437 INFO:tasks.workunit.client.1.smithi110.stdout:9/18: write f0 [265021,100021] 0 2024-04-12T13:41:48.437 INFO:tasks.workunit.client.1.smithi110.stdout:6/20: link l2 d7/l9 0 2024-04-12T13:41:48.437 INFO:tasks.workunit.client.1.smithi110.stdout:6/21: write - no filename 2024-04-12T13:41:48.437 INFO:tasks.workunit.client.1.smithi110.stdout:6/22: dread - no filename 2024-04-12T13:41:48.437 INFO:tasks.workunit.client.1.smithi110.stdout:6/23: dwrite - no filename 2024-04-12T13:41:48.438 INFO:tasks.workunit.client.1.smithi110.stdout:5/14: dread f1 [0,4194304] 0 2024-04-12T13:41:48.439 INFO:tasks.workunit.client.1.smithi110.stdout:3/38: rename d5/db to d5/dc 0 2024-04-12T13:41:48.439 INFO:tasks.workunit.client.1.smithi110.stdout:4/22: creat d0/f5 x:0 0 0 2024-04-12T13:41:48.440 INFO:tasks.workunit.client.1.smithi110.stdout:3/39: chown d5/dc 163 1 2024-04-12T13:41:48.440 INFO:tasks.workunit.client.1.smithi110.stdout:9/19: truncate f7 86128 0 2024-04-12T13:41:48.441 INFO:tasks.workunit.client.1.smithi110.stdout:6/24: unlink l0 0 2024-04-12T13:41:48.441 INFO:tasks.workunit.client.1.smithi110.stdout:6/25: dwrite - no filename 2024-04-12T13:41:48.442 INFO:tasks.workunit.client.1.smithi110.stdout:7/31: getdents d1/d3 0 2024-04-12T13:41:48.443 INFO:tasks.workunit.client.1.smithi110.stdout:5/15: unlink c2 0 2024-04-12T13:41:48.443 INFO:tasks.workunit.client.1.smithi110.stdout:7/32: chown d1/f5 5 1 2024-04-12T13:41:48.444 INFO:tasks.workunit.client.1.smithi110.stdout:9/20: creat f8 x:0 0 0 2024-04-12T13:41:48.445 INFO:tasks.workunit.client.1.smithi110.stdout:4/23: dread d0/f1 [0,4194304] 0 2024-04-12T13:41:48.445 INFO:tasks.workunit.client.1.smithi110.stdout:9/21: read - f3 zero size 2024-04-12T13:41:48.446 INFO:tasks.workunit.client.1.smithi110.stdout:6/26: mknod d7/ca 0 2024-04-12T13:41:48.447 INFO:tasks.workunit.client.1.smithi110.stdout:3/40: write d5/f9 [412781,43287] 0 2024-04-12T13:41:48.450 INFO:tasks.workunit.client.1.smithi110.stdout:7/33: write d1/f5 [626822,32765] 0 2024-04-12T13:41:48.452 INFO:tasks.workunit.client.1.smithi110.stdout:9/22: unlink f8 0 2024-04-12T13:41:48.453 INFO:tasks.workunit.client.1.smithi110.stdout:6/27: symlink d7/lb 0 2024-04-12T13:41:48.455 INFO:tasks.workunit.client.1.smithi110.stdout:9/23: truncate f3 1015456 0 2024-04-12T13:41:48.458 INFO:tasks.workunit.client.1.smithi110.stdout:9/24: read f3 [249104,104724] 0 2024-04-12T13:41:48.458 INFO:tasks.workunit.client.1.smithi110.stdout:3/41: creat d5/dc/fd x:0 0 0 2024-04-12T13:41:48.458 INFO:tasks.workunit.client.1.smithi110.stdout:0/14: dwrite f0 [0,4194304] 0 2024-04-12T13:41:48.459 INFO:tasks.workunit.client.1.smithi110.stdout:9/25: dread - f5 zero size 2024-04-12T13:41:48.462 INFO:tasks.workunit.client.1.smithi110.stdout:3/42: dread d5/f9 [0,4194304] 0 2024-04-12T13:41:48.469 INFO:tasks.workunit.client.1.smithi110.stdout:0/15: unlink d1/f2 0 2024-04-12T13:41:48.472 INFO:tasks.workunit.client.1.smithi110.stdout:7/34: symlink d1/d3/d4/l7 0 2024-04-12T13:41:48.472 INFO:tasks.workunit.client.1.smithi110.stdout:9/26: write f5 [1001923,127246] 0 2024-04-12T13:41:48.474 INFO:tasks.workunit.client.1.smithi110.stdout:4/24: link d0/l3 d0/l6 0 2024-04-12T13:41:48.475 INFO:tasks.workunit.client.1.smithi110.stdout:7/35: readlink d1/d3/d4/l7 0 2024-04-12T13:41:48.475 INFO:tasks.workunit.client.1.smithi110.stdout:4/25: dread - d0/f5 zero size 2024-04-12T13:41:48.478 INFO:tasks.workunit.client.1.smithi110.stdout:0/16: symlink d1/l6 0 2024-04-12T13:41:48.480 INFO:tasks.workunit.client.1.smithi110.stdout:0/17: chown f0 88 1 2024-04-12T13:41:48.483 INFO:tasks.workunit.client.1.smithi110.stdout:7/36: write d1/f5 [1419685,63374] 0 2024-04-12T13:41:48.486 INFO:tasks.workunit.client.1.smithi110.stdout:6/28: getdents d7 0 2024-04-12T13:41:48.486 INFO:tasks.workunit.client.1.smithi110.stdout:0/18: creat d1/f7 x:0 0 0 2024-04-12T13:41:48.487 INFO:tasks.workunit.client.1.smithi110.stdout:6/29: write - no filename 2024-04-12T13:41:48.487 INFO:tasks.workunit.client.1.smithi110.stdout:6/30: dread - no filename 2024-04-12T13:41:48.487 INFO:tasks.workunit.client.1.smithi110.stdout:6/31: write - no filename 2024-04-12T13:41:48.494 INFO:tasks.workunit.client.1.smithi110.stdout:0/19: write d1/f7 [190584,61758] 0 2024-04-12T13:41:48.497 INFO:tasks.workunit.client.1.smithi110.stdout:3/43: dwrite d5/f9 [0,4194304] 0 2024-04-12T13:41:48.497 INFO:tasks.workunit.client.1.smithi110.stdout:6/32: link c4 d7/cc 0 2024-04-12T13:41:48.506 INFO:tasks.workunit.client.1.smithi110.stdout:6/33: creat d7/fd x:0 0 0 2024-04-12T13:41:48.507 INFO:tasks.workunit.client.1.smithi110.stdout:3/44: creat d5/dc/fe x:0 0 0 2024-04-12T13:41:48.511 INFO:tasks.workunit.client.1.smithi110.stdout:4/26: dwrite d0/f4 [0,4194304] 0 2024-04-12T13:41:48.513 INFO:tasks.workunit.client.1.smithi110.stdout:3/45: stat d5/l8 0 2024-04-12T13:41:48.515 INFO:tasks.workunit.client.1.smithi110.stdout:4/27: chown d0 0 1 2024-04-12T13:41:48.518 INFO:tasks.workunit.client.1.smithi110.stdout:6/34: write d7/fd [47310,62326] 0 2024-04-12T13:41:48.519 INFO:tasks.workunit.client.1.smithi110.stdout:3/46: symlink d5/lf 0 2024-04-12T13:41:48.521 INFO:tasks.workunit.client.1.smithi110.stdout:9/27: dwrite f7 [0,4194304] 0 2024-04-12T13:41:48.524 INFO:tasks.workunit.client.1.smithi110.stdout:4/28: write d0/f5 [622589,1535] 0 2024-04-12T13:41:48.527 INFO:tasks.workunit.client.1.smithi110.stdout:9/28: write f0 [860195,111204] 0 2024-04-12T13:41:48.531 INFO:tasks.workunit.client.1.smithi110.stdout:6/35: link d7/ca d7/ce 0 2024-04-12T13:41:48.532 INFO:tasks.workunit.client.1.smithi110.stdout:4/29: mknod d0/c7 0 2024-04-12T13:41:48.533 INFO:tasks.workunit.client.1.smithi110.stdout:3/47: getdents d5/dc 0 2024-04-12T13:41:48.535 INFO:tasks.workunit.client.1.smithi110.stdout:0/20: dwrite f0 [4194304,4194304] 0 2024-04-12T13:41:48.539 INFO:tasks.workunit.client.1.smithi110.stdout:9/29: dread f0 [0,4194304] 0 2024-04-12T13:41:48.543 INFO:tasks.workunit.client.1.smithi110.stdout:9/30: creat f9 x:0 0 0 2024-04-12T13:41:48.544 INFO:tasks.workunit.client.1.smithi110.stdout:0/21: rmdir d1 39 2024-04-12T13:41:48.547 INFO:tasks.workunit.client.1.smithi110.stdout:9/31: creat fa x:0 0 0 2024-04-12T13:41:48.554 INFO:tasks.workunit.client.1.smithi110.stdout:9/32: read - fa zero size 2024-04-12T13:41:48.559 INFO:tasks.workunit.client.1.smithi110.stdout:9/33: fdatasync f5 0 2024-04-12T13:41:48.570 INFO:tasks.workunit.client.1.smithi110.stdout:9/34: rename f0 to fb 0 2024-04-12T13:41:48.579 INFO:tasks.workunit.client.1.smithi110.stdout:6/36: dwrite d7/fd [0,4194304] 0 2024-04-12T13:41:48.582 INFO:tasks.workunit.client.1.smithi110.stdout:9/35: rename f9 to fc 0 2024-04-12T13:41:48.584 INFO:tasks.workunit.client.1.smithi110.stdout:4/30: dwrite d0/f1 [0,4194304] 0 2024-04-12T13:41:48.585 INFO:tasks.workunit.client.1.smithi110.stdout:3/48: dwrite d5/dc/fe [0,4194304] 0 2024-04-12T13:41:48.586 INFO:tasks.workunit.client.1.smithi110.stdout:6/37: truncate d7/fd 4703220 0 2024-04-12T13:41:48.586 INFO:tasks.workunit.client.1.smithi110.stdout:0/22: dwrite f0 [4194304,4194304] 0 2024-04-12T13:41:48.587 INFO:tasks.workunit.client.1.smithi110.stdout:9/36: creat fd x:0 0 0 2024-04-12T13:41:48.588 INFO:tasks.workunit.client.1.smithi110.stdout:9/37: chown f5 1082 1 2024-04-12T13:41:48.590 INFO:tasks.workunit.client.1.smithi110.stdout:0/23: fsync d1/f7 0 2024-04-12T13:41:48.590 INFO:tasks.workunit.client.1.smithi110.stdout:6/38: rmdir d7 39 2024-04-12T13:41:48.593 INFO:tasks.workunit.client.1.smithi110.stdout:3/49: unlink d5/f9 0 2024-04-12T13:41:48.599 INFO:tasks.workunit.client.1.smithi110.stdout:0/24: mkdir d1/d8 0 2024-04-12T13:41:48.600 INFO:tasks.workunit.client.1.smithi110.stdout:3/50: unlink d5/l8 0 2024-04-12T13:41:48.601 INFO:tasks.workunit.client.1.smithi110.stdout:6/39: rmdir d7 39 2024-04-12T13:41:48.608 INFO:tasks.workunit.client.1.smithi110.stdout:4/31: dwrite d0/f1 [0,4194304] 0 2024-04-12T13:41:48.609 INFO:tasks.workunit.client.1.smithi110.stdout:6/40: mknod d7/cf 0 2024-04-12T13:41:48.612 INFO:tasks.workunit.client.1.smithi110.stdout:6/41: read d7/fd [1253687,57779] 0 2024-04-12T13:41:48.613 INFO:tasks.workunit.client.1.smithi110.stdout:6/42: fdatasync d7/fd 0 2024-04-12T13:41:48.616 INFO:tasks.workunit.client.1.smithi110.stdout:6/43: write d7/fd [5668581,95076] 0 2024-04-12T13:41:48.616 INFO:tasks.workunit.client.1.smithi110.stdout:9/38: dwrite fb [0,4194304] 0 2024-04-12T13:41:48.621 INFO:tasks.workunit.client.1.smithi110.stdout:0/25: getdents d1 0 2024-04-12T13:41:48.622 INFO:tasks.workunit.client.1.smithi110.stdout:0/26: fsync d1/f7 0 2024-04-12T13:41:48.623 INFO:tasks.workunit.client.1.smithi110.stdout:0/27: chown d1/l3 0 1 2024-04-12T13:41:48.626 INFO:tasks.workunit.client.1.smithi110.stdout:6/44: mkdir d7/d10 0 2024-04-12T13:41:48.626 INFO:tasks.workunit.client.1.smithi110.stdout:9/39: symlink le 0 2024-04-12T13:41:48.626 INFO:tasks.workunit.client.1.smithi110.stdout:9/40: dread - fd zero size 2024-04-12T13:41:48.628 INFO:tasks.workunit.client.1.smithi110.stdout:9/41: chown c2 14991681 1 2024-04-12T13:41:48.633 INFO:tasks.workunit.client.1.smithi110.stdout:4/32: fsync d0/f1 0 2024-04-12T13:41:48.635 INFO:tasks.workunit.client.1.smithi110.stdout:4/33: rmdir d0 39 2024-04-12T13:41:48.637 INFO:tasks.workunit.client.1.smithi110.stdout:6/45: dread d7/fd [0,4194304] 0 2024-04-12T13:41:48.639 INFO:tasks.workunit.client.1.smithi110.stdout:4/34: symlink d0/l8 0 2024-04-12T13:41:48.639 INFO:tasks.workunit.client.1.smithi110.stdout:9/42: dread fb [0,4194304] 0 2024-04-12T13:41:48.640 INFO:tasks.workunit.client.1.smithi110.stdout:6/46: write d7/fd [2008114,23311] 0 2024-04-12T13:41:48.641 INFO:tasks.workunit.client.1.smithi110.stdout:4/35: symlink d0/l9 0 2024-04-12T13:41:48.644 INFO:tasks.workunit.client.1.smithi110.stdout:4/36: symlink d0/la 0 2024-04-12T13:41:48.646 INFO:tasks.workunit.client.1.smithi110.stdout:9/43: getdents . 0 2024-04-12T13:41:48.647 INFO:tasks.workunit.client.1.smithi110.stdout:4/37: creat d0/fb x:0 0 0 2024-04-12T13:41:48.648 INFO:tasks.workunit.client.1.smithi110.stdout:9/44: mkdir df 0 2024-04-12T13:41:48.650 INFO:tasks.workunit.client.1.smithi110.stdout:4/38: creat d0/fc x:0 0 0 2024-04-12T13:41:48.651 INFO:tasks.workunit.client.1.smithi110.stdout:9/45: mknod df/c10 0 2024-04-12T13:41:48.652 INFO:tasks.workunit.client.1.smithi110.stdout:9/46: write f5 [668633,3328] 0 2024-04-12T13:41:48.658 INFO:tasks.workunit.client.1.smithi110.stdout:4/39: getdents d0 0 2024-04-12T13:41:48.659 INFO:tasks.workunit.client.1.smithi110.stdout:6/47: dwrite d7/fd [0,4194304] 0 2024-04-12T13:41:48.659 INFO:tasks.workunit.client.1.smithi110.stdout:9/47: dread f3 [0,4194304] 0 2024-04-12T13:41:48.660 INFO:tasks.workunit.client.1.smithi110.stdout:4/40: truncate d0/fc 935846 0 2024-04-12T13:41:48.666 INFO:tasks.workunit.client.1.smithi110.stdout:6/48: rename d7/cf to d7/d10/c11 0 2024-04-12T13:41:48.667 INFO:tasks.workunit.client.1.smithi110.stdout:6/49: read d7/fd [4600829,105168] 0 2024-04-12T13:41:48.667 INFO:tasks.workunit.client.1.smithi110.stdout:9/48: link f5 df/f11 0 2024-04-12T13:41:48.671 INFO:tasks.workunit.client.1.smithi110.stdout:9/49: unlink le 0 2024-04-12T13:41:48.673 INFO:tasks.workunit.client.1.smithi110.stdout:4/41: link d0/l3 d0/ld 0 2024-04-12T13:41:48.674 INFO:tasks.workunit.client.1.smithi110.stdout:9/50: rmdir df 39 2024-04-12T13:41:48.675 INFO:tasks.workunit.client.1.smithi110.stdout:4/42: mkdir d0/de 0 2024-04-12T13:41:48.676 INFO:tasks.workunit.client.1.smithi110.stdout:4/43: read - d0/fb zero size 2024-04-12T13:41:48.676 INFO:tasks.workunit.client.1.smithi110.stdout:9/51: write fb [279566,124138] 0 2024-04-12T13:41:48.678 INFO:tasks.workunit.client.1.smithi110.stdout:6/50: truncate d7/fd 3124256 0 2024-04-12T13:41:48.680 INFO:tasks.workunit.client.1.smithi110.stdout:4/44: creat d0/ff x:0 0 0 2024-04-12T13:41:48.682 INFO:tasks.workunit.client.1.smithi110.stdout:6/51: rmdir d7/d10 39 2024-04-12T13:41:48.686 INFO:tasks.workunit.client.1.smithi110.stdout:4/45: link d0/l9 d0/l10 0 2024-04-12T13:41:48.688 INFO:tasks.workunit.client.1.smithi110.stdout:4/46: write d0/fc [1609639,37824] 0 2024-04-12T13:41:48.690 INFO:tasks.workunit.client.1.smithi110.stdout:4/47: fsync d0/f1 0 2024-04-12T13:41:48.690 INFO:tasks.workunit.client.1.smithi110.stdout:6/52: fsync d7/fd 0 2024-04-12T13:41:48.694 INFO:tasks.workunit.client.1.smithi110.stdout:4/48: write d0/f4 [2397216,77825] 0 2024-04-12T13:41:48.695 INFO:tasks.workunit.client.1.smithi110.stdout:6/53: mkdir d7/d10/d12 0 2024-04-12T13:41:48.699 INFO:tasks.workunit.client.1.smithi110.stdout:4/49: write d0/f5 [92390,120723] 0 2024-04-12T13:41:48.701 INFO:tasks.workunit.client.1.smithi110.stdout:9/52: dwrite fc [0,4194304] 0 2024-04-12T13:41:48.702 INFO:tasks.workunit.client.1.smithi110.stdout:9/53: chown f7 49797 1 2024-04-12T13:41:48.703 INFO:tasks.workunit.client.1.smithi110.stdout:4/50: unlink d0/f1 0 2024-04-12T13:41:48.709 INFO:tasks.workunit.client.1.smithi110.stdout:4/51: read d0/fc [551409,57564] 0 2024-04-12T13:41:48.716 INFO:tasks.workunit.client.1.smithi110.stdout:4/52: rename d0/l3 to d0/l11 0 2024-04-12T13:41:48.722 INFO:tasks.workunit.client.1.smithi110.stdout:6/54: dwrite d7/fd [0,4194304] 0 2024-04-12T13:41:48.728 INFO:tasks.workunit.client.1.smithi110.stdout:9/54: dwrite f5 [0,4194304] 0 2024-04-12T13:41:48.750 INFO:tasks.workunit.client.1.smithi110.stdout:6/55: fdatasync d7/fd 0 2024-04-12T13:41:48.751 INFO:tasks.workunit.client.0.smithi060.stdout:5/9: sync 2024-04-12T13:41:48.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/12: sync 2024-04-12T13:41:48.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/13: dread - no filename 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:1/25: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:2/10: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:8/25: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:6/51: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:0/80: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:3/33: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:4/34: sync 2024-04-12T13:41:48.759 INFO:tasks.workunit.client.0.smithi060.stdout:9/16: sync 2024-04-12T13:41:48.761 INFO:tasks.workunit.client.0.smithi060.stdout:2/11: dread - f3 zero size 2024-04-12T13:41:48.761 INFO:tasks.workunit.client.0.smithi060.stdout:3/34: chown c1 139 1 2024-04-12T13:41:48.762 INFO:tasks.workunit.client.0.smithi060.stdout:5/10: link f1 f2 0 2024-04-12T13:41:48.763 INFO:tasks.workunit.client.0.smithi060.stdout:3/35: write d7/f8 [479008,10651] 0 2024-04-12T13:41:48.765 INFO:tasks.workunit.client.0.smithi060.stdout:7/14: mknod d0/d1/c2 0 2024-04-12T13:41:48.767 INFO:tasks.workunit.client.0.smithi060.stdout:0/81: symlink d7/l1f 0 2024-04-12T13:41:48.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/11: dread f2 [0,4194304] 0 2024-04-12T13:41:48.772 INFO:tasks.workunit.client.0.smithi060.stdout:8/26: mknod c7 0 2024-04-12T13:41:48.775 INFO:tasks.workunit.client.0.smithi060.stdout:2/12: creat f4 x:0 0 0 2024-04-12T13:41:48.783 INFO:tasks.workunit.client.0.smithi060.stdout:3/36: dwrite d7/f8 [0,4194304] 0 2024-04-12T13:41:48.787 INFO:tasks.workunit.client.0.smithi060.stdout:6/52: unlink d1/c6 0 2024-04-12T13:41:48.792 INFO:tasks.workunit.client.0.smithi060.stdout:9/17: mknod d4/c5 0 2024-04-12T13:41:48.801 INFO:tasks.workunit.client.0.smithi060.stdout:8/27: mknod c8 0 2024-04-12T13:41:48.805 INFO:tasks.workunit.client.0.smithi060.stdout:5/12: write f1 [1353092,96710] 0 2024-04-12T13:41:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:4/35: creat d6/d7/dd/fe x:0 0 0 2024-04-12T13:41:48.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/13: dwrite f4 [0,4194304] 0 2024-04-12T13:41:48.810 INFO:tasks.workunit.client.0.smithi060.stdout:6/53: mknod d1/d7/c12 0 2024-04-12T13:41:48.818 INFO:tasks.workunit.client.0.smithi060.stdout:4/36: chown d6/d7/dd/fe 144867380 1 2024-04-12T13:41:48.823 INFO:tasks.workunit.client.0.smithi060.stdout:4/37: chown f2 780441 1 2024-04-12T13:41:48.823 INFO:tasks.workunit.client.0.smithi060.stdout:5/13: dread f1 [0,4194304] 0 2024-04-12T13:41:48.826 INFO:tasks.workunit.client.0.smithi060.stdout:3/37: dwrite d7/f9 [0,4194304] 0 2024-04-12T13:41:48.829 INFO:tasks.workunit.client.0.smithi060.stdout:7/15: link d0/d1/c2 d0/c3 0 2024-04-12T13:41:48.829 INFO:tasks.workunit.client.0.smithi060.stdout:7/16: fdatasync - no filename 2024-04-12T13:41:48.829 INFO:tasks.workunit.client.0.smithi060.stdout:7/17: dwrite - no filename 2024-04-12T13:41:48.832 INFO:tasks.workunit.client.0.smithi060.stdout:4/38: write f4 [1836375,34044] 0 2024-04-12T13:41:48.833 INFO:tasks.workunit.client.0.smithi060.stdout:9/18: dwrite f2 [4194304,4194304] 0 2024-04-12T13:41:48.842 INFO:tasks.workunit.client.0.smithi060.stdout:6/54: dread d1/f11 [0,4194304] 0 2024-04-12T13:41:48.842 INFO:tasks.workunit.client.0.smithi060.stdout:2/14: dread f4 [0,4194304] 0 2024-04-12T13:41:48.847 INFO:tasks.workunit.client.0.smithi060.stdout:6/55: write d1/d7/fd [4184226,110334] 0 2024-04-12T13:41:48.850 INFO:tasks.workunit.client.0.smithi060.stdout:5/14: write f2 [2112949,129495] 0 2024-04-12T13:41:48.852 INFO:tasks.workunit.client.0.smithi060.stdout:3/38: symlink d7/lc 0 2024-04-12T13:41:48.855 INFO:tasks.workunit.client.0.smithi060.stdout:6/56: truncate d1/d7/da/ff 329146 0 2024-04-12T13:41:48.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/18: rmdir d0/d1 39 2024-04-12T13:41:48.863 INFO:tasks.workunit.client.0.smithi060.stdout:4/39: mkdir d6/d7/dd/df 0 2024-04-12T13:41:48.866 INFO:tasks.workunit.client.0.smithi060.stdout:0/82: getdents d7 0 2024-04-12T13:41:48.866 INFO:tasks.workunit.client.0.smithi060.stdout:9/19: mknod d4/c6 0 2024-04-12T13:41:48.867 INFO:tasks.workunit.client.0.smithi060.stdout:1/26: write f3 [674743,28077] 0 2024-04-12T13:41:48.868 INFO:tasks.workunit.client.0.smithi060.stdout:0/83: chown d7/d9/l1d 0 1 2024-04-12T13:41:48.868 INFO:tasks.workunit.client.0.smithi060.stdout:9/20: fdatasync f2 0 2024-04-12T13:41:48.873 INFO:tasks.workunit.client.0.smithi060.stdout:5/15: symlink l3 0 2024-04-12T13:41:48.875 INFO:tasks.workunit.client.0.smithi060.stdout:3/39: unlink f3 0 2024-04-12T13:41:48.876 INFO:tasks.workunit.client.0.smithi060.stdout:3/40: fsync d7/f8 0 2024-04-12T13:41:48.936 INFO:tasks.workunit.client.0.smithi060.stdout:2/15: dwrite f4 [0,4194304] 0 2024-04-12T13:41:48.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/16: dwrite f3 [0,4194304] 0 2024-04-12T13:41:48.977 INFO:tasks.workunit.client.0.smithi060.stdout:2/17: write f3 [2918245,115001] 0 2024-04-12T13:41:49.018 INFO:tasks.workunit.client.0.smithi060.stdout:6/57: write d1/f11 [149971,10489] 0 2024-04-12T13:41:49.020 INFO:tasks.workunit.client.0.smithi060.stdout:7/19: rename d0 to d0/d4 22 2024-04-12T13:41:49.020 INFO:tasks.workunit.client.0.smithi060.stdout:7/20: dwrite - no filename 2024-04-12T13:41:49.023 INFO:tasks.workunit.client.0.smithi060.stdout:6/58: write d1/d7/fd [733807,47365] 0 2024-04-12T13:41:49.027 INFO:tasks.workunit.client.1.smithi110.stdout:4/53: fdatasync d0/fc 0 2024-04-12T13:41:49.028 INFO:tasks.workunit.client.0.smithi060.stdout:6/59: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:49.029 INFO:tasks.workunit.client.0.smithi060.stdout:1/27: creat fb x:0 0 0 2024-04-12T13:41:49.032 INFO:tasks.workunit.client.0.smithi060.stdout:9/21: mknod d4/c7 0 2024-04-12T13:41:49.033 INFO:tasks.workunit.client.0.smithi060.stdout:6/60: write d1/d7/fd [3640756,61961] 0 2024-04-12T13:41:49.037 INFO:tasks.workunit.client.0.smithi060.stdout:5/16: mknod c4 0 2024-04-12T13:41:49.037 INFO:tasks.workunit.client.1.smithi110.stdout:4/54: write d0/f4 [953079,24070] 0 2024-04-12T13:41:49.038 INFO:tasks.workunit.client.1.smithi110.stdout:9/55: rename df to df/d12 22 2024-04-12T13:41:49.038 INFO:tasks.workunit.client.0.smithi060.stdout:8/28: getdents . 0 2024-04-12T13:41:49.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/17: readlink l3 0 2024-04-12T13:41:49.039 INFO:tasks.workunit.client.0.smithi060.stdout:8/29: readlink l5 0 2024-04-12T13:41:49.040 INFO:tasks.workunit.client.0.smithi060.stdout:5/18: chown l3 9029 1 2024-04-12T13:41:49.040 INFO:tasks.workunit.client.0.smithi060.stdout:6/61: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:49.041 INFO:tasks.workunit.client.0.smithi060.stdout:5/19: chown f1 6901 1 2024-04-12T13:41:49.042 INFO:tasks.workunit.client.0.smithi060.stdout:6/62: fdatasync d1/f11 0 2024-04-12T13:41:49.043 INFO:tasks.workunit.client.1.smithi110.stdout:4/55: write d0/f4 [801753,33787] 0 2024-04-12T13:41:49.045 INFO:tasks.workunit.client.1.smithi110.stdout:6/56: symlink d7/d10/d12/l13 0 2024-04-12T13:41:49.046 INFO:tasks.workunit.client.0.smithi060.stdout:3/41: chown d7/da/lb 121 1 2024-04-12T13:41:49.046 INFO:tasks.workunit.client.1.smithi110.stdout:4/56: fsync d0/fb 0 2024-04-12T13:41:49.049 INFO:tasks.workunit.client.1.smithi110.stdout:9/56: mkdir df/d13 0 2024-04-12T13:41:49.050 INFO:tasks.workunit.client.1.smithi110.stdout:9/57: fdatasync f7 0 2024-04-12T13:41:49.051 INFO:tasks.workunit.client.0.smithi060.stdout:2/18: creat f5 x:0 0 0 2024-04-12T13:41:49.052 INFO:tasks.workunit.client.1.smithi110.stdout:9/58: rename df to df/d13/d14 22 2024-04-12T13:41:49.052 INFO:tasks.workunit.client.1.smithi110.stdout:6/57: mknod d7/d10/d12/c14 0 2024-04-12T13:41:49.056 INFO:tasks.workunit.client.0.smithi060.stdout:0/84: rename d7/l8 to d7/d9/de/l20 0 2024-04-12T13:41:49.057 INFO:tasks.workunit.client.1.smithi110.stdout:4/57: getdents d0/de 0 2024-04-12T13:41:49.063 INFO:tasks.workunit.client.0.smithi060.stdout:0/85: dread d7/fd [0,4194304] 0 2024-04-12T13:41:49.063 INFO:tasks.workunit.client.0.smithi060.stdout:9/22: mkdir d4/d8 0 2024-04-12T13:41:49.064 INFO:tasks.workunit.client.0.smithi060.stdout:9/23: fsync f2 0 2024-04-12T13:41:49.064 INFO:tasks.workunit.client.0.smithi060.stdout:8/30: mkdir d9 0 2024-04-12T13:41:49.065 INFO:tasks.workunit.client.0.smithi060.stdout:9/24: write f2 [5715879,34128] 0 2024-04-12T13:41:49.067 INFO:tasks.workunit.client.0.smithi060.stdout:5/20: mknod c5 0 2024-04-12T13:41:49.069 INFO:tasks.workunit.client.0.smithi060.stdout:6/63: symlink d1/l13 0 2024-04-12T13:41:49.071 INFO:tasks.workunit.client.0.smithi060.stdout:3/42: mkdir d7/da/dd 0 2024-04-12T13:41:49.072 INFO:tasks.workunit.client.0.smithi060.stdout:6/64: write d1/d7/fd [1691495,122182] 0 2024-04-12T13:41:49.073 INFO:tasks.workunit.client.0.smithi060.stdout:3/43: truncate f0 4566532 0 2024-04-12T13:41:49.074 INFO:tasks.workunit.client.0.smithi060.stdout:2/19: chown c1 3 1 2024-04-12T13:41:49.074 INFO:tasks.workunit.client.1.smithi110.stdout:6/58: dwrite d7/fd [4194304,4194304] 0 2024-04-12T13:41:49.074 INFO:tasks.workunit.client.1.smithi110.stdout:9/59: dwrite fd [0,4194304] 0 2024-04-12T13:41:49.077 INFO:tasks.workunit.client.0.smithi060.stdout:7/21: symlink d0/l5 0 2024-04-12T13:41:49.077 INFO:tasks.workunit.client.0.smithi060.stdout:7/22: dwrite - no filename 2024-04-12T13:41:49.077 INFO:tasks.workunit.client.0.smithi060.stdout:7/23: dwrite - no filename 2024-04-12T13:41:49.085 INFO:tasks.workunit.client.1.smithi110.stdout:4/58: dwrite d0/fb [0,4194304] 0 2024-04-12T13:41:49.085 INFO:tasks.workunit.client.0.smithi060.stdout:1/28: unlink l5 0 2024-04-12T13:41:49.087 INFO:tasks.workunit.client.1.smithi110.stdout:9/60: mknod df/c15 0 2024-04-12T13:41:49.087 INFO:tasks.workunit.client.0.smithi060.stdout:9/25: dwrite f2 [4194304,4194304] 0 2024-04-12T13:41:49.089 INFO:tasks.workunit.client.0.smithi060.stdout:0/86: creat d7/d9/f21 x:0 0 0 2024-04-12T13:41:49.091 INFO:tasks.workunit.client.1.smithi110.stdout:6/59: rename d7/d10/d12/l13 to d7/d10/l15 0 2024-04-12T13:41:49.093 INFO:tasks.workunit.client.1.smithi110.stdout:6/60: write d7/fd [5297834,8801] 0 2024-04-12T13:41:49.103 INFO:tasks.workunit.client.1.smithi110.stdout:6/61: symlink d7/d10/l16 0 2024-04-12T13:41:49.105 INFO:tasks.workunit.client.1.smithi110.stdout:4/59: dwrite d0/f5 [0,4194304] 0 2024-04-12T13:41:49.105 INFO:tasks.workunit.client.0.smithi060.stdout:3/44: rename d7/f9 to d7/fe 0 2024-04-12T13:41:49.107 INFO:tasks.workunit.client.1.smithi110.stdout:4/60: read d0/f5 [1621845,57750] 0 2024-04-12T13:41:49.108 INFO:tasks.workunit.client.1.smithi110.stdout:9/61: dwrite fd [0,4194304] 0 2024-04-12T13:41:49.112 INFO:tasks.workunit.client.0.smithi060.stdout:1/29: symlink lc 0 2024-04-12T13:41:49.114 INFO:tasks.workunit.client.0.smithi060.stdout:8/31: mkdir d9/da 0 2024-04-12T13:41:49.114 INFO:tasks.workunit.client.0.smithi060.stdout:9/26: mkdir d4/d9 0 2024-04-12T13:41:49.120 INFO:tasks.workunit.client.1.smithi110.stdout:9/62: mknod df/c16 0 2024-04-12T13:41:49.123 INFO:tasks.workunit.client.1.smithi110.stdout:9/63: chown f7 3970040 1 2024-04-12T13:41:49.124 INFO:tasks.workunit.client.0.smithi060.stdout:3/45: dread d7/fe [0,4194304] 0 2024-04-12T13:41:49.125 INFO:tasks.workunit.client.0.smithi060.stdout:7/24: creat d0/d1/f6 x:0 0 0 2024-04-12T13:41:49.128 INFO:tasks.workunit.client.0.smithi060.stdout:3/46: truncate d7/f8 5210449 0 2024-04-12T13:41:49.129 INFO:tasks.workunit.client.0.smithi060.stdout:0/87: symlink d7/d9/d14/d1b/l22 0 2024-04-12T13:41:49.131 INFO:tasks.workunit.client.1.smithi110.stdout:9/64: creat df/f17 x:0 0 0 2024-04-12T13:41:49.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/32: unlink l5 0 2024-04-12T13:41:49.134 INFO:tasks.workunit.client.1.smithi110.stdout:4/61: dwrite d0/fc [0,4194304] 0 2024-04-12T13:41:49.138 INFO:tasks.workunit.client.1.smithi110.stdout:4/62: chown d0/fc 52314 1 2024-04-12T13:41:49.139 INFO:tasks.workunit.client.0.smithi060.stdout:1/30: dwrite f3 [0,4194304] 0 2024-04-12T13:41:49.143 INFO:tasks.workunit.client.1.smithi110.stdout:4/63: write d0/ff [128830,119969] 0 2024-04-12T13:41:49.145 INFO:tasks.workunit.client.0.smithi060.stdout:0/88: creat d7/d9/f23 x:0 0 0 2024-04-12T13:41:49.145 INFO:tasks.workunit.client.0.smithi060.stdout:9/27: creat d4/d8/fa x:0 0 0 2024-04-12T13:41:49.149 INFO:tasks.workunit.client.0.smithi060.stdout:2/20: getdents . 0 2024-04-12T13:41:49.150 INFO:tasks.workunit.client.0.smithi060.stdout:6/65: getdents d1/d7 0 2024-04-12T13:41:49.151 INFO:tasks.workunit.client.1.smithi110.stdout:9/65: dwrite f7 [0,4194304] 0 2024-04-12T13:41:49.156 INFO:tasks.workunit.client.0.smithi060.stdout:6/66: chown d1/l10 12186700 1 2024-04-12T13:41:49.157 INFO:tasks.workunit.client.0.smithi060.stdout:1/31: mknod cd 0 2024-04-12T13:41:49.159 INFO:tasks.workunit.client.1.smithi110.stdout:4/64: symlink d0/de/l12 0 2024-04-12T13:41:49.164 INFO:tasks.workunit.client.0.smithi060.stdout:0/89: creat d7/d9/d14/f24 x:0 0 0 2024-04-12T13:41:49.165 INFO:tasks.workunit.client.1.smithi110.stdout:9/66: mknod df/d13/c18 0 2024-04-12T13:41:49.168 INFO:tasks.workunit.client.0.smithi060.stdout:8/33: dwrite f1 [4194304,4194304] 0 2024-04-12T13:41:49.169 INFO:tasks.workunit.client.1.smithi110.stdout:4/65: mkdir d0/d13 0 2024-04-12T13:41:49.173 INFO:tasks.workunit.client.0.smithi060.stdout:6/67: creat d1/f14 x:0 0 0 2024-04-12T13:41:49.173 INFO:tasks.workunit.client.0.smithi060.stdout:8/34: write f1 [6557501,107597] 0 2024-04-12T13:41:49.174 INFO:tasks.workunit.client.1.smithi110.stdout:9/67: creat df/f19 x:0 0 0 2024-04-12T13:41:49.174 INFO:tasks.workunit.client.1.smithi110.stdout:9/68: fdatasync fb 0 2024-04-12T13:41:49.177 INFO:tasks.workunit.client.0.smithi060.stdout:8/35: read - f4 zero size 2024-04-12T13:41:49.177 INFO:tasks.workunit.client.1.smithi110.stdout:4/66: readlink d0/l10 0 2024-04-12T13:41:49.179 INFO:tasks.workunit.client.0.smithi060.stdout:2/21: dread f3 [0,4194304] 0 2024-04-12T13:41:49.181 INFO:tasks.workunit.client.0.smithi060.stdout:8/36: chown f1 13 1 2024-04-12T13:41:49.186 INFO:tasks.workunit.client.1.smithi110.stdout:4/67: mknod d0/de/c14 0 2024-04-12T13:41:49.188 INFO:tasks.workunit.client.1.smithi110.stdout:4/68: truncate d0/ff 280762 0 2024-04-12T13:41:49.189 INFO:tasks.workunit.client.0.smithi060.stdout:1/32: dwrite fb [0,4194304] 0 2024-04-12T13:41:49.196 INFO:tasks.workunit.client.1.smithi110.stdout:4/69: write d0/f5 [2137372,86672] 0 2024-04-12T13:41:49.198 INFO:tasks.workunit.client.0.smithi060.stdout:6/68: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:49.199 INFO:tasks.workunit.client.0.smithi060.stdout:7/25: rename d0/d1 to d0/d7 0 2024-04-12T13:41:49.204 INFO:tasks.workunit.client.1.smithi110.stdout:4/70: creat d0/f15 x:0 0 0 2024-04-12T13:41:49.204 INFO:tasks.workunit.client.0.smithi060.stdout:2/22: mkdir d6 0 2024-04-12T13:41:49.204 INFO:tasks.workunit.client.1.smithi110.stdout:4/71: chown d0 216 1 2024-04-12T13:41:49.206 INFO:tasks.workunit.client.0.smithi060.stdout:8/37: creat d9/fb x:0 0 0 2024-04-12T13:41:49.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/21: sync 2024-04-12T13:41:49.207 INFO:tasks.workunit.client.0.smithi060.stdout:4/40: sync 2024-04-12T13:41:49.207 INFO:tasks.workunit.client.1.smithi110.stdout:6/62: link d7/d10/l15 d7/d10/d12/l17 0 2024-04-12T13:41:49.210 INFO:tasks.workunit.client.1.smithi110.stdout:4/72: chown d0/l11 102 1 2024-04-12T13:41:49.210 INFO:tasks.workunit.client.1.smithi110.stdout:4/73: fdatasync d0/ff 0 2024-04-12T13:41:49.211 INFO:tasks.workunit.client.1.smithi110.stdout:6/63: mknod d7/d10/d12/c18 0 2024-04-12T13:41:49.213 INFO:tasks.workunit.client.0.smithi060.stdout:0/90: dwrite d7/f11 [4194304,4194304] 0 2024-04-12T13:41:49.213 INFO:tasks.workunit.client.0.smithi060.stdout:3/47: truncate f0 405325 0 2024-04-12T13:41:49.218 INFO:tasks.workunit.client.0.smithi060.stdout:2/23: write f3 [612218,70499] 0 2024-04-12T13:41:49.220 INFO:tasks.workunit.client.0.smithi060.stdout:2/24: write f3 [2356784,24072] 0 2024-04-12T13:41:49.225 INFO:tasks.workunit.client.1.smithi110.stdout:6/64: dread d7/fd [4194304,4194304] 0 2024-04-12T13:41:49.228 INFO:tasks.workunit.client.1.smithi110.stdout:9/69: write f3 [461542,42184] 0 2024-04-12T13:41:49.229 INFO:tasks.workunit.client.1.smithi110.stdout:4/74: link d0/l6 d0/l16 0 2024-04-12T13:41:49.240 INFO:tasks.workunit.client.1.smithi110.stdout:4/75: dread d0/f5 [0,4194304] 0 2024-04-12T13:41:49.244 INFO:tasks.workunit.client.1.smithi110.stdout:9/70: truncate fb 3444215 0 2024-04-12T13:41:49.247 INFO:tasks.workunit.client.1.smithi110.stdout:6/65: creat d7/f19 x:0 0 0 2024-04-12T13:41:49.249 INFO:tasks.workunit.client.1.smithi110.stdout:4/76: mkdir d0/d17 0 2024-04-12T13:41:49.249 INFO:tasks.workunit.client.1.smithi110.stdout:4/77: chown d0/ff 233016991 1 2024-04-12T13:41:49.251 INFO:tasks.workunit.client.1.smithi110.stdout:4/78: chown d0/f5 24 1 2024-04-12T13:41:49.253 INFO:tasks.workunit.client.1.smithi110.stdout:6/66: getdents d7/d10 0 2024-04-12T13:41:49.254 INFO:tasks.workunit.client.1.smithi110.stdout:4/79: creat d0/d17/f18 x:0 0 0 2024-04-12T13:41:49.258 INFO:tasks.workunit.client.1.smithi110.stdout:4/80: mkdir d0/d19 0 2024-04-12T13:41:49.259 INFO:tasks.workunit.client.1.smithi110.stdout:6/67: creat d7/f1a x:0 0 0 2024-04-12T13:41:49.261 INFO:tasks.workunit.client.0.smithi060.stdout:5/22: mkdir d6 0 2024-04-12T13:41:49.262 INFO:tasks.workunit.client.0.smithi060.stdout:9/28: truncate f2 4602533 0 2024-04-12T13:41:49.262 INFO:tasks.workunit.client.0.smithi060.stdout:5/23: stat l3 0 2024-04-12T13:41:49.263 INFO:tasks.workunit.client.1.smithi110.stdout:9/71: dwrite f3 [0,4194304] 0 2024-04-12T13:41:49.263 INFO:tasks.workunit.client.1.smithi110.stdout:6/68: mknod d7/d10/c1b 0 2024-04-12T13:41:49.263 INFO:tasks.workunit.client.0.smithi060.stdout:0/91: creat d7/d9/d14/f25 x:0 0 0 2024-04-12T13:41:49.265 INFO:tasks.workunit.client.0.smithi060.stdout:4/41: dread f2 [0,4194304] 0 2024-04-12T13:41:49.265 INFO:tasks.workunit.client.0.smithi060.stdout:7/26: creat d0/f8 x:0 0 0 2024-04-12T13:41:49.269 INFO:tasks.workunit.client.1.smithi110.stdout:9/72: symlink df/l1a 0 2024-04-12T13:41:49.271 INFO:tasks.workunit.client.1.smithi110.stdout:9/73: dread - df/f17 zero size 2024-04-12T13:41:49.274 INFO:tasks.workunit.client.1.smithi110.stdout:6/69: mkdir d7/d10/d1c 0 2024-04-12T13:41:49.274 INFO:tasks.workunit.client.0.smithi060.stdout:5/24: dread f1 [0,4194304] 0 2024-04-12T13:41:49.275 INFO:tasks.workunit.client.0.smithi060.stdout:5/25: readlink l3 0 2024-04-12T13:41:49.275 INFO:tasks.workunit.client.1.smithi110.stdout:9/74: write fd [613642,57214] 0 2024-04-12T13:41:49.279 INFO:tasks.workunit.client.0.smithi060.stdout:6/69: getdents d1/d7/da 0 2024-04-12T13:41:49.280 INFO:tasks.workunit.client.1.smithi110.stdout:4/81: dwrite d0/f4 [0,4194304] 0 2024-04-12T13:41:49.285 INFO:tasks.workunit.client.1.smithi110.stdout:6/70: creat d7/d10/d12/f1d x:0 0 0 2024-04-12T13:41:49.285 INFO:tasks.workunit.client.1.smithi110.stdout:9/75: creat df/d13/f1b x:0 0 0 2024-04-12T13:41:49.285 INFO:tasks.workunit.client.0.smithi060.stdout:3/48: link l6 d7/da/dd/lf 0 2024-04-12T13:41:49.286 INFO:tasks.workunit.client.0.smithi060.stdout:4/42: write f2 [372409,29183] 0 2024-04-12T13:41:49.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/71: read - d7/f19 zero size 2024-04-12T13:41:49.287 INFO:tasks.workunit.client.0.smithi060.stdout:7/27: dwrite d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.287 INFO:tasks.workunit.client.0.smithi060.stdout:1/33: link c6 ce 0 2024-04-12T13:41:49.289 INFO:tasks.workunit.client.0.smithi060.stdout:3/49: read d7/f8 [2832729,92729] 0 2024-04-12T13:41:49.289 INFO:tasks.workunit.client.1.smithi110.stdout:4/82: rename d0/de/c14 to d0/d17/c1a 0 2024-04-12T13:41:49.295 INFO:tasks.workunit.client.0.smithi060.stdout:2/25: truncate f4 2301902 0 2024-04-12T13:41:49.295 INFO:tasks.workunit.client.0.smithi060.stdout:5/26: write f2 [362167,113572] 0 2024-04-12T13:41:49.296 INFO:tasks.workunit.client.1.smithi110.stdout:6/72: creat d7/d10/d12/f1e x:0 0 0 2024-04-12T13:41:49.299 INFO:tasks.workunit.client.1.smithi110.stdout:9/76: dread f7 [0,4194304] 0 2024-04-12T13:41:49.299 INFO:tasks.workunit.client.1.smithi110.stdout:6/73: write d7/f19 [507356,60320] 0 2024-04-12T13:41:49.302 INFO:tasks.workunit.client.0.smithi060.stdout:6/70: creat d1/f15 x:0 0 0 2024-04-12T13:41:49.302 INFO:tasks.workunit.client.1.smithi110.stdout:9/77: chown df/d13/c18 42582674 1 2024-04-12T13:41:49.302 INFO:tasks.workunit.client.1.smithi110.stdout:4/83: dread d0/fc [0,4194304] 0 2024-04-12T13:41:49.310 INFO:tasks.workunit.client.1.smithi110.stdout:9/78: creat df/d13/f1c x:0 0 0 2024-04-12T13:41:49.311 INFO:tasks.workunit.client.1.smithi110.stdout:9/79: chown df 70410 1 2024-04-12T13:41:49.314 INFO:tasks.workunit.client.1.smithi110.stdout:4/84: symlink d0/d17/l1b 0 2024-04-12T13:41:49.316 INFO:tasks.workunit.client.1.smithi110.stdout:4/85: dread - d0/d17/f18 zero size 2024-04-12T13:41:49.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/92: dwrite d7/fd [0,4194304] 0 2024-04-12T13:41:49.317 INFO:tasks.workunit.client.0.smithi060.stdout:3/50: rename d7/fe to d7/f10 0 2024-04-12T13:41:49.319 INFO:tasks.workunit.client.1.smithi110.stdout:9/80: mkdir df/d1d 0 2024-04-12T13:41:49.322 INFO:tasks.workunit.client.1.smithi110.stdout:9/81: read fd [3607287,70826] 0 2024-04-12T13:41:49.324 INFO:tasks.workunit.client.1.smithi110.stdout:6/74: dwrite d7/f1a [0,4194304] 0 2024-04-12T13:41:49.324 INFO:tasks.workunit.client.1.smithi110.stdout:4/86: mkdir d0/d19/d1c 0 2024-04-12T13:41:49.325 INFO:tasks.workunit.client.1.smithi110.stdout:9/82: stat df/d13/f1c 0 2024-04-12T13:41:49.325 INFO:tasks.workunit.client.0.smithi060.stdout:6/71: dread d1/d7/fd [0,4194304] 0 2024-04-12T13:41:49.325 INFO:tasks.workunit.client.0.smithi060.stdout:4/43: mknod d6/d7/dd/df/c10 0 2024-04-12T13:41:49.326 INFO:tasks.workunit.client.1.smithi110.stdout:6/75: chown d7/d10 1240 1 2024-04-12T13:41:49.328 INFO:tasks.workunit.client.1.smithi110.stdout:6/76: chown d7/d10/d12/f1d 13853761 1 2024-04-12T13:41:49.332 INFO:tasks.workunit.client.0.smithi060.stdout:4/44: rename d6 to d6/d7/db/d11 22 2024-04-12T13:41:49.333 INFO:tasks.workunit.client.0.smithi060.stdout:5/27: creat d6/f7 x:0 0 0 2024-04-12T13:41:49.337 INFO:tasks.workunit.client.0.smithi060.stdout:6/72: mkdir d1/d16 0 2024-04-12T13:41:49.339 INFO:tasks.workunit.client.0.smithi060.stdout:9/29: dwrite f2 [0,4194304] 0 2024-04-12T13:41:49.342 INFO:tasks.workunit.client.0.smithi060.stdout:9/30: fsync d4/d8/fa 0 2024-04-12T13:41:49.343 INFO:tasks.workunit.client.0.smithi060.stdout:3/51: dread d7/f10 [0,4194304] 0 2024-04-12T13:41:49.344 INFO:tasks.workunit.client.0.smithi060.stdout:9/31: read f2 [2770273,41249] 0 2024-04-12T13:41:49.346 INFO:tasks.workunit.client.0.smithi060.stdout:5/28: fsync d6/f7 0 2024-04-12T13:41:49.350 INFO:tasks.workunit.client.0.smithi060.stdout:4/45: dread f4 [0,4194304] 0 2024-04-12T13:41:49.350 INFO:tasks.workunit.client.1.smithi110.stdout:9/83: rmdir df/d1d 0 2024-04-12T13:41:49.350 INFO:tasks.workunit.client.0.smithi060.stdout:2/26: fsync f4 0 2024-04-12T13:41:49.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/28: getdents d0/d7 0 2024-04-12T13:41:49.354 INFO:tasks.workunit.client.0.smithi060.stdout:6/73: fdatasync d1/d7/da/ff 0 2024-04-12T13:41:49.357 INFO:tasks.workunit.client.0.smithi060.stdout:6/74: read - d1/f15 zero size 2024-04-12T13:41:49.357 INFO:tasks.workunit.client.1.smithi110.stdout:6/77: getdents d7/d10/d12 0 2024-04-12T13:41:49.360 INFO:tasks.workunit.client.0.smithi060.stdout:3/52: rename d7/da/lb to d7/l11 0 2024-04-12T13:41:49.361 INFO:tasks.workunit.client.1.smithi110.stdout:4/87: truncate d0/fb 824304 0 2024-04-12T13:41:49.363 INFO:tasks.workunit.client.0.smithi060.stdout:0/93: truncate d7/fd 2063509 0 2024-04-12T13:41:49.366 INFO:tasks.workunit.client.1.smithi110.stdout:6/78: dread d7/fd [4194304,4194304] 0 2024-04-12T13:41:49.367 INFO:tasks.workunit.client.0.smithi060.stdout:0/94: dread - d7/d9/f1e zero size 2024-04-12T13:41:49.367 INFO:tasks.workunit.client.1.smithi110.stdout:6/79: dread - d7/d10/d12/f1d zero size 2024-04-12T13:41:49.368 INFO:tasks.workunit.client.0.smithi060.stdout:4/46: creat d6/d7/dd/df/f12 x:0 0 0 2024-04-12T13:41:49.368 INFO:tasks.workunit.client.0.smithi060.stdout:7/29: rmdir d0/d7 39 2024-04-12T13:41:49.369 INFO:tasks.workunit.client.1.smithi110.stdout:6/80: dread - d7/d10/d12/f1d zero size 2024-04-12T13:41:49.369 INFO:tasks.workunit.client.0.smithi060.stdout:2/27: write f4 [3202691,36606] 0 2024-04-12T13:41:49.369 INFO:tasks.workunit.client.0.smithi060.stdout:2/28: readlink - no filename 2024-04-12T13:41:49.370 INFO:tasks.workunit.client.0.smithi060.stdout:5/29: dwrite f1 [0,4194304] 0 2024-04-12T13:41:49.372 INFO:tasks.workunit.client.0.smithi060.stdout:6/75: mknod d1/d7/da/c17 0 2024-04-12T13:41:49.377 INFO:tasks.workunit.client.0.smithi060.stdout:3/53: dread f0 [0,4194304] 0 2024-04-12T13:41:49.377 INFO:tasks.workunit.client.1.smithi110.stdout:6/81: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:49.378 INFO:tasks.workunit.client.0.smithi060.stdout:0/95: creat d7/f26 x:0 0 0 2024-04-12T13:41:49.386 INFO:tasks.workunit.client.1.smithi110.stdout:6/82: rename d7/fd to d7/d10/d12/f1f 0 2024-04-12T13:41:49.386 INFO:tasks.workunit.client.1.smithi110.stdout:4/88: write d0/fb [1665113,13458] 0 2024-04-12T13:41:49.386 INFO:tasks.workunit.client.1.smithi110.stdout:6/83: readlink l5 0 2024-04-12T13:41:49.388 INFO:tasks.workunit.client.1.smithi110.stdout:4/89: write d0/ff [477675,130341] 0 2024-04-12T13:41:49.390 INFO:tasks.workunit.client.1.smithi110.stdout:6/84: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:49.392 INFO:tasks.workunit.client.0.smithi060.stdout:5/30: creat d6/f8 x:0 0 0 2024-04-12T13:41:49.396 INFO:tasks.workunit.client.1.smithi110.stdout:4/90: getdents d0/d19/d1c 0 2024-04-12T13:41:49.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/31: write d6/f8 [964447,85147] 0 2024-04-12T13:41:49.401 INFO:tasks.workunit.client.1.smithi110.stdout:4/91: rmdir d0/d19 39 2024-04-12T13:41:49.402 INFO:tasks.workunit.client.0.smithi060.stdout:4/47: dwrite f2 [0,4194304] 0 2024-04-12T13:41:49.404 INFO:tasks.workunit.client.0.smithi060.stdout:6/76: rename d1/c9 to d1/d16/c18 0 2024-04-12T13:41:49.407 INFO:tasks.workunit.client.1.smithi110.stdout:6/85: dwrite d7/f19 [0,4194304] 0 2024-04-12T13:41:49.409 INFO:tasks.workunit.client.1.smithi110.stdout:4/92: symlink d0/d19/l1d 0 2024-04-12T13:41:49.410 INFO:tasks.workunit.client.1.smithi110.stdout:6/86: creat d7/d10/f20 x:0 0 0 2024-04-12T13:41:49.411 INFO:tasks.workunit.client.1.smithi110.stdout:4/93: getdents d0/d19/d1c 0 2024-04-12T13:41:49.412 INFO:tasks.workunit.client.0.smithi060.stdout:5/32: creat d6/f9 x:0 0 0 2024-04-12T13:41:49.412 INFO:tasks.workunit.client.0.smithi060.stdout:4/48: rmdir d6 39 2024-04-12T13:41:49.412 INFO:tasks.workunit.client.1.smithi110.stdout:4/94: readlink d0/l8 0 2024-04-12T13:41:49.414 INFO:tasks.workunit.client.1.smithi110.stdout:6/87: creat d7/d10/d12/f21 x:0 0 0 2024-04-12T13:41:49.416 INFO:tasks.workunit.client.0.smithi060.stdout:6/77: fsync d1/d7/fd 0 2024-04-12T13:41:49.418 INFO:tasks.workunit.client.0.smithi060.stdout:4/49: unlink f4 0 2024-04-12T13:41:49.421 INFO:tasks.workunit.client.1.smithi110.stdout:4/95: write d0/f5 [3853242,126020] 0 2024-04-12T13:41:49.421 INFO:tasks.workunit.client.0.smithi060.stdout:5/33: fsync d6/f8 0 2024-04-12T13:41:49.423 INFO:tasks.workunit.client.1.smithi110.stdout:6/88: symlink d7/l22 0 2024-04-12T13:41:49.425 INFO:tasks.workunit.client.0.smithi060.stdout:5/34: rename d6 to d6/da 22 2024-04-12T13:41:49.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/50: read - d6/d7/dd/fe zero size 2024-04-12T13:41:49.435 INFO:tasks.workunit.client.0.smithi060.stdout:7/30: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.437 INFO:tasks.workunit.client.0.smithi060.stdout:3/54: dwrite d7/f10 [0,4194304] 0 2024-04-12T13:41:49.438 INFO:tasks.workunit.client.1.smithi110.stdout:6/89: rmdir d7 39 2024-04-12T13:41:49.438 INFO:tasks.workunit.client.0.smithi060.stdout:6/78: creat d1/d7/da/dc/f19 x:0 0 0 2024-04-12T13:41:49.438 INFO:tasks.workunit.client.1.smithi110.stdout:4/96: dwrite d0/fc [0,4194304] 0 2024-04-12T13:41:49.441 INFO:tasks.workunit.client.0.smithi060.stdout:6/79: chown d1/c5 163 1 2024-04-12T13:41:49.442 INFO:tasks.workunit.client.1.smithi110.stdout:4/97: mknod d0/de/c1e 0 2024-04-12T13:41:49.442 INFO:tasks.workunit.client.0.smithi060.stdout:0/96: dwrite d7/fd [0,4194304] 0 2024-04-12T13:41:49.442 INFO:tasks.workunit.client.1.smithi110.stdout:4/98: fdatasync d0/f4 0 2024-04-12T13:41:49.444 INFO:tasks.workunit.client.0.smithi060.stdout:0/97: fsync d7/d9/f17 0 2024-04-12T13:41:49.446 INFO:tasks.workunit.client.0.smithi060.stdout:0/98: fsync d7/d9/f17 0 2024-04-12T13:41:49.449 INFO:tasks.workunit.client.0.smithi060.stdout:0/99: chown d7 5861 1 2024-04-12T13:41:49.451 INFO:tasks.workunit.client.0.smithi060.stdout:5/35: dread f1 [0,4194304] 0 2024-04-12T13:41:49.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/36: write d6/f7 [613284,13474] 0 2024-04-12T13:41:49.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/31: dwrite d0/f8 [0,4194304] 0 2024-04-12T13:41:49.478 INFO:tasks.workunit.client.1.smithi110.stdout:4/99: dwrite d0/d17/f18 [0,4194304] 0 2024-04-12T13:41:49.480 INFO:tasks.workunit.client.1.smithi110.stdout:6/90: dwrite d7/d10/d12/f21 [0,4194304] 0 2024-04-12T13:41:49.489 INFO:tasks.workunit.client.0.smithi060.stdout:0/100: rename d7/l10 to d7/d9/d14/d1b/l27 0 2024-04-12T13:41:49.489 INFO:tasks.workunit.client.0.smithi060.stdout:6/80: write d1/d7/da/ff [240512,93116] 0 2024-04-12T13:41:49.491 INFO:tasks.workunit.client.0.smithi060.stdout:5/37: symlink d6/lb 0 2024-04-12T13:41:49.495 INFO:tasks.workunit.client.0.smithi060.stdout:5/38: write d6/f7 [793679,116521] 0 2024-04-12T13:41:49.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/32: symlink d0/d7/l9 0 2024-04-12T13:41:49.499 INFO:tasks.workunit.client.1.smithi110.stdout:6/91: chown d7/ce 0 1 2024-04-12T13:41:49.500 INFO:tasks.workunit.client.0.smithi060.stdout:7/33: chown d0/d7 901692 1 2024-04-12T13:41:49.502 INFO:tasks.workunit.client.1.smithi110.stdout:6/92: stat d7/d10/d12/f1f 0 2024-04-12T13:41:49.503 INFO:tasks.workunit.client.0.smithi060.stdout:6/81: mknod d1/d7/da/c1a 0 2024-04-12T13:41:49.506 INFO:tasks.workunit.client.1.smithi110.stdout:6/93: dread - d7/d10/d12/f1e zero size 2024-04-12T13:41:49.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/82: creat d1/d7/da/dc/f1b x:0 0 0 2024-04-12T13:41:49.510 INFO:tasks.workunit.client.0.smithi060.stdout:7/34: chown d0/c3 484315 1 2024-04-12T13:41:49.511 INFO:tasks.workunit.client.1.smithi110.stdout:4/100: link d0/ld d0/d19/d1c/l1f 0 2024-04-12T13:41:49.516 INFO:tasks.workunit.client.1.smithi110.stdout:4/101: creat d0/d19/f20 x:0 0 0 2024-04-12T13:41:49.516 INFO:tasks.workunit.client.0.smithi060.stdout:7/35: fsync d0/d7/f6 0 2024-04-12T13:41:49.521 INFO:tasks.workunit.client.1.smithi110.stdout:4/102: creat d0/d13/f21 x:0 0 0 2024-04-12T13:41:49.523 INFO:tasks.workunit.client.1.smithi110.stdout:4/103: dread - d0/d13/f21 zero size 2024-04-12T13:41:49.524 INFO:tasks.workunit.client.0.smithi060.stdout:7/36: mknod d0/ca 0 2024-04-12T13:41:49.526 INFO:tasks.workunit.client.1.smithi110.stdout:4/104: truncate d0/d19/f20 759818 0 2024-04-12T13:41:49.527 INFO:tasks.workunit.client.0.smithi060.stdout:5/39: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:41:49.529 INFO:tasks.workunit.client.1.smithi110.stdout:4/105: write d0/f5 [1904411,34402] 0 2024-04-12T13:41:49.531 INFO:tasks.workunit.client.0.smithi060.stdout:7/37: rename d0 to d0/db 22 2024-04-12T13:41:49.531 INFO:tasks.workunit.client.0.smithi060.stdout:3/55: dwrite d7/f8 [4194304,4194304] 0 2024-04-12T13:41:49.536 INFO:tasks.workunit.client.0.smithi060.stdout:3/56: chown f0 0 1 2024-04-12T13:41:49.537 INFO:tasks.workunit.client.0.smithi060.stdout:5/40: write d6/f7 [682462,16419] 0 2024-04-12T13:41:49.539 INFO:tasks.workunit.client.0.smithi060.stdout:3/57: stat d7/lc 0 2024-04-12T13:41:49.543 INFO:tasks.workunit.client.0.smithi060.stdout:5/41: write d6/f7 [974869,49928] 0 2024-04-12T13:41:49.543 INFO:tasks.workunit.client.1.smithi110.stdout:4/106: dread d0/f4 [0,4194304] 0 2024-04-12T13:41:49.550 INFO:tasks.workunit.client.0.smithi060.stdout:5/42: creat d6/fc x:0 0 0 2024-04-12T13:41:49.552 INFO:tasks.workunit.client.1.smithi110.stdout:4/107: dread d0/fb [0,4194304] 0 2024-04-12T13:41:49.552 INFO:tasks.workunit.client.0.smithi060.stdout:8/38: sync 2024-04-12T13:41:49.553 INFO:tasks.workunit.client.1.smithi110.stdout:4/108: fdatasync d0/ff 0 2024-04-12T13:41:49.554 INFO:tasks.workunit.client.1.smithi110.stdout:4/109: fsync d0/d19/f20 0 2024-04-12T13:41:49.555 INFO:tasks.workunit.client.0.smithi060.stdout:5/43: mkdir d6/dd 0 2024-04-12T13:41:49.555 INFO:tasks.workunit.client.0.smithi060.stdout:6/83: dwrite d1/d7/da/dc/f1b [0,4194304] 0 2024-04-12T13:41:49.556 INFO:tasks.workunit.client.0.smithi060.stdout:6/84: readlink d1/l13 0 2024-04-12T13:41:49.557 INFO:tasks.workunit.client.0.smithi060.stdout:8/39: rename f4 to d9/fc 0 2024-04-12T13:41:49.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/44: symlink d6/le 0 2024-04-12T13:41:49.559 INFO:tasks.workunit.client.0.smithi060.stdout:8/40: chown d9/da 299608768 1 2024-04-12T13:41:49.560 INFO:tasks.workunit.client.0.smithi060.stdout:7/38: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.560 INFO:tasks.workunit.client.0.smithi060.stdout:5/45: chown d6 28429522 1 2024-04-12T13:41:49.563 INFO:tasks.workunit.client.0.smithi060.stdout:6/85: write d1/d7/da/dc/f19 [253598,114323] 0 2024-04-12T13:41:49.563 INFO:tasks.workunit.client.0.smithi060.stdout:5/46: write d6/f8 [280109,24196] 0 2024-04-12T13:41:49.565 INFO:tasks.workunit.client.0.smithi060.stdout:6/86: fsync d1/d7/fd 0 2024-04-12T13:41:49.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/39: write d0/d7/f6 [523442,87307] 0 2024-04-12T13:41:49.566 INFO:tasks.workunit.client.0.smithi060.stdout:5/47: unlink l3 0 2024-04-12T13:41:49.568 INFO:tasks.workunit.client.0.smithi060.stdout:6/87: symlink d1/d7/l1c 0 2024-04-12T13:41:49.569 INFO:tasks.workunit.client.0.smithi060.stdout:7/40: chown d0/c3 15 1 2024-04-12T13:41:49.570 INFO:tasks.workunit.client.0.smithi060.stdout:5/48: chown d6/dd 320701 1 2024-04-12T13:41:49.571 INFO:tasks.workunit.client.0.smithi060.stdout:5/49: truncate f2 5024463 0 2024-04-12T13:41:49.572 INFO:tasks.workunit.client.0.smithi060.stdout:6/88: rmdir d1/d7/da 39 2024-04-12T13:41:49.573 INFO:tasks.workunit.client.0.smithi060.stdout:7/41: symlink d0/d7/lc 0 2024-04-12T13:41:49.575 INFO:tasks.workunit.client.0.smithi060.stdout:5/50: unlink d6/lb 0 2024-04-12T13:41:49.576 INFO:tasks.workunit.client.1.smithi110.stdout:4/110: truncate d0/fc 672787 0 2024-04-12T13:41:49.577 INFO:tasks.workunit.client.0.smithi060.stdout:6/89: fdatasync d1/d7/da/ff 0 2024-04-12T13:41:49.579 INFO:tasks.workunit.client.0.smithi060.stdout:7/42: creat d0/d7/fd x:0 0 0 2024-04-12T13:41:49.580 INFO:tasks.workunit.client.0.smithi060.stdout:8/41: truncate f1 1604567 0 2024-04-12T13:41:49.581 INFO:tasks.workunit.client.0.smithi060.stdout:5/51: rename c5 to d6/dd/cf 0 2024-04-12T13:41:49.582 INFO:tasks.workunit.client.1.smithi110.stdout:4/111: readlink d0/ld 0 2024-04-12T13:41:49.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/42: rename c8 to d9/cd 0 2024-04-12T13:41:49.585 INFO:tasks.workunit.client.0.smithi060.stdout:5/52: mkdir d6/d10 0 2024-04-12T13:41:49.586 INFO:tasks.workunit.client.1.smithi110.stdout:4/112: mknod d0/d17/c22 0 2024-04-12T13:41:49.588 INFO:tasks.workunit.client.0.smithi060.stdout:7/43: creat d0/fe x:0 0 0 2024-04-12T13:41:49.588 INFO:tasks.workunit.client.0.smithi060.stdout:5/53: symlink d6/l11 0 2024-04-12T13:41:49.590 INFO:tasks.workunit.client.1.smithi110.stdout:4/113: creat d0/d19/f23 x:0 0 0 2024-04-12T13:41:49.590 INFO:tasks.workunit.client.0.smithi060.stdout:8/43: getdents d9/da 0 2024-04-12T13:41:49.590 INFO:tasks.workunit.client.0.smithi060.stdout:7/44: write d0/d7/f6 [1594199,22049] 0 2024-04-12T13:41:49.591 INFO:tasks.workunit.client.0.smithi060.stdout:6/90: dread d1/f11 [0,4194304] 0 2024-04-12T13:41:49.593 INFO:tasks.workunit.client.1.smithi110.stdout:4/114: creat d0/de/f24 x:0 0 0 2024-04-12T13:41:49.594 INFO:tasks.workunit.client.0.smithi060.stdout:8/44: symlink d9/da/le 0 2024-04-12T13:41:49.594 INFO:tasks.workunit.client.1.smithi110.stdout:4/115: chown d0/ld 0 1 2024-04-12T13:41:49.598 INFO:tasks.workunit.client.0.smithi060.stdout:8/45: write f2 [1483805,48559] 0 2024-04-12T13:41:49.603 INFO:tasks.workunit.client.0.smithi060.stdout:8/46: symlink d9/da/lf 0 2024-04-12T13:41:49.608 INFO:tasks.workunit.client.0.smithi060.stdout:8/47: write d9/fb [542691,91015] 0 2024-04-12T13:41:49.614 INFO:tasks.workunit.client.0.smithi060.stdout:6/91: dread d1/f11 [0,4194304] 0 2024-04-12T13:41:49.617 INFO:tasks.workunit.client.1.smithi110.stdout:4/116: truncate d0/fc 509608 0 2024-04-12T13:41:49.619 INFO:tasks.workunit.client.1.smithi110.stdout:4/117: write d0/f4 [1600040,1006] 0 2024-04-12T13:41:49.619 INFO:tasks.workunit.client.0.smithi060.stdout:5/54: dwrite f2 [0,4194304] 0 2024-04-12T13:41:49.620 INFO:tasks.workunit.client.0.smithi060.stdout:7/45: dwrite d0/fe [0,4194304] 0 2024-04-12T13:41:49.620 INFO:tasks.workunit.client.1.smithi110.stdout:4/118: readlink d0/d19/l1d 0 2024-04-12T13:41:49.622 INFO:tasks.workunit.client.0.smithi060.stdout:5/55: write d6/f7 [995996,50496] 0 2024-04-12T13:41:49.623 INFO:tasks.workunit.client.0.smithi060.stdout:6/92: symlink d1/d7/da/l1d 0 2024-04-12T13:41:49.626 INFO:tasks.workunit.client.1.smithi110.stdout:4/119: unlink d0/d19/l1d 0 2024-04-12T13:41:49.629 INFO:tasks.workunit.client.0.smithi060.stdout:6/93: dread - d1/f15 zero size 2024-04-12T13:41:49.631 INFO:tasks.workunit.client.0.smithi060.stdout:5/56: readlink d6/le 0 2024-04-12T13:41:49.634 INFO:tasks.workunit.client.0.smithi060.stdout:5/57: dread - d6/fc zero size 2024-04-12T13:41:49.634 INFO:tasks.workunit.client.1.smithi110.stdout:4/120: creat d0/d19/d1c/f25 x:0 0 0 2024-04-12T13:41:49.645 INFO:tasks.workunit.client.1.smithi110.stdout:4/121: dread d0/f5 [0,4194304] 0 2024-04-12T13:41:49.645 INFO:tasks.workunit.client.0.smithi060.stdout:6/94: dread d1/d7/da/dc/f19 [0,4194304] 0 2024-04-12T13:41:49.645 INFO:tasks.workunit.client.0.smithi060.stdout:8/48: dwrite f2 [0,4194304] 0 2024-04-12T13:41:49.647 INFO:tasks.workunit.client.1.smithi110.stdout:4/122: mkdir d0/d19/d26 0 2024-04-12T13:41:49.650 INFO:tasks.workunit.client.1.smithi110.stdout:4/123: mknod d0/d19/c27 0 2024-04-12T13:41:49.651 INFO:tasks.workunit.client.0.smithi060.stdout:8/49: mkdir d9/da/d10 0 2024-04-12T13:41:49.652 INFO:tasks.workunit.client.1.smithi110.stdout:4/124: write d0/ff [401570,79736] 0 2024-04-12T13:41:49.655 INFO:tasks.workunit.client.0.smithi060.stdout:6/95: getdents d1 0 2024-04-12T13:41:49.655 INFO:tasks.workunit.client.0.smithi060.stdout:7/46: dwrite d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.656 INFO:tasks.workunit.client.1.smithi110.stdout:4/125: symlink d0/d19/d1c/l28 0 2024-04-12T13:41:49.658 INFO:tasks.workunit.client.1.smithi110.stdout:4/126: write d0/d13/f21 [196327,96751] 0 2024-04-12T13:41:49.664 INFO:tasks.workunit.client.0.smithi060.stdout:6/96: chown d1/d7/da/dc/f19 22755 1 2024-04-12T13:41:49.665 INFO:tasks.workunit.client.0.smithi060.stdout:5/58: dwrite d6/f7 [0,4194304] 0 2024-04-12T13:41:49.665 INFO:tasks.workunit.client.0.smithi060.stdout:7/47: write d0/fe [265835,41594] 0 2024-04-12T13:41:49.667 INFO:tasks.workunit.client.1.smithi110.stdout:4/127: fsync d0/d19/d1c/f25 0 2024-04-12T13:41:49.668 INFO:tasks.workunit.client.0.smithi060.stdout:7/48: chown d0/f8 217 1 2024-04-12T13:41:49.670 INFO:tasks.workunit.client.1.smithi110.stdout:4/128: truncate d0/de/f24 849457 0 2024-04-12T13:41:49.677 INFO:tasks.workunit.client.0.smithi060.stdout:6/97: mkdir d1/d7/da/dc/d1e 0 2024-04-12T13:41:49.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/50: write f1 [356517,46871] 0 2024-04-12T13:41:49.681 INFO:tasks.workunit.client.1.smithi110.stdout:4/129: fdatasync d0/fc 0 2024-04-12T13:41:49.687 INFO:tasks.workunit.client.0.smithi060.stdout:6/98: unlink d1/d7/da/dc/f1b 0 2024-04-12T13:41:49.690 INFO:tasks.workunit.client.0.smithi060.stdout:5/59: truncate f1 1066394 0 2024-04-12T13:41:49.691 INFO:tasks.workunit.client.0.smithi060.stdout:6/99: chown d1/d7/da/l1d 1042959267 1 2024-04-12T13:41:49.693 INFO:tasks.workunit.client.0.smithi060.stdout:6/100: fsync d1/d7/fd 0 2024-04-12T13:41:49.695 INFO:tasks.workunit.client.0.smithi060.stdout:6/101: read - d1/f14 zero size 2024-04-12T13:41:49.697 INFO:tasks.workunit.client.0.smithi060.stdout:7/49: dwrite d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.703 INFO:tasks.workunit.client.0.smithi060.stdout:7/50: mknod d0/cf 0 2024-04-12T13:41:49.705 INFO:tasks.workunit.client.0.smithi060.stdout:8/51: dwrite d9/fb [0,4194304] 0 2024-04-12T13:41:49.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/34: sync 2024-04-12T13:41:49.710 INFO:tasks.workunit.client.1.smithi110.stdout:8/4: sync 2024-04-12T13:41:49.715 INFO:tasks.workunit.client.0.smithi060.stdout:8/52: creat d9/f11 x:0 0 0 2024-04-12T13:41:49.716 INFO:tasks.workunit.client.0.smithi060.stdout:7/51: creat d0/d7/f10 x:0 0 0 2024-04-12T13:41:49.716 INFO:tasks.workunit.client.1.smithi110.stdout:8/5: creat f0 x:0 0 0 2024-04-12T13:41:49.717 INFO:tasks.workunit.client.1.smithi110.stdout:4/130: dread d0/d13/f21 [0,4194304] 0 2024-04-12T13:41:49.721 INFO:tasks.workunit.client.1.smithi110.stdout:8/6: mkdir d1 0 2024-04-12T13:41:49.723 INFO:tasks.workunit.client.0.smithi060.stdout:1/35: fdatasync f2 0 2024-04-12T13:41:49.725 INFO:tasks.workunit.client.0.smithi060.stdout:8/53: symlink d9/l12 0 2024-04-12T13:41:49.725 INFO:tasks.workunit.client.0.smithi060.stdout:5/60: dwrite d6/fc [0,4194304] 0 2024-04-12T13:41:49.728 INFO:tasks.workunit.client.1.smithi110.stdout:4/131: truncate d0/f5 4351582 0 2024-04-12T13:41:49.728 INFO:tasks.workunit.client.0.smithi060.stdout:7/52: creat d0/d7/f11 x:0 0 0 2024-04-12T13:41:49.733 INFO:tasks.workunit.client.1.smithi110.stdout:4/132: dread d0/fb [0,4194304] 0 2024-04-12T13:41:49.735 INFO:tasks.workunit.client.0.smithi060.stdout:5/61: write d6/f9 [757157,77760] 0 2024-04-12T13:41:49.736 INFO:tasks.workunit.client.0.smithi060.stdout:7/53: fdatasync d0/d7/f11 0 2024-04-12T13:41:49.737 INFO:tasks.workunit.client.0.smithi060.stdout:5/62: fsync d6/f8 0 2024-04-12T13:41:49.738 INFO:tasks.workunit.client.0.smithi060.stdout:6/102: dwrite d1/f15 [0,4194304] 0 2024-04-12T13:41:49.738 INFO:tasks.workunit.client.0.smithi060.stdout:1/36: symlink lf 0 2024-04-12T13:41:49.740 INFO:tasks.workunit.client.0.smithi060.stdout:6/103: chown d1/d7/da/ff 268850 1 2024-04-12T13:41:49.742 INFO:tasks.workunit.client.0.smithi060.stdout:8/54: symlink d9/l13 0 2024-04-12T13:41:49.742 INFO:tasks.workunit.client.0.smithi060.stdout:8/55: readlink d9/l12 0 2024-04-12T13:41:49.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/37: dread f2 [0,4194304] 0 2024-04-12T13:41:49.754 INFO:tasks.workunit.client.0.smithi060.stdout:6/104: unlink d1/d7/fd 0 2024-04-12T13:41:49.754 INFO:tasks.workunit.client.1.smithi110.stdout:4/133: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:41:49.755 INFO:tasks.workunit.client.0.smithi060.stdout:6/105: dread - d1/f14 zero size 2024-04-12T13:41:49.758 INFO:tasks.workunit.client.0.smithi060.stdout:8/56: symlink d9/da/l14 0 2024-04-12T13:41:49.758 INFO:tasks.workunit.client.0.smithi060.stdout:8/57: chown d9/fc 4732553 1 2024-04-12T13:41:49.759 INFO:tasks.workunit.client.0.smithi060.stdout:5/63: mkdir d6/d10/d12 0 2024-04-12T13:41:49.762 INFO:tasks.workunit.client.0.smithi060.stdout:6/106: creat d1/d16/f1f x:0 0 0 2024-04-12T13:41:49.767 INFO:tasks.workunit.client.1.smithi110.stdout:4/134: dread d0/f5 [0,4194304] 0 2024-04-12T13:41:49.768 INFO:tasks.workunit.client.1.smithi110.stdout:4/135: chown d0/f15 0 1 2024-04-12T13:41:49.769 INFO:tasks.workunit.client.0.smithi060.stdout:1/38: unlink f3 0 2024-04-12T13:41:49.770 INFO:tasks.workunit.client.1.smithi110.stdout:4/136: read d0/d17/f18 [1794975,66731] 0 2024-04-12T13:41:49.772 INFO:tasks.workunit.client.1.smithi110.stdout:4/137: fdatasync d0/ff 0 2024-04-12T13:41:49.772 INFO:tasks.workunit.client.0.smithi060.stdout:6/107: mkdir d1/d7/da/d20 0 2024-04-12T13:41:49.775 INFO:tasks.workunit.client.0.smithi060.stdout:7/54: getdents d0/d7 0 2024-04-12T13:41:49.777 INFO:tasks.workunit.client.1.smithi110.stdout:4/138: dread d0/ff [0,4194304] 0 2024-04-12T13:41:49.779 INFO:tasks.workunit.client.1.smithi110.stdout:4/139: chown d0/d19/f23 2880026 1 2024-04-12T13:41:49.779 INFO:tasks.workunit.client.0.smithi060.stdout:7/55: write d0/d7/f10 [724836,40108] 0 2024-04-12T13:41:49.785 INFO:tasks.workunit.client.0.smithi060.stdout:5/64: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:49.790 INFO:tasks.workunit.client.0.smithi060.stdout:8/58: link d9/da/lf d9/da/d10/l15 0 2024-04-12T13:41:49.794 INFO:tasks.workunit.client.0.smithi060.stdout:6/108: dread d1/f15 [0,4194304] 0 2024-04-12T13:41:49.796 INFO:tasks.workunit.client.0.smithi060.stdout:6/109: fdatasync d1/f14 0 2024-04-12T13:41:49.798 INFO:tasks.workunit.client.0.smithi060.stdout:6/110: write d1/d16/f1f [759244,60482] 0 2024-04-12T13:41:49.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/39: dread fb [0,4194304] 0 2024-04-12T13:41:49.800 INFO:tasks.workunit.client.0.smithi060.stdout:1/40: write f2 [3677818,95576] 0 2024-04-12T13:41:49.812 INFO:tasks.workunit.client.0.smithi060.stdout:9/32: sync 2024-04-12T13:41:49.812 INFO:tasks.workunit.client.0.smithi060.stdout:2/29: sync 2024-04-12T13:41:49.812 INFO:tasks.workunit.client.0.smithi060.stdout:4/51: sync 2024-04-12T13:41:49.812 INFO:tasks.workunit.client.0.smithi060.stdout:0/101: sync 2024-04-12T13:41:49.812 INFO:tasks.workunit.client.0.smithi060.stdout:3/58: sync 2024-04-12T13:41:49.814 INFO:tasks.workunit.client.0.smithi060.stdout:2/30: dread - f5 zero size 2024-04-12T13:41:49.814 INFO:tasks.workunit.client.0.smithi060.stdout:0/102: readlink d7/l1f 0 2024-04-12T13:41:49.815 INFO:tasks.workunit.client.0.smithi060.stdout:9/33: truncate f2 5321535 0 2024-04-12T13:41:49.815 INFO:tasks.workunit.client.0.smithi060.stdout:8/59: rename c7 to d9/da/d10/c16 0 2024-04-12T13:41:49.816 INFO:tasks.workunit.client.0.smithi060.stdout:2/31: chown c2 68095 1 2024-04-12T13:41:49.817 INFO:tasks.workunit.client.0.smithi060.stdout:7/56: creat d0/f12 x:0 0 0 2024-04-12T13:41:49.817 INFO:tasks.workunit.client.0.smithi060.stdout:9/34: chown f2 26873030 1 2024-04-12T13:41:49.818 INFO:tasks.workunit.client.0.smithi060.stdout:2/32: chown f4 1484 1 2024-04-12T13:41:49.824 INFO:tasks.workunit.client.0.smithi060.stdout:4/52: chown d6/d7/db/cc 28309 1 2024-04-12T13:41:49.826 INFO:tasks.workunit.client.0.smithi060.stdout:4/53: write d6/d7/dd/fe [867041,51615] 0 2024-04-12T13:41:49.830 INFO:tasks.workunit.client.0.smithi060.stdout:0/103: rmdir d7/d9/d14/d1b 39 2024-04-12T13:41:49.831 INFO:tasks.workunit.client.0.smithi060.stdout:9/35: dread f2 [0,4194304] 0 2024-04-12T13:41:49.832 INFO:tasks.workunit.client.0.smithi060.stdout:0/104: readlink d7/d9/de/l15 0 2024-04-12T13:41:49.833 INFO:tasks.workunit.client.0.smithi060.stdout:2/33: dread f3 [0,4194304] 0 2024-04-12T13:41:49.835 INFO:tasks.workunit.client.0.smithi060.stdout:2/34: chown c0 74156 1 2024-04-12T13:41:49.838 INFO:tasks.workunit.client.0.smithi060.stdout:7/57: unlink d0/d7/fd 0 2024-04-12T13:41:49.839 INFO:tasks.workunit.client.0.smithi060.stdout:7/58: read d0/fe [3512510,72648] 0 2024-04-12T13:41:49.851 INFO:tasks.workunit.client.0.smithi060.stdout:0/105: dwrite d7/d9/d14/f24 [0,4194304] 0 2024-04-12T13:41:49.854 INFO:tasks.workunit.client.0.smithi060.stdout:0/106: write d7/d9/f17 [521413,67751] 0 2024-04-12T13:41:49.854 INFO:tasks.workunit.client.0.smithi060.stdout:7/59: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:49.860 INFO:tasks.workunit.client.0.smithi060.stdout:4/54: mkdir d6/d7/d13 0 2024-04-12T13:41:49.860 INFO:tasks.workunit.client.0.smithi060.stdout:9/36: fdatasync f2 0 2024-04-12T13:41:49.860 INFO:tasks.workunit.client.0.smithi060.stdout:4/55: chown d6/d7/dd 13795483 1 2024-04-12T13:41:49.861 INFO:tasks.workunit.client.0.smithi060.stdout:4/56: fsync d6/d7/dd/fe 0 2024-04-12T13:41:49.863 INFO:tasks.workunit.client.0.smithi060.stdout:8/60: write f2 [4491977,39841] 0 2024-04-12T13:41:49.865 INFO:tasks.workunit.client.0.smithi060.stdout:8/61: dread - d9/f11 zero size 2024-04-12T13:41:49.871 INFO:tasks.workunit.client.0.smithi060.stdout:0/107: dread d7/fa [0,4194304] 0 2024-04-12T13:41:49.872 INFO:tasks.workunit.client.0.smithi060.stdout:6/111: link d1/d7/da/c1a d1/d7/da/c21 0 2024-04-12T13:41:49.875 INFO:tasks.workunit.client.0.smithi060.stdout:6/112: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:49.877 INFO:tasks.workunit.client.0.smithi060.stdout:6/113: fdatasync d1/d7/da/ff 0 2024-04-12T13:41:49.877 INFO:tasks.workunit.client.0.smithi060.stdout:3/59: link f0 d7/da/dd/f12 0 2024-04-12T13:41:49.878 INFO:tasks.workunit.client.0.smithi060.stdout:6/114: dread - d1/f14 zero size 2024-04-12T13:41:49.879 INFO:tasks.workunit.client.0.smithi060.stdout:6/115: fdatasync d1/f14 0 2024-04-12T13:41:49.888 INFO:tasks.workunit.client.0.smithi060.stdout:0/108: dwrite d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:49.889 INFO:tasks.workunit.client.0.smithi060.stdout:9/37: creat d4/d8/fb x:0 0 0 2024-04-12T13:41:49.895 INFO:tasks.workunit.client.0.smithi060.stdout:4/57: rename c1 to d6/d7/db/c14 0 2024-04-12T13:41:49.898 INFO:tasks.workunit.client.0.smithi060.stdout:8/62: creat d9/f17 x:0 0 0 2024-04-12T13:41:49.899 INFO:tasks.workunit.client.0.smithi060.stdout:8/63: stat d9/fc 0 2024-04-12T13:41:49.902 INFO:tasks.workunit.client.0.smithi060.stdout:2/35: truncate f3 3554156 0 2024-04-12T13:41:49.909 INFO:tasks.workunit.client.0.smithi060.stdout:9/38: rmdir d4 39 2024-04-12T13:41:49.910 INFO:tasks.workunit.client.0.smithi060.stdout:8/64: dread d9/fb [0,4194304] 0 2024-04-12T13:41:49.911 INFO:tasks.workunit.client.0.smithi060.stdout:0/109: mkdir d7/d9/d28 0 2024-04-12T13:41:49.917 INFO:tasks.workunit.client.1.smithi110.stdout:2/21: sync 2024-04-12T13:41:49.917 INFO:tasks.workunit.client.1.smithi110.stdout:5/16: sync 2024-04-12T13:41:49.917 INFO:tasks.workunit.client.1.smithi110.stdout:1/8: sync 2024-04-12T13:41:49.917 INFO:tasks.workunit.client.1.smithi110.stdout:5/17: rmdir - no directory 2024-04-12T13:41:49.918 INFO:tasks.workunit.client.1.smithi110.stdout:2/22: fsync f3 0 2024-04-12T13:41:49.922 INFO:tasks.workunit.client.0.smithi060.stdout:1/41: link c6 c10 0 2024-04-12T13:41:49.928 INFO:tasks.workunit.client.0.smithi060.stdout:0/110: mknod d7/c29 0 2024-04-12T13:41:49.931 INFO:tasks.workunit.client.0.smithi060.stdout:8/65: rename c3 to d9/c18 0 2024-04-12T13:41:49.932 INFO:tasks.workunit.client.0.smithi060.stdout:8/66: fdatasync d9/f17 0 2024-04-12T13:41:49.933 INFO:tasks.workunit.client.0.smithi060.stdout:8/67: readlink d9/da/l14 0 2024-04-12T13:41:49.934 INFO:tasks.workunit.client.0.smithi060.stdout:7/60: truncate d0/d7/f6 1669021 0 2024-04-12T13:41:49.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/36: getdents d6 0 2024-04-12T13:41:49.942 INFO:tasks.workunit.client.1.smithi110.stdout:4/140: fsync d0/fc 0 2024-04-12T13:41:49.942 INFO:tasks.workunit.client.0.smithi060.stdout:6/116: link d1/l10 d1/d7/da/l22 0 2024-04-12T13:41:49.943 INFO:tasks.workunit.client.0.smithi060.stdout:9/39: dwrite d4/d8/fb [0,4194304] 0 2024-04-12T13:41:49.945 INFO:tasks.workunit.client.1.smithi110.stdout:4/141: truncate d0/de/f24 895283 0 2024-04-12T13:41:49.947 INFO:tasks.workunit.client.0.smithi060.stdout:0/111: rmdir d7/d9 39 2024-04-12T13:41:49.951 INFO:tasks.workunit.client.1.smithi110.stdout:1/9: creat f4 x:0 0 0 2024-04-12T13:41:49.952 INFO:tasks.workunit.client.1.smithi110.stdout:1/10: fdatasync f4 0 2024-04-12T13:41:49.953 INFO:tasks.workunit.client.1.smithi110.stdout:5/18: symlink l3 0 2024-04-12T13:41:49.954 INFO:tasks.workunit.client.1.smithi110.stdout:1/11: chown f1 119284 1 2024-04-12T13:41:49.955 INFO:tasks.workunit.client.0.smithi060.stdout:4/58: truncate f2 3748110 0 2024-04-12T13:41:49.957 INFO:tasks.workunit.client.1.smithi110.stdout:2/23: symlink l5 0 2024-04-12T13:41:49.959 INFO:tasks.workunit.client.1.smithi110.stdout:3/51: sync 2024-04-12T13:41:49.959 INFO:tasks.workunit.client.1.smithi110.stdout:6/94: sync 2024-04-12T13:41:49.959 INFO:tasks.workunit.client.1.smithi110.stdout:0/28: sync 2024-04-12T13:41:49.960 INFO:tasks.workunit.client.1.smithi110.stdout:7/37: sync 2024-04-12T13:41:49.960 INFO:tasks.workunit.client.1.smithi110.stdout:9/84: sync 2024-04-12T13:41:49.962 INFO:tasks.workunit.client.1.smithi110.stdout:0/29: chown d1/l3 1975198 1 2024-04-12T13:41:49.963 INFO:tasks.workunit.client.1.smithi110.stdout:9/85: truncate fa 467515 0 2024-04-12T13:41:49.972 INFO:tasks.workunit.client.1.smithi110.stdout:6/95: dread d7/d10/d12/f1f [0,4194304] 0 2024-04-12T13:41:49.973 INFO:tasks.workunit.client.1.smithi110.stdout:6/96: chown d7/ce 759 1 2024-04-12T13:41:49.975 INFO:tasks.workunit.client.1.smithi110.stdout:9/86: dread f5 [0,4194304] 0 2024-04-12T13:41:50.037 INFO:tasks.workunit.client.1.smithi110.stdout:8/7: creat d1/f2 x:0 0 0 2024-04-12T13:41:50.039 INFO:tasks.workunit.client.1.smithi110.stdout:8/8: read - d1/f2 zero size 2024-04-12T13:41:50.041 INFO:tasks.workunit.client.1.smithi110.stdout:8/9: dread - f0 zero size 2024-04-12T13:41:50.044 INFO:tasks.workunit.client.1.smithi110.stdout:8/10: chown d1/f2 3 1 2024-04-12T13:41:50.046 INFO:tasks.workunit.client.0.smithi060.stdout:1/42: symlink l11 0 2024-04-12T13:41:50.054 INFO:tasks.workunit.client.0.smithi060.stdout:6/117: rename d1/f11 to d1/d7/da/dc/d1e/f23 0 2024-04-12T13:41:50.068 INFO:tasks.workunit.client.1.smithi110.stdout:1/12: rename f1 to f5 0 2024-04-12T13:41:50.071 INFO:tasks.workunit.client.1.smithi110.stdout:1/13: dread - f4 zero size 2024-04-12T13:41:50.073 INFO:tasks.workunit.client.0.smithi060.stdout:8/68: link d9/f17 d9/da/d10/f19 0 2024-04-12T13:41:50.076 INFO:tasks.workunit.client.0.smithi060.stdout:7/61: fdatasync d0/d7/f6 0 2024-04-12T13:41:50.077 INFO:tasks.workunit.client.1.smithi110.stdout:2/24: write f0 [1319030,64912] 0 2024-04-12T13:41:50.080 INFO:tasks.workunit.client.0.smithi060.stdout:7/62: chown d0/l5 18294 1 2024-04-12T13:41:50.080 INFO:tasks.workunit.client.1.smithi110.stdout:2/25: chown l5 56241 1 2024-04-12T13:41:50.082 INFO:tasks.workunit.client.0.smithi060.stdout:4/59: mkdir d6/d7/dd/d15 0 2024-04-12T13:41:50.082 INFO:tasks.workunit.client.1.smithi110.stdout:2/26: dread - f4 zero size 2024-04-12T13:41:50.084 INFO:tasks.workunit.client.1.smithi110.stdout:7/38: rmdir d1 39 2024-04-12T13:41:50.085 INFO:tasks.workunit.client.1.smithi110.stdout:2/27: fdatasync f4 0 2024-04-12T13:41:50.087 INFO:tasks.workunit.client.0.smithi060.stdout:4/60: write d6/d7/dd/df/f12 [765090,108478] 0 2024-04-12T13:41:50.091 INFO:tasks.workunit.client.1.smithi110.stdout:2/28: chown f3 1089 1 2024-04-12T13:41:50.096 INFO:tasks.workunit.client.1.smithi110.stdout:6/97: symlink d7/d10/l23 0 2024-04-12T13:41:50.098 INFO:tasks.workunit.client.0.smithi060.stdout:8/69: dread f2 [0,4194304] 0 2024-04-12T13:41:50.099 INFO:tasks.workunit.client.1.smithi110.stdout:6/98: chown d7/f19 432579977 1 2024-04-12T13:41:50.106 INFO:tasks.workunit.client.0.smithi060.stdout:6/118: rename d1/d16 to d1/d7/da/dc/d24 0 2024-04-12T13:41:50.106 INFO:tasks.workunit.client.1.smithi110.stdout:6/99: chown d7/d10/c11 741 1 2024-04-12T13:41:50.106 INFO:tasks.workunit.client.1.smithi110.stdout:9/87: creat df/f1e x:0 0 0 2024-04-12T13:41:50.107 INFO:tasks.workunit.client.1.smithi110.stdout:9/88: fdatasync df/f19 0 2024-04-12T13:41:50.107 INFO:tasks.workunit.client.1.smithi110.stdout:8/11: mkdir d1/d3 0 2024-04-12T13:41:50.107 INFO:tasks.workunit.client.0.smithi060.stdout:9/40: creat d4/d9/fc x:0 0 0 2024-04-12T13:41:50.111 INFO:tasks.workunit.client.1.smithi110.stdout:5/19: link f1 f4 0 2024-04-12T13:41:50.113 INFO:tasks.workunit.client.0.smithi060.stdout:7/63: symlink d0/d7/l13 0 2024-04-12T13:41:50.114 INFO:tasks.workunit.client.1.smithi110.stdout:3/52: getdents d5/dc 0 2024-04-12T13:41:50.116 INFO:tasks.workunit.client.0.smithi060.stdout:8/70: rmdir d9/da 39 2024-04-12T13:41:50.119 INFO:tasks.workunit.client.1.smithi110.stdout:2/29: mkdir d6 0 2024-04-12T13:41:50.121 INFO:tasks.workunit.client.1.smithi110.stdout:0/30: creat d1/d8/f9 x:0 0 0 2024-04-12T13:41:50.126 INFO:tasks.workunit.client.1.smithi110.stdout:9/89: truncate fd 4095061 0 2024-04-12T13:41:50.129 INFO:tasks.workunit.client.0.smithi060.stdout:1/43: dwrite fb [0,4194304] 0 2024-04-12T13:41:50.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/61: mknod d6/d7/dd/d15/c16 0 2024-04-12T13:41:50.134 INFO:tasks.workunit.client.1.smithi110.stdout:1/14: link f2 f6 0 2024-04-12T13:41:50.135 INFO:tasks.workunit.client.0.smithi060.stdout:6/119: mkdir d1/d7/d25 0 2024-04-12T13:41:50.137 INFO:tasks.workunit.client.1.smithi110.stdout:7/39: symlink d1/d3/l8 0 2024-04-12T13:41:50.139 INFO:tasks.workunit.client.1.smithi110.stdout:3/53: rename d5/la to d5/l10 0 2024-04-12T13:41:50.141 INFO:tasks.workunit.client.1.smithi110.stdout:7/40: write d1/f5 [1431688,33379] 0 2024-04-12T13:41:50.141 INFO:tasks.workunit.client.0.smithi060.stdout:9/41: truncate f2 7548 0 2024-04-12T13:41:50.143 INFO:tasks.workunit.client.0.smithi060.stdout:7/64: mknod d0/c14 0 2024-04-12T13:41:50.145 INFO:tasks.workunit.client.0.smithi060.stdout:1/44: read f2 [2700193,12542] 0 2024-04-12T13:41:50.146 INFO:tasks.workunit.client.1.smithi110.stdout:0/31: mknod d1/ca 0 2024-04-12T13:41:50.146 INFO:tasks.workunit.client.1.smithi110.stdout:6/100: creat d7/d10/d1c/f24 x:0 0 0 2024-04-12T13:41:50.146 INFO:tasks.workunit.client.1.smithi110.stdout:8/12: symlink d1/d3/l4 0 2024-04-12T13:41:50.147 INFO:tasks.workunit.client.0.smithi060.stdout:8/71: chown d9/da/lf 2 1 2024-04-12T13:41:50.148 INFO:tasks.workunit.client.0.smithi060.stdout:8/72: read - d9/fc zero size 2024-04-12T13:41:50.148 INFO:tasks.workunit.client.1.smithi110.stdout:4/142: getdents d0/de 0 2024-04-12T13:41:50.149 INFO:tasks.workunit.client.0.smithi060.stdout:8/73: chown d9/da/d10 795751 1 2024-04-12T13:41:50.149 INFO:tasks.workunit.client.1.smithi110.stdout:5/20: rename f4 to f5 0 2024-04-12T13:41:50.152 INFO:tasks.workunit.client.1.smithi110.stdout:9/90: dread f3 [0,4194304] 0 2024-04-12T13:41:50.152 INFO:tasks.workunit.client.1.smithi110.stdout:1/15: mknod c7 0 2024-04-12T13:41:50.152 INFO:tasks.workunit.client.1.smithi110.stdout:7/41: read d1/f5 [957678,7269] 0 2024-04-12T13:41:50.154 INFO:tasks.workunit.client.0.smithi060.stdout:9/42: creat d4/fd x:0 0 0 2024-04-12T13:41:50.157 INFO:tasks.workunit.client.1.smithi110.stdout:2/30: mknod d6/c7 0 2024-04-12T13:41:50.158 INFO:tasks.workunit.client.1.smithi110.stdout:2/31: read - f4 zero size 2024-04-12T13:41:50.162 INFO:tasks.workunit.client.0.smithi060.stdout:5/65: sync 2024-04-12T13:41:50.163 INFO:tasks.workunit.client.1.smithi110.stdout:3/54: creat d5/dc/f11 x:0 0 0 2024-04-12T13:41:50.167 INFO:tasks.workunit.client.0.smithi060.stdout:6/120: dwrite d1/f15 [0,4194304] 0 2024-04-12T13:41:50.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/13: mkdir d1/d5 0 2024-04-12T13:41:50.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/14: stat d1 0 2024-04-12T13:41:50.170 INFO:tasks.workunit.client.1.smithi110.stdout:8/15: dread - f0 zero size 2024-04-12T13:41:50.171 INFO:tasks.workunit.client.0.smithi060.stdout:0/112: getdents d7/d9/d14/d1b 0 2024-04-12T13:41:50.171 INFO:tasks.workunit.client.1.smithi110.stdout:8/16: truncate f0 88081 0 2024-04-12T13:41:50.172 INFO:tasks.workunit.client.0.smithi060.stdout:0/113: read - d7/f26 zero size 2024-04-12T13:41:50.172 INFO:tasks.workunit.client.1.smithi110.stdout:0/32: unlink d1/c5 0 2024-04-12T13:41:50.174 INFO:tasks.workunit.client.0.smithi060.stdout:9/43: dwrite d4/d8/fa [0,4194304] 0 2024-04-12T13:41:50.174 INFO:tasks.workunit.client.0.smithi060.stdout:0/114: chown d7/d9/f23 252 1 2024-04-12T13:41:50.174 INFO:tasks.workunit.client.1.smithi110.stdout:6/101: rmdir d7/d10/d12 39 2024-04-12T13:41:50.176 INFO:tasks.workunit.client.0.smithi060.stdout:9/44: stat d4/c5 0 2024-04-12T13:41:50.176 INFO:tasks.workunit.client.0.smithi060.stdout:1/45: symlink l12 0 2024-04-12T13:41:50.177 INFO:tasks.workunit.client.0.smithi060.stdout:9/45: chown d4/d9 54729173 1 2024-04-12T13:41:50.177 INFO:tasks.workunit.client.0.smithi060.stdout:0/115: chown d7/d9/f1e 8011548 1 2024-04-12T13:41:50.179 INFO:tasks.workunit.client.1.smithi110.stdout:4/143: write d0/d13/f21 [140650,12625] 0 2024-04-12T13:41:50.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:49 smithi060 ceph-mon[29097]: pgmap v19: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 9.8 MiB/s wr, 277 op/s 2024-04-12T13:41:50.182 INFO:tasks.workunit.client.0.smithi060.stdout:4/62: link d6/d7/dd/df/c10 d6/d7/db/c17 0 2024-04-12T13:41:50.184 INFO:tasks.workunit.client.1.smithi110.stdout:1/16: write f5 [1665383,77585] 0 2024-04-12T13:41:50.187 INFO:tasks.workunit.client.0.smithi060.stdout:4/63: write d6/d7/dd/df/f12 [96932,26098] 0 2024-04-12T13:41:50.187 INFO:tasks.workunit.client.1.smithi110.stdout:2/32: creat d6/f8 x:0 0 0 2024-04-12T13:41:50.189 INFO:tasks.workunit.client.0.smithi060.stdout:8/74: mknod d9/c1a 0 2024-04-12T13:41:50.192 INFO:tasks.workunit.client.1.smithi110.stdout:3/55: rename d5/dc/fe to d5/dc/f12 0 2024-04-12T13:41:50.195 INFO:tasks.workunit.client.0.smithi060.stdout:7/65: dwrite d0/fe [0,4194304] 0 2024-04-12T13:41:50.196 INFO:tasks.workunit.client.1.smithi110.stdout:0/33: creat d1/d8/fb x:0 0 0 2024-04-12T13:41:50.197 INFO:tasks.workunit.client.0.smithi060.stdout:5/66: mkdir d6/d10/d12/d13 0 2024-04-12T13:41:50.202 INFO:tasks.workunit.client.1.smithi110.stdout:9/91: link df/d13/f1b df/d13/f1f 0 2024-04-12T13:41:50.204 INFO:tasks.workunit.client.1.smithi110.stdout:6/102: dwrite d7/d10/f20 [0,4194304] 0 2024-04-12T13:41:50.204 INFO:tasks.workunit.client.1.smithi110.stdout:9/92: dread - df/d13/f1b zero size 2024-04-12T13:41:50.206 INFO:tasks.workunit.client.1.smithi110.stdout:9/93: chown f3 1735 1 2024-04-12T13:41:50.208 INFO:tasks.workunit.client.1.smithi110.stdout:9/94: chown c2 7 1 2024-04-12T13:41:50.209 INFO:tasks.workunit.client.1.smithi110.stdout:9/95: dread - df/f19 zero size 2024-04-12T13:41:50.210 INFO:tasks.workunit.client.0.smithi060.stdout:6/121: creat d1/d7/da/d20/f26 x:0 0 0 2024-04-12T13:41:50.215 INFO:tasks.workunit.client.1.smithi110.stdout:8/17: symlink d1/d5/l6 0 2024-04-12T13:41:50.216 INFO:tasks.workunit.client.1.smithi110.stdout:3/56: creat d5/dc/f13 x:0 0 0 2024-04-12T13:41:50.219 INFO:tasks.workunit.client.1.smithi110.stdout:4/144: symlink d0/d19/d26/l29 0 2024-04-12T13:41:50.219 INFO:tasks.workunit.client.0.smithi060.stdout:5/67: dread d6/f9 [0,4194304] 0 2024-04-12T13:41:50.223 INFO:tasks.workunit.client.0.smithi060.stdout:9/46: link d4/c7 d4/d8/ce 0 2024-04-12T13:41:50.223 INFO:tasks.workunit.client.0.smithi060.stdout:7/66: dwrite d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:50.224 INFO:tasks.workunit.client.0.smithi060.stdout:4/64: dread f2 [0,4194304] 0 2024-04-12T13:41:50.225 INFO:tasks.workunit.client.1.smithi110.stdout:0/34: unlink d1/d8/f9 0 2024-04-12T13:41:50.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:49 smithi110 ceph-mon[36055]: pgmap v19: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 9.8 MiB/s wr, 277 op/s 2024-04-12T13:41:50.230 INFO:tasks.workunit.client.0.smithi060.stdout:4/65: write d6/d7/dd/fe [698849,112861] 0 2024-04-12T13:41:50.233 INFO:tasks.workunit.client.1.smithi110.stdout:7/42: truncate d1/d3/d4/f6 652795 0 2024-04-12T13:41:50.238 INFO:tasks.workunit.client.1.smithi110.stdout:8/18: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:50.240 INFO:tasks.workunit.client.0.smithi060.stdout:5/68: dwrite d6/fc [0,4194304] 0 2024-04-12T13:41:50.240 INFO:tasks.workunit.client.1.smithi110.stdout:9/96: mknod df/d13/c20 0 2024-04-12T13:41:50.244 INFO:tasks.workunit.client.0.smithi060.stdout:8/75: rename d9/da/d10 to d9/d1b 0 2024-04-12T13:41:50.246 INFO:tasks.workunit.client.0.smithi060.stdout:1/46: rename fa to f13 0 2024-04-12T13:41:50.246 INFO:tasks.workunit.client.1.smithi110.stdout:3/57: readlink l2 0 2024-04-12T13:41:50.248 INFO:tasks.workunit.client.0.smithi060.stdout:9/47: mknod d4/d8/cf 0 2024-04-12T13:41:50.251 INFO:tasks.workunit.client.0.smithi060.stdout:7/67: mknod d0/d7/c15 0 2024-04-12T13:41:50.252 INFO:tasks.workunit.client.1.smithi110.stdout:1/17: dwrite f2 [0,4194304] 0 2024-04-12T13:41:50.253 INFO:tasks.workunit.client.1.smithi110.stdout:0/35: mknod d1/d8/cc 0 2024-04-12T13:41:50.257 INFO:tasks.workunit.client.1.smithi110.stdout:6/103: mkdir d7/d25 0 2024-04-12T13:41:50.262 INFO:tasks.workunit.client.1.smithi110.stdout:0/36: write d1/f7 [669193,86829] 0 2024-04-12T13:41:50.264 INFO:tasks.workunit.client.0.smithi060.stdout:8/76: rename d9/l12 to d9/da/l1c 0 2024-04-12T13:41:50.264 INFO:tasks.workunit.client.0.smithi060.stdout:8/77: chown d9/da 160709160 1 2024-04-12T13:41:50.265 INFO:tasks.workunit.client.0.smithi060.stdout:9/48: creat d4/d9/f10 x:0 0 0 2024-04-12T13:41:50.267 INFO:tasks.workunit.client.1.smithi110.stdout:6/104: chown d7/d10/c11 94 1 2024-04-12T13:41:50.268 INFO:tasks.workunit.client.1.smithi110.stdout:5/21: sync 2024-04-12T13:41:50.268 INFO:tasks.workunit.client.1.smithi110.stdout:9/97: fdatasync f7 0 2024-04-12T13:41:50.270 INFO:tasks.workunit.client.0.smithi060.stdout:6/122: rmdir d1/d7/d25 0 2024-04-12T13:41:50.274 INFO:tasks.workunit.client.1.smithi110.stdout:4/145: link d0/d19/f20 d0/d13/f2a 0 2024-04-12T13:41:50.275 INFO:tasks.workunit.client.1.smithi110.stdout:1/18: creat f8 x:0 0 0 2024-04-12T13:41:50.276 INFO:tasks.workunit.client.1.smithi110.stdout:8/19: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:50.277 INFO:tasks.workunit.client.0.smithi060.stdout:2/37: sync 2024-04-12T13:41:50.277 INFO:tasks.workunit.client.1.smithi110.stdout:6/105: write d7/d10/d1c/f24 [73212,122674] 0 2024-04-12T13:41:50.278 INFO:tasks.workunit.client.0.smithi060.stdout:3/60: sync 2024-04-12T13:41:50.278 INFO:tasks.workunit.client.1.smithi110.stdout:2/33: getdents d6 0 2024-04-12T13:41:50.279 INFO:tasks.workunit.client.0.smithi060.stdout:3/61: stat c1 0 2024-04-12T13:41:50.280 INFO:tasks.workunit.client.1.smithi110.stdout:2/34: chown f0 1722278 1 2024-04-12T13:41:50.281 INFO:tasks.workunit.client.0.smithi060.stdout:3/62: write d7/f10 [2977256,69201] 0 2024-04-12T13:41:50.284 INFO:tasks.workunit.client.1.smithi110.stdout:2/35: truncate f4 239027 0 2024-04-12T13:41:50.284 INFO:tasks.workunit.client.0.smithi060.stdout:1/47: write f7 [2750583,113527] 0 2024-04-12T13:41:50.286 INFO:tasks.workunit.client.0.smithi060.stdout:8/78: mkdir d9/d1d 0 2024-04-12T13:41:50.286 INFO:tasks.workunit.client.1.smithi110.stdout:0/37: unlink d1/c4 0 2024-04-12T13:41:50.286 INFO:tasks.workunit.client.1.smithi110.stdout:3/58: dwrite d5/dc/fd [0,4194304] 0 2024-04-12T13:41:50.287 INFO:tasks.workunit.client.1.smithi110.stdout:2/36: read f3 [2735570,47556] 0 2024-04-12T13:41:50.288 INFO:tasks.workunit.client.1.smithi110.stdout:5/22: symlink l6 0 2024-04-12T13:41:50.290 INFO:tasks.workunit.client.0.smithi060.stdout:8/79: dread - d9/f17 zero size 2024-04-12T13:41:50.292 INFO:tasks.workunit.client.1.smithi110.stdout:9/98: mknod df/c21 0 2024-04-12T13:41:50.296 INFO:tasks.workunit.client.0.smithi060.stdout:1/48: write f7 [576805,72037] 0 2024-04-12T13:41:50.296 INFO:tasks.workunit.client.0.smithi060.stdout:7/68: creat d0/f16 x:0 0 0 2024-04-12T13:41:50.296 INFO:tasks.workunit.client.0.smithi060.stdout:2/38: chown f3 9666 1 2024-04-12T13:41:50.299 INFO:tasks.workunit.client.0.smithi060.stdout:2/39: dread - f5 zero size 2024-04-12T13:41:50.300 INFO:tasks.workunit.client.0.smithi060.stdout:5/69: getdents d6/d10 0 2024-04-12T13:41:50.300 INFO:tasks.workunit.client.0.smithi060.stdout:6/123: dwrite d1/d7/da/d20/f26 [0,4194304] 0 2024-04-12T13:41:50.302 INFO:tasks.workunit.client.0.smithi060.stdout:5/70: chown d6/l11 0 1 2024-04-12T13:41:50.304 INFO:tasks.workunit.client.1.smithi110.stdout:8/20: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:50.305 INFO:tasks.workunit.client.0.smithi060.stdout:6/124: dread - d1/f14 zero size 2024-04-12T13:41:50.309 INFO:tasks.workunit.client.1.smithi110.stdout:8/21: write d1/f2 [4186819,27662] 0 2024-04-12T13:41:50.309 INFO:tasks.workunit.client.0.smithi060.stdout:6/125: rename d1/d7/da/dc to d1/d7/da/dc/d27 22 2024-04-12T13:41:50.311 INFO:tasks.workunit.client.0.smithi060.stdout:6/126: truncate d1/d7/da/ff 896305 0 2024-04-12T13:41:50.311 INFO:tasks.workunit.client.1.smithi110.stdout:3/59: mknod d5/dc/c14 0 2024-04-12T13:41:50.311 INFO:tasks.workunit.client.1.smithi110.stdout:2/37: creat d6/f9 x:0 0 0 2024-04-12T13:41:50.312 INFO:tasks.workunit.client.1.smithi110.stdout:8/22: read d1/f2 [111756,17858] 0 2024-04-12T13:41:50.313 INFO:tasks.workunit.client.1.smithi110.stdout:3/60: stat l2 0 2024-04-12T13:41:50.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/23: creat f7 x:0 0 0 2024-04-12T13:41:50.315 INFO:tasks.workunit.client.1.smithi110.stdout:9/99: dwrite df/f1e [0,4194304] 0 2024-04-12T13:41:50.318 INFO:tasks.workunit.client.1.smithi110.stdout:3/61: dread - d5/dc/f13 zero size 2024-04-12T13:41:50.318 INFO:tasks.workunit.client.1.smithi110.stdout:0/38: creat d1/fd x:0 0 0 2024-04-12T13:41:50.319 INFO:tasks.workunit.client.0.smithi060.stdout:8/80: write d9/d1b/f19 [86355,17339] 0 2024-04-12T13:41:50.321 INFO:tasks.workunit.client.1.smithi110.stdout:4/146: link d0/ff d0/d17/f2b 0 2024-04-12T13:41:50.322 INFO:tasks.workunit.client.0.smithi060.stdout:8/81: read f1 [1091395,107265] 0 2024-04-12T13:41:50.326 INFO:tasks.workunit.client.1.smithi110.stdout:6/106: symlink d7/l26 0 2024-04-12T13:41:50.328 INFO:tasks.workunit.client.0.smithi060.stdout:5/71: creat d6/f14 x:0 0 0 2024-04-12T13:41:50.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/127: creat d1/d7/da/dc/d1e/f28 x:0 0 0 2024-04-12T13:41:50.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/128: write d1/f15 [2007499,27883] 0 2024-04-12T13:41:50.335 INFO:tasks.workunit.client.0.smithi060.stdout:1/49: dwrite f7 [0,4194304] 0 2024-04-12T13:41:50.337 INFO:tasks.workunit.client.0.smithi060.stdout:2/40: mknod d6/c7 0 2024-04-12T13:41:50.339 INFO:tasks.workunit.client.1.smithi110.stdout:8/23: mkdir d1/d7 0 2024-04-12T13:41:50.339 INFO:tasks.workunit.client.1.smithi110.stdout:5/24: chown f5 47 1 2024-04-12T13:41:50.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/82: dread f1 [0,4194304] 0 2024-04-12T13:41:50.342 INFO:tasks.workunit.client.1.smithi110.stdout:9/100: mknod df/c22 0 2024-04-12T13:41:50.344 INFO:tasks.workunit.client.1.smithi110.stdout:7/43: dwrite d1/f5 [0,4194304] 0 2024-04-12T13:41:50.345 INFO:tasks.workunit.client.0.smithi060.stdout:7/69: link d0/c3 d0/d7/c17 0 2024-04-12T13:41:50.354 INFO:tasks.workunit.client.1.smithi110.stdout:4/147: fdatasync d0/fb 0 2024-04-12T13:41:50.355 INFO:tasks.workunit.client.0.smithi060.stdout:2/41: dread f4 [0,4194304] 0 2024-04-12T13:41:50.355 INFO:tasks.workunit.client.1.smithi110.stdout:2/38: dwrite f3 [0,4194304] 0 2024-04-12T13:41:50.355 INFO:tasks.workunit.client.1.smithi110.stdout:0/39: dread f0 [0,4194304] 0 2024-04-12T13:41:50.357 INFO:tasks.workunit.client.0.smithi060.stdout:5/72: mkdir d6/d10/d12/d15 0 2024-04-12T13:41:50.357 INFO:tasks.workunit.client.1.smithi110.stdout:1/19: truncate f5 2249243 0 2024-04-12T13:41:50.360 INFO:tasks.workunit.client.1.smithi110.stdout:5/25: creat f8 x:0 0 0 2024-04-12T13:41:50.360 INFO:tasks.workunit.client.0.smithi060.stdout:6/129: dwrite d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:50.362 INFO:tasks.workunit.client.1.smithi110.stdout:5/26: write f7 [988349,71376] 0 2024-04-12T13:41:50.362 INFO:tasks.workunit.client.1.smithi110.stdout:3/62: dwrite d5/dc/fd [0,4194304] 0 2024-04-12T13:41:50.363 INFO:tasks.workunit.client.1.smithi110.stdout:5/27: truncate f8 777987 0 2024-04-12T13:41:50.363 INFO:tasks.workunit.client.1.smithi110.stdout:8/24: dread d1/f2 [0,4194304] 0 2024-04-12T13:41:50.364 INFO:tasks.workunit.client.1.smithi110.stdout:9/101: rename df/c15 to df/d13/c23 0 2024-04-12T13:41:50.364 INFO:tasks.workunit.client.0.smithi060.stdout:8/83: chown d9/c18 26158250 1 2024-04-12T13:41:50.367 INFO:tasks.workunit.client.1.smithi110.stdout:3/63: read d5/dc/f12 [195537,66870] 0 2024-04-12T13:41:50.367 INFO:tasks.workunit.client.0.smithi060.stdout:7/70: rmdir d0 39 2024-04-12T13:41:50.368 INFO:tasks.workunit.client.1.smithi110.stdout:7/44: creat d1/d3/d4/f9 x:0 0 0 2024-04-12T13:41:50.369 INFO:tasks.workunit.client.1.smithi110.stdout:2/39: symlink d6/la 0 2024-04-12T13:41:50.370 INFO:tasks.workunit.client.1.smithi110.stdout:3/64: write d5/dc/f11 [401890,95785] 0 2024-04-12T13:41:50.372 INFO:tasks.workunit.client.1.smithi110.stdout:7/45: fdatasync d1/d3/d4/f6 0 2024-04-12T13:41:50.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/63: dwrite d7/da/dd/f12 [0,4194304] 0 2024-04-12T13:41:50.381 INFO:tasks.workunit.client.1.smithi110.stdout:5/28: creat f9 x:0 0 0 2024-04-12T13:41:50.386 INFO:tasks.workunit.client.0.smithi060.stdout:5/73: creat d6/d10/f16 x:0 0 0 2024-04-12T13:41:50.386 INFO:tasks.workunit.client.0.smithi060.stdout:6/130: dread d1/d7/da/d20/f26 [0,4194304] 0 2024-04-12T13:41:50.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/116: sync 2024-04-12T13:41:50.393 INFO:tasks.workunit.client.1.smithi110.stdout:9/102: creat df/f24 x:0 0 0 2024-04-12T13:41:50.395 INFO:tasks.workunit.client.1.smithi110.stdout:4/148: rename d0/d17 to d0/de/d2c 0 2024-04-12T13:41:50.400 INFO:tasks.workunit.client.1.smithi110.stdout:3/65: dread d5/dc/fd [0,4194304] 0 2024-04-12T13:41:50.405 INFO:tasks.workunit.client.1.smithi110.stdout:3/66: fsync d5/dc/f11 0 2024-04-12T13:41:50.407 INFO:tasks.workunit.client.1.smithi110.stdout:2/40: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:50.407 INFO:tasks.workunit.client.0.smithi060.stdout:1/50: creat f14 x:0 0 0 2024-04-12T13:41:50.410 INFO:tasks.workunit.client.1.smithi110.stdout:2/41: readlink d6/la 0 2024-04-12T13:41:50.412 INFO:tasks.workunit.client.1.smithi110.stdout:7/46: creat d1/d3/fa x:0 0 0 2024-04-12T13:41:50.412 INFO:tasks.workunit.client.1.smithi110.stdout:0/40: truncate f0 6922646 0 2024-04-12T13:41:50.415 INFO:tasks.workunit.client.1.smithi110.stdout:5/29: dwrite f9 [0,4194304] 0 2024-04-12T13:41:50.415 INFO:tasks.workunit.client.0.smithi060.stdout:5/74: read f2 [320777,51799] 0 2024-04-12T13:41:50.415 INFO:tasks.workunit.client.0.smithi060.stdout:1/51: chown f14 496665 1 2024-04-12T13:41:50.416 INFO:tasks.workunit.client.0.smithi060.stdout:7/71: fdatasync d0/d7/f10 0 2024-04-12T13:41:50.419 INFO:tasks.workunit.client.1.smithi110.stdout:6/107: sync 2024-04-12T13:41:50.421 INFO:tasks.workunit.client.1.smithi110.stdout:1/20: truncate f2 89948 0 2024-04-12T13:41:50.422 INFO:tasks.workunit.client.1.smithi110.stdout:9/103: creat df/f25 x:0 0 0 2024-04-12T13:41:50.424 INFO:tasks.workunit.client.1.smithi110.stdout:9/104: readlink df/l1a 0 2024-04-12T13:41:50.424 INFO:tasks.workunit.client.1.smithi110.stdout:4/149: rename d0/fb to d0/d13/f2d 0 2024-04-12T13:41:50.434 INFO:tasks.workunit.client.1.smithi110.stdout:3/67: dwrite d5/dc/f11 [0,4194304] 0 2024-04-12T13:41:50.437 INFO:tasks.workunit.client.0.smithi060.stdout:8/84: dwrite d9/fc [0,4194304] 0 2024-04-12T13:41:50.439 INFO:tasks.workunit.client.0.smithi060.stdout:7/72: mknod d0/d7/c18 0 2024-04-12T13:41:50.439 INFO:tasks.workunit.client.1.smithi110.stdout:2/42: dwrite f4 [0,4194304] 0 2024-04-12T13:41:50.441 INFO:tasks.workunit.client.0.smithi060.stdout:6/131: dwrite d1/d7/da/dc/d24/f1f [0,4194304] 0 2024-04-12T13:41:50.445 INFO:tasks.workunit.client.0.smithi060.stdout:1/52: unlink c10 0 2024-04-12T13:41:50.449 INFO:tasks.workunit.client.0.smithi060.stdout:8/85: read d9/d1b/f19 [101616,87846] 0 2024-04-12T13:41:50.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/42: dwrite f3 [0,4194304] 0 2024-04-12T13:41:50.468 INFO:tasks.workunit.client.0.smithi060.stdout:5/75: dwrite d6/f14 [0,4194304] 0 2024-04-12T13:41:50.473 INFO:tasks.workunit.client.1.smithi110.stdout:5/30: mkdir da 0 2024-04-12T13:41:50.478 INFO:tasks.workunit.client.0.smithi060.stdout:2/43: dread f3 [0,4194304] 0 2024-04-12T13:41:50.479 INFO:tasks.workunit.client.1.smithi110.stdout:7/47: rename d1/d3/d4/f6 to d1/d3/d4/fb 0 2024-04-12T13:41:50.484 INFO:tasks.workunit.client.1.smithi110.stdout:8/25: link d1/d3/l4 d1/d7/l8 0 2024-04-12T13:41:50.484 INFO:tasks.workunit.client.1.smithi110.stdout:8/26: chown f0 24731130 1 2024-04-12T13:41:50.485 INFO:tasks.workunit.client.1.smithi110.stdout:6/108: unlink l5 0 2024-04-12T13:41:50.485 INFO:tasks.workunit.client.0.smithi060.stdout:8/86: creat d9/d1b/f1e x:0 0 0 2024-04-12T13:41:50.487 INFO:tasks.workunit.client.1.smithi110.stdout:6/109: chown d7/d10/f20 21659254 1 2024-04-12T13:41:50.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/117: getdents d7/d9 0 2024-04-12T13:41:50.488 INFO:tasks.workunit.client.1.smithi110.stdout:4/150: creat d0/d19/f2e x:0 0 0 2024-04-12T13:41:50.489 INFO:tasks.workunit.client.0.smithi060.stdout:6/132: creat d1/d7/da/dc/f29 x:0 0 0 2024-04-12T13:41:50.490 INFO:tasks.workunit.client.1.smithi110.stdout:9/105: mkdir df/d13/d26 0 2024-04-12T13:41:50.495 INFO:tasks.workunit.client.0.smithi060.stdout:5/76: unlink d6/d10/f16 0 2024-04-12T13:41:50.496 INFO:tasks.workunit.client.1.smithi110.stdout:3/68: rmdir d5 39 2024-04-12T13:41:50.500 INFO:tasks.workunit.client.1.smithi110.stdout:2/43: unlink d6/f9 0 2024-04-12T13:41:50.500 INFO:tasks.workunit.client.1.smithi110.stdout:2/44: stat f4 0 2024-04-12T13:41:50.502 INFO:tasks.workunit.client.0.smithi060.stdout:2/44: rename f5 to d6/f8 0 2024-04-12T13:41:50.509 INFO:tasks.workunit.client.0.smithi060.stdout:0/118: creat d7/d9/d14/d1b/f2a x:0 0 0 2024-04-12T13:41:50.510 INFO:tasks.workunit.client.0.smithi060.stdout:0/119: dread - d7/d9/f1e zero size 2024-04-12T13:41:50.511 INFO:tasks.workunit.client.0.smithi060.stdout:4/66: sync 2024-04-12T13:41:50.511 INFO:tasks.workunit.client.0.smithi060.stdout:9/49: sync 2024-04-12T13:41:50.511 INFO:tasks.workunit.client.0.smithi060.stdout:0/120: stat d7/c29 0 2024-04-12T13:41:50.512 INFO:tasks.workunit.client.0.smithi060.stdout:7/73: creat d0/f19 x:0 0 0 2024-04-12T13:41:50.514 INFO:tasks.workunit.client.1.smithi110.stdout:7/48: creat d1/d3/d4/fc x:0 0 0 2024-04-12T13:41:50.515 INFO:tasks.workunit.client.0.smithi060.stdout:6/133: symlink d1/d7/da/dc/d24/l2a 0 2024-04-12T13:41:50.517 INFO:tasks.workunit.client.1.smithi110.stdout:1/21: dread f2 [0,4194304] 0 2024-04-12T13:41:50.522 INFO:tasks.workunit.client.1.smithi110.stdout:6/110: creat d7/d10/d1c/f27 x:0 0 0 2024-04-12T13:41:50.522 INFO:tasks.workunit.client.1.smithi110.stdout:9/106: creat df/d13/f27 x:0 0 0 2024-04-12T13:41:50.522 INFO:tasks.workunit.client.0.smithi060.stdout:1/53: creat f15 x:0 0 0 2024-04-12T13:41:50.523 INFO:tasks.workunit.client.1.smithi110.stdout:3/69: stat d5/dc/c14 0 2024-04-12T13:41:50.523 INFO:tasks.workunit.client.0.smithi060.stdout:2/45: creat d6/f9 x:0 0 0 2024-04-12T13:41:50.524 INFO:tasks.workunit.client.0.smithi060.stdout:9/50: mknod d4/d9/c11 0 2024-04-12T13:41:50.528 INFO:tasks.workunit.client.0.smithi060.stdout:0/121: unlink d7/d9/f17 0 2024-04-12T13:41:50.529 INFO:tasks.workunit.client.1.smithi110.stdout:5/31: mkdir da/db 0 2024-04-12T13:41:50.530 INFO:tasks.workunit.client.1.smithi110.stdout:5/32: readlink l6 0 2024-04-12T13:41:50.531 INFO:tasks.workunit.client.0.smithi060.stdout:4/67: creat d6/d7/dd/df/f18 x:0 0 0 2024-04-12T13:41:50.532 INFO:tasks.workunit.client.1.smithi110.stdout:0/41: truncate f0 2090780 0 2024-04-12T13:41:50.533 INFO:tasks.workunit.client.1.smithi110.stdout:4/151: write d0/de/d2c/f18 [2908616,55311] 0 2024-04-12T13:41:50.533 INFO:tasks.workunit.client.0.smithi060.stdout:0/122: dread d7/d9/f1c [0,4194304] 0 2024-04-12T13:41:50.534 INFO:tasks.workunit.client.1.smithi110.stdout:8/27: mknod d1/d7/c9 0 2024-04-12T13:41:50.535 INFO:tasks.workunit.client.1.smithi110.stdout:7/49: dwrite d1/d3/d4/f9 [0,4194304] 0 2024-04-12T13:41:50.536 INFO:tasks.workunit.client.0.smithi060.stdout:7/74: dwrite d0/f16 [0,4194304] 0 2024-04-12T13:41:50.536 INFO:tasks.workunit.client.1.smithi110.stdout:8/28: readlink d1/d3/l4 0 2024-04-12T13:41:50.537 INFO:tasks.workunit.client.0.smithi060.stdout:7/75: stat d0/fe 0 2024-04-12T13:41:50.538 INFO:tasks.workunit.client.1.smithi110.stdout:7/50: write d1/d3/d4/fc [878631,124573] 0 2024-04-12T13:41:50.539 INFO:tasks.workunit.client.1.smithi110.stdout:8/29: dread f0 [0,4194304] 0 2024-04-12T13:41:50.539 INFO:tasks.workunit.client.1.smithi110.stdout:1/22: rename f4 to f9 0 2024-04-12T13:41:50.540 INFO:tasks.workunit.client.0.smithi060.stdout:2/46: dread f3 [0,4194304] 0 2024-04-12T13:41:50.540 INFO:tasks.workunit.client.1.smithi110.stdout:6/111: creat d7/d10/d1c/f28 x:0 0 0 2024-04-12T13:41:50.545 INFO:tasks.workunit.client.0.smithi060.stdout:3/64: sync 2024-04-12T13:41:50.546 INFO:tasks.workunit.client.0.smithi060.stdout:8/87: creat d9/f1f x:0 0 0 2024-04-12T13:41:50.550 INFO:tasks.workunit.client.0.smithi060.stdout:4/68: rmdir d6 39 2024-04-12T13:41:50.550 INFO:tasks.workunit.client.0.smithi060.stdout:2/47: chown d6/f9 23679 1 2024-04-12T13:41:50.551 INFO:tasks.workunit.client.0.smithi060.stdout:5/77: truncate d6/f7 920021 0 2024-04-12T13:41:50.552 INFO:tasks.workunit.client.0.smithi060.stdout:8/88: truncate f1 2648092 0 2024-04-12T13:41:50.556 INFO:tasks.workunit.client.1.smithi110.stdout:5/33: creat da/fc x:0 0 0 2024-04-12T13:41:50.556 INFO:tasks.workunit.client.0.smithi060.stdout:5/78: write d6/f14 [1548565,98333] 0 2024-04-12T13:41:50.556 INFO:tasks.workunit.client.1.smithi110.stdout:2/45: truncate f0 1127372 0 2024-04-12T13:41:50.559 INFO:tasks.workunit.client.0.smithi060.stdout:1/54: mkdir d16 0 2024-04-12T13:41:50.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/51: fdatasync f2 0 2024-04-12T13:41:50.564 INFO:tasks.workunit.client.0.smithi060.stdout:6/134: dwrite d1/d7/da/d20/f26 [0,4194304] 0 2024-04-12T13:41:50.564 INFO:tasks.workunit.client.0.smithi060.stdout:5/79: dread f2 [0,4194304] 0 2024-04-12T13:41:50.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/48: creat d6/fa x:0 0 0 2024-04-12T13:41:50.569 INFO:tasks.workunit.client.1.smithi110.stdout:7/51: unlink d1/d3/d4/fc 0 2024-04-12T13:41:50.576 INFO:tasks.workunit.client.1.smithi110.stdout:4/152: dwrite d0/f5 [0,4194304] 0 2024-04-12T13:41:50.577 INFO:tasks.workunit.client.1.smithi110.stdout:1/23: rename f9 to fa 0 2024-04-12T13:41:50.579 INFO:tasks.workunit.client.0.smithi060.stdout:1/55: dread fb [0,4194304] 0 2024-04-12T13:41:50.581 INFO:tasks.workunit.client.1.smithi110.stdout:9/107: creat df/d13/d26/f28 x:0 0 0 2024-04-12T13:41:50.585 INFO:tasks.workunit.client.1.smithi110.stdout:8/30: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:50.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/52: symlink d4/l12 0 2024-04-12T13:41:50.589 INFO:tasks.workunit.client.1.smithi110.stdout:4/153: dread d0/d13/f2d [0,4194304] 0 2024-04-12T13:41:50.594 INFO:tasks.workunit.client.0.smithi060.stdout:4/69: dwrite d6/d7/dd/df/f12 [0,4194304] 0 2024-04-12T13:41:50.595 INFO:tasks.workunit.client.1.smithi110.stdout:7/52: creat d1/fd x:0 0 0 2024-04-12T13:41:50.599 INFO:tasks.workunit.client.0.smithi060.stdout:3/65: creat d7/da/dd/f13 x:0 0 0 2024-04-12T13:41:50.599 INFO:tasks.workunit.client.0.smithi060.stdout:6/135: dwrite d1/d7/da/dc/d1e/f28 [0,4194304] 0 2024-04-12T13:41:50.599 INFO:tasks.workunit.client.0.smithi060.stdout:4/70: readlink l3 0 2024-04-12T13:41:50.600 INFO:tasks.workunit.client.0.smithi060.stdout:2/49: fdatasync f4 0 2024-04-12T13:41:50.600 INFO:tasks.workunit.client.0.smithi060.stdout:6/136: chown d1/d7/da/d20/f26 99154930 1 2024-04-12T13:41:50.600 INFO:tasks.workunit.client.0.smithi060.stdout:0/123: rmdir d7/d9/d28 0 2024-04-12T13:41:50.601 INFO:tasks.workunit.client.1.smithi110.stdout:1/24: rename f8 to fb 0 2024-04-12T13:41:50.603 INFO:tasks.workunit.client.0.smithi060.stdout:4/71: write d6/d7/dd/df/f18 [237415,95611] 0 2024-04-12T13:41:50.605 INFO:tasks.workunit.client.1.smithi110.stdout:3/70: link d5/lf d5/l15 0 2024-04-12T13:41:50.607 INFO:tasks.workunit.client.0.smithi060.stdout:6/137: write d1/d7/da/ff [600129,48276] 0 2024-04-12T13:41:50.609 INFO:tasks.workunit.client.1.smithi110.stdout:9/108: symlink df/d13/d26/l29 0 2024-04-12T13:41:50.612 INFO:tasks.workunit.client.0.smithi060.stdout:6/138: chown d1/d7/ce 72 1 2024-04-12T13:41:50.612 INFO:tasks.workunit.client.1.smithi110.stdout:9/109: chown fc 16622375 1 2024-04-12T13:41:50.613 INFO:tasks.workunit.client.1.smithi110.stdout:2/46: fsync f0 0 2024-04-12T13:41:50.613 INFO:tasks.workunit.client.0.smithi060.stdout:7/76: rename d0/f12 to d0/f1a 0 2024-04-12T13:41:50.616 INFO:tasks.workunit.client.1.smithi110.stdout:2/47: truncate d6/f8 843353 0 2024-04-12T13:41:50.617 INFO:tasks.workunit.client.1.smithi110.stdout:5/34: symlink da/db/ld 0 2024-04-12T13:41:50.617 INFO:tasks.workunit.client.1.smithi110.stdout:2/48: fdatasync f3 0 2024-04-12T13:41:50.618 INFO:tasks.workunit.client.1.smithi110.stdout:2/49: fsync f3 0 2024-04-12T13:41:50.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/53: dread d4/d8/fb [0,4194304] 0 2024-04-12T13:41:50.619 INFO:tasks.workunit.client.0.smithi060.stdout:5/80: link d6/f14 d6/f17 0 2024-04-12T13:41:50.620 INFO:tasks.workunit.client.1.smithi110.stdout:8/31: rename d1/d7/c9 to d1/d5/ca 0 2024-04-12T13:41:50.623 INFO:tasks.workunit.client.0.smithi060.stdout:2/50: symlink d6/lb 0 2024-04-12T13:41:50.623 INFO:tasks.workunit.client.0.smithi060.stdout:4/72: dread f2 [0,4194304] 0 2024-04-12T13:41:50.624 INFO:tasks.workunit.client.1.smithi110.stdout:7/53: symlink d1/d3/le 0 2024-04-12T13:41:50.626 INFO:tasks.workunit.client.0.smithi060.stdout:3/66: rename d7/lc to d7/da/dd/l14 0 2024-04-12T13:41:50.627 INFO:tasks.workunit.client.1.smithi110.stdout:7/54: write d1/d3/d4/f9 [3968654,31815] 0 2024-04-12T13:41:50.628 INFO:tasks.workunit.client.0.smithi060.stdout:0/124: unlink d7/d9/d14/d1b/l27 0 2024-04-12T13:41:50.632 INFO:tasks.workunit.client.1.smithi110.stdout:1/25: symlink lc 0 2024-04-12T13:41:50.633 INFO:tasks.workunit.client.0.smithi060.stdout:8/89: rename d9/c18 to d9/c20 0 2024-04-12T13:41:50.633 INFO:tasks.workunit.client.1.smithi110.stdout:1/26: read - fa zero size 2024-04-12T13:41:50.635 INFO:tasks.workunit.client.1.smithi110.stdout:3/71: rename d5/dc/c14 to d5/dc/c16 0 2024-04-12T13:41:50.636 INFO:tasks.workunit.client.1.smithi110.stdout:5/35: dwrite da/fc [0,4194304] 0 2024-04-12T13:41:50.646 INFO:tasks.workunit.client.1.smithi110.stdout:2/50: creat d6/fb x:0 0 0 2024-04-12T13:41:50.648 INFO:tasks.workunit.client.1.smithi110.stdout:2/51: write d6/fb [387828,33441] 0 2024-04-12T13:41:50.648 INFO:tasks.workunit.client.0.smithi060.stdout:5/81: mknod d6/d10/d12/c18 0 2024-04-12T13:41:50.651 INFO:tasks.workunit.client.0.smithi060.stdout:2/51: symlink d6/lc 0 2024-04-12T13:41:50.656 INFO:tasks.workunit.client.0.smithi060.stdout:4/73: fsync f2 0 2024-04-12T13:41:50.657 INFO:tasks.workunit.client.0.smithi060.stdout:0/125: dwrite d7/d9/f23 [0,4194304] 0 2024-04-12T13:41:50.658 INFO:tasks.workunit.client.1.smithi110.stdout:7/55: mknod d1/cf 0 2024-04-12T13:41:50.660 INFO:tasks.workunit.client.1.smithi110.stdout:0/42: dwrite f0 [0,4194304] 0 2024-04-12T13:41:50.661 INFO:tasks.workunit.client.0.smithi060.stdout:3/67: symlink d7/da/dd/l15 0 2024-04-12T13:41:50.664 INFO:tasks.workunit.client.0.smithi060.stdout:3/68: dread - d7/da/dd/f13 zero size 2024-04-12T13:41:50.664 INFO:tasks.workunit.client.0.smithi060.stdout:8/90: creat d9/da/f21 x:0 0 0 2024-04-12T13:41:50.666 INFO:tasks.workunit.client.0.smithi060.stdout:1/56: rmdir d16 0 2024-04-12T13:41:50.668 INFO:tasks.workunit.client.1.smithi110.stdout:8/32: write f0 [573805,47476] 0 2024-04-12T13:41:50.672 INFO:tasks.workunit.client.0.smithi060.stdout:6/139: mknod d1/d7/c2b 0 2024-04-12T13:41:50.677 INFO:tasks.workunit.client.1.smithi110.stdout:5/36: rmdir da/db 39 2024-04-12T13:41:50.677 INFO:tasks.workunit.client.0.smithi060.stdout:5/82: dread d6/fc [0,4194304] 0 2024-04-12T13:41:50.679 INFO:tasks.workunit.client.1.smithi110.stdout:8/33: fdatasync f0 0 2024-04-12T13:41:50.682 INFO:tasks.workunit.client.1.smithi110.stdout:2/52: read f0 [172810,117712] 0 2024-04-12T13:41:50.685 INFO:tasks.workunit.client.1.smithi110.stdout:0/43: dwrite d1/fd [0,4194304] 0 2024-04-12T13:41:50.685 INFO:tasks.workunit.client.1.smithi110.stdout:6/112: getdents d7/d10/d12 0 2024-04-12T13:41:50.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/126: dread d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:50.689 INFO:tasks.workunit.client.0.smithi060.stdout:2/52: dwrite d6/fa [0,4194304] 0 2024-04-12T13:41:50.690 INFO:tasks.workunit.client.0.smithi060.stdout:8/91: symlink d9/d1b/l22 0 2024-04-12T13:41:50.690 INFO:tasks.workunit.client.1.smithi110.stdout:1/27: truncate f5 748215 0 2024-04-12T13:41:50.691 INFO:tasks.workunit.client.1.smithi110.stdout:2/53: chown f0 1185 1 2024-04-12T13:41:50.693 INFO:tasks.workunit.client.1.smithi110.stdout:8/34: write d1/f2 [4892784,101291] 0 2024-04-12T13:41:50.696 INFO:tasks.workunit.client.0.smithi060.stdout:6/140: mkdir d1/d2c 0 2024-04-12T13:41:50.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/127: write d7/d9/d14/f25 [897732,113719] 0 2024-04-12T13:41:50.700 INFO:tasks.workunit.client.1.smithi110.stdout:1/28: dread f2 [0,4194304] 0 2024-04-12T13:41:50.700 INFO:tasks.workunit.client.0.smithi060.stdout:9/54: truncate d4/d8/fa 1848044 0 2024-04-12T13:41:50.701 INFO:tasks.workunit.client.1.smithi110.stdout:4/154: getdents d0 0 2024-04-12T13:41:50.701 INFO:tasks.workunit.client.1.smithi110.stdout:3/72: dwrite d5/dc/f12 [0,4194304] 0 2024-04-12T13:41:50.704 INFO:tasks.workunit.client.0.smithi060.stdout:5/83: rename d6/le to d6/d10/d12/l19 0 2024-04-12T13:41:50.704 INFO:tasks.workunit.client.0.smithi060.stdout:6/141: read - d1/f14 zero size 2024-04-12T13:41:50.704 INFO:tasks.workunit.client.1.smithi110.stdout:6/113: creat d7/d10/d1c/f29 x:0 0 0 2024-04-12T13:41:50.705 INFO:tasks.workunit.client.0.smithi060.stdout:2/53: truncate d6/f9 791150 0 2024-04-12T13:41:50.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/55: readlink l3 0 2024-04-12T13:41:50.705 INFO:tasks.workunit.client.0.smithi060.stdout:1/57: dread f7 [0,4194304] 0 2024-04-12T13:41:50.707 INFO:tasks.workunit.client.0.smithi060.stdout:7/77: getdents d0/d7 0 2024-04-12T13:41:50.707 INFO:tasks.workunit.client.0.smithi060.stdout:3/69: dwrite d7/da/dd/f13 [0,4194304] 0 2024-04-12T13:41:50.709 INFO:tasks.workunit.client.0.smithi060.stdout:2/54: symlink d6/ld 0 2024-04-12T13:41:50.709 INFO:tasks.workunit.client.0.smithi060.stdout:0/128: truncate d7/f11 8610040 0 2024-04-12T13:41:50.711 INFO:tasks.workunit.client.0.smithi060.stdout:2/55: chown c0 3586 1 2024-04-12T13:41:50.711 INFO:tasks.workunit.client.0.smithi060.stdout:1/58: dread - f13 zero size 2024-04-12T13:41:50.711 INFO:tasks.workunit.client.0.smithi060.stdout:9/56: rename d4/c5 to d4/c13 0 2024-04-12T13:41:50.712 INFO:tasks.workunit.client.0.smithi060.stdout:5/84: mkdir d6/d10/d12/d13/d1a 0 2024-04-12T13:41:50.713 INFO:tasks.workunit.client.1.smithi110.stdout:5/37: creat da/db/fe x:0 0 0 2024-04-12T13:41:50.715 INFO:tasks.workunit.client.0.smithi060.stdout:3/70: mknod d7/da/dd/c16 0 2024-04-12T13:41:50.716 INFO:tasks.workunit.client.1.smithi110.stdout:1/29: mknod cd 0 2024-04-12T13:41:50.720 INFO:tasks.workunit.client.0.smithi060.stdout:0/129: creat d7/d9/f2b x:0 0 0 2024-04-12T13:41:50.720 INFO:tasks.workunit.client.1.smithi110.stdout:3/73: symlink d5/l17 0 2024-04-12T13:41:50.723 INFO:tasks.workunit.client.0.smithi060.stdout:1/59: write f13 [117623,32698] 0 2024-04-12T13:41:50.725 INFO:tasks.workunit.client.0.smithi060.stdout:2/56: mknod d6/ce 0 2024-04-12T13:41:50.727 INFO:tasks.workunit.client.1.smithi110.stdout:4/155: symlink d0/l2f 0 2024-04-12T13:41:50.730 INFO:tasks.workunit.client.0.smithi060.stdout:9/57: rename l1 to d4/l14 0 2024-04-12T13:41:50.735 INFO:tasks.workunit.client.0.smithi060.stdout:3/71: mkdir d7/d17 0 2024-04-12T13:41:50.735 INFO:tasks.workunit.client.0.smithi060.stdout:7/78: dwrite d0/f8 [0,4194304] 0 2024-04-12T13:41:50.737 INFO:tasks.workunit.client.1.smithi110.stdout:9/110: dwrite fd [0,4194304] 0 2024-04-12T13:41:50.739 INFO:tasks.workunit.client.1.smithi110.stdout:5/38: creat da/db/ff x:0 0 0 2024-04-12T13:41:50.739 INFO:tasks.workunit.client.0.smithi060.stdout:4/74: truncate f2 2541453 0 2024-04-12T13:41:50.741 INFO:tasks.workunit.client.1.smithi110.stdout:2/54: dread f3 [0,4194304] 0 2024-04-12T13:41:50.741 INFO:tasks.workunit.client.1.smithi110.stdout:6/114: symlink d7/l2a 0 2024-04-12T13:41:50.741 INFO:tasks.workunit.client.0.smithi060.stdout:3/72: write d7/da/dd/f13 [3545525,7976] 0 2024-04-12T13:41:50.746 INFO:tasks.workunit.client.0.smithi060.stdout:1/60: write f7 [2294824,25942] 0 2024-04-12T13:41:50.746 INFO:tasks.workunit.client.1.smithi110.stdout:3/74: write d5/dc/f12 [673231,88678] 0 2024-04-12T13:41:50.747 INFO:tasks.workunit.client.0.smithi060.stdout:9/58: fsync f2 0 2024-04-12T13:41:50.750 INFO:tasks.workunit.client.1.smithi110.stdout:7/56: dwrite d1/d3/d4/fb [4194304,4194304] 0 2024-04-12T13:41:50.752 INFO:tasks.workunit.client.0.smithi060.stdout:5/85: creat d6/d10/d12/d13/d1a/f1b x:0 0 0 2024-04-12T13:41:50.752 INFO:tasks.workunit.client.0.smithi060.stdout:0/130: dwrite d7/d9/f2b [0,4194304] 0 2024-04-12T13:41:50.753 INFO:tasks.workunit.client.1.smithi110.stdout:2/55: read d6/fb [138285,15103] 0 2024-04-12T13:41:50.755 INFO:tasks.workunit.client.1.smithi110.stdout:9/111: chown df/f11 15419032 1 2024-04-12T13:41:50.756 INFO:tasks.workunit.client.1.smithi110.stdout:3/75: rename d5/dc to d5/dc/d18 22 2024-04-12T13:41:50.757 INFO:tasks.workunit.client.1.smithi110.stdout:0/44: dwrite d1/d8/fb [0,4194304] 0 2024-04-12T13:41:50.757 INFO:tasks.workunit.client.0.smithi060.stdout:2/57: rename c1 to d6/cf 0 2024-04-12T13:41:50.758 INFO:tasks.workunit.client.0.smithi060.stdout:7/79: write d0/f1a [598340,49205] 0 2024-04-12T13:41:50.762 INFO:tasks.workunit.client.1.smithi110.stdout:0/45: write f0 [1077766,120853] 0 2024-04-12T13:41:50.763 INFO:tasks.workunit.client.1.smithi110.stdout:8/35: dwrite f0 [0,4194304] 0 2024-04-12T13:41:50.772 INFO:tasks.workunit.client.0.smithi060.stdout:3/73: rmdir d7 39 2024-04-12T13:41:50.777 INFO:tasks.workunit.client.1.smithi110.stdout:7/57: dread d1/d3/d4/fb [0,4194304] 0 2024-04-12T13:41:50.778 INFO:tasks.workunit.client.0.smithi060.stdout:6/142: truncate d1/f15 2647596 0 2024-04-12T13:41:50.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/80: dwrite d0/f16 [0,4194304] 0 2024-04-12T13:41:50.787 INFO:tasks.workunit.client.0.smithi060.stdout:2/58: mkdir d6/d10 0 2024-04-12T13:41:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:4/75: mkdir d6/d7/d13/d19 0 2024-04-12T13:41:50.792 INFO:tasks.workunit.client.1.smithi110.stdout:8/36: dwrite f0 [0,4194304] 0 2024-04-12T13:41:50.798 INFO:tasks.workunit.client.0.smithi060.stdout:1/61: symlink l17 0 2024-04-12T13:41:50.804 INFO:tasks.workunit.client.0.smithi060.stdout:6/143: mkdir d1/d7/da/dc/d24/d2d 0 2024-04-12T13:41:50.809 INFO:tasks.workunit.client.0.smithi060.stdout:0/131: mknod d7/c2c 0 2024-04-12T13:41:50.810 INFO:tasks.workunit.client.0.smithi060.stdout:3/74: dread d7/f8 [4194304,4194304] 0 2024-04-12T13:41:50.811 INFO:tasks.workunit.client.1.smithi110.stdout:8/37: dread d1/f2 [0,4194304] 0 2024-04-12T13:41:50.820 INFO:tasks.workunit.client.0.smithi060.stdout:7/81: mkdir d0/d1b 0 2024-04-12T13:41:50.820 INFO:tasks.workunit.client.0.smithi060.stdout:5/86: write d6/f14 [148007,63845] 0 2024-04-12T13:41:50.824 INFO:tasks.workunit.client.0.smithi060.stdout:2/59: getdents d6/d10 0 2024-04-12T13:41:50.825 INFO:tasks.workunit.client.0.smithi060.stdout:4/76: rename d6/d7/d13 to d6/d7/dd/d1a 0 2024-04-12T13:41:50.834 INFO:tasks.workunit.client.0.smithi060.stdout:1/62: rename l17 to l18 0 2024-04-12T13:41:50.835 INFO:tasks.workunit.client.0.smithi060.stdout:1/63: chown l12 12843 1 2024-04-12T13:41:50.837 INFO:tasks.workunit.client.0.smithi060.stdout:3/75: rename d7/da/dd/lf to d7/l18 0 2024-04-12T13:41:50.839 INFO:tasks.workunit.client.0.smithi060.stdout:4/77: creat d6/d7/dd/d1a/d19/f1b x:0 0 0 2024-04-12T13:41:50.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/87: rename d6/d10/d12/d13 to d6/d10/d1c 0 2024-04-12T13:41:50.849 INFO:tasks.workunit.client.0.smithi060.stdout:6/144: fdatasync d1/f15 0 2024-04-12T13:41:50.854 INFO:tasks.workunit.client.0.smithi060.stdout:9/59: write d4/d8/fa [45569,110004] 0 2024-04-12T13:41:50.855 INFO:tasks.workunit.client.0.smithi060.stdout:2/60: rename c2 to d6/d10/c11 0 2024-04-12T13:41:50.860 INFO:tasks.workunit.client.0.smithi060.stdout:6/145: symlink d1/d7/da/d20/l2e 0 2024-04-12T13:41:50.863 INFO:tasks.workunit.client.0.smithi060.stdout:4/78: fsync f2 0 2024-04-12T13:41:50.865 INFO:tasks.workunit.client.0.smithi060.stdout:1/64: creat f19 x:0 0 0 2024-04-12T13:41:50.871 INFO:tasks.workunit.client.0.smithi060.stdout:6/146: creat d1/d7/da/dc/d1e/f2f x:0 0 0 2024-04-12T13:41:50.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/76: dwrite d7/f8 [4194304,4194304] 0 2024-04-12T13:41:50.873 INFO:tasks.workunit.client.0.smithi060.stdout:6/147: write d1/d7/da/ff [256132,15085] 0 2024-04-12T13:41:50.875 INFO:tasks.workunit.client.0.smithi060.stdout:6/148: chown d1/d7/c12 6015 1 2024-04-12T13:41:50.885 INFO:tasks.workunit.client.0.smithi060.stdout:4/79: rename d6/ca to d6/d7/dd/d1a/c1c 0 2024-04-12T13:41:50.887 INFO:tasks.workunit.client.0.smithi060.stdout:5/88: dwrite d6/fc [0,4194304] 0 2024-04-12T13:41:50.890 INFO:tasks.workunit.client.0.smithi060.stdout:5/89: stat d6/d10/d12/d15 0 2024-04-12T13:41:50.891 INFO:tasks.workunit.client.0.smithi060.stdout:4/80: creat d6/d7/dd/d1a/f1d x:0 0 0 2024-04-12T13:41:50.893 INFO:tasks.workunit.client.0.smithi060.stdout:6/149: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:50.895 INFO:tasks.workunit.client.0.smithi060.stdout:2/61: getdents d6 0 2024-04-12T13:41:50.900 INFO:tasks.workunit.client.0.smithi060.stdout:5/90: rmdir d6/d10 39 2024-04-12T13:41:50.908 INFO:tasks.workunit.client.0.smithi060.stdout:4/81: rename d6/c9 to d6/d7/db/c1e 0 2024-04-12T13:41:50.911 INFO:tasks.workunit.client.0.smithi060.stdout:6/150: write d1/d7/da/dc/d1e/f23 [2378735,44047] 0 2024-04-12T13:41:50.915 INFO:tasks.workunit.client.0.smithi060.stdout:1/65: link l9 l1a 0 2024-04-12T13:41:50.920 INFO:tasks.workunit.client.0.smithi060.stdout:2/62: dwrite f4 [0,4194304] 0 2024-04-12T13:41:50.920 INFO:tasks.workunit.client.0.smithi060.stdout:5/91: rmdir d6/d10/d1c 39 2024-04-12T13:41:50.920 INFO:tasks.workunit.client.0.smithi060.stdout:4/82: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:41:50.921 INFO:tasks.workunit.client.0.smithi060.stdout:5/92: read d6/fc [923590,37771] 0 2024-04-12T13:41:50.925 INFO:tasks.workunit.client.0.smithi060.stdout:6/151: mkdir d1/d7/da/dc/d24/d30 0 2024-04-12T13:41:50.929 INFO:tasks.workunit.client.0.smithi060.stdout:6/152: dread - d1/d7/da/dc/f29 zero size 2024-04-12T13:41:50.931 INFO:tasks.workunit.client.0.smithi060.stdout:1/66: mkdir d1b 0 2024-04-12T13:41:50.932 INFO:tasks.workunit.client.0.smithi060.stdout:4/83: rename d6/d7/dd/d1a/f1d to d6/d7/dd/d1a/d19/f1f 0 2024-04-12T13:41:50.936 INFO:tasks.workunit.client.0.smithi060.stdout:5/93: dread d6/f9 [0,4194304] 0 2024-04-12T13:41:50.948 INFO:tasks.workunit.client.0.smithi060.stdout:6/153: dwrite d1/d7/da/dc/d1e/f23 [0,4194304] 0 2024-04-12T13:41:50.951 INFO:tasks.workunit.client.0.smithi060.stdout:1/67: dwrite f13 [0,4194304] 0 2024-04-12T13:41:50.952 INFO:tasks.workunit.client.0.smithi060.stdout:1/68: chown f7 474699 1 2024-04-12T13:41:50.953 INFO:tasks.workunit.client.0.smithi060.stdout:1/69: write f19 [852962,29917] 0 2024-04-12T13:41:51.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/84: creat d6/d7/dd/df/f20 x:0 0 0 2024-04-12T13:41:51.057 INFO:tasks.workunit.client.0.smithi060.stdout:5/94: dread - d6/d10/d1c/d1a/f1b zero size 2024-04-12T13:41:51.060 INFO:tasks.workunit.client.0.smithi060.stdout:2/63: link d6/c7 d6/d10/c12 0 2024-04-12T13:41:51.062 INFO:tasks.workunit.client.1.smithi110.stdout:5/39: symlink da/db/l10 0 2024-04-12T13:41:51.066 INFO:tasks.workunit.client.0.smithi060.stdout:6/154: symlink d1/d7/da/dc/d24/l31 0 2024-04-12T13:41:51.069 INFO:tasks.workunit.client.0.smithi060.stdout:1/70: truncate f2 1664824 0 2024-04-12T13:41:51.074 INFO:tasks.workunit.client.1.smithi110.stdout:6/115: mkdir d7/d10/d1c/d2b 0 2024-04-12T13:41:51.079 INFO:tasks.workunit.client.1.smithi110.stdout:2/56: unlink f3 0 2024-04-12T13:41:51.087 INFO:tasks.workunit.client.1.smithi110.stdout:2/57: fdatasync f4 0 2024-04-12T13:41:51.087 INFO:tasks.workunit.client.1.smithi110.stdout:3/76: rmdir d5 39 2024-04-12T13:41:51.088 INFO:tasks.workunit.client.0.smithi060.stdout:6/155: rename d1/c5 to d1/d7/da/c32 0 2024-04-12T13:41:51.090 INFO:tasks.workunit.client.1.smithi110.stdout:2/58: chown d6/c7 573 1 2024-04-12T13:41:51.094 INFO:tasks.workunit.client.0.smithi060.stdout:2/64: dwrite f4 [0,4194304] 0 2024-04-12T13:41:51.094 INFO:tasks.workunit.client.1.smithi110.stdout:2/59: truncate d6/f8 938596 0 2024-04-12T13:41:51.097 INFO:tasks.workunit.client.1.smithi110.stdout:9/112: symlink df/d13/l2a 0 2024-04-12T13:41:51.112 INFO:tasks.workunit.client.0.smithi060.stdout:6/156: dread d1/d7/da/dc/d24/f1f [0,4194304] 0 2024-04-12T13:41:51.114 INFO:tasks.workunit.client.1.smithi110.stdout:6/116: dread d7/d10/d12/f21 [0,4194304] 0 2024-04-12T13:41:51.115 INFO:tasks.workunit.client.1.smithi110.stdout:0/46: unlink d1/l3 0 2024-04-12T13:41:51.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/157: fsync d1/d7/da/dc/d1e/f2f 0 2024-04-12T13:41:51.118 INFO:tasks.workunit.client.1.smithi110.stdout:6/117: write d7/f1a [2642856,5909] 0 2024-04-12T13:41:51.120 INFO:tasks.workunit.client.0.smithi060.stdout:6/158: read d1/d7/da/dc/d1e/f28 [3557027,19200] 0 2024-04-12T13:41:51.122 INFO:tasks.workunit.client.0.smithi060.stdout:1/71: rmdir d1b 0 2024-04-12T13:41:51.124 INFO:tasks.workunit.client.0.smithi060.stdout:1/72: dread - f15 zero size 2024-04-12T13:41:51.124 INFO:tasks.workunit.client.0.smithi060.stdout:6/159: fdatasync d1/d7/da/dc/d1e/f28 0 2024-04-12T13:41:51.127 INFO:tasks.workunit.client.0.smithi060.stdout:8/92: sync 2024-04-12T13:41:51.131 INFO:tasks.workunit.client.0.smithi060.stdout:4/85: getdents d6/d7/dd/d1a 0 2024-04-12T13:41:51.131 INFO:tasks.workunit.client.1.smithi110.stdout:6/118: fsync d7/f1a 0 2024-04-12T13:41:51.131 INFO:tasks.workunit.client.0.smithi060.stdout:5/95: write f1 [765555,89131] 0 2024-04-12T13:41:51.133 INFO:tasks.workunit.client.0.smithi060.stdout:5/96: chown f1 5796 1 2024-04-12T13:41:51.137 INFO:tasks.workunit.client.0.smithi060.stdout:2/65: getdents d6 0 2024-04-12T13:41:51.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/86: truncate f2 2644854 0 2024-04-12T13:41:51.144 INFO:tasks.workunit.client.1.smithi110.stdout:2/60: mkdir d6/dc 0 2024-04-12T13:41:51.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/87: readlink l3 0 2024-04-12T13:41:51.147 INFO:tasks.workunit.client.1.smithi110.stdout:9/113: mknod df/d13/c2b 0 2024-04-12T13:41:51.147 INFO:tasks.workunit.client.0.smithi060.stdout:4/88: dread - d6/d7/dd/d1a/d19/f1f zero size 2024-04-12T13:41:51.148 INFO:tasks.workunit.client.1.smithi110.stdout:4/156: dwrite d0/f15 [4194304,4194304] 0 2024-04-12T13:41:51.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/89: readlink l3 0 2024-04-12T13:41:51.157 INFO:tasks.workunit.client.1.smithi110.stdout:0/47: creat d1/fe x:0 0 0 2024-04-12T13:41:51.160 INFO:tasks.workunit.client.0.smithi060.stdout:4/90: dread d6/d7/dd/df/f18 [0,4194304] 0 2024-04-12T13:41:51.160 INFO:tasks.workunit.client.0.smithi060.stdout:2/66: dwrite f4 [0,4194304] 0 2024-04-12T13:41:51.163 INFO:tasks.workunit.client.0.smithi060.stdout:5/97: mknod d6/d10/d12/d15/c1d 0 2024-04-12T13:41:51.165 INFO:tasks.workunit.client.0.smithi060.stdout:5/98: chown d6/dd 1235306 1 2024-04-12T13:41:51.168 INFO:tasks.workunit.client.0.smithi060.stdout:6/160: link d1/d7/l1c d1/d2c/l33 0 2024-04-12T13:41:51.170 INFO:tasks.workunit.client.1.smithi110.stdout:0/48: write d1/d8/fb [1916044,106335] 0 2024-04-12T13:41:51.170 INFO:tasks.workunit.client.1.smithi110.stdout:7/58: truncate d1/d3/d4/f9 3623195 0 2024-04-12T13:41:51.171 INFO:tasks.workunit.client.0.smithi060.stdout:1/73: dwrite f13 [4194304,4194304] 0 2024-04-12T13:41:51.171 INFO:tasks.workunit.client.0.smithi060.stdout:2/67: mkdir d6/d13 0 2024-04-12T13:41:51.172 INFO:tasks.workunit.client.1.smithi110.stdout:6/119: dwrite d7/d10/d12/f1e [0,4194304] 0 2024-04-12T13:41:51.175 INFO:tasks.workunit.client.0.smithi060.stdout:8/93: dwrite f2 [0,4194304] 0 2024-04-12T13:41:51.179 INFO:tasks.workunit.client.0.smithi060.stdout:4/91: write d6/d7/dd/df/f18 [89271,84910] 0 2024-04-12T13:41:51.179 INFO:tasks.workunit.client.0.smithi060.stdout:8/94: truncate d9/f1f 268462 0 2024-04-12T13:41:51.180 INFO:tasks.workunit.client.0.smithi060.stdout:2/68: creat d6/f14 x:0 0 0 2024-04-12T13:41:51.182 INFO:tasks.workunit.client.1.smithi110.stdout:0/49: chown d1/fe 2 1 2024-04-12T13:41:51.182 INFO:tasks.workunit.client.1.smithi110.stdout:3/77: creat d5/dc/f19 x:0 0 0 2024-04-12T13:41:51.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/161: rename d1/d7/da/dc/d1e to d1/d7/da/dc/d24/d34 0 2024-04-12T13:41:51.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/162: chown d1 944009574 1 2024-04-12T13:41:51.186 INFO:tasks.workunit.client.0.smithi060.stdout:6/163: chown d1/d7/da/dc/d24/d2d 97 1 2024-04-12T13:41:51.187 INFO:tasks.workunit.client.0.smithi060.stdout:8/95: fsync d9/d1b/f19 0 2024-04-12T13:41:51.189 INFO:tasks.workunit.client.0.smithi060.stdout:2/69: creat d6/f15 x:0 0 0 2024-04-12T13:41:51.190 INFO:tasks.workunit.client.0.smithi060.stdout:6/164: creat d1/d7/da/dc/f35 x:0 0 0 2024-04-12T13:41:51.191 INFO:tasks.workunit.client.1.smithi110.stdout:0/50: chown d1/d8 59706 1 2024-04-12T13:41:51.192 INFO:tasks.workunit.client.1.smithi110.stdout:7/59: mknod d1/d3/d4/c10 0 2024-04-12T13:41:51.192 INFO:tasks.workunit.client.1.smithi110.stdout:4/157: stat d0/d13 0 2024-04-12T13:41:51.194 INFO:tasks.workunit.client.0.smithi060.stdout:4/92: rename d6/d7/dd/d15 to d6/d21 0 2024-04-12T13:41:51.195 INFO:tasks.workunit.client.0.smithi060.stdout:4/93: chown d6/d7/dd/d1a/d19 84 1 2024-04-12T13:41:51.196 INFO:tasks.workunit.client.1.smithi110.stdout:5/40: creat da/f11 x:0 0 0 2024-04-12T13:41:51.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/94: dread d6/d7/dd/df/f18 [0,4194304] 0 2024-04-12T13:41:51.199 INFO:tasks.workunit.client.1.smithi110.stdout:8/38: getdents d1/d5 0 2024-04-12T13:41:51.199 INFO:tasks.workunit.client.0.smithi060.stdout:6/165: creat d1/d7/da/d20/f36 x:0 0 0 2024-04-12T13:41:51.205 INFO:tasks.workunit.client.1.smithi110.stdout:9/114: dwrite df/d13/d26/f28 [0,4194304] 0 2024-04-12T13:41:51.206 INFO:tasks.workunit.client.0.smithi060.stdout:6/166: chown d1/d7/da/dc/d24/l2a 11662 1 2024-04-12T13:41:51.208 INFO:tasks.workunit.client.1.smithi110.stdout:6/120: chown d7/d10/d12/l17 416327 1 2024-04-12T13:41:51.212 INFO:tasks.workunit.client.0.smithi060.stdout:1/74: fdatasync f2 0 2024-04-12T13:41:51.212 INFO:tasks.workunit.client.0.smithi060.stdout:2/70: dwrite d6/fa [0,4194304] 0 2024-04-12T13:41:51.214 INFO:tasks.workunit.client.1.smithi110.stdout:0/51: rmdir d1 39 2024-04-12T13:41:51.214 INFO:tasks.workunit.client.1.smithi110.stdout:1/30: dwrite f5 [0,4194304] 0 2024-04-12T13:41:51.215 INFO:tasks.workunit.client.0.smithi060.stdout:8/96: rename d9/f17 to d9/f23 0 2024-04-12T13:41:51.220 INFO:tasks.workunit.client.0.smithi060.stdout:8/97: write d9/d1b/f1e [1004041,125285] 0 2024-04-12T13:41:51.222 INFO:tasks.workunit.client.0.smithi060.stdout:8/98: fdatasync f2 0 2024-04-12T13:41:51.224 INFO:tasks.workunit.client.0.smithi060.stdout:6/167: readlink d1/d2c/l33 0 2024-04-12T13:41:51.227 INFO:tasks.workunit.client.1.smithi110.stdout:8/39: fdatasync d1/f2 0 2024-04-12T13:41:51.227 INFO:tasks.workunit.client.1.smithi110.stdout:3/78: dread d5/dc/f11 [0,4194304] 0 2024-04-12T13:41:51.229 INFO:tasks.workunit.client.0.smithi060.stdout:4/95: dwrite d6/d7/dd/df/f12 [0,4194304] 0 2024-04-12T13:41:51.230 INFO:tasks.workunit.client.0.smithi060.stdout:1/75: chown l9 2457587 1 2024-04-12T13:41:51.233 INFO:tasks.workunit.client.0.smithi060.stdout:4/96: chown d6/d7/dd/d1a/c1c 14121885 1 2024-04-12T13:41:51.234 INFO:tasks.workunit.client.0.smithi060.stdout:4/97: readlink l3 0 2024-04-12T13:41:51.234 INFO:tasks.workunit.client.1.smithi110.stdout:8/40: read f0 [934077,70658] 0 2024-04-12T13:41:51.235 INFO:tasks.workunit.client.0.smithi060.stdout:5/99: truncate d6/f9 3878218 0 2024-04-12T13:41:51.235 INFO:tasks.workunit.client.1.smithi110.stdout:3/79: readlink d5/l7 0 2024-04-12T13:41:51.236 INFO:tasks.workunit.client.1.smithi110.stdout:7/60: dread d1/d3/d4/fb [4194304,4194304] 0 2024-04-12T13:41:51.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/71: chown c0 0 1 2024-04-12T13:41:51.238 INFO:tasks.workunit.client.0.smithi060.stdout:2/72: dread - d6/f14 zero size 2024-04-12T13:41:51.238 INFO:tasks.workunit.client.1.smithi110.stdout:9/115: write df/d13/d26/f28 [4284936,115123] 0 2024-04-12T13:41:51.241 INFO:tasks.workunit.client.0.smithi060.stdout:4/98: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:41:51.243 INFO:tasks.workunit.client.0.smithi060.stdout:6/168: write d1/d7/da/dc/d24/f1f [257621,91807] 0 2024-04-12T13:41:51.245 INFO:tasks.workunit.client.0.smithi060.stdout:4/99: write d6/d7/dd/d1a/d19/f1b [813027,123053] 0 2024-04-12T13:41:51.252 INFO:tasks.workunit.client.1.smithi110.stdout:6/121: mkdir d7/d25/d2c 0 2024-04-12T13:41:51.253 INFO:tasks.workunit.client.0.smithi060.stdout:6/169: creat d1/d7/da/dc/d24/f37 x:0 0 0 2024-04-12T13:41:51.253 INFO:tasks.workunit.client.1.smithi110.stdout:5/41: dread f7 [0,4194304] 0 2024-04-12T13:41:51.256 INFO:tasks.workunit.client.0.smithi060.stdout:4/100: fsync d6/d7/dd/d1a/d19/f1f 0 2024-04-12T13:41:51.258 INFO:tasks.workunit.client.1.smithi110.stdout:3/80: rmdir d5/dc 39 2024-04-12T13:41:51.259 INFO:tasks.workunit.client.1.smithi110.stdout:5/42: chown f8 14 1 2024-04-12T13:41:51.262 INFO:tasks.workunit.client.0.smithi060.stdout:2/73: dwrite d6/fa [0,4194304] 0 2024-04-12T13:41:51.262 INFO:tasks.workunit.client.1.smithi110.stdout:0/52: creat d1/d8/ff x:0 0 0 2024-04-12T13:41:51.263 INFO:tasks.workunit.client.1.smithi110.stdout:2/61: dwrite f0 [0,4194304] 0 2024-04-12T13:41:51.263 INFO:tasks.workunit.client.1.smithi110.stdout:5/43: write f8 [919112,79348] 0 2024-04-12T13:41:51.264 INFO:tasks.workunit.client.0.smithi060.stdout:2/74: write d6/f14 [332114,76240] 0 2024-04-12T13:41:51.265 INFO:tasks.workunit.client.0.smithi060.stdout:6/170: write d1/d7/da/ff [1550966,100597] 0 2024-04-12T13:41:51.267 INFO:tasks.workunit.client.0.smithi060.stdout:4/101: creat d6/d7/db/f22 x:0 0 0 2024-04-12T13:41:51.267 INFO:tasks.workunit.client.1.smithi110.stdout:2/62: chown c1 7434345 1 2024-04-12T13:41:51.269 INFO:tasks.workunit.client.1.smithi110.stdout:2/63: chown d6/dc 13746640 1 2024-04-12T13:41:51.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/100: creat d6/f1e x:0 0 0 2024-04-12T13:41:51.269 INFO:tasks.workunit.client.1.smithi110.stdout:7/61: rename d1/d3/fa to d1/d3/f11 0 2024-04-12T13:41:51.270 INFO:tasks.workunit.client.1.smithi110.stdout:4/158: dwrite d0/f5 [0,4194304] 0 2024-04-12T13:41:51.273 INFO:tasks.workunit.client.1.smithi110.stdout:8/41: rename f0 to d1/d7/fb 0 2024-04-12T13:41:51.274 INFO:tasks.workunit.client.1.smithi110.stdout:4/159: write d0/d13/f21 [1125180,40495] 0 2024-04-12T13:41:51.277 INFO:tasks.workunit.client.0.smithi060.stdout:2/75: write f3 [1993602,112650] 0 2024-04-12T13:41:51.282 INFO:tasks.workunit.client.1.smithi110.stdout:6/122: creat d7/d10/d12/f2d x:0 0 0 2024-04-12T13:41:51.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/82: sync 2024-04-12T13:41:51.285 INFO:tasks.workunit.client.0.smithi060.stdout:0/132: sync 2024-04-12T13:41:51.285 INFO:tasks.workunit.client.0.smithi060.stdout:3/77: sync 2024-04-12T13:41:51.285 INFO:tasks.workunit.client.0.smithi060.stdout:9/60: sync 2024-04-12T13:41:51.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/123: write d7/d10/d1c/f24 [434107,82460] 0 2024-04-12T13:41:51.287 INFO:tasks.workunit.client.0.smithi060.stdout:5/101: rename d6/d10/d1c/d1a to d6/dd/d1f 0 2024-04-12T13:41:51.289 INFO:tasks.workunit.client.0.smithi060.stdout:6/171: mknod d1/d7/da/dc/d24/d30/c38 0 2024-04-12T13:41:51.289 INFO:tasks.workunit.client.1.smithi110.stdout:0/53: dread d1/fd [0,4194304] 0 2024-04-12T13:41:51.290 INFO:tasks.workunit.client.1.smithi110.stdout:9/116: unlink df/d13/c23 0 2024-04-12T13:41:51.291 INFO:tasks.workunit.client.0.smithi060.stdout:8/99: dwrite d9/fb [0,4194304] 0 2024-04-12T13:41:51.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/76: dwrite fb [0,4194304] 0 2024-04-12T13:41:51.293 INFO:tasks.workunit.client.0.smithi060.stdout:5/102: write f2 [1080341,129262] 0 2024-04-12T13:41:51.297 INFO:tasks.workunit.client.0.smithi060.stdout:0/133: dread - d7/d9/d14/d1b/f2a zero size 2024-04-12T13:41:51.297 INFO:tasks.workunit.client.0.smithi060.stdout:9/61: mkdir d4/d8/d15 0 2024-04-12T13:41:51.297 INFO:tasks.workunit.client.1.smithi110.stdout:6/124: truncate d7/d10/d12/f2d 63319 0 2024-04-12T13:41:51.298 INFO:tasks.workunit.client.0.smithi060.stdout:2/76: write d6/f8 [594111,102204] 0 2024-04-12T13:41:51.298 INFO:tasks.workunit.client.0.smithi060.stdout:1/77: read f7 [1494205,78721] 0 2024-04-12T13:41:51.299 INFO:tasks.workunit.client.0.smithi060.stdout:4/102: dread d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:41:51.299 INFO:tasks.workunit.client.0.smithi060.stdout:1/78: rmdir - no directory 2024-04-12T13:41:51.301 INFO:tasks.workunit.client.0.smithi060.stdout:9/62: fdatasync d4/d9/f10 0 2024-04-12T13:41:51.304 INFO:tasks.workunit.client.0.smithi060.stdout:9/63: read - d4/fd zero size 2024-04-12T13:41:51.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/78: mkdir d7/d17/d19 0 2024-04-12T13:41:51.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/172: mkdir d1/d7/da/d39 0 2024-04-12T13:41:51.309 INFO:tasks.workunit.client.0.smithi060.stdout:5/103: unlink d6/f1e 0 2024-04-12T13:41:51.309 INFO:tasks.workunit.client.1.smithi110.stdout:3/81: fsync d5/dc/f11 0 2024-04-12T13:41:51.310 INFO:tasks.workunit.client.1.smithi110.stdout:2/64: mkdir d6/dc/dd 0 2024-04-12T13:41:51.311 INFO:tasks.workunit.client.0.smithi060.stdout:0/134: mknod d7/d9/d14/d1b/c2d 0 2024-04-12T13:41:51.311 INFO:tasks.workunit.client.0.smithi060.stdout:2/77: mkdir d6/d10/d16 0 2024-04-12T13:41:51.313 INFO:tasks.workunit.client.0.smithi060.stdout:2/78: write d6/f8 [605562,33759] 0 2024-04-12T13:41:51.314 INFO:tasks.workunit.client.0.smithi060.stdout:4/103: creat d6/d7/dd/df/f23 x:0 0 0 2024-04-12T13:41:51.314 INFO:tasks.workunit.client.0.smithi060.stdout:3/79: rmdir d7/da 39 2024-04-12T13:41:51.315 INFO:tasks.workunit.client.0.smithi060.stdout:7/83: creat d0/f1c x:0 0 0 2024-04-12T13:41:51.317 INFO:tasks.workunit.client.1.smithi110.stdout:4/160: dwrite d0/f15 [4194304,4194304] 0 2024-04-12T13:41:51.317 INFO:tasks.workunit.client.0.smithi060.stdout:6/173: mkdir d1/d7/da/dc/d3a 0 2024-04-12T13:41:51.317 INFO:tasks.workunit.client.0.smithi060.stdout:3/80: chown f0 205295467 1 2024-04-12T13:41:51.320 INFO:tasks.workunit.client.0.smithi060.stdout:7/84: read d0/d7/f6 [1413525,29051] 0 2024-04-12T13:41:51.321 INFO:tasks.workunit.client.0.smithi060.stdout:1/79: dread f19 [0,4194304] 0 2024-04-12T13:41:51.325 INFO:tasks.workunit.client.0.smithi060.stdout:0/135: symlink d7/d9/de/l2e 0 2024-04-12T13:41:51.331 INFO:tasks.workunit.client.1.smithi110.stdout:9/117: dwrite df/f1e [0,4194304] 0 2024-04-12T13:41:51.331 INFO:tasks.workunit.client.1.smithi110.stdout:2/65: creat d6/dc/dd/fe x:0 0 0 2024-04-12T13:41:51.332 INFO:tasks.workunit.client.0.smithi060.stdout:6/174: creat d1/d7/da/dc/f3b x:0 0 0 2024-04-12T13:41:51.336 INFO:tasks.workunit.client.1.smithi110.stdout:7/62: dwrite d1/d3/f11 [0,4194304] 0 2024-04-12T13:41:51.337 INFO:tasks.workunit.client.1.smithi110.stdout:6/125: dread d7/f1a [0,4194304] 0 2024-04-12T13:41:51.339 INFO:tasks.workunit.client.0.smithi060.stdout:7/85: rename d0/f16 to d0/d1b/f1d 0 2024-04-12T13:41:51.340 INFO:tasks.workunit.client.0.smithi060.stdout:6/175: write d1/d7/da/dc/d24/f1f [2468258,69912] 0 2024-04-12T13:41:51.342 INFO:tasks.workunit.client.1.smithi110.stdout:8/42: write d1/f2 [4419089,102427] 0 2024-04-12T13:41:51.344 INFO:tasks.workunit.client.0.smithi060.stdout:3/81: dwrite d7/f8 [8388608,4194304] 0 2024-04-12T13:41:51.345 INFO:tasks.workunit.client.0.smithi060.stdout:2/79: mkdir d6/d13/d17 0 2024-04-12T13:41:51.345 INFO:tasks.workunit.client.1.smithi110.stdout:7/63: symlink d1/l12 0 2024-04-12T13:41:51.346 INFO:tasks.workunit.client.0.smithi060.stdout:8/100: write d9/f23 [326314,83087] 0 2024-04-12T13:41:51.350 INFO:tasks.workunit.client.1.smithi110.stdout:2/66: read d6/f8 [37952,26539] 0 2024-04-12T13:41:51.355 INFO:tasks.workunit.client.1.smithi110.stdout:0/54: truncate d1/fd 487801 0 2024-04-12T13:41:51.358 INFO:tasks.workunit.client.1.smithi110.stdout:6/126: symlink d7/d25/d2c/l2e 0 2024-04-12T13:41:51.361 INFO:tasks.workunit.client.1.smithi110.stdout:9/118: dread fb [0,4194304] 0 2024-04-12T13:41:51.366 INFO:tasks.workunit.client.1.smithi110.stdout:0/55: rename d1/fe to d1/d8/f10 0 2024-04-12T13:41:51.371 INFO:tasks.workunit.client.1.smithi110.stdout:3/82: dwrite d5/dc/fd [0,4194304] 0 2024-04-12T13:41:51.375 INFO:tasks.workunit.client.1.smithi110.stdout:0/56: stat d1/d8/cc 0 2024-04-12T13:41:51.377 INFO:tasks.workunit.client.1.smithi110.stdout:4/161: write d0/ff [348299,91286] 0 2024-04-12T13:41:51.379 INFO:tasks.workunit.client.1.smithi110.stdout:7/64: dread d1/f5 [4194304,4194304] 0 2024-04-12T13:41:51.380 INFO:tasks.workunit.client.1.smithi110.stdout:3/83: truncate d5/dc/f13 2848 0 2024-04-12T13:41:51.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/82: chown d7/da 207 1 2024-04-12T13:41:51.383 INFO:tasks.workunit.client.0.smithi060.stdout:2/80: dwrite d6/fa [4194304,4194304] 0 2024-04-12T13:41:51.385 INFO:tasks.workunit.client.0.smithi060.stdout:9/64: getdents d4/d9 0 2024-04-12T13:41:51.387 INFO:tasks.workunit.client.1.smithi110.stdout:3/84: rename d5 to d5/dc/d1a 22 2024-04-12T13:41:51.390 INFO:tasks.workunit.client.0.smithi060.stdout:1/80: creat f1c x:0 0 0 2024-04-12T13:41:51.393 INFO:tasks.workunit.client.0.smithi060.stdout:9/65: readlink d4/l12 0 2024-04-12T13:41:51.393 INFO:tasks.workunit.client.0.smithi060.stdout:0/136: link d7/d9/l13 d7/d9/l2f 0 2024-04-12T13:41:51.393 INFO:tasks.workunit.client.0.smithi060.stdout:4/104: link d6/d21/c16 d6/d7/dd/df/c24 0 2024-04-12T13:41:51.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/137: fsync d7/d9/f23 0 2024-04-12T13:41:51.395 INFO:tasks.workunit.client.0.smithi060.stdout:5/104: write d6/f9 [3775928,2101] 0 2024-04-12T13:41:51.396 INFO:tasks.workunit.client.1.smithi110.stdout:3/85: chown l2 0 1 2024-04-12T13:41:51.397 INFO:tasks.workunit.client.0.smithi060.stdout:8/101: dwrite f2 [4194304,4194304] 0 2024-04-12T13:41:51.398 INFO:tasks.workunit.client.1.smithi110.stdout:7/65: write d1/fd [365105,99831] 0 2024-04-12T13:41:51.398 INFO:tasks.workunit.client.1.smithi110.stdout:8/43: dwrite d1/f2 [0,4194304] 0 2024-04-12T13:41:51.399 INFO:tasks.workunit.client.0.smithi060.stdout:7/86: creat d0/f1e x:0 0 0 2024-04-12T13:41:51.404 INFO:tasks.workunit.client.0.smithi060.stdout:3/83: rename d7/da/dd/f13 to d7/d17/f1a 0 2024-04-12T13:41:51.405 INFO:tasks.workunit.client.0.smithi060.stdout:3/84: fdatasync d7/f10 0 2024-04-12T13:41:51.406 INFO:tasks.workunit.client.0.smithi060.stdout:4/105: mknod d6/d7/dd/d1a/c25 0 2024-04-12T13:41:51.409 INFO:tasks.workunit.client.0.smithi060.stdout:2/81: creat d6/d10/d16/f18 x:0 0 0 2024-04-12T13:41:51.410 INFO:tasks.workunit.client.0.smithi060.stdout:5/105: unlink d6/dd/d1f/f1b 0 2024-04-12T13:41:51.410 INFO:tasks.workunit.client.0.smithi060.stdout:7/87: symlink d0/d7/l1f 0 2024-04-12T13:41:51.412 INFO:tasks.workunit.client.0.smithi060.stdout:0/138: mknod d7/d9/d14/c30 0 2024-04-12T13:41:51.413 INFO:tasks.workunit.client.0.smithi060.stdout:5/106: write d6/f8 [4456520,68844] 0 2024-04-12T13:41:51.417 INFO:tasks.workunit.client.0.smithi060.stdout:1/81: rename f15 to f1d 0 2024-04-12T13:41:51.417 INFO:tasks.workunit.client.1.smithi110.stdout:2/67: dwrite f4 [0,4194304] 0 2024-04-12T13:41:51.419 INFO:tasks.workunit.client.1.smithi110.stdout:8/44: mknod d1/d7/cc 0 2024-04-12T13:41:51.419 INFO:tasks.workunit.client.1.smithi110.stdout:9/119: dwrite fd [0,4194304] 0 2024-04-12T13:41:51.419 INFO:tasks.workunit.client.1.smithi110.stdout:3/86: truncate d5/dc/f19 566238 0 2024-04-12T13:41:51.420 INFO:tasks.workunit.client.1.smithi110.stdout:5/44: sync 2024-04-12T13:41:51.422 INFO:tasks.workunit.client.1.smithi110.stdout:1/31: sync 2024-04-12T13:41:51.422 INFO:tasks.workunit.client.1.smithi110.stdout:7/66: stat d1/cf 0 2024-04-12T13:41:51.422 INFO:tasks.workunit.client.0.smithi060.stdout:9/66: rmdir d4/d8/d15 0 2024-04-12T13:41:51.426 INFO:tasks.workunit.client.0.smithi060.stdout:9/67: dread - d4/d9/f10 zero size 2024-04-12T13:41:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:8/102: getdents d9/d1d 0 2024-04-12T13:41:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/85: dread d7/da/dd/f12 [0,4194304] 0 2024-04-12T13:41:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:0/139: creat d7/d9/f31 x:0 0 0 2024-04-12T13:41:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:2/82: creat d6/f19 x:0 0 0 2024-04-12T13:41:51.433 INFO:tasks.workunit.client.1.smithi110.stdout:1/32: readlink lc 0 2024-04-12T13:41:51.433 INFO:tasks.workunit.client.1.smithi110.stdout:6/127: dwrite d7/d10/d12/f1d [0,4194304] 0 2024-04-12T13:41:51.442 INFO:tasks.workunit.client.1.smithi110.stdout:7/67: mknod d1/c13 0 2024-04-12T13:41:51.442 INFO:tasks.workunit.client.1.smithi110.stdout:0/57: dwrite d1/d8/ff [0,4194304] 0 2024-04-12T13:41:51.445 INFO:tasks.workunit.client.1.smithi110.stdout:9/120: mkdir df/d13/d2c 0 2024-04-12T13:41:51.446 INFO:tasks.workunit.client.0.smithi060.stdout:8/103: creat d9/da/f24 x:0 0 0 2024-04-12T13:41:51.446 INFO:tasks.workunit.client.0.smithi060.stdout:5/107: creat d6/f20 x:0 0 0 2024-04-12T13:41:51.448 INFO:tasks.workunit.client.1.smithi110.stdout:4/162: dwrite d0/d13/f2a [0,4194304] 0 2024-04-12T13:41:51.448 INFO:tasks.workunit.client.0.smithi060.stdout:9/68: truncate d4/d8/fa 2543734 0 2024-04-12T13:41:51.450 INFO:tasks.workunit.client.1.smithi110.stdout:0/58: write d1/d8/fb [4423113,111468] 0 2024-04-12T13:41:51.451 INFO:tasks.workunit.client.0.smithi060.stdout:3/86: symlink d7/d17/l1b 0 2024-04-12T13:41:51.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/108: write f1 [1350004,61054] 0 2024-04-12T13:41:51.458 INFO:tasks.workunit.client.0.smithi060.stdout:2/83: mknod d6/d10/d16/c1a 0 2024-04-12T13:41:51.459 INFO:tasks.workunit.client.1.smithi110.stdout:7/68: read d1/d3/d4/fb [5562135,106858] 0 2024-04-12T13:41:51.460 INFO:tasks.workunit.client.1.smithi110.stdout:2/68: symlink d6/dc/dd/lf 0 2024-04-12T13:41:51.462 INFO:tasks.workunit.client.1.smithi110.stdout:8/45: write d1/d7/fb [3612586,111235] 0 2024-04-12T13:41:51.468 INFO:tasks.workunit.client.0.smithi060.stdout:0/140: creat d7/d9/d14/d1b/f32 x:0 0 0 2024-04-12T13:41:51.468 INFO:tasks.workunit.client.0.smithi060.stdout:7/88: dwrite d0/f19 [0,4194304] 0 2024-04-12T13:41:51.469 INFO:tasks.workunit.client.0.smithi060.stdout:9/69: creat d4/f16 x:0 0 0 2024-04-12T13:41:51.470 INFO:tasks.workunit.client.1.smithi110.stdout:3/87: getdents d5/dc 0 2024-04-12T13:41:51.470 INFO:tasks.workunit.client.1.smithi110.stdout:9/121: mkdir df/d13/d2c/d2d 0 2024-04-12T13:41:51.471 INFO:tasks.workunit.client.0.smithi060.stdout:1/82: dwrite fb [0,4194304] 0 2024-04-12T13:41:51.474 INFO:tasks.workunit.client.0.smithi060.stdout:7/89: fsync d0/d7/f10 0 2024-04-12T13:41:51.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/141: dread d7/d9/f1c [0,4194304] 0 2024-04-12T13:41:51.476 INFO:tasks.workunit.client.1.smithi110.stdout:4/163: write d0/f4 [766639,95614] 0 2024-04-12T13:41:51.477 INFO:tasks.workunit.client.0.smithi060.stdout:2/84: unlink d6/fa 0 2024-04-12T13:41:51.477 INFO:tasks.workunit.client.0.smithi060.stdout:4/106: dwrite d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:41:51.483 INFO:tasks.workunit.client.0.smithi060.stdout:5/109: symlink d6/dd/d1f/l21 0 2024-04-12T13:41:51.487 INFO:tasks.workunit.client.1.smithi110.stdout:8/46: mkdir d1/d5/dd 0 2024-04-12T13:41:51.489 INFO:tasks.workunit.client.1.smithi110.stdout:5/45: dwrite f8 [0,4194304] 0 2024-04-12T13:41:51.489 INFO:tasks.workunit.client.1.smithi110.stdout:2/69: dread d6/fb [0,4194304] 0 2024-04-12T13:41:51.490 INFO:tasks.workunit.client.1.smithi110.stdout:7/69: symlink d1/d3/d4/l14 0 2024-04-12T13:41:51.493 INFO:tasks.workunit.client.0.smithi060.stdout:7/90: read d0/d7/f6 [33963,12971] 0 2024-04-12T13:41:51.494 INFO:tasks.workunit.client.0.smithi060.stdout:2/85: creat d6/f1b x:0 0 0 2024-04-12T13:41:51.497 INFO:tasks.workunit.client.0.smithi060.stdout:2/86: truncate d6/f19 228862 0 2024-04-12T13:41:51.497 INFO:tasks.workunit.client.0.smithi060.stdout:2/87: chown d6 3385 1 2024-04-12T13:41:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:8/104: link d9/c20 d9/d1b/c25 0 2024-04-12T13:41:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:5/110: creat d6/d10/d12/d15/f22 x:0 0 0 2024-04-12T13:41:51.500 INFO:tasks.workunit.client.1.smithi110.stdout:0/59: dread d1/d8/fb [0,4194304] 0 2024-04-12T13:41:51.500 INFO:tasks.workunit.client.1.smithi110.stdout:9/122: creat df/f2e x:0 0 0 2024-04-12T13:41:51.500 INFO:tasks.workunit.client.1.smithi110.stdout:6/128: link d7/d10/d1c/f27 d7/d10/d1c/d2b/f2f 0 2024-04-12T13:41:51.503 INFO:tasks.workunit.client.1.smithi110.stdout:8/47: creat d1/d3/fe x:0 0 0 2024-04-12T13:41:51.504 INFO:tasks.workunit.client.1.smithi110.stdout:0/60: readlink d1/l6 0 2024-04-12T13:41:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:2/88: write d6/d10/d16/f18 [230816,10297] 0 2024-04-12T13:41:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:0/142: unlink d7/d9/de/l20 0 2024-04-12T13:41:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:5/111: chown d6/d10/d12/c18 1667452573 1 2024-04-12T13:41:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:4/107: fsync d6/d7/dd/fe 0 2024-04-12T13:41:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:3/87: rename l6 to d7/l1c 0 2024-04-12T13:41:51.509 INFO:tasks.workunit.client.1.smithi110.stdout:4/164: chown d0/de/d2c/f18 1800115 1 2024-04-12T13:41:51.509 INFO:tasks.workunit.client.1.smithi110.stdout:2/70: creat d6/dc/dd/f10 x:0 0 0 2024-04-12T13:41:51.510 INFO:tasks.workunit.client.1.smithi110.stdout:9/123: write df/f1e [503503,73211] 0 2024-04-12T13:41:51.513 INFO:tasks.workunit.client.1.smithi110.stdout:6/129: mkdir d7/d25/d30 0 2024-04-12T13:41:51.515 INFO:tasks.workunit.client.1.smithi110.stdout:3/88: dwrite d5/dc/f13 [0,4194304] 0 2024-04-12T13:41:51.515 INFO:tasks.workunit.client.0.smithi060.stdout:7/91: rename d0/l5 to d0/d7/l20 0 2024-04-12T13:41:51.517 INFO:tasks.workunit.client.1.smithi110.stdout:9/124: fdatasync df/f24 0 2024-04-12T13:41:51.517 INFO:tasks.workunit.client.0.smithi060.stdout:8/105: chown d9/d1b/c25 6617684 1 2024-04-12T13:41:51.518 INFO:tasks.workunit.client.1.smithi110.stdout:0/61: mkdir d1/d11 0 2024-04-12T13:41:51.521 INFO:tasks.workunit.client.1.smithi110.stdout:5/46: fsync f8 0 2024-04-12T13:41:51.524 INFO:tasks.workunit.client.1.smithi110.stdout:5/47: write da/db/ff [264151,86408] 0 2024-04-12T13:41:51.525 INFO:tasks.workunit.client.1.smithi110.stdout:5/48: chown f9 31 1 2024-04-12T13:41:51.529 INFO:tasks.workunit.client.1.smithi110.stdout:5/49: dread da/db/ff [0,4194304] 0 2024-04-12T13:41:51.531 INFO:tasks.workunit.client.1.smithi110.stdout:4/165: mknod d0/d19/c30 0 2024-04-12T13:41:51.533 INFO:tasks.workunit.client.1.smithi110.stdout:6/130: creat d7/d10/d12/f31 x:0 0 0 2024-04-12T13:41:51.534 INFO:tasks.workunit.client.1.smithi110.stdout:4/166: truncate d0/d19/f2e 243225 0 2024-04-12T13:41:51.534 INFO:tasks.workunit.client.1.smithi110.stdout:6/131: write d7/d10/d12/f31 [992751,30479] 0 2024-04-12T13:41:51.536 INFO:tasks.workunit.client.1.smithi110.stdout:6/132: stat d7/d10/d12/l17 0 2024-04-12T13:41:51.539 INFO:tasks.workunit.client.1.smithi110.stdout:8/48: creat d1/d5/dd/ff x:0 0 0 2024-04-12T13:41:51.540 INFO:tasks.workunit.client.0.smithi060.stdout:5/112: fsync d6/d10/d12/d15/f22 0 2024-04-12T13:41:51.542 INFO:tasks.workunit.client.0.smithi060.stdout:7/92: dread d0/d7/f10 [0,4194304] 0 2024-04-12T13:41:51.542 INFO:tasks.workunit.client.0.smithi060.stdout:4/108: getdents d6/d7/dd/df 0 2024-04-12T13:41:51.544 INFO:tasks.workunit.client.1.smithi110.stdout:3/89: mknod d5/c1b 0 2024-04-12T13:41:51.545 INFO:tasks.workunit.client.1.smithi110.stdout:5/50: creat da/db/f12 x:0 0 0 2024-04-12T13:41:51.546 INFO:tasks.workunit.client.0.smithi060.stdout:1/83: dwrite f2 [0,4194304] 0 2024-04-12T13:41:51.548 INFO:tasks.workunit.client.1.smithi110.stdout:9/125: mknod df/d13/d2c/d2d/c2f 0 2024-04-12T13:41:51.548 INFO:tasks.workunit.client.1.smithi110.stdout:2/71: write d6/f8 [715041,57923] 0 2024-04-12T13:41:51.553 INFO:tasks.workunit.client.0.smithi060.stdout:2/89: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:51.554 INFO:tasks.workunit.client.1.smithi110.stdout:2/72: chown d6/dc/dd/f10 7 1 2024-04-12T13:41:51.556 INFO:tasks.workunit.client.1.smithi110.stdout:8/49: symlink d1/l10 0 2024-04-12T13:41:51.557 INFO:tasks.workunit.client.0.smithi060.stdout:4/109: dread - d6/d7/dd/d1a/d19/f1f zero size 2024-04-12T13:41:51.559 INFO:tasks.workunit.client.1.smithi110.stdout:5/51: creat da/db/f13 x:0 0 0 2024-04-12T13:41:51.561 INFO:tasks.workunit.client.1.smithi110.stdout:9/126: mknod df/d13/c30 0 2024-04-12T13:41:51.562 INFO:tasks.workunit.client.1.smithi110.stdout:6/133: dwrite d7/d10/d12/f31 [0,4194304] 0 2024-04-12T13:41:51.564 INFO:tasks.workunit.client.1.smithi110.stdout:9/127: read - df/d13/f27 zero size 2024-04-12T13:41:51.565 INFO:tasks.workunit.client.1.smithi110.stdout:6/134: stat d7/d25/d30 0 2024-04-12T13:41:51.568 INFO:tasks.workunit.client.1.smithi110.stdout:6/135: chown d7/d10/f20 2686 1 2024-04-12T13:41:51.570 INFO:tasks.workunit.client.1.smithi110.stdout:0/62: truncate f0 3484984 0 2024-04-12T13:41:51.572 INFO:tasks.workunit.client.1.smithi110.stdout:2/73: creat d6/f11 x:0 0 0 2024-04-12T13:41:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:1/84: mkdir d1e 0 2024-04-12T13:41:51.575 INFO:tasks.workunit.client.1.smithi110.stdout:3/90: symlink d5/l1c 0 2024-04-12T13:41:51.575 INFO:tasks.workunit.client.1.smithi110.stdout:8/50: rename d1/d7/l8 to d1/l11 0 2024-04-12T13:41:51.578 INFO:tasks.workunit.client.1.smithi110.stdout:9/128: mkdir df/d13/d2c/d2d/d31 0 2024-04-12T13:41:51.579 INFO:tasks.workunit.client.1.smithi110.stdout:9/129: fdatasync f7 0 2024-04-12T13:41:51.579 INFO:tasks.workunit.client.1.smithi110.stdout:4/167: dwrite d0/d13/f2d [0,4194304] 0 2024-04-12T13:41:51.580 INFO:tasks.workunit.client.1.smithi110.stdout:0/63: mknod d1/d8/c12 0 2024-04-12T13:41:51.580 INFO:tasks.workunit.client.0.smithi060.stdout:4/110: symlink d6/d7/l26 0 2024-04-12T13:41:51.580 INFO:tasks.workunit.client.0.smithi060.stdout:1/85: stat f7 0 2024-04-12T13:41:51.581 INFO:tasks.workunit.client.1.smithi110.stdout:3/91: fdatasync d5/dc/f11 0 2024-04-12T13:41:51.583 INFO:tasks.workunit.client.0.smithi060.stdout:3/88: dwrite d7/da/dd/f12 [4194304,4194304] 0 2024-04-12T13:41:51.584 INFO:tasks.workunit.client.1.smithi110.stdout:6/136: rename d7/c8 to d7/d10/d1c/c32 0 2024-04-12T13:41:51.585 INFO:tasks.workunit.client.1.smithi110.stdout:9/130: fdatasync fa 0 2024-04-12T13:41:51.590 INFO:tasks.workunit.client.1.smithi110.stdout:0/64: read d1/d8/fb [2826457,91133] 0 2024-04-12T13:41:51.591 INFO:tasks.workunit.client.0.smithi060.stdout:8/106: dwrite d9/f23 [0,4194304] 0 2024-04-12T13:41:51.592 INFO:tasks.workunit.client.1.smithi110.stdout:4/168: mkdir d0/de/d31 0 2024-04-12T13:41:51.592 INFO:tasks.workunit.client.1.smithi110.stdout:1/33: sync 2024-04-12T13:41:51.596 INFO:tasks.workunit.client.1.smithi110.stdout:5/52: dwrite f9 [0,4194304] 0 2024-04-12T13:41:51.596 INFO:tasks.workunit.client.1.smithi110.stdout:1/34: dread - fb zero size 2024-04-12T13:41:51.600 INFO:tasks.workunit.client.0.smithi060.stdout:4/111: write d6/d7/dd/df/f20 [597682,38594] 0 2024-04-12T13:41:51.602 INFO:tasks.workunit.client.0.smithi060.stdout:3/89: creat d7/d17/f1d x:0 0 0 2024-04-12T13:41:51.603 INFO:tasks.workunit.client.1.smithi110.stdout:0/65: mknod d1/d8/c13 0 2024-04-12T13:41:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:3/90: chown l5 158 1 2024-04-12T13:41:51.607 INFO:tasks.workunit.client.1.smithi110.stdout:9/131: creat df/d13/d26/f32 x:0 0 0 2024-04-12T13:41:51.609 INFO:tasks.workunit.client.0.smithi060.stdout:5/113: dwrite f1 [0,4194304] 0 2024-04-12T13:41:51.609 INFO:tasks.workunit.client.1.smithi110.stdout:4/169: mkdir d0/de/d32 0 2024-04-12T13:41:51.611 INFO:tasks.workunit.client.1.smithi110.stdout:9/132: write fd [4403191,60425] 0 2024-04-12T13:41:51.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/112: creat d6/d21/f27 x:0 0 0 2024-04-12T13:41:51.611 INFO:tasks.workunit.client.1.smithi110.stdout:2/74: dwrite f0 [0,4194304] 0 2024-04-12T13:41:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:5/114: chown d6/f9 961954 1 2024-04-12T13:41:51.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/51: getdents d1/d3 0 2024-04-12T13:41:51.614 INFO:tasks.workunit.client.0.smithi060.stdout:7/93: dwrite d0/f19 [0,4194304] 0 2024-04-12T13:41:51.614 INFO:tasks.workunit.client.0.smithi060.stdout:5/115: chown d6/d10/d1c 12208961 1 2024-04-12T13:41:51.615 INFO:tasks.workunit.client.1.smithi110.stdout:5/53: creat da/db/f14 x:0 0 0 2024-04-12T13:41:51.615 INFO:tasks.workunit.client.1.smithi110.stdout:6/137: write d7/d10/d1c/f27 [652832,52829] 0 2024-04-12T13:41:51.616 INFO:tasks.workunit.client.1.smithi110.stdout:1/35: fdatasync fa 0 2024-04-12T13:41:51.620 INFO:tasks.workunit.client.1.smithi110.stdout:9/133: mknod df/d13/d26/c33 0 2024-04-12T13:41:51.620 INFO:tasks.workunit.client.1.smithi110.stdout:1/36: write f5 [3889707,55782] 0 2024-04-12T13:41:51.621 INFO:tasks.workunit.client.1.smithi110.stdout:2/75: truncate d6/dc/dd/fe 207891 0 2024-04-12T13:41:51.624 INFO:tasks.workunit.client.0.smithi060.stdout:5/116: symlink d6/dd/d1f/l23 0 2024-04-12T13:41:51.626 INFO:tasks.workunit.client.1.smithi110.stdout:0/66: rename d1/fd to d1/f14 0 2024-04-12T13:41:51.626 INFO:tasks.workunit.client.1.smithi110.stdout:3/92: link l2 d5/l1d 0 2024-04-12T13:41:51.632 INFO:tasks.workunit.client.1.smithi110.stdout:6/138: creat d7/d10/d12/f33 x:0 0 0 2024-04-12T13:41:51.632 INFO:tasks.workunit.client.1.smithi110.stdout:2/76: rmdir d6 39 2024-04-12T13:41:51.637 INFO:tasks.workunit.client.0.smithi060.stdout:3/91: dwrite d7/d17/f1d [0,4194304] 0 2024-04-12T13:41:51.638 INFO:tasks.workunit.client.1.smithi110.stdout:6/139: chown d7/d10/d12/f1f 14925 1 2024-04-12T13:41:51.640 INFO:tasks.workunit.client.1.smithi110.stdout:0/67: mknod d1/d11/c15 0 2024-04-12T13:41:51.641 INFO:tasks.workunit.client.0.smithi060.stdout:7/94: rename d0/f8 to d0/f21 0 2024-04-12T13:41:51.644 INFO:tasks.workunit.client.0.smithi060.stdout:7/95: fsync d0/d7/f11 0 2024-04-12T13:41:51.647 INFO:tasks.workunit.client.1.smithi110.stdout:8/52: dread d1/f2 [0,4194304] 0 2024-04-12T13:41:51.647 INFO:tasks.workunit.client.0.smithi060.stdout:3/92: creat d7/d17/d19/f1e x:0 0 0 2024-04-12T13:41:51.649 INFO:tasks.workunit.client.1.smithi110.stdout:4/170: dwrite d0/f4 [4194304,4194304] 0 2024-04-12T13:41:51.650 INFO:tasks.workunit.client.0.smithi060.stdout:7/96: creat d0/d7/f22 x:0 0 0 2024-04-12T13:41:51.651 INFO:tasks.workunit.client.0.smithi060.stdout:7/97: readlink d0/d7/l9 0 2024-04-12T13:41:51.656 INFO:tasks.workunit.client.0.smithi060.stdout:3/93: rename d7/d17/d19/f1e to d7/d17/d19/f1f 0 2024-04-12T13:41:51.662 INFO:tasks.workunit.client.1.smithi110.stdout:8/53: creat d1/d5/dd/f12 x:0 0 0 2024-04-12T13:41:51.662 INFO:tasks.workunit.client.0.smithi060.stdout:3/94: creat d7/d17/f20 x:0 0 0 2024-04-12T13:41:51.662 INFO:tasks.workunit.client.0.smithi060.stdout:5/117: fsync f1 0 2024-04-12T13:41:51.663 INFO:tasks.workunit.client.0.smithi060.stdout:4/113: truncate d6/d7/dd/df/f20 266366 0 2024-04-12T13:41:51.675 INFO:tasks.workunit.client.1.smithi110.stdout:9/134: dwrite df/f17 [0,4194304] 0 2024-04-12T13:41:51.678 INFO:tasks.workunit.client.0.smithi060.stdout:4/114: link d6/d7/db/c17 d6/d7/dd/d1a/c28 0 2024-04-12T13:41:51.680 INFO:tasks.workunit.client.1.smithi110.stdout:8/54: write d1/f2 [1874263,5183] 0 2024-04-12T13:41:51.681 INFO:tasks.workunit.client.0.smithi060.stdout:7/98: dwrite d0/f21 [0,4194304] 0 2024-04-12T13:41:51.685 INFO:tasks.workunit.client.0.smithi060.stdout:7/99: write d0/f19 [45421,28089] 0 2024-04-12T13:41:51.686 INFO:tasks.workunit.client.0.smithi060.stdout:3/95: dread d7/f10 [0,4194304] 0 2024-04-12T13:41:51.686 INFO:tasks.workunit.client.0.smithi060.stdout:5/118: dread d6/fc [0,4194304] 0 2024-04-12T13:41:51.688 INFO:tasks.workunit.client.1.smithi110.stdout:9/135: creat df/f34 x:0 0 0 2024-04-12T13:41:51.689 INFO:tasks.workunit.client.0.smithi060.stdout:3/96: stat d7/l1c 0 2024-04-12T13:41:51.689 INFO:tasks.workunit.client.1.smithi110.stdout:8/55: fdatasync d1/d5/dd/f12 0 2024-04-12T13:41:51.691 INFO:tasks.workunit.client.0.smithi060.stdout:3/97: read d7/f8 [6169607,108742] 0 2024-04-12T13:41:51.693 INFO:tasks.workunit.client.0.smithi060.stdout:6/176: sync 2024-04-12T13:41:51.694 INFO:tasks.workunit.client.1.smithi110.stdout:0/68: dread f0 [0,4194304] 0 2024-04-12T13:41:51.694 INFO:tasks.workunit.client.1.smithi110.stdout:9/136: write df/f25 [392313,43379] 0 2024-04-12T13:41:51.694 INFO:tasks.workunit.client.0.smithi060.stdout:3/98: chown d7/l18 45383896 1 2024-04-12T13:41:51.696 INFO:tasks.workunit.client.1.smithi110.stdout:8/56: write d1/d5/dd/f12 [163490,20716] 0 2024-04-12T13:41:51.696 INFO:tasks.workunit.client.0.smithi060.stdout:7/100: rename d0/f19 to d0/d1b/f23 0 2024-04-12T13:41:51.697 INFO:tasks.workunit.client.1.smithi110.stdout:4/171: dread d0/d13/f2a [0,4194304] 0 2024-04-12T13:41:51.699 INFO:tasks.workunit.client.1.smithi110.stdout:7/70: sync 2024-04-12T13:41:51.702 INFO:tasks.workunit.client.1.smithi110.stdout:6/140: dwrite d7/d10/d12/f1f [4194304,4194304] 0 2024-04-12T13:41:51.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/177: write d1/d7/da/dc/d24/d34/f23 [1509731,96852] 0 2024-04-12T13:41:51.705 INFO:tasks.workunit.client.1.smithi110.stdout:2/77: dwrite d6/fb [0,4194304] 0 2024-04-12T13:41:51.707 INFO:tasks.workunit.client.0.smithi060.stdout:4/115: getdents d6/d7/dd 0 2024-04-12T13:41:51.709 INFO:tasks.workunit.client.0.smithi060.stdout:4/116: fsync d6/d7/db/f22 0 2024-04-12T13:41:51.710 INFO:tasks.workunit.client.1.smithi110.stdout:2/78: write d6/fb [840233,96548] 0 2024-04-12T13:41:51.710 INFO:tasks.workunit.client.1.smithi110.stdout:9/137: rename f3 to df/f35 0 2024-04-12T13:41:51.712 INFO:tasks.workunit.client.1.smithi110.stdout:9/138: truncate df/f34 51687 0 2024-04-12T13:41:51.713 INFO:tasks.workunit.client.1.smithi110.stdout:8/57: creat d1/d3/f13 x:0 0 0 2024-04-12T13:41:51.713 INFO:tasks.workunit.client.1.smithi110.stdout:9/139: chown fb 122385527 1 2024-04-12T13:41:51.713 INFO:tasks.workunit.client.1.smithi110.stdout:2/79: chown d6/dc/dd/lf 771196 1 2024-04-12T13:41:51.714 INFO:tasks.workunit.client.0.smithi060.stdout:3/99: mkdir d7/d17/d19/d21 0 2024-04-12T13:41:51.714 INFO:tasks.workunit.client.1.smithi110.stdout:8/58: chown d1/d7/cc 3798897 1 2024-04-12T13:41:51.716 INFO:tasks.workunit.client.1.smithi110.stdout:7/71: rmdir d1 39 2024-04-12T13:41:51.719 INFO:tasks.workunit.client.1.smithi110.stdout:4/172: symlink d0/de/d2c/l33 0 2024-04-12T13:41:51.724 INFO:tasks.workunit.client.0.smithi060.stdout:5/119: rmdir d6/d10/d1c 0 2024-04-12T13:41:51.724 INFO:tasks.workunit.client.0.smithi060.stdout:7/101: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:51.724 INFO:tasks.workunit.client.0.smithi060.stdout:6/178: creat d1/d7/da/dc/f3c x:0 0 0 2024-04-12T13:41:51.725 INFO:tasks.workunit.client.1.smithi110.stdout:8/59: dread d1/d5/dd/f12 [0,4194304] 0 2024-04-12T13:41:51.726 INFO:tasks.workunit.client.0.smithi060.stdout:3/100: mknod d7/d17/d19/c22 0 2024-04-12T13:41:51.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/101: write d7/f10 [1830178,57700] 0 2024-04-12T13:41:51.730 INFO:tasks.workunit.client.0.smithi060.stdout:6/179: write d1/d7/da/dc/f3c [940245,28235] 0 2024-04-12T13:41:51.732 INFO:tasks.workunit.client.0.smithi060.stdout:3/102: truncate d7/d17/f20 1024583 0 2024-04-12T13:41:51.733 INFO:tasks.workunit.client.1.smithi110.stdout:6/141: symlink d7/d25/d30/l34 0 2024-04-12T13:41:51.733 INFO:tasks.workunit.client.0.smithi060.stdout:4/117: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:41:51.734 INFO:tasks.workunit.client.0.smithi060.stdout:7/102: rename d0/d7/f22 to d0/d7/f24 0 2024-04-12T13:41:51.740 INFO:tasks.workunit.client.1.smithi110.stdout:9/140: link df/d13/d26/f28 df/d13/d2c/f36 0 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.737+0000 7f79ebe00700 1 -- 172.21.15.60:0/1276331739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 msgr2=0x7f79e40fd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.737+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1276331739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e40fd330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79d8004940 tx=0x7f79d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.737+0000 7f79ebe00700 1 -- 172.21.15.60:0/1276331739 shutdown_connections 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.738+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1276331739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 0x7f79e40fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.738+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1276331739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e40fd330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.738+0000 7f79ebe00700 1 -- 172.21.15.60:0/1276331739 >> 172.21.15.60:0/1276331739 conn(0x7f79e40f85c0 msgr2=0x7f79e40faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.738+0000 7f79ebe00700 1 -- 172.21.15.60:0/1276331739 shutdown_connections 2024-04-12T13:41:51.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.738+0000 7f79ebe00700 1 -- 172.21.15.60:0/1276331739 wait complete. 2024-04-12T13:41:51.741 INFO:tasks.workunit.client.1.smithi110.stdout:2/80: dwrite d6/fb [0,4194304] 0 2024-04-12T13:41:51.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.740+0000 7f79ebe00700 1 Processor -- start 2024-04-12T13:41:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.740+0000 7f79ebe00700 1 -- start start 2024-04-12T13:41:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79ebe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:51.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79ebe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 0x7f79e4114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:51.742 INFO:tasks.workunit.client.0.smithi060.stdout:3/103: stat d7/da/dd/l14 0 2024-04-12T13:41:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79ebe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4114b30 con 0x7f79e40fe090 2024-04-12T13:41:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79ebe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4115380 con 0x7f79e40fcf20 2024-04-12T13:41:51.743 INFO:tasks.workunit.client.0.smithi060.stdout:4/118: dread d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79e9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79e9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:52288/0 (socket says 172.21.15.60:52288) 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79e9400700 1 -- 172.21.15.60:0/1209427384 learned_addr learned my addr 172.21.15.60:0/1209427384 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.741+0000 7f79e8a00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 0x7f79e4114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.742+0000 7f79e9400700 1 -- 172.21.15.60:0/1209427384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 msgr2=0x7f79e4114530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.742+0000 7f79e9400700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 0x7f79e4114530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.742+0000 7f79e9400700 1 -- 172.21.15.60:0/1209427384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0005040 con 0x7f79e40fcf20 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.742+0000 7f79e9400700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79d800b0d0 tx=0x7f79d8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.743+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d800e070 con 0x7f79e40fcf20 2024-04-12T13:41:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.743+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79d800b410 con 0x7f79e40fcf20 2024-04-12T13:41:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.743+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d80125e0 con 0x7f79e40fcf20 2024-04-12T13:41:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.743+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d8005040 con 0x7f79e40fcf20 2024-04-12T13:41:51.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/104: stat d7/da/dd/l15 0 2024-04-12T13:41:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.743+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e41159b0 con 0x7f79e40fcf20 2024-04-12T13:41:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.744+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e4100a10 con 0x7f79e40fcf20 2024-04-12T13:41:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.746+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f79d800b580 con 0x7f79e40fcf20 2024-04-12T13:41:51.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/105: dread - d7/d17/d19/f1f zero size 2024-04-12T13:41:51.749 INFO:tasks.workunit.client.1.smithi110.stdout:0/69: getdents d1 0 2024-04-12T13:41:51.749 INFO:tasks.workunit.client.1.smithi110.stdout:0/70: chown d1/d11 15 1 2024-04-12T13:41:51.749 INFO:tasks.workunit.client.1.smithi110.stdout:2/81: truncate d6/dc/dd/f10 423426 0 2024-04-12T13:41:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.746+0000 7f79e1600700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 0x7f79cc06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.747+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f79d808b850 con 0x7f79e40fcf20 2024-04-12T13:41:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.747+0000 7f79e8a00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 0x7f79cc06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:51.750 INFO:tasks.workunit.client.0.smithi060.stdout:5/120: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:51.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.748+0000 7f79e8a00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 0x7f79cc06e1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009fd0 tx=0x7f79d0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:51.750 INFO:tasks.workunit.client.1.smithi110.stdout:8/60: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:51.750 INFO:tasks.workunit.client.1.smithi110.stdout:7/72: dread d1/d3/d4/fb [4194304,4194304] 0 2024-04-12T13:41:51.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/103: rename d0/d7/l9 to d0/d1b/l25 0 2024-04-12T13:41:51.751 INFO:tasks.workunit.client.0.smithi060.stdout:6/180: getdents d1/d7/da/dc/d3a 0 2024-04-12T13:41:51.751 INFO:tasks.workunit.client.0.smithi060.stdout:5/121: fsync d6/f17 0 2024-04-12T13:41:51.752 INFO:tasks.workunit.client.0.smithi060.stdout:7/104: dread - d0/f1e zero size 2024-04-12T13:41:51.752 INFO:tasks.workunit.client.1.smithi110.stdout:7/73: stat d1/d3/l8 0 2024-04-12T13:41:51.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/119: mkdir d6/d21/d29 0 2024-04-12T13:41:51.756 INFO:tasks.workunit.client.0.smithi060.stdout:3/106: creat d7/d17/d19/f23 x:0 0 0 2024-04-12T13:41:51.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:51.758+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f79d8058970 con 0x7f79e40fcf20 2024-04-12T13:41:51.759 INFO:tasks.workunit.client.1.smithi110.stdout:7/74: chown d1/f5 1218 1 2024-04-12T13:41:51.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/122: symlink d6/dd/d1f/l24 0 2024-04-12T13:41:51.762 INFO:tasks.workunit.client.1.smithi110.stdout:5/54: sync 2024-04-12T13:41:51.762 INFO:tasks.workunit.client.1.smithi110.stdout:7/75: rename d1/d3 to d1/d3/d15 22 2024-04-12T13:41:51.765 INFO:tasks.workunit.client.0.smithi060.stdout:4/120: creat d6/d21/f2a x:0 0 0 2024-04-12T13:41:51.766 INFO:tasks.workunit.client.1.smithi110.stdout:6/142: dwrite d7/f19 [0,4194304] 0 2024-04-12T13:41:51.771 INFO:tasks.workunit.client.1.smithi110.stdout:7/76: dread d1/fd [0,4194304] 0 2024-04-12T13:41:51.772 INFO:tasks.workunit.client.0.smithi060.stdout:5/123: mkdir d6/dd/d1f/d25 0 2024-04-12T13:41:51.774 INFO:tasks.workunit.client.0.smithi060.stdout:7/105: mknod d0/c26 0 2024-04-12T13:41:51.775 INFO:tasks.workunit.client.0.smithi060.stdout:6/181: creat d1/d7/da/dc/d24/d2d/f3d x:0 0 0 2024-04-12T13:41:51.776 INFO:tasks.workunit.client.1.smithi110.stdout:6/143: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:51.776 INFO:tasks.workunit.client.0.smithi060.stdout:5/124: symlink d6/d10/d12/d15/l26 0 2024-04-12T13:41:51.777 INFO:tasks.workunit.client.0.smithi060.stdout:3/107: dread d7/f8 [4194304,4194304] 0 2024-04-12T13:41:51.777 INFO:tasks.workunit.client.0.smithi060.stdout:7/106: dread - d0/f1e zero size 2024-04-12T13:41:51.777 INFO:tasks.workunit.client.1.smithi110.stdout:6/144: write d7/d10/d1c/f28 [379164,128581] 0 2024-04-12T13:41:51.778 INFO:tasks.workunit.client.1.smithi110.stdout:1/37: sync 2024-04-12T13:41:51.778 INFO:tasks.workunit.client.1.smithi110.stdout:3/93: sync 2024-04-12T13:41:51.779 INFO:tasks.workunit.client.0.smithi060.stdout:3/108: readlink d7/l18 0 2024-04-12T13:41:51.779 INFO:tasks.workunit.client.1.smithi110.stdout:6/145: readlink d7/d25/d30/l34 0 2024-04-12T13:41:51.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/107: truncate d0/f1c 711078 0 2024-04-12T13:41:51.780 INFO:tasks.workunit.client.1.smithi110.stdout:1/38: write f5 [1571993,6933] 0 2024-04-12T13:41:51.784 INFO:tasks.workunit.client.0.smithi060.stdout:7/108: read d0/f1a [297183,77711] 0 2024-04-12T13:41:51.785 INFO:tasks.workunit.client.0.smithi060.stdout:5/125: mkdir d6/dd/d27 0 2024-04-12T13:41:51.786 INFO:tasks.workunit.client.0.smithi060.stdout:6/182: fdatasync d1/d7/da/dc/f19 0 2024-04-12T13:41:51.789 INFO:tasks.workunit.client.0.smithi060.stdout:4/121: link d6/d7/dd/d1a/c25 d6/d7/dd/d1a/d19/c2b 0 2024-04-12T13:41:51.789 INFO:tasks.workunit.client.0.smithi060.stdout:6/183: dread - d1/d7/da/dc/d24/d34/f2f zero size 2024-04-12T13:41:51.790 INFO:tasks.workunit.client.1.smithi110.stdout:6/146: dread d7/d10/d12/f1d [0,4194304] 0 2024-04-12T13:41:51.791 INFO:tasks.workunit.client.0.smithi060.stdout:4/122: fsync d6/d21/f27 0 2024-04-12T13:41:51.793 INFO:tasks.workunit.client.0.smithi060.stdout:5/126: unlink d6/dd/d1f/l23 0 2024-04-12T13:41:51.793 INFO:tasks.workunit.client.0.smithi060.stdout:7/109: creat d0/d1b/f27 x:0 0 0 2024-04-12T13:41:51.796 INFO:tasks.workunit.client.0.smithi060.stdout:7/110: chown d0/f21 1508 1 2024-04-12T13:41:51.798 INFO:tasks.workunit.client.0.smithi060.stdout:6/184: rename d1/d7/c12 to d1/d7/da/d39/c3e 0 2024-04-12T13:41:51.802 INFO:tasks.workunit.client.0.smithi060.stdout:7/111: mknod d0/c28 0 2024-04-12T13:41:51.804 INFO:tasks.workunit.client.0.smithi060.stdout:4/123: dread f2 [0,4194304] 0 2024-04-12T13:41:51.804 INFO:tasks.workunit.client.0.smithi060.stdout:6/185: symlink d1/d7/da/dc/d24/d34/l3f 0 2024-04-12T13:41:51.809 INFO:tasks.workunit.client.0.smithi060.stdout:5/127: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:41:51.810 INFO:tasks.workunit.client.0.smithi060.stdout:6/186: mknod d1/d7/da/d20/c40 0 2024-04-12T13:41:51.814 INFO:tasks.workunit.client.0.smithi060.stdout:4/124: symlink d6/l2c 0 2024-04-12T13:41:51.816 INFO:tasks.workunit.client.1.smithi110.stdout:4/173: mknod d0/de/d31/c34 0 2024-04-12T13:41:51.819 INFO:tasks.workunit.client.0.smithi060.stdout:4/125: write d6/d7/dd/df/f23 [21427,57865] 0 2024-04-12T13:41:51.823 INFO:tasks.workunit.client.0.smithi060.stdout:4/126: chown d6/d7/dd/d1a/d19/f1b 45 1 2024-04-12T13:41:51.825 INFO:tasks.workunit.client.0.smithi060.stdout:6/187: symlink d1/d7/da/dc/d24/l41 0 2024-04-12T13:41:51.829 INFO:tasks.workunit.client.1.smithi110.stdout:0/71: mknod d1/d8/c16 0 2024-04-12T13:41:51.830 INFO:tasks.workunit.client.0.smithi060.stdout:5/128: dwrite d6/f17 [0,4194304] 0 2024-04-12T13:41:51.833 INFO:tasks.workunit.client.0.smithi060.stdout:4/127: write d6/d7/dd/df/f20 [977352,110365] 0 2024-04-12T13:41:51.833 INFO:tasks.workunit.client.1.smithi110.stdout:8/61: symlink d1/d7/l14 0 2024-04-12T13:41:51.836 INFO:tasks.workunit.client.0.smithi060.stdout:5/129: mknod d6/dd/d1f/c28 0 2024-04-12T13:41:51.836 INFO:tasks.workunit.client.0.smithi060.stdout:4/128: fdatasync d6/d7/dd/df/f20 0 2024-04-12T13:41:51.837 INFO:tasks.workunit.client.1.smithi110.stdout:9/141: dread f5 [0,4194304] 0 2024-04-12T13:41:51.837 INFO:tasks.workunit.client.0.smithi060.stdout:5/130: read - d6/f20 zero size 2024-04-12T13:41:51.844 INFO:tasks.workunit.client.1.smithi110.stdout:0/72: dwrite d1/d8/ff [0,4194304] 0 2024-04-12T13:41:51.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/129: write d6/d7/dd/d1a/d19/f1b [365063,118170] 0 2024-04-12T13:41:51.848 INFO:tasks.workunit.client.1.smithi110.stdout:7/77: rename d1/l12 to d1/l16 0 2024-04-12T13:41:51.850 INFO:tasks.workunit.client.0.smithi060.stdout:6/188: link d1/d7/da/d20/f36 d1/d7/da/dc/d3a/f42 0 2024-04-12T13:41:51.851 INFO:tasks.workunit.client.1.smithi110.stdout:3/94: symlink d5/dc/l1e 0 2024-04-12T13:41:51.852 INFO:tasks.workunit.client.0.smithi060.stdout:6/189: chown d1/d7/da/dc/f3b 2862 1 2024-04-12T13:41:51.853 INFO:tasks.workunit.client.0.smithi060.stdout:4/130: creat d6/d21/f2d x:0 0 0 2024-04-12T13:41:51.853 INFO:tasks.workunit.client.1.smithi110.stdout:3/95: write d5/dc/f13 [1958906,85980] 0 2024-04-12T13:41:51.855 INFO:tasks.workunit.client.0.smithi060.stdout:9/70: sync 2024-04-12T13:41:51.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/71: dread - d4/d9/fc zero size 2024-04-12T13:41:51.861 INFO:tasks.workunit.client.1.smithi110.stdout:6/147: unlink d7/l2a 0 2024-04-12T13:41:51.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/131: rename d6/l11 to d6/l29 0 2024-04-12T13:41:51.874 INFO:tasks.workunit.client.0.smithi060.stdout:9/72: creat d4/d8/f17 x:0 0 0 2024-04-12T13:41:51.875 INFO:tasks.workunit.client.0.smithi060.stdout:6/190: dwrite d1/d7/da/dc/d24/d34/f2f [0,4194304] 0 2024-04-12T13:41:51.879 INFO:tasks.workunit.client.0.smithi060.stdout:9/73: write d4/d9/fc [700661,104963] 0 2024-04-12T13:41:51.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/191: fdatasync d1/d7/da/dc/d24/f1f 0 2024-04-12T13:41:51.882 INFO:tasks.workunit.client.1.smithi110.stdout:8/62: rmdir d1/d5/dd 39 2024-04-12T13:41:51.882 INFO:tasks.workunit.client.1.smithi110.stdout:8/63: chown d1 6617872 1 2024-04-12T13:41:51.886 INFO:tasks.workunit.client.0.smithi060.stdout:6/192: read - d1/d7/da/dc/d24/d2d/f3d zero size 2024-04-12T13:41:51.889 INFO:tasks.workunit.client.0.smithi060.stdout:4/131: link d6/d7/dd/df/f18 d6/f2e 0 2024-04-12T13:41:51.892 INFO:tasks.workunit.client.1.smithi110.stdout:9/142: mkdir df/d13/d26/d37 0 2024-04-12T13:41:51.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/74: creat d4/f18 x:0 0 0 2024-04-12T13:41:51.896 INFO:tasks.workunit.client.0.smithi060.stdout:7/112: write d0/d7/f6 [3741619,108387] 0 2024-04-12T13:41:51.896 INFO:tasks.workunit.client.0.smithi060.stdout:9/75: read d4/d9/fc [207144,61466] 0 2024-04-12T13:41:51.899 INFO:tasks.workunit.client.0.smithi060.stdout:6/193: unlink d1/c3 0 2024-04-12T13:41:51.903 INFO:tasks.workunit.client.0.smithi060.stdout:4/132: unlink d6/d7/dd/df/f12 0 2024-04-12T13:41:51.907 INFO:tasks.workunit.client.0.smithi060.stdout:5/132: creat d6/d10/f2a x:0 0 0 2024-04-12T13:41:51.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/76: mkdir d4/d9/d19 0 2024-04-12T13:41:51.913 INFO:tasks.workunit.client.1.smithi110.stdout:7/78: dread d1/d3/d4/f9 [0,4194304] 0 2024-04-12T13:41:51.913 INFO:tasks.workunit.client.1.smithi110.stdout:4/174: fsync d0/fc 0 2024-04-12T13:41:51.918 INFO:tasks.workunit.client.1.smithi110.stdout:9/143: truncate fb 4335530 0 2024-04-12T13:41:51.920 INFO:tasks.workunit.client.1.smithi110.stdout:9/144: write df/f2e [839757,84954] 0 2024-04-12T13:41:51.920 INFO:tasks.workunit.client.0.smithi060.stdout:4/133: dwrite d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:41:51.922 INFO:tasks.workunit.client.1.smithi110.stdout:0/73: link d1/d8/fb d1/d11/f17 0 2024-04-12T13:41:51.922 INFO:tasks.workunit.client.1.smithi110.stdout:9/145: chown df/f11 723633464 1 2024-04-12T13:41:51.924 INFO:tasks.workunit.client.1.smithi110.stdout:6/148: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:51.925 INFO:tasks.workunit.client.0.smithi060.stdout:7/113: mknod d0/c29 0 2024-04-12T13:41:51.927 INFO:tasks.workunit.client.1.smithi110.stdout:6/149: write d7/d10/f20 [3856150,115897] 0 2024-04-12T13:41:51.928 INFO:tasks.workunit.client.1.smithi110.stdout:7/79: symlink d1/l17 0 2024-04-12T13:41:51.929 INFO:tasks.workunit.client.1.smithi110.stdout:6/150: dread - d7/d10/d1c/f29 zero size 2024-04-12T13:41:51.930 INFO:tasks.workunit.client.1.smithi110.stdout:2/82: truncate f0 4047277 0 2024-04-12T13:41:51.931 INFO:tasks.workunit.client.1.smithi110.stdout:8/64: unlink d1/d5/dd/f12 0 2024-04-12T13:41:51.932 INFO:tasks.workunit.client.1.smithi110.stdout:6/151: write d7/d10/d1c/f29 [653708,101570] 0 2024-04-12T13:41:51.932 INFO:tasks.workunit.client.1.smithi110.stdout:2/83: write d6/fb [4550869,11393] 0 2024-04-12T13:41:51.934 INFO:tasks.workunit.client.1.smithi110.stdout:4/175: rename d0/d19/c27 to d0/de/c35 0 2024-04-12T13:41:51.934 INFO:tasks.workunit.client.1.smithi110.stdout:8/65: dread - d1/d3/fe zero size 2024-04-12T13:41:51.937 INFO:tasks.workunit.client.0.smithi060.stdout:6/194: creat d1/d7/f43 x:0 0 0 2024-04-12T13:41:51.937 INFO:tasks.workunit.client.1.smithi110.stdout:5/55: getdents da/db 0 2024-04-12T13:41:51.938 INFO:tasks.workunit.client.1.smithi110.stdout:6/152: read d7/d10/d12/f1f [2096879,77597] 0 2024-04-12T13:41:51.939 INFO:tasks.workunit.client.0.smithi060.stdout:7/114: rename d0/ca to d0/d1b/c2a 0 2024-04-12T13:41:51.941 INFO:tasks.workunit.client.0.smithi060.stdout:7/115: write d0/f1c [845184,120201] 0 2024-04-12T13:41:51.941 INFO:tasks.workunit.client.1.smithi110.stdout:1/39: getdents . 0 2024-04-12T13:41:51.943 INFO:tasks.workunit.client.1.smithi110.stdout:8/66: write d1/d7/fb [4331637,79351] 0 2024-04-12T13:41:51.943 INFO:tasks.workunit.client.1.smithi110.stdout:5/56: fsync da/db/fe 0 2024-04-12T13:41:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/77: link d4/d8/fb d4/d9/d19/f1a 0 2024-04-12T13:41:51.945 INFO:tasks.workunit.client.0.smithi060.stdout:9/78: fdatasync d4/d9/f10 0 2024-04-12T13:41:51.946 INFO:tasks.workunit.client.1.smithi110.stdout:2/84: truncate d6/dc/dd/f10 1247113 0 2024-04-12T13:41:51.946 INFO:tasks.workunit.client.1.smithi110.stdout:1/40: dread - fb zero size 2024-04-12T13:41:51.946 INFO:tasks.workunit.client.1.smithi110.stdout:0/74: creat d1/d11/f18 x:0 0 0 2024-04-12T13:41:51.947 INFO:tasks.workunit.client.0.smithi060.stdout:4/134: mkdir d6/d2f 0 2024-04-12T13:41:51.948 INFO:tasks.workunit.client.1.smithi110.stdout:9/146: dwrite df/f1e [0,4194304] 0 2024-04-12T13:41:51.948 INFO:tasks.workunit.client.1.smithi110.stdout:8/67: write d1/d3/fe [1032656,25844] 0 2024-04-12T13:41:51.950 INFO:tasks.workunit.client.0.smithi060.stdout:5/133: creat d6/d10/f2b x:0 0 0 2024-04-12T13:41:51.955 INFO:tasks.workunit.client.0.smithi060.stdout:7/116: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:41:51.958 INFO:tasks.workunit.client.0.smithi060.stdout:9/79: readlink d4/l14 0 2024-04-12T13:41:51.960 INFO:tasks.workunit.client.0.smithi060.stdout:9/80: fdatasync d4/d8/fa 0 2024-04-12T13:41:51.963 INFO:tasks.workunit.client.1.smithi110.stdout:4/176: rename d0/de/d2c/f18 to d0/de/f36 0 2024-04-12T13:41:51.966 INFO:tasks.workunit.client.1.smithi110.stdout:5/57: mkdir da/db/d15 0 2024-04-12T13:41:51.968 INFO:tasks.workunit.client.1.smithi110.stdout:5/58: readlink l6 0 2024-04-12T13:41:51.968 INFO:tasks.workunit.client.1.smithi110.stdout:4/177: write d0/f5 [331628,80963] 0 2024-04-12T13:41:51.969 INFO:tasks.workunit.client.0.smithi060.stdout:5/134: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:51.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/135: read f2 [1972907,5728] 0 2024-04-12T13:41:51.972 INFO:tasks.workunit.client.1.smithi110.stdout:2/85: rmdir d6 39 2024-04-12T13:41:51.973 INFO:tasks.workunit.client.0.smithi060.stdout:7/117: dread d0/d1b/f23 [0,4194304] 0 2024-04-12T13:41:51.974 INFO:tasks.workunit.client.0.smithi060.stdout:7/118: chown d0/f21 0 1 2024-04-12T13:41:51.975 INFO:tasks.workunit.client.1.smithi110.stdout:1/41: mkdir de 0 2024-04-12T13:41:51.975 INFO:tasks.workunit.client.1.smithi110.stdout:9/147: dread df/d13/d2c/f36 [0,4194304] 0 2024-04-12T13:41:51.975 INFO:tasks.workunit.client.1.smithi110.stdout:0/75: dread d1/d11/f17 [0,4194304] 0 2024-04-12T13:41:51.976 INFO:tasks.workunit.client.0.smithi060.stdout:7/119: readlink d0/d7/l13 0 2024-04-12T13:41:51.976 INFO:tasks.workunit.client.1.smithi110.stdout:6/153: dwrite d7/d10/d1c/d2b/f2f [0,4194304] 0 2024-04-12T13:41:51.977 INFO:tasks.workunit.client.0.smithi060.stdout:7/120: readlink d0/d7/lc 0 2024-04-12T13:41:51.977 INFO:tasks.workunit.client.0.smithi060.stdout:9/81: mkdir d4/d9/d1b 0 2024-04-12T13:41:51.978 INFO:tasks.workunit.client.1.smithi110.stdout:1/42: dread - fa zero size 2024-04-12T13:41:51.978 INFO:tasks.workunit.client.0.smithi060.stdout:7/121: chown d0/d1b/f27 1 1 2024-04-12T13:41:51.981 INFO:tasks.workunit.client.1.smithi110.stdout:0/76: stat d1/d8 0 2024-04-12T13:41:51.983 INFO:tasks.workunit.client.1.smithi110.stdout:8/68: dwrite d1/d7/fb [4194304,4194304] 0 2024-04-12T13:41:51.984 INFO:tasks.workunit.client.1.smithi110.stdout:9/148: truncate df/d13/d26/f32 253771 0 2024-04-12T13:41:51.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/135: link d6/d7/db/f22 d6/f30 0 2024-04-12T13:41:51.989 INFO:tasks.workunit.client.1.smithi110.stdout:8/69: read - d1/d5/dd/ff zero size 2024-04-12T13:41:51.989 INFO:tasks.workunit.client.1.smithi110.stdout:3/96: sync 2024-04-12T13:41:51.990 INFO:tasks.workunit.client.1.smithi110.stdout:7/80: link d1/d3/f11 d1/f18 0 2024-04-12T13:41:51.994 INFO:tasks.workunit.client.0.smithi060.stdout:6/195: getdents d1 0 2024-04-12T13:41:51.998 INFO:tasks.workunit.client.0.smithi060.stdout:7/122: symlink d0/d7/l2b 0 2024-04-12T13:41:52.000 INFO:tasks.workunit.client.0.smithi060.stdout:1/86: sync 2024-04-12T13:41:52.000 INFO:tasks.workunit.client.0.smithi060.stdout:0/143: sync 2024-04-12T13:41:52.000 INFO:tasks.workunit.client.0.smithi060.stdout:8/107: sync 2024-04-12T13:41:52.001 INFO:tasks.workunit.client.0.smithi060.stdout:2/90: sync 2024-04-12T13:41:52.001 INFO:tasks.workunit.client.0.smithi060.stdout:3/109: sync 2024-04-12T13:41:52.001 INFO:tasks.workunit.client.1.smithi110.stdout:4/178: write d0/d19/f20 [2770790,77014] 0 2024-04-12T13:41:52.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/82: creat d4/d9/d1b/f1c x:0 0 0 2024-04-12T13:41:52.007 INFO:tasks.workunit.client.0.smithi060.stdout:8/108: dread - d9/da/f24 zero size 2024-04-12T13:41:52.007 INFO:tasks.workunit.client.0.smithi060.stdout:6/196: write d1/d7/da/dc/d24/f37 [199734,58562] 0 2024-04-12T13:41:52.008 INFO:tasks.workunit.client.1.smithi110.stdout:5/59: truncate da/db/ff 78928 0 2024-04-12T13:41:52.009 INFO:tasks.workunit.client.1.smithi110.stdout:8/70: fdatasync d1/d7/fb 0 2024-04-12T13:41:52.009 INFO:tasks.workunit.client.1.smithi110.stdout:5/60: fsync f8 0 2024-04-12T13:41:52.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/136: creat d6/d10/f2c x:0 0 0 2024-04-12T13:41:52.011 INFO:tasks.workunit.client.1.smithi110.stdout:6/154: rmdir d7/d10 39 2024-04-12T13:41:52.011 INFO:tasks.workunit.client.1.smithi110.stdout:1/43: write fb [740251,47243] 0 2024-04-12T13:41:52.012 INFO:tasks.workunit.client.0.smithi060.stdout:2/91: rmdir d6/d13 39 2024-04-12T13:41:52.012 INFO:tasks.workunit.client.1.smithi110.stdout:0/77: mknod d1/d11/c19 0 2024-04-12T13:41:52.012 INFO:tasks.workunit.client.0.smithi060.stdout:1/87: chown ce 551993 1 2024-04-12T13:41:52.013 INFO:tasks.workunit.client.1.smithi110.stdout:1/44: write fa [100257,68171] 0 2024-04-12T13:41:52.014 INFO:tasks.workunit.client.1.smithi110.stdout:0/78: dread d1/f14 [0,4194304] 0 2024-04-12T13:41:52.016 INFO:tasks.workunit.client.1.smithi110.stdout:9/149: mkdir df/d38 0 2024-04-12T13:41:52.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/110: symlink d7/da/l24 0 2024-04-12T13:41:52.018 INFO:tasks.workunit.client.1.smithi110.stdout:7/81: write d1/d3/f11 [1863311,55271] 0 2024-04-12T13:41:52.019 INFO:tasks.workunit.client.0.smithi060.stdout:2/92: fdatasync d6/d10/d16/f18 0 2024-04-12T13:41:52.020 INFO:tasks.workunit.client.0.smithi060.stdout:9/83: rmdir d4/d9/d19 39 2024-04-12T13:41:52.021 INFO:tasks.workunit.client.0.smithi060.stdout:4/136: dwrite d6/d21/f2a [0,4194304] 0 2024-04-12T13:41:52.023 INFO:tasks.workunit.client.0.smithi060.stdout:6/197: creat d1/d7/da/d20/f44 x:0 0 0 2024-04-12T13:41:52.026 INFO:tasks.workunit.client.1.smithi110.stdout:9/150: dread df/f11 [0,4194304] 0 2024-04-12T13:41:52.027 INFO:tasks.workunit.client.0.smithi060.stdout:9/84: write d4/f18 [632261,43876] 0 2024-04-12T13:41:52.031 INFO:tasks.workunit.client.0.smithi060.stdout:2/93: truncate d6/d10/d16/f18 285134 0 2024-04-12T13:41:52.032 INFO:tasks.workunit.client.1.smithi110.stdout:5/61: unlink da/fc 0 2024-04-12T13:41:52.034 INFO:tasks.workunit.client.1.smithi110.stdout:5/62: write f9 [3119015,128462] 0 2024-04-12T13:41:52.034 INFO:tasks.workunit.client.1.smithi110.stdout:8/71: symlink d1/d5/dd/l15 0 2024-04-12T13:41:52.036 INFO:tasks.workunit.client.1.smithi110.stdout:8/72: write d1/d3/f13 [3021560,37166] 0 2024-04-12T13:41:52.037 INFO:tasks.workunit.client.0.smithi060.stdout:8/109: unlink d9/d1b/c16 0 2024-04-12T13:41:52.038 INFO:tasks.workunit.client.1.smithi110.stdout:8/73: chown d1/d5/ca 159434189 1 2024-04-12T13:41:52.044 INFO:tasks.workunit.client.0.smithi060.stdout:8/110: fdatasync d9/da/f24 0 2024-04-12T13:41:52.044 INFO:tasks.workunit.client.1.smithi110.stdout:0/79: symlink d1/d8/l1a 0 2024-04-12T13:41:52.047 INFO:tasks.workunit.client.0.smithi060.stdout:1/88: mkdir d1e/d1f 0 2024-04-12T13:41:52.050 INFO:tasks.workunit.client.0.smithi060.stdout:8/111: chown d9/fb 3822 1 2024-04-12T13:41:52.050 INFO:tasks.workunit.client.0.smithi060.stdout:7/123: dwrite d0/d1b/f23 [4194304,4194304] 0 2024-04-12T13:41:52.051 INFO:tasks.workunit.client.1.smithi110.stdout:2/86: link d6/dc/dd/fe d6/f12 0 2024-04-12T13:41:52.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/111: dwrite d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:41:52.061 INFO:tasks.workunit.client.1.smithi110.stdout:7/82: symlink d1/l19 0 2024-04-12T13:41:52.064 INFO:tasks.workunit.client.0.smithi060.stdout:3/112: fdatasync d7/f10 0 2024-04-12T13:41:52.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/94: dread d6/f9 [0,4194304] 0 2024-04-12T13:41:52.067 INFO:tasks.workunit.client.0.smithi060.stdout:0/144: getdents d7/d9 0 2024-04-12T13:41:52.072 INFO:tasks.workunit.client.0.smithi060.stdout:5/137: creat d6/dd/d27/f2d x:0 0 0 2024-04-12T13:41:52.076 INFO:tasks.workunit.client.1.smithi110.stdout:9/151: mkdir df/d13/d2c/d2d/d39 0 2024-04-12T13:41:52.077 INFO:tasks.workunit.client.1.smithi110.stdout:9/152: write fd [3622447,86772] 0 2024-04-12T13:41:52.079 INFO:tasks.workunit.client.0.smithi060.stdout:7/124: dread d0/fe [0,4194304] 0 2024-04-12T13:41:52.081 INFO:tasks.workunit.client.0.smithi060.stdout:6/198: dwrite d1/d7/da/dc/d24/d2d/f3d [0,4194304] 0 2024-04-12T13:41:52.084 INFO:tasks.workunit.client.0.smithi060.stdout:4/137: symlink d6/d2f/l31 0 2024-04-12T13:41:52.088 INFO:tasks.workunit.client.0.smithi060.stdout:4/138: dread - d6/d21/f2d zero size 2024-04-12T13:41:52.090 INFO:tasks.workunit.client.1.smithi110.stdout:8/74: unlink d1/f2 0 2024-04-12T13:41:52.092 INFO:tasks.workunit.client.1.smithi110.stdout:1/45: mknod de/cf 0 2024-04-12T13:41:52.095 INFO:tasks.workunit.client.0.smithi060.stdout:5/138: dread d6/fc [0,4194304] 0 2024-04-12T13:41:52.097 INFO:tasks.workunit.client.1.smithi110.stdout:3/97: creat d5/f1f x:0 0 0 2024-04-12T13:41:52.098 INFO:tasks.workunit.client.0.smithi060.stdout:5/139: chown d6/f14 9 1 2024-04-12T13:41:52.099 INFO:tasks.workunit.client.1.smithi110.stdout:2/87: mkdir d6/dc/d13 0 2024-04-12T13:41:52.101 INFO:tasks.workunit.client.0.smithi060.stdout:2/95: dwrite d6/f19 [0,4194304] 0 2024-04-12T13:41:52.102 INFO:tasks.workunit.client.1.smithi110.stdout:2/88: write d6/fb [3375295,126700] 0 2024-04-12T13:41:52.103 INFO:tasks.workunit.client.0.smithi060.stdout:3/113: write d7/f8 [8983257,88076] 0 2024-04-12T13:41:52.108 INFO:tasks.workunit.client.0.smithi060.stdout:2/96: write d6/d10/d16/f18 [2255,129345] 0 2024-04-12T13:41:52.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/89: unlink lf 0 2024-04-12T13:41:52.114 INFO:tasks.workunit.client.1.smithi110.stdout:3/98: dread d5/dc/f13 [0,4194304] 0 2024-04-12T13:41:52.115 INFO:tasks.workunit.client.0.smithi060.stdout:6/199: mknod d1/c45 0 2024-04-12T13:41:52.117 INFO:tasks.workunit.client.0.smithi060.stdout:8/112: mknod d9/d1d/c26 0 2024-04-12T13:41:52.120 INFO:tasks.workunit.client.1.smithi110.stdout:5/63: mknod da/db/d15/c16 0 2024-04-12T13:41:52.120 INFO:tasks.workunit.client.1.smithi110.stdout:5/64: stat f8 0 2024-04-12T13:41:52.122 INFO:tasks.workunit.client.0.smithi060.stdout:0/145: mkdir d7/d33 0 2024-04-12T13:41:52.127 INFO:tasks.workunit.client.1.smithi110.stdout:8/75: chown d1/d3/l4 57573711 1 2024-04-12T13:41:52.128 INFO:tasks.workunit.client.1.smithi110.stdout:1/46: creat de/f10 x:0 0 0 2024-04-12T13:41:52.130 INFO:tasks.workunit.client.1.smithi110.stdout:1/47: dread f6 [0,4194304] 0 2024-04-12T13:41:52.130 INFO:tasks.workunit.client.0.smithi060.stdout:3/114: write d7/d17/f1a [4105746,70900] 0 2024-04-12T13:41:52.132 INFO:tasks.workunit.client.1.smithi110.stdout:0/80: dwrite d1/d11/f17 [0,4194304] 0 2024-04-12T13:41:52.133 INFO:tasks.workunit.client.0.smithi060.stdout:1/90: symlink d1e/l20 0 2024-04-12T13:41:52.136 INFO:tasks.workunit.client.1.smithi110.stdout:2/89: rmdir d6/dc 39 2024-04-12T13:41:52.139 INFO:tasks.workunit.client.0.smithi060.stdout:7/125: rename d0/d1b/f23 to d0/d7/f2c 0 2024-04-12T13:41:52.143 INFO:tasks.workunit.client.0.smithi060.stdout:8/113: mknod d9/d1d/c27 0 2024-04-12T13:41:52.144 INFO:tasks.workunit.client.1.smithi110.stdout:4/179: link d0/l9 d0/d19/l37 0 2024-04-12T13:41:52.145 INFO:tasks.workunit.client.1.smithi110.stdout:4/180: stat d0/ff 0 2024-04-12T13:41:52.145 INFO:tasks.workunit.client.0.smithi060.stdout:8/114: truncate d9/f1f 483897 0 2024-04-12T13:41:52.146 INFO:tasks.workunit.client.0.smithi060.stdout:1/91: dread f13 [4194304,4194304] 0 2024-04-12T13:41:52.147 INFO:tasks.workunit.client.1.smithi110.stdout:3/99: readlink l4 0 2024-04-12T13:41:52.147 INFO:tasks.workunit.client.0.smithi060.stdout:5/140: truncate f1 3710283 0 2024-04-12T13:41:52.148 INFO:tasks.workunit.client.0.smithi060.stdout:1/92: fsync fb 0 2024-04-12T13:41:52.148 INFO:tasks.workunit.client.1.smithi110.stdout:9/153: getdents df/d13/d26/d37 0 2024-04-12T13:41:52.149 INFO:tasks.workunit.client.0.smithi060.stdout:1/93: truncate f1d 652998 0 2024-04-12T13:41:52.149 INFO:tasks.workunit.client.0.smithi060.stdout:3/115: mkdir d7/da/dd/d25 0 2024-04-12T13:41:52.151 INFO:tasks.workunit.client.1.smithi110.stdout:6/155: creat d7/d10/f35 x:0 0 0 2024-04-12T13:41:52.154 INFO:tasks.workunit.client.1.smithi110.stdout:4/181: dread d0/d13/f21 [0,4194304] 0 2024-04-12T13:41:52.155 INFO:tasks.workunit.client.1.smithi110.stdout:8/76: symlink d1/l16 0 2024-04-12T13:41:52.156 INFO:tasks.workunit.client.0.smithi060.stdout:7/126: rmdir d0/d1b 39 2024-04-12T13:41:52.157 INFO:tasks.workunit.client.1.smithi110.stdout:8/77: write d1/d3/fe [798600,7917] 0 2024-04-12T13:41:52.158 INFO:tasks.workunit.client.1.smithi110.stdout:1/48: creat de/f11 x:0 0 0 2024-04-12T13:41:52.160 INFO:tasks.workunit.client.1.smithi110.stdout:1/49: chown cd 6520 1 2024-04-12T13:41:52.162 INFO:tasks.workunit.client.0.smithi060.stdout:6/200: rename d1/d7/da/d20/f44 to d1/d7/da/dc/d24/f46 0 2024-04-12T13:41:52.163 INFO:tasks.workunit.client.1.smithi110.stdout:0/81: symlink d1/l1b 0 2024-04-12T13:41:52.165 INFO:tasks.workunit.client.0.smithi060.stdout:2/97: truncate d6/f19 3662133 0 2024-04-12T13:41:52.166 INFO:tasks.workunit.client.1.smithi110.stdout:6/156: dwrite d7/d10/f35 [0,4194304] 0 2024-04-12T13:41:52.166 INFO:tasks.workunit.client.0.smithi060.stdout:2/98: fdatasync f4 0 2024-04-12T13:41:52.167 INFO:tasks.workunit.client.0.smithi060.stdout:6/201: truncate d1/d7/da/dc/d24/f37 813112 0 2024-04-12T13:41:52.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/99: chown f3 1880985 1 2024-04-12T13:41:52.168 INFO:tasks.workunit.client.0.smithi060.stdout:6/202: write d1/f14 [24620,127885] 0 2024-04-12T13:41:52.173 INFO:tasks.workunit.client.1.smithi110.stdout:3/100: mkdir d5/dc/d20 0 2024-04-12T13:41:52.176 INFO:tasks.workunit.client.0.smithi060.stdout:7/127: fdatasync d0/d7/f2c 0 2024-04-12T13:41:52.177 INFO:tasks.workunit.client.1.smithi110.stdout:4/182: mknod d0/de/d2c/c38 0 2024-04-12T13:41:52.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:51 smithi060 ceph-mon[29097]: pgmap v20: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 8.5 MiB/s wr, 177 op/s 2024-04-12T13:41:52.181 INFO:tasks.workunit.client.0.smithi060.stdout:1/94: rename l9 to d1e/d1f/l21 0 2024-04-12T13:41:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:1/95: truncate f1c 351793 0 2024-04-12T13:41:52.182 INFO:tasks.workunit.client.1.smithi110.stdout:8/78: mknod d1/d7/c17 0 2024-04-12T13:41:52.184 INFO:tasks.workunit.client.1.smithi110.stdout:8/79: write d1/d3/fe [705240,113380] 0 2024-04-12T13:41:52.184 INFO:tasks.workunit.client.0.smithi060.stdout:1/96: dread f19 [0,4194304] 0 2024-04-12T13:41:52.186 INFO:tasks.workunit.client.1.smithi110.stdout:1/50: symlink de/l12 0 2024-04-12T13:41:52.188 INFO:tasks.workunit.client.1.smithi110.stdout:1/51: dread - de/f10 zero size 2024-04-12T13:41:52.189 INFO:tasks.workunit.client.0.smithi060.stdout:2/100: creat d6/d10/d16/f1c x:0 0 0 2024-04-12T13:41:52.191 INFO:tasks.workunit.client.1.smithi110.stdout:0/82: symlink d1/d8/l1c 0 2024-04-12T13:41:52.193 INFO:tasks.workunit.client.1.smithi110.stdout:7/83: getdents d1/d3/d4 0 2024-04-12T13:41:52.193 INFO:tasks.workunit.client.1.smithi110.stdout:5/65: write da/db/ff [1029191,121309] 0 2024-04-12T13:41:52.194 INFO:tasks.workunit.client.0.smithi060.stdout:3/116: creat d7/da/dd/d25/f26 x:0 0 0 2024-04-12T13:41:52.195 INFO:tasks.workunit.client.1.smithi110.stdout:5/66: write da/db/fe [854500,108491] 0 2024-04-12T13:41:52.197 INFO:tasks.workunit.client.1.smithi110.stdout:5/67: chown da/db/f12 0 1 2024-04-12T13:41:52.198 INFO:tasks.workunit.client.0.smithi060.stdout:6/203: rename d1/d7/da/dc/d24/d30/c38 to d1/d7/da/dc/d24/d30/c47 0 2024-04-12T13:41:52.201 INFO:tasks.workunit.client.1.smithi110.stdout:6/157: rename d7/d10/d12/f1e to d7/d25/f36 0 2024-04-12T13:41:52.201 INFO:tasks.workunit.client.1.smithi110.stdout:2/90: creat d6/dc/f14 x:0 0 0 2024-04-12T13:41:52.202 INFO:tasks.workunit.client.0.smithi060.stdout:8/115: truncate f1 2334082 0 2024-04-12T13:41:52.203 INFO:tasks.workunit.client.0.smithi060.stdout:8/116: write d9/f11 [453840,95326] 0 2024-04-12T13:41:52.204 INFO:tasks.workunit.client.1.smithi110.stdout:9/154: getdents df/d13/d2c/d2d/d39 0 2024-04-12T13:41:52.204 INFO:tasks.workunit.client.0.smithi060.stdout:7/128: rename d0/d1b to d0/d1b/d2d 22 2024-04-12T13:41:52.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.204+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e4071d40 con 0x7f79cc06bcf0 2024-04-12T13:41:52.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.206+0000 7f79e1600700 1 -- 172.21.15.60:0/1209427384 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f79d000f040 con 0x7f79cc06bcf0 2024-04-12T13:41:52.207 INFO:tasks.workunit.client.1.smithi110.stdout:4/183: write d0/d13/f21 [1082046,62919] 0 2024-04-12T13:41:52.209 INFO:tasks.workunit.client.1.smithi110.stdout:8/80: rename d1/d7/l14 to d1/d7/l18 0 2024-04-12T13:41:52.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 msgr2=0x7f79cc06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 0x7f79cc06e1a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009fd0 tx=0x7f79d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:52.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 msgr2=0x7f79e4113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79d800b0d0 tx=0x7f79d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:52.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 shutdown_connections 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f79cc06bcf0 0x7f79cc06e1a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e40fcf20 0x7f79e4113ff0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79d800b0d0 tx=0x7f79d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 --2- 172.21.15.60:0/1209427384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79e40fe090 0x7f79e4114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 >> 172.21.15.60:0/1209427384 conn(0x7f79e40f85c0 msgr2=0x7f79e40f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.209+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 shutdown_connections 2024-04-12T13:41:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.210+0000 7f79ebe00700 1 -- 172.21.15.60:0/1209427384 wait complete. 2024-04-12T13:41:52.218 INFO:tasks.workunit.client.0.smithi060.stdout:6/204: truncate d1/d7/da/dc/d24/d34/f28 411781 0 2024-04-12T13:41:52.221 INFO:tasks.workunit.client.0.smithi060.stdout:6/205: stat d1/d7/da/dc/d24/l41 0 2024-04-12T13:41:52.221 INFO:tasks.workunit.client.0.smithi060.stdout:8/117: mknod d9/d1d/c28 0 2024-04-12T13:41:52.221 INFO:tasks.workunit.client.0.smithi060.stdout:1/97: dwrite f1d [0,4194304] 0 2024-04-12T13:41:52.225 INFO:tasks.workunit.client.0.smithi060.stdout:1/98: read f1d [931408,63907] 0 2024-04-12T13:41:52.225 INFO:tasks.workunit.client.0.smithi060.stdout:5/141: dread f1 [0,4194304] 0 2024-04-12T13:41:52.226 INFO:tasks.workunit.client.0.smithi060.stdout:8/118: write d9/da/f24 [715044,39798] 0 2024-04-12T13:41:52.226 INFO:tasks.workunit.client.1.smithi110.stdout:0/83: rename d1/d11/c19 to d1/c1d 0 2024-04-12T13:41:52.227 INFO:tasks.workunit.client.1.smithi110.stdout:0/84: readlink d1/d8/l1a 0 2024-04-12T13:41:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:51 smithi110 ceph-mon[36055]: pgmap v20: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 8.5 MiB/s wr, 177 op/s 2024-04-12T13:41:52.229 INFO:tasks.workunit.client.1.smithi110.stdout:3/101: symlink d5/l21 0 2024-04-12T13:41:52.233 INFO:tasks.workunit.client.1.smithi110.stdout:6/158: fsync d7/d10/d12/f1f 0 2024-04-12T13:41:52.234 INFO:tasks.workunit.client.1.smithi110.stdout:1/52: write f6 [292030,73663] 0 2024-04-12T13:41:52.235 INFO:tasks.workunit.client.0.smithi060.stdout:2/101: truncate f4 748128 0 2024-04-12T13:41:52.236 INFO:tasks.workunit.client.1.smithi110.stdout:2/91: fdatasync d6/dc/dd/fe 0 2024-04-12T13:41:52.238 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:41:52.246 INFO:tasks.workunit.client.1.smithi110.stdout:1/53: dread fb [0,4194304] 0 2024-04-12T13:41:52.250 INFO:tasks.workunit.client.1.smithi110.stdout:0/85: dwrite d1/d11/f18 [0,4194304] 0 2024-04-12T13:41:52.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/102: unlink d5/l21 0 2024-04-12T13:41:52.252 INFO:tasks.workunit.client.1.smithi110.stdout:5/68: dwrite f1 [0,4194304] 0 2024-04-12T13:41:52.252 INFO:tasks.workunit.client.1.smithi110.stdout:0/86: stat d1/d8/fb 0 2024-04-12T13:41:52.253 INFO:tasks.workunit.client.1.smithi110.stdout:3/103: write d5/f1f [135167,43512] 0 2024-04-12T13:41:52.253 INFO:tasks.workunit.client.0.smithi060.stdout:1/99: creat d1e/d1f/f22 x:0 0 0 2024-04-12T13:41:52.254 INFO:tasks.workunit.client.0.smithi060.stdout:7/129: dwrite d0/d7/f2c [4194304,4194304] 0 2024-04-12T13:41:52.256 INFO:tasks.workunit.client.0.smithi060.stdout:8/119: symlink d9/d1b/l29 0 2024-04-12T13:41:52.257 INFO:tasks.workunit.client.0.smithi060.stdout:7/130: fdatasync d0/f21 0 2024-04-12T13:41:52.257 INFO:tasks.workunit.client.1.smithi110.stdout:6/159: write d7/d10/d12/f1f [7616201,126697] 0 2024-04-12T13:41:52.261 INFO:tasks.workunit.client.0.smithi060.stdout:2/102: chown d6/d10/c11 775098 1 2024-04-12T13:41:52.262 INFO:tasks.workunit.client.0.smithi060.stdout:3/117: rmdir d7/d17/d19/d21 0 2024-04-12T13:41:52.263 INFO:tasks.workunit.client.0.smithi060.stdout:7/131: read d0/f1c [166376,3007] 0 2024-04-12T13:41:52.264 INFO:tasks.workunit.client.1.smithi110.stdout:5/69: dread da/db/fe [0,4194304] 0 2024-04-12T13:41:52.264 INFO:tasks.workunit.client.0.smithi060.stdout:7/132: read - d0/f1e zero size 2024-04-12T13:41:52.264 INFO:tasks.workunit.client.0.smithi060.stdout:2/103: readlink d6/lb 0 2024-04-12T13:41:52.265 INFO:tasks.workunit.client.1.smithi110.stdout:9/155: mkdir df/d13/d2c/d2d/d39/d3a 0 2024-04-12T13:41:52.268 INFO:tasks.workunit.client.0.smithi060.stdout:2/104: truncate d6/f15 39284 0 2024-04-12T13:41:52.268 INFO:tasks.workunit.client.1.smithi110.stdout:2/92: fsync d6/dc/dd/fe 0 2024-04-12T13:41:52.269 INFO:tasks.workunit.client.1.smithi110.stdout:4/184: symlink d0/l39 0 2024-04-12T13:41:52.274 INFO:tasks.workunit.client.0.smithi060.stdout:5/142: symlink d6/l2e 0 2024-04-12T13:41:52.276 INFO:tasks.workunit.client.1.smithi110.stdout:1/54: symlink de/l13 0 2024-04-12T13:41:52.276 INFO:tasks.workunit.client.0.smithi060.stdout:5/143: chown d6/d10/d12/d15/l26 28782876 1 2024-04-12T13:41:52.277 INFO:tasks.workunit.client.0.smithi060.stdout:1/100: mkdir d1e/d23 0 2024-04-12T13:41:52.277 INFO:tasks.workunit.client.0.smithi060.stdout:1/101: read - f14 zero size 2024-04-12T13:41:52.283 INFO:tasks.workunit.client.0.smithi060.stdout:1/102: dread f19 [0,4194304] 0 2024-04-12T13:41:52.284 INFO:tasks.workunit.client.1.smithi110.stdout:0/87: creat d1/f1e x:0 0 0 2024-04-12T13:41:52.286 INFO:tasks.workunit.client.0.smithi060.stdout:8/120: symlink d9/d1b/l2a 0 2024-04-12T13:41:52.290 INFO:tasks.workunit.client.0.smithi060.stdout:3/118: mkdir d7/d17/d27 0 2024-04-12T13:41:52.294 INFO:tasks.workunit.client.1.smithi110.stdout:6/160: rename d7/d10/d1c/d2b/f2f to d7/d10/d12/f37 0 2024-04-12T13:41:52.294 INFO:tasks.workunit.client.1.smithi110.stdout:0/88: dread d1/d11/f18 [0,4194304] 0 2024-04-12T13:41:52.296 INFO:tasks.workunit.client.1.smithi110.stdout:5/70: mkdir da/db/d15/d17 0 2024-04-12T13:41:52.301 INFO:tasks.workunit.client.0.smithi060.stdout:7/133: write d0/f1a [1080303,8563] 0 2024-04-12T13:41:52.302 INFO:tasks.workunit.client.0.smithi060.stdout:7/134: fdatasync d0/d7/f10 0 2024-04-12T13:41:52.305 INFO:tasks.workunit.client.0.smithi060.stdout:7/135: write d0/f1a [1631237,104689] 0 2024-04-12T13:41:52.312 INFO:tasks.workunit.client.0.smithi060.stdout:6/206: write d1/d7/da/dc/d24/d34/f28 [218449,116430] 0 2024-04-12T13:41:52.319 INFO:tasks.workunit.client.0.smithi060.stdout:2/105: mknod d6/d13/d17/c1d 0 2024-04-12T13:41:52.320 INFO:tasks.workunit.client.0.smithi060.stdout:6/207: mknod d1/d7/da/dc/c48 0 2024-04-12T13:41:52.323 INFO:tasks.workunit.client.0.smithi060.stdout:6/208: dread - d1/d7/da/d20/f36 zero size 2024-04-12T13:41:52.324 INFO:tasks.workunit.client.0.smithi060.stdout:7/136: symlink d0/l2e 0 2024-04-12T13:41:52.326 INFO:tasks.workunit.client.0.smithi060.stdout:5/144: getdents d6/d10/d12 0 2024-04-12T13:41:52.327 INFO:tasks.workunit.client.0.smithi060.stdout:1/103: link l1a d1e/d23/l24 0 2024-04-12T13:41:52.328 INFO:tasks.workunit.client.0.smithi060.stdout:5/145: read - d6/d10/f2a zero size 2024-04-12T13:41:52.329 INFO:tasks.workunit.client.0.smithi060.stdout:8/121: getdents d9/da 0 2024-04-12T13:41:52.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/119: truncate d7/da/dd/f12 2494563 0 2024-04-12T13:41:52.332 INFO:tasks.workunit.client.0.smithi060.stdout:6/209: stat d1/d7/da/c1a 0 2024-04-12T13:41:52.333 INFO:tasks.workunit.client.1.smithi110.stdout:7/84: link d1/l16 d1/d3/l1a 0 2024-04-12T13:41:52.334 INFO:tasks.workunit.client.1.smithi110.stdout:9/156: rename df/d13/d2c/d2d/d31 to df/d13/d3b 0 2024-04-12T13:41:52.334 INFO:tasks.workunit.client.1.smithi110.stdout:1/55: read fb [765064,99238] 0 2024-04-12T13:41:52.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/146: symlink d6/dd/l2f 0 2024-04-12T13:41:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:8/122: mkdir d9/d1b/d2b 0 2024-04-12T13:41:52.340 INFO:tasks.workunit.client.1.smithi110.stdout:6/161: creat d7/d10/d1c/d2b/f38 x:0 0 0 2024-04-12T13:41:52.340 INFO:tasks.workunit.client.1.smithi110.stdout:2/93: link f4 d6/dc/f15 0 2024-04-12T13:41:52.340 INFO:tasks.workunit.client.1.smithi110.stdout:1/56: truncate de/f11 629841 0 2024-04-12T13:41:52.342 INFO:tasks.workunit.client.0.smithi060.stdout:3/120: rename d7/d17/f1d to d7/d17/f28 0 2024-04-12T13:41:52.344 INFO:tasks.workunit.client.0.smithi060.stdout:3/121: read d7/f8 [7744203,86387] 0 2024-04-12T13:41:52.346 INFO:tasks.workunit.client.0.smithi060.stdout:1/104: creat d1e/d23/f25 x:0 0 0 2024-04-12T13:41:52.346 INFO:tasks.workunit.client.1.smithi110.stdout:9/157: dread f5 [0,4194304] 0 2024-04-12T13:41:52.348 INFO:tasks.workunit.client.1.smithi110.stdout:7/85: mkdir d1/d1b 0 2024-04-12T13:41:52.352 INFO:tasks.workunit.client.0.smithi060.stdout:6/210: rename d1/d7/da/dc/d24/d34/f2f to d1/d7/da/dc/d3a/f49 0 2024-04-12T13:41:52.352 INFO:tasks.workunit.client.0.smithi060.stdout:1/105: fsync d1e/d23/f25 0 2024-04-12T13:41:52.353 INFO:tasks.workunit.client.0.smithi060.stdout:5/147: dread d6/fc [0,4194304] 0 2024-04-12T13:41:52.354 INFO:tasks.workunit.client.1.smithi110.stdout:0/89: dwrite d1/f14 [0,4194304] 0 2024-04-12T13:41:52.355 INFO:tasks.workunit.client.0.smithi060.stdout:8/123: unlink d9/da/le 0 2024-04-12T13:41:52.357 INFO:tasks.workunit.client.1.smithi110.stdout:6/162: rmdir d7/d10 39 2024-04-12T13:41:52.358 INFO:tasks.workunit.client.1.smithi110.stdout:2/94: creat d6/dc/dd/f16 x:0 0 0 2024-04-12T13:41:52.360 INFO:tasks.workunit.client.1.smithi110.stdout:2/95: chown l5 4061950 1 2024-04-12T13:41:52.360 INFO:tasks.workunit.client.1.smithi110.stdout:2/96: readlink d6/la 0 2024-04-12T13:41:52.363 INFO:tasks.workunit.client.0.smithi060.stdout:7/137: creat d0/f2f x:0 0 0 2024-04-12T13:41:52.363 INFO:tasks.workunit.client.0.smithi060.stdout:7/138: stat d0/f1c 0 2024-04-12T13:41:52.364 INFO:tasks.workunit.client.1.smithi110.stdout:3/104: getdents d5 0 2024-04-12T13:41:52.367 INFO:tasks.workunit.client.1.smithi110.stdout:9/158: symlink df/d13/d2c/d2d/l3c 0 2024-04-12T13:41:52.367 INFO:tasks.workunit.client.1.smithi110.stdout:2/97: dread d6/f8 [0,4194304] 0 2024-04-12T13:41:52.369 INFO:tasks.workunit.client.1.smithi110.stdout:7/86: creat d1/d3/d4/f1c x:0 0 0 2024-04-12T13:41:52.373 INFO:tasks.workunit.client.1.smithi110.stdout:0/90: rmdir d1/d11 39 2024-04-12T13:41:52.376 INFO:tasks.workunit.client.0.smithi060.stdout:5/148: rmdir d6/dd 39 2024-04-12T13:41:52.382 INFO:tasks.workunit.client.0.smithi060.stdout:3/122: fdatasync f0 0 2024-04-12T13:41:52.384 INFO:tasks.workunit.client.0.smithi060.stdout:3/123: chown d7/d17/d19/f1f 53 1 2024-04-12T13:41:52.385 INFO:tasks.workunit.client.1.smithi110.stdout:2/98: symlink d6/dc/l17 0 2024-04-12T13:41:52.386 INFO:tasks.workunit.client.1.smithi110.stdout:2/99: chown d6/dc 251 1 2024-04-12T13:41:52.386 INFO:tasks.workunit.client.1.smithi110.stdout:7/87: fdatasync d1/f5 0 2024-04-12T13:41:52.387 INFO:tasks.workunit.client.0.smithi060.stdout:3/124: write d7/d17/d19/f23 [2394896,92975] 0 2024-04-12T13:41:52.388 INFO:tasks.workunit.client.1.smithi110.stdout:5/71: link da/db/l10 da/l18 0 2024-04-12T13:41:52.389 INFO:tasks.workunit.client.1.smithi110.stdout:2/100: truncate d6/f11 14934 0 2024-04-12T13:41:52.390 INFO:tasks.workunit.client.1.smithi110.stdout:9/159: write df/d13/d2c/f36 [1831304,49096] 0 2024-04-12T13:41:52.392 INFO:tasks.workunit.client.1.smithi110.stdout:0/91: unlink d1/f1e 0 2024-04-12T13:41:52.392 INFO:tasks.workunit.client.1.smithi110.stdout:5/72: write f5 [3385679,38969] 0 2024-04-12T13:41:52.394 INFO:tasks.workunit.client.0.smithi060.stdout:1/106: link c6 d1e/c26 0 2024-04-12T13:41:52.395 INFO:tasks.workunit.client.1.smithi110.stdout:3/105: getdents d5/dc/d20 0 2024-04-12T13:41:52.395 INFO:tasks.workunit.client.1.smithi110.stdout:6/163: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:41:52.396 INFO:tasks.workunit.client.1.smithi110.stdout:0/92: chown d1/d8/c12 13965402 1 2024-04-12T13:41:52.398 INFO:tasks.workunit.client.1.smithi110.stdout:2/101: dread d6/f12 [0,4194304] 0 2024-04-12T13:41:52.400 INFO:tasks.workunit.client.0.smithi060.stdout:5/149: symlink d6/dd/d27/l30 0 2024-04-12T13:41:52.401 INFO:tasks.workunit.client.1.smithi110.stdout:3/106: write d5/dc/f11 [3967551,129573] 0 2024-04-12T13:41:52.401 INFO:tasks.workunit.client.1.smithi110.stdout:2/102: dread - d6/dc/f14 zero size 2024-04-12T13:41:52.402 INFO:tasks.workunit.client.1.smithi110.stdout:1/57: getdents de 0 2024-04-12T13:41:52.405 INFO:tasks.workunit.client.1.smithi110.stdout:9/160: truncate f5 236603 0 2024-04-12T13:41:52.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/139: creat d0/f30 x:0 0 0 2024-04-12T13:41:52.406 INFO:tasks.workunit.client.1.smithi110.stdout:7/88: write d1/fd [11470,4383] 0 2024-04-12T13:41:52.407 INFO:tasks.workunit.client.1.smithi110.stdout:9/161: truncate df/f1e 4714666 0 2024-04-12T13:41:52.407 INFO:tasks.workunit.client.1.smithi110.stdout:1/58: chown de/cf 1051 1 2024-04-12T13:41:52.407 INFO:tasks.workunit.client.0.smithi060.stdout:7/140: write d0/f21 [3852229,3850] 0 2024-04-12T13:41:52.408 INFO:tasks.workunit.client.0.smithi060.stdout:1/107: mkdir d1e/d1f/d27 0 2024-04-12T13:41:52.409 INFO:tasks.workunit.client.1.smithi110.stdout:1/59: read f5 [2740066,65780] 0 2024-04-12T13:41:52.409 INFO:tasks.workunit.client.0.smithi060.stdout:6/211: getdents d1/d2c 0 2024-04-12T13:41:52.410 INFO:tasks.workunit.client.1.smithi110.stdout:7/89: read - d1/d3/d4/f1c zero size 2024-04-12T13:41:52.413 INFO:tasks.workunit.client.0.smithi060.stdout:3/125: symlink d7/l29 0 2024-04-12T13:41:52.413 INFO:tasks.workunit.client.0.smithi060.stdout:3/126: stat c1 0 2024-04-12T13:41:52.413 INFO:tasks.workunit.client.0.smithi060.stdout:8/124: getdents d9/d1b 0 2024-04-12T13:41:52.414 INFO:tasks.workunit.client.1.smithi110.stdout:6/164: dread d7/f1a [0,4194304] 0 2024-04-12T13:41:52.415 INFO:tasks.workunit.client.0.smithi060.stdout:8/125: chown d9/d1d 7210875 1 2024-04-12T13:41:52.416 INFO:tasks.workunit.client.0.smithi060.stdout:8/126: chown d9/f23 1770077400 1 2024-04-12T13:41:52.416 INFO:tasks.workunit.client.1.smithi110.stdout:5/73: creat da/db/d15/d17/f19 x:0 0 0 2024-04-12T13:41:52.417 INFO:tasks.workunit.client.1.smithi110.stdout:7/90: truncate d1/d3/d4/f1c 446774 0 2024-04-12T13:41:52.417 INFO:tasks.workunit.client.0.smithi060.stdout:8/127: readlink d9/d1b/l29 0 2024-04-12T13:41:52.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/108: creat d1e/f28 x:0 0 0 2024-04-12T13:41:52.419 INFO:tasks.workunit.client.1.smithi110.stdout:6/165: chown d7/d10/d1c/f28 682 1 2024-04-12T13:41:52.421 INFO:tasks.workunit.client.1.smithi110.stdout:7/91: write d1/d3/d4/fb [4486728,49754] 0 2024-04-12T13:41:52.422 INFO:tasks.workunit.client.1.smithi110.stdout:1/60: mkdir de/d14 0 2024-04-12T13:41:52.423 INFO:tasks.workunit.client.1.smithi110.stdout:0/93: dwrite d1/d8/ff [0,4194304] 0 2024-04-12T13:41:52.424 INFO:tasks.workunit.client.0.smithi060.stdout:3/127: mknod d7/da/dd/d25/c2a 0 2024-04-12T13:41:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.424+0000 7f3f17a00700 1 -- 172.21.15.60:0/4065899374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100fff70 msgr2=0x7f3f10102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.424+0000 7f3f17a00700 1 --2- 172.21.15.60:0/4065899374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100fff70 0x7f3f10102390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009ce0 tx=0x7f3f00004d10 comp rx=0 tx=0).stop 2024-04-12T13:41:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.424+0000 7f3f17a00700 1 -- 172.21.15.60:0/4065899374 shutdown_connections 2024-04-12T13:41:52.427 INFO:tasks.workunit.client.1.smithi110.stdout:6/166: fdatasync d7/d10/d12/f2d 0 2024-04-12T13:41:52.427 INFO:tasks.workunit.client.1.smithi110.stdout:7/92: write d1/d3/f11 [887105,103064] 0 2024-04-12T13:41:52.427 INFO:tasks.workunit.client.0.smithi060.stdout:3/128: stat d7/d17/d19 0 2024-04-12T13:41:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.425+0000 7f3f17a00700 1 --2- 172.21.15.60:0/4065899374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100fff70 0x7f3f10102390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.425+0000 7f3f17a00700 1 --2- 172.21.15.60:0/4065899374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100662f0 0x7f3f100ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.425+0000 7f3f17a00700 1 -- 172.21.15.60:0/4065899374 >> 172.21.15.60:0/4065899374 conn(0x7f3f100f74c0 msgr2=0x7f3f100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.425+0000 7f3f17a00700 1 -- 172.21.15.60:0/4065899374 shutdown_connections 2024-04-12T13:41:52.428 INFO:tasks.workunit.client.0.smithi060.stdout:5/150: write f1 [4593539,123502] 0 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.425+0000 7f3f17a00700 1 -- 172.21.15.60:0/4065899374 wait complete. 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.426+0000 7f3f17a00700 1 Processor -- start 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.427+0000 7f3f17a00700 1 -- start start 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.427+0000 7f3f17a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 0x7f3f1006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.427+0000 7f3f17a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 0x7f3f1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f17a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1006f0c0 con 0x7f3f100662f0 2024-04-12T13:41:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f17a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1006f200 con 0x7f3f100fff70 2024-04-12T13:41:52.429 INFO:tasks.workunit.client.1.smithi110.stdout:2/103: unlink f0 0 2024-04-12T13:41:52.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f0fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 0x7f3f1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:52.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f15000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 0x7f3f1006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:52.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f0fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 0x7f3f1006eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:52302/0 (socket says 172.21.15.60:52302) 2024-04-12T13:41:52.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.428+0000 7f3f0fe00700 1 -- 172.21.15.60:0/937569978 learned_addr learned my addr 172.21.15.60:0/937569978 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:52.430 INFO:tasks.workunit.client.1.smithi110.stdout:3/107: write d5/dc/f13 [2691833,63000] 0 2024-04-12T13:41:52.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.429+0000 7f3f15000700 1 -- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 msgr2=0x7f3f1006eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.429+0000 7f3f15000700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 0x7f3f1006eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.429+0000 7f3f15000700 1 -- 172.21.15.60:0/937569978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009940 con 0x7f3f100662f0 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.430+0000 7f3f15000700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 0x7f3f1006e5f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8004fd0 tx=0x7f3ef8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.431+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef8014070 con 0x7f3f100662f0 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.431+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ef8002b40 con 0x7f3f100662f0 2024-04-12T13:41:52.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.431+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef80099d0 con 0x7f3f100662f0 2024-04-12T13:41:52.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/141: unlink d0/d7/c2 0 2024-04-12T13:41:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.431+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f100fb810 con 0x7f3f100662f0 2024-04-12T13:41:52.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.431+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f100fbdd0 con 0x7f3f100662f0 2024-04-12T13:41:52.433 INFO:tasks.workunit.client.1.smithi110.stdout:3/108: chown d5/dc/l1e 4438514 1 2024-04-12T13:41:52.434 INFO:tasks.workunit.client.0.smithi060.stdout:3/129: chown d7/d17/d27 4 1 2024-04-12T13:41:52.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.434+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1005f5f0 con 0x7f3f100662f0 2024-04-12T13:41:52.438 INFO:tasks.workunit.client.1.smithi110.stdout:5/74: dwrite f1 [0,4194304] 0 2024-04-12T13:41:52.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.437+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f3ef8002670 con 0x7f3f100662f0 2024-04-12T13:41:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.438+0000 7f3f0cc00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 0x7f3ef406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.439+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3ef808e730 con 0x7f3f100662f0 2024-04-12T13:41:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.439+0000 7f3f0fe00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 0x7f3ef406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:52.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.441+0000 7f3f0fe00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 0x7f3ef406e260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f100701c0 tx=0x7f3f00004d10 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:52.443 INFO:tasks.workunit.client.1.smithi110.stdout:0/94: write d1/d8/f10 [876031,91953] 0 2024-04-12T13:41:52.443 INFO:tasks.workunit.client.0.smithi060.stdout:1/109: dwrite d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:52.446 INFO:tasks.workunit.client.0.smithi060.stdout:7/142: readlink d0/d7/l20 0 2024-04-12T13:41:52.447 INFO:tasks.workunit.client.0.smithi060.stdout:8/128: rename d9/da/f21 to d9/f2c 0 2024-04-12T13:41:52.448 INFO:tasks.workunit.client.1.smithi110.stdout:6/167: dwrite d7/d10/d1c/f28 [0,4194304] 0 2024-04-12T13:41:52.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.448+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f3ef8057e90 con 0x7f3f100662f0 2024-04-12T13:41:52.452 INFO:tasks.workunit.client.0.smithi060.stdout:5/151: dread d6/fc [0,4194304] 0 2024-04-12T13:41:52.452 INFO:tasks.workunit.client.0.smithi060.stdout:8/129: write d9/da/f24 [38096,6907] 0 2024-04-12T13:41:52.454 INFO:tasks.workunit.client.0.smithi060.stdout:8/130: chown d9/d1b/f19 269288368 1 2024-04-12T13:41:52.455 INFO:tasks.workunit.client.1.smithi110.stdout:9/162: dread fc [0,4194304] 0 2024-04-12T13:41:52.455 INFO:tasks.workunit.client.1.smithi110.stdout:8/81: sync 2024-04-12T13:41:52.457 INFO:tasks.workunit.client.1.smithi110.stdout:9/163: chown df/d13/f1c 34222 1 2024-04-12T13:41:52.465 INFO:tasks.workunit.client.1.smithi110.stdout:6/168: dwrite d7/f1a [4194304,4194304] 0 2024-04-12T13:41:52.466 INFO:tasks.workunit.client.1.smithi110.stdout:3/109: rename d5/c1b to d5/c22 0 2024-04-12T13:41:52.468 INFO:tasks.workunit.client.0.smithi060.stdout:6/212: truncate d1/d7/da/dc/d3a/f49 3789706 0 2024-04-12T13:41:52.471 INFO:tasks.workunit.client.0.smithi060.stdout:1/110: truncate f7 3633247 0 2024-04-12T13:41:52.471 INFO:tasks.workunit.client.0.smithi060.stdout:3/130: dwrite d7/d17/f28 [0,4194304] 0 2024-04-12T13:41:52.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/131: fdatasync d7/da/dd/d25/f26 0 2024-04-12T13:41:52.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/146: sync 2024-04-12T13:41:52.475 INFO:tasks.workunit.client.0.smithi060.stdout:9/85: sync 2024-04-12T13:41:52.475 INFO:tasks.workunit.client.0.smithi060.stdout:7/143: creat d0/d1b/f31 x:0 0 0 2024-04-12T13:41:52.475 INFO:tasks.workunit.client.0.smithi060.stdout:4/139: sync 2024-04-12T13:41:52.478 INFO:tasks.workunit.client.1.smithi110.stdout:2/104: mkdir d6/d18 0 2024-04-12T13:41:52.479 INFO:tasks.workunit.client.0.smithi060.stdout:0/147: dread - d7/d9/f21 zero size 2024-04-12T13:41:52.482 INFO:tasks.workunit.client.0.smithi060.stdout:6/213: creat d1/d7/da/d20/f4a x:0 0 0 2024-04-12T13:41:52.482 INFO:tasks.workunit.client.0.smithi060.stdout:0/148: truncate d7/d9/f2b 5018766 0 2024-04-12T13:41:52.484 INFO:tasks.workunit.client.0.smithi060.stdout:6/214: fdatasync d1/f15 0 2024-04-12T13:41:52.486 INFO:tasks.workunit.client.0.smithi060.stdout:8/131: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:41:52.488 INFO:tasks.workunit.client.0.smithi060.stdout:8/132: fsync f2 0 2024-04-12T13:41:52.489 INFO:tasks.workunit.client.1.smithi110.stdout:6/169: rmdir d7/d25/d2c 39 2024-04-12T13:41:52.490 INFO:tasks.workunit.client.0.smithi060.stdout:0/149: chown d7/d9/d14/c30 5 1 2024-04-12T13:41:52.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/86: mknod d4/c1d 0 2024-04-12T13:41:52.492 INFO:tasks.workunit.client.0.smithi060.stdout:4/140: mknod d6/d21/c32 0 2024-04-12T13:41:52.492 INFO:tasks.workunit.client.0.smithi060.stdout:0/150: fsync d7/d9/f1e 0 2024-04-12T13:41:52.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/87: chown d4/d9/c11 1440244 1 2024-04-12T13:41:52.494 INFO:tasks.workunit.client.1.smithi110.stdout:0/95: symlink d1/d11/l1f 0 2024-04-12T13:41:52.496 INFO:tasks.workunit.client.0.smithi060.stdout:9/88: dread f2 [0,4194304] 0 2024-04-12T13:41:52.498 INFO:tasks.workunit.client.1.smithi110.stdout:7/93: link d1/d3/l1a d1/d3/d4/l1d 0 2024-04-12T13:41:52.499 INFO:tasks.workunit.client.1.smithi110.stdout:3/110: creat d5/dc/f23 x:0 0 0 2024-04-12T13:41:52.501 INFO:tasks.workunit.client.0.smithi060.stdout:6/215: creat d1/d7/da/dc/d3a/f4b x:0 0 0 2024-04-12T13:41:52.502 INFO:tasks.workunit.client.1.smithi110.stdout:1/61: getdents de 0 2024-04-12T13:41:52.503 INFO:tasks.workunit.client.0.smithi060.stdout:8/133: mknod d9/d1b/c2d 0 2024-04-12T13:41:52.504 INFO:tasks.workunit.client.0.smithi060.stdout:6/216: write d1/d7/da/dc/d24/d34/f23 [4466529,74329] 0 2024-04-12T13:41:52.506 INFO:tasks.workunit.client.0.smithi060.stdout:5/152: creat d6/d10/f31 x:0 0 0 2024-04-12T13:41:52.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/153: write d6/f8 [4684900,8667] 0 2024-04-12T13:41:52.513 INFO:tasks.workunit.client.0.smithi060.stdout:1/111: fsync f7 0 2024-04-12T13:41:52.514 INFO:tasks.workunit.client.0.smithi060.stdout:4/141: creat d6/d7/dd/d1a/d19/f33 x:0 0 0 2024-04-12T13:41:52.519 INFO:tasks.workunit.client.1.smithi110.stdout:3/111: creat d5/dc/f24 x:0 0 0 2024-04-12T13:41:52.521 INFO:tasks.workunit.client.1.smithi110.stdout:1/62: mkdir de/d15 0 2024-04-12T13:41:52.523 INFO:tasks.workunit.client.1.smithi110.stdout:1/63: dread fb [0,4194304] 0 2024-04-12T13:41:52.528 INFO:tasks.workunit.client.0.smithi060.stdout:2/106: sync 2024-04-12T13:41:52.528 INFO:tasks.workunit.client.1.smithi110.stdout:5/75: getdents da/db 0 2024-04-12T13:41:52.529 INFO:tasks.workunit.client.1.smithi110.stdout:5/76: chown da/db/fe 1045680719 1 2024-04-12T13:41:52.530 INFO:tasks.workunit.client.1.smithi110.stdout:5/77: readlink da/db/ld 0 2024-04-12T13:41:52.530 INFO:tasks.workunit.client.0.smithi060.stdout:6/217: readlink d1/d7/da/l22 0 2024-04-12T13:41:52.531 INFO:tasks.workunit.client.1.smithi110.stdout:0/96: rmdir d1 39 2024-04-12T13:41:52.531 INFO:tasks.workunit.client.1.smithi110.stdout:9/164: getdents df/d13/d2c/d2d/d39 0 2024-04-12T13:41:52.531 INFO:tasks.workunit.client.1.smithi110.stdout:2/105: write d6/dc/f15 [1920628,102137] 0 2024-04-12T13:41:52.532 INFO:tasks.workunit.client.0.smithi060.stdout:2/107: write d6/d10/d16/f18 [1294015,116040] 0 2024-04-12T13:41:52.532 INFO:tasks.workunit.client.1.smithi110.stdout:9/165: dread - df/d13/f1c zero size 2024-04-12T13:41:52.535 INFO:tasks.workunit.client.0.smithi060.stdout:2/108: fdatasync d6/d10/d16/f1c 0 2024-04-12T13:41:52.536 INFO:tasks.workunit.client.0.smithi060.stdout:4/142: dwrite d6/d7/dd/d1a/d19/f1f [0,4194304] 0 2024-04-12T13:41:52.538 INFO:tasks.workunit.client.0.smithi060.stdout:5/154: mkdir d6/dd/d1f/d32 0 2024-04-12T13:41:52.538 INFO:tasks.workunit.client.0.smithi060.stdout:4/143: read - d6/d7/db/f22 zero size 2024-04-12T13:41:52.540 INFO:tasks.workunit.client.0.smithi060.stdout:4/144: fdatasync d6/d21/f27 0 2024-04-12T13:41:52.543 INFO:tasks.workunit.client.0.smithi060.stdout:1/112: rename d1e/d1f/d27 to d1e/d29 0 2024-04-12T13:41:52.545 INFO:tasks.workunit.client.0.smithi060.stdout:9/89: symlink d4/d9/l1e 0 2024-04-12T13:41:52.548 INFO:tasks.workunit.client.0.smithi060.stdout:3/132: truncate d7/d17/f1a 1455911 0 2024-04-12T13:41:52.548 INFO:tasks.workunit.client.1.smithi110.stdout:6/170: link d7/d10/d12/f1f d7/f39 0 2024-04-12T13:41:52.551 INFO:tasks.workunit.client.1.smithi110.stdout:1/64: unlink de/f11 0 2024-04-12T13:41:52.553 INFO:tasks.workunit.client.1.smithi110.stdout:7/94: truncate d1/f18 92277 0 2024-04-12T13:41:52.554 INFO:tasks.workunit.client.0.smithi060.stdout:8/134: symlink d9/l2e 0 2024-04-12T13:41:52.555 INFO:tasks.workunit.client.1.smithi110.stdout:5/78: creat da/db/d15/f1a x:0 0 0 2024-04-12T13:41:52.557 INFO:tasks.workunit.client.1.smithi110.stdout:9/166: fdatasync df/d13/f1b 0 2024-04-12T13:41:52.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/151: creat d7/d9/d14/f34 x:0 0 0 2024-04-12T13:41:52.560 INFO:tasks.workunit.client.1.smithi110.stdout:2/106: dread d6/f8 [0,4194304] 0 2024-04-12T13:41:52.560 INFO:tasks.workunit.client.0.smithi060.stdout:6/218: truncate d1/d7/da/dc/d3a/f42 1008935 0 2024-04-12T13:41:52.564 INFO:tasks.workunit.client.1.smithi110.stdout:5/79: dread da/db/ff [0,4194304] 0 2024-04-12T13:41:52.564 INFO:tasks.workunit.client.1.smithi110.stdout:6/171: mkdir d7/d10/d1c/d2b/d3a 0 2024-04-12T13:41:52.565 INFO:tasks.workunit.client.0.smithi060.stdout:2/109: mknod d6/d13/d17/c1e 0 2024-04-12T13:41:52.571 INFO:tasks.workunit.client.1.smithi110.stdout:0/97: creat d1/d8/f20 x:0 0 0 2024-04-12T13:41:52.573 INFO:tasks.workunit.client.0.smithi060.stdout:8/135: dwrite d9/da/f24 [0,4194304] 0 2024-04-12T13:41:52.576 INFO:tasks.workunit.client.0.smithi060.stdout:5/155: chown d6/f7 0 1 2024-04-12T13:41:52.577 INFO:tasks.workunit.client.1.smithi110.stdout:4/185: sync 2024-04-12T13:41:52.579 INFO:tasks.workunit.client.0.smithi060.stdout:5/156: write d6/d10/f2c [355510,55618] 0 2024-04-12T13:41:52.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/157: readlink d6/l2e 0 2024-04-12T13:41:52.584 INFO:tasks.workunit.client.0.smithi060.stdout:4/145: symlink d6/d7/dd/l34 0 2024-04-12T13:41:52.588 INFO:tasks.workunit.client.1.smithi110.stdout:9/167: rename df/d13/d2c/f36 to df/f3d 0 2024-04-12T13:41:52.588 INFO:tasks.workunit.client.0.smithi060.stdout:1/113: mknod d1e/d23/c2a 0 2024-04-12T13:41:52.593 INFO:tasks.workunit.client.1.smithi110.stdout:4/186: dwrite d0/d19/f20 [4194304,4194304] 0 2024-04-12T13:41:52.593 INFO:tasks.workunit.client.1.smithi110.stdout:1/65: write f5 [4379216,99180] 0 2024-04-12T13:41:52.594 INFO:tasks.workunit.client.0.smithi060.stdout:3/133: symlink d7/da/dd/d25/l2b 0 2024-04-12T13:41:52.594 INFO:tasks.workunit.client.1.smithi110.stdout:4/187: fsync d0/f5 0 2024-04-12T13:41:52.595 INFO:tasks.workunit.client.1.smithi110.stdout:1/66: dread - de/f10 zero size 2024-04-12T13:41:52.595 INFO:tasks.workunit.client.0.smithi060.stdout:7/144: symlink d0/d7/l32 0 2024-04-12T13:41:52.597 INFO:tasks.workunit.client.1.smithi110.stdout:7/95: link d1/f5 d1/f1e 0 2024-04-12T13:41:52.600 INFO:tasks.workunit.client.0.smithi060.stdout:8/136: dwrite d9/f1f [0,4194304] 0 2024-04-12T13:41:52.603 INFO:tasks.workunit.client.0.smithi060.stdout:8/137: write f2 [4768727,66658] 0 2024-04-12T13:41:52.605 INFO:tasks.workunit.client.1.smithi110.stdout:9/168: dwrite df/f17 [0,4194304] 0 2024-04-12T13:41:52.610 INFO:tasks.workunit.client.0.smithi060.stdout:8/138: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:41:52.611 INFO:tasks.workunit.client.1.smithi110.stdout:3/112: truncate d5/f1f 3112 0 2024-04-12T13:41:52.611 INFO:tasks.workunit.client.0.smithi060.stdout:6/219: chown d1/d7/da/dc/d24/c18 11993625 1 2024-04-12T13:41:52.612 INFO:tasks.workunit.client.1.smithi110.stdout:1/67: dwrite de/f10 [0,4194304] 0 2024-04-12T13:41:52.614 INFO:tasks.workunit.client.0.smithi060.stdout:8/139: truncate d9/f11 1111664 0 2024-04-12T13:41:52.620 INFO:tasks.workunit.client.1.smithi110.stdout:2/107: mkdir d6/d18/d19 0 2024-04-12T13:41:52.622 INFO:tasks.workunit.client.1.smithi110.stdout:2/108: fsync d6/dc/dd/fe 0 2024-04-12T13:41:52.624 INFO:tasks.workunit.client.0.smithi060.stdout:2/110: chown d6/c7 19 1 2024-04-12T13:41:52.626 INFO:tasks.workunit.client.0.smithi060.stdout:5/158: symlink d6/dd/d27/l33 0 2024-04-12T13:41:52.628 INFO:tasks.workunit.client.1.smithi110.stdout:9/169: dwrite df/d13/d26/f32 [0,4194304] 0 2024-04-12T13:41:52.628 INFO:tasks.workunit.client.1.smithi110.stdout:3/113: dread d5/dc/f12 [0,4194304] 0 2024-04-12T13:41:52.632 INFO:tasks.workunit.client.0.smithi060.stdout:1/114: creat d1e/f2b x:0 0 0 2024-04-12T13:41:52.635 INFO:tasks.workunit.client.0.smithi060.stdout:9/90: dwrite f2 [0,4194304] 0 2024-04-12T13:41:52.640 INFO:tasks.workunit.client.0.smithi060.stdout:8/140: dread d9/fc [0,4194304] 0 2024-04-12T13:41:52.643 INFO:tasks.workunit.client.0.smithi060.stdout:0/152: mkdir d7/d9/d14/d35 0 2024-04-12T13:41:52.649 INFO:tasks.workunit.client.1.smithi110.stdout:1/68: mknod de/c16 0 2024-04-12T13:41:52.654 INFO:tasks.workunit.client.0.smithi060.stdout:4/146: write f2 [3284294,95967] 0 2024-04-12T13:41:52.661 INFO:tasks.workunit.client.1.smithi110.stdout:2/109: mknod d6/dc/dd/c1a 0 2024-04-12T13:41:52.662 INFO:tasks.workunit.client.0.smithi060.stdout:6/220: dwrite d1/d7/da/dc/f3c [0,4194304] 0 2024-04-12T13:41:52.664 INFO:tasks.workunit.client.0.smithi060.stdout:2/111: creat d6/d13/d17/f1f x:0 0 0 2024-04-12T13:41:52.665 INFO:tasks.workunit.client.1.smithi110.stdout:4/188: dwrite d0/fc [0,4194304] 0 2024-04-12T13:41:52.673 INFO:tasks.workunit.client.0.smithi060.stdout:7/145: chown d0/d7/l2b 2944277 1 2024-04-12T13:41:52.675 INFO:tasks.workunit.client.0.smithi060.stdout:8/141: mkdir d9/d1d/d2f 0 2024-04-12T13:41:52.676 INFO:tasks.workunit.client.1.smithi110.stdout:6/172: getdents d7/d25 0 2024-04-12T13:41:52.677 INFO:tasks.workunit.client.1.smithi110.stdout:9/170: write df/f35 [3666054,95970] 0 2024-04-12T13:41:52.679 INFO:tasks.workunit.client.1.smithi110.stdout:2/110: mkdir d6/dc/d1b 0 2024-04-12T13:41:52.681 INFO:tasks.workunit.client.1.smithi110.stdout:8/82: sync 2024-04-12T13:41:52.687 INFO:tasks.workunit.client.0.smithi060.stdout:6/221: mknod d1/d7/da/d39/c4c 0 2024-04-12T13:41:52.689 INFO:tasks.workunit.client.1.smithi110.stdout:3/114: unlink d5/l17 0 2024-04-12T13:41:52.690 INFO:tasks.workunit.client.1.smithi110.stdout:7/96: link d1/d3/d4/fb d1/f1f 0 2024-04-12T13:41:52.690 INFO:tasks.workunit.client.0.smithi060.stdout:1/115: dwrite f7 [0,4194304] 0 2024-04-12T13:41:52.692 INFO:tasks.workunit.client.1.smithi110.stdout:1/69: mknod de/d15/c17 0 2024-04-12T13:41:52.693 INFO:tasks.workunit.client.0.smithi060.stdout:5/159: creat d6/dd/d1f/d25/f34 x:0 0 0 2024-04-12T13:41:52.693 INFO:tasks.workunit.client.0.smithi060.stdout:2/112: dread f4 [0,4194304] 0 2024-04-12T13:41:52.695 INFO:tasks.workunit.client.0.smithi060.stdout:2/113: stat d6/lc 0 2024-04-12T13:41:52.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/91: link d4/d9/d1b/f1c d4/f1f 0 2024-04-12T13:41:52.696 INFO:tasks.workunit.client.1.smithi110.stdout:6/173: readlink l3 0 2024-04-12T13:41:52.697 INFO:tasks.workunit.client.1.smithi110.stdout:9/171: mknod df/d13/d2c/c3e 0 2024-04-12T13:41:52.699 INFO:tasks.workunit.client.1.smithi110.stdout:2/111: symlink d6/d18/l1c 0 2024-04-12T13:41:52.700 INFO:tasks.workunit.client.1.smithi110.stdout:9/172: truncate df/d13/f1b 594703 0 2024-04-12T13:41:52.701 INFO:tasks.workunit.client.1.smithi110.stdout:9/173: fsync fa 0 2024-04-12T13:41:52.701 INFO:tasks.workunit.client.1.smithi110.stdout:8/83: creat d1/f19 x:0 0 0 2024-04-12T13:41:52.701 INFO:tasks.workunit.client.1.smithi110.stdout:2/112: chown d6/dc/dd/f16 265 1 2024-04-12T13:41:52.708 INFO:tasks.workunit.client.0.smithi060.stdout:8/142: rename d9/fb to d9/d1d/d2f/f30 0 2024-04-12T13:41:52.709 INFO:tasks.workunit.client.0.smithi060.stdout:4/147: symlink d6/d21/d29/l35 0 2024-04-12T13:41:52.710 INFO:tasks.workunit.client.1.smithi110.stdout:4/189: mknod d0/c3a 0 2024-04-12T13:41:52.712 INFO:tasks.workunit.client.1.smithi110.stdout:7/97: creat d1/d3/f20 x:0 0 0 2024-04-12T13:41:52.712 INFO:tasks.workunit.client.1.smithi110.stdout:4/190: chown d0/d19/d1c 57320392 1 2024-04-12T13:41:52.713 INFO:tasks.workunit.client.0.smithi060.stdout:6/222: creat d1/d7/da/d39/f4d x:0 0 0 2024-04-12T13:41:52.714 INFO:tasks.workunit.client.1.smithi110.stdout:1/70: mknod de/c18 0 2024-04-12T13:41:52.716 INFO:tasks.workunit.client.0.smithi060.stdout:1/116: creat d1e/f2c x:0 0 0 2024-04-12T13:41:52.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/160: fdatasync d6/fc 0 2024-04-12T13:41:52.720 INFO:tasks.workunit.client.1.smithi110.stdout:9/174: creat df/d13/d2c/f3f x:0 0 0 2024-04-12T13:41:52.721 INFO:tasks.workunit.client.0.smithi060.stdout:2/114: write d6/f9 [3458059,100604] 0 2024-04-12T13:41:52.724 INFO:tasks.workunit.client.0.smithi060.stdout:9/92: unlink d4/f16 0 2024-04-12T13:41:52.725 INFO:tasks.workunit.client.0.smithi060.stdout:7/146: dwrite d0/fe [0,4194304] 0 2024-04-12T13:41:52.726 INFO:tasks.workunit.client.1.smithi110.stdout:8/84: rename d1/l16 to d1/l1a 0 2024-04-12T13:41:52.727 INFO:tasks.workunit.client.1.smithi110.stdout:8/85: fsync d1/d7/fb 0 2024-04-12T13:41:52.727 INFO:tasks.workunit.client.0.smithi060.stdout:3/134: getdents d7/d17/d19 0 2024-04-12T13:41:52.731 INFO:tasks.workunit.client.1.smithi110.stdout:3/115: mknod d5/c25 0 2024-04-12T13:41:52.731 INFO:tasks.workunit.client.1.smithi110.stdout:7/98: symlink d1/d3/l21 0 2024-04-12T13:41:52.737 INFO:tasks.workunit.client.1.smithi110.stdout:4/191: dread d0/de/f36 [0,4194304] 0 2024-04-12T13:41:52.739 INFO:tasks.workunit.client.0.smithi060.stdout:4/148: mknod d6/d2f/c36 0 2024-04-12T13:41:52.740 INFO:tasks.workunit.client.1.smithi110.stdout:9/175: mkdir df/d13/d3b/d40 0 2024-04-12T13:41:52.743 INFO:tasks.workunit.client.0.smithi060.stdout:6/223: creat d1/d7/da/d20/f4e x:0 0 0 2024-04-12T13:41:52.744 INFO:tasks.workunit.client.1.smithi110.stdout:8/86: mknod d1/d3/c1b 0 2024-04-12T13:41:52.748 INFO:tasks.workunit.client.1.smithi110.stdout:7/99: dread d1/f5 [4194304,4194304] 0 2024-04-12T13:41:52.749 INFO:tasks.workunit.client.0.smithi060.stdout:5/161: mkdir d6/dd/d1f/d25/d35 0 2024-04-12T13:41:52.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/147: chown d0/d7/l13 187 1 2024-04-12T13:41:52.753 INFO:tasks.workunit.client.1.smithi110.stdout:4/192: chown d0/de/d2c/c1a 23386179 1 2024-04-12T13:41:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:3/135: fsync f0 0 2024-04-12T13:41:52.754 INFO:tasks.workunit.client.1.smithi110.stdout:5/80: sync 2024-04-12T13:41:52.754 INFO:tasks.workunit.client.1.smithi110.stdout:0/98: sync 2024-04-12T13:41:52.754 INFO:tasks.workunit.client.1.smithi110.stdout:1/71: dwrite fb [0,4194304] 0 2024-04-12T13:41:52.755 INFO:tasks.workunit.client.1.smithi110.stdout:1/72: chown de 5511271 1 2024-04-12T13:41:52.756 INFO:tasks.workunit.client.1.smithi110.stdout:9/176: write df/d13/d26/f28 [2449424,107804] 0 2024-04-12T13:41:52.757 INFO:tasks.workunit.client.1.smithi110.stdout:1/73: write f5 [3549466,48751] 0 2024-04-12T13:41:52.759 INFO:tasks.workunit.client.0.smithi060.stdout:4/149: creat d6/d7/dd/df/f37 x:0 0 0 2024-04-12T13:41:52.760 INFO:tasks.workunit.client.1.smithi110.stdout:8/87: dread d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:52.761 INFO:tasks.workunit.client.1.smithi110.stdout:8/88: chown d1/d3/fe 54294 1 2024-04-12T13:41:52.764 INFO:tasks.workunit.client.1.smithi110.stdout:8/89: truncate d1/d3/fe 1539199 0 2024-04-12T13:41:52.767 INFO:tasks.workunit.client.1.smithi110.stdout:6/174: link d7/ca d7/d10/c3b 0 2024-04-12T13:41:52.769 INFO:tasks.workunit.client.1.smithi110.stdout:6/175: write d7/d10/d1c/f24 [1122519,37590] 0 2024-04-12T13:41:52.769 INFO:tasks.workunit.client.1.smithi110.stdout:7/100: mkdir d1/d3/d22 0 2024-04-12T13:41:52.770 INFO:tasks.workunit.client.1.smithi110.stdout:6/176: chown d7/d25 3 1 2024-04-12T13:41:52.771 INFO:tasks.workunit.client.1.smithi110.stdout:3/116: truncate d5/dc/f19 464995 0 2024-04-12T13:41:52.772 INFO:tasks.workunit.client.1.smithi110.stdout:1/74: dwrite f2 [0,4194304] 0 2024-04-12T13:41:52.773 INFO:tasks.workunit.client.1.smithi110.stdout:2/113: getdents d6/d18 0 2024-04-12T13:41:52.777 INFO:tasks.workunit.client.0.smithi060.stdout:3/136: creat d7/da/f2c x:0 0 0 2024-04-12T13:41:52.778 INFO:tasks.workunit.client.0.smithi060.stdout:6/224: symlink d1/d7/l4f 0 2024-04-12T13:41:52.778 INFO:tasks.workunit.client.1.smithi110.stdout:0/99: creat d1/d8/f21 x:0 0 0 2024-04-12T13:41:52.782 INFO:tasks.workunit.client.1.smithi110.stdout:9/177: creat df/d13/d26/f41 x:0 0 0 2024-04-12T13:41:52.783 INFO:tasks.workunit.client.0.smithi060.stdout:5/162: dread d6/fc [0,4194304] 0 2024-04-12T13:41:52.783 INFO:tasks.workunit.client.0.smithi060.stdout:6/225: truncate d1/d7/da/dc/d24/f37 1059145 0 2024-04-12T13:41:52.786 INFO:tasks.workunit.client.1.smithi110.stdout:8/90: mkdir d1/d5/dd/d1c 0 2024-04-12T13:41:52.787 INFO:tasks.workunit.client.1.smithi110.stdout:8/91: fdatasync d1/f19 0 2024-04-12T13:41:52.788 INFO:tasks.workunit.client.1.smithi110.stdout:7/101: dread d1/f1f [4194304,4194304] 0 2024-04-12T13:41:52.789 INFO:tasks.workunit.client.1.smithi110.stdout:9/178: dread df/d13/f1b [0,4194304] 0 2024-04-12T13:41:52.791 INFO:tasks.workunit.client.0.smithi060.stdout:7/148: write d0/f1c [1724093,8705] 0 2024-04-12T13:41:52.793 INFO:tasks.workunit.client.1.smithi110.stdout:8/92: dread - d1/d5/dd/ff zero size 2024-04-12T13:41:52.793 INFO:tasks.workunit.client.0.smithi060.stdout:8/143: rename d9/d1b/c25 to d9/c31 0 2024-04-12T13:41:52.795 INFO:tasks.workunit.client.1.smithi110.stdout:7/102: dread d1/fd [0,4194304] 0 2024-04-12T13:41:52.796 INFO:tasks.workunit.client.0.smithi060.stdout:3/137: fsync f0 0 2024-04-12T13:41:52.802 INFO:tasks.workunit.client.0.smithi060.stdout:1/117: getdents d1e/d1f 0 2024-04-12T13:41:52.802 INFO:tasks.workunit.client.1.smithi110.stdout:2/114: dwrite d6/fb [0,4194304] 0 2024-04-12T13:41:52.802 INFO:tasks.workunit.client.0.smithi060.stdout:2/115: getdents d6/d13 0 2024-04-12T13:41:52.803 INFO:tasks.workunit.client.0.smithi060.stdout:1/118: write f7 [2915796,7224] 0 2024-04-12T13:41:52.804 INFO:tasks.workunit.client.1.smithi110.stdout:4/193: dwrite d0/de/f36 [0,4194304] 0 2024-04-12T13:41:52.805 INFO:tasks.workunit.client.1.smithi110.stdout:1/75: dwrite f6 [0,4194304] 0 2024-04-12T13:41:52.806 INFO:tasks.workunit.client.0.smithi060.stdout:5/163: unlink d6/l2e 0 2024-04-12T13:41:52.809 INFO:tasks.workunit.client.0.smithi060.stdout:5/164: write f1 [4836664,116964] 0 2024-04-12T13:41:52.809 INFO:tasks.workunit.client.0.smithi060.stdout:6/226: creat d1/d7/da/d20/f50 x:0 0 0 2024-04-12T13:41:52.811 INFO:tasks.workunit.client.0.smithi060.stdout:5/165: readlink d6/dd/d27/l30 0 2024-04-12T13:41:52.813 INFO:tasks.workunit.client.1.smithi110.stdout:2/115: dread - d6/dc/f14 zero size 2024-04-12T13:41:52.815 INFO:tasks.workunit.client.0.smithi060.stdout:5/166: write d6/f20 [27519,40272] 0 2024-04-12T13:41:52.815 INFO:tasks.workunit.client.1.smithi110.stdout:9/179: chown df/f11 3 1 2024-04-12T13:41:52.816 INFO:tasks.workunit.client.0.smithi060.stdout:5/167: fsync d6/f14 0 2024-04-12T13:41:52.818 INFO:tasks.workunit.client.0.smithi060.stdout:6/227: truncate d1/d7/da/dc/d24/d34/f28 470808 0 2024-04-12T13:41:52.820 INFO:tasks.workunit.client.1.smithi110.stdout:6/177: dwrite d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:41:52.822 INFO:tasks.workunit.client.1.smithi110.stdout:8/93: write d1/d3/f13 [2525605,9227] 0 2024-04-12T13:41:52.823 INFO:tasks.workunit.client.0.smithi060.stdout:4/150: truncate d6/d21/f2a 2261738 0 2024-04-12T13:41:52.823 INFO:tasks.workunit.client.1.smithi110.stdout:2/116: truncate d6/fb 5424598 0 2024-04-12T13:41:52.825 INFO:tasks.workunit.client.0.smithi060.stdout:2/116: mknod d6/d13/d17/c20 0 2024-04-12T13:41:52.825 INFO:tasks.workunit.client.0.smithi060.stdout:1/119: creat d1e/f2d x:0 0 0 2024-04-12T13:41:52.829 INFO:tasks.workunit.client.1.smithi110.stdout:3/117: link d5/dc/l1e d5/dc/l26 0 2024-04-12T13:41:52.829 INFO:tasks.workunit.client.0.smithi060.stdout:1/120: chown d1e/l20 510 1 2024-04-12T13:41:52.829 INFO:tasks.workunit.client.0.smithi060.stdout:2/117: chown d6/d10/d16 17 1 2024-04-12T13:41:52.834 INFO:tasks.workunit.client.1.smithi110.stdout:0/100: creat d1/f22 x:0 0 0 2024-04-12T13:41:52.837 INFO:tasks.workunit.client.0.smithi060.stdout:5/168: creat d6/d10/d12/f36 x:0 0 0 2024-04-12T13:41:52.837 INFO:tasks.workunit.client.1.smithi110.stdout:4/194: dwrite d0/d13/f21 [0,4194304] 0 2024-04-12T13:41:52.838 INFO:tasks.workunit.client.1.smithi110.stdout:9/180: mknod df/d13/d3b/c42 0 2024-04-12T13:41:52.838 INFO:tasks.workunit.client.1.smithi110.stdout:4/195: readlink d0/l2f 0 2024-04-12T13:41:52.839 INFO:tasks.workunit.client.0.smithi060.stdout:5/169: chown d6/f7 15 1 2024-04-12T13:41:52.840 INFO:tasks.workunit.client.1.smithi110.stdout:8/94: creat d1/d7/f1d x:0 0 0 2024-04-12T13:41:52.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/144: truncate f1 1527542 0 2024-04-12T13:41:52.851 INFO:tasks.workunit.client.0.smithi060.stdout:1/121: chown lc 31058 1 2024-04-12T13:41:52.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/149: creat d0/d7/f33 x:0 0 0 2024-04-12T13:41:52.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/150: chown d0 49529841 1 2024-04-12T13:41:52.859 INFO:tasks.workunit.client.0.smithi060.stdout:2/118: mkdir d6/d13/d17/d21 0 2024-04-12T13:41:52.859 INFO:tasks.workunit.client.0.smithi060.stdout:7/151: dread - d0/f30 zero size 2024-04-12T13:41:52.861 INFO:tasks.workunit.client.0.smithi060.stdout:3/138: truncate d7/d17/f20 111934 0 2024-04-12T13:41:52.863 INFO:tasks.workunit.client.0.smithi060.stdout:7/152: truncate d0/fe 4953891 0 2024-04-12T13:41:52.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/170: dwrite d6/d10/f2c [0,4194304] 0 2024-04-12T13:41:52.866 INFO:tasks.workunit.client.1.smithi110.stdout:8/95: fsync d1/d7/f1d 0 2024-04-12T13:41:52.866 INFO:tasks.workunit.client.1.smithi110.stdout:2/117: mkdir d6/dc/d13/d1d 0 2024-04-12T13:41:52.866 INFO:tasks.workunit.client.1.smithi110.stdout:8/96: fsync d1/d7/f1d 0 2024-04-12T13:41:52.867 INFO:tasks.workunit.client.1.smithi110.stdout:3/118: dread d5/dc/f11 [0,4194304] 0 2024-04-12T13:41:52.869 INFO:tasks.workunit.client.1.smithi110.stdout:7/103: link d1/d3/d4/f9 d1/f23 0 2024-04-12T13:41:52.870 INFO:tasks.workunit.client.0.smithi060.stdout:1/122: write f19 [1586274,6155] 0 2024-04-12T13:41:52.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/171: chown d6/dd/d27/l30 1 1 2024-04-12T13:41:52.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/119: mknod d6/d10/c22 0 2024-04-12T13:41:52.875 INFO:tasks.workunit.client.0.smithi060.stdout:5/172: write d6/d10/f31 [512815,54304] 0 2024-04-12T13:41:52.875 INFO:tasks.workunit.client.0.smithi060.stdout:7/153: mknod d0/d1b/c34 0 2024-04-12T13:41:52.876 INFO:tasks.workunit.client.1.smithi110.stdout:2/118: dread d6/dc/dd/f10 [0,4194304] 0 2024-04-12T13:41:52.876 INFO:tasks.workunit.client.1.smithi110.stdout:1/76: link cd de/d15/c19 0 2024-04-12T13:41:52.877 INFO:tasks.workunit.client.0.smithi060.stdout:2/120: truncate d6/d10/d16/f18 2313032 0 2024-04-12T13:41:52.878 INFO:tasks.workunit.client.0.smithi060.stdout:7/154: read d0/f21 [3882888,48170] 0 2024-04-12T13:41:52.881 INFO:tasks.workunit.client.0.smithi060.stdout:8/145: creat d9/d1b/d2b/f32 x:0 0 0 2024-04-12T13:41:52.882 INFO:tasks.workunit.client.0.smithi060.stdout:2/121: dread d6/f14 [0,4194304] 0 2024-04-12T13:41:52.889 INFO:tasks.workunit.client.0.smithi060.stdout:4/151: getdents d6/d7/dd/d1a 0 2024-04-12T13:41:52.890 INFO:tasks.workunit.client.0.smithi060.stdout:4/152: stat d6/l2c 0 2024-04-12T13:41:52.897 INFO:tasks.workunit.client.0.smithi060.stdout:2/122: mknod d6/c23 0 2024-04-12T13:41:52.898 INFO:tasks.workunit.client.0.smithi060.stdout:4/153: symlink d6/l38 0 2024-04-12T13:41:52.900 INFO:tasks.workunit.client.0.smithi060.stdout:2/123: unlink d6/lc 0 2024-04-12T13:41:52.901 INFO:tasks.workunit.client.0.smithi060.stdout:2/124: readlink d6/lb 0 2024-04-12T13:41:52.903 INFO:tasks.workunit.client.0.smithi060.stdout:2/125: dread f4 [0,4194304] 0 2024-04-12T13:41:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.903+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f100f8fb0 con 0x7f3ef406bdb0 2024-04-12T13:41:52.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.905+0000 7f3f0cc00700 1 -- 172.21.15.60:0/937569978 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3f100f8fb0 con 0x7f3ef406bdb0 2024-04-12T13:41:52.906 INFO:tasks.workunit.client.0.smithi060.stdout:2/126: truncate d6/f1b 210901 0 2024-04-12T13:41:52.908 INFO:tasks.workunit.client.1.smithi110.stdout:4/196: mkdir d0/d3b 0 2024-04-12T13:41:52.909 INFO:tasks.workunit.client.1.smithi110.stdout:2/119: stat d6/dc/dd/f10 0 2024-04-12T13:41:52.909 INFO:tasks.workunit.client.1.smithi110.stdout:9/181: symlink df/d13/d26/d37/l43 0 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 msgr2=0x7f3ef406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 0x7f3ef406e260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f100701c0 tx=0x7f3f00004d10 comp rx=0 tx=0).stop 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 msgr2=0x7f3f1006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 0x7f3f1006e5f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8004fd0 tx=0x7f3ef8004570 comp rx=0 tx=0).stop 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 shutdown_connections 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f3ef406bdb0 0x7f3ef406e260 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f100662f0 0x7f3f1006e5f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 --2- 172.21.15.60:0/937569978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f100fff70 0x7f3f1006eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.908+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 >> 172.21.15.60:0/937569978 conn(0x7f3f100f74c0 msgr2=0x7f3f100f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:52.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.909+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 shutdown_connections 2024-04-12T13:41:52.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:52.909+0000 7f3f17a00700 1 -- 172.21.15.60:0/937569978 wait complete. 2024-04-12T13:41:52.911 INFO:tasks.workunit.client.1.smithi110.stdout:3/119: creat d5/dc/f27 x:0 0 0 2024-04-12T13:41:52.913 INFO:tasks.workunit.client.1.smithi110.stdout:1/77: symlink de/l1a 0 2024-04-12T13:41:52.914 INFO:tasks.workunit.client.1.smithi110.stdout:4/197: symlink d0/d19/l3c 0 2024-04-12T13:41:52.914 INFO:tasks.workunit.client.0.smithi060.stdout:7/155: dwrite d0/d7/f24 [0,4194304] 0 2024-04-12T13:41:52.916 INFO:tasks.workunit.client.1.smithi110.stdout:9/182: readlink df/d13/d2c/d2d/l3c 0 2024-04-12T13:41:52.918 INFO:tasks.workunit.client.1.smithi110.stdout:8/97: dwrite d1/f19 [0,4194304] 0 2024-04-12T13:41:52.919 INFO:tasks.workunit.client.1.smithi110.stdout:9/183: write df/d13/d2c/f3f [968856,123059] 0 2024-04-12T13:41:52.919 INFO:tasks.workunit.client.1.smithi110.stdout:1/78: creat de/f1b x:0 0 0 2024-04-12T13:41:52.924 INFO:tasks.workunit.client.1.smithi110.stdout:3/120: fsync d5/f1f 0 2024-04-12T13:41:52.924 INFO:tasks.workunit.client.1.smithi110.stdout:2/120: creat d6/dc/d13/d1d/f1e x:0 0 0 2024-04-12T13:41:52.924 INFO:tasks.workunit.client.1.smithi110.stdout:9/184: write df/f1e [4856139,113411] 0 2024-04-12T13:41:52.925 INFO:tasks.workunit.client.0.smithi060.stdout:2/127: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:52.925 INFO:tasks.workunit.client.1.smithi110.stdout:8/98: truncate d1/d3/fe 2398692 0 2024-04-12T13:41:52.926 INFO:tasks.workunit.client.1.smithi110.stdout:1/79: creat de/d15/f1c x:0 0 0 2024-04-12T13:41:52.930 INFO:tasks.workunit.client.1.smithi110.stdout:9/185: chown df/d13/f1f 1 1 2024-04-12T13:41:52.937 INFO:tasks.workunit.client.1.smithi110.stdout:4/198: rmdir d0/d3b 0 2024-04-12T13:41:52.938 INFO:tasks.workunit.client.1.smithi110.stdout:1/80: dread fa [0,4194304] 0 2024-04-12T13:41:52.943 INFO:tasks.workunit.client.0.smithi060.stdout:7/156: rename d0/d7/lc to d0/l35 0 2024-04-12T13:41:52.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/123: write f13 [5719105,129067] 0 2024-04-12T13:41:52.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/124: fsync d1e/f28 0 2024-04-12T13:41:52.946 INFO:tasks.workunit.client.0.smithi060.stdout:5/173: write d6/f7 [1106337,70234] 0 2024-04-12T13:41:52.953 INFO:tasks.workunit.client.1.smithi110.stdout:9/186: rmdir df/d13/d26 39 2024-04-12T13:41:52.958 INFO:tasks.workunit.client.1.smithi110.stdout:8/99: rename d1/d5/dd/l15 to d1/l1e 0 2024-04-12T13:41:52.960 INFO:tasks.workunit.client.0.smithi060.stdout:1/125: mkdir d1e/d23/d2e 0 2024-04-12T13:41:52.963 INFO:tasks.workunit.client.1.smithi110.stdout:1/81: mkdir de/d1d 0 2024-04-12T13:41:52.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/128: creat d6/f24 x:0 0 0 2024-04-12T13:41:52.965 INFO:tasks.workunit.client.1.smithi110.stdout:1/82: write de/f1b [79412,4183] 0 2024-04-12T13:41:52.966 INFO:tasks.workunit.client.1.smithi110.stdout:1/83: chown f6 139546 1 2024-04-12T13:41:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:5/174: mknod d6/d10/d12/d15/c37 0 2024-04-12T13:41:52.967 INFO:tasks.workunit.client.1.smithi110.stdout:1/84: fdatasync f2 0 2024-04-12T13:41:52.968 INFO:tasks.workunit.client.0.smithi060.stdout:5/175: fdatasync d6/d10/f2a 0 2024-04-12T13:41:52.969 INFO:tasks.workunit.client.1.smithi110.stdout:2/121: link d6/fb d6/dc/dd/f1f 0 2024-04-12T13:41:52.969 INFO:tasks.workunit.client.1.smithi110.stdout:7/104: write d1/d3/d4/f9 [2552194,112274] 0 2024-04-12T13:41:52.969 INFO:tasks.workunit.client.1.smithi110.stdout:1/85: truncate de/f1b 345024 0 2024-04-12T13:41:52.970 INFO:tasks.workunit.client.0.smithi060.stdout:7/157: mknod d0/d7/c36 0 2024-04-12T13:41:52.973 INFO:tasks.workunit.client.0.smithi060.stdout:1/126: dread f13 [0,4194304] 0 2024-04-12T13:41:52.978 INFO:tasks.workunit.client.1.smithi110.stdout:8/100: dwrite d1/d5/dd/ff [0,4194304] 0 2024-04-12T13:41:52.979 INFO:tasks.workunit.client.1.smithi110.stdout:8/101: read d1/f19 [4193318,11737] 0 2024-04-12T13:41:52.981 INFO:tasks.workunit.client.1.smithi110.stdout:8/102: read - d1/d7/f1d zero size 2024-04-12T13:41:52.981 INFO:tasks.workunit.client.0.smithi060.stdout:7/158: unlink d0/f1e 0 2024-04-12T13:41:52.982 INFO:tasks.workunit.client.1.smithi110.stdout:2/122: mkdir d6/d18/d20 0 2024-04-12T13:41:52.984 INFO:tasks.workunit.client.0.smithi060.stdout:8/146: write f1 [1239193,110651] 0 2024-04-12T13:41:52.984 INFO:tasks.workunit.client.1.smithi110.stdout:2/123: chown f4 5 1 2024-04-12T13:41:52.984 INFO:tasks.workunit.client.1.smithi110.stdout:8/103: write d1/f19 [4033881,109090] 0 2024-04-12T13:41:52.988 INFO:tasks.workunit.client.0.smithi060.stdout:5/176: dwrite d6/f9 [0,4194304] 0 2024-04-12T13:41:52.988 INFO:tasks.workunit.client.1.smithi110.stdout:8/104: write d1/d3/fe [782520,127029] 0 2024-04-12T13:41:52.993 INFO:tasks.workunit.client.1.smithi110.stdout:3/121: dwrite d5/dc/f12 [0,4194304] 0 2024-04-12T13:41:53.004 INFO:tasks.workunit.client.1.smithi110.stdout:5/81: sync 2024-04-12T13:41:53.006 INFO:tasks.workunit.client.0.smithi060.stdout:4/154: dwrite d6/d21/f2a [0,4194304] 0 2024-04-12T13:41:53.007 INFO:tasks.workunit.client.1.smithi110.stdout:5/82: write da/db/f14 [751342,116027] 0 2024-04-12T13:41:53.007 INFO:tasks.workunit.client.1.smithi110.stdout:5/83: chown f7 224 1 2024-04-12T13:41:53.009 INFO:tasks.workunit.client.0.smithi060.stdout:7/159: creat d0/d1b/f37 x:0 0 0 2024-04-12T13:41:53.011 INFO:tasks.workunit.client.1.smithi110.stdout:1/86: symlink de/d14/l1e 0 2024-04-12T13:41:53.011 INFO:tasks.workunit.client.1.smithi110.stdout:5/84: chown da/db/ld 77068115 1 2024-04-12T13:41:53.012 INFO:tasks.workunit.client.0.smithi060.stdout:4/155: write d6/d21/f2d [894349,51604] 0 2024-04-12T13:41:53.013 INFO:tasks.workunit.client.0.smithi060.stdout:5/177: dread d6/fc [0,4194304] 0 2024-04-12T13:41:53.016 INFO:tasks.workunit.client.1.smithi110.stdout:8/105: write d1/d5/dd/ff [4910935,111390] 0 2024-04-12T13:41:53.022 INFO:tasks.workunit.client.0.smithi060.stdout:2/129: creat d6/f25 x:0 0 0 2024-04-12T13:41:53.022 INFO:tasks.workunit.client.0.smithi060.stdout:4/156: write d6/d7/dd/d1a/d19/f1b [1177973,98652] 0 2024-04-12T13:41:53.024 INFO:tasks.workunit.client.1.smithi110.stdout:2/124: rename d6/dc/dd/c1a to d6/d18/c21 0 2024-04-12T13:41:53.028 INFO:tasks.workunit.client.0.smithi060.stdout:8/147: dwrite d9/d1b/d2b/f32 [0,4194304] 0 2024-04-12T13:41:53.028 INFO:tasks.workunit.client.0.smithi060.stdout:5/178: mkdir d6/d10/d12/d38 0 2024-04-12T13:41:53.028 INFO:tasks.workunit.client.1.smithi110.stdout:9/187: dwrite df/d13/f1b [0,4194304] 0 2024-04-12T13:41:53.030 INFO:tasks.workunit.client.0.smithi060.stdout:4/157: truncate d6/d7/dd/df/f23 90004 0 2024-04-12T13:41:53.036 INFO:tasks.workunit.client.1.smithi110.stdout:1/87: unlink lc 0 2024-04-12T13:41:53.036 INFO:tasks.workunit.client.1.smithi110.stdout:5/85: creat da/db/d15/f1b x:0 0 0 2024-04-12T13:41:53.036 INFO:tasks.workunit.client.1.smithi110.stdout:1/88: readlink de/d14/l1e 0 2024-04-12T13:41:53.036 INFO:tasks.workunit.client.0.smithi060.stdout:1/127: getdents d1e/d23 0 2024-04-12T13:41:53.037 INFO:tasks.workunit.client.1.smithi110.stdout:5/86: fdatasync f9 0 2024-04-12T13:41:53.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/179: unlink d6/f9 0 2024-04-12T13:41:53.040 INFO:tasks.workunit.client.0.smithi060.stdout:8/148: unlink d9/da/l14 0 2024-04-12T13:41:53.042 INFO:tasks.workunit.client.1.smithi110.stdout:2/125: unlink d6/d18/l1c 0 2024-04-12T13:41:53.044 INFO:tasks.workunit.client.1.smithi110.stdout:7/105: link d1/l16 d1/d3/l24 0 2024-04-12T13:41:53.044 INFO:tasks.workunit.client.1.smithi110.stdout:2/126: write f4 [2123560,92502] 0 2024-04-12T13:41:53.044 INFO:tasks.workunit.client.0.smithi060.stdout:4/158: symlink d6/d7/dd/d1a/l39 0 2024-04-12T13:41:53.045 INFO:tasks.workunit.client.0.smithi060.stdout:7/160: creat d0/d7/f38 x:0 0 0 2024-04-12T13:41:53.046 INFO:tasks.workunit.client.1.smithi110.stdout:9/188: creat df/d13/d2c/d2d/d39/f44 x:0 0 0 2024-04-12T13:41:53.049 INFO:tasks.workunit.client.1.smithi110.stdout:0/101: sync 2024-04-12T13:41:53.049 INFO:tasks.workunit.client.1.smithi110.stdout:6/178: sync 2024-04-12T13:41:53.052 INFO:tasks.workunit.client.1.smithi110.stdout:2/127: write d6/f12 [1154526,68095] 0 2024-04-12T13:41:53.053 INFO:tasks.workunit.client.1.smithi110.stdout:8/106: mkdir d1/d5/d1f 0 2024-04-12T13:41:53.059 INFO:tasks.workunit.client.0.smithi060.stdout:1/128: mknod d1e/d23/d2e/c2f 0 2024-04-12T13:41:53.060 INFO:tasks.workunit.client.1.smithi110.stdout:3/122: creat d5/f28 x:0 0 0 2024-04-12T13:41:53.060 INFO:tasks.workunit.client.1.smithi110.stdout:6/179: read d7/d10/f20 [142697,70393] 0 2024-04-12T13:41:53.061 INFO:tasks.workunit.client.0.smithi060.stdout:8/149: dread d9/d1b/f19 [0,4194304] 0 2024-04-12T13:41:53.061 INFO:tasks.workunit.client.1.smithi110.stdout:2/128: dread d6/f11 [0,4194304] 0 2024-04-12T13:41:53.064 INFO:tasks.workunit.client.1.smithi110.stdout:5/87: dwrite f5 [0,4194304] 0 2024-04-12T13:41:53.065 INFO:tasks.workunit.client.1.smithi110.stdout:8/107: truncate d1/d7/f1d 716245 0 2024-04-12T13:41:53.065 INFO:tasks.workunit.client.0.smithi060.stdout:5/180: creat d6/dd/d1f/d25/d35/f39 x:0 0 0 2024-04-12T13:41:53.069 INFO:tasks.workunit.client.1.smithi110.stdout:8/108: chown d1/d3 1 1 2024-04-12T13:41:53.070 INFO:tasks.workunit.client.1.smithi110.stdout:8/109: chown d1 216905 1 2024-04-12T13:41:53.072 INFO:tasks.workunit.client.0.smithi060.stdout:5/181: readlink d6/dd/d27/l33 0 2024-04-12T13:41:53.072 INFO:tasks.workunit.client.1.smithi110.stdout:1/89: symlink de/d1d/l1f 0 2024-04-12T13:41:53.075 INFO:tasks.workunit.client.0.smithi060.stdout:4/159: dwrite d6/d7/dd/df/f23 [0,4194304] 0 2024-04-12T13:41:53.078 INFO:tasks.workunit.client.0.smithi060.stdout:4/160: write d6/d21/f27 [687839,95266] 0 2024-04-12T13:41:53.080 INFO:tasks.workunit.client.1.smithi110.stdout:0/102: dwrite d1/d8/f21 [0,4194304] 0 2024-04-12T13:41:53.080 INFO:tasks.workunit.client.1.smithi110.stdout:2/129: dread f4 [0,4194304] 0 2024-04-12T13:41:53.080 INFO:tasks.workunit.client.1.smithi110.stdout:0/103: stat d1/d8 0 2024-04-12T13:41:53.084 INFO:tasks.workunit.client.0.smithi060.stdout:1/129: mkdir d1e/d23/d2e/d30 0 2024-04-12T13:41:53.091 INFO:tasks.workunit.client.0.smithi060.stdout:8/150: creat d9/d1d/f33 x:0 0 0 2024-04-12T13:41:53.094 INFO:tasks.workunit.client.1.smithi110.stdout:6/180: creat d7/d25/d2c/f3c x:0 0 0 2024-04-12T13:41:53.096 INFO:tasks.workunit.client.0.smithi060.stdout:7/161: creat d0/d7/f39 x:0 0 0 2024-04-12T13:41:53.101 INFO:tasks.workunit.client.1.smithi110.stdout:5/88: symlink da/db/l1c 0 2024-04-12T13:41:53.105 INFO:tasks.workunit.client.0.smithi060.stdout:1/130: dread d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:53.107 INFO:tasks.workunit.client.1.smithi110.stdout:8/110: unlink d1/d7/cc 0 2024-04-12T13:41:53.108 INFO:tasks.workunit.client.1.smithi110.stdout:8/111: chown d1/d5/d1f 1191 1 2024-04-12T13:41:53.109 INFO:tasks.workunit.client.0.smithi060.stdout:8/151: dread d9/f23 [0,4194304] 0 2024-04-12T13:41:53.109 INFO:tasks.workunit.client.1.smithi110.stdout:8/112: readlink d1/l11 0 2024-04-12T13:41:53.110 INFO:tasks.workunit.client.1.smithi110.stdout:6/181: dwrite d7/f1a [0,4194304] 0 2024-04-12T13:41:53.113 INFO:tasks.workunit.client.0.smithi060.stdout:9/93: sync 2024-04-12T13:41:53.113 INFO:tasks.workunit.client.0.smithi060.stdout:0/153: sync 2024-04-12T13:41:53.114 INFO:tasks.workunit.client.1.smithi110.stdout:1/90: symlink de/l20 0 2024-04-12T13:41:53.115 INFO:tasks.workunit.client.0.smithi060.stdout:9/94: read - d4/fd zero size 2024-04-12T13:41:53.116 INFO:tasks.workunit.client.0.smithi060.stdout:2/130: dwrite d6/f19 [4194304,4194304] 0 2024-04-12T13:41:53.118 INFO:tasks.workunit.client.0.smithi060.stdout:8/152: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:41:53.119 INFO:tasks.workunit.client.0.smithi060.stdout:1/131: creat d1e/f31 x:0 0 0 2024-04-12T13:41:53.123 INFO:tasks.workunit.client.1.smithi110.stdout:2/130: creat d6/dc/dd/f22 x:0 0 0 2024-04-12T13:41:53.123 INFO:tasks.workunit.client.1.smithi110.stdout:4/199: sync 2024-04-12T13:41:53.124 INFO:tasks.workunit.client.0.smithi060.stdout:1/132: chown d1e/d23/c2a 2763 1 2024-04-12T13:41:53.124 INFO:tasks.workunit.client.0.smithi060.stdout:1/133: read - d1e/f28 zero size 2024-04-12T13:41:53.124 INFO:tasks.workunit.client.1.smithi110.stdout:7/106: write d1/f5 [3500569,102909] 0 2024-04-12T13:41:53.126 INFO:tasks.workunit.client.0.smithi060.stdout:4/161: creat d6/f3a x:0 0 0 2024-04-12T13:41:53.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/162: write d0/d7/f6 [1646655,97285] 0 2024-04-12T13:41:53.131 INFO:tasks.workunit.client.0.smithi060.stdout:4/162: dread d6/d7/dd/df/f18 [0,4194304] 0 2024-04-12T13:41:53.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/95: mknod d4/c20 0 2024-04-12T13:41:53.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/154: rmdir d7/d9/de 39 2024-04-12T13:41:53.138 INFO:tasks.workunit.client.1.smithi110.stdout:2/131: truncate d6/f12 2078195 0 2024-04-12T13:41:53.139 INFO:tasks.workunit.client.1.smithi110.stdout:5/89: rename da/db/fe to da/db/f1d 0 2024-04-12T13:41:53.140 INFO:tasks.workunit.client.0.smithi060.stdout:2/131: mkdir d6/d10/d16/d26 0 2024-04-12T13:41:53.142 INFO:tasks.workunit.client.1.smithi110.stdout:8/113: fdatasync d1/f19 0 2024-04-12T13:41:53.144 INFO:tasks.workunit.client.1.smithi110.stdout:6/182: mkdir d7/d10/d12/d3d 0 2024-04-12T13:41:53.144 INFO:tasks.workunit.client.0.smithi060.stdout:1/134: symlink d1e/l32 0 2024-04-12T13:41:53.146 INFO:tasks.workunit.client.0.smithi060.stdout:5/182: truncate d6/d10/f31 285412 0 2024-04-12T13:41:53.147 INFO:tasks.workunit.client.1.smithi110.stdout:6/183: chown d7/d25/d30 352193 1 2024-04-12T13:41:53.149 INFO:tasks.workunit.client.0.smithi060.stdout:5/183: write d6/dd/d1f/d25/f34 [640814,5410] 0 2024-04-12T13:41:53.152 INFO:tasks.workunit.client.1.smithi110.stdout:6/184: chown d7/d10/d1c 4 1 2024-04-12T13:41:53.152 INFO:tasks.workunit.client.1.smithi110.stdout:1/91: dwrite de/d15/f1c [0,4194304] 0 2024-04-12T13:41:53.152 INFO:tasks.workunit.client.1.smithi110.stdout:4/200: creat d0/de/d2c/f3d x:0 0 0 2024-04-12T13:41:53.153 INFO:tasks.workunit.client.1.smithi110.stdout:9/189: dwrite df/f11 [0,4194304] 0 2024-04-12T13:41:53.157 INFO:tasks.workunit.client.1.smithi110.stdout:1/92: stat de/f1b 0 2024-04-12T13:41:53.157 INFO:tasks.workunit.client.1.smithi110.stdout:3/123: link d5/dc/c16 d5/dc/d20/c29 0 2024-04-12T13:41:53.162 INFO:tasks.workunit.client.0.smithi060.stdout:9/96: rmdir d4 39 2024-04-12T13:41:53.163 INFO:tasks.workunit.client.0.smithi060.stdout:1/135: dread f13 [4194304,4194304] 0 2024-04-12T13:41:53.164 INFO:tasks.workunit.client.1.smithi110.stdout:0/104: dwrite d1/d11/f18 [0,4194304] 0 2024-04-12T13:41:53.164 INFO:tasks.workunit.client.1.smithi110.stdout:6/185: write d7/d10/d1c/d2b/f38 [3674120,62117] 0 2024-04-12T13:41:53.164 INFO:tasks.workunit.client.1.smithi110.stdout:7/107: dread d1/fd [0,4194304] 0 2024-04-12T13:41:53.166 INFO:tasks.workunit.client.1.smithi110.stdout:2/132: mknod d6/dc/dd/c23 0 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 -- 172.21.15.60:0/943237426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 msgr2=0x7ff4c00fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/943237426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 0x7ff4c00fbf20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0004940 tx=0x7ff4b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 -- 172.21.15.60:0/943237426 shutdown_connections 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/943237426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c00fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/943237426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 0x7ff4c00fbf20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.165+0000 7ff4c5a00700 1 -- 172.21.15.60:0/943237426 >> 172.21.15.60:0/943237426 conn(0x7ff4c00f7270 msgr2=0x7ff4c00f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.166+0000 7ff4c5a00700 1 -- 172.21.15.60:0/943237426 shutdown_connections 2024-04-12T13:41:53.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.166+0000 7ff4c5a00700 1 -- 172.21.15.60:0/943237426 wait complete. 2024-04-12T13:41:53.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/132: dwrite d6/d10/d16/f1c [0,4194304] 0 2024-04-12T13:41:53.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 Processor -- start 2024-04-12T13:41:53.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 -- start start 2024-04-12T13:41:53.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 0x7ff4c010fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0110640 con 0x7ff4c00fbb10 2024-04-12T13:41:53.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.167+0000 7ff4c5a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0110e30 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.169 INFO:tasks.workunit.client.0.smithi060.stdout:4/163: creat d6/d7/f3b x:0 0 0 2024-04-12T13:41:53.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.168+0000 7ff4bf400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:53.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.168+0000 7ff4bf400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:52328/0 (socket says 172.21.15.60:52328) 2024-04-12T13:41:53.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.168+0000 7ff4bf400700 1 -- 172.21.15.60:0/2609287293 learned_addr learned my addr 172.21.15.60:0/2609287293 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:53.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.169+0000 7ff4bf400700 1 -- 172.21.15.60:0/2609287293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 msgr2=0x7ff4c010fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.169+0000 7ff4bf400700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 0x7ff4c010fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.169+0000 7ff4bf400700 1 -- 172.21.15.60:0/2609287293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0005040 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.170+0000 7ff4bf400700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00b790 tx=0x7ff4ac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:53.173 INFO:tasks.workunit.client.0.smithi060.stdout:4/164: dread - d6/d7/dd/d1a/d19/f33 zero size 2024-04-12T13:41:53.177 INFO:tasks.workunit.client.1.smithi110.stdout:3/124: unlink d5/c25 0 2024-04-12T13:41:53.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.176+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ac00f770 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.176+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ac00fda0 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.176+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ac00d310 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.177+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0111110 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.178+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c01116d0 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.180 INFO:tasks.workunit.client.0.smithi060.stdout:9/97: write d4/d8/f17 [213293,124228] 0 2024-04-12T13:41:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.180+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c0100750 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.181 INFO:tasks.workunit.client.0.smithi060.stdout:0/155: creat d7/d9/d14/d35/f36 x:0 0 0 2024-04-12T13:41:53.182 INFO:tasks.workunit.client.1.smithi110.stdout:0/105: symlink d1/d11/l23 0 2024-04-12T13:41:53.184 INFO:tasks.workunit.client.0.smithi060.stdout:5/184: dwrite f1 [4194304,4194304] 0 2024-04-12T13:41:53.184 INFO:tasks.workunit.client.0.smithi060.stdout:0/156: write d7/d9/d14/d1b/f2a [931939,127576] 0 2024-04-12T13:41:53.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.184+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7ff4ac010420 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.186+0000 7ff4b7e00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 0x7ff4a406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.187+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff4ac08a750 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.189 INFO:tasks.workunit.client.1.smithi110.stdout:5/90: link f7 da/db/d15/d17/f1e 0 2024-04-12T13:41:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.188+0000 7ff4bfe00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 0x7ff4a406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.189+0000 7ff4bfe00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 0x7ff4a406e1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0004f90 tx=0x7ff4b0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:53.191 INFO:tasks.workunit.client.0.smithi060.stdout:2/133: mknod d6/d10/c27 0 2024-04-12T13:41:53.194 INFO:tasks.workunit.client.0.smithi060.stdout:6/228: sync 2024-04-12T13:41:53.194 INFO:tasks.workunit.client.0.smithi060.stdout:3/139: sync 2024-04-12T13:41:53.194 INFO:tasks.workunit.client.0.smithi060.stdout:2/134: stat d6/d13/d17/f1f 0 2024-04-12T13:41:53.194 INFO:tasks.workunit.client.0.smithi060.stdout:4/165: rmdir d6/d21 39 2024-04-12T13:41:53.198 INFO:tasks.workunit.client.0.smithi060.stdout:4/166: dread - d6/d7/db/f22 zero size 2024-04-12T13:41:53.198 INFO:tasks.workunit.client.1.smithi110.stdout:2/133: creat d6/dc/dd/f24 x:0 0 0 2024-04-12T13:41:53.200 INFO:tasks.workunit.client.0.smithi060.stdout:2/135: chown d6/d13/d17/f1f 6574478 1 2024-04-12T13:41:53.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.199+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7ff4ac057980 con 0x7ff4c00fcdc0 2024-04-12T13:41:53.202 INFO:tasks.workunit.client.1.smithi110.stdout:4/201: mknod d0/de/d32/c3e 0 2024-04-12T13:41:53.205 INFO:tasks.workunit.client.0.smithi060.stdout:7/163: creat d0/f3a x:0 0 0 2024-04-12T13:41:53.205 INFO:tasks.workunit.client.0.smithi060.stdout:1/136: dwrite fb [0,4194304] 0 2024-04-12T13:41:53.205 INFO:tasks.workunit.client.0.smithi060.stdout:9/98: unlink d4/d9/f10 0 2024-04-12T13:41:53.207 INFO:tasks.workunit.client.1.smithi110.stdout:9/190: rename df/f35 to df/d13/d26/f45 0 2024-04-12T13:41:53.208 INFO:tasks.workunit.client.0.smithi060.stdout:8/153: link d9/d1b/l22 d9/l34 0 2024-04-12T13:41:53.210 INFO:tasks.workunit.client.0.smithi060.stdout:0/157: mknod d7/d9/d14/d35/c37 0 2024-04-12T13:41:53.211 INFO:tasks.workunit.client.1.smithi110.stdout:0/106: dwrite d1/f22 [0,4194304] 0 2024-04-12T13:41:53.218 INFO:tasks.workunit.client.0.smithi060.stdout:6/229: mkdir d1/d7/da/dc/d24/d34/d51 0 2024-04-12T13:41:53.222 INFO:tasks.workunit.client.0.smithi060.stdout:6/230: fsync d1/d7/da/d20/f26 0 2024-04-12T13:41:53.222 INFO:tasks.workunit.client.0.smithi060.stdout:9/99: dwrite d4/d8/fa [0,4194304] 0 2024-04-12T13:41:53.223 INFO:tasks.workunit.client.1.smithi110.stdout:4/202: symlink d0/d19/l3f 0 2024-04-12T13:41:53.225 INFO:tasks.workunit.client.1.smithi110.stdout:1/93: sync 2024-04-12T13:41:53.225 INFO:tasks.workunit.client.1.smithi110.stdout:8/114: sync 2024-04-12T13:41:53.227 INFO:tasks.workunit.client.0.smithi060.stdout:4/167: read d6/d21/f2d [797360,14701] 0 2024-04-12T13:41:53.227 INFO:tasks.workunit.client.1.smithi110.stdout:6/186: creat d7/f3e x:0 0 0 2024-04-12T13:41:53.229 INFO:tasks.workunit.client.0.smithi060.stdout:1/137: write f1d [961956,123776] 0 2024-04-12T13:41:53.230 INFO:tasks.workunit.client.1.smithi110.stdout:0/107: creat d1/d8/f24 x:0 0 0 2024-04-12T13:41:53.233 INFO:tasks.workunit.client.1.smithi110.stdout:3/125: link d5/dc/f27 d5/dc/d20/f2a 0 2024-04-12T13:41:53.233 INFO:tasks.workunit.client.1.smithi110.stdout:3/126: chown d5 3147428 1 2024-04-12T13:41:53.235 INFO:tasks.workunit.client.1.smithi110.stdout:2/134: dread f4 [0,4194304] 0 2024-04-12T13:41:53.236 INFO:tasks.workunit.client.0.smithi060.stdout:0/158: write d7/d9/f1c [1065895,109105] 0 2024-04-12T13:41:53.246 INFO:tasks.workunit.client.1.smithi110.stdout:7/108: truncate d1/f1e 406940 0 2024-04-12T13:41:53.247 INFO:tasks.workunit.client.1.smithi110.stdout:4/203: creat d0/d19/d26/f40 x:0 0 0 2024-04-12T13:41:53.247 INFO:tasks.workunit.client.1.smithi110.stdout:1/94: creat de/d15/f21 x:0 0 0 2024-04-12T13:41:53.248 INFO:tasks.workunit.client.0.smithi060.stdout:3/140: truncate d7/d17/f1a 1752566 0 2024-04-12T13:41:53.248 INFO:tasks.workunit.client.1.smithi110.stdout:9/191: mknod df/d13/d3b/d40/c46 0 2024-04-12T13:41:53.249 INFO:tasks.workunit.client.1.smithi110.stdout:4/204: chown d0/d19/d1c/l1f 13333030 1 2024-04-12T13:41:53.249 INFO:tasks.workunit.client.1.smithi110.stdout:9/192: write df/f19 [183662,24332] 0 2024-04-12T13:41:53.253 INFO:tasks.workunit.client.0.smithi060.stdout:7/164: symlink d0/l3b 0 2024-04-12T13:41:53.253 INFO:tasks.workunit.client.0.smithi060.stdout:6/231: dwrite d1/d7/da/dc/d24/d2d/f3d [0,4194304] 0 2024-04-12T13:41:53.253 INFO:tasks.workunit.client.0.smithi060.stdout:3/141: write d7/d17/d19/f23 [4971257,111873] 0 2024-04-12T13:41:53.253 INFO:tasks.workunit.client.0.smithi060.stdout:1/138: dread f7 [0,4194304] 0 2024-04-12T13:41:53.254 INFO:tasks.workunit.client.1.smithi110.stdout:6/187: mknod d7/d25/c3f 0 2024-04-12T13:41:53.254 INFO:tasks.workunit.client.0.smithi060.stdout:7/165: readlink d0/l2e 0 2024-04-12T13:41:53.260 INFO:tasks.workunit.client.0.smithi060.stdout:9/100: rename d4/d9/d1b to d4/d9/d19/d21 0 2024-04-12T13:41:53.262 INFO:tasks.workunit.client.0.smithi060.stdout:2/136: creat d6/d10/d16/d26/f28 x:0 0 0 2024-04-12T13:41:53.263 INFO:tasks.workunit.client.0.smithi060.stdout:9/101: readlink d4/d9/l1e 0 2024-04-12T13:41:53.264 INFO:tasks.workunit.client.1.smithi110.stdout:8/115: dread d1/d7/fb [0,4194304] 0 2024-04-12T13:41:53.265 INFO:tasks.workunit.client.1.smithi110.stdout:1/95: creat de/f22 x:0 0 0 2024-04-12T13:41:53.266 INFO:tasks.workunit.client.0.smithi060.stdout:4/168: rmdir d6/d7/dd 39 2024-04-12T13:41:53.266 INFO:tasks.workunit.client.0.smithi060.stdout:9/102: chown l3 1693 1 2024-04-12T13:41:53.267 INFO:tasks.workunit.client.0.smithi060.stdout:9/103: fdatasync f2 0 2024-04-12T13:41:53.268 INFO:tasks.workunit.client.0.smithi060.stdout:3/142: dread f0 [0,4194304] 0 2024-04-12T13:41:53.271 INFO:tasks.workunit.client.0.smithi060.stdout:0/159: dwrite d7/d9/d14/f25 [0,4194304] 0 2024-04-12T13:41:53.272 INFO:tasks.workunit.client.1.smithi110.stdout:3/127: mkdir d5/dc/d20/d2b 0 2024-04-12T13:41:53.273 INFO:tasks.workunit.client.0.smithi060.stdout:3/143: stat d7/da/dd/f12 0 2024-04-12T13:41:53.276 INFO:tasks.workunit.client.1.smithi110.stdout:5/91: getdents da/db 0 2024-04-12T13:41:53.276 INFO:tasks.workunit.client.1.smithi110.stdout:7/109: getdents d1/d3/d22 0 2024-04-12T13:41:53.276 INFO:tasks.workunit.client.1.smithi110.stdout:5/92: readlink da/db/l1c 0 2024-04-12T13:41:53.277 INFO:tasks.workunit.client.1.smithi110.stdout:7/110: chown d1/d3/d22 245 1 2024-04-12T13:41:53.278 INFO:tasks.workunit.client.0.smithi060.stdout:7/166: fsync d0/d1b/f1d 0 2024-04-12T13:41:53.278 INFO:tasks.workunit.client.1.smithi110.stdout:2/135: write d6/dc/dd/f10 [602111,8896] 0 2024-04-12T13:41:53.279 INFO:tasks.workunit.client.1.smithi110.stdout:8/116: mkdir d1/d7/d20 0 2024-04-12T13:41:53.280 INFO:tasks.workunit.client.1.smithi110.stdout:2/136: write d6/dc/dd/f10 [1037953,34002] 0 2024-04-12T13:41:53.283 INFO:tasks.workunit.client.1.smithi110.stdout:1/96: rename de/l12 to de/d1d/l23 0 2024-04-12T13:41:53.285 INFO:tasks.workunit.client.0.smithi060.stdout:1/139: creat d1e/f33 x:0 0 0 2024-04-12T13:41:53.286 INFO:tasks.workunit.client.1.smithi110.stdout:1/97: dread f5 [4194304,4194304] 0 2024-04-12T13:41:53.286 INFO:tasks.workunit.client.0.smithi060.stdout:6/232: mkdir d1/d7/da/dc/d24/d30/d52 0 2024-04-12T13:41:53.287 INFO:tasks.workunit.client.0.smithi060.stdout:2/137: rename d6/d10/c22 to d6/d13/c29 0 2024-04-12T13:41:53.287 INFO:tasks.workunit.client.0.smithi060.stdout:8/154: truncate f2 4809592 0 2024-04-12T13:41:53.287 INFO:tasks.workunit.client.1.smithi110.stdout:1/98: truncate f6 4465256 0 2024-04-12T13:41:53.287 INFO:tasks.workunit.client.0.smithi060.stdout:0/160: rename d7 to d7/d9/d14/d35/d38 22 2024-04-12T13:41:53.294 INFO:tasks.workunit.client.1.smithi110.stdout:8/117: readlink d1/d7/l18 0 2024-04-12T13:41:53.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/169: dread - d6/d7/dd/d1a/d19/f33 zero size 2024-04-12T13:41:53.298 INFO:tasks.workunit.client.0.smithi060.stdout:6/233: dread d1/d7/da/dc/f19 [0,4194304] 0 2024-04-12T13:41:53.301 INFO:tasks.workunit.client.0.smithi060.stdout:5/185: dread d6/d10/f31 [0,4194304] 0 2024-04-12T13:41:53.302 INFO:tasks.workunit.client.0.smithi060.stdout:8/155: rmdir d9/d1b 39 2024-04-12T13:41:53.303 INFO:tasks.workunit.client.1.smithi110.stdout:8/118: dread d1/d7/fb [0,4194304] 0 2024-04-12T13:41:53.304 INFO:tasks.workunit.client.0.smithi060.stdout:6/234: chown d1/d7/da/dc/f29 430436181 1 2024-04-12T13:41:53.304 INFO:tasks.workunit.client.1.smithi110.stdout:8/119: fdatasync d1/f19 0 2024-04-12T13:41:53.305 INFO:tasks.workunit.client.1.smithi110.stdout:5/93: rename da/db/f12 to da/db/d15/d17/f1f 0 2024-04-12T13:41:53.305 INFO:tasks.workunit.client.0.smithi060.stdout:7/167: dwrite d0/f3a [0,4194304] 0 2024-04-12T13:41:53.306 INFO:tasks.workunit.client.0.smithi060.stdout:4/170: write d6/d7/dd/df/f37 [915277,20034] 0 2024-04-12T13:41:53.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/144: dwrite d7/d17/f28 [0,4194304] 0 2024-04-12T13:41:53.312 INFO:tasks.workunit.client.0.smithi060.stdout:7/168: chown d0/d7/l2b 48809775 1 2024-04-12T13:41:53.313 INFO:tasks.workunit.client.0.smithi060.stdout:3/145: dread - d7/da/f2c zero size 2024-04-12T13:41:53.317 INFO:tasks.workunit.client.1.smithi110.stdout:2/137: write d6/fb [5817777,121963] 0 2024-04-12T13:41:53.319 INFO:tasks.workunit.client.0.smithi060.stdout:0/161: dwrite d7/d9/f23 [0,4194304] 0 2024-04-12T13:41:53.321 INFO:tasks.workunit.client.1.smithi110.stdout:2/138: write d6/dc/dd/fe [405974,97225] 0 2024-04-12T13:41:53.321 INFO:tasks.workunit.client.0.smithi060.stdout:7/169: write d0/d7/f6 [740544,125464] 0 2024-04-12T13:41:53.323 INFO:tasks.workunit.client.1.smithi110.stdout:1/99: symlink de/d14/l24 0 2024-04-12T13:41:53.324 INFO:tasks.workunit.client.0.smithi060.stdout:9/104: symlink d4/d9/l22 0 2024-04-12T13:41:53.327 INFO:tasks.workunit.client.1.smithi110.stdout:7/111: creat d1/d3/d22/f25 x:0 0 0 2024-04-12T13:41:53.328 INFO:tasks.workunit.client.1.smithi110.stdout:7/112: chown d1/d3/d22 1462240 1 2024-04-12T13:41:53.329 INFO:tasks.workunit.client.1.smithi110.stdout:7/113: read - d1/d3/f20 zero size 2024-04-12T13:41:53.329 INFO:tasks.workunit.client.0.smithi060.stdout:5/186: creat d6/d10/d12/d15/f3a x:0 0 0 2024-04-12T13:41:53.332 INFO:tasks.workunit.client.1.smithi110.stdout:6/188: creat d7/d25/d2c/f40 x:0 0 0 2024-04-12T13:41:53.333 INFO:tasks.workunit.client.1.smithi110.stdout:6/189: dread - d7/d10/d12/f33 zero size 2024-04-12T13:41:53.335 INFO:tasks.workunit.client.0.smithi060.stdout:4/171: creat d6/d7/db/f3c x:0 0 0 2024-04-12T13:41:53.336 INFO:tasks.workunit.client.0.smithi060.stdout:1/140: mkdir d1e/d23/d2e/d30/d34 0 2024-04-12T13:41:53.337 INFO:tasks.workunit.client.0.smithi060.stdout:4/172: fsync d6/d7/dd/df/f23 0 2024-04-12T13:41:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:6/235: symlink d1/d7/da/dc/d24/d30/l53 0 2024-04-12T13:41:53.339 INFO:tasks.workunit.client.0.smithi060.stdout:3/146: dwrite d7/f10 [0,4194304] 0 2024-04-12T13:41:53.340 INFO:tasks.workunit.client.1.smithi110.stdout:5/94: mknod da/db/d15/d17/c20 0 2024-04-12T13:41:53.340 INFO:tasks.workunit.client.1.smithi110.stdout:0/108: sync 2024-04-12T13:41:53.341 INFO:tasks.workunit.client.1.smithi110.stdout:0/109: stat d1/l6 0 2024-04-12T13:41:53.342 INFO:tasks.workunit.client.1.smithi110.stdout:9/193: getdents df/d13/d2c 0 2024-04-12T13:41:53.343 INFO:tasks.workunit.client.1.smithi110.stdout:4/205: link d0/l9 d0/l41 0 2024-04-12T13:41:53.350 INFO:tasks.workunit.client.0.smithi060.stdout:8/156: readlink d9/d1b/l22 0 2024-04-12T13:41:53.352 INFO:tasks.workunit.client.1.smithi110.stdout:1/100: mknod de/d14/c25 0 2024-04-12T13:41:53.354 INFO:tasks.workunit.client.0.smithi060.stdout:2/138: creat d6/f2a x:0 0 0 2024-04-12T13:41:53.355 INFO:tasks.workunit.client.1.smithi110.stdout:7/114: mknod d1/d3/c26 0 2024-04-12T13:41:53.358 INFO:tasks.workunit.client.0.smithi060.stdout:1/141: truncate f7 4676137 0 2024-04-12T13:41:53.358 INFO:tasks.workunit.client.0.smithi060.stdout:3/147: rmdir d7/d17/d19 39 2024-04-12T13:41:53.359 INFO:tasks.workunit.client.0.smithi060.stdout:0/162: rmdir d7/d9/de 39 2024-04-12T13:41:53.361 INFO:tasks.workunit.client.1.smithi110.stdout:5/95: fdatasync da/db/ff 0 2024-04-12T13:41:53.362 INFO:tasks.workunit.client.0.smithi060.stdout:0/163: stat d7/d9/d14/d35/c37 0 2024-04-12T13:41:53.363 INFO:tasks.workunit.client.0.smithi060.stdout:0/164: readlink d7/l1f 0 2024-04-12T13:41:53.366 INFO:tasks.workunit.client.1.smithi110.stdout:0/110: symlink d1/d11/l25 0 2024-04-12T13:41:53.367 INFO:tasks.workunit.client.0.smithi060.stdout:7/170: unlink d0/d7/c18 0 2024-04-12T13:41:53.367 INFO:tasks.workunit.client.0.smithi060.stdout:4/173: dread d6/d7/dd/df/f20 [0,4194304] 0 2024-04-12T13:41:53.370 INFO:tasks.workunit.client.0.smithi060.stdout:6/236: rename d1/d7/da/c17 to d1/d7/da/dc/d24/d30/d52/c54 0 2024-04-12T13:41:53.371 INFO:tasks.workunit.client.1.smithi110.stdout:9/194: symlink df/d13/d2c/d2d/d39/l47 0 2024-04-12T13:41:53.375 INFO:tasks.workunit.client.0.smithi060.stdout:9/105: symlink d4/d9/l23 0 2024-04-12T13:41:53.376 INFO:tasks.workunit.client.1.smithi110.stdout:0/111: dread d1/f22 [0,4194304] 0 2024-04-12T13:41:53.377 INFO:tasks.workunit.client.0.smithi060.stdout:8/157: dread d9/f1f [0,4194304] 0 2024-04-12T13:41:53.377 INFO:tasks.workunit.client.0.smithi060.stdout:4/174: truncate d6/d7/dd/d1a/d19/f33 69655 0 2024-04-12T13:41:53.378 INFO:tasks.workunit.client.1.smithi110.stdout:2/139: mkdir d6/d18/d19/d25 0 2024-04-12T13:41:53.379 INFO:tasks.workunit.client.1.smithi110.stdout:2/140: dread - d6/dc/dd/f24 zero size 2024-04-12T13:41:53.381 INFO:tasks.workunit.client.0.smithi060.stdout:5/187: mknod d6/d10/c3b 0 2024-04-12T13:41:53.381 INFO:tasks.workunit.client.1.smithi110.stdout:3/128: link l2 d5/dc/d20/d2b/l2c 0 2024-04-12T13:41:53.384 INFO:tasks.workunit.client.0.smithi060.stdout:1/142: dwrite d1e/f31 [0,4194304] 0 2024-04-12T13:41:53.385 INFO:tasks.workunit.client.0.smithi060.stdout:2/139: mkdir d6/d10/d2b 0 2024-04-12T13:41:53.385 INFO:tasks.workunit.client.1.smithi110.stdout:1/101: creat de/f26 x:0 0 0 2024-04-12T13:41:53.387 INFO:tasks.workunit.client.1.smithi110.stdout:9/195: dwrite df/d13/d26/f28 [0,4194304] 0 2024-04-12T13:41:53.387 INFO:tasks.workunit.client.1.smithi110.stdout:7/115: creat d1/d3/d4/f27 x:0 0 0 2024-04-12T13:41:53.389 INFO:tasks.workunit.client.1.smithi110.stdout:7/116: chown d1/d3/l21 33 1 2024-04-12T13:41:53.389 INFO:tasks.workunit.client.0.smithi060.stdout:2/140: write d6/f1b [921846,37079] 0 2024-04-12T13:41:53.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/141: chown d6/d13/d17/f1f 0 1 2024-04-12T13:41:53.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/142: read - d6/f24 zero size 2024-04-12T13:41:53.393 INFO:tasks.workunit.client.0.smithi060.stdout:2/143: fdatasync d6/f2a 0 2024-04-12T13:41:53.394 INFO:tasks.workunit.client.0.smithi060.stdout:2/144: fdatasync f3 0 2024-04-12T13:41:53.397 INFO:tasks.workunit.client.1.smithi110.stdout:6/190: mkdir d7/d10/d41 0 2024-04-12T13:41:53.397 INFO:tasks.workunit.client.0.smithi060.stdout:2/145: read d6/f19 [6571507,14925] 0 2024-04-12T13:41:53.397 INFO:tasks.workunit.client.1.smithi110.stdout:8/120: rmdir d1/d5/dd/d1c 0 2024-04-12T13:41:53.398 INFO:tasks.workunit.client.0.smithi060.stdout:3/148: mknod d7/da/c2d 0 2024-04-12T13:41:53.399 INFO:tasks.workunit.client.0.smithi060.stdout:7/171: mkdir d0/d1b/d3c 0 2024-04-12T13:41:53.405 INFO:tasks.workunit.client.0.smithi060.stdout:3/149: fsync d7/da/dd/f12 0 2024-04-12T13:41:53.409 INFO:tasks.workunit.client.0.smithi060.stdout:7/172: dread - d0/d7/f39 zero size 2024-04-12T13:41:53.409 INFO:tasks.workunit.client.1.smithi110.stdout:2/141: creat d6/dc/d13/d1d/f26 x:0 0 0 2024-04-12T13:41:53.410 INFO:tasks.workunit.client.0.smithi060.stdout:0/165: dread d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:53.413 INFO:tasks.workunit.client.1.smithi110.stdout:9/196: dwrite df/d13/f27 [0,4194304] 0 2024-04-12T13:41:53.414 INFO:tasks.workunit.client.1.smithi110.stdout:3/129: write d5/dc/f11 [5217066,112352] 0 2024-04-12T13:41:53.414 INFO:tasks.workunit.client.1.smithi110.stdout:2/142: chown d6/dc/f14 874 1 2024-04-12T13:41:53.414 INFO:tasks.workunit.client.1.smithi110.stdout:7/117: dwrite d1/d3/d4/f1c [0,4194304] 0 2024-04-12T13:41:53.418 INFO:tasks.workunit.client.0.smithi060.stdout:6/237: truncate d1/d7/da/dc/d24/f1f 2196993 0 2024-04-12T13:41:53.418 INFO:tasks.workunit.client.0.smithi060.stdout:2/146: dread d6/f9 [0,4194304] 0 2024-04-12T13:41:53.419 INFO:tasks.workunit.client.1.smithi110.stdout:6/191: creat d7/d10/d1c/f42 x:0 0 0 2024-04-12T13:41:53.420 INFO:tasks.workunit.client.1.smithi110.stdout:4/206: truncate d0/d13/f2d 89387 0 2024-04-12T13:41:53.421 INFO:tasks.workunit.client.1.smithi110.stdout:6/192: stat d7/d25/d2c/f40 0 2024-04-12T13:41:53.422 INFO:tasks.workunit.client.1.smithi110.stdout:8/121: symlink d1/d5/dd/l21 0 2024-04-12T13:41:53.429 INFO:tasks.workunit.client.0.smithi060.stdout:4/175: rename d6/d7/db/cc to d6/d21/c3d 0 2024-04-12T13:41:53.433 INFO:tasks.workunit.client.0.smithi060.stdout:5/188: creat d6/d10/d12/d38/f3c x:0 0 0 2024-04-12T13:41:53.434 INFO:tasks.workunit.client.1.smithi110.stdout:5/96: link f9 da/f21 0 2024-04-12T13:41:53.437 INFO:tasks.workunit.client.0.smithi060.stdout:0/166: read d7/fa [781126,76607] 0 2024-04-12T13:41:53.439 INFO:tasks.workunit.client.1.smithi110.stdout:3/130: stat d5/dc/d20/c29 0 2024-04-12T13:41:53.442 INFO:tasks.workunit.client.0.smithi060.stdout:0/167: truncate d7/d9/d14/d1b/f32 923588 0 2024-04-12T13:41:53.444 INFO:tasks.workunit.client.0.smithi060.stdout:0/168: read d7/d9/d14/d1b/f32 [610116,108087] 0 2024-04-12T13:41:53.445 INFO:tasks.workunit.client.1.smithi110.stdout:9/197: symlink df/d13/d3b/l48 0 2024-04-12T13:41:53.446 INFO:tasks.workunit.client.1.smithi110.stdout:9/198: write df/f17 [523647,102628] 0 2024-04-12T13:41:53.448 INFO:tasks.workunit.client.1.smithi110.stdout:5/97: dwrite da/db/f14 [0,4194304] 0 2024-04-12T13:41:53.452 INFO:tasks.workunit.client.1.smithi110.stdout:4/207: symlink d0/d19/l42 0 2024-04-12T13:41:53.452 INFO:tasks.workunit.client.1.smithi110.stdout:5/98: write f1 [4238744,80707] 0 2024-04-12T13:41:53.452 INFO:tasks.workunit.client.1.smithi110.stdout:9/199: dread fd [4194304,4194304] 0 2024-04-12T13:41:53.452 INFO:tasks.workunit.client.1.smithi110.stdout:4/208: write d0/fc [2763934,92372] 0 2024-04-12T13:41:53.453 INFO:tasks.workunit.client.1.smithi110.stdout:6/193: creat d7/d10/d1c/f43 x:0 0 0 2024-04-12T13:41:53.454 INFO:tasks.workunit.client.1.smithi110.stdout:5/99: write da/f11 [57230,88182] 0 2024-04-12T13:41:53.454 INFO:tasks.workunit.client.0.smithi060.stdout:6/238: creat d1/d7/da/dc/d24/d2d/f55 x:0 0 0 2024-04-12T13:41:53.455 INFO:tasks.workunit.client.1.smithi110.stdout:8/122: symlink d1/d3/l22 0 2024-04-12T13:41:53.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/158: link d9/d1d/c27 d9/da/c35 0 2024-04-12T13:41:53.458 INFO:tasks.workunit.client.1.smithi110.stdout:0/112: creat d1/f26 x:0 0 0 2024-04-12T13:41:53.460 INFO:tasks.workunit.client.1.smithi110.stdout:0/113: write d1/d8/f21 [3118953,91091] 0 2024-04-12T13:41:53.461 INFO:tasks.workunit.client.0.smithi060.stdout:1/143: rename d1e/d23/d2e/c2f to d1e/d29/c35 0 2024-04-12T13:41:53.464 INFO:tasks.workunit.client.1.smithi110.stdout:3/131: mkdir d5/dc/d20/d2d 0 2024-04-12T13:41:53.465 INFO:tasks.workunit.client.0.smithi060.stdout:1/144: write d1e/f2c [999188,98456] 0 2024-04-12T13:41:53.467 INFO:tasks.workunit.client.1.smithi110.stdout:2/143: symlink d6/d18/d19/d25/l27 0 2024-04-12T13:41:53.468 INFO:tasks.workunit.client.1.smithi110.stdout:3/132: read - d5/f28 zero size 2024-04-12T13:41:53.472 INFO:tasks.workunit.client.0.smithi060.stdout:2/147: getdents d6/d13/d17/d21 0 2024-04-12T13:41:53.473 INFO:tasks.workunit.client.1.smithi110.stdout:9/200: dwrite df/f24 [0,4194304] 0 2024-04-12T13:41:53.475 INFO:tasks.workunit.client.0.smithi060.stdout:9/106: link d4/l12 d4/d9/l24 0 2024-04-12T13:41:53.476 INFO:tasks.workunit.client.1.smithi110.stdout:9/201: chown fd 1054513 1 2024-04-12T13:41:53.476 INFO:tasks.workunit.client.0.smithi060.stdout:8/159: dread d9/da/f24 [0,4194304] 0 2024-04-12T13:41:53.477 INFO:tasks.workunit.client.1.smithi110.stdout:8/123: dwrite d1/d3/fe [0,4194304] 0 2024-04-12T13:41:53.480 INFO:tasks.workunit.client.0.smithi060.stdout:0/169: dread d7/d9/d14/f24 [0,4194304] 0 2024-04-12T13:41:53.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/107: dread d4/d8/f17 [0,4194304] 0 2024-04-12T13:41:53.485 INFO:tasks.workunit.client.1.smithi110.stdout:5/100: mknod da/db/d15/c22 0 2024-04-12T13:41:53.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/189: mkdir d6/dd/d1f/d32/d3d 0 2024-04-12T13:41:53.489 INFO:tasks.workunit.client.0.smithi060.stdout:3/150: truncate d7/d17/f28 3800246 0 2024-04-12T13:41:53.494 INFO:tasks.workunit.client.1.smithi110.stdout:2/144: dwrite d6/dc/dd/f10 [0,4194304] 0 2024-04-12T13:41:53.497 INFO:tasks.workunit.client.0.smithi060.stdout:1/145: rmdir d1e 39 2024-04-12T13:41:53.498 INFO:tasks.workunit.client.1.smithi110.stdout:3/133: dwrite d5/dc/fd [0,4194304] 0 2024-04-12T13:41:53.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/146: write f1d [3906894,14923] 0 2024-04-12T13:41:53.505 INFO:tasks.workunit.client.0.smithi060.stdout:8/160: unlink d9/d1b/l15 0 2024-04-12T13:41:53.508 INFO:tasks.workunit.client.0.smithi060.stdout:8/161: read - d9/f2c zero size 2024-04-12T13:41:53.509 INFO:tasks.workunit.client.1.smithi110.stdout:6/194: rename d7/d10/d12 to d7/d25/d30/d44 0 2024-04-12T13:41:53.510 INFO:tasks.workunit.client.1.smithi110.stdout:9/202: mkdir df/d13/d26/d37/d49 0 2024-04-12T13:41:53.513 INFO:tasks.workunit.client.0.smithi060.stdout:0/170: write d7/d9/f1a [4838979,40132] 0 2024-04-12T13:41:53.514 INFO:tasks.workunit.client.0.smithi060.stdout:5/190: mkdir d6/d10/d12/d3e 0 2024-04-12T13:41:53.515 INFO:tasks.workunit.client.1.smithi110.stdout:5/101: rename da/db/f13 to da/db/f23 0 2024-04-12T13:41:53.515 INFO:tasks.workunit.client.1.smithi110.stdout:9/203: dread fa [0,4194304] 0 2024-04-12T13:41:53.516 INFO:tasks.workunit.client.1.smithi110.stdout:5/102: fdatasync da/f11 0 2024-04-12T13:41:53.517 INFO:tasks.workunit.client.1.smithi110.stdout:7/118: link d1/d3/f11 d1/f28 0 2024-04-12T13:41:53.517 INFO:tasks.workunit.client.1.smithi110.stdout:1/102: sync 2024-04-12T13:41:53.517 INFO:tasks.workunit.client.1.smithi110.stdout:2/145: dwrite d6/dc/d13/d1d/f26 [0,4194304] 0 2024-04-12T13:41:53.520 INFO:tasks.workunit.client.0.smithi060.stdout:5/191: chown d6/dd/d1f/d25/f34 40681 1 2024-04-12T13:41:53.521 INFO:tasks.workunit.client.1.smithi110.stdout:0/114: mkdir d1/d27 0 2024-04-12T13:41:53.525 INFO:tasks.workunit.client.1.smithi110.stdout:5/103: dread da/db/f1d [0,4194304] 0 2024-04-12T13:41:53.529 INFO:tasks.workunit.client.0.smithi060.stdout:2/148: mknod d6/d10/d2b/c2c 0 2024-04-12T13:41:53.530 INFO:tasks.workunit.client.0.smithi060.stdout:2/149: read - d6/f2a zero size 2024-04-12T13:41:53.531 INFO:tasks.workunit.client.1.smithi110.stdout:8/124: truncate d1/f19 1526616 0 2024-04-12T13:41:53.533 INFO:tasks.workunit.client.0.smithi060.stdout:2/150: stat d6/f9 0 2024-04-12T13:41:53.537 INFO:tasks.workunit.client.1.smithi110.stdout:7/119: dwrite d1/d3/f20 [0,4194304] 0 2024-04-12T13:41:53.537 INFO:tasks.workunit.client.0.smithi060.stdout:0/171: creat d7/d9/d14/d35/f39 x:0 0 0 2024-04-12T13:41:53.541 INFO:tasks.workunit.client.0.smithi060.stdout:6/239: dread d1/d7/da/dc/d24/f1f [0,4194304] 0 2024-04-12T13:41:53.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/108: truncate d4/d8/fb 2540270 0 2024-04-12T13:41:53.547 INFO:tasks.workunit.client.0.smithi060.stdout:5/192: dwrite d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:41:53.553 INFO:tasks.workunit.client.1.smithi110.stdout:7/120: dwrite d1/d3/f20 [0,4194304] 0 2024-04-12T13:41:53.556 INFO:tasks.workunit.client.0.smithi060.stdout:7/173: rename d0/d1b/d3c to d0/d3d 0 2024-04-12T13:41:53.562 INFO:tasks.workunit.client.0.smithi060.stdout:8/162: dwrite d9/d1d/d2f/f30 [0,4194304] 0 2024-04-12T13:41:53.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/151: dwrite d6/f15 [0,4194304] 0 2024-04-12T13:41:53.565 INFO:tasks.workunit.client.1.smithi110.stdout:0/115: rmdir d1/d11 39 2024-04-12T13:41:53.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/152: write d6/d10/d16/f18 [1331172,96447] 0 2024-04-12T13:41:53.572 INFO:tasks.workunit.client.0.smithi060.stdout:3/151: fsync d7/d17/f20 0 2024-04-12T13:41:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.573+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c0111980 con 0x7ff4a406bcf0 2024-04-12T13:41:53.576 INFO:tasks.workunit.client.0.smithi060.stdout:0/172: symlink d7/d9/d14/d35/l3a 0 2024-04-12T13:41:53.579 INFO:tasks.workunit.client.0.smithi060.stdout:9/109: mkdir d4/d25 0 2024-04-12T13:41:53.580 INFO:tasks.workunit.client.0.smithi060.stdout:8/163: dread d9/d1b/d2b/f32 [0,4194304] 0 2024-04-12T13:41:53.580 INFO:tasks.workunit.client.1.smithi110.stdout:1/103: rename de/cf to de/d15/c27 0 2024-04-12T13:41:53.583 INFO:tasks.workunit.client.1.smithi110.stdout:5/104: creat da/db/d15/f24 x:0 0 0 2024-04-12T13:41:53.586 INFO:tasks.workunit.client.0.smithi060.stdout:5/193: unlink d6/f14 0 2024-04-12T13:41:53.589 INFO:tasks.workunit.client.1.smithi110.stdout:4/209: getdents d0/de/d32 0 2024-04-12T13:41:53.592 INFO:tasks.workunit.client.1.smithi110.stdout:6/195: mknod d7/c45 0 2024-04-12T13:41:53.593 INFO:tasks.workunit.client.1.smithi110.stdout:8/125: mkdir d1/d5/dd/d23 0 2024-04-12T13:41:53.594 INFO:tasks.workunit.client.1.smithi110.stdout:8/126: chown d1 1962825432 1 2024-04-12T13:41:53.596 INFO:tasks.workunit.client.1.smithi110.stdout:9/204: mknod df/d13/d26/d37/d49/c4a 0 2024-04-12T13:41:53.601 INFO:tasks.workunit.client.0.smithi060.stdout:0/173: creat d7/d9/d14/d1b/f3b x:0 0 0 2024-04-12T13:41:53.601 INFO:tasks.workunit.client.1.smithi110.stdout:7/121: dread d1/f1e [0,4194304] 0 2024-04-12T13:41:53.606 INFO:tasks.workunit.client.1.smithi110.stdout:5/105: rmdir da/db/d15/d17 39 2024-04-12T13:41:53.608 INFO:tasks.workunit.client.1.smithi110.stdout:4/210: rename d0/de/d2c/c1a to d0/d19/d1c/c43 0 2024-04-12T13:41:53.610 INFO:tasks.workunit.client.1.smithi110.stdout:6/196: unlink d7/ca 0 2024-04-12T13:41:53.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/127: stat d1/l1e 0 2024-04-12T13:41:53.613 INFO:tasks.workunit.client.0.smithi060.stdout:4/176: rename d6/d7/db/c1e to d6/d7/dd/d1a/d19/c3e 0 2024-04-12T13:41:53.613 INFO:tasks.workunit.client.1.smithi110.stdout:8/128: fsync d1/d7/fb 0 2024-04-12T13:41:53.614 INFO:tasks.workunit.client.1.smithi110.stdout:0/116: rename d1/d11/l25 to d1/d11/l28 0 2024-04-12T13:41:53.615 INFO:tasks.workunit.client.1.smithi110.stdout:8/129: read d1/d5/dd/ff [1853308,95617] 0 2024-04-12T13:41:53.615 INFO:tasks.workunit.client.0.smithi060.stdout:7/174: mknod d0/c3e 0 2024-04-12T13:41:53.616 INFO:tasks.workunit.client.1.smithi110.stdout:2/146: truncate d6/dc/d13/d1d/f26 2104391 0 2024-04-12T13:41:53.617 INFO:tasks.workunit.client.1.smithi110.stdout:8/130: write d1/d3/fe [82709,94170] 0 2024-04-12T13:41:53.618 INFO:tasks.workunit.client.1.smithi110.stdout:3/134: getdents d5/dc 0 2024-04-12T13:41:53.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/110: write d4/d9/d19/d21/f1c [362875,57691] 0 2024-04-12T13:41:53.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.618+0000 7ff4b7e00700 1 -- 172.21.15.60:0/2609287293 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7ff4c0111980 con 0x7ff4a406bcf0 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 18s ago 10m 13.7M - 0.25.0 c8568f914cd2 e80776cea52a 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (11m) 18s ago 11m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (9m) 24s ago 9m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (8m) 18s ago 10m 75.3M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (3m) 18s ago 3m 12.0M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (3m) 18s ago 3m 140M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (3m) 24s ago 3m 11.9M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (3m) 24s ago 3m 12.0M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (12m) 18s ago 12m 327M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (57s) 24s ago 9m 487M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (12m) 18s ago 12m 46.7M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (9m) 24s ago 9m 38.8M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 starting - - - - 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (9m) 24s ago 9m 8162k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:41:53.620 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (8m) 18s ago 8m 101M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 18s ago 7m 112M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (7m) 18s ago 7m 95.2M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (6m) 24s ago 6m 119M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (5m) 24s ago 5m 109M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (5m) 24s ago 5m 106M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:41:53.621 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (8m) 18s ago 10m 50.6M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:41:53.621 INFO:tasks.workunit.client.1.smithi110.stdout:7/122: mknod d1/d3/d22/c29 0 2024-04-12T13:41:53.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.621+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 msgr2=0x7ff4a406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.621+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 0x7ff4a406e1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0004f90 tx=0x7ff4b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.621+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 msgr2=0x7ff4c010ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.621+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00b790 tx=0x7ff4ac009250 comp rx=0 tx=0).stop 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 shutdown_connections 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4a406bcf0 0x7ff4a406e1a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c00fbb10 0x7ff4c010fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 --2- 172.21.15.60:0/2609287293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c00fcdc0 0x7ff4c010ffb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 >> 172.21.15.60:0/2609287293 conn(0x7ff4c00f7270 msgr2=0x7ff4c00f8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:53.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.622+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 shutdown_connections 2024-04-12T13:41:53.624 INFO:tasks.workunit.client.1.smithi110.stdout:1/104: link de/d15/f21 de/d1d/f28 0 2024-04-12T13:41:53.624 INFO:tasks.workunit.client.0.smithi060.stdout:0/174: mkdir d7/d9/d14/d35/d3c 0 2024-04-12T13:41:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.625+0000 7ff4c5a00700 1 -- 172.21.15.60:0/2609287293 wait complete. 2024-04-12T13:41:53.634 INFO:tasks.workunit.client.1.smithi110.stdout:9/205: symlink df/d13/d2c/d2d/d39/d3a/l4b 0 2024-04-12T13:41:53.635 INFO:tasks.workunit.client.1.smithi110.stdout:9/206: fsync df/d13/f1b 0 2024-04-12T13:41:53.637 INFO:tasks.workunit.client.1.smithi110.stdout:9/207: readlink df/d13/d26/l29 0 2024-04-12T13:41:53.637 INFO:tasks.workunit.client.0.smithi060.stdout:1/147: rename f1d to d1e/d23/d2e/d30/f36 0 2024-04-12T13:41:53.637 INFO:tasks.workunit.client.0.smithi060.stdout:3/152: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:41:53.639 INFO:tasks.workunit.client.1.smithi110.stdout:9/208: write df/f3d [4690899,44321] 0 2024-04-12T13:41:53.639 INFO:tasks.workunit.client.1.smithi110.stdout:6/197: dwrite d7/d10/d1c/f27 [0,4194304] 0 2024-04-12T13:41:53.642 INFO:tasks.workunit.client.1.smithi110.stdout:3/135: creat d5/dc/f2e x:0 0 0 2024-04-12T13:41:53.645 INFO:tasks.workunit.client.1.smithi110.stdout:2/147: creat d6/dc/dd/f28 x:0 0 0 2024-04-12T13:41:53.646 INFO:tasks.workunit.client.1.smithi110.stdout:2/148: read - d6/dc/dd/f24 zero size 2024-04-12T13:41:53.654 INFO:tasks.workunit.client.0.smithi060.stdout:8/164: creat d9/f36 x:0 0 0 2024-04-12T13:41:53.655 INFO:tasks.workunit.client.1.smithi110.stdout:1/105: rename de/c16 to de/d1d/c29 0 2024-04-12T13:41:53.656 INFO:tasks.workunit.client.1.smithi110.stdout:1/106: write f6 [1221953,122393] 0 2024-04-12T13:41:53.658 INFO:tasks.workunit.client.0.smithi060.stdout:5/194: mknod d6/c3f 0 2024-04-12T13:41:53.660 INFO:tasks.workunit.client.1.smithi110.stdout:5/106: mkdir da/db/d15/d17/d25 0 2024-04-12T13:41:53.663 INFO:tasks.workunit.client.1.smithi110.stdout:2/149: dread d6/dc/dd/f1f [4194304,4194304] 0 2024-04-12T13:41:53.665 INFO:tasks.workunit.client.0.smithi060.stdout:6/240: getdents d1/d7/da/d39 0 2024-04-12T13:41:53.666 INFO:tasks.workunit.client.1.smithi110.stdout:2/150: dread - d6/dc/dd/f24 zero size 2024-04-12T13:41:53.671 INFO:tasks.workunit.client.1.smithi110.stdout:1/107: dread f2 [0,4194304] 0 2024-04-12T13:41:53.677 INFO:tasks.workunit.client.1.smithi110.stdout:4/211: write d0/d13/f2d [560541,66666] 0 2024-04-12T13:41:53.677 INFO:tasks.workunit.client.1.smithi110.stdout:9/209: mkdir df/d13/d26/d37/d4c 0 2024-04-12T13:41:53.680 INFO:tasks.workunit.client.1.smithi110.stdout:2/151: dread d6/fb [0,4194304] 0 2024-04-12T13:41:53.681 INFO:tasks.workunit.client.1.smithi110.stdout:7/123: unlink d1/d3/l24 0 2024-04-12T13:41:53.686 INFO:tasks.workunit.client.1.smithi110.stdout:2/152: chown d6/d18/d19/d25/l27 1006 1 2024-04-12T13:41:53.686 INFO:tasks.workunit.client.1.smithi110.stdout:6/198: dread d7/d25/d30/d44/f1f [4194304,4194304] 0 2024-04-12T13:41:53.690 INFO:tasks.workunit.client.1.smithi110.stdout:7/124: creat d1/f2a x:0 0 0 2024-04-12T13:41:53.693 INFO:tasks.workunit.client.1.smithi110.stdout:0/117: getdents d1 0 2024-04-12T13:41:53.694 INFO:tasks.workunit.client.1.smithi110.stdout:7/125: creat d1/f2b x:0 0 0 2024-04-12T13:41:53.695 INFO:tasks.workunit.client.1.smithi110.stdout:1/108: write de/d15/f21 [572346,97598] 0 2024-04-12T13:41:53.695 INFO:tasks.workunit.client.1.smithi110.stdout:5/107: creat da/f26 x:0 0 0 2024-04-12T13:41:53.698 INFO:tasks.workunit.client.1.smithi110.stdout:9/210: dwrite df/d13/d2c/f3f [0,4194304] 0 2024-04-12T13:41:53.699 INFO:tasks.workunit.client.1.smithi110.stdout:0/118: symlink d1/d11/l29 0 2024-04-12T13:41:53.700 INFO:tasks.workunit.client.1.smithi110.stdout:7/126: chown d1/d3/l21 49807557 1 2024-04-12T13:41:53.706 INFO:tasks.workunit.client.1.smithi110.stdout:9/211: chown df/d13/d2c/c3e 175398 1 2024-04-12T13:41:53.707 INFO:tasks.workunit.client.1.smithi110.stdout:0/119: mknod d1/c2a 0 2024-04-12T13:41:53.710 INFO:tasks.workunit.client.1.smithi110.stdout:1/109: dread de/f1b [0,4194304] 0 2024-04-12T13:41:53.715 INFO:tasks.workunit.client.1.smithi110.stdout:3/136: dwrite d5/f1f [0,4194304] 0 2024-04-12T13:41:53.720 INFO:tasks.workunit.client.1.smithi110.stdout:6/199: dwrite d7/d25/d30/d44/f33 [0,4194304] 0 2024-04-12T13:41:53.720 INFO:tasks.workunit.client.1.smithi110.stdout:2/153: dwrite d6/dc/dd/f16 [0,4194304] 0 2024-04-12T13:41:53.721 INFO:tasks.workunit.client.1.smithi110.stdout:9/212: symlink df/d13/d26/d37/d49/l4d 0 2024-04-12T13:41:53.723 INFO:tasks.workunit.client.1.smithi110.stdout:3/137: dread - d5/dc/f2e zero size 2024-04-12T13:41:53.735 INFO:tasks.workunit.client.1.smithi110.stdout:1/110: link de/d14/l24 de/l2a 0 2024-04-12T13:41:53.735 INFO:tasks.workunit.client.1.smithi110.stdout:7/127: dwrite d1/f2b [0,4194304] 0 2024-04-12T13:41:53.736 INFO:tasks.workunit.client.1.smithi110.stdout:3/138: mkdir d5/d2f 0 2024-04-12T13:41:53.739 INFO:tasks.workunit.client.1.smithi110.stdout:6/200: dread d7/d25/d30/d44/f2d [0,4194304] 0 2024-04-12T13:41:53.742 INFO:tasks.workunit.client.1.smithi110.stdout:0/120: fsync d1/d11/f17 0 2024-04-12T13:41:53.747 INFO:tasks.workunit.client.1.smithi110.stdout:2/154: dread d6/dc/f15 [0,4194304] 0 2024-04-12T13:41:53.748 INFO:tasks.workunit.client.1.smithi110.stdout:0/121: creat d1/d11/f2b x:0 0 0 2024-04-12T13:41:53.750 INFO:tasks.workunit.client.1.smithi110.stdout:3/139: mkdir d5/dc/d20/d2b/d30 0 2024-04-12T13:41:53.751 INFO:tasks.workunit.client.1.smithi110.stdout:8/131: sync 2024-04-12T13:41:53.751 INFO:tasks.workunit.client.1.smithi110.stdout:7/128: symlink d1/d3/d22/l2c 0 2024-04-12T13:41:53.751 INFO:tasks.workunit.client.1.smithi110.stdout:2/155: truncate d6/dc/dd/f24 454972 0 2024-04-12T13:41:53.753 INFO:tasks.workunit.client.1.smithi110.stdout:7/129: fsync d1/d3/d4/f9 0 2024-04-12T13:41:53.753 INFO:tasks.workunit.client.1.smithi110.stdout:9/213: truncate df/f17 1176546 0 2024-04-12T13:41:53.754 INFO:tasks.workunit.client.1.smithi110.stdout:6/201: creat d7/d25/f46 x:0 0 0 2024-04-12T13:41:53.754 INFO:tasks.workunit.client.1.smithi110.stdout:0/122: unlink d1/d11/f17 0 2024-04-12T13:41:53.757 INFO:tasks.workunit.client.1.smithi110.stdout:2/156: creat d6/d18/f29 x:0 0 0 2024-04-12T13:41:53.757 INFO:tasks.workunit.client.1.smithi110.stdout:8/132: unlink d1/d7/fb 0 2024-04-12T13:41:53.758 INFO:tasks.workunit.client.1.smithi110.stdout:1/111: dread f2 [0,4194304] 0 2024-04-12T13:41:53.759 INFO:tasks.workunit.client.1.smithi110.stdout:7/130: creat d1/d3/d4/f2d x:0 0 0 2024-04-12T13:41:53.760 INFO:tasks.workunit.client.1.smithi110.stdout:7/131: fsync d1/f23 0 2024-04-12T13:41:53.765 INFO:tasks.workunit.client.1.smithi110.stdout:6/202: rmdir d7/d25/d30 39 2024-04-12T13:41:53.768 INFO:tasks.workunit.client.1.smithi110.stdout:1/112: chown de/d14/l24 1 1 2024-04-12T13:41:53.769 INFO:tasks.workunit.client.1.smithi110.stdout:7/132: creat d1/d3/d4/f2e x:0 0 0 2024-04-12T13:41:53.769 INFO:tasks.workunit.client.1.smithi110.stdout:1/113: fdatasync fb 0 2024-04-12T13:41:53.770 INFO:tasks.workunit.client.1.smithi110.stdout:8/133: dread d1/f19 [0,4194304] 0 2024-04-12T13:41:53.770 INFO:tasks.workunit.client.1.smithi110.stdout:2/157: write d6/f8 [917764,56398] 0 2024-04-12T13:41:53.774 INFO:tasks.workunit.client.1.smithi110.stdout:6/203: write d7/d10/f35 [3949937,2271] 0 2024-04-12T13:41:53.775 INFO:tasks.workunit.client.1.smithi110.stdout:1/114: symlink de/d15/l2b 0 2024-04-12T13:41:53.777 INFO:tasks.workunit.client.1.smithi110.stdout:8/134: creat d1/d3/f24 x:0 0 0 2024-04-12T13:41:53.778 INFO:tasks.workunit.client.1.smithi110.stdout:1/115: chown f2 76038 1 2024-04-12T13:41:53.779 INFO:tasks.workunit.client.1.smithi110.stdout:0/123: truncate d1/f7 505134 0 2024-04-12T13:41:53.779 INFO:tasks.workunit.client.1.smithi110.stdout:7/133: rename d1/l19 to d1/d3/d22/l2f 0 2024-04-12T13:41:53.779 INFO:tasks.workunit.client.1.smithi110.stdout:3/140: dwrite d5/dc/f27 [0,4194304] 0 2024-04-12T13:41:53.790 INFO:tasks.workunit.client.1.smithi110.stdout:8/135: chown d1/d5/dd/d23 2 1 2024-04-12T13:41:53.791 INFO:tasks.workunit.client.1.smithi110.stdout:9/214: dwrite df/d13/d26/f32 [4194304,4194304] 0 2024-04-12T13:41:53.804 INFO:tasks.workunit.client.1.smithi110.stdout:1/116: symlink de/d15/l2c 0 2024-04-12T13:41:53.812 INFO:tasks.workunit.client.1.smithi110.stdout:0/124: dread d1/d8/f10 [0,4194304] 0 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 -- 172.21.15.60:0/4135108467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c0ff000 msgr2=0x7fcb4c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 --2- 172.21.15.60:0/4135108467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c0ff410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb40004940 tx=0x7fcb40009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 -- 172.21.15.60:0/4135108467 shutdown_connections 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 --2- 172.21.15.60:0/4135108467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 --2- 172.21.15.60:0/4135108467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c0ff410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 -- 172.21.15.60:0/4135108467 >> 172.21.15.60:0/4135108467 conn(0x7fcb4c0fa950 msgr2=0x7fcb4c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.812+0000 7fcb53c00700 1 -- 172.21.15.60:0/4135108467 shutdown_connections 2024-04-12T13:41:53.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.813+0000 7fcb53c00700 1 -- 172.21.15.60:0/4135108467 wait complete. 2024-04-12T13:41:53.815 INFO:tasks.workunit.client.1.smithi110.stdout:3/141: dwrite d5/dc/f11 [0,4194304] 0 2024-04-12T13:41:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.814+0000 7fcb53c00700 1 Processor -- start 2024-04-12T13:41:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.814+0000 7fcb53c00700 1 -- start start 2024-04-12T13:41:53.816 INFO:tasks.workunit.client.1.smithi110.stdout:6/204: dwrite d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.814+0000 7fcb53c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb53c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb53c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c110700 con 0x7fcb4c1002b0 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb53c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c110f50 con 0x7fcb4c0ff000 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37562/0 (socket says 172.21.15.60:37562) 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 -- 172.21.15.60:0/3213760044 learned_addr learned my addr 172.21.15.60:0/3213760044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb51200700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 -- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0ff000 msgr2=0x7fcb4c10fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c10fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.815+0000 7fcb4be00700 1 -- 172.21.15.60:0/3213760044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40005040 con 0x7fcb4c1002b0 2024-04-12T13:41:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.816+0000 7fcb4be00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcb38002a80 tx=0x7fcb380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:53.818 INFO:tasks.workunit.client.1.smithi110.stdout:3/142: write d5/dc/f12 [520817,111648] 0 2024-04-12T13:41:53.836 INFO:tasks.workunit.client.1.smithi110.stdout:4/212: sync 2024-04-12T13:41:53.869 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:53 smithi060 ceph-mon[29097]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:53.869 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:53 smithi060 ceph-mon[29097]: pgmap v21: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 8.5 MiB/s wr, 177 op/s 2024-04-12T13:41:53.872 INFO:tasks.workunit.client.0.smithi060.stdout:1/148: mkdir d1e/d29/d37 0 2024-04-12T13:41:53.875 INFO:tasks.workunit.client.0.smithi060.stdout:6/241: dread - d1/d7/da/dc/d3a/f4b zero size 2024-04-12T13:41:53.875 INFO:tasks.workunit.client.0.smithi060.stdout:3/153: rmdir d7/da/dd 39 2024-04-12T13:41:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.875+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38007cc0 con 0x7fcb4c1002b0 2024-04-12T13:41:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.875+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb3800f040 con 0x7fcb4c1002b0 2024-04-12T13:41:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.875+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3800dac0 con 0x7fcb4c1002b0 2024-04-12T13:41:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.875+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c111230 con 0x7fcb4c1002b0 2024-04-12T13:41:53.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.875+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c111770 con 0x7fcb4c1002b0 2024-04-12T13:41:53.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/175: symlink d0/l3f 0 2024-04-12T13:41:53.878 INFO:tasks.workunit.client.0.smithi060.stdout:2/153: getdents d6/d10 0 2024-04-12T13:41:53.878 INFO:tasks.workunit.client.0.smithi060.stdout:8/165: mkdir d9/d1b/d37 0 2024-04-12T13:41:53.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.877+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c05f5f0 con 0x7fcb4c1002b0 2024-04-12T13:41:53.879 INFO:tasks.workunit.client.1.smithi110.stdout:7/134: write d1/f1e [935739,76500] 0 2024-04-12T13:41:53.880 INFO:tasks.workunit.client.1.smithi110.stdout:9/215: mkdir df/d13/d2c/d2d/d39/d3a/d4e 0 2024-04-12T13:41:53.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.881+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fcb3800dc20 con 0x7fcb4c1002b0 2024-04-12T13:41:53.883 INFO:tasks.workunit.client.1.smithi110.stdout:9/216: chown df/d13/d26/f32 506 1 2024-04-12T13:41:53.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.883+0000 7fcb48c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 0x7fcb3406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:53.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.883+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcb3808ab00 con 0x7fcb4c1002b0 2024-04-12T13:41:53.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.884+0000 7fcb51200700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 0x7fcb3406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:53.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.886+0000 7fcb51200700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 0x7fcb3406e260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000b3b0 tx=0x7fcb40009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:53.889 INFO:tasks.workunit.client.0.smithi060.stdout:2/154: write d6/f1b [463569,99125] 0 2024-04-12T13:41:53.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:53.887+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fcb38057ce0 con 0x7fcb4c1002b0 2024-04-12T13:41:53.891 INFO:tasks.workunit.client.0.smithi060.stdout:4/177: dwrite d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:41:53.892 INFO:tasks.workunit.client.1.smithi110.stdout:1/117: creat de/d1d/f2d x:0 0 0 2024-04-12T13:41:53.896 INFO:tasks.workunit.client.0.smithi060.stdout:7/176: creat d0/d3d/f40 x:0 0 0 2024-04-12T13:41:53.898 INFO:tasks.workunit.client.1.smithi110.stdout:6/205: fdatasync d7/d25/d2c/f3c 0 2024-04-12T13:41:53.898 INFO:tasks.workunit.client.0.smithi060.stdout:3/154: write d7/f8 [11260856,39538] 0 2024-04-12T13:41:53.901 INFO:tasks.workunit.client.0.smithi060.stdout:8/166: mknod d9/d1d/c38 0 2024-04-12T13:41:53.903 INFO:tasks.workunit.client.0.smithi060.stdout:9/111: getdents d4/d9 0 2024-04-12T13:41:53.906 INFO:tasks.workunit.client.1.smithi110.stdout:8/136: creat d1/d5/d1f/f25 x:0 0 0 2024-04-12T13:41:53.908 INFO:tasks.workunit.client.0.smithi060.stdout:2/155: dread d6/f9 [0,4194304] 0 2024-04-12T13:41:53.908 INFO:tasks.workunit.client.1.smithi110.stdout:6/206: dread d7/d10/d1c/f29 [0,4194304] 0 2024-04-12T13:41:53.909 INFO:tasks.workunit.client.0.smithi060.stdout:5/195: dread d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:41:53.909 INFO:tasks.workunit.client.1.smithi110.stdout:7/135: rmdir d1/d3/d22 39 2024-04-12T13:41:53.911 INFO:tasks.workunit.client.1.smithi110.stdout:9/217: mkdir df/d13/d2c/d2d/d39/d4f 0 2024-04-12T13:41:53.911 INFO:tasks.workunit.client.0.smithi060.stdout:6/242: rename d1/d7/da/dc/d24/c18 to d1/d7/da/dc/d24/d30/d52/c56 0 2024-04-12T13:41:53.912 INFO:tasks.workunit.client.1.smithi110.stdout:9/218: fdatasync df/d13/d26/f28 0 2024-04-12T13:41:53.913 INFO:tasks.workunit.client.1.smithi110.stdout:9/219: stat df/f34 0 2024-04-12T13:41:53.914 INFO:tasks.workunit.client.0.smithi060.stdout:6/243: write d1/d7/da/dc/d3a/f4b [953977,87415] 0 2024-04-12T13:41:53.915 INFO:tasks.workunit.client.1.smithi110.stdout:1/118: mknod de/d14/c2e 0 2024-04-12T13:41:53.915 INFO:tasks.workunit.client.1.smithi110.stdout:9/220: write df/f34 [651142,84993] 0 2024-04-12T13:41:53.917 INFO:tasks.workunit.client.1.smithi110.stdout:9/221: read df/f24 [2388719,31158] 0 2024-04-12T13:41:53.917 INFO:tasks.workunit.client.1.smithi110.stdout:1/119: truncate de/d15/f21 828727 0 2024-04-12T13:41:53.918 INFO:tasks.workunit.client.0.smithi060.stdout:6/244: write d1/d7/da/dc/f3b [967228,130093] 0 2024-04-12T13:41:53.918 INFO:tasks.workunit.client.0.smithi060.stdout:4/178: symlink d6/d7/dd/df/l3f 0 2024-04-12T13:41:53.923 INFO:tasks.workunit.client.0.smithi060.stdout:8/167: dwrite d9/d1d/d2f/f30 [4194304,4194304] 0 2024-04-12T13:41:53.924 INFO:tasks.workunit.client.1.smithi110.stdout:1/120: dread de/d1d/f28 [0,4194304] 0 2024-04-12T13:41:53.930 INFO:tasks.workunit.client.1.smithi110.stdout:9/222: dread fc [0,4194304] 0 2024-04-12T13:41:53.930 INFO:tasks.workunit.client.0.smithi060.stdout:1/149: truncate d1e/f31 2933719 0 2024-04-12T13:41:53.932 INFO:tasks.workunit.client.0.smithi060.stdout:1/150: chown d1e/f33 911659 1 2024-04-12T13:41:53.932 INFO:tasks.workunit.client.0.smithi060.stdout:5/196: fsync d6/d10/d12/d15/f3a 0 2024-04-12T13:41:53.933 INFO:tasks.workunit.client.1.smithi110.stdout:9/223: write df/d13/d26/f32 [6996578,54803] 0 2024-04-12T13:41:53.933 INFO:tasks.workunit.client.1.smithi110.stdout:7/136: creat d1/d3/d4/f30 x:0 0 0 2024-04-12T13:41:53.933 INFO:tasks.workunit.client.0.smithi060.stdout:1/151: fdatasync d1e/d1f/f22 0 2024-04-12T13:41:53.935 INFO:tasks.workunit.client.1.smithi110.stdout:3/143: truncate d5/dc/f11 1724954 0 2024-04-12T13:41:53.939 INFO:tasks.workunit.client.0.smithi060.stdout:6/245: creat d1/f57 x:0 0 0 2024-04-12T13:41:53.941 INFO:tasks.workunit.client.0.smithi060.stdout:6/246: chown d1/d7/da/dc/d24/d2d/f3d 30266 1 2024-04-12T13:41:53.941 INFO:tasks.workunit.client.0.smithi060.stdout:4/179: mknod d6/d7/db/c40 0 2024-04-12T13:41:53.943 INFO:tasks.workunit.client.0.smithi060.stdout:6/247: fdatasync d1/d7/da/dc/d24/f37 0 2024-04-12T13:41:53.944 INFO:tasks.workunit.client.1.smithi110.stdout:4/213: link d0/l41 d0/d19/l44 0 2024-04-12T13:41:53.945 INFO:tasks.workunit.client.1.smithi110.stdout:4/214: dread - d0/d19/d1c/f25 zero size 2024-04-12T13:41:53.949 INFO:tasks.workunit.client.1.smithi110.stdout:1/121: creat de/f2f x:0 0 0 2024-04-12T13:41:53.955 INFO:tasks.workunit.client.0.smithi060.stdout:5/197: creat d6/d10/d12/d38/f40 x:0 0 0 2024-04-12T13:41:53.958 INFO:tasks.workunit.client.0.smithi060.stdout:1/152: rename d1e/f2c to d1e/f38 0 2024-04-12T13:41:53.960 INFO:tasks.workunit.client.0.smithi060.stdout:2/156: creat d6/d13/d17/d21/f2d x:0 0 0 2024-04-12T13:41:53.962 INFO:tasks.workunit.client.1.smithi110.stdout:9/224: unlink f7 0 2024-04-12T13:41:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:4/180: creat d6/d21/f41 x:0 0 0 2024-04-12T13:41:53.966 INFO:tasks.workunit.client.1.smithi110.stdout:7/137: unlink d1/fd 0 2024-04-12T13:41:53.966 INFO:tasks.workunit.client.1.smithi110.stdout:7/138: fdatasync d1/f23 0 2024-04-12T13:41:53.968 INFO:tasks.workunit.client.0.smithi060.stdout:7/177: creat d0/d7/f41 x:0 0 0 2024-04-12T13:41:53.969 INFO:tasks.workunit.client.1.smithi110.stdout:3/144: mkdir d5/dc/d31 0 2024-04-12T13:41:53.971 INFO:tasks.workunit.client.0.smithi060.stdout:9/112: write d4/d9/d19/f1a [2957481,31181] 0 2024-04-12T13:41:53.973 INFO:tasks.workunit.client.0.smithi060.stdout:6/248: mknod d1/c58 0 2024-04-12T13:41:53.974 INFO:tasks.workunit.client.1.smithi110.stdout:9/225: dread fc [0,4194304] 0 2024-04-12T13:41:53.974 INFO:tasks.workunit.client.0.smithi060.stdout:3/155: dwrite d7/d17/f1a [0,4194304] 0 2024-04-12T13:41:53.974 INFO:tasks.workunit.client.0.smithi060.stdout:9/113: fsync f2 0 2024-04-12T13:41:53.975 INFO:tasks.workunit.client.1.smithi110.stdout:4/215: symlink d0/d19/d26/l45 0 2024-04-12T13:41:53.976 INFO:tasks.workunit.client.1.smithi110.stdout:8/137: link d1/l11 d1/d7/d20/l26 0 2024-04-12T13:41:53.977 INFO:tasks.workunit.client.1.smithi110.stdout:4/216: write d0/de/f24 [292965,55925] 0 2024-04-12T13:41:53.978 INFO:tasks.workunit.client.0.smithi060.stdout:8/168: creat d9/d1b/d37/f39 x:0 0 0 2024-04-12T13:41:53.979 INFO:tasks.workunit.client.1.smithi110.stdout:5/108: sync 2024-04-12T13:41:53.979 INFO:tasks.workunit.client.1.smithi110.stdout:6/207: creat d7/d25/d30/d44/d3d/f47 x:0 0 0 2024-04-12T13:41:53.981 INFO:tasks.workunit.client.0.smithi060.stdout:1/153: dwrite d1e/f28 [0,4194304] 0 2024-04-12T13:41:53.982 INFO:tasks.workunit.client.0.smithi060.stdout:8/169: stat d9/d1b/f1e 0 2024-04-12T13:41:53.983 INFO:tasks.workunit.client.1.smithi110.stdout:6/208: chown d7/d25/d30/d44/c14 12 1 2024-04-12T13:41:53.983 INFO:tasks.workunit.client.0.smithi060.stdout:5/198: rename d6/d10/d12/d3e to d6/dd/d1f/d32/d41 0 2024-04-12T13:41:53.984 INFO:tasks.workunit.client.0.smithi060.stdout:1/154: dread - f14 zero size 2024-04-12T13:41:53.985 INFO:tasks.workunit.client.1.smithi110.stdout:6/209: fsync d7/d10/d1c/f28 0 2024-04-12T13:41:53.987 INFO:tasks.workunit.client.1.smithi110.stdout:6/210: chown d7/d10/f35 7449197 1 2024-04-12T13:41:53.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/181: unlink d6/d2f/c36 0 2024-04-12T13:41:53.989 INFO:tasks.workunit.client.1.smithi110.stdout:6/211: fdatasync d7/d10/d1c/f27 0 2024-04-12T13:41:53.999 INFO:tasks.workunit.client.1.smithi110.stdout:9/226: read fd [644675,80591] 0 2024-04-12T13:41:54.001 INFO:tasks.workunit.client.1.smithi110.stdout:9/227: write df/f2e [217562,82025] 0 2024-04-12T13:41:54.005 INFO:tasks.workunit.client.0.smithi060.stdout:3/156: dread d7/d17/f1a [0,4194304] 0 2024-04-12T13:41:54.007 INFO:tasks.workunit.client.1.smithi110.stdout:8/138: rename d1/f19 to d1/d5/dd/f27 0 2024-04-12T13:41:54.008 INFO:tasks.workunit.client.1.smithi110.stdout:8/139: dread - d1/d3/f24 zero size 2024-04-12T13:41:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:1/155: dread f13 [0,4194304] 0 2024-04-12T13:41:54.012 INFO:tasks.workunit.client.1.smithi110.stdout:5/109: fsync da/db/d15/d17/f1e 0 2024-04-12T13:41:54.012 INFO:tasks.workunit.client.0.smithi060.stdout:8/170: write d9/f1f [4972865,78305] 0 2024-04-12T13:41:54.017 INFO:tasks.workunit.client.0.smithi060.stdout:6/249: rename d1/d7/da/d39 to d1/d7/da/dc/d24/d34/d51/d59 0 2024-04-12T13:41:54.018 INFO:tasks.workunit.client.0.smithi060.stdout:7/178: rmdir d0 39 2024-04-12T13:41:54.019 INFO:tasks.workunit.client.0.smithi060.stdout:4/182: dwrite d6/d7/dd/d1a/d19/f1f [4194304,4194304] 0 2024-04-12T13:41:54.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/199: mkdir d6/dd/d1f/d25/d42 0 2024-04-12T13:41:54.021 INFO:tasks.workunit.client.0.smithi060.stdout:4/183: readlink d6/d7/dd/l34 0 2024-04-12T13:41:54.028 INFO:tasks.workunit.client.1.smithi110.stdout:7/139: truncate d1/d3/f11 348340 0 2024-04-12T13:41:54.029 INFO:tasks.workunit.client.1.smithi110.stdout:1/122: link de/f1b de/f30 0 2024-04-12T13:41:54.032 INFO:tasks.workunit.client.1.smithi110.stdout:4/217: dread d0/f15 [0,4194304] 0 2024-04-12T13:41:54.033 INFO:tasks.workunit.client.1.smithi110.stdout:9/228: symlink df/d13/d2c/l50 0 2024-04-12T13:41:54.035 INFO:tasks.workunit.client.1.smithi110.stdout:4/218: read d0/d13/f21 [506038,98762] 0 2024-04-12T13:41:54.035 INFO:tasks.workunit.client.0.smithi060.stdout:8/171: chown d9/c31 79 1 2024-04-12T13:41:54.037 INFO:tasks.workunit.client.0.smithi060.stdout:8/172: fsync d9/d1d/d2f/f30 0 2024-04-12T13:41:54.038 INFO:tasks.workunit.client.1.smithi110.stdout:4/219: write d0/de/d2c/f3d [105300,66017] 0 2024-04-12T13:41:54.039 INFO:tasks.workunit.client.1.smithi110.stdout:4/220: readlink d0/de/d2c/l33 0 2024-04-12T13:41:54.042 INFO:tasks.workunit.client.1.smithi110.stdout:5/110: fdatasync f9 0 2024-04-12T13:41:54.042 INFO:tasks.workunit.client.1.smithi110.stdout:2/158: sync 2024-04-12T13:41:54.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/250: creat d1/d7/da/dc/d24/d2d/f5a x:0 0 0 2024-04-12T13:41:54.046 INFO:tasks.workunit.client.0.smithi060.stdout:5/200: creat d6/d10/d12/f43 x:0 0 0 2024-04-12T13:41:54.048 INFO:tasks.workunit.client.0.smithi060.stdout:6/251: fsync d1/d7/da/dc/d3a/f4b 0 2024-04-12T13:41:54.048 INFO:tasks.workunit.client.0.smithi060.stdout:5/201: chown d6/dd/l2f 83 1 2024-04-12T13:41:54.049 INFO:tasks.workunit.client.0.smithi060.stdout:4/184: mkdir d6/d7/dd/d1a/d19/d42 0 2024-04-12T13:41:54.051 INFO:tasks.workunit.client.0.smithi060.stdout:5/202: readlink d6/dd/d27/l33 0 2024-04-12T13:41:54.052 INFO:tasks.workunit.client.1.smithi110.stdout:1/123: unlink de/d1d/f2d 0 2024-04-12T13:41:54.052 INFO:tasks.workunit.client.0.smithi060.stdout:9/114: dwrite d4/d9/fc [0,4194304] 0 2024-04-12T13:41:54.053 INFO:tasks.workunit.client.1.smithi110.stdout:1/124: read f6 [2645540,64730] 0 2024-04-12T13:41:54.053 INFO:tasks.workunit.client.0.smithi060.stdout:3/157: symlink d7/da/l2e 0 2024-04-12T13:41:54.054 INFO:tasks.workunit.client.1.smithi110.stdout:4/221: dwrite d0/d19/f23 [0,4194304] 0 2024-04-12T13:41:54.054 INFO:tasks.workunit.client.0.smithi060.stdout:4/185: write d6/d7/dd/d1a/d19/f33 [174864,50851] 0 2024-04-12T13:41:54.056 INFO:tasks.workunit.client.1.smithi110.stdout:4/222: dread - d0/d19/d1c/f25 zero size 2024-04-12T13:41:54.056 INFO:tasks.workunit.client.1.smithi110.stdout:6/212: write d7/d10/d1c/f29 [1520060,73417] 0 2024-04-12T13:41:54.058 INFO:tasks.workunit.client.1.smithi110.stdout:9/229: creat df/d13/d2c/d2d/f51 x:0 0 0 2024-04-12T13:41:54.070 INFO:tasks.workunit.client.1.smithi110.stdout:2/159: fsync d6/f11 0 2024-04-12T13:41:54.076 INFO:tasks.workunit.client.0.smithi060.stdout:9/115: dwrite d4/d9/d19/f1a [0,4194304] 0 2024-04-12T13:41:54.078 INFO:tasks.workunit.client.0.smithi060.stdout:7/179: fsync d0/f21 0 2024-04-12T13:41:54.089 INFO:tasks.workunit.client.0.smithi060.stdout:6/252: symlink d1/d7/da/d20/l5b 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:8/173: write d9/da/f24 [3201970,107127] 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:5/203: creat d6/dd/d27/f44 x:0 0 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:3/158: read d7/da/dd/f12 [1059907,84078] 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:1/156: rmdir d1e/d23/d2e/d30/d34 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:1/157: write f1c [353813,112619] 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:9/116: dread d4/d8/f17 [0,4194304] 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:9/117: readlink l3 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:6/253: symlink d1/d7/da/l5c 0 2024-04-12T13:41:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:8/174: creat d9/d1b/d37/f3a x:0 0 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:8/175: truncate d9/d1d/f33 166011 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:5/204: write d6/f8 [2988432,118612] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:4/186: mknod d6/d7/dd/d1a/d19/d42/c43 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:5/205: read f1 [854752,81587] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:1/158: stat l1a 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:9/118: dread d4/d8/fb [0,4194304] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:3/159: symlink d7/d17/d27/l2f 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:4/187: dread d6/d7/dd/df/f37 [0,4194304] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:3/160: stat d7/da/dd/f12 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:8/176: write d9/d1b/f19 [807077,55798] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:3/161: stat d7/d17/f20 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:1/159: rename f19 to d1e/d23/d2e/f39 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:5/206: creat d6/dd/f45 x:0 0 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:3/162: write d7/da/dd/f12 [2585334,98586] 0 2024-04-12T13:41:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:9/119: dread d4/d9/fc [0,4194304] 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.0.smithi060.stdout:9/120: write d4/fd [334685,100704] 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.0.smithi060.stdout:4/188: dread d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.0.smithi060.stdout:9/121: truncate d4/d9/d19/d21/f1c 1456655 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:1/125: creat de/d15/f31 x:0 0 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:0/125: sync 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:3/145: sync 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:3/146: readlink d5/dc/d20/d2b/l2c 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:4/223: creat d0/d19/d26/f46 x:0 0 0 2024-04-12T13:41:54.167 INFO:tasks.workunit.client.1.smithi110.stdout:8/140: creat d1/d5/f28 x:0 0 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:4/224: dread d0/de/f24 [0,4194304] 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:6/213: unlink d7/d25/d30/d44/f1f 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:5/111: mkdir da/db/d15/d27 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:1/126: mkdir de/d15/d32 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:9/230: creat df/d38/f52 x:0 0 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/141: symlink d1/l29 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:4/225: mknod d0/de/d32/c47 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/142: chown d1/d5/dd/d23 5710 1 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:6/214: mkdir d7/d10/d1c/d2b/d48 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:2/160: getdents d6/d18/d20 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:7/140: dwrite d1/f18 [0,4194304] 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/143: truncate d1/d5/f28 836010 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:6/215: write d7/d25/d30/d44/f33 [2740341,43977] 0 2024-04-12T13:41:54.168 INFO:tasks.workunit.client.1.smithi110.stdout:6/216: truncate d7/d10/d1c/f29 2432146 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/144: fsync d1/d3/f24 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:1/127: dread de/f30 [0,4194304] 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:6/217: dread - d7/d25/d2c/f3c zero size 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/145: chown d1/d3/c1b 64546 1 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:6/218: chown d7/d10/d1c/d2b/d3a 93873137 1 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/146: write d1/d5/d1f/f25 [255470,80137] 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:4/226: mknod d0/de/d2c/c48 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:2/161: rename d6/fb to d6/dc/d1b/f2a 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:4/227: fdatasync d0/d19/f20 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:0/126: creat d1/f2c x:0 0 0 2024-04-12T13:41:54.169 INFO:tasks.workunit.client.1.smithi110.stdout:9/231: dwrite df/d13/d26/f45 [0,4194304] 0 2024-04-12T13:41:54.170 INFO:tasks.workunit.client.0.smithi060.stdout:7/180: link d0/c14 d0/c42 0 2024-04-12T13:41:54.170 INFO:tasks.workunit.client.1.smithi110.stdout:6/219: fdatasync d7/d25/d30/d44/f1d 0 2024-04-12T13:41:54.171 INFO:tasks.workunit.client.1.smithi110.stdout:7/141: getdents d1/d1b 0 2024-04-12T13:41:54.171 INFO:tasks.workunit.client.0.smithi060.stdout:6/254: creat d1/d7/f5d x:0 0 0 2024-04-12T13:41:54.171 INFO:tasks.workunit.client.0.smithi060.stdout:4/189: read d6/d7/dd/fe [2710511,74361] 0 2024-04-12T13:41:54.172 INFO:tasks.workunit.client.1.smithi110.stdout:7/142: truncate d1/f2a 940333 0 2024-04-12T13:41:54.174 INFO:tasks.workunit.client.1.smithi110.stdout:7/143: truncate d1/d3/d4/f2d 997705 0 2024-04-12T13:41:54.179 INFO:tasks.workunit.client.1.smithi110.stdout:2/162: unlink d6/dc/dd/lf 0 2024-04-12T13:41:54.181 INFO:tasks.workunit.client.1.smithi110.stdout:5/112: write da/db/f1d [122534,454] 0 2024-04-12T13:41:54.183 INFO:tasks.workunit.client.1.smithi110.stdout:3/147: truncate d5/f1f 271733 0 2024-04-12T13:41:54.185 INFO:tasks.workunit.client.1.smithi110.stdout:0/127: dread - d1/d11/f2b zero size 2024-04-12T13:41:54.186 INFO:tasks.workunit.client.1.smithi110.stdout:3/148: write d5/dc/fd [4937640,42118] 0 2024-04-12T13:41:54.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:53 smithi060 ceph-mon[29097]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:54.186 INFO:tasks.workunit.client.0.smithi060.stdout:5/207: dwrite d6/d10/d12/d38/f3c [0,4194304] 0 2024-04-12T13:41:54.187 INFO:tasks.workunit.client.1.smithi110.stdout:3/149: fsync d5/dc/f24 0 2024-04-12T13:41:54.190 INFO:tasks.workunit.client.0.smithi060.stdout:9/122: dwrite d4/f1f [0,4194304] 0 2024-04-12T13:41:54.190 INFO:tasks.workunit.client.1.smithi110.stdout:4/228: unlink d0/l2f 0 2024-04-12T13:41:54.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/163: dread d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:41:54.195 INFO:tasks.workunit.client.0.smithi060.stdout:8/177: dwrite d9/fc [0,4194304] 0 2024-04-12T13:41:54.198 INFO:tasks.workunit.client.1.smithi110.stdout:3/150: dread d5/dc/fd [0,4194304] 0 2024-04-12T13:41:54.201 INFO:tasks.workunit.client.0.smithi060.stdout:3/164: fdatasync d7/da/dd/f12 0 2024-04-12T13:41:54.207 INFO:tasks.workunit.client.1.smithi110.stdout:9/232: creat df/d13/d2c/f53 x:0 0 0 2024-04-12T13:41:54.208 INFO:tasks.workunit.client.0.smithi060.stdout:1/160: dwrite d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:54.209 INFO:tasks.workunit.client.1.smithi110.stdout:9/233: fsync df/d13/d2c/d2d/f51 0 2024-04-12T13:41:54.210 INFO:tasks.workunit.client.0.smithi060.stdout:6/255: dwrite d1/d7/da/dc/d24/d34/d51/d59/f4d [0,4194304] 0 2024-04-12T13:41:54.213 INFO:tasks.workunit.client.0.smithi060.stdout:5/208: mkdir d6/dd/d1f/d32/d46 0 2024-04-12T13:41:54.215 INFO:tasks.workunit.client.0.smithi060.stdout:1/161: truncate d1e/f2d 705084 0 2024-04-12T13:41:54.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/209: stat d6/dd/d27/f2d 0 2024-04-12T13:41:54.219 INFO:tasks.workunit.client.0.smithi060.stdout:9/123: unlink d4/f18 0 2024-04-12T13:41:54.220 INFO:tasks.workunit.client.0.smithi060.stdout:7/181: mkdir d0/d7/d43 0 2024-04-12T13:41:54.226 INFO:tasks.workunit.client.1.smithi110.stdout:9/234: dread df/f34 [0,4194304] 0 2024-04-12T13:41:54.226 INFO:tasks.workunit.client.1.smithi110.stdout:7/144: dread - d1/d3/d22/f25 zero size 2024-04-12T13:41:54.227 INFO:tasks.workunit.client.1.smithi110.stdout:1/128: dwrite de/f30 [0,4194304] 0 2024-04-12T13:41:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:53 smithi110 ceph-mon[36055]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:53 smithi110 ceph-mon[36055]: pgmap v21: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 368 KiB/s rd, 8.5 MiB/s wr, 177 op/s 2024-04-12T13:41:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:53 smithi110 ceph-mon[36055]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:54.229 INFO:tasks.workunit.client.1.smithi110.stdout:7/145: dread - d1/d3/d4/f27 zero size 2024-04-12T13:41:54.230 INFO:tasks.workunit.client.1.smithi110.stdout:1/129: read de/f1b [4024717,103514] 0 2024-04-12T13:41:54.231 INFO:tasks.workunit.client.1.smithi110.stdout:1/130: dread - de/f22 zero size 2024-04-12T13:41:54.231 INFO:tasks.workunit.client.1.smithi110.stdout:2/163: chown d6/dc/dd/f1f 0 1 2024-04-12T13:41:54.234 INFO:tasks.workunit.client.1.smithi110.stdout:1/131: chown de/l13 151270 1 2024-04-12T13:41:54.234 INFO:tasks.workunit.client.0.smithi060.stdout:1/162: dread d1e/f2d [0,4194304] 0 2024-04-12T13:41:54.235 INFO:tasks.workunit.client.1.smithi110.stdout:1/132: chown de/l20 455161860 1 2024-04-12T13:41:54.238 INFO:tasks.workunit.client.1.smithi110.stdout:1/133: truncate de/d15/f31 1046316 0 2024-04-12T13:41:54.241 INFO:tasks.workunit.client.0.smithi060.stdout:5/210: dread d6/d10/d12/d38/f3c [0,4194304] 0 2024-04-12T13:41:54.244 INFO:tasks.workunit.client.0.smithi060.stdout:3/165: creat d7/d17/d27/f30 x:0 0 0 2024-04-12T13:41:54.246 INFO:tasks.workunit.client.0.smithi060.stdout:1/163: dread d1e/d23/d2e/f39 [0,4194304] 0 2024-04-12T13:41:54.246 INFO:tasks.workunit.client.1.smithi110.stdout:2/164: dwrite d6/dc/dd/f16 [0,4194304] 0 2024-04-12T13:41:54.247 INFO:tasks.workunit.client.0.smithi060.stdout:1/164: stat d1e/d23/d2e 0 2024-04-12T13:41:54.253 INFO:tasks.workunit.client.1.smithi110.stdout:4/229: mknod d0/d19/d26/c49 0 2024-04-12T13:41:54.254 INFO:tasks.workunit.client.0.smithi060.stdout:0/175: sync 2024-04-12T13:41:54.258 INFO:tasks.workunit.client.0.smithi060.stdout:0/176: dread - d7/d9/d14/d35/f39 zero size 2024-04-12T13:41:54.259 INFO:tasks.workunit.client.1.smithi110.stdout:0/128: dwrite d1/f14 [4194304,4194304] 0 2024-04-12T13:41:54.259 INFO:tasks.workunit.client.0.smithi060.stdout:9/124: mknod d4/d9/d19/d21/c26 0 2024-04-12T13:41:54.260 INFO:tasks.workunit.client.0.smithi060.stdout:7/182: write d0/d7/f10 [319683,124359] 0 2024-04-12T13:41:54.263 INFO:tasks.workunit.client.1.smithi110.stdout:9/235: rename df/d13/d26/d37/d4c to df/d13/d2c/d2d/d39/d54 0 2024-04-12T13:41:54.267 INFO:tasks.workunit.client.1.smithi110.stdout:7/146: mkdir d1/d31 0 2024-04-12T13:41:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:5/211: creat d6/d10/d12/d38/f47 x:0 0 0 2024-04-12T13:41:54.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/166: creat d7/d17/d19/f31 x:0 0 0 2024-04-12T13:41:54.270 INFO:tasks.workunit.client.0.smithi060.stdout:4/190: rename d6/l38 to d6/l44 0 2024-04-12T13:41:54.270 INFO:tasks.workunit.client.1.smithi110.stdout:6/220: fdatasync d7/d10/d1c/f28 0 2024-04-12T13:41:54.275 INFO:tasks.workunit.client.0.smithi060.stdout:1/165: creat d1e/d23/d2e/f3a x:0 0 0 2024-04-12T13:41:54.278 INFO:tasks.workunit.client.1.smithi110.stdout:1/134: symlink de/d15/l33 0 2024-04-12T13:41:54.285 INFO:tasks.workunit.client.1.smithi110.stdout:2/165: creat d6/dc/f2b x:0 0 0 2024-04-12T13:41:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:8/178: creat d9/f3b x:0 0 0 2024-04-12T13:41:54.289 INFO:tasks.workunit.client.0.smithi060.stdout:6/256: dread d1/d7/da/dc/d3a/f49 [0,4194304] 0 2024-04-12T13:41:54.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/179: write d9/d1d/f33 [47137,108975] 0 2024-04-12T13:41:54.290 INFO:tasks.workunit.client.1.smithi110.stdout:1/135: dwrite fb [0,4194304] 0 2024-04-12T13:41:54.302 INFO:tasks.workunit.client.0.smithi060.stdout:5/212: mknod d6/dd/d1f/d25/d35/c48 0 2024-04-12T13:41:54.302 INFO:tasks.workunit.client.1.smithi110.stdout:8/147: getdents d1/d7 0 2024-04-12T13:41:54.302 INFO:tasks.workunit.client.1.smithi110.stdout:0/129: symlink d1/d11/l2d 0 2024-04-12T13:41:54.306 INFO:tasks.workunit.client.0.smithi060.stdout:1/166: symlink d1e/d29/l3b 0 2024-04-12T13:41:54.306 INFO:tasks.workunit.client.0.smithi060.stdout:9/125: write d4/d8/f17 [780467,91392] 0 2024-04-12T13:41:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:4/191: chown d6/l44 218 1 2024-04-12T13:41:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:0/177: mknod d7/d9/d14/c3d 0 2024-04-12T13:41:54.309 INFO:tasks.workunit.client.1.smithi110.stdout:4/230: rename d0/d19/d26/c49 to d0/de/d32/c4a 0 2024-04-12T13:41:54.311 INFO:tasks.workunit.client.1.smithi110.stdout:9/236: unlink df/d13/d2c/d2d/f51 0 2024-04-12T13:41:54.311 INFO:tasks.workunit.client.1.smithi110.stdout:4/231: chown d0/d19/l42 89648380 1 2024-04-12T13:41:54.313 INFO:tasks.workunit.client.1.smithi110.stdout:4/232: chown d0/d19/f2e 290607184 1 2024-04-12T13:41:54.314 INFO:tasks.workunit.client.0.smithi060.stdout:7/183: unlink d0/d7/f2c 0 2024-04-12T13:41:54.315 INFO:tasks.workunit.client.1.smithi110.stdout:4/233: fsync d0/d19/f2e 0 2024-04-12T13:41:54.315 INFO:tasks.workunit.client.1.smithi110.stdout:3/151: rmdir d5/d2f 0 2024-04-12T13:41:54.317 INFO:tasks.workunit.client.1.smithi110.stdout:3/152: dread - d5/f28 zero size 2024-04-12T13:41:54.318 INFO:tasks.workunit.client.1.smithi110.stdout:8/148: dwrite d1/d3/fe [4194304,4194304] 0 2024-04-12T13:41:54.319 INFO:tasks.workunit.client.0.smithi060.stdout:4/192: truncate d6/f2e 221270 0 2024-04-12T13:41:54.321 INFO:tasks.workunit.client.1.smithi110.stdout:6/221: read - d7/d25/d30/d44/d3d/f47 zero size 2024-04-12T13:41:54.326 INFO:tasks.workunit.client.0.smithi060.stdout:3/167: rename d7/d17/d27/l2f to d7/d17/l32 0 2024-04-12T13:41:54.327 INFO:tasks.workunit.client.0.smithi060.stdout:5/213: creat d6/dd/d1f/d25/f49 x:0 0 0 2024-04-12T13:41:54.329 INFO:tasks.workunit.client.1.smithi110.stdout:4/234: chown d0/d19/d1c/c43 158 1 2024-04-12T13:41:54.329 INFO:tasks.workunit.client.0.smithi060.stdout:7/184: symlink d0/d1b/l44 0 2024-04-12T13:41:54.330 INFO:tasks.workunit.client.1.smithi110.stdout:3/153: chown d5/l10 32545 1 2024-04-12T13:41:54.332 INFO:tasks.workunit.client.0.smithi060.stdout:6/257: dwrite d1/d7/da/d20/f4a [0,4194304] 0 2024-04-12T13:41:54.333 INFO:tasks.workunit.client.0.smithi060.stdout:1/167: link d1e/d23/c2a d1e/d1f/c3c 0 2024-04-12T13:41:54.337 INFO:tasks.workunit.client.0.smithi060.stdout:1/168: write d1e/f33 [957826,33944] 0 2024-04-12T13:41:54.340 INFO:tasks.workunit.client.0.smithi060.stdout:3/168: dread - d7/d17/d27/f30 zero size 2024-04-12T13:41:54.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/180: dwrite d9/f11 [0,4194304] 0 2024-04-12T13:41:54.343 INFO:tasks.workunit.client.0.smithi060.stdout:4/193: creat d6/d21/d29/f45 x:0 0 0 2024-04-12T13:41:54.343 INFO:tasks.workunit.client.1.smithi110.stdout:8/149: dwrite d1/d5/f28 [0,4194304] 0 2024-04-12T13:41:54.343 INFO:tasks.workunit.client.1.smithi110.stdout:9/237: dwrite df/d13/d26/f41 [0,4194304] 0 2024-04-12T13:41:54.345 INFO:tasks.workunit.client.1.smithi110.stdout:5/113: sync 2024-04-12T13:41:54.352 INFO:tasks.workunit.client.1.smithi110.stdout:1/136: truncate de/f30 386543 0 2024-04-12T13:41:54.357 INFO:tasks.workunit.client.0.smithi060.stdout:8/181: read - d9/d1b/d37/f3a zero size 2024-04-12T13:41:54.358 INFO:tasks.workunit.client.0.smithi060.stdout:3/169: dread - d7/d17/d19/f31 zero size 2024-04-12T13:41:54.361 INFO:tasks.workunit.client.1.smithi110.stdout:3/154: rename d5/dc/d20/d2b/d30 to d5/dc/d20/d2b/d32 0 2024-04-12T13:41:54.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/178: dwrite d7/d9/d14/d35/f39 [0,4194304] 0 2024-04-12T13:41:54.364 INFO:tasks.workunit.client.0.smithi060.stdout:4/194: truncate d6/d7/dd/d1a/d19/f33 1253166 0 2024-04-12T13:41:54.366 INFO:tasks.workunit.client.0.smithi060.stdout:2/157: sync 2024-04-12T13:41:54.367 INFO:tasks.workunit.client.0.smithi060.stdout:3/170: fsync d7/da/dd/f12 0 2024-04-12T13:41:54.368 INFO:tasks.workunit.client.0.smithi060.stdout:9/126: dread f2 [0,4194304] 0 2024-04-12T13:41:54.369 INFO:tasks.workunit.client.1.smithi110.stdout:8/150: mknod d1/d5/dd/c2a 0 2024-04-12T13:41:54.369 INFO:tasks.workunit.client.1.smithi110.stdout:2/166: dwrite d6/dc/d13/d1d/f26 [0,4194304] 0 2024-04-12T13:41:54.369 INFO:tasks.workunit.client.1.smithi110.stdout:0/130: dwrite d1/f22 [4194304,4194304] 0 2024-04-12T13:41:54.369 INFO:tasks.workunit.client.1.smithi110.stdout:7/147: sync 2024-04-12T13:41:54.373 INFO:tasks.workunit.client.1.smithi110.stdout:8/151: write d1/d7/f1d [1026043,70628] 0 2024-04-12T13:41:54.376 INFO:tasks.workunit.client.1.smithi110.stdout:1/137: mkdir de/d14/d34 0 2024-04-12T13:41:54.377 INFO:tasks.workunit.client.0.smithi060.stdout:6/258: mkdir d1/d7/da/dc/d24/d30/d52/d5e 0 2024-04-12T13:41:54.380 INFO:tasks.workunit.client.0.smithi060.stdout:0/179: chown d7/d9/d14/d1b/f32 1483 1 2024-04-12T13:41:54.383 INFO:tasks.workunit.client.1.smithi110.stdout:9/238: rename df/d38/f52 to df/d13/d26/d37/d49/f55 0 2024-04-12T13:41:54.383 INFO:tasks.workunit.client.1.smithi110.stdout:4/235: link d0/de/d2c/c38 d0/de/d32/c4b 0 2024-04-12T13:41:54.383 INFO:tasks.workunit.client.1.smithi110.stdout:6/222: dread d7/d25/d30/d44/f21 [0,4194304] 0 2024-04-12T13:41:54.385 INFO:tasks.workunit.client.1.smithi110.stdout:5/114: dwrite da/db/f14 [0,4194304] 0 2024-04-12T13:41:54.387 INFO:tasks.workunit.client.0.smithi060.stdout:5/214: mkdir d6/dd/d1f/d32/d46/d4a 0 2024-04-12T13:41:54.387 INFO:tasks.workunit.client.0.smithi060.stdout:8/182: mkdir d9/d1b/d3c 0 2024-04-12T13:41:54.390 INFO:tasks.workunit.client.1.smithi110.stdout:3/155: mkdir d5/dc/d33 0 2024-04-12T13:41:54.395 INFO:tasks.workunit.client.0.smithi060.stdout:7/185: creat d0/d7/f45 x:0 0 0 2024-04-12T13:41:54.399 INFO:tasks.workunit.client.0.smithi060.stdout:3/171: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:41:54.400 INFO:tasks.workunit.client.0.smithi060.stdout:1/169: rename c6 to d1e/d1f/c3d 0 2024-04-12T13:41:54.402 INFO:tasks.workunit.client.0.smithi060.stdout:8/183: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:41:54.405 INFO:tasks.workunit.client.1.smithi110.stdout:8/152: dread d1/d5/d1f/f25 [0,4194304] 0 2024-04-12T13:41:54.406 INFO:tasks.workunit.client.0.smithi060.stdout:7/186: read d0/f1c [294287,2492] 0 2024-04-12T13:41:54.410 INFO:tasks.workunit.client.0.smithi060.stdout:8/184: readlink d9/l2e 0 2024-04-12T13:41:54.410 INFO:tasks.workunit.client.1.smithi110.stdout:8/153: write d1/d3/fe [7689911,58883] 0 2024-04-12T13:41:54.410 INFO:tasks.workunit.client.1.smithi110.stdout:4/236: creat d0/de/f4c x:0 0 0 2024-04-12T13:41:54.411 INFO:tasks.workunit.client.1.smithi110.stdout:5/115: dwrite da/db/f14 [0,4194304] 0 2024-04-12T13:41:54.413 INFO:tasks.workunit.client.0.smithi060.stdout:4/195: mknod d6/d7/dd/d1a/d19/d42/c46 0 2024-04-12T13:41:54.413 INFO:tasks.workunit.client.1.smithi110.stdout:4/237: chown d0/d19/d26/l45 262 1 2024-04-12T13:41:54.414 INFO:tasks.workunit.client.1.smithi110.stdout:8/154: write d1/d3/f13 [3199345,100376] 0 2024-04-12T13:41:54.416 INFO:tasks.workunit.client.0.smithi060.stdout:9/127: dread d4/d9/fc [0,4194304] 0 2024-04-12T13:41:54.417 INFO:tasks.workunit.client.0.smithi060.stdout:0/180: rmdir d7/d9/d14 39 2024-04-12T13:41:54.418 INFO:tasks.workunit.client.1.smithi110.stdout:7/148: rename d1/l17 to d1/d1b/l32 0 2024-04-12T13:41:54.421 INFO:tasks.workunit.client.0.smithi060.stdout:2/158: dwrite d6/f15 [0,4194304] 0 2024-04-12T13:41:54.421 INFO:tasks.workunit.client.1.smithi110.stdout:9/239: mkdir df/d13/d3b/d40/d56 0 2024-04-12T13:41:54.430 INFO:tasks.workunit.client.1.smithi110.stdout:5/116: dread f7 [0,4194304] 0 2024-04-12T13:41:54.430 INFO:tasks.workunit.client.0.smithi060.stdout:3/172: write d7/d17/f1a [3711780,5240] 0 2024-04-12T13:41:54.433 INFO:tasks.workunit.client.1.smithi110.stdout:5/117: write da/db/d15/d17/f19 [517168,89974] 0 2024-04-12T13:41:54.435 INFO:tasks.workunit.client.1.smithi110.stdout:6/223: rmdir d7/d25/d30/d44 39 2024-04-12T13:41:54.435 INFO:tasks.workunit.client.0.smithi060.stdout:3/173: write d7/d17/d19/f1f [2085774,96110] 0 2024-04-12T13:41:54.435 INFO:tasks.workunit.client.0.smithi060.stdout:6/259: dread d1/d7/da/ff [0,4194304] 0 2024-04-12T13:41:54.436 INFO:tasks.workunit.client.0.smithi060.stdout:3/174: readlink l5 0 2024-04-12T13:41:54.437 INFO:tasks.workunit.client.1.smithi110.stdout:4/238: dwrite d0/d13/f2d [0,4194304] 0 2024-04-12T13:41:54.439 INFO:tasks.workunit.client.0.smithi060.stdout:6/260: dread - d1/d7/da/d20/f50 zero size 2024-04-12T13:41:54.441 INFO:tasks.workunit.client.1.smithi110.stdout:0/131: rmdir d1/d8 39 2024-04-12T13:41:54.441 INFO:tasks.workunit.client.0.smithi060.stdout:1/170: dwrite d1e/d23/d2e/f3a [0,4194304] 0 2024-04-12T13:41:54.445 INFO:tasks.workunit.client.0.smithi060.stdout:3/175: write d7/da/dd/d25/f26 [551356,46808] 0 2024-04-12T13:41:54.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/261: chown d1/d7/da/dc/d3a/f4b 324 1 2024-04-12T13:41:54.473 INFO:tasks.workunit.client.0.smithi060.stdout:3/176: dread d7/da/dd/d25/f26 [0,4194304] 0 2024-04-12T13:41:54.474 INFO:tasks.workunit.client.0.smithi060.stdout:8/185: mknod d9/d1b/c3d 0 2024-04-12T13:41:54.494 INFO:tasks.workunit.client.0.smithi060.stdout:3/177: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:41:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.495+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb4c04bed0 con 0x7fcb4c1002b0 2024-04-12T13:41:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.496+0000 7fcb48c00700 1 -- 172.21.15.60:0/3213760044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fcb38057870 con 0x7fcb4c1002b0 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:41:54.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:41:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:41:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 13, 2024-04-12T13:41:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:41:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:41:54.502 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 msgr2=0x7fcb3406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 0x7fcb3406e260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000b3b0 tx=0x7fcb40009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 msgr2=0x7fcb4c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcb38002a80 tx=0x7fcb380046b0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 shutdown_connections 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcb3406bdb0 0x7fcb3406e260 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb4c0ff000 0x7fcb4c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 --2- 172.21.15.60:0/3213760044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4c1002b0 0x7fcb4c110100 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.499+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 >> 172.21.15.60:0/3213760044 conn(0x7fcb4c0fa950 msgr2=0x7fcb4c0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.500+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 shutdown_connections 2024-04-12T13:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.501+0000 7fcb53c00700 1 -- 172.21.15.60:0/3213760044 wait complete. 2024-04-12T13:41:54.509 INFO:tasks.workunit.client.0.smithi060.stdout:4/196: dread d6/f2e [0,4194304] 0 2024-04-12T13:41:54.510 INFO:tasks.workunit.client.0.smithi060.stdout:0/181: readlink d7/d9/de/l2e 0 2024-04-12T13:41:54.512 INFO:tasks.workunit.client.0.smithi060.stdout:9/128: creat d4/d9/d19/d21/f27 x:0 0 0 2024-04-12T13:41:54.514 INFO:tasks.workunit.client.1.smithi110.stdout:2/167: write d6/dc/f15 [2494044,77975] 0 2024-04-12T13:41:54.515 INFO:tasks.workunit.client.0.smithi060.stdout:2/159: creat d6/d10/d16/f2e x:0 0 0 2024-04-12T13:41:54.522 INFO:tasks.workunit.client.1.smithi110.stdout:8/155: mknod d1/d3/c2b 0 2024-04-12T13:41:54.527 INFO:tasks.workunit.client.1.smithi110.stdout:7/149: mkdir d1/d1b/d33 0 2024-04-12T13:41:54.527 INFO:tasks.workunit.client.0.smithi060.stdout:5/215: write f2 [4871444,68501] 0 2024-04-12T13:41:54.528 INFO:tasks.workunit.client.1.smithi110.stdout:7/150: write d1/d3/f20 [5242109,35635] 0 2024-04-12T13:41:54.530 INFO:tasks.workunit.client.0.smithi060.stdout:7/187: creat d0/d7/d43/f46 x:0 0 0 2024-04-12T13:41:54.534 INFO:tasks.workunit.client.0.smithi060.stdout:1/171: unlink d1e/l32 0 2024-04-12T13:41:54.535 INFO:tasks.workunit.client.1.smithi110.stdout:6/224: fsync d7/d25/d30/d44/f2d 0 2024-04-12T13:41:54.536 INFO:tasks.workunit.client.1.smithi110.stdout:6/225: chown d7/d10 354425753 1 2024-04-12T13:41:54.538 INFO:tasks.workunit.client.0.smithi060.stdout:6/262: rmdir d1/d7/da/dc/d24/d34/d51 39 2024-04-12T13:41:54.545 INFO:tasks.workunit.client.0.smithi060.stdout:3/178: stat d7/d17/f28 0 2024-04-12T13:41:54.545 INFO:tasks.workunit.client.1.smithi110.stdout:7/151: dwrite d1/d3/f20 [4194304,4194304] 0 2024-04-12T13:41:54.547 INFO:tasks.workunit.client.1.smithi110.stdout:2/168: rmdir d6/dc/d13/d1d 39 2024-04-12T13:41:54.548 INFO:tasks.workunit.client.1.smithi110.stdout:7/152: write d1/f23 [445486,122501] 0 2024-04-12T13:41:54.549 INFO:tasks.workunit.client.1.smithi110.stdout:2/169: chown d6/dc/dd/f16 5536922 1 2024-04-12T13:41:54.550 INFO:tasks.workunit.client.1.smithi110.stdout:2/170: chown d6/dc/d1b 1363661 1 2024-04-12T13:41:54.550 INFO:tasks.workunit.client.0.smithi060.stdout:3/179: fsync d7/d17/d19/f31 0 2024-04-12T13:41:54.553 INFO:tasks.workunit.client.1.smithi110.stdout:1/138: rename de/d1d/c29 to de/c35 0 2024-04-12T13:41:54.553 INFO:tasks.workunit.client.1.smithi110.stdout:2/171: fsync d6/dc/f14 0 2024-04-12T13:41:54.554 INFO:tasks.workunit.client.0.smithi060.stdout:1/172: dread d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:54.554 INFO:tasks.workunit.client.1.smithi110.stdout:7/153: dread d1/f5 [0,4194304] 0 2024-04-12T13:41:54.555 INFO:tasks.workunit.client.1.smithi110.stdout:1/139: readlink de/d15/l33 0 2024-04-12T13:41:54.557 INFO:tasks.workunit.client.0.smithi060.stdout:1/173: write f2 [1318681,64213] 0 2024-04-12T13:41:54.557 INFO:tasks.workunit.client.1.smithi110.stdout:7/154: truncate d1/f2a 1340944 0 2024-04-12T13:41:54.558 INFO:tasks.workunit.client.0.smithi060.stdout:1/174: chown d1e/d1f 150 1 2024-04-12T13:41:54.560 INFO:tasks.workunit.client.1.smithi110.stdout:0/132: dwrite d1/d8/f24 [0,4194304] 0 2024-04-12T13:41:54.561 INFO:tasks.workunit.client.0.smithi060.stdout:9/129: symlink d4/d9/l28 0 2024-04-12T13:41:54.566 INFO:tasks.workunit.client.0.smithi060.stdout:2/160: creat d6/d13/f2f x:0 0 0 2024-04-12T13:41:54.566 INFO:tasks.workunit.client.0.smithi060.stdout:9/130: write d4/d8/fa [4471099,49254] 0 2024-04-12T13:41:54.572 INFO:tasks.workunit.client.0.smithi060.stdout:2/161: truncate d6/d13/d17/f1f 404335 0 2024-04-12T13:41:54.572 INFO:tasks.workunit.client.0.smithi060.stdout:5/216: symlink d6/dd/d1f/d25/l4b 0 2024-04-12T13:41:54.573 INFO:tasks.workunit.client.1.smithi110.stdout:9/240: creat df/d13/d2c/d2d/d39/d3a/d4e/f57 x:0 0 0 2024-04-12T13:41:54.574 INFO:tasks.workunit.client.0.smithi060.stdout:5/217: readlink d6/dd/l2f 0 2024-04-12T13:41:54.577 INFO:tasks.workunit.client.0.smithi060.stdout:5/218: stat d6/d10/d12/f36 0 2024-04-12T13:41:54.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/162: write d6/d13/d17/f1f [795821,79575] 0 2024-04-12T13:41:54.588 INFO:tasks.workunit.client.1.smithi110.stdout:2/172: creat d6/d18/d19/f2c x:0 0 0 2024-04-12T13:41:54.589 INFO:tasks.workunit.client.1.smithi110.stdout:2/173: stat d6/dc/f2b 0 2024-04-12T13:41:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/175: mknod d1e/d23/d2e/d30/c3e 0 2024-04-12T13:41:54.592 INFO:tasks.workunit.client.0.smithi060.stdout:1/176: write f14 [909300,44423] 0 2024-04-12T13:41:54.599 INFO:tasks.workunit.client.0.smithi060.stdout:9/131: symlink d4/d8/l29 0 2024-04-12T13:41:54.601 INFO:tasks.workunit.client.0.smithi060.stdout:5/219: dwrite d6/d10/d12/f43 [0,4194304] 0 2024-04-12T13:41:54.614 INFO:tasks.workunit.client.1.smithi110.stdout:6/226: truncate d7/d10/d1c/f28 966369 0 2024-04-12T13:41:54.614 INFO:tasks.workunit.client.1.smithi110.stdout:6/227: readlink d7/d25/d2c/l2e 0 2024-04-12T13:41:54.614 INFO:tasks.workunit.client.0.smithi060.stdout:6/263: truncate d1/d7/da/dc/d24/f37 329447 0 2024-04-12T13:41:54.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/220: dread f1 [4194304,4194304] 0 2024-04-12T13:41:54.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/221: stat d6/dd/d1f/d32/d3d 0 2024-04-12T13:41:54.619 INFO:tasks.workunit.client.0.smithi060.stdout:2/163: unlink d6/d10/c12 0 2024-04-12T13:41:54.624 INFO:tasks.workunit.client.1.smithi110.stdout:3/156: rename d5/lf to d5/dc/d20/d2b/d32/l34 0 2024-04-12T13:41:54.626 INFO:tasks.workunit.client.0.smithi060.stdout:1/177: dread f2 [0,4194304] 0 2024-04-12T13:41:54.629 INFO:tasks.workunit.client.1.smithi110.stdout:2/174: mknod d6/d18/d19/c2d 0 2024-04-12T13:41:54.632 INFO:tasks.workunit.client.1.smithi110.stdout:7/155: mknod d1/d1b/d33/c34 0 2024-04-12T13:41:54.637 INFO:tasks.workunit.client.1.smithi110.stdout:0/133: link d1/d8/f20 d1/d8/f2e 0 2024-04-12T13:41:54.638 INFO:tasks.workunit.client.1.smithi110.stdout:0/134: chown d1/c2a 159425 1 2024-04-12T13:41:54.641 INFO:tasks.workunit.client.1.smithi110.stdout:9/241: mkdir df/d13/d2c/d2d/d39/d4f/d58 0 2024-04-12T13:41:54.643 INFO:tasks.workunit.client.0.smithi060.stdout:5/222: rename d6/dd/d1f/d32/d41 to d6/d10/d12/d4c 0 2024-04-12T13:41:54.646 INFO:tasks.workunit.client.1.smithi110.stdout:6/228: creat d7/d25/d30/d44/d3d/f49 x:0 0 0 2024-04-12T13:41:54.646 INFO:tasks.workunit.client.0.smithi060.stdout:2/164: creat d6/d13/d17/f30 x:0 0 0 2024-04-12T13:41:54.647 INFO:tasks.workunit.client.1.smithi110.stdout:6/229: chown d7/d10/d1c/f29 5246 1 2024-04-12T13:41:54.649 INFO:tasks.workunit.client.0.smithi060.stdout:1/178: rmdir d1e/d29 39 2024-04-12T13:41:54.649 INFO:tasks.workunit.client.1.smithi110.stdout:5/118: rename da/l18 to da/db/l28 0 2024-04-12T13:41:54.652 INFO:tasks.workunit.client.1.smithi110.stdout:2/175: mknod d6/d18/d19/d25/c2e 0 2024-04-12T13:41:54.655 INFO:tasks.workunit.client.1.smithi110.stdout:7/156: write d1/f5 [317944,99150] 0 2024-04-12T13:41:54.657 INFO:tasks.workunit.client.0.smithi060.stdout:6/264: rename d1/d7/da/c1a to d1/d7/da/dc/d24/d34/d51/c5f 0 2024-04-12T13:41:54.659 INFO:tasks.workunit.client.0.smithi060.stdout:5/223: symlink d6/dd/d1f/d32/d46/l4d 0 2024-04-12T13:41:54.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/165: mkdir d6/d13/d31 0 2024-04-12T13:41:54.662 INFO:tasks.workunit.client.0.smithi060.stdout:2/166: stat d6/f24 0 2024-04-12T13:41:54.663 INFO:tasks.workunit.client.1.smithi110.stdout:0/135: dread d1/d8/f21 [0,4194304] 0 2024-04-12T13:41:54.664 INFO:tasks.workunit.client.0.smithi060.stdout:1/179: symlink d1e/d23/l3f 0 2024-04-12T13:41:54.665 INFO:tasks.workunit.client.1.smithi110.stdout:3/157: creat d5/dc/d20/d2d/f35 x:0 0 0 2024-04-12T13:41:54.667 INFO:tasks.workunit.client.1.smithi110.stdout:5/119: mkdir da/db/d15/d17/d29 0 2024-04-12T13:41:54.668 INFO:tasks.workunit.client.0.smithi060.stdout:6/265: creat d1/d7/da/dc/d24/d30/d52/f60 x:0 0 0 2024-04-12T13:41:54.669 INFO:tasks.workunit.client.1.smithi110.stdout:5/120: write da/db/f1d [1130419,121517] 0 2024-04-12T13:41:54.669 INFO:tasks.workunit.client.1.smithi110.stdout:2/176: rmdir d6/d18/d19/d25 39 2024-04-12T13:41:54.673 INFO:tasks.workunit.client.1.smithi110.stdout:4/239: truncate d0/ff 388420 0 2024-04-12T13:41:54.675 INFO:tasks.workunit.client.1.smithi110.stdout:9/242: mknod df/d13/c59 0 2024-04-12T13:41:54.676 INFO:tasks.workunit.client.0.smithi060.stdout:6/266: write d1/d7/da/dc/f3c [663246,82982] 0 2024-04-12T13:41:54.676 INFO:tasks.workunit.client.1.smithi110.stdout:6/230: truncate d7/d10/f20 3783283 0 2024-04-12T13:41:54.676 INFO:tasks.workunit.client.1.smithi110.stdout:9/243: chown df/f34 1497 1 2024-04-12T13:41:54.678 INFO:tasks.workunit.client.0.smithi060.stdout:5/224: rename d6/f7 to d6/d10/d12/f4e 0 2024-04-12T13:41:54.679 INFO:tasks.workunit.client.0.smithi060.stdout:1/180: rename d1e/d1f to d1e/d1f/d40 22 2024-04-12T13:41:54.679 INFO:tasks.workunit.client.0.smithi060.stdout:3/180: write d7/d17/f20 [868493,77216] 0 2024-04-12T13:41:54.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/197: mkdir d6/d47 0 2024-04-12T13:41:54.682 INFO:tasks.workunit.client.1.smithi110.stdout:0/136: dwrite d1/f14 [4194304,4194304] 0 2024-04-12T13:41:54.687 INFO:tasks.workunit.client.1.smithi110.stdout:5/121: write da/db/f23 [883499,24594] 0 2024-04-12T13:41:54.688 INFO:tasks.workunit.client.0.smithi060.stdout:0/182: creat d7/f3e x:0 0 0 2024-04-12T13:41:54.689 INFO:tasks.workunit.client.1.smithi110.stdout:1/140: write f5 [3577647,7086] 0 2024-04-12T13:41:54.694 INFO:tasks.workunit.client.0.smithi060.stdout:1/181: readlink l8 0 2024-04-12T13:41:54.698 INFO:tasks.workunit.client.0.smithi060.stdout:2/167: link d6/d10/d16/f2e d6/f32 0 2024-04-12T13:41:54.700 INFO:tasks.workunit.client.1.smithi110.stdout:2/177: dread d6/dc/d13/d1d/f26 [0,4194304] 0 2024-04-12T13:41:54.700 INFO:tasks.workunit.client.0.smithi060.stdout:2/168: dread - d6/f25 zero size 2024-04-12T13:41:54.701 INFO:tasks.workunit.client.0.smithi060.stdout:3/181: mkdir d7/d17/d19/d33 0 2024-04-12T13:41:54.702 INFO:tasks.workunit.client.0.smithi060.stdout:4/198: dwrite d6/d21/f2a [0,4194304] 0 2024-04-12T13:41:54.703 INFO:tasks.workunit.client.1.smithi110.stdout:9/244: mknod df/d13/d2c/d2d/d39/c5a 0 2024-04-12T13:41:54.705 INFO:tasks.workunit.client.0.smithi060.stdout:2/169: truncate d6/d13/d17/f30 856137 0 2024-04-12T13:41:54.706 INFO:tasks.workunit.client.0.smithi060.stdout:4/199: rename d6 to d6/d7/dd/d1a/d48 22 2024-04-12T13:41:54.706 INFO:tasks.workunit.client.0.smithi060.stdout:5/225: creat d6/d10/d12/d15/f4f x:0 0 0 2024-04-12T13:41:54.709 INFO:tasks.workunit.client.1.smithi110.stdout:3/158: truncate d5/f1f 314306 0 2024-04-12T13:41:54.712 INFO:tasks.workunit.client.1.smithi110.stdout:5/122: fsync da/f21 0 2024-04-12T13:41:54.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 -- 172.21.15.60:0/2845638820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d400fffd0 msgr2=0x7f0d401023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:54.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 --2- 172.21.15.60:0/2845638820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d400fffd0 0x7f0d401023b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c004940 tx=0x7f0d2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:54.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 -- 172.21.15.60:0/2845638820 shutdown_connections 2024-04-12T13:41:54.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 --2- 172.21.15.60:0/2845638820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d400fffd0 0x7f0d401023b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 --2- 172.21.15.60:0/2845638820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d40066290 0x7f0d400ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.711+0000 7f0d46a00700 1 -- 172.21.15.60:0/2845638820 >> 172.21.15.60:0/2845638820 conn(0x7f0d400f74c0 msgr2=0x7f0d400f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:54.713 INFO:tasks.workunit.client.1.smithi110.stdout:9/245: dread df/f25 [0,4194304] 0 2024-04-12T13:41:54.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.712+0000 7f0d46a00700 1 -- 172.21.15.60:0/2845638820 shutdown_connections 2024-04-12T13:41:54.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.712+0000 7f0d46a00700 1 -- 172.21.15.60:0/2845638820 wait complete. 2024-04-12T13:41:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 Processor -- start 2024-04-12T13:41:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 -- start start 2024-04-12T13:41:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 0x7f0d40114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 0x7f0d40114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40114c20 con 0x7f0d40066290 2024-04-12T13:41:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.714+0000 7f0d46a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40115410 con 0x7f0d400fffd0 2024-04-12T13:41:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 0x7f0d40114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:54.717 INFO:tasks.workunit.client.1.smithi110.stdout:8/156: dwrite d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 0x7f0d40114590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:52358/0 (socket says 172.21.15.60:52358) 2024-04-12T13:41:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3f400700 1 -- 172.21.15.60:0/4087009781 learned_addr learned my addr 172.21.15.60:0/4087009781 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3fe00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 0x7f0d40114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3fe00700 1 -- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 msgr2=0x7f0d40114590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.715+0000 7f0d3fe00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 0x7f0d40114590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d3fe00700 1 -- 172.21.15.60:0/4087009781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c005040 con 0x7f0d40066290 2024-04-12T13:41:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d3fe00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 0x7f0d40114050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000b550 tx=0x7f0d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:54.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3000f6f0 con 0x7f0d40066290 2024-04-12T13:41:54.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d3000fd20 con 0x7f0d40066290 2024-04-12T13:41:54.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d300103a0 con 0x7f0d40066290 2024-04-12T13:41:54.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.716+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d401156f0 con 0x7f0d40066290 2024-04-12T13:41:54.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.717+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d40115cb0 con 0x7f0d40066290 2024-04-12T13:41:54.720 INFO:tasks.workunit.client.0.smithi060.stdout:1/182: symlink d1e/d23/d2e/l41 0 2024-04-12T13:41:54.723 INFO:tasks.workunit.client.1.smithi110.stdout:5/123: dread da/db/d15/d17/f19 [0,4194304] 0 2024-04-12T13:41:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.720+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f0d30011400 con 0x7f0d40066290 2024-04-12T13:41:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.720+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4005f5f0 con 0x7f0d40066290 2024-04-12T13:41:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.721+0000 7f0d37e00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 0x7f0d2406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.722+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0d3008a6f0 con 0x7f0d40066290 2024-04-12T13:41:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.722+0000 7f0d3f400700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 0x7f0d2406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:54.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.723+0000 7f0d3f400700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 0x7f0d2406e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00b020 tx=0x7f0d2c009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:54.725 INFO:tasks.workunit.client.1.smithi110.stdout:5/124: read da/db/d15/d17/f19 [330292,79690] 0 2024-04-12T13:41:54.728 INFO:tasks.workunit.client.0.smithi060.stdout:4/200: fsync d6/f2e 0 2024-04-12T13:41:54.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:54.728+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f0d30057920 con 0x7f0d40066290 2024-04-12T13:41:54.734 INFO:tasks.workunit.client.1.smithi110.stdout:7/157: unlink d1/c13 0 2024-04-12T13:41:54.737 INFO:tasks.workunit.client.1.smithi110.stdout:7/158: dread d1/f5 [0,4194304] 0 2024-04-12T13:41:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:9/132: link d4/d9/d19/f1a d4/d9/f2a 0 2024-04-12T13:41:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:8/186: sync 2024-04-12T13:41:54.741 INFO:tasks.workunit.client.0.smithi060.stdout:9/133: fsync d4/d8/f17 0 2024-04-12T13:41:54.751 INFO:tasks.workunit.client.1.smithi110.stdout:7/159: dwrite d1/f28 [0,4194304] 0 2024-04-12T13:41:54.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/188: unlink d0/f1c 0 2024-04-12T13:41:54.760 INFO:tasks.workunit.client.0.smithi060.stdout:3/182: symlink d7/d17/d19/d33/l34 0 2024-04-12T13:41:54.765 INFO:tasks.workunit.client.1.smithi110.stdout:1/141: unlink de/d1d/l23 0 2024-04-12T13:41:54.768 INFO:tasks.workunit.client.0.smithi060.stdout:8/187: dwrite d9/f11 [0,4194304] 0 2024-04-12T13:41:54.770 INFO:tasks.workunit.client.0.smithi060.stdout:5/226: dread d6/fc [0,4194304] 0 2024-04-12T13:41:54.771 INFO:tasks.workunit.client.0.smithi060.stdout:2/170: mkdir d6/d13/d31/d33 0 2024-04-12T13:41:54.772 INFO:tasks.workunit.client.0.smithi060.stdout:4/201: dread d6/d7/dd/df/f37 [0,4194304] 0 2024-04-12T13:41:54.773 INFO:tasks.workunit.client.0.smithi060.stdout:2/171: read - d6/d13/d17/d21/f2d zero size 2024-04-12T13:41:54.774 INFO:tasks.workunit.client.1.smithi110.stdout:2/178: creat d6/d18/d20/f2f x:0 0 0 2024-04-12T13:41:54.777 INFO:tasks.workunit.client.0.smithi060.stdout:4/202: dread d6/f2e [0,4194304] 0 2024-04-12T13:41:54.778 INFO:tasks.workunit.client.0.smithi060.stdout:5/227: truncate d6/d10/d12/f43 5015658 0 2024-04-12T13:41:54.785 INFO:tasks.workunit.client.1.smithi110.stdout:0/137: link d1/d8/f24 d1/f2f 0 2024-04-12T13:41:54.785 INFO:tasks.workunit.client.1.smithi110.stdout:4/240: dread d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:41:54.786 INFO:tasks.workunit.client.1.smithi110.stdout:4/241: readlink d0/de/l12 0 2024-04-12T13:41:54.788 INFO:tasks.workunit.client.1.smithi110.stdout:2/179: dread d6/dc/dd/f10 [0,4194304] 0 2024-04-12T13:41:54.789 INFO:tasks.workunit.client.1.smithi110.stdout:2/180: readlink d6/dc/l17 0 2024-04-12T13:41:54.790 INFO:tasks.workunit.client.0.smithi060.stdout:6/267: link d1/d7/da/dc/d24/d34/d51/d59/c3e d1/d7/c61 0 2024-04-12T13:41:54.793 INFO:tasks.workunit.client.0.smithi060.stdout:8/188: dwrite d9/f11 [0,4194304] 0 2024-04-12T13:41:54.795 INFO:tasks.workunit.client.0.smithi060.stdout:8/189: dread - d9/f3b zero size 2024-04-12T13:41:54.799 INFO:tasks.workunit.client.1.smithi110.stdout:7/160: readlink d1/d1b/l32 0 2024-04-12T13:41:54.800 INFO:tasks.workunit.client.0.smithi060.stdout:2/172: write d6/f9 [1057524,28999] 0 2024-04-12T13:41:54.808 INFO:tasks.workunit.client.0.smithi060.stdout:5/228: mkdir d6/dd/d1f/d25/d35/d50 0 2024-04-12T13:41:54.808 INFO:tasks.workunit.client.0.smithi060.stdout:4/203: creat d6/d7/dd/d1a/d19/d42/f49 x:0 0 0 2024-04-12T13:41:54.809 INFO:tasks.workunit.client.1.smithi110.stdout:6/231: getdents d7/d25 0 2024-04-12T13:41:54.811 INFO:tasks.workunit.client.0.smithi060.stdout:9/134: creat d4/d25/f2b x:0 0 0 2024-04-12T13:41:54.813 INFO:tasks.workunit.client.1.smithi110.stdout:7/161: dwrite d1/f2a [0,4194304] 0 2024-04-12T13:41:54.815 INFO:tasks.workunit.client.1.smithi110.stdout:1/142: rename de/d15/l2c to de/d14/l36 0 2024-04-12T13:41:54.818 INFO:tasks.workunit.client.1.smithi110.stdout:5/125: creat da/db/d15/d17/d25/f2a x:0 0 0 2024-04-12T13:41:54.821 INFO:tasks.workunit.client.0.smithi060.stdout:4/204: dread d6/d7/dd/df/f20 [0,4194304] 0 2024-04-12T13:41:54.822 INFO:tasks.workunit.client.0.smithi060.stdout:1/183: mknod d1e/d29/d37/c42 0 2024-04-12T13:41:54.822 INFO:tasks.workunit.client.0.smithi060.stdout:0/183: truncate d7/d9/f2b 4954460 0 2024-04-12T13:41:54.824 INFO:tasks.workunit.client.1.smithi110.stdout:6/232: dwrite d7/d25/d2c/f40 [0,4194304] 0 2024-04-12T13:41:54.827 INFO:tasks.workunit.client.1.smithi110.stdout:7/162: dread d1/d3/f20 [0,4194304] 0 2024-04-12T13:41:54.827 INFO:tasks.workunit.client.1.smithi110.stdout:6/233: chown d7/d25/f36 1525 1 2024-04-12T13:41:54.827 INFO:tasks.workunit.client.0.smithi060.stdout:0/184: write d7/f11 [4791033,62180] 0 2024-04-12T13:41:54.829 INFO:tasks.workunit.client.1.smithi110.stdout:7/163: write d1/d3/d4/f2e [353846,106656] 0 2024-04-12T13:41:54.831 INFO:tasks.workunit.client.0.smithi060.stdout:6/268: symlink d1/d7/da/dc/d24/d34/d51/d59/l62 0 2024-04-12T13:41:54.834 INFO:tasks.workunit.client.0.smithi060.stdout:6/269: readlink d1/d7/da/l5c 0 2024-04-12T13:41:54.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/190: mkdir d9/d1b/d37/d3e 0 2024-04-12T13:41:54.838 INFO:tasks.workunit.client.0.smithi060.stdout:2/173: creat d6/d13/f34 x:0 0 0 2024-04-12T13:41:54.839 INFO:tasks.workunit.client.0.smithi060.stdout:2/174: readlink d6/ld 0 2024-04-12T13:41:54.840 INFO:tasks.workunit.client.0.smithi060.stdout:2/175: fdatasync d6/f24 0 2024-04-12T13:41:54.843 INFO:tasks.workunit.client.0.smithi060.stdout:5/229: dwrite d6/dd/d27/f44 [0,4194304] 0 2024-04-12T13:41:54.844 INFO:tasks.workunit.client.1.smithi110.stdout:7/164: dwrite d1/f23 [0,4194304] 0 2024-04-12T13:41:54.845 INFO:tasks.workunit.client.0.smithi060.stdout:7/189: creat d0/f47 x:0 0 0 2024-04-12T13:41:54.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/205: symlink d6/d21/d29/l4a 0 2024-04-12T13:41:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:5/230: dread d6/d10/f31 [0,4194304] 0 2024-04-12T13:41:54.851 INFO:tasks.workunit.client.1.smithi110.stdout:8/157: rename d1/d5/ca to d1/d5/c2c 0 2024-04-12T13:41:54.853 INFO:tasks.workunit.client.1.smithi110.stdout:9/246: sync 2024-04-12T13:41:54.854 INFO:tasks.workunit.client.0.smithi060.stdout:1/184: creat d1e/d23/f43 x:0 0 0 2024-04-12T13:41:54.855 INFO:tasks.workunit.client.0.smithi060.stdout:1/185: truncate f14 1199194 0 2024-04-12T13:41:54.856 INFO:tasks.workunit.client.1.smithi110.stdout:9/247: dread - df/d13/d2c/f53 zero size 2024-04-12T13:41:54.858 INFO:tasks.workunit.client.0.smithi060.stdout:1/186: write d1e/d23/d2e/f3a [2164377,84690] 0 2024-04-12T13:41:54.863 INFO:tasks.workunit.client.0.smithi060.stdout:3/183: creat d7/da/f35 x:0 0 0 2024-04-12T13:41:54.864 INFO:tasks.workunit.client.1.smithi110.stdout:1/143: mknod de/d1d/c37 0 2024-04-12T13:41:54.864 INFO:tasks.workunit.client.1.smithi110.stdout:3/159: write d5/f1f [946099,3492] 0 2024-04-12T13:41:54.864 INFO:tasks.workunit.client.1.smithi110.stdout:1/144: chown f2 1711 1 2024-04-12T13:41:54.865 INFO:tasks.workunit.client.0.smithi060.stdout:3/184: chown d7/d17/d19/c22 0 1 2024-04-12T13:41:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:3/185: fdatasync d7/f8 0 2024-04-12T13:41:54.868 INFO:tasks.workunit.client.1.smithi110.stdout:4/242: rename d0/d19/d26/f46 to d0/de/d2c/f4d 0 2024-04-12T13:41:54.869 INFO:tasks.workunit.client.1.smithi110.stdout:4/243: truncate d0/d19/d26/f40 471809 0 2024-04-12T13:41:54.874 INFO:tasks.workunit.client.0.smithi060.stdout:8/191: symlink d9/d1b/d37/l3f 0 2024-04-12T13:41:54.875 INFO:tasks.workunit.client.0.smithi060.stdout:3/186: dread d7/d17/f20 [0,4194304] 0 2024-04-12T13:41:54.881 INFO:tasks.workunit.client.0.smithi060.stdout:9/135: link f2 d4/d8/f2c 0 2024-04-12T13:41:54.884 INFO:tasks.workunit.client.0.smithi060.stdout:7/190: rename d0/d7/f38 to d0/d1b/f48 0 2024-04-12T13:41:54.889 INFO:tasks.workunit.client.1.smithi110.stdout:4/244: dread d0/f4 [4194304,4194304] 0 2024-04-12T13:41:54.890 INFO:tasks.workunit.client.1.smithi110.stdout:7/165: creat d1/d3/d4/f35 x:0 0 0 2024-04-12T13:41:54.890 INFO:tasks.workunit.client.1.smithi110.stdout:0/138: dwrite d1/d8/f10 [0,4194304] 0 2024-04-12T13:41:54.891 INFO:tasks.workunit.client.0.smithi060.stdout:5/231: symlink d6/dd/d27/l51 0 2024-04-12T13:41:54.893 INFO:tasks.workunit.client.0.smithi060.stdout:5/232: dread - d6/d10/d12/d15/f22 zero size 2024-04-12T13:41:54.897 INFO:tasks.workunit.client.1.smithi110.stdout:9/248: creat df/d13/d2c/d2d/d39/d3a/d4e/f5b x:0 0 0 2024-04-12T13:41:54.898 INFO:tasks.workunit.client.0.smithi060.stdout:1/187: dread d1e/f2d [0,4194304] 0 2024-04-12T13:41:54.899 INFO:tasks.workunit.client.1.smithi110.stdout:9/249: fdatasync df/d13/f27 0 2024-04-12T13:41:54.900 INFO:tasks.workunit.client.0.smithi060.stdout:5/233: write d6/dd/d27/f44 [4454416,115358] 0 2024-04-12T13:41:54.903 INFO:tasks.workunit.client.0.smithi060.stdout:5/234: dread - d6/d10/d12/d38/f47 zero size 2024-04-12T13:41:54.903 INFO:tasks.workunit.client.1.smithi110.stdout:1/145: creat de/d14/f38 x:0 0 0 2024-04-12T13:41:54.904 INFO:tasks.workunit.client.1.smithi110.stdout:0/139: dwrite d1/d11/f2b [0,4194304] 0 2024-04-12T13:41:54.907 INFO:tasks.workunit.client.0.smithi060.stdout:0/185: creat d7/d9/d14/d35/f3f x:0 0 0 2024-04-12T13:41:54.910 INFO:tasks.workunit.client.0.smithi060.stdout:0/186: write d7/d9/f23 [3107031,38603] 0 2024-04-12T13:41:54.911 INFO:tasks.workunit.client.0.smithi060.stdout:8/192: creat d9/d1b/d2b/f40 x:0 0 0 2024-04-12T13:41:54.914 INFO:tasks.workunit.client.0.smithi060.stdout:3/187: mkdir d7/d17/d27/d36 0 2024-04-12T13:41:54.916 INFO:tasks.workunit.client.0.smithi060.stdout:6/270: creat d1/d7/da/dc/d24/d30/d52/d5e/f63 x:0 0 0 2024-04-12T13:41:54.917 INFO:tasks.workunit.client.0.smithi060.stdout:9/136: readlink d4/d9/l24 0 2024-04-12T13:41:54.918 INFO:tasks.workunit.client.1.smithi110.stdout:6/234: unlink c4 0 2024-04-12T13:41:54.919 INFO:tasks.workunit.client.1.smithi110.stdout:2/181: link l5 d6/d18/d20/l30 0 2024-04-12T13:41:54.921 INFO:tasks.workunit.client.1.smithi110.stdout:4/245: mknod d0/de/d31/c4e 0 2024-04-12T13:41:54.923 INFO:tasks.workunit.client.1.smithi110.stdout:7/166: mkdir d1/d3/d4/d36 0 2024-04-12T13:41:54.927 INFO:tasks.workunit.client.0.smithi060.stdout:1/188: rename f1c to d1e/d29/f44 0 2024-04-12T13:41:54.933 INFO:tasks.workunit.client.1.smithi110.stdout:1/146: unlink de/d15/f21 0 2024-04-12T13:41:54.936 INFO:tasks.workunit.client.1.smithi110.stdout:0/140: mkdir d1/d8/d30 0 2024-04-12T13:41:54.936 INFO:tasks.workunit.client.1.smithi110.stdout:3/160: dwrite d5/dc/fd [0,4194304] 0 2024-04-12T13:41:54.937 INFO:tasks.workunit.client.0.smithi060.stdout:0/187: rmdir d7/d9/d14/d1b 39 2024-04-12T13:41:54.940 INFO:tasks.workunit.client.0.smithi060.stdout:8/193: mknod d9/da/c41 0 2024-04-12T13:41:54.941 INFO:tasks.workunit.client.1.smithi110.stdout:5/126: creat da/db/d15/f2b x:0 0 0 2024-04-12T13:41:54.946 INFO:tasks.workunit.client.0.smithi060.stdout:3/188: fsync d7/da/dd/d25/f26 0 2024-04-12T13:41:54.946 INFO:tasks.workunit.client.0.smithi060.stdout:6/271: rmdir d1/d2c 39 2024-04-12T13:41:54.947 INFO:tasks.workunit.client.1.smithi110.stdout:4/246: creat d0/de/d31/f4f x:0 0 0 2024-04-12T13:41:54.949 INFO:tasks.workunit.client.0.smithi060.stdout:6/272: read d1/d7/da/dc/f19 [339063,7175] 0 2024-04-12T13:41:54.949 INFO:tasks.workunit.client.1.smithi110.stdout:1/147: dwrite de/d15/f1c [0,4194304] 0 2024-04-12T13:41:54.950 INFO:tasks.workunit.client.0.smithi060.stdout:6/273: chown d1/d7/f43 4 1 2024-04-12T13:41:54.952 INFO:tasks.workunit.client.1.smithi110.stdout:7/167: mknod d1/d1b/d33/c37 0 2024-04-12T13:41:54.952 INFO:tasks.workunit.client.1.smithi110.stdout:7/168: fdatasync d1/f2b 0 2024-04-12T13:41:54.955 INFO:tasks.workunit.client.0.smithi060.stdout:1/189: rmdir d1e/d23 39 2024-04-12T13:41:54.959 INFO:tasks.workunit.client.1.smithi110.stdout:3/161: creat d5/dc/d20/f36 x:0 0 0 2024-04-12T13:41:54.961 INFO:tasks.workunit.client.1.smithi110.stdout:8/158: getdents d1 0 2024-04-12T13:41:54.962 INFO:tasks.workunit.client.0.smithi060.stdout:8/194: write d9/d1b/d2b/f32 [1322555,104079] 0 2024-04-12T13:41:54.963 INFO:tasks.workunit.client.1.smithi110.stdout:4/247: dread d0/d13/f2d [0,4194304] 0 2024-04-12T13:41:54.964 INFO:tasks.workunit.client.1.smithi110.stdout:4/248: fdatasync d0/de/f36 0 2024-04-12T13:41:54.966 INFO:tasks.workunit.client.1.smithi110.stdout:1/148: chown de/d15/c19 356570312 1 2024-04-12T13:41:54.968 INFO:tasks.workunit.client.1.smithi110.stdout:1/149: write de/f22 [298068,1886] 0 2024-04-12T13:41:54.968 INFO:tasks.workunit.client.0.smithi060.stdout:7/191: creat d0/d7/f49 x:0 0 0 2024-04-12T13:41:54.970 INFO:tasks.workunit.client.0.smithi060.stdout:4/206: getdents d6/d7/dd/d1a/d19/d42 0 2024-04-12T13:41:54.972 INFO:tasks.workunit.client.0.smithi060.stdout:4/207: readlink d6/d7/dd/df/l3f 0 2024-04-12T13:41:54.972 INFO:tasks.workunit.client.0.smithi060.stdout:6/274: mkdir d1/d7/da/dc/d24/d34/d51/d64 0 2024-04-12T13:41:54.975 INFO:tasks.workunit.client.0.smithi060.stdout:5/235: rmdir d6/dd/d1f/d32/d46/d4a 0 2024-04-12T13:41:54.979 INFO:tasks.workunit.client.1.smithi110.stdout:3/162: creat d5/dc/d20/d2b/d32/f37 x:0 0 0 2024-04-12T13:41:54.981 INFO:tasks.workunit.client.0.smithi060.stdout:0/188: link d7/d9/d14/d35/f36 d7/d9/de/f40 0 2024-04-12T13:41:54.982 INFO:tasks.workunit.client.1.smithi110.stdout:8/159: symlink d1/d5/d1f/l2d 0 2024-04-12T13:41:54.983 INFO:tasks.workunit.client.0.smithi060.stdout:9/137: write d4/d9/f2a [4360077,70792] 0 2024-04-12T13:41:54.983 INFO:tasks.workunit.client.1.smithi110.stdout:4/249: dwrite d0/de/f36 [4194304,4194304] 0 2024-04-12T13:41:54.987 INFO:tasks.workunit.client.1.smithi110.stdout:1/150: unlink fa 0 2024-04-12T13:41:54.988 INFO:tasks.workunit.client.1.smithi110.stdout:9/250: getdents df/d13/d26/d37 0 2024-04-12T13:41:54.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/208: fsync d6/d7/db/f22 0 2024-04-12T13:41:54.991 INFO:tasks.workunit.client.0.smithi060.stdout:7/192: dwrite d0/d7/f33 [0,4194304] 0 2024-04-12T13:41:54.994 INFO:tasks.workunit.client.1.smithi110.stdout:0/141: getdents d1/d27 0 2024-04-12T13:41:54.994 INFO:tasks.workunit.client.1.smithi110.stdout:0/142: chown d1/d8 1 1 2024-04-12T13:41:54.995 INFO:tasks.workunit.client.0.smithi060.stdout:4/209: truncate d6/d7/f3b 111377 0 2024-04-12T13:41:54.996 INFO:tasks.workunit.client.1.smithi110.stdout:5/127: rmdir da/db/d15/d27 0 2024-04-12T13:41:54.998 INFO:tasks.workunit.client.1.smithi110.stdout:5/128: write da/db/f1d [63457,120479] 0 2024-04-12T13:41:55.000 INFO:tasks.workunit.client.0.smithi060.stdout:6/275: dwrite d1/d7/da/dc/d24/d34/f23 [4194304,4194304] 0 2024-04-12T13:41:55.001 INFO:tasks.workunit.client.1.smithi110.stdout:3/163: chown d5/dc/f11 5545 1 2024-04-12T13:41:55.003 INFO:tasks.workunit.client.1.smithi110.stdout:3/164: read - d5/dc/f24 zero size 2024-04-12T13:41:55.008 INFO:tasks.workunit.client.1.smithi110.stdout:4/250: mkdir d0/d19/d1c/d50 0 2024-04-12T13:41:55.010 INFO:tasks.workunit.client.0.smithi060.stdout:7/193: mknod d0/d3d/c4a 0 2024-04-12T13:41:55.010 INFO:tasks.workunit.client.0.smithi060.stdout:8/195: dwrite d9/f2c [0,4194304] 0 2024-04-12T13:41:55.012 INFO:tasks.workunit.client.1.smithi110.stdout:3/165: dread d5/dc/f27 [0,4194304] 0 2024-04-12T13:41:55.013 INFO:tasks.workunit.client.0.smithi060.stdout:7/194: write d0/d7/f6 [2513214,102337] 0 2024-04-12T13:41:55.014 INFO:tasks.workunit.client.1.smithi110.stdout:3/166: dread - d5/dc/f24 zero size 2024-04-12T13:41:55.016 INFO:tasks.workunit.client.1.smithi110.stdout:3/167: write d5/dc/f2e [413313,88942] 0 2024-04-12T13:41:55.017 INFO:tasks.workunit.client.0.smithi060.stdout:1/190: creat d1e/f45 x:0 0 0 2024-04-12T13:41:55.018 INFO:tasks.workunit.client.1.smithi110.stdout:0/143: stat d1/d11/l28 0 2024-04-12T13:41:55.019 INFO:tasks.workunit.client.1.smithi110.stdout:3/168: read d5/dc/f11 [1167187,86237] 0 2024-04-12T13:41:55.020 INFO:tasks.workunit.client.0.smithi060.stdout:5/236: mkdir d6/dd/d1f/d25/d42/d52 0 2024-04-12T13:41:55.027 INFO:tasks.workunit.client.1.smithi110.stdout:5/129: rename f7 to da/db/d15/d17/d25/f2c 0 2024-04-12T13:41:55.029 INFO:tasks.workunit.client.0.smithi060.stdout:0/189: mkdir d7/d41 0 2024-04-12T13:41:55.030 INFO:tasks.workunit.client.1.smithi110.stdout:5/130: fdatasync da/db/d15/f1b 0 2024-04-12T13:41:55.032 INFO:tasks.workunit.client.1.smithi110.stdout:4/251: rename d0/d19/l3c to d0/d19/l51 0 2024-04-12T13:41:55.032 INFO:tasks.workunit.client.1.smithi110.stdout:1/151: creat de/d15/d32/f39 x:0 0 0 2024-04-12T13:41:55.033 INFO:tasks.workunit.client.1.smithi110.stdout:5/131: write da/db/d15/f2b [905858,96849] 0 2024-04-12T13:41:55.033 INFO:tasks.workunit.client.1.smithi110.stdout:4/252: stat d0/de/d32/c3e 0 2024-04-12T13:41:55.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:54 smithi060 ceph-mon[29097]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:55.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:54 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3213760044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:41:55.036 INFO:tasks.workunit.client.0.smithi060.stdout:1/191: dread d1e/f33 [0,4194304] 0 2024-04-12T13:41:55.038 INFO:tasks.workunit.client.0.smithi060.stdout:1/192: readlink d1e/d29/l3b 0 2024-04-12T13:41:55.038 INFO:tasks.workunit.client.0.smithi060.stdout:8/196: dread d9/d1b/d2b/f32 [0,4194304] 0 2024-04-12T13:41:55.038 INFO:tasks.workunit.client.0.smithi060.stdout:9/138: link d4/d8/fa d4/f2d 0 2024-04-12T13:41:55.039 INFO:tasks.workunit.client.0.smithi060.stdout:1/193: readlink l8 0 2024-04-12T13:41:55.040 INFO:tasks.workunit.client.0.smithi060.stdout:4/210: write d6/d7/dd/df/f37 [462959,38965] 0 2024-04-12T13:41:55.041 INFO:tasks.workunit.client.0.smithi060.stdout:9/139: write d4/d9/f2a [1440584,97237] 0 2024-04-12T13:41:55.043 INFO:tasks.workunit.client.0.smithi060.stdout:7/195: rmdir d0/d1b 39 2024-04-12T13:41:55.045 INFO:tasks.workunit.client.1.smithi110.stdout:8/160: truncate d1/d5/f28 998200 0 2024-04-12T13:41:55.046 INFO:tasks.workunit.client.0.smithi060.stdout:9/140: dread - d4/d25/f2b zero size 2024-04-12T13:41:55.047 INFO:tasks.workunit.client.1.smithi110.stdout:1/152: creat de/d14/f3a x:0 0 0 2024-04-12T13:41:55.049 INFO:tasks.workunit.client.0.smithi060.stdout:5/237: unlink d6/dd/d1f/d25/f49 0 2024-04-12T13:41:55.050 INFO:tasks.workunit.client.0.smithi060.stdout:5/238: fdatasync d6/dd/f45 0 2024-04-12T13:41:55.051 INFO:tasks.workunit.client.1.smithi110.stdout:5/132: unlink da/db/ff 0 2024-04-12T13:41:55.053 INFO:tasks.workunit.client.1.smithi110.stdout:9/251: truncate df/d13/d2c/f3f 3530079 0 2024-04-12T13:41:55.054 INFO:tasks.workunit.client.1.smithi110.stdout:4/253: creat d0/d13/f52 x:0 0 0 2024-04-12T13:41:55.054 INFO:tasks.workunit.client.1.smithi110.stdout:9/252: stat df/d13/c30 0 2024-04-12T13:41:55.055 INFO:tasks.workunit.client.1.smithi110.stdout:4/254: chown d0/d19/d1c 130556949 1 2024-04-12T13:41:55.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/276: mknod d1/c65 0 2024-04-12T13:41:55.058 INFO:tasks.workunit.client.1.smithi110.stdout:0/144: write d1/f2f [3516078,18980] 0 2024-04-12T13:41:55.059 INFO:tasks.workunit.client.1.smithi110.stdout:3/169: getdents d5/dc/d33 0 2024-04-12T13:41:55.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/189: link d7/d17/l32 d7/d17/l37 0 2024-04-12T13:41:55.061 INFO:tasks.workunit.client.1.smithi110.stdout:1/153: dwrite de/d14/f3a [0,4194304] 0 2024-04-12T13:41:55.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/255: creat d0/d19/d26/f53 x:0 0 0 2024-04-12T13:41:55.066 INFO:tasks.workunit.client.0.smithi060.stdout:4/211: dwrite d6/f30 [0,4194304] 0 2024-04-12T13:41:55.069 INFO:tasks.workunit.client.0.smithi060.stdout:7/196: symlink d0/d7/d43/l4b 0 2024-04-12T13:41:55.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/212: write d6/d7/dd/d1a/d19/f33 [1853978,125680] 0 2024-04-12T13:41:55.075 INFO:tasks.workunit.client.1.smithi110.stdout:0/145: dread d1/f14 [4194304,4194304] 0 2024-04-12T13:41:55.078 INFO:tasks.workunit.client.1.smithi110.stdout:5/133: creat da/db/d15/d17/d29/f2d x:0 0 0 2024-04-12T13:41:55.082 INFO:tasks.workunit.client.1.smithi110.stdout:1/154: rename de/l20 to de/d15/d32/l3b 0 2024-04-12T13:41:55.083 INFO:tasks.workunit.client.1.smithi110.stdout:1/155: fdatasync de/f10 0 2024-04-12T13:41:55.084 INFO:tasks.workunit.client.1.smithi110.stdout:6/235: sync 2024-04-12T13:41:55.084 INFO:tasks.workunit.client.1.smithi110.stdout:2/182: sync 2024-04-12T13:41:55.087 INFO:tasks.workunit.client.1.smithi110.stdout:2/183: stat d6/d18/d19/c2d 0 2024-04-12T13:41:55.087 INFO:tasks.workunit.client.1.smithi110.stdout:8/161: dread d1/d5/f28 [0,4194304] 0 2024-04-12T13:41:55.089 INFO:tasks.workunit.client.1.smithi110.stdout:8/162: chown d1/l1e 0 1 2024-04-12T13:41:55.089 INFO:tasks.workunit.client.1.smithi110.stdout:9/253: dread df/d13/f27 [0,4194304] 0 2024-04-12T13:41:55.091 INFO:tasks.workunit.client.0.smithi060.stdout:5/239: mkdir d6/dd/d1f/d25/d53 0 2024-04-12T13:41:55.093 INFO:tasks.workunit.client.0.smithi060.stdout:5/240: fsync d6/d10/f2a 0 2024-04-12T13:41:55.094 INFO:tasks.workunit.client.0.smithi060.stdout:6/277: dread d1/f15 [0,4194304] 0 2024-04-12T13:41:55.097 INFO:tasks.workunit.client.0.smithi060.stdout:0/190: creat d7/d9/d14/d35/d3c/f42 x:0 0 0 2024-04-12T13:41:55.099 INFO:tasks.workunit.client.0.smithi060.stdout:9/141: dread d4/d9/d19/d21/f1c [0,4194304] 0 2024-04-12T13:41:55.099 INFO:tasks.workunit.client.0.smithi060.stdout:4/213: dwrite d6/d21/f27 [0,4194304] 0 2024-04-12T13:41:55.100 INFO:tasks.workunit.client.0.smithi060.stdout:4/214: fsync d6/f30 0 2024-04-12T13:41:55.101 INFO:tasks.workunit.client.1.smithi110.stdout:8/163: dwrite d1/d3/f24 [0,4194304] 0 2024-04-12T13:41:55.106 INFO:tasks.workunit.client.0.smithi060.stdout:8/197: fsync f2 0 2024-04-12T13:41:55.106 INFO:tasks.workunit.client.0.smithi060.stdout:8/198: read - d9/f3b zero size 2024-04-12T13:41:55.109 INFO:tasks.workunit.client.0.smithi060.stdout:6/278: truncate d1/d7/da/dc/d24/d30/d52/d5e/f63 383250 0 2024-04-12T13:41:55.111 INFO:tasks.workunit.client.0.smithi060.stdout:8/199: read d9/d1d/f33 [63368,111681] 0 2024-04-12T13:41:55.114 INFO:tasks.workunit.client.0.smithi060.stdout:1/194: mkdir d1e/d46 0 2024-04-12T13:41:55.123 INFO:tasks.workunit.client.1.smithi110.stdout:2/184: symlink d6/d18/l31 0 2024-04-12T13:41:55.124 INFO:tasks.workunit.client.0.smithi060.stdout:8/200: read d9/f2c [1092844,124326] 0 2024-04-12T13:41:55.128 INFO:tasks.workunit.client.0.smithi060.stdout:5/241: creat d6/dd/d1f/d25/d35/f54 x:0 0 0 2024-04-12T13:41:55.133 INFO:tasks.workunit.client.0.smithi060.stdout:5/242: fsync d6/dd/d1f/d25/d35/f39 0 2024-04-12T13:41:55.139 INFO:tasks.workunit.client.0.smithi060.stdout:6/279: dwrite d1/d7/da/dc/f3b [0,4194304] 0 2024-04-12T13:41:55.139 INFO:tasks.workunit.client.0.smithi060.stdout:0/191: creat d7/d9/de/f43 x:0 0 0 2024-04-12T13:41:55.150 INFO:tasks.workunit.client.0.smithi060.stdout:6/280: truncate d1/d7/da/dc/d24/d2d/f5a 551945 0 2024-04-12T13:41:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.148+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d40107b50 con 0x7f0d40066290 2024-04-12T13:41:55.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.149+0000 7f0d37e00700 1 -- 172.21.15.60:0/4087009781 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f0d300574b0 con 0x7f0d40066290 2024-04-12T13:41:55.153 INFO:tasks.workunit.client.0.smithi060.stdout:4/215: chown d6/d7/dd/d1a/d19/c2b 28 1 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:41:55.153 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:41:55.154 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:55.155 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.152+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 msgr2=0x7f0d2406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.152+0000 7f0d46a00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 0x7f0d2406e1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00b020 tx=0x7f0d2c009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.152+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 msgr2=0x7f0d40114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.152+0000 7f0d46a00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 0x7f0d40114050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000b550 tx=0x7f0d300091a0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 shutdown_connections 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f0d2406bcf0 0x7f0d2406e1a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d40066290 0x7f0d40114050 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 --2- 172.21.15.60:0/4087009781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d400fffd0 0x7f0d40114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 >> 172.21.15.60:0/4087009781 conn(0x7f0d400f74c0 msgr2=0x7f0d400f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:55.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 shutdown_connections 2024-04-12T13:41:55.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.153+0000 7f0d46a00700 1 -- 172.21.15.60:0/4087009781 wait complete. 2024-04-12T13:41:55.157 INFO:tasks.workunit.client.0.smithi060.stdout:9/142: dread d4/d9/fc [0,4194304] 0 2024-04-12T13:41:55.157 INFO:tasks.workunit.client.0.smithi060.stdout:9/143: read d4/f1f [1290174,59408] 0 2024-04-12T13:41:55.157 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:41:55.161 INFO:tasks.workunit.client.0.smithi060.stdout:0/192: mkdir d7/d9/d14/d35/d44 0 2024-04-12T13:41:55.163 INFO:tasks.workunit.client.0.smithi060.stdout:3/190: creat d7/f38 x:0 0 0 2024-04-12T13:41:55.163 INFO:tasks.workunit.client.0.smithi060.stdout:5/243: dread d6/f20 [0,4194304] 0 2024-04-12T13:41:55.164 INFO:tasks.workunit.client.0.smithi060.stdout:6/281: creat d1/d7/da/dc/d24/d2d/f66 x:0 0 0 2024-04-12T13:41:55.165 INFO:tasks.workunit.client.0.smithi060.stdout:5/244: stat d6/d10/d12/d38/f3c 0 2024-04-12T13:41:55.166 INFO:tasks.workunit.client.0.smithi060.stdout:6/282: stat d1/d7/da/d20/f4a 0 2024-04-12T13:41:55.168 INFO:tasks.workunit.client.0.smithi060.stdout:4/216: fdatasync d6/d21/f2d 0 2024-04-12T13:41:55.170 INFO:tasks.workunit.client.0.smithi060.stdout:9/144: unlink d4/c20 0 2024-04-12T13:41:55.171 INFO:tasks.workunit.client.0.smithi060.stdout:9/145: read d4/d9/d19/d21/f1c [3408981,22260] 0 2024-04-12T13:41:55.172 INFO:tasks.workunit.client.0.smithi060.stdout:1/195: symlink d1e/d23/d2e/l47 0 2024-04-12T13:41:55.172 INFO:tasks.workunit.client.0.smithi060.stdout:8/201: write d9/d1b/d2b/f32 [1485874,124173] 0 2024-04-12T13:41:55.174 INFO:tasks.workunit.client.0.smithi060.stdout:9/146: dread - d4/d9/d19/d21/f27 zero size 2024-04-12T13:41:55.174 INFO:tasks.workunit.client.0.smithi060.stdout:1/196: stat d1e/d23/d2e/d30/f36 0 2024-04-12T13:41:55.188 INFO:tasks.workunit.client.0.smithi060.stdout:2/176: sync 2024-04-12T13:41:55.190 INFO:tasks.workunit.client.0.smithi060.stdout:0/193: rename d7/d9/d14/d35/f3f to d7/d9/d14/d35/d3c/f45 0 2024-04-12T13:41:55.191 INFO:tasks.workunit.client.0.smithi060.stdout:5/245: symlink d6/dd/d1f/d32/l55 0 2024-04-12T13:41:55.196 INFO:tasks.workunit.client.0.smithi060.stdout:6/283: creat d1/d7/da/dc/d24/d30/d52/d5e/f67 x:0 0 0 2024-04-12T13:41:55.196 INFO:tasks.workunit.client.0.smithi060.stdout:4/217: creat d6/d7/db/f4b x:0 0 0 2024-04-12T13:41:55.196 INFO:tasks.workunit.client.1.smithi110.stdout:9/254: symlink df/d13/d2c/d2d/d39/d4f/l5c 0 2024-04-12T13:41:55.197 INFO:tasks.workunit.client.0.smithi060.stdout:8/202: symlink d9/d1b/l42 0 2024-04-12T13:41:55.197 INFO:tasks.workunit.client.0.smithi060.stdout:9/147: rmdir d4/d9 39 2024-04-12T13:41:55.197 INFO:tasks.workunit.client.1.smithi110.stdout:0/146: mkdir d1/d27/d31 0 2024-04-12T13:41:55.198 INFO:tasks.workunit.client.0.smithi060.stdout:2/177: mkdir d6/d10/d2b/d35 0 2024-04-12T13:41:55.199 INFO:tasks.workunit.client.1.smithi110.stdout:0/147: chown d1 2493 1 2024-04-12T13:41:55.199 INFO:tasks.workunit.client.1.smithi110.stdout:5/134: mkdir da/d2e 0 2024-04-12T13:41:55.200 INFO:tasks.workunit.client.1.smithi110.stdout:6/236: unlink d7/d10/d1c/f27 0 2024-04-12T13:41:55.201 INFO:tasks.workunit.client.0.smithi060.stdout:7/197: getdents d0/d1b 0 2024-04-12T13:41:55.201 INFO:tasks.workunit.client.0.smithi060.stdout:1/197: creat d1e/d46/f48 x:0 0 0 2024-04-12T13:41:55.201 INFO:tasks.workunit.client.0.smithi060.stdout:4/218: read f2 [881483,20577] 0 2024-04-12T13:41:55.202 INFO:tasks.workunit.client.1.smithi110.stdout:8/164: symlink d1/d7/d20/l2e 0 2024-04-12T13:41:55.204 INFO:tasks.workunit.client.1.smithi110.stdout:0/148: chown d1/d8/ff 5 1 2024-04-12T13:41:55.204 INFO:tasks.workunit.client.0.smithi060.stdout:2/178: chown d6/lb 232 1 2024-04-12T13:41:55.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/246: symlink d6/l56 0 2024-04-12T13:41:55.210 INFO:tasks.workunit.client.0.smithi060.stdout:8/203: rename d9/f36 to d9/da/f43 0 2024-04-12T13:41:55.210 INFO:tasks.workunit.client.0.smithi060.stdout:0/194: dwrite d7/d9/f21 [0,4194304] 0 2024-04-12T13:41:55.214 INFO:tasks.workunit.client.0.smithi060.stdout:0/195: chown d7/d9/d14/d35/l3a 1801754 1 2024-04-12T13:41:55.220 INFO:tasks.workunit.client.0.smithi060.stdout:6/284: write d1/d7/da/ff [2372030,44508] 0 2024-04-12T13:41:55.221 INFO:tasks.workunit.client.0.smithi060.stdout:1/198: mkdir d1e/d23/d49 0 2024-04-12T13:41:55.221 INFO:tasks.workunit.client.1.smithi110.stdout:4/256: getdents d0/de/d2c 0 2024-04-12T13:41:55.222 INFO:tasks.workunit.client.0.smithi060.stdout:8/204: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:41:55.223 INFO:tasks.workunit.client.1.smithi110.stdout:2/185: dread d6/dc/dd/fe [0,4194304] 0 2024-04-12T13:41:55.224 INFO:tasks.workunit.client.1.smithi110.stdout:5/135: unlink da/db/d15/c22 0 2024-04-12T13:41:55.225 INFO:tasks.workunit.client.0.smithi060.stdout:4/219: symlink d6/d21/l4c 0 2024-04-12T13:41:55.230 INFO:tasks.workunit.client.1.smithi110.stdout:8/165: dread d1/d5/d1f/f25 [0,4194304] 0 2024-04-12T13:41:55.230 INFO:tasks.workunit.client.0.smithi060.stdout:9/148: write d4/d9/d19/d21/f1c [2672482,125300] 0 2024-04-12T13:41:55.230 INFO:tasks.workunit.client.0.smithi060.stdout:2/179: mkdir d6/d10/d16/d36 0 2024-04-12T13:41:55.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:54 smithi110 ceph-mon[36055]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:55.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:54 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3213760044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:41:55.231 INFO:tasks.workunit.client.0.smithi060.stdout:4/220: stat d6/d21/f2d 0 2024-04-12T13:41:55.231 INFO:tasks.workunit.client.1.smithi110.stdout:7/169: sync 2024-04-12T13:41:55.231 INFO:tasks.workunit.client.1.smithi110.stdout:9/255: dwrite df/d13/d26/f32 [0,4194304] 0 2024-04-12T13:41:55.233 INFO:tasks.workunit.client.1.smithi110.stdout:4/257: symlink d0/de/d32/l54 0 2024-04-12T13:41:55.233 INFO:tasks.workunit.client.0.smithi060.stdout:9/149: write d4/d9/d19/d21/f1c [1129511,71120] 0 2024-04-12T13:41:55.234 INFO:tasks.workunit.client.0.smithi060.stdout:9/150: stat d4/f2d 0 2024-04-12T13:41:55.235 INFO:tasks.workunit.client.0.smithi060.stdout:9/151: readlink d4/d8/l29 0 2024-04-12T13:41:55.238 INFO:tasks.workunit.client.1.smithi110.stdout:6/237: dwrite d7/d25/f46 [0,4194304] 0 2024-04-12T13:41:55.243 INFO:tasks.workunit.client.0.smithi060.stdout:6/285: dwrite d1/d7/da/dc/d24/d2d/f3d [4194304,4194304] 0 2024-04-12T13:41:55.244 INFO:tasks.workunit.client.0.smithi060.stdout:1/199: creat d1e/d1f/f4a x:0 0 0 2024-04-12T13:41:55.245 INFO:tasks.workunit.client.1.smithi110.stdout:5/136: mknod da/db/d15/d17/c2f 0 2024-04-12T13:41:55.246 INFO:tasks.workunit.client.0.smithi060.stdout:8/205: mknod d9/d1b/d37/c44 0 2024-04-12T13:41:55.248 INFO:tasks.workunit.client.0.smithi060.stdout:1/200: write d1e/f2b [160213,122875] 0 2024-04-12T13:41:55.251 INFO:tasks.workunit.client.0.smithi060.stdout:8/206: chown d9/d1d 1989174 1 2024-04-12T13:41:55.254 INFO:tasks.workunit.client.0.smithi060.stdout:4/221: mkdir d6/d7/dd/d4d 0 2024-04-12T13:41:55.255 INFO:tasks.workunit.client.0.smithi060.stdout:5/247: symlink d6/dd/d1f/d25/d35/d50/l57 0 2024-04-12T13:41:55.255 INFO:tasks.workunit.client.1.smithi110.stdout:7/170: dread d1/f1e [0,4194304] 0 2024-04-12T13:41:55.255 INFO:tasks.workunit.client.1.smithi110.stdout:2/186: dwrite d6/f12 [0,4194304] 0 2024-04-12T13:41:55.257 INFO:tasks.workunit.client.1.smithi110.stdout:7/171: write d1/d3/d4/f2e [1208547,121172] 0 2024-04-12T13:41:55.259 INFO:tasks.workunit.client.0.smithi060.stdout:9/152: unlink d4/d9/l24 0 2024-04-12T13:41:55.259 INFO:tasks.workunit.client.1.smithi110.stdout:7/172: write d1/f18 [3395948,20905] 0 2024-04-12T13:41:55.265 INFO:tasks.workunit.client.0.smithi060.stdout:0/196: rmdir d7/d9/d14/d1b 39 2024-04-12T13:41:55.266 INFO:tasks.workunit.client.1.smithi110.stdout:9/256: rename df/d13/d2c/d2d/d39/d54 to df/d13/d2c/d2d/d39/d4f/d58/d5d 0 2024-04-12T13:41:55.266 INFO:tasks.workunit.client.1.smithi110.stdout:0/149: rmdir d1/d8/d30 0 2024-04-12T13:41:55.268 INFO:tasks.workunit.client.1.smithi110.stdout:8/166: creat d1/d5/dd/d23/f2f x:0 0 0 2024-04-12T13:41:55.270 INFO:tasks.workunit.client.1.smithi110.stdout:3/170: sync 2024-04-12T13:41:55.270 INFO:tasks.workunit.client.1.smithi110.stdout:1/156: sync 2024-04-12T13:41:55.270 INFO:tasks.workunit.client.1.smithi110.stdout:0/150: read d1/d8/f21 [2022457,97631] 0 2024-04-12T13:41:55.271 INFO:tasks.workunit.client.0.smithi060.stdout:2/180: link d6/d13/d17/d21/f2d d6/d10/d16/f37 0 2024-04-12T13:41:55.272 INFO:tasks.workunit.client.1.smithi110.stdout:8/167: write d1/d3/f24 [472657,90998] 0 2024-04-12T13:41:55.274 INFO:tasks.workunit.client.1.smithi110.stdout:7/173: dread d1/d3/f11 [0,4194304] 0 2024-04-12T13:41:55.274 INFO:tasks.workunit.client.1.smithi110.stdout:2/187: dwrite d6/f12 [0,4194304] 0 2024-04-12T13:41:55.274 INFO:tasks.workunit.client.1.smithi110.stdout:3/171: truncate d5/dc/f2e 673834 0 2024-04-12T13:41:55.275 INFO:tasks.workunit.client.1.smithi110.stdout:2/188: stat f4 0 2024-04-12T13:41:55.276 INFO:tasks.workunit.client.1.smithi110.stdout:3/172: truncate d5/dc/f24 665441 0 2024-04-12T13:41:55.278 INFO:tasks.workunit.client.0.smithi060.stdout:9/153: dread d4/d8/f2c [0,4194304] 0 2024-04-12T13:41:55.281 INFO:tasks.workunit.client.1.smithi110.stdout:4/258: symlink d0/d19/d1c/d50/l55 0 2024-04-12T13:41:55.282 INFO:tasks.workunit.client.0.smithi060.stdout:6/286: creat d1/d7/da/dc/d24/d30/d52/d5e/f68 x:0 0 0 2024-04-12T13:41:55.282 INFO:tasks.workunit.client.0.smithi060.stdout:4/222: dwrite d6/d21/d29/f45 [0,4194304] 0 2024-04-12T13:41:55.282 INFO:tasks.workunit.client.1.smithi110.stdout:4/259: dread - d0/de/d31/f4f zero size 2024-04-12T13:41:55.284 INFO:tasks.workunit.client.0.smithi060.stdout:9/154: read d4/d8/fa [636821,38239] 0 2024-04-12T13:41:55.285 INFO:tasks.workunit.client.0.smithi060.stdout:8/207: rename d9/f23 to d9/d1b/d2b/f45 0 2024-04-12T13:41:55.292 INFO:tasks.workunit.client.0.smithi060.stdout:7/198: getdents d0/d3d 0 2024-04-12T13:41:55.295 INFO:tasks.workunit.client.0.smithi060.stdout:7/199: chown d0/d1b/c2a 98118171 1 2024-04-12T13:41:55.297 INFO:tasks.workunit.client.0.smithi060.stdout:7/200: readlink d0/d7/d43/l4b 0 2024-04-12T13:41:55.301 INFO:tasks.workunit.client.0.smithi060.stdout:1/201: dwrite d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:55.302 INFO:tasks.workunit.client.1.smithi110.stdout:5/137: creat da/d2e/f30 x:0 0 0 2024-04-12T13:41:55.302 INFO:tasks.workunit.client.1.smithi110.stdout:5/138: write da/db/d15/f24 [878597,30131] 0 2024-04-12T13:41:55.303 INFO:tasks.workunit.client.1.smithi110.stdout:1/157: fdatasync f2 0 2024-04-12T13:41:55.304 INFO:tasks.workunit.client.1.smithi110.stdout:3/173: dread d5/dc/f19 [0,4194304] 0 2024-04-12T13:41:55.305 INFO:tasks.workunit.client.0.smithi060.stdout:4/223: rmdir d6/d21 39 2024-04-12T13:41:55.307 INFO:tasks.workunit.client.1.smithi110.stdout:5/139: chown da/db/d15/f1a 7719955 1 2024-04-12T13:41:55.309 INFO:tasks.workunit.client.1.smithi110.stdout:0/151: fdatasync d1/d8/f2e 0 2024-04-12T13:41:55.310 INFO:tasks.workunit.client.1.smithi110.stdout:5/140: write da/db/f23 [1650364,13376] 0 2024-04-12T13:41:55.310 INFO:tasks.workunit.client.1.smithi110.stdout:8/168: mknod d1/d3/c30 0 2024-04-12T13:41:55.312 INFO:tasks.workunit.client.0.smithi060.stdout:1/202: read d1e/d23/d2e/d30/f36 [724878,97824] 0 2024-04-12T13:41:55.318 INFO:tasks.workunit.client.1.smithi110.stdout:6/238: dwrite d7/f19 [0,4194304] 0 2024-04-12T13:41:55.320 INFO:tasks.workunit.client.1.smithi110.stdout:2/189: write d6/dc/dd/f10 [2146602,82826] 0 2024-04-12T13:41:55.320 INFO:tasks.workunit.client.0.smithi060.stdout:9/155: readlink d4/d9/l1e 0 2024-04-12T13:41:55.321 INFO:tasks.workunit.client.0.smithi060.stdout:5/248: mknod d6/dd/d1f/d32/d3d/c58 0 2024-04-12T13:41:55.321 INFO:tasks.workunit.client.0.smithi060.stdout:9/156: dread - d4/d9/d19/d21/f27 zero size 2024-04-12T13:41:55.323 INFO:tasks.workunit.client.0.smithi060.stdout:8/208: write d9/da/f43 [293764,90691] 0 2024-04-12T13:41:55.328 INFO:tasks.workunit.client.0.smithi060.stdout:0/197: mknod d7/c46 0 2024-04-12T13:41:55.328 INFO:tasks.workunit.client.0.smithi060.stdout:8/209: readlink d9/d1b/l2a 0 2024-04-12T13:41:55.330 INFO:tasks.workunit.client.0.smithi060.stdout:8/210: readlink d9/d1b/l29 0 2024-04-12T13:41:55.333 INFO:tasks.workunit.client.0.smithi060.stdout:2/181: mknod d6/c38 0 2024-04-12T13:41:55.334 INFO:tasks.workunit.client.0.smithi060.stdout:0/198: write d7/d9/d14/f34 [142044,82952] 0 2024-04-12T13:41:55.336 INFO:tasks.workunit.client.0.smithi060.stdout:2/182: chown d6/f8 761106 1 2024-04-12T13:41:55.338 INFO:tasks.workunit.client.0.smithi060.stdout:2/183: fsync d6/d13/f34 0 2024-04-12T13:41:55.340 INFO:tasks.workunit.client.0.smithi060.stdout:1/203: dwrite d1e/f2b [0,4194304] 0 2024-04-12T13:41:55.341 INFO:tasks.workunit.client.0.smithi060.stdout:4/224: fsync d6/f2e 0 2024-04-12T13:41:55.344 INFO:tasks.workunit.client.0.smithi060.stdout:1/204: read - d1e/d1f/f4a zero size 2024-04-12T13:41:55.347 INFO:tasks.workunit.client.0.smithi060.stdout:9/157: unlink d4/d9/l1e 0 2024-04-12T13:41:55.348 INFO:tasks.workunit.client.0.smithi060.stdout:4/225: write d6/d7/dd/d1a/d19/f1f [6825546,95664] 0 2024-04-12T13:41:55.351 INFO:tasks.workunit.client.0.smithi060.stdout:4/226: write d6/f3a [55864,110100] 0 2024-04-12T13:41:55.353 INFO:tasks.workunit.client.1.smithi110.stdout:7/174: dwrite d1/f5 [0,4194304] 0 2024-04-12T13:41:55.356 INFO:tasks.workunit.client.1.smithi110.stdout:0/152: creat d1/d27/f32 x:0 0 0 2024-04-12T13:41:55.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/287: rename d1/d7/da/dc/d24/d30/d52/c56 to d1/d7/da/dc/d24/d30/d52/d5e/c69 0 2024-04-12T13:41:55.360 INFO:tasks.workunit.client.1.smithi110.stdout:8/169: mkdir d1/d5/dd/d31 0 2024-04-12T13:41:55.361 INFO:tasks.workunit.client.1.smithi110.stdout:5/141: creat da/db/f31 x:0 0 0 2024-04-12T13:41:55.364 INFO:tasks.workunit.client.1.smithi110.stdout:4/260: mknod d0/c56 0 2024-04-12T13:41:55.365 INFO:tasks.workunit.client.0.smithi060.stdout:2/184: stat d6/c7 0 2024-04-12T13:41:55.365 INFO:tasks.workunit.client.1.smithi110.stdout:5/142: write da/db/d15/d17/d25/f2a [699129,84858] 0 2024-04-12T13:41:55.365 INFO:tasks.workunit.client.1.smithi110.stdout:2/190: creat d6/d18/d20/f32 x:0 0 0 2024-04-12T13:41:55.366 INFO:tasks.workunit.client.1.smithi110.stdout:9/257: creat df/d13/f5e x:0 0 0 2024-04-12T13:41:55.367 INFO:tasks.workunit.client.0.smithi060.stdout:9/158: creat d4/d8/f2e x:0 0 0 2024-04-12T13:41:55.369 INFO:tasks.workunit.client.0.smithi060.stdout:9/159: fdatasync d4/d8/f2e 0 2024-04-12T13:41:55.370 INFO:tasks.workunit.client.1.smithi110.stdout:9/258: dread fa [0,4194304] 0 2024-04-12T13:41:55.371 INFO:tasks.workunit.client.1.smithi110.stdout:9/259: chown df/f24 626 1 2024-04-12T13:41:55.371 INFO:tasks.workunit.client.0.smithi060.stdout:5/249: rename d6/d10/d12/f43 to d6/dd/d1f/d32/d3d/f59 0 2024-04-12T13:41:55.372 INFO:tasks.workunit.client.0.smithi060.stdout:5/250: chown d6/d10/d12/d4c 13 1 2024-04-12T13:41:55.378 INFO:tasks.workunit.client.0.smithi060.stdout:8/211: mknod d9/c46 0 2024-04-12T13:41:55.379 INFO:tasks.workunit.client.1.smithi110.stdout:7/175: creat d1/f38 x:0 0 0 2024-04-12T13:41:55.380 INFO:tasks.workunit.client.0.smithi060.stdout:8/212: truncate d9/fc 4440544 0 2024-04-12T13:41:55.381 INFO:tasks.workunit.client.0.smithi060.stdout:7/201: creat d0/f4c x:0 0 0 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 -- 172.21.15.60:0/2582387007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 msgr2=0x7f8e70007400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2582387007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e70007400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004940 tx=0x7f8e64009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 -- 172.21.15.60:0/2582387007 shutdown_connections 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2582387007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e70007400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2582387007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e70008540 0x7f8e70006a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.380+0000 7f8e7da00700 1 -- 172.21.15.60:0/2582387007 >> 172.21.15.60:0/2582387007 conn(0x7f8e70090320 msgr2=0x7f8e70092750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:55.383 INFO:tasks.workunit.client.0.smithi060.stdout:7/202: chown d0/d7/f6 7216875 1 2024-04-12T13:41:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.383+0000 7f8e7da00700 1 -- 172.21.15.60:0/2582387007 shutdown_connections 2024-04-12T13:41:55.385 INFO:tasks.workunit.client.1.smithi110.stdout:0/153: mknod d1/d8/c33 0 2024-04-12T13:41:55.385 INFO:tasks.workunit.client.1.smithi110.stdout:8/170: creat d1/d7/f32 x:0 0 0 2024-04-12T13:41:55.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.383+0000 7f8e7da00700 1 -- 172.21.15.60:0/2582387007 wait complete. 2024-04-12T13:41:55.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.384+0000 7f8e7da00700 1 Processor -- start 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.385+0000 7f8e7da00700 1 -- start start 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.385+0000 7f8e7da00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.385+0000 7f8e7da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e70008540 0x7f8e700a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.385+0000 7f8e7da00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700a3fa0 con 0x7f8e70006f90 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.385+0000 7f8e7da00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700a4110 con 0x7f8e70008540 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.386+0000 7f8e77e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.386+0000 7f8e77e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37588/0 (socket says 172.21.15.60:37588) 2024-04-12T13:41:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.386+0000 7f8e77e00700 1 -- 172.21.15.60:0/2458533732 learned_addr learned my addr 172.21.15.60:0/2458533732 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.386+0000 7f8e77e00700 1 -- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e70008540 msgr2=0x7f8e700a39a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T13:41:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.387+0000 7f8e77e00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e70008540 0x7f8e700a39a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.387+0000 7f8e77e00700 1 -- 172.21.15.60:0/2458533732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64005040 con 0x7f8e70006f90 2024-04-12T13:41:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.387+0000 7f8e77e00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c002a80 tx=0x7f8e6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:55.390 INFO:tasks.workunit.client.1.smithi110.stdout:6/239: chown d7/d25/d30/d44/d3d 63552959 1 2024-04-12T13:41:55.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.388+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6c007cc0 con 0x7f8e70006f90 2024-04-12T13:41:55.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.388+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e6c00f040 con 0x7f8e70006f90 2024-04-12T13:41:55.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.388+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6c00dad0 con 0x7f8e70006f90 2024-04-12T13:41:55.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.388+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700a8b70 con 0x7f8e70006f90 2024-04-12T13:41:55.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.388+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e700a9130 con 0x7f8e70006f90 2024-04-12T13:41:55.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.390+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70098f10 con 0x7f8e70006f90 2024-04-12T13:41:55.392 INFO:tasks.workunit.client.1.smithi110.stdout:2/191: creat d6/dc/f33 x:0 0 0 2024-04-12T13:41:55.392 INFO:tasks.workunit.client.1.smithi110.stdout:6/240: read - d7/d25/d30/d44/d3d/f47 zero size 2024-04-12T13:41:55.393 INFO:tasks.workunit.client.1.smithi110.stdout:1/158: dwrite de/f1b [0,4194304] 0 2024-04-12T13:41:55.394 INFO:tasks.workunit.client.0.smithi060.stdout:6/288: dwrite d1/d7/da/d20/f4a [0,4194304] 0 2024-04-12T13:41:55.394 INFO:tasks.workunit.client.1.smithi110.stdout:6/241: read d7/f19 [1926121,91632] 0 2024-04-12T13:41:55.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/227: chown d6/d21/c3d 66 1 2024-04-12T13:41:55.397 INFO:tasks.workunit.client.1.smithi110.stdout:4/261: unlink d0/d19/l42 0 2024-04-12T13:41:55.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.395+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f8e6c00dc30 con 0x7f8e70006f90 2024-04-12T13:41:55.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.397+0000 7f8e6be00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 0x7f8e6006e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:55.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.397+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8e6c08ae30 con 0x7f8e70006f90 2024-04-12T13:41:55.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.398+0000 7f8e77400700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 0x7f8e6006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:55.400 INFO:tasks.workunit.client.0.smithi060.stdout:4/228: dread - d6/d7/db/f4b zero size 2024-04-12T13:41:55.401 INFO:tasks.workunit.client.1.smithi110.stdout:4/262: truncate d0/d13/f52 1048114 0 2024-04-12T13:41:55.401 INFO:tasks.workunit.client.0.smithi060.stdout:9/160: creat d4/d9/d19/d21/f2f x:0 0 0 2024-04-12T13:41:55.402 INFO:tasks.workunit.client.1.smithi110.stdout:5/143: mkdir da/db/d15/d17/d29/d32 0 2024-04-12T13:41:55.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.400+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f8e6c057f50 con 0x7f8e70006f90 2024-04-12T13:41:55.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.401+0000 7f8e77400700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 0x7f8e6006e380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004f90 tx=0x7f8e64009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:55.403 INFO:tasks.workunit.client.0.smithi060.stdout:1/205: write d1e/f31 [1381090,89873] 0 2024-04-12T13:41:55.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/174: link l4 d5/dc/d20/d2b/d32/l38 0 2024-04-12T13:41:55.407 INFO:tasks.workunit.client.1.smithi110.stdout:3/175: chown d5/l10 2 1 2024-04-12T13:41:55.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/199: rename d7/d9/de/l15 to d7/d41/l47 0 2024-04-12T13:41:55.410 INFO:tasks.workunit.client.1.smithi110.stdout:0/154: creat d1/d8/f34 x:0 0 0 2024-04-12T13:41:55.411 INFO:tasks.workunit.client.0.smithi060.stdout:9/161: chown d4/d9/fc 19408800 1 2024-04-12T13:41:55.412 INFO:tasks.workunit.client.1.smithi110.stdout:8/171: chown d1/d5/c2c 60 1 2024-04-12T13:41:55.413 INFO:tasks.workunit.client.1.smithi110.stdout:2/192: symlink d6/dc/l34 0 2024-04-12T13:41:55.414 INFO:tasks.workunit.client.0.smithi060.stdout:2/185: creat d6/d13/d31/d33/f39 x:0 0 0 2024-04-12T13:41:55.416 INFO:tasks.workunit.client.0.smithi060.stdout:6/289: readlink d1/d2c/l33 0 2024-04-12T13:41:55.417 INFO:tasks.workunit.client.1.smithi110.stdout:6/242: dread d7/d25/d2c/f40 [0,4194304] 0 2024-04-12T13:41:55.417 INFO:tasks.workunit.client.0.smithi060.stdout:1/206: creat d1e/d1f/f4b x:0 0 0 2024-04-12T13:41:55.417 INFO:tasks.workunit.client.0.smithi060.stdout:7/203: dwrite d0/d1b/f31 [0,4194304] 0 2024-04-12T13:41:55.418 INFO:tasks.workunit.client.1.smithi110.stdout:5/144: creat da/d2e/f33 x:0 0 0 2024-04-12T13:41:55.419 INFO:tasks.workunit.client.1.smithi110.stdout:1/159: dwrite de/f2f [0,4194304] 0 2024-04-12T13:41:55.425 INFO:tasks.workunit.client.0.smithi060.stdout:5/251: rename d6/dd/d1f/d32/d3d/f59 to d6/d10/d12/d38/f5a 0 2024-04-12T13:41:55.433 INFO:tasks.workunit.client.0.smithi060.stdout:8/213: dwrite d9/d1b/d2b/f45 [0,4194304] 0 2024-04-12T13:41:55.435 INFO:tasks.workunit.client.1.smithi110.stdout:4/263: mkdir d0/de/d2c/d57 0 2024-04-12T13:41:55.436 INFO:tasks.workunit.client.1.smithi110.stdout:3/176: dwrite d5/dc/d20/f36 [0,4194304] 0 2024-04-12T13:41:55.436 INFO:tasks.workunit.client.1.smithi110.stdout:9/260: symlink df/d13/l5f 0 2024-04-12T13:41:55.437 INFO:tasks.workunit.client.0.smithi060.stdout:4/229: creat d6/d47/f4e x:0 0 0 2024-04-12T13:41:55.439 INFO:tasks.workunit.client.1.smithi110.stdout:4/264: truncate d0/de/d2c/f4d 737583 0 2024-04-12T13:41:55.439 INFO:tasks.workunit.client.1.smithi110.stdout:7/176: rename d1/d3/l1a to d1/d3/d4/d36/l39 0 2024-04-12T13:41:55.440 INFO:tasks.workunit.client.1.smithi110.stdout:1/160: dread de/f30 [0,4194304] 0 2024-04-12T13:41:55.440 INFO:tasks.workunit.client.1.smithi110.stdout:7/177: fsync d1/f23 0 2024-04-12T13:41:55.444 INFO:tasks.workunit.client.1.smithi110.stdout:4/265: dread d0/d19/d26/f40 [0,4194304] 0 2024-04-12T13:41:55.445 INFO:tasks.workunit.client.1.smithi110.stdout:4/266: chown d0/de/c1e 104817695 1 2024-04-12T13:41:55.446 INFO:tasks.workunit.client.1.smithi110.stdout:4/267: readlink d0/de/d2c/l1b 0 2024-04-12T13:41:55.447 INFO:tasks.workunit.client.0.smithi060.stdout:8/214: dread d9/d1d/d2f/f30 [0,4194304] 0 2024-04-12T13:41:55.448 INFO:tasks.workunit.client.1.smithi110.stdout:4/268: chown d0/d19/f23 131 1 2024-04-12T13:41:55.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/186: symlink d6/d13/d31/d33/l3a 0 2024-04-12T13:41:55.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/187: chown d6/f15 85143533 1 2024-04-12T13:41:55.454 INFO:tasks.workunit.client.0.smithi060.stdout:2/188: chown d6/d10/d16/d36 6 1 2024-04-12T13:41:55.455 INFO:tasks.workunit.client.0.smithi060.stdout:2/189: read - d6/d13/f34 zero size 2024-04-12T13:41:55.457 INFO:tasks.workunit.client.0.smithi060.stdout:6/290: mkdir d1/d7/da/d20/d6a 0 2024-04-12T13:41:55.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/190: dread - d6/d10/d16/d26/f28 zero size 2024-04-12T13:41:55.457 INFO:tasks.workunit.client.0.smithi060.stdout:9/162: write d4/f2d [3560409,49243] 0 2024-04-12T13:41:55.460 INFO:tasks.workunit.client.0.smithi060.stdout:2/191: chown d6/f19 1159438650 1 2024-04-12T13:41:55.463 INFO:tasks.workunit.client.1.smithi110.stdout:4/269: dwrite d0/d19/f2e [0,4194304] 0 2024-04-12T13:41:55.464 INFO:tasks.workunit.client.0.smithi060.stdout:2/192: write d6/d10/d16/d26/f28 [786623,89665] 0 2024-04-12T13:41:55.465 INFO:tasks.workunit.client.0.smithi060.stdout:1/207: creat d1e/d29/d37/f4c x:0 0 0 2024-04-12T13:41:55.466 INFO:tasks.workunit.client.0.smithi060.stdout:5/252: truncate f1 5072815 0 2024-04-12T13:41:55.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/253: chown d6/dd/d1f/d25/d53 15082 1 2024-04-12T13:41:55.469 INFO:tasks.workunit.client.0.smithi060.stdout:9/163: fdatasync d4/d8/fa 0 2024-04-12T13:41:55.471 INFO:tasks.workunit.client.1.smithi110.stdout:5/145: symlink da/db/l34 0 2024-04-12T13:41:55.472 INFO:tasks.workunit.client.1.smithi110.stdout:8/172: write d1/d5/f28 [337003,101749] 0 2024-04-12T13:41:55.475 INFO:tasks.workunit.client.1.smithi110.stdout:8/173: dread - d1/d5/dd/d23/f2f zero size 2024-04-12T13:41:55.477 INFO:tasks.workunit.client.0.smithi060.stdout:8/215: creat d9/d1b/f47 x:0 0 0 2024-04-12T13:41:55.479 INFO:tasks.workunit.client.1.smithi110.stdout:3/177: mknod d5/dc/d20/d2b/d32/c39 0 2024-04-12T13:41:55.479 INFO:tasks.workunit.client.1.smithi110.stdout:9/261: mkdir df/d13/d2c/d2d/d39/d60 0 2024-04-12T13:41:55.481 INFO:tasks.workunit.client.1.smithi110.stdout:4/270: dwrite d0/d13/f2a [4194304,4194304] 0 2024-04-12T13:41:55.482 INFO:tasks.workunit.client.1.smithi110.stdout:1/161: symlink de/d14/l3c 0 2024-04-12T13:41:55.483 INFO:tasks.workunit.client.0.smithi060.stdout:9/164: mknod d4/d25/c30 0 2024-04-12T13:41:55.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/200: creat d7/d9/f48 x:0 0 0 2024-04-12T13:41:55.487 INFO:tasks.workunit.client.0.smithi060.stdout:0/201: chown d7/d9/f1e 29519508 1 2024-04-12T13:41:55.491 INFO:tasks.workunit.client.0.smithi060.stdout:5/254: rename d6/d10/d12/c18 to d6/dd/d1f/d32/d46/c5b 0 2024-04-12T13:41:55.492 INFO:tasks.workunit.client.1.smithi110.stdout:0/155: getdents d1/d27/d31 0 2024-04-12T13:41:55.493 INFO:tasks.workunit.client.1.smithi110.stdout:0/156: write d1/d8/ff [1972557,104413] 0 2024-04-12T13:41:55.495 INFO:tasks.workunit.client.1.smithi110.stdout:0/157: readlink d1/d11/l29 0 2024-04-12T13:41:55.496 INFO:tasks.workunit.client.0.smithi060.stdout:5/255: chown d6/dd 19868 1 2024-04-12T13:41:55.499 INFO:tasks.workunit.client.0.smithi060.stdout:8/216: rename d9/d1b/d37/d3e to d9/d1b/d37/d48 0 2024-04-12T13:41:55.500 INFO:tasks.workunit.client.0.smithi060.stdout:4/230: dwrite d6/d21/f2d [0,4194304] 0 2024-04-12T13:41:55.504 INFO:tasks.workunit.client.0.smithi060.stdout:7/204: truncate d0/f1a 172354 0 2024-04-12T13:41:55.505 INFO:tasks.workunit.client.1.smithi110.stdout:8/174: creat d1/d5/dd/d23/f33 x:0 0 0 2024-04-12T13:41:55.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/205: read - d0/d7/f49 zero size 2024-04-12T13:41:55.509 INFO:tasks.workunit.client.0.smithi060.stdout:7/206: readlink d0/l3f 0 2024-04-12T13:41:55.510 INFO:tasks.workunit.client.0.smithi060.stdout:7/207: fsync d0/f47 0 2024-04-12T13:41:55.515 INFO:tasks.workunit.client.1.smithi110.stdout:4/271: fdatasync d0/ff 0 2024-04-12T13:41:55.516 INFO:tasks.workunit.client.0.smithi060.stdout:9/165: rename d4/f1f to d4/d9/d19/d21/f31 0 2024-04-12T13:41:55.519 INFO:tasks.workunit.client.1.smithi110.stdout:7/178: unlink d1/d3/d22/l2f 0 2024-04-12T13:41:55.521 INFO:tasks.workunit.client.1.smithi110.stdout:7/179: truncate d1/d3/d22/f25 349886 0 2024-04-12T13:41:55.522 INFO:tasks.workunit.client.0.smithi060.stdout:0/202: dread d7/f11 [4194304,4194304] 0 2024-04-12T13:41:55.522 INFO:tasks.workunit.client.1.smithi110.stdout:6/243: write d7/d25/d30/d44/f37 [899058,66504] 0 2024-04-12T13:41:55.523 INFO:tasks.workunit.client.1.smithi110.stdout:3/178: dwrite d5/dc/f27 [0,4194304] 0 2024-04-12T13:41:55.524 INFO:tasks.workunit.client.0.smithi060.stdout:1/208: link d1e/d29/f44 d1e/f4d 0 2024-04-12T13:41:55.527 INFO:tasks.workunit.client.0.smithi060.stdout:1/209: write d1e/d23/f43 [603887,102572] 0 2024-04-12T13:41:55.529 INFO:tasks.workunit.client.0.smithi060.stdout:8/217: mknod d9/d1b/d37/c49 0 2024-04-12T13:41:55.530 INFO:tasks.workunit.client.1.smithi110.stdout:0/158: dread - d1/d8/f2e zero size 2024-04-12T13:41:55.531 INFO:tasks.workunit.client.0.smithi060.stdout:8/218: chown d9/d1b/l2a 12286765 1 2024-04-12T13:41:55.532 INFO:tasks.workunit.client.0.smithi060.stdout:8/219: chown d9/d1d/c38 8918 1 2024-04-12T13:41:55.535 INFO:tasks.workunit.client.0.smithi060.stdout:4/231: symlink d6/d7/dd/l4f 0 2024-04-12T13:41:55.538 INFO:tasks.workunit.client.1.smithi110.stdout:2/193: sync 2024-04-12T13:41:55.540 INFO:tasks.workunit.client.1.smithi110.stdout:5/146: mkdir da/d35 0 2024-04-12T13:41:55.540 INFO:tasks.workunit.client.1.smithi110.stdout:2/194: truncate d6/dc/f2b 155749 0 2024-04-12T13:41:55.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/291: getdents d1/d7/da/dc/d24/d34 0 2024-04-12T13:41:55.545 INFO:tasks.workunit.client.0.smithi060.stdout:7/208: mkdir d0/d7/d43/d4d 0 2024-04-12T13:41:55.546 INFO:tasks.workunit.client.1.smithi110.stdout:6/244: rename d7/d25/d30 to d7/d25/d30/d44/d4a 22 2024-04-12T13:41:55.547 INFO:tasks.workunit.client.0.smithi060.stdout:9/166: mkdir d4/d8/d32 0 2024-04-12T13:41:55.548 INFO:tasks.workunit.client.1.smithi110.stdout:7/180: dread d1/f2b [0,4194304] 0 2024-04-12T13:41:55.548 INFO:tasks.workunit.client.1.smithi110.stdout:0/159: dwrite d1/f22 [4194304,4194304] 0 2024-04-12T13:41:55.548 INFO:tasks.workunit.client.1.smithi110.stdout:3/179: mknod d5/dc/c3a 0 2024-04-12T13:41:55.548 INFO:tasks.workunit.client.0.smithi060.stdout:5/256: getdents d6/dd/d1f/d25/d42/d52 0 2024-04-12T13:41:55.549 INFO:tasks.workunit.client.1.smithi110.stdout:7/181: chown d1/f23 26690556 1 2024-04-12T13:41:55.550 INFO:tasks.workunit.client.0.smithi060.stdout:6/292: dread - d1/d7/da/dc/d24/d30/d52/d5e/f67 zero size 2024-04-12T13:41:55.551 INFO:tasks.workunit.client.0.smithi060.stdout:5/257: dread - d6/d10/d12/d38/f47 zero size 2024-04-12T13:41:55.551 INFO:tasks.workunit.client.1.smithi110.stdout:5/147: unlink da/db/f23 0 2024-04-12T13:41:55.552 INFO:tasks.workunit.client.0.smithi060.stdout:1/210: chown d1e/d23/c2a 39 1 2024-04-12T13:41:55.553 INFO:tasks.workunit.client.0.smithi060.stdout:8/220: symlink d9/d1b/d37/l4a 0 2024-04-12T13:41:55.554 INFO:tasks.workunit.client.0.smithi060.stdout:4/232: creat d6/d7/dd/d1a/f50 x:0 0 0 2024-04-12T13:41:55.554 INFO:tasks.workunit.client.0.smithi060.stdout:1/211: write d1e/d1f/f4b [535846,35871] 0 2024-04-12T13:41:55.556 INFO:tasks.workunit.client.1.smithi110.stdout:1/162: link de/c18 de/c3d 0 2024-04-12T13:41:55.557 INFO:tasks.workunit.client.0.smithi060.stdout:0/203: mkdir d7/d9/d14/d35/d44/d49 0 2024-04-12T13:41:55.558 INFO:tasks.workunit.client.1.smithi110.stdout:6/245: chown d7/d25/d30/d44/f21 118749483 1 2024-04-12T13:41:55.558 INFO:tasks.workunit.client.1.smithi110.stdout:1/163: chown f2 7 1 2024-04-12T13:41:55.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/258: write d6/fc [4627706,76009] 0 2024-04-12T13:41:55.560 INFO:tasks.workunit.client.0.smithi060.stdout:8/221: fdatasync f2 0 2024-04-12T13:41:55.564 INFO:tasks.workunit.client.1.smithi110.stdout:7/182: dwrite d1/f5 [0,4194304] 0 2024-04-12T13:41:55.564 INFO:tasks.workunit.client.0.smithi060.stdout:4/233: mkdir d6/d2f/d51 0 2024-04-12T13:41:55.566 INFO:tasks.workunit.client.0.smithi060.stdout:9/167: mkdir d4/d33 0 2024-04-12T13:41:55.567 INFO:tasks.workunit.client.0.smithi060.stdout:4/234: readlink d6/d7/dd/l34 0 2024-04-12T13:41:55.567 INFO:tasks.workunit.client.1.smithi110.stdout:3/180: rename d5/dc/d20/d2b to d5/dc/d31/d3b 0 2024-04-12T13:41:55.568 INFO:tasks.workunit.client.1.smithi110.stdout:8/175: link d1/l10 d1/d5/dd/d23/l34 0 2024-04-12T13:41:55.569 INFO:tasks.workunit.client.1.smithi110.stdout:1/164: creat de/d15/f3e x:0 0 0 2024-04-12T13:41:55.571 INFO:tasks.workunit.client.0.smithi060.stdout:4/235: write d6/d7/db/f22 [2401323,84336] 0 2024-04-12T13:41:55.572 INFO:tasks.workunit.client.0.smithi060.stdout:8/222: creat d9/d1d/d2f/f4b x:0 0 0 2024-04-12T13:41:55.572 INFO:tasks.workunit.client.1.smithi110.stdout:8/176: write d1/d5/dd/d23/f33 [762740,29246] 0 2024-04-12T13:41:55.572 INFO:tasks.workunit.client.1.smithi110.stdout:7/183: creat d1/d3/d4/d36/f3a x:0 0 0 2024-04-12T13:41:55.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/212: mkdir d1e/d23/d49/d4e 0 2024-04-12T13:41:55.576 INFO:tasks.workunit.client.1.smithi110.stdout:8/177: chown d1/d7/l18 1157262 1 2024-04-12T13:41:55.576 INFO:tasks.workunit.client.1.smithi110.stdout:8/178: write d1/d3/fe [8489169,11756] 0 2024-04-12T13:41:55.577 INFO:tasks.workunit.client.0.smithi060.stdout:0/204: mkdir d7/d9/d14/d4a 0 2024-04-12T13:41:55.578 INFO:tasks.workunit.client.0.smithi060.stdout:1/213: stat d1e/d23/f25 0 2024-04-12T13:41:55.578 INFO:tasks.workunit.client.0.smithi060.stdout:4/236: readlink d6/d21/d29/l4a 0 2024-04-12T13:41:55.579 INFO:tasks.workunit.client.1.smithi110.stdout:5/148: creat da/db/d15/d17/d29/d32/f36 x:0 0 0 2024-04-12T13:41:55.582 INFO:tasks.workunit.client.0.smithi060.stdout:6/293: rmdir d1/d7/da/d20/d6a 0 2024-04-12T13:41:55.583 INFO:tasks.workunit.client.0.smithi060.stdout:5/259: dwrite d6/d10/d12/d15/f22 [0,4194304] 0 2024-04-12T13:41:55.584 INFO:tasks.workunit.client.1.smithi110.stdout:0/160: creat d1/f35 x:0 0 0 2024-04-12T13:41:55.585 INFO:tasks.workunit.client.0.smithi060.stdout:5/260: chown d6/dd/d27/l51 156450 1 2024-04-12T13:41:55.587 INFO:tasks.workunit.client.0.smithi060.stdout:9/168: rename f2 to d4/d9/d19/f34 0 2024-04-12T13:41:55.591 INFO:tasks.workunit.client.1.smithi110.stdout:6/246: dread d7/f1a [4194304,4194304] 0 2024-04-12T13:41:55.592 INFO:tasks.workunit.client.0.smithi060.stdout:8/223: creat d9/d1d/f4c x:0 0 0 2024-04-12T13:41:55.593 INFO:tasks.workunit.client.1.smithi110.stdout:3/181: creat d5/dc/d20/d2d/f3c x:0 0 0 2024-04-12T13:41:55.595 INFO:tasks.workunit.client.1.smithi110.stdout:1/165: creat de/d15/f3f x:0 0 0 2024-04-12T13:41:55.597 INFO:tasks.workunit.client.1.smithi110.stdout:2/195: getdents d6/dc/d1b 0 2024-04-12T13:41:55.597 INFO:tasks.workunit.client.1.smithi110.stdout:1/166: read de/f22 [5797,119781] 0 2024-04-12T13:41:55.599 INFO:tasks.workunit.client.0.smithi060.stdout:9/169: dread d4/fd [0,4194304] 0 2024-04-12T13:41:55.600 INFO:tasks.workunit.client.1.smithi110.stdout:7/184: creat d1/d3/d22/f3b x:0 0 0 2024-04-12T13:41:55.602 INFO:tasks.workunit.client.0.smithi060.stdout:4/237: creat d6/d7/dd/d1a/d19/f52 x:0 0 0 2024-04-12T13:41:55.602 INFO:tasks.workunit.client.1.smithi110.stdout:8/179: mkdir d1/d3/d35 0 2024-04-12T13:41:55.603 INFO:tasks.workunit.client.1.smithi110.stdout:9/262: sync 2024-04-12T13:41:55.603 INFO:tasks.workunit.client.0.smithi060.stdout:1/214: dread f14 [0,4194304] 0 2024-04-12T13:41:55.605 INFO:tasks.workunit.client.1.smithi110.stdout:9/263: chown df/d13/d3b/c42 11 1 2024-04-12T13:41:55.608 INFO:tasks.workunit.client.0.smithi060.stdout:5/261: dread d6/dd/d27/f44 [0,4194304] 0 2024-04-12T13:41:55.608 INFO:tasks.workunit.client.1.smithi110.stdout:3/182: dwrite d5/dc/f24 [0,4194304] 0 2024-04-12T13:41:55.609 INFO:tasks.workunit.client.1.smithi110.stdout:9/264: chown df/d13/d3b/d40/c46 3511536 1 2024-04-12T13:41:55.609 INFO:tasks.workunit.client.1.smithi110.stdout:6/247: readlink d7/l22 0 2024-04-12T13:41:55.609 INFO:tasks.workunit.client.0.smithi060.stdout:0/205: mknod d7/d9/d14/d4a/c4b 0 2024-04-12T13:41:55.611 INFO:tasks.workunit.client.1.smithi110.stdout:6/248: read - d7/d10/d1c/f43 zero size 2024-04-12T13:41:55.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/170: mknod d4/d33/c35 0 2024-04-12T13:41:55.624 INFO:tasks.workunit.client.0.smithi060.stdout:3/191: sync 2024-04-12T13:41:55.625 INFO:tasks.workunit.client.0.smithi060.stdout:4/238: dwrite d6/d7/dd/d1a/d19/f52 [0,4194304] 0 2024-04-12T13:41:55.625 INFO:tasks.workunit.client.1.smithi110.stdout:9/265: dwrite df/f1e [4194304,4194304] 0 2024-04-12T13:41:55.626 INFO:tasks.workunit.client.0.smithi060.stdout:4/239: stat d6/d7/dd/df/f23 0 2024-04-12T13:41:55.629 INFO:tasks.workunit.client.0.smithi060.stdout:4/240: read - d6/d7/dd/d1a/f50 zero size 2024-04-12T13:41:55.630 INFO:tasks.workunit.client.0.smithi060.stdout:6/294: creat d1/f6b x:0 0 0 2024-04-12T13:41:55.631 INFO:tasks.workunit.client.1.smithi110.stdout:5/149: dwrite da/db/d15/d17/f19 [0,4194304] 0 2024-04-12T13:41:55.631 INFO:tasks.workunit.client.0.smithi060.stdout:6/295: dread - d1/f6b zero size 2024-04-12T13:41:55.638 INFO:tasks.workunit.client.1.smithi110.stdout:3/183: mknod d5/dc/d31/c3d 0 2024-04-12T13:41:55.640 INFO:tasks.workunit.client.0.smithi060.stdout:1/215: write d1e/d29/f44 [75482,1551] 0 2024-04-12T13:41:55.640 INFO:tasks.workunit.client.0.smithi060.stdout:5/262: fsync d6/d10/d12/d38/f3c 0 2024-04-12T13:41:55.641 INFO:tasks.workunit.client.1.smithi110.stdout:4/272: sync 2024-04-12T13:41:55.645 INFO:tasks.workunit.client.1.smithi110.stdout:0/161: write d1/d8/fb [1865524,89460] 0 2024-04-12T13:41:55.645 INFO:tasks.workunit.client.1.smithi110.stdout:2/196: mknod d6/c35 0 2024-04-12T13:41:55.646 INFO:tasks.workunit.client.1.smithi110.stdout:2/197: chown d6/dc/dd 159974778 1 2024-04-12T13:41:55.648 INFO:tasks.workunit.client.1.smithi110.stdout:2/198: chown d6/dc/dd/f10 4 1 2024-04-12T13:41:55.649 INFO:tasks.workunit.client.1.smithi110.stdout:6/249: truncate d7/f19 855125 0 2024-04-12T13:41:55.651 INFO:tasks.workunit.client.1.smithi110.stdout:2/199: write d6/d18/d19/f2c [862409,122409] 0 2024-04-12T13:41:55.653 INFO:tasks.workunit.client.1.smithi110.stdout:2/200: chown d6/dc/f2b 2648 1 2024-04-12T13:41:55.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/206: mkdir d7/d9/d4c 0 2024-04-12T13:41:55.657 INFO:tasks.workunit.client.1.smithi110.stdout:8/180: link d1/d3/f24 d1/d7/d20/f36 0 2024-04-12T13:41:55.659 INFO:tasks.workunit.client.0.smithi060.stdout:3/192: write d7/d17/d19/f23 [5905828,94680] 0 2024-04-12T13:41:55.661 INFO:tasks.workunit.client.0.smithi060.stdout:4/241: creat d6/d21/f53 x:0 0 0 2024-04-12T13:41:55.665 INFO:tasks.workunit.client.0.smithi060.stdout:6/296: rename d1/d7/da/dc/d24/d34/l3f to d1/d7/da/dc/l6c 0 2024-04-12T13:41:55.667 INFO:tasks.workunit.client.1.smithi110.stdout:9/266: unlink df/d13/d2c/d2d/d39/d3a/l4b 0 2024-04-12T13:41:55.669 INFO:tasks.workunit.client.1.smithi110.stdout:2/201: dwrite d6/dc/dd/f24 [0,4194304] 0 2024-04-12T13:41:55.669 INFO:tasks.workunit.client.0.smithi060.stdout:1/216: unlink d1e/d23/d2e/l47 0 2024-04-12T13:41:55.670 INFO:tasks.workunit.client.0.smithi060.stdout:9/171: dwrite d4/d9/d19/d21/f1c [0,4194304] 0 2024-04-12T13:41:55.672 INFO:tasks.workunit.client.1.smithi110.stdout:2/202: write d6/dc/dd/f28 [307507,67635] 0 2024-04-12T13:41:55.672 INFO:tasks.workunit.client.1.smithi110.stdout:6/250: dread d7/d10/f35 [0,4194304] 0 2024-04-12T13:41:55.673 INFO:tasks.workunit.client.0.smithi060.stdout:9/172: fdatasync d4/d8/f17 0 2024-04-12T13:41:55.673 INFO:tasks.workunit.client.1.smithi110.stdout:5/150: rename da/db/d15/f2b to da/db/f37 0 2024-04-12T13:41:55.676 INFO:tasks.workunit.client.0.smithi060.stdout:9/173: write d4/d8/f17 [584766,101145] 0 2024-04-12T13:41:55.680 INFO:tasks.workunit.client.1.smithi110.stdout:3/184: mkdir d5/dc/d31/d3b/d32/d3e 0 2024-04-12T13:41:55.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/224: getdents d9/da 0 2024-04-12T13:41:55.682 INFO:tasks.workunit.client.1.smithi110.stdout:4/273: creat d0/d19/d1c/f58 x:0 0 0 2024-04-12T13:41:55.684 INFO:tasks.workunit.client.0.smithi060.stdout:0/207: readlink d7/d41/l47 0 2024-04-12T13:41:55.686 INFO:tasks.workunit.client.0.smithi060.stdout:3/193: creat d7/d17/d19/d33/f39 x:0 0 0 2024-04-12T13:41:55.687 INFO:tasks.workunit.client.0.smithi060.stdout:1/217: dread d1e/d23/f25 [0,4194304] 0 2024-04-12T13:41:55.688 INFO:tasks.workunit.client.1.smithi110.stdout:7/185: link d1/d3/d22/l2c d1/d1b/l3c 0 2024-04-12T13:41:55.690 INFO:tasks.workunit.client.1.smithi110.stdout:2/203: dread d6/dc/dd/f16 [0,4194304] 0 2024-04-12T13:41:55.695 INFO:tasks.workunit.client.1.smithi110.stdout:8/181: fsync d1/d7/d20/f36 0 2024-04-12T13:41:55.696 INFO:tasks.workunit.client.0.smithi060.stdout:8/225: fsync d9/d1d/f33 0 2024-04-12T13:41:55.699 INFO:tasks.workunit.client.1.smithi110.stdout:9/267: rename df/d13/d26/d37/l43 to df/d13/d2c/d2d/d39/d4f/l61 0 2024-04-12T13:41:55.701 INFO:tasks.workunit.client.0.smithi060.stdout:1/218: dread d1e/d23/d2e/f3a [0,4194304] 0 2024-04-12T13:41:55.703 INFO:tasks.workunit.client.1.smithi110.stdout:4/274: dwrite d0/d19/d1c/f58 [0,4194304] 0 2024-04-12T13:41:55.704 INFO:tasks.workunit.client.1.smithi110.stdout:5/151: unlink da/f26 0 2024-04-12T13:41:55.705 INFO:tasks.workunit.client.1.smithi110.stdout:2/204: fdatasync d6/dc/dd/f24 0 2024-04-12T13:41:55.706 INFO:tasks.workunit.client.1.smithi110.stdout:5/152: chown da/db/d15/d17/f19 600 1 2024-04-12T13:41:55.707 INFO:tasks.workunit.client.1.smithi110.stdout:2/205: write d6/f12 [5045681,98632] 0 2024-04-12T13:41:55.710 INFO:tasks.workunit.client.1.smithi110.stdout:5/153: dread - da/db/d15/f1a zero size 2024-04-12T13:41:55.711 INFO:tasks.workunit.client.1.smithi110.stdout:3/185: dread d5/dc/f12 [0,4194304] 0 2024-04-12T13:41:55.711 INFO:tasks.workunit.client.1.smithi110.stdout:2/206: fdatasync d6/dc/dd/f10 0 2024-04-12T13:41:55.714 INFO:tasks.workunit.client.1.smithi110.stdout:2/207: stat d6/dc/dd/fe 0 2024-04-12T13:41:55.714 INFO:tasks.workunit.client.0.smithi060.stdout:5/263: link d6/dd/d1f/c28 d6/dd/d1f/d25/d35/d50/c5c 0 2024-04-12T13:41:55.715 INFO:tasks.workunit.client.1.smithi110.stdout:1/167: getdents de/d14 0 2024-04-12T13:41:55.716 INFO:tasks.workunit.client.1.smithi110.stdout:3/186: chown d5/dc/d31/d3b/d32/d3e 55016847 1 2024-04-12T13:41:55.717 INFO:tasks.workunit.client.1.smithi110.stdout:1/168: readlink de/d14/l1e 0 2024-04-12T13:41:55.717 INFO:tasks.workunit.client.0.smithi060.stdout:9/174: rename d4/d8/ce to d4/d25/c36 0 2024-04-12T13:41:55.719 INFO:tasks.workunit.client.1.smithi110.stdout:9/268: dwrite df/d13/f1f [0,4194304] 0 2024-04-12T13:41:55.721 INFO:tasks.workunit.client.0.smithi060.stdout:8/226: dwrite d9/d1b/d2b/f40 [0,4194304] 0 2024-04-12T13:41:55.721 INFO:tasks.workunit.client.0.smithi060.stdout:0/208: symlink d7/l4d 0 2024-04-12T13:41:55.724 INFO:tasks.workunit.client.0.smithi060.stdout:4/242: link d6/d7/db/c40 d6/d2f/d51/c54 0 2024-04-12T13:41:55.729 INFO:tasks.workunit.client.0.smithi060.stdout:4/243: read d6/d7/dd/d1a/d19/f33 [627012,17707] 0 2024-04-12T13:41:55.730 INFO:tasks.workunit.client.1.smithi110.stdout:8/182: rename d1/d3/l22 to d1/d5/dd/d23/l37 0 2024-04-12T13:41:55.732 INFO:tasks.workunit.client.1.smithi110.stdout:9/269: dread df/d13/f1b [0,4194304] 0 2024-04-12T13:41:55.732 INFO:tasks.workunit.client.0.smithi060.stdout:5/264: dread d6/fc [0,4194304] 0 2024-04-12T13:41:55.734 INFO:tasks.workunit.client.1.smithi110.stdout:4/275: creat d0/d19/d26/f59 x:0 0 0 2024-04-12T13:41:55.734 INFO:tasks.workunit.client.0.smithi060.stdout:4/244: write d6/d7/dd/df/f37 [1104155,108906] 0 2024-04-12T13:41:55.736 INFO:tasks.workunit.client.0.smithi060.stdout:3/194: rename c1 to d7/da/dd/c3a 0 2024-04-12T13:41:55.736 INFO:tasks.workunit.client.1.smithi110.stdout:4/276: write d0/de/d2c/f3d [702650,85954] 0 2024-04-12T13:41:55.738 INFO:tasks.workunit.client.1.smithi110.stdout:6/251: truncate d7/d10/d1c/f28 123481 0 2024-04-12T13:41:55.739 INFO:tasks.workunit.client.0.smithi060.stdout:5/265: read - d6/d10/d12/f36 zero size 2024-04-12T13:41:55.739 INFO:tasks.workunit.client.0.smithi060.stdout:3/195: dread - d7/d17/d27/f30 zero size 2024-04-12T13:41:55.744 INFO:tasks.workunit.client.0.smithi060.stdout:8/227: fdatasync d9/f2c 0 2024-04-12T13:41:55.744 INFO:tasks.workunit.client.0.smithi060.stdout:3/196: stat d7/d17/l32 0 2024-04-12T13:41:55.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/197: fsync d7/da/f2c 0 2024-04-12T13:41:55.747 INFO:tasks.workunit.client.0.smithi060.stdout:8/228: chown d9/d1b/l2a 26 1 2024-04-12T13:41:55.761 INFO:tasks.workunit.client.0.smithi060.stdout:4/245: dread d6/d7/dd/d1a/d19/f33 [0,4194304] 0 2024-04-12T13:41:55.761 INFO:tasks.workunit.client.0.smithi060.stdout:9/175: mkdir d4/d9/d37 0 2024-04-12T13:41:55.764 INFO:tasks.workunit.client.0.smithi060.stdout:4/246: readlink d6/d21/d29/l35 0 2024-04-12T13:41:55.765 INFO:tasks.workunit.client.0.smithi060.stdout:5/266: dwrite d6/dd/d27/f2d [0,4194304] 0 2024-04-12T13:41:55.769 INFO:tasks.workunit.client.0.smithi060.stdout:8/229: dwrite d9/f11 [0,4194304] 0 2024-04-12T13:41:55.775 INFO:tasks.workunit.client.0.smithi060.stdout:0/209: dread d7/d9/d14/d1b/f32 [0,4194304] 0 2024-04-12T13:41:55.779 INFO:tasks.workunit.client.1.smithi110.stdout:5/154: rmdir da/db 39 2024-04-12T13:41:55.780 INFO:tasks.workunit.client.1.smithi110.stdout:2/208: fsync d6/dc/dd/f16 0 2024-04-12T13:41:55.780 INFO:tasks.workunit.client.0.smithi060.stdout:3/198: mknod d7/d17/d19/c3b 0 2024-04-12T13:41:55.781 INFO:tasks.workunit.client.1.smithi110.stdout:1/169: unlink de/f1b 0 2024-04-12T13:41:55.783 INFO:tasks.workunit.client.0.smithi060.stdout:6/297: getdents d1/d7/da/dc/d24/d34 0 2024-04-12T13:41:55.784 INFO:tasks.workunit.client.1.smithi110.stdout:2/209: chown d6/dc/d1b 3710 1 2024-04-12T13:41:55.784 INFO:tasks.workunit.client.1.smithi110.stdout:7/186: truncate d1/f2b 3770861 0 2024-04-12T13:41:55.786 INFO:tasks.workunit.client.1.smithi110.stdout:9/270: creat df/d13/d2c/d2d/d39/d3a/f62 x:0 0 0 2024-04-12T13:41:55.790 INFO:tasks.workunit.client.1.smithi110.stdout:4/277: mknod d0/de/d32/c5a 0 2024-04-12T13:41:55.791 INFO:tasks.workunit.client.1.smithi110.stdout:9/271: dread df/f19 [0,4194304] 0 2024-04-12T13:41:55.793 INFO:tasks.workunit.client.0.smithi060.stdout:4/247: write f2 [3439154,114402] 0 2024-04-12T13:41:55.793 INFO:tasks.workunit.client.0.smithi060.stdout:1/219: dwrite f7 [0,4194304] 0 2024-04-12T13:41:55.795 INFO:tasks.workunit.client.1.smithi110.stdout:6/252: dread d7/d25/f46 [0,4194304] 0 2024-04-12T13:41:55.797 INFO:tasks.workunit.client.0.smithi060.stdout:8/230: dread d9/fc [0,4194304] 0 2024-04-12T13:41:55.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/267: symlink d6/d10/d12/l5d 0 2024-04-12T13:41:55.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/268: dread - d6/d10/d12/d15/f3a zero size 2024-04-12T13:41:55.804 INFO:tasks.workunit.client.1.smithi110.stdout:2/210: dwrite d6/dc/f33 [0,4194304] 0 2024-04-12T13:41:55.805 INFO:tasks.workunit.client.1.smithi110.stdout:2/211: fsync d6/d18/f29 0 2024-04-12T13:41:55.805 INFO:tasks.workunit.client.1.smithi110.stdout:7/187: dwrite d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:41:55.807 INFO:tasks.workunit.client.1.smithi110.stdout:2/212: dread - d6/d18/d20/f2f zero size 2024-04-12T13:41:55.808 INFO:tasks.workunit.client.1.smithi110.stdout:7/188: write d1/d3/d4/fb [2027956,97294] 0 2024-04-12T13:41:55.808 INFO:tasks.workunit.client.1.smithi110.stdout:2/213: chown d6/d18/d19 223706 1 2024-04-12T13:41:55.816 INFO:tasks.workunit.client.1.smithi110.stdout:8/183: truncate d1/d3/f13 594423 0 2024-04-12T13:41:55.817 INFO:tasks.workunit.client.0.smithi060.stdout:8/231: mkdir d9/d1b/d37/d4d 0 2024-04-12T13:41:55.819 INFO:tasks.workunit.client.1.smithi110.stdout:8/184: write d1/d7/f32 [181770,78645] 0 2024-04-12T13:41:55.819 INFO:tasks.workunit.client.1.smithi110.stdout:5/155: mknod da/db/c38 0 2024-04-12T13:41:55.820 INFO:tasks.workunit.client.0.smithi060.stdout:9/176: truncate d4/f2d 2237452 0 2024-04-12T13:41:55.821 INFO:tasks.workunit.client.0.smithi060.stdout:1/220: mknod d1e/d46/c4f 0 2024-04-12T13:41:55.822 INFO:tasks.workunit.client.1.smithi110.stdout:9/272: mkdir df/d13/d2c/d2d/d39/d4f/d58/d63 0 2024-04-12T13:41:55.830 INFO:tasks.workunit.client.0.smithi060.stdout:6/298: rename d1/d7/da/dc/d3a/f42 to d1/d7/da/dc/f6d 0 2024-04-12T13:41:55.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/232: fsync d9/fc 0 2024-04-12T13:41:55.835 INFO:tasks.workunit.client.1.smithi110.stdout:0/162: sync 2024-04-12T13:41:55.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.835+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e70004360 con 0x7f8e6006bed0 2024-04-12T13:41:55.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.837+0000 7f8e6be00700 1 -- 172.21.15.60:0/2458533732 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8e70004360 con 0x7f8e6006bed0 2024-04-12T13:41:55.838 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/21 daemons upgraded", 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:41:55.839 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:41:55.842 INFO:tasks.workunit.client.0.smithi060.stdout:9/177: rmdir d4/d8 39 2024-04-12T13:41:55.842 INFO:tasks.workunit.client.0.smithi060.stdout:1/221: fsync f13 0 2024-04-12T13:41:55.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 msgr2=0x7f8e6006e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:55.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 0x7f8e6006e380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8e64004f90 tx=0x7f8e64009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 msgr2=0x7f8e700a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c002a80 tx=0x7f8e6c004600 comp rx=0 tx=0).stop 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 shutdown_connections 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f8e6006bed0 0x7f8e6006e380 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e70006f90 0x7f8e700a3460 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 --2- 172.21.15.60:0/2458533732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e70008540 0x7f8e700a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.841+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 >> 172.21.15.60:0/2458533732 conn(0x7f8e70090320 msgr2=0x7f8e700918f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:55.844 INFO:tasks.workunit.client.1.smithi110.stdout:7/189: mkdir d1/d1b/d3d 0 2024-04-12T13:41:55.844 INFO:tasks.workunit.client.1.smithi110.stdout:2/214: dread d6/dc/dd/f1f [0,4194304] 0 2024-04-12T13:41:55.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.842+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 shutdown_connections 2024-04-12T13:41:55.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:55.842+0000 7f8e7da00700 1 -- 172.21.15.60:0/2458533732 wait complete. 2024-04-12T13:41:55.846 INFO:tasks.workunit.client.0.smithi060.stdout:5/269: creat d6/dd/d1f/d25/d42/d52/f5e x:0 0 0 2024-04-12T13:41:55.848 INFO:tasks.workunit.client.1.smithi110.stdout:5/156: dwrite da/db/d15/d17/d29/d32/f36 [0,4194304] 0 2024-04-12T13:41:55.850 INFO:tasks.workunit.client.0.smithi060.stdout:4/248: creat d6/f55 x:0 0 0 2024-04-12T13:41:55.851 INFO:tasks.workunit.client.1.smithi110.stdout:4/278: dwrite d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:41:55.851 INFO:tasks.workunit.client.1.smithi110.stdout:1/170: truncate de/d14/f3a 2204871 0 2024-04-12T13:41:55.858 INFO:tasks.workunit.client.1.smithi110.stdout:7/190: dread d1/f1f [0,4194304] 0 2024-04-12T13:41:55.863 INFO:tasks.workunit.client.0.smithi060.stdout:8/233: creat d9/da/f4e x:0 0 0 2024-04-12T13:41:55.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/270: mkdir d6/dd/d1f/d25/d35/d50/d5f 0 2024-04-12T13:41:55.866 INFO:tasks.workunit.client.1.smithi110.stdout:0/163: mkdir d1/d8/d36 0 2024-04-12T13:41:55.866 INFO:tasks.workunit.client.0.smithi060.stdout:0/210: getdents d7/d9/d14/d1b 0 2024-04-12T13:41:55.867 INFO:tasks.workunit.client.0.smithi060.stdout:9/178: dwrite d4/d9/d19/d21/f27 [0,4194304] 0 2024-04-12T13:41:55.870 INFO:tasks.workunit.client.0.smithi060.stdout:0/211: write d7/f26 [23266,3315] 0 2024-04-12T13:41:55.873 INFO:tasks.workunit.client.1.smithi110.stdout:7/191: dwrite d1/d3/d4/f2e [0,4194304] 0 2024-04-12T13:41:55.874 INFO:tasks.workunit.client.1.smithi110.stdout:7/192: chown d1/d1b/d33 920113 1 2024-04-12T13:41:55.877 INFO:tasks.workunit.client.0.smithi060.stdout:4/249: dwrite f2 [0,4194304] 0 2024-04-12T13:41:55.878 INFO:tasks.workunit.client.1.smithi110.stdout:2/215: unlink d6/dc/f15 0 2024-04-12T13:41:55.881 INFO:tasks.workunit.client.1.smithi110.stdout:3/187: sync 2024-04-12T13:41:55.883 INFO:tasks.workunit.client.0.smithi060.stdout:4/250: write d6/d21/f2a [2211742,129059] 0 2024-04-12T13:41:55.885 INFO:tasks.workunit.client.1.smithi110.stdout:3/188: write d5/dc/d20/d2d/f3c [52131,59519] 0 2024-04-12T13:41:55.888 INFO:tasks.workunit.client.0.smithi060.stdout:1/222: dread f2 [0,4194304] 0 2024-04-12T13:41:55.888 INFO:tasks.workunit.client.0.smithi060.stdout:4/251: fsync d6/d7/dd/df/f20 0 2024-04-12T13:41:55.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/234: creat d9/d1d/d2f/f4f x:0 0 0 2024-04-12T13:41:55.890 INFO:tasks.workunit.client.1.smithi110.stdout:6/253: truncate d7/d10/d1c/f24 2600465 0 2024-04-12T13:41:55.893 INFO:tasks.workunit.client.0.smithi060.stdout:5/271: dread d6/f20 [0,4194304] 0 2024-04-12T13:41:55.895 INFO:tasks.workunit.client.1.smithi110.stdout:1/171: unlink f2 0 2024-04-12T13:41:55.895 INFO:tasks.workunit.client.0.smithi060.stdout:5/272: write d6/d10/f2a [841647,127801] 0 2024-04-12T13:41:55.897 INFO:tasks.workunit.client.0.smithi060.stdout:0/212: symlink d7/d9/d14/d35/d44/l4e 0 2024-04-12T13:41:55.899 INFO:tasks.workunit.client.0.smithi060.stdout:0/213: dread - d7/d9/de/f40 zero size 2024-04-12T13:41:55.905 INFO:tasks.workunit.client.0.smithi060.stdout:6/299: rmdir d1/d7/da/dc/d24/d34/d51/d64 0 2024-04-12T13:41:55.905 INFO:tasks.workunit.client.0.smithi060.stdout:0/214: truncate d7/d9/d14/d1b/f2a 1198693 0 2024-04-12T13:41:55.907 INFO:tasks.workunit.client.1.smithi110.stdout:9/273: rename df/d13/d2c/f3f to df/d13/d2c/d2d/f64 0 2024-04-12T13:41:55.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/300: write d1/f14 [1030286,62676] 0 2024-04-12T13:41:55.909 INFO:tasks.workunit.client.0.smithi060.stdout:0/215: chown d7/d9/d14/f24 76 1 2024-04-12T13:41:55.909 INFO:tasks.workunit.client.0.smithi060.stdout:4/252: mkdir d6/d7/dd/d1a/d56 0 2024-04-12T13:41:55.910 INFO:tasks.workunit.client.1.smithi110.stdout:0/164: creat d1/d27/f37 x:0 0 0 2024-04-12T13:41:55.912 INFO:tasks.workunit.client.1.smithi110.stdout:0/165: write d1/d8/f34 [43341,56059] 0 2024-04-12T13:41:55.912 INFO:tasks.workunit.client.0.smithi060.stdout:1/223: creat d1e/d29/d37/f50 x:0 0 0 2024-04-12T13:41:55.914 INFO:tasks.workunit.client.0.smithi060.stdout:9/179: truncate d4/d9/d19/f34 1045753 0 2024-04-12T13:41:55.916 INFO:tasks.workunit.client.1.smithi110.stdout:5/157: mkdir da/db/d15/d39 0 2024-04-12T13:41:55.917 INFO:tasks.workunit.client.0.smithi060.stdout:9/180: write d4/d9/d19/d21/f1c [374755,97843] 0 2024-04-12T13:41:55.922 INFO:tasks.workunit.client.1.smithi110.stdout:9/274: dwrite df/d13/d26/f41 [4194304,4194304] 0 2024-04-12T13:41:55.929 INFO:tasks.workunit.client.0.smithi060.stdout:5/273: dread d6/f8 [0,4194304] 0 2024-04-12T13:41:55.932 INFO:tasks.workunit.client.0.smithi060.stdout:0/216: creat d7/d9/d14/d4a/f4f x:0 0 0 2024-04-12T13:41:55.935 INFO:tasks.workunit.client.0.smithi060.stdout:4/253: mkdir d6/d7/dd/d1a/d57 0 2024-04-12T13:41:55.937 INFO:tasks.workunit.client.0.smithi060.stdout:4/254: readlink d6/d21/l4c 0 2024-04-12T13:41:55.937 INFO:tasks.workunit.client.1.smithi110.stdout:7/193: truncate d1/f5 4210137 0 2024-04-12T13:41:55.939 INFO:tasks.workunit.client.1.smithi110.stdout:7/194: write d1/d3/d4/f27 [1004937,53718] 0 2024-04-12T13:41:55.940 INFO:tasks.workunit.client.1.smithi110.stdout:2/216: rename d6/d18/d20/f32 to d6/dc/f36 0 2024-04-12T13:41:55.942 INFO:tasks.workunit.client.1.smithi110.stdout:7/195: write d1/d3/d4/f2e [3241653,2272] 0 2024-04-12T13:41:55.946 INFO:tasks.workunit.client.0.smithi060.stdout:9/181: symlink d4/d9/d19/d21/l38 0 2024-04-12T13:41:55.948 INFO:tasks.workunit.client.1.smithi110.stdout:3/189: write d5/dc/f11 [1915832,2847] 0 2024-04-12T13:41:55.949 INFO:tasks.workunit.client.1.smithi110.stdout:5/158: creat da/db/d15/d17/d29/f3a x:0 0 0 2024-04-12T13:41:55.949 INFO:tasks.workunit.client.1.smithi110.stdout:3/190: dread d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:41:55.951 INFO:tasks.workunit.client.0.smithi060.stdout:6/301: truncate d1/d7/da/d20/f36 438766 0 2024-04-12T13:41:55.952 INFO:tasks.workunit.client.1.smithi110.stdout:8/185: link d1/d5/c2c d1/d5/c38 0 2024-04-12T13:41:55.960 INFO:tasks.workunit.client.1.smithi110.stdout:4/279: creat d0/f5b x:0 0 0 2024-04-12T13:41:55.962 INFO:tasks.workunit.client.0.smithi060.stdout:9/182: creat d4/d25/f39 x:0 0 0 2024-04-12T13:41:55.963 INFO:tasks.workunit.client.1.smithi110.stdout:6/254: mkdir d7/d10/d1c/d2b/d48/d4b 0 2024-04-12T13:41:55.963 INFO:tasks.workunit.client.1.smithi110.stdout:8/186: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:55.965 INFO:tasks.workunit.client.0.smithi060.stdout:5/274: link d6/fc d6/d10/d12/d15/f60 0 2024-04-12T13:41:55.967 INFO:tasks.workunit.client.0.smithi060.stdout:4/255: creat d6/d7/dd/d4d/f58 x:0 0 0 2024-04-12T13:41:55.968 INFO:tasks.workunit.client.0.smithi060.stdout:5/275: chown d6/d10/c3b 6250 1 2024-04-12T13:41:55.968 INFO:tasks.workunit.client.0.smithi060.stdout:0/217: dread d7/d9/d14/f24 [0,4194304] 0 2024-04-12T13:41:55.970 INFO:tasks.workunit.client.0.smithi060.stdout:1/224: truncate d1e/d1f/f4b 434948 0 2024-04-12T13:41:55.970 INFO:tasks.workunit.client.0.smithi060.stdout:4/256: dread - d6/d21/f41 zero size 2024-04-12T13:41:55.972 INFO:tasks.workunit.client.0.smithi060.stdout:1/225: fdatasync d1e/d29/d37/f4c 0 2024-04-12T13:41:55.973 INFO:tasks.workunit.client.0.smithi060.stdout:6/302: dwrite d1/d7/da/dc/d24/d34/f23 [4194304,4194304] 0 2024-04-12T13:41:55.974 INFO:tasks.workunit.client.1.smithi110.stdout:2/217: creat d6/dc/f37 x:0 0 0 2024-04-12T13:41:55.976 INFO:tasks.workunit.client.0.smithi060.stdout:1/226: write d1e/d1f/f22 [980120,96521] 0 2024-04-12T13:41:55.976 INFO:tasks.workunit.client.1.smithi110.stdout:0/166: symlink d1/d8/d36/l38 0 2024-04-12T13:41:55.977 INFO:tasks.workunit.client.1.smithi110.stdout:2/218: dread d6/dc/f2b [0,4194304] 0 2024-04-12T13:41:55.978 INFO:tasks.workunit.client.1.smithi110.stdout:2/219: chown d6/d18/d19/c2d 39 1 2024-04-12T13:41:55.978 INFO:tasks.workunit.client.0.smithi060.stdout:6/303: fdatasync d1/d7/da/dc/d24/d34/d51/d59/f4d 0 2024-04-12T13:41:55.980 INFO:tasks.workunit.client.1.smithi110.stdout:7/196: creat d1/d3/d4/f3e x:0 0 0 2024-04-12T13:41:55.981 INFO:tasks.workunit.client.1.smithi110.stdout:7/197: read - d1/d3/d4/f30 zero size 2024-04-12T13:41:55.985 INFO:tasks.workunit.client.0.smithi060.stdout:5/276: symlink d6/d10/d12/d4c/l61 0 2024-04-12T13:41:55.988 INFO:tasks.workunit.client.1.smithi110.stdout:5/159: mkdir da/db/d3b 0 2024-04-12T13:41:55.990 INFO:tasks.workunit.client.1.smithi110.stdout:5/160: write f1 [4490954,22670] 0 2024-04-12T13:41:55.991 INFO:tasks.workunit.client.0.smithi060.stdout:1/227: dread d1e/d29/f44 [0,4194304] 0 2024-04-12T13:41:55.992 INFO:tasks.workunit.client.0.smithi060.stdout:1/228: stat d1e/f38 0 2024-04-12T13:41:55.993 INFO:tasks.workunit.client.1.smithi110.stdout:3/191: creat d5/dc/d31/d3b/d32/f3f x:0 0 0 2024-04-12T13:41:55.995 INFO:tasks.workunit.client.1.smithi110.stdout:9/275: truncate df/f17 1273970 0 2024-04-12T13:41:55.995 INFO:tasks.workunit.client.1.smithi110.stdout:3/192: chown l2 12949 1 2024-04-12T13:41:55.996 INFO:tasks.workunit.client.0.smithi060.stdout:6/304: unlink d1/d7/da/dc/d24/l31 0 2024-04-12T13:41:55.998 INFO:tasks.workunit.client.0.smithi060.stdout:0/218: creat d7/d9/d4c/f50 x:0 0 0 2024-04-12T13:41:55.998 INFO:tasks.workunit.client.1.smithi110.stdout:9/276: chown df/d13/d3b/c42 108627 1 2024-04-12T13:41:55.999 INFO:tasks.workunit.client.1.smithi110.stdout:1/172: dread - de/d15/f3f zero size 2024-04-12T13:41:55.999 INFO:tasks.workunit.client.1.smithi110.stdout:4/280: unlink d0/d19/d26/l29 0 2024-04-12T13:41:55.999 INFO:tasks.workunit.client.0.smithi060.stdout:6/305: truncate d1/d7/da/dc/f19 1047313 0 2024-04-12T13:41:56.005 INFO:tasks.workunit.client.0.smithi060.stdout:5/277: rename d6/d10/d12/d38/f5a to d6/dd/d1f/d32/d46/f62 0 2024-04-12T13:41:56.005 INFO:tasks.workunit.client.1.smithi110.stdout:6/255: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:56.009 INFO:tasks.workunit.client.0.smithi060.stdout:1/229: mkdir d1e/d23/d2e/d30/d51 0 2024-04-12T13:41:56.012 INFO:tasks.workunit.client.1.smithi110.stdout:0/167: symlink d1/d11/l39 0 2024-04-12T13:41:56.013 INFO:tasks.workunit.client.1.smithi110.stdout:2/220: mknod d6/dc/c38 0 2024-04-12T13:41:56.014 INFO:tasks.workunit.client.0.smithi060.stdout:4/257: link d6/d7/dd/d1a/c1c d6/d2f/c59 0 2024-04-12T13:41:56.017 INFO:tasks.workunit.client.1.smithi110.stdout:9/277: dread df/f3d [0,4194304] 0 2024-04-12T13:41:56.023 INFO:tasks.workunit.client.0.smithi060.stdout:1/230: dwrite f7 [0,4194304] 0 2024-04-12T13:41:56.023 INFO:tasks.workunit.client.0.smithi060.stdout:5/278: rename c4 to d6/dd/d1f/c63 0 2024-04-12T13:41:56.025 INFO:tasks.workunit.client.1.smithi110.stdout:2/221: dwrite d6/d18/f29 [0,4194304] 0 2024-04-12T13:41:56.027 INFO:tasks.workunit.client.1.smithi110.stdout:4/281: rename d0/f5b to d0/d19/f5c 0 2024-04-12T13:41:56.029 INFO:tasks.workunit.client.1.smithi110.stdout:8/187: getdents d1/d5/dd/d31 0 2024-04-12T13:41:56.031 INFO:tasks.workunit.client.0.smithi060.stdout:0/219: creat d7/d9/d14/d35/d44/d49/f51 x:0 0 0 2024-04-12T13:41:56.032 INFO:tasks.workunit.client.1.smithi110.stdout:6/256: fsync d7/d25/d30/d44/f2d 0 2024-04-12T13:41:56.032 INFO:tasks.workunit.client.0.smithi060.stdout:9/183: write d4/d8/f2c [516146,48877] 0 2024-04-12T13:41:56.034 INFO:tasks.workunit.client.1.smithi110.stdout:0/168: symlink d1/d11/l3a 0 2024-04-12T13:41:56.035 INFO:tasks.workunit.client.0.smithi060.stdout:4/258: creat d6/d7/dd/d1a/d19/f5a x:0 0 0 2024-04-12T13:41:56.045 INFO:tasks.workunit.client.1.smithi110.stdout:7/198: creat d1/d1b/d3d/f3f x:0 0 0 2024-04-12T13:41:56.046 INFO:tasks.workunit.client.0.smithi060.stdout:1/231: creat d1e/d23/d2e/d30/f52 x:0 0 0 2024-04-12T13:41:56.046 INFO:tasks.workunit.client.0.smithi060.stdout:5/279: mknod d6/dd/d1f/d25/d42/c64 0 2024-04-12T13:41:56.047 INFO:tasks.workunit.client.0.smithi060.stdout:9/184: symlink d4/d33/l3a 0 2024-04-12T13:41:56.053 INFO:tasks.workunit.client.0.smithi060.stdout:0/220: symlink d7/d9/d14/d35/d44/l52 0 2024-04-12T13:41:56.053 INFO:tasks.workunit.client.0.smithi060.stdout:9/185: chown d4/d9/f2a 2223328 1 2024-04-12T13:41:56.053 INFO:tasks.workunit.client.0.smithi060.stdout:6/306: getdents d1/d7/da/dc/d24/d34/d51/d59 0 2024-04-12T13:41:56.054 INFO:tasks.workunit.client.1.smithi110.stdout:6/257: dread d7/f1a [0,4194304] 0 2024-04-12T13:41:56.054 INFO:tasks.workunit.client.1.smithi110.stdout:2/222: rename d6/c35 to d6/dc/dd/c39 0 2024-04-12T13:41:56.057 INFO:tasks.workunit.client.0.smithi060.stdout:6/307: fdatasync d1/d7/da/dc/f19 0 2024-04-12T13:41:56.057 INFO:tasks.workunit.client.0.smithi060.stdout:4/259: dwrite d6/f55 [0,4194304] 0 2024-04-12T13:41:56.057 INFO:tasks.workunit.client.1.smithi110.stdout:4/282: creat d0/de/d32/f5d x:0 0 0 2024-04-12T13:41:56.058 INFO:tasks.workunit.client.0.smithi060.stdout:9/186: creat d4/d8/f3b x:0 0 0 2024-04-12T13:41:56.065 INFO:tasks.workunit.client.0.smithi060.stdout:1/232: dwrite d1e/d1f/f4a [0,4194304] 0 2024-04-12T13:41:56.065 INFO:tasks.workunit.client.0.smithi060.stdout:9/187: dread d4/d9/d19/f34 [0,4194304] 0 2024-04-12T13:41:56.069 INFO:tasks.workunit.client.0.smithi060.stdout:9/188: chown d4/d8/f2e 498154261 1 2024-04-12T13:41:56.070 INFO:tasks.workunit.client.1.smithi110.stdout:3/193: link d5/dc/d20/d2d/f35 d5/f40 0 2024-04-12T13:41:56.071 INFO:tasks.workunit.client.0.smithi060.stdout:9/189: write d4/d9/d19/d21/f31 [1770001,50092] 0 2024-04-12T13:41:56.076 INFO:tasks.workunit.client.0.smithi060.stdout:7/209: sync 2024-04-12T13:41:56.076 INFO:tasks.workunit.client.0.smithi060.stdout:2/193: sync 2024-04-12T13:41:56.076 INFO:tasks.workunit.client.1.smithi110.stdout:7/199: dread d1/d3/d4/fb [0,4194304] 0 2024-04-12T13:41:56.078 INFO:tasks.workunit.client.1.smithi110.stdout:7/200: write d1/f38 [774121,98589] 0 2024-04-12T13:41:56.080 INFO:tasks.workunit.client.0.smithi060.stdout:2/194: write d6/d10/d16/f1c [1530682,77298] 0 2024-04-12T13:41:56.081 INFO:tasks.workunit.client.0.smithi060.stdout:7/210: write d0/fe [4796153,107446] 0 2024-04-12T13:41:56.082 INFO:tasks.workunit.client.1.smithi110.stdout:8/188: dread d1/d5/dd/ff [0,4194304] 0 2024-04-12T13:41:56.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 -- 172.21.15.60:0/1972355634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b81002d0 msgr2=0x7f98b8100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:56.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 --2- 172.21.15.60:0/1972355634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b81002d0 0x7f98b8100740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98a4004940 tx=0x7f98a4009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:56.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:55 smithi060 ceph-mon[29097]: pgmap v22: 65 pgs: 65 active+clean; 695 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 77 MiB/s wr, 259 op/s 2024-04-12T13:41:56.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:55 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/4087009781' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:41:56.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 -- 172.21.15.60:0/1972355634 shutdown_connections 2024-04-12T13:41:56.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 --2- 172.21.15.60:0/1972355634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b81002d0 0x7f98b8100740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 --2- 172.21.15.60:0/1972355634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80ff020 0x7f98b80ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.081+0000 7f98bfa00700 1 -- 172.21.15.60:0/1972355634 >> 172.21.15.60:0/1972355634 conn(0x7f98b80fa950 msgr2=0x7f98b80fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:56.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.083+0000 7f98bfa00700 1 -- 172.21.15.60:0/1972355634 shutdown_connections 2024-04-12T13:41:56.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.083+0000 7f98bfa00700 1 -- 172.21.15.60:0/1972355634 wait complete. 2024-04-12T13:41:56.085 INFO:tasks.workunit.client.0.smithi060.stdout:2/195: chown d6/d10/d16 5902264 1 2024-04-12T13:41:56.086 INFO:tasks.workunit.client.1.smithi110.stdout:1/173: creat de/d14/d34/f40 x:0 0 0 2024-04-12T13:41:56.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.085+0000 7f98bfa00700 1 Processor -- start 2024-04-12T13:41:56.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.085+0000 7f98bfa00700 1 -- start start 2024-04-12T13:41:56.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bfa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:56.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bfa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 0x7f98b8110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:56.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bfa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8110610 con 0x7f98b81002d0 2024-04-12T13:41:56.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bfa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8110780 con 0x7f98b80ff020 2024-04-12T13:41:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bd000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bd000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:52404/0 (socket says 172.21.15.60:52404) 2024-04-12T13:41:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.087+0000 7f98bd000700 1 -- 172.21.15.60:0/96514508 learned_addr learned my addr 172.21.15.60:0/96514508 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:41:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.088+0000 7f98b7e00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 0x7f98b8110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:56.090 INFO:tasks.workunit.client.1.smithi110.stdout:2/223: unlink c1 0 2024-04-12T13:41:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.088+0000 7f98bd000700 1 -- 172.21.15.60:0/96514508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 msgr2=0x7f98b8110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.088+0000 7f98bd000700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 0x7f98b8110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.088+0000 7f98bd000700 1 -- 172.21.15.60:0/96514508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac005040 con 0x7f98b80ff020 2024-04-12T13:41:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.088+0000 7f98b7e00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 0x7f98b8110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:41:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.089+0000 7f98bd000700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0096d0 tx=0x7f98ac009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:56.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.089+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ac00e840 con 0x7f98b80ff020 2024-04-12T13:41:56.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.089+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98ac00f040 con 0x7f98b80ff020 2024-04-12T13:41:56.092 INFO:tasks.workunit.client.1.smithi110.stdout:2/224: truncate d6/dc/f36 805069 0 2024-04-12T13:41:56.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.089+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ac013e50 con 0x7f98b80ff020 2024-04-12T13:41:56.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.090+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a4005040 con 0x7f98b80ff020 2024-04-12T13:41:56.092 INFO:tasks.workunit.client.0.smithi060.stdout:5/280: write d6/f20 [177338,113189] 0 2024-04-12T13:41:56.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.090+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b8115540 con 0x7f98b80ff020 2024-04-12T13:41:56.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.091+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b804c710 con 0x7f98b80ff020 2024-04-12T13:41:56.094 INFO:tasks.workunit.client.0.smithi060.stdout:4/260: rename d6/d47 to d6/d7/db/d5b 0 2024-04-12T13:41:56.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.094+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f98ac00e9a0 con 0x7f98b80ff020 2024-04-12T13:41:56.095 INFO:tasks.workunit.client.1.smithi110.stdout:6/258: mkdir d7/d25/d2c/d4c 0 2024-04-12T13:41:56.096 INFO:tasks.workunit.client.0.smithi060.stdout:2/196: dread d6/d13/d17/f1f [0,4194304] 0 2024-04-12T13:41:56.097 INFO:tasks.workunit.client.1.smithi110.stdout:4/283: symlink d0/de/d31/l5e 0 2024-04-12T13:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.096+0000 7f98b4c00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 0x7f98a006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.097+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f98ac08a390 con 0x7f98b80ff020 2024-04-12T13:41:56.099 INFO:tasks.workunit.client.0.smithi060.stdout:1/233: symlink d1e/d29/l53 0 2024-04-12T13:41:56.099 INFO:tasks.workunit.client.1.smithi110.stdout:0/169: symlink d1/d27/d31/l3b 0 2024-04-12T13:41:56.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.098+0000 7f98b7e00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 0x7f98a006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:41:56.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.098+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f98ac0574b0 con 0x7f98b80ff020 2024-04-12T13:41:56.100 INFO:tasks.workunit.client.1.smithi110.stdout:0/170: fdatasync d1/d8/fb 0 2024-04-12T13:41:56.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.099+0000 7f98b7e00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 0x7f98a006e2b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98a4013870 tx=0x7f98a4009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:41:56.103 INFO:tasks.workunit.client.1.smithi110.stdout:9/278: truncate df/d13/d26/f45 1542243 0 2024-04-12T13:41:56.103 INFO:tasks.workunit.client.0.smithi060.stdout:6/308: mknod d1/c6e 0 2024-04-12T13:41:56.104 INFO:tasks.workunit.client.1.smithi110.stdout:9/279: stat df/d13/d2c/d2d/d39/d3a/f62 0 2024-04-12T13:41:56.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/189: mknod d1/c39 0 2024-04-12T13:41:56.113 INFO:tasks.workunit.client.1.smithi110.stdout:2/225: symlink d6/dc/dd/l3a 0 2024-04-12T13:41:56.114 INFO:tasks.workunit.client.1.smithi110.stdout:6/259: mkdir d7/d10/d1c/d4d 0 2024-04-12T13:41:56.115 INFO:tasks.workunit.client.0.smithi060.stdout:0/221: link d7/c46 d7/d9/d14/d4a/c53 0 2024-04-12T13:41:56.115 INFO:tasks.workunit.client.0.smithi060.stdout:7/211: mknod d0/d3d/c4e 0 2024-04-12T13:41:56.119 INFO:tasks.workunit.client.0.smithi060.stdout:8/235: sync 2024-04-12T13:41:56.119 INFO:tasks.workunit.client.0.smithi060.stdout:3/199: sync 2024-04-12T13:41:56.122 INFO:tasks.workunit.client.0.smithi060.stdout:3/200: readlink d7/d17/d19/d33/l34 0 2024-04-12T13:41:56.122 INFO:tasks.workunit.client.1.smithi110.stdout:8/190: dwrite d1/d7/f1d [0,4194304] 0 2024-04-12T13:41:56.123 INFO:tasks.workunit.client.0.smithi060.stdout:5/281: write d6/d10/d12/f4e [1267456,86992] 0 2024-04-12T13:41:56.126 INFO:tasks.workunit.client.0.smithi060.stdout:8/236: read f1 [457094,13572] 0 2024-04-12T13:41:56.126 INFO:tasks.workunit.client.0.smithi060.stdout:5/282: fsync d6/d10/f2a 0 2024-04-12T13:41:56.127 INFO:tasks.workunit.client.1.smithi110.stdout:2/226: dread d6/dc/dd/f24 [0,4194304] 0 2024-04-12T13:41:56.129 INFO:tasks.workunit.client.0.smithi060.stdout:8/237: read d9/d1b/f19 [2860288,2993] 0 2024-04-12T13:41:56.130 INFO:tasks.workunit.client.1.smithi110.stdout:3/194: creat d5/dc/d31/d3b/d32/d3e/f41 x:0 0 0 2024-04-12T13:41:56.132 INFO:tasks.workunit.client.0.smithi060.stdout:4/261: chown d6/d7/dd/df/c24 883 1 2024-04-12T13:41:56.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/238: write d9/d1b/d2b/f45 [2665205,70408] 0 2024-04-12T13:41:56.133 INFO:tasks.workunit.client.0.smithi060.stdout:2/197: rmdir d6/d13 39 2024-04-12T13:41:56.137 INFO:tasks.workunit.client.0.smithi060.stdout:8/239: chown d9/fc 2744990 1 2024-04-12T13:41:56.137 INFO:tasks.workunit.client.0.smithi060.stdout:9/190: mknod d4/d8/d32/c3c 0 2024-04-12T13:41:56.138 INFO:tasks.workunit.client.1.smithi110.stdout:7/201: truncate d1/f23 779452 0 2024-04-12T13:41:56.139 INFO:tasks.workunit.client.1.smithi110.stdout:8/191: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:56.141 INFO:tasks.workunit.client.0.smithi060.stdout:1/234: creat d1e/d23/d49/f54 x:0 0 0 2024-04-12T13:41:56.144 INFO:tasks.workunit.client.0.smithi060.stdout:6/309: mknod d1/d7/da/d20/c6f 0 2024-04-12T13:41:56.145 INFO:tasks.workunit.client.1.smithi110.stdout:2/227: dwrite d6/d18/d20/f2f [0,4194304] 0 2024-04-12T13:41:56.146 INFO:tasks.workunit.client.0.smithi060.stdout:0/222: rename l3 to d7/d41/l54 0 2024-04-12T13:41:56.147 INFO:tasks.workunit.client.1.smithi110.stdout:5/161: sync 2024-04-12T13:41:56.147 INFO:tasks.workunit.client.0.smithi060.stdout:3/201: dwrite d7/f10 [0,4194304] 0 2024-04-12T13:41:56.148 INFO:tasks.workunit.client.1.smithi110.stdout:0/171: write f0 [3465262,88617] 0 2024-04-12T13:41:56.150 INFO:tasks.workunit.client.0.smithi060.stdout:0/223: chown d7/d9/f21 34 1 2024-04-12T13:41:56.151 INFO:tasks.workunit.client.1.smithi110.stdout:8/192: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:56.157 INFO:tasks.workunit.client.1.smithi110.stdout:6/260: rmdir d7/d25/d30/d44/d3d 39 2024-04-12T13:41:56.158 INFO:tasks.workunit.client.1.smithi110.stdout:1/174: dread de/d1d/f28 [0,4194304] 0 2024-04-12T13:41:56.159 INFO:tasks.workunit.client.1.smithi110.stdout:3/195: creat d5/dc/d20/d2d/f42 x:0 0 0 2024-04-12T13:41:56.159 INFO:tasks.workunit.client.0.smithi060.stdout:5/283: stat d6/f17 0 2024-04-12T13:41:56.162 INFO:tasks.workunit.client.0.smithi060.stdout:2/198: rmdir d6/d10/d16 39 2024-04-12T13:41:56.163 INFO:tasks.workunit.client.1.smithi110.stdout:9/280: creat df/d13/d2c/d2d/d39/d4f/d58/d63/f65 x:0 0 0 2024-04-12T13:41:56.167 INFO:tasks.workunit.client.1.smithi110.stdout:2/228: rmdir d6/dc/d13/d1d 39 2024-04-12T13:41:56.170 INFO:tasks.workunit.client.0.smithi060.stdout:8/240: creat d9/d1b/d2b/f50 x:0 0 0 2024-04-12T13:41:56.174 INFO:tasks.workunit.client.1.smithi110.stdout:4/284: truncate d0/de/d2c/f2b 1414203 0 2024-04-12T13:41:56.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/310: creat d1/d2c/f70 x:0 0 0 2024-04-12T13:41:56.177 INFO:tasks.workunit.client.0.smithi060.stdout:5/284: dread d6/f8 [0,4194304] 0 2024-04-12T13:41:56.178 INFO:tasks.workunit.client.1.smithi110.stdout:0/172: truncate d1/f26 683183 0 2024-04-12T13:41:56.179 INFO:tasks.workunit.client.1.smithi110.stdout:3/196: fsync d5/dc/d20/d2d/f42 0 2024-04-12T13:41:56.179 INFO:tasks.workunit.client.1.smithi110.stdout:2/229: dread d6/dc/dd/fe [0,4194304] 0 2024-04-12T13:41:56.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/212: getdents d0/d7/d43/d4d 0 2024-04-12T13:41:56.181 INFO:tasks.workunit.client.1.smithi110.stdout:2/230: fdatasync d6/f8 0 2024-04-12T13:41:56.182 INFO:tasks.workunit.client.1.smithi110.stdout:6/261: rmdir d7/d10/d1c/d2b/d48 39 2024-04-12T13:41:56.182 INFO:tasks.workunit.client.1.smithi110.stdout:2/231: chown d6/d18/d19/c2d 198 1 2024-04-12T13:41:56.188 INFO:tasks.workunit.client.0.smithi060.stdout:9/191: symlink d4/l3d 0 2024-04-12T13:41:56.188 INFO:tasks.workunit.client.1.smithi110.stdout:9/281: readlink df/d13/d2c/d2d/d39/d4f/l61 0 2024-04-12T13:41:56.188 INFO:tasks.workunit.client.0.smithi060.stdout:0/224: write d7/fa [1578728,41701] 0 2024-04-12T13:41:56.189 INFO:tasks.workunit.client.0.smithi060.stdout:9/192: stat d4/d8/f3b 0 2024-04-12T13:41:56.191 INFO:tasks.workunit.client.1.smithi110.stdout:7/202: dwrite d1/d3/d4/f9 [0,4194304] 0 2024-04-12T13:41:56.192 INFO:tasks.workunit.client.1.smithi110.stdout:7/203: chown d1/d3/d4/f35 3815726 1 2024-04-12T13:41:56.193 INFO:tasks.workunit.client.1.smithi110.stdout:5/162: dwrite f9 [4194304,4194304] 0 2024-04-12T13:41:56.198 INFO:tasks.workunit.client.1.smithi110.stdout:4/285: rename d0/de/d31 to d0/de/d32/d5f 0 2024-04-12T13:41:56.198 INFO:tasks.workunit.client.0.smithi060.stdout:4/262: truncate d6/d7/dd/fe 1897760 0 2024-04-12T13:41:56.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/241: unlink d9/d1b/l42 0 2024-04-12T13:41:56.199 INFO:tasks.workunit.client.0.smithi060.stdout:8/242: chown d9/d1b/l29 722030331 1 2024-04-12T13:41:56.199 INFO:tasks.workunit.client.0.smithi060.stdout:8/243: readlink d9/d1b/d37/l4a 0 2024-04-12T13:41:56.199 INFO:tasks.workunit.client.0.smithi060.stdout:3/202: creat d7/d17/d27/d36/f3c x:0 0 0 2024-04-12T13:41:56.200 INFO:tasks.workunit.client.1.smithi110.stdout:8/193: mkdir d1/d3/d35/d3a 0 2024-04-12T13:41:56.201 INFO:tasks.workunit.client.0.smithi060.stdout:8/244: write d9/fc [3904642,46230] 0 2024-04-12T13:41:56.203 INFO:tasks.workunit.client.0.smithi060.stdout:6/311: creat d1/d7/da/dc/d24/d30/f71 x:0 0 0 2024-04-12T13:41:56.203 INFO:tasks.workunit.client.1.smithi110.stdout:0/173: rmdir d1/d8/d36 39 2024-04-12T13:41:56.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/199: dwrite d6/d10/d16/f18 [0,4194304] 0 2024-04-12T13:41:56.208 INFO:tasks.workunit.client.0.smithi060.stdout:5/285: symlink d6/d10/d12/d15/l65 0 2024-04-12T13:41:56.226 INFO:tasks.workunit.client.0.smithi060.stdout:0/225: rmdir d7/d9/d14/d35/d44 39 2024-04-12T13:41:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:55 smithi110 ceph-mon[36055]: pgmap v22: 65 pgs: 65 active+clean; 695 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 77 MiB/s wr, 259 op/s 2024-04-12T13:41:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:55 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/4087009781' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:41:56.230 INFO:tasks.workunit.client.0.smithi060.stdout:9/193: dwrite d4/d9/d19/d21/f31 [4194304,4194304] 0 2024-04-12T13:41:56.232 INFO:tasks.workunit.client.1.smithi110.stdout:9/282: fsync df/f19 0 2024-04-12T13:41:56.232 INFO:tasks.workunit.client.1.smithi110.stdout:3/197: dwrite d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:41:56.235 INFO:tasks.workunit.client.0.smithi060.stdout:8/245: creat d9/d1d/d2f/f51 x:0 0 0 2024-04-12T13:41:56.236 INFO:tasks.workunit.client.0.smithi060.stdout:3/203: mknod d7/d17/d19/c3d 0 2024-04-12T13:41:56.240 INFO:tasks.workunit.client.1.smithi110.stdout:5/163: dread f9 [0,4194304] 0 2024-04-12T13:41:56.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/312: dwrite d1/d2c/f70 [0,4194304] 0 2024-04-12T13:41:56.243 INFO:tasks.workunit.client.1.smithi110.stdout:5/164: write da/db/f1d [1123856,55406] 0 2024-04-12T13:41:56.246 INFO:tasks.workunit.client.0.smithi060.stdout:5/286: dwrite d6/d10/d12/d38/f47 [0,4194304] 0 2024-04-12T13:41:56.247 INFO:tasks.workunit.client.1.smithi110.stdout:7/204: write d1/f18 [147690,84216] 0 2024-04-12T13:41:56.247 INFO:tasks.workunit.client.0.smithi060.stdout:1/235: getdents d1e/d29/d37 0 2024-04-12T13:41:56.248 INFO:tasks.workunit.client.1.smithi110.stdout:0/174: rmdir d1/d8 39 2024-04-12T13:41:56.255 INFO:tasks.workunit.client.1.smithi110.stdout:1/175: getdents de/d14 0 2024-04-12T13:41:56.256 INFO:tasks.workunit.client.0.smithi060.stdout:2/200: mknod d6/d10/c3b 0 2024-04-12T13:41:56.258 INFO:tasks.workunit.client.1.smithi110.stdout:2/232: read d6/dc/d13/d1d/f26 [1601904,51748] 0 2024-04-12T13:41:56.260 INFO:tasks.workunit.client.0.smithi060.stdout:8/246: rename d9/da/c41 to d9/d1b/d37/d48/c52 0 2024-04-12T13:41:56.263 INFO:tasks.workunit.client.0.smithi060.stdout:8/247: write d9/d1b/f47 [814018,5599] 0 2024-04-12T13:41:56.264 INFO:tasks.workunit.client.1.smithi110.stdout:3/198: fdatasync d5/dc/d20/d2d/f35 0 2024-04-12T13:41:56.265 INFO:tasks.workunit.client.0.smithi060.stdout:0/226: write d7/d9/d14/d1b/f32 [1651160,60230] 0 2024-04-12T13:41:56.267 INFO:tasks.workunit.client.0.smithi060.stdout:6/313: creat d1/d7/da/dc/d24/d30/d52/d5e/f72 x:0 0 0 2024-04-12T13:41:56.267 INFO:tasks.workunit.client.1.smithi110.stdout:3/199: chown d5/dc/d31/c3d 228 1 2024-04-12T13:41:56.268 INFO:tasks.workunit.client.0.smithi060.stdout:8/248: truncate d9/da/f43 1431738 0 2024-04-12T13:41:56.268 INFO:tasks.workunit.client.1.smithi110.stdout:9/283: rename df/d13/d2c/d2d/d39/d60 to df/d13/d2c/d66 0 2024-04-12T13:41:56.269 INFO:tasks.workunit.client.1.smithi110.stdout:5/165: rename da/d2e to da/d2e/d3c 22 2024-04-12T13:41:56.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/287: creat d6/d10/d12/d38/f66 x:0 0 0 2024-04-12T13:41:56.270 INFO:tasks.workunit.client.1.smithi110.stdout:4/286: dwrite d0/d13/f21 [0,4194304] 0 2024-04-12T13:41:56.273 INFO:tasks.workunit.client.1.smithi110.stdout:6/262: creat d7/d25/d30/f4e x:0 0 0 2024-04-12T13:41:56.276 INFO:tasks.workunit.client.1.smithi110.stdout:2/233: mkdir d6/d18/d3b 0 2024-04-12T13:41:56.284 INFO:tasks.workunit.client.1.smithi110.stdout:9/284: creat df/d13/d2c/d2d/d39/d4f/d58/d5d/f67 x:0 0 0 2024-04-12T13:41:56.286 INFO:tasks.workunit.client.1.smithi110.stdout:8/194: truncate d1/d3/fe 8423347 0 2024-04-12T13:41:56.288 INFO:tasks.workunit.client.1.smithi110.stdout:1/176: rename de/d14/c25 to de/d1d/c41 0 2024-04-12T13:41:56.289 INFO:tasks.workunit.client.1.smithi110.stdout:8/195: mknod d1/d5/d1f/c3b 0 2024-04-12T13:41:56.292 INFO:tasks.workunit.client.1.smithi110.stdout:4/287: rename d0/de/d32/d5f/f4f to d0/d19/d1c/f60 0 2024-04-12T13:41:56.293 INFO:tasks.workunit.client.1.smithi110.stdout:1/177: dread - de/f26 zero size 2024-04-12T13:41:56.294 INFO:tasks.workunit.client.1.smithi110.stdout:8/196: dread d1/d7/f32 [0,4194304] 0 2024-04-12T13:41:56.295 INFO:tasks.workunit.client.1.smithi110.stdout:3/200: truncate d5/dc/d20/d2d/f35 170735 0 2024-04-12T13:41:56.295 INFO:tasks.workunit.client.1.smithi110.stdout:9/285: link df/d13/f5e df/d13/d2c/d2d/d39/d4f/d58/f68 0 2024-04-12T13:41:56.296 INFO:tasks.workunit.client.1.smithi110.stdout:6/263: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:41:56.297 INFO:tasks.workunit.client.1.smithi110.stdout:5/166: dread da/db/f14 [0,4194304] 0 2024-04-12T13:41:56.298 INFO:tasks.workunit.client.1.smithi110.stdout:6/264: dread - d7/d10/d1c/f43 zero size 2024-04-12T13:41:56.299 INFO:tasks.workunit.client.1.smithi110.stdout:2/234: rename d6/dc/d13/d1d to d6/d18/d3b/d3c 0 2024-04-12T13:41:56.299 INFO:tasks.workunit.client.1.smithi110.stdout:3/201: read d5/f1f [837597,58030] 0 2024-04-12T13:41:56.300 INFO:tasks.workunit.client.1.smithi110.stdout:0/175: write d1/d8/f20 [647214,95618] 0 2024-04-12T13:41:56.301 INFO:tasks.workunit.client.1.smithi110.stdout:2/235: chown d6/dc/dd/f22 100619867 1 2024-04-12T13:41:56.302 INFO:tasks.workunit.client.1.smithi110.stdout:9/286: rmdir df 39 2024-04-12T13:41:56.306 INFO:tasks.workunit.client.1.smithi110.stdout:5/167: mkdir da/db/d15/d17/d25/d3d 0 2024-04-12T13:41:56.311 INFO:tasks.workunit.client.1.smithi110.stdout:2/236: mknod d6/d18/d3b/d3c/c3d 0 2024-04-12T13:41:56.313 INFO:tasks.workunit.client.1.smithi110.stdout:1/178: creat de/d1d/f42 x:0 0 0 2024-04-12T13:41:56.313 INFO:tasks.workunit.client.1.smithi110.stdout:6/265: truncate d7/d10/d1c/f28 1118376 0 2024-04-12T13:41:56.315 INFO:tasks.workunit.client.1.smithi110.stdout:0/176: mkdir d1/d3c 0 2024-04-12T13:41:56.315 INFO:tasks.workunit.client.1.smithi110.stdout:4/288: dwrite d0/d13/f2d [4194304,4194304] 0 2024-04-12T13:41:56.319 INFO:tasks.workunit.client.1.smithi110.stdout:9/287: fsync df/f25 0 2024-04-12T13:41:56.322 INFO:tasks.workunit.client.1.smithi110.stdout:3/202: creat d5/f43 x:0 0 0 2024-04-12T13:41:56.325 INFO:tasks.workunit.client.1.smithi110.stdout:6/266: write d7/d25/f46 [2101186,59357] 0 2024-04-12T13:41:56.325 INFO:tasks.workunit.client.1.smithi110.stdout:5/168: creat da/db/d15/d17/d25/d3d/f3e x:0 0 0 2024-04-12T13:41:56.328 INFO:tasks.workunit.client.1.smithi110.stdout:4/289: stat d0/ld 0 2024-04-12T13:41:56.334 INFO:tasks.workunit.client.1.smithi110.stdout:1/179: symlink de/l43 0 2024-04-12T13:41:56.339 INFO:tasks.workunit.client.1.smithi110.stdout:4/290: mkdir d0/de/d32/d61 0 2024-04-12T13:41:56.340 INFO:tasks.workunit.client.1.smithi110.stdout:7/205: sync 2024-04-12T13:41:56.341 INFO:tasks.workunit.client.1.smithi110.stdout:4/291: fdatasync d0/d19/f23 0 2024-04-12T13:41:56.341 INFO:tasks.workunit.client.1.smithi110.stdout:5/169: dwrite da/f11 [0,4194304] 0 2024-04-12T13:41:56.341 INFO:tasks.workunit.client.1.smithi110.stdout:6/267: symlink d7/d25/d30/l4f 0 2024-04-12T13:41:56.346 INFO:tasks.workunit.client.1.smithi110.stdout:8/197: truncate d1/d3/fe 7664959 0 2024-04-12T13:41:56.352 INFO:tasks.workunit.client.1.smithi110.stdout:0/177: getdents d1 0 2024-04-12T13:41:56.355 INFO:tasks.workunit.client.1.smithi110.stdout:3/203: getdents d5/dc 0 2024-04-12T13:41:56.355 INFO:tasks.workunit.client.1.smithi110.stdout:5/170: mknod da/db/d15/d17/d25/c3f 0 2024-04-12T13:41:56.355 INFO:tasks.workunit.client.1.smithi110.stdout:9/288: write df/f19 [127828,57405] 0 2024-04-12T13:41:56.356 INFO:tasks.workunit.client.1.smithi110.stdout:6/268: rmdir d7/d25/d30 39 2024-04-12T13:41:56.357 INFO:tasks.workunit.client.1.smithi110.stdout:1/180: dwrite de/d14/d34/f40 [0,4194304] 0 2024-04-12T13:41:56.359 INFO:tasks.workunit.client.1.smithi110.stdout:8/198: rename d1/d5/dd/d23 to d1/d3/d3c 0 2024-04-12T13:41:56.360 INFO:tasks.workunit.client.1.smithi110.stdout:2/237: dwrite d6/f12 [0,4194304] 0 2024-04-12T13:41:56.360 INFO:tasks.workunit.client.1.smithi110.stdout:4/292: dread d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:41:56.363 INFO:tasks.workunit.client.1.smithi110.stdout:8/199: dread - d1/d3/d3c/f2f zero size 2024-04-12T13:41:56.364 INFO:tasks.workunit.client.1.smithi110.stdout:4/293: write d0/d19/f20 [2292491,65788] 0 2024-04-12T13:41:56.365 INFO:tasks.workunit.client.1.smithi110.stdout:3/204: fsync d5/dc/f13 0 2024-04-12T13:41:56.366 INFO:tasks.workunit.client.1.smithi110.stdout:5/171: rmdir da/db/d15/d17/d25/d3d 39 2024-04-12T13:41:56.367 INFO:tasks.workunit.client.1.smithi110.stdout:7/206: write d1/f5 [305888,16545] 0 2024-04-12T13:41:56.370 INFO:tasks.workunit.client.1.smithi110.stdout:9/289: unlink fb 0 2024-04-12T13:41:56.371 INFO:tasks.workunit.client.1.smithi110.stdout:5/172: write da/db/d15/d17/d25/f2a [130535,54943] 0 2024-04-12T13:41:56.373 INFO:tasks.workunit.client.1.smithi110.stdout:5/173: read da/db/f14 [2393960,126867] 0 2024-04-12T13:41:56.379 INFO:tasks.workunit.client.1.smithi110.stdout:4/294: readlink d0/d19/l51 0 2024-04-12T13:41:56.380 INFO:tasks.workunit.client.1.smithi110.stdout:0/178: creat d1/d8/f3d x:0 0 0 2024-04-12T13:41:56.380 INFO:tasks.workunit.client.1.smithi110.stdout:8/200: readlink d1/d7/d20/l26 0 2024-04-12T13:41:56.381 INFO:tasks.workunit.client.1.smithi110.stdout:7/207: mknod d1/d3/d22/c40 0 2024-04-12T13:41:56.383 INFO:tasks.workunit.client.1.smithi110.stdout:0/179: read d1/f2f [2355123,121021] 0 2024-04-12T13:41:56.384 INFO:tasks.workunit.client.1.smithi110.stdout:9/290: read df/d13/f1f [4097910,108392] 0 2024-04-12T13:41:56.384 INFO:tasks.workunit.client.1.smithi110.stdout:2/238: symlink d6/d18/d19/d25/l3e 0 2024-04-12T13:41:56.384 INFO:tasks.workunit.client.1.smithi110.stdout:7/208: read d1/d3/d22/f25 [221596,33882] 0 2024-04-12T13:41:56.386 INFO:tasks.workunit.client.1.smithi110.stdout:9/291: truncate fa 1412662 0 2024-04-12T13:41:56.386 INFO:tasks.workunit.client.1.smithi110.stdout:7/209: write d1/d3/f11 [647362,124663] 0 2024-04-12T13:41:56.388 INFO:tasks.workunit.client.1.smithi110.stdout:3/205: rename d5/dc/f23 to d5/dc/d31/d3b/d32/d3e/f44 0 2024-04-12T13:41:56.394 INFO:tasks.workunit.client.1.smithi110.stdout:2/239: creat d6/dc/f3f x:0 0 0 2024-04-12T13:41:56.395 INFO:tasks.workunit.client.1.smithi110.stdout:8/201: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:56.395 INFO:tasks.workunit.client.1.smithi110.stdout:5/174: dread da/db/d15/d17/d25/f2c [0,4194304] 0 2024-04-12T13:41:56.396 INFO:tasks.workunit.client.1.smithi110.stdout:9/292: stat df/d13/d2c/d2d/f64 0 2024-04-12T13:41:56.397 INFO:tasks.workunit.client.1.smithi110.stdout:2/240: write d6/d18/d20/f2f [4492985,10287] 0 2024-04-12T13:41:56.397 INFO:tasks.workunit.client.1.smithi110.stdout:3/206: creat d5/dc/d31/f45 x:0 0 0 2024-04-12T13:41:56.398 INFO:tasks.workunit.client.1.smithi110.stdout:8/202: write d1/d5/f28 [583621,121469] 0 2024-04-12T13:41:56.401 INFO:tasks.workunit.client.1.smithi110.stdout:2/241: chown d6/d18/d3b 57120836 1 2024-04-12T13:41:56.401 INFO:tasks.workunit.client.1.smithi110.stdout:3/207: fsync d5/dc/f2e 0 2024-04-12T13:41:56.401 INFO:tasks.workunit.client.1.smithi110.stdout:7/210: mknod d1/d1b/d3d/c41 0 2024-04-12T13:41:56.403 INFO:tasks.workunit.client.1.smithi110.stdout:0/180: dwrite f0 [0,4194304] 0 2024-04-12T13:41:56.403 INFO:tasks.workunit.client.1.smithi110.stdout:5/175: write da/db/d15/f1b [908843,94960] 0 2024-04-12T13:41:56.403 INFO:tasks.workunit.client.1.smithi110.stdout:1/181: link f6 de/d15/d32/f44 0 2024-04-12T13:41:56.403 INFO:tasks.workunit.client.1.smithi110.stdout:2/242: readlink d6/d18/d20/l30 0 2024-04-12T13:41:56.408 INFO:tasks.workunit.client.1.smithi110.stdout:7/211: read d1/d3/d4/f27 [804890,32660] 0 2024-04-12T13:41:56.408 INFO:tasks.workunit.client.1.smithi110.stdout:0/181: truncate d1/d27/f32 581130 0 2024-04-12T13:41:56.408 INFO:tasks.workunit.client.1.smithi110.stdout:9/293: symlink df/d13/d3b/d40/l69 0 2024-04-12T13:41:56.409 INFO:tasks.workunit.client.0.smithi060.stdout:7/213: getdents d0/d7 0 2024-04-12T13:41:56.413 INFO:tasks.workunit.client.1.smithi110.stdout:8/203: dread d1/d7/f32 [0,4194304] 0 2024-04-12T13:41:56.413 INFO:tasks.workunit.client.0.smithi060.stdout:1/236: mknod d1e/d23/d49/d4e/c55 0 2024-04-12T13:41:56.414 INFO:tasks.workunit.client.1.smithi110.stdout:9/294: dread fa [0,4194304] 0 2024-04-12T13:41:56.415 INFO:tasks.workunit.client.1.smithi110.stdout:9/295: fdatasync fa 0 2024-04-12T13:41:56.418 INFO:tasks.workunit.client.1.smithi110.stdout:9/296: fsync df/d13/d2c/d2d/d39/d3a/d4e/f57 0 2024-04-12T13:41:56.418 INFO:tasks.workunit.client.0.smithi060.stdout:5/288: mknod d6/dd/d1f/d25/d35/d50/c67 0 2024-04-12T13:41:56.419 INFO:tasks.workunit.client.1.smithi110.stdout:2/243: creat d6/d18/d19/d25/f40 x:0 0 0 2024-04-12T13:41:56.419 INFO:tasks.workunit.client.1.smithi110.stdout:9/297: chown df/d13/l2a 1 1 2024-04-12T13:41:56.421 INFO:tasks.workunit.client.0.smithi060.stdout:5/289: dread - d6/d10/d12/d38/f66 zero size 2024-04-12T13:41:56.422 INFO:tasks.workunit.client.1.smithi110.stdout:7/212: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:41:56.424 INFO:tasks.workunit.client.0.smithi060.stdout:1/237: write d1e/f4d [1064831,5946] 0 2024-04-12T13:41:56.429 INFO:tasks.workunit.client.1.smithi110.stdout:5/176: unlink da/db/d15/d17/d29/f3a 0 2024-04-12T13:41:56.429 INFO:tasks.workunit.client.1.smithi110.stdout:1/182: dwrite f5 [0,4194304] 0 2024-04-12T13:41:56.430 INFO:tasks.workunit.client.1.smithi110.stdout:4/295: truncate d0/d19/d1c/f58 122791 0 2024-04-12T13:41:56.431 INFO:tasks.workunit.client.1.smithi110.stdout:5/177: chown da/db/d15/d17/d25/c3f 542 1 2024-04-12T13:41:56.431 INFO:tasks.workunit.client.0.smithi060.stdout:9/194: link d4/d8/fa d4/d9/f3e 0 2024-04-12T13:41:56.432 INFO:tasks.workunit.client.0.smithi060.stdout:8/249: dwrite d9/d1b/d2b/f32 [4194304,4194304] 0 2024-04-12T13:41:56.433 INFO:tasks.workunit.client.1.smithi110.stdout:4/296: dread - d0/d19/d26/f59 zero size 2024-04-12T13:41:56.435 INFO:tasks.workunit.client.1.smithi110.stdout:6/269: write d7/d25/d30/d44/f1d [2511303,81548] 0 2024-04-12T13:41:56.435 INFO:tasks.workunit.client.0.smithi060.stdout:7/214: symlink d0/d7/d43/d4d/l4f 0 2024-04-12T13:41:56.443 INFO:tasks.workunit.client.0.smithi060.stdout:6/314: dwrite d1/d7/da/dc/d24/d2d/f55 [0,4194304] 0 2024-04-12T13:41:56.448 INFO:tasks.workunit.client.0.smithi060.stdout:1/238: creat d1e/d29/d37/f56 x:0 0 0 2024-04-12T13:41:56.452 INFO:tasks.workunit.client.0.smithi060.stdout:2/201: dwrite d6/f14 [0,4194304] 0 2024-04-12T13:41:56.454 INFO:tasks.workunit.client.1.smithi110.stdout:2/244: creat d6/d18/f41 x:0 0 0 2024-04-12T13:41:56.458 INFO:tasks.workunit.client.0.smithi060.stdout:0/227: dread d7/fd [0,4194304] 0 2024-04-12T13:41:56.461 INFO:tasks.workunit.client.1.smithi110.stdout:9/298: mkdir df/d13/d26/d37/d6a 0 2024-04-12T13:41:56.463 INFO:tasks.workunit.client.0.smithi060.stdout:5/290: creat d6/d10/f68 x:0 0 0 2024-04-12T13:41:56.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/215: rename d0/d1b/c2a to d0/d7/c50 0 2024-04-12T13:41:56.464 INFO:tasks.workunit.client.1.smithi110.stdout:0/182: mkdir d1/d8/d3e 0 2024-04-12T13:41:56.469 INFO:tasks.workunit.client.0.smithi060.stdout:1/239: mknod d1e/d23/d49/d4e/c57 0 2024-04-12T13:41:56.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/228: creat d7/d9/d4c/f55 x:0 0 0 2024-04-12T13:41:56.475 INFO:tasks.workunit.client.1.smithi110.stdout:5/178: rename da/db/d15/d39 to da/db/d3b/d40 0 2024-04-12T13:41:56.475 INFO:tasks.workunit.client.0.smithi060.stdout:1/240: write d1e/d29/d37/f56 [407533,23537] 0 2024-04-12T13:41:56.475 INFO:tasks.workunit.client.0.smithi060.stdout:9/195: dwrite d4/d9/d19/d21/f1c [0,4194304] 0 2024-04-12T13:41:56.476 INFO:tasks.workunit.client.1.smithi110.stdout:5/179: chown da/db/d3b 48747 1 2024-04-12T13:41:56.477 INFO:tasks.workunit.client.1.smithi110.stdout:4/297: creat d0/d19/f62 x:0 0 0 2024-04-12T13:41:56.479 INFO:tasks.workunit.client.1.smithi110.stdout:4/298: write d0/d19/d26/f53 [690467,54725] 0 2024-04-12T13:41:56.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/196: chown d4/d8/l29 0 1 2024-04-12T13:41:56.482 INFO:tasks.workunit.client.1.smithi110.stdout:8/204: creat d1/d5/dd/d31/f3d x:0 0 0 2024-04-12T13:41:56.484 INFO:tasks.workunit.client.1.smithi110.stdout:4/299: dread d0/de/d2c/f4d [0,4194304] 0 2024-04-12T13:41:56.486 INFO:tasks.workunit.client.0.smithi060.stdout:2/202: creat d6/d13/d17/f3c x:0 0 0 2024-04-12T13:41:56.491 INFO:tasks.workunit.client.1.smithi110.stdout:0/183: unlink d1/f35 0 2024-04-12T13:41:56.494 INFO:tasks.workunit.client.1.smithi110.stdout:7/213: truncate d1/f5 1660940 0 2024-04-12T13:41:56.495 INFO:tasks.workunit.client.1.smithi110.stdout:7/214: chown d1/f28 107835822 1 2024-04-12T13:41:56.496 INFO:tasks.workunit.client.0.smithi060.stdout:5/291: dwrite d6/d10/f2b [0,4194304] 0 2024-04-12T13:41:56.500 INFO:tasks.workunit.client.1.smithi110.stdout:3/208: getdents d5/dc/d31/d3b/d32 0 2024-04-12T13:41:56.501 INFO:tasks.workunit.client.1.smithi110.stdout:2/245: symlink d6/d18/d19/l42 0 2024-04-12T13:41:56.502 INFO:tasks.workunit.client.0.smithi060.stdout:8/250: dwrite d9/d1b/f19 [0,4194304] 0 2024-04-12T13:41:56.502 INFO:tasks.workunit.client.1.smithi110.stdout:4/300: symlink d0/d19/d1c/l63 0 2024-04-12T13:41:56.506 INFO:tasks.workunit.client.1.smithi110.stdout:1/183: link de/d15/f3f de/d1d/f45 0 2024-04-12T13:41:56.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/197: unlink d4/d9/l28 0 2024-04-12T13:41:56.506 INFO:tasks.workunit.client.0.smithi060.stdout:7/216: dread - d0/d7/f49 zero size 2024-04-12T13:41:56.508 INFO:tasks.workunit.client.0.smithi060.stdout:0/229: symlink d7/d9/d14/l56 0 2024-04-12T13:41:56.512 INFO:tasks.workunit.client.1.smithi110.stdout:7/215: rmdir d1/d1b/d33 39 2024-04-12T13:41:56.513 INFO:tasks.workunit.client.0.smithi060.stdout:0/230: dread - d7/d9/f48 zero size 2024-04-12T13:41:56.516 INFO:tasks.workunit.client.1.smithi110.stdout:6/270: rename l2 to d7/d10/d1c/d2b/d3a/l50 0 2024-04-12T13:41:56.518 INFO:tasks.workunit.client.0.smithi060.stdout:2/203: truncate d6/d13/d17/f1f 1694985 0 2024-04-12T13:41:56.518 INFO:tasks.workunit.client.0.smithi060.stdout:6/315: dread d1/d7/da/dc/d24/d2d/f3d [0,4194304] 0 2024-04-12T13:41:56.519 INFO:tasks.workunit.client.1.smithi110.stdout:3/209: rmdir d5/dc/d31/d3b 39 2024-04-12T13:41:56.520 INFO:tasks.workunit.client.0.smithi060.stdout:8/251: creat d9/da/f53 x:0 0 0 2024-04-12T13:41:56.522 INFO:tasks.workunit.client.0.smithi060.stdout:1/241: dread d1e/f31 [0,4194304] 0 2024-04-12T13:41:56.522 INFO:tasks.workunit.client.1.smithi110.stdout:4/301: creat d0/d19/d26/f64 x:0 0 0 2024-04-12T13:41:56.523 INFO:tasks.workunit.client.1.smithi110.stdout:2/246: truncate d6/dc/dd/f1f 2887326 0 2024-04-12T13:41:56.523 INFO:tasks.workunit.client.1.smithi110.stdout:4/302: write d0/d19/d1c/f25 [368622,52391] 0 2024-04-12T13:41:56.526 INFO:tasks.workunit.client.0.smithi060.stdout:9/198: fsync d4/d9/fc 0 2024-04-12T13:41:56.528 INFO:tasks.workunit.client.1.smithi110.stdout:7/216: unlink d1/d1b/d3d/c41 0 2024-04-12T13:41:56.531 INFO:tasks.workunit.client.0.smithi060.stdout:7/217: mknod d0/c51 0 2024-04-12T13:41:56.533 INFO:tasks.workunit.client.0.smithi060.stdout:3/204: sync 2024-04-12T13:41:56.533 INFO:tasks.workunit.client.0.smithi060.stdout:4/263: sync 2024-04-12T13:41:56.534 INFO:tasks.workunit.client.0.smithi060.stdout:5/292: dwrite d6/d10/d12/f36 [0,4194304] 0 2024-04-12T13:41:56.537 INFO:tasks.workunit.client.0.smithi060.stdout:4/264: write d6/d7/db/f3c [828814,42585] 0 2024-04-12T13:41:56.537 INFO:tasks.workunit.client.1.smithi110.stdout:5/180: rename da/d2e/f33 to da/d35/f41 0 2024-04-12T13:41:56.539 INFO:tasks.workunit.client.0.smithi060.stdout:0/231: mknod d7/d33/c57 0 2024-04-12T13:41:56.543 INFO:tasks.workunit.client.1.smithi110.stdout:0/184: dread d1/d11/f18 [0,4194304] 0 2024-04-12T13:41:56.543 INFO:tasks.workunit.client.0.smithi060.stdout:6/316: write d1/d7/da/dc/d3a/f49 [2365744,4653] 0 2024-04-12T13:41:56.547 INFO:tasks.workunit.client.1.smithi110.stdout:4/303: write d0/d19/d1c/f60 [847660,119796] 0 2024-04-12T13:41:56.552 INFO:tasks.workunit.client.1.smithi110.stdout:1/184: mknod de/d1d/c46 0 2024-04-12T13:41:56.554 INFO:tasks.workunit.client.0.smithi060.stdout:1/242: rmdir d1e/d46 39 2024-04-12T13:41:56.554 INFO:tasks.workunit.client.1.smithi110.stdout:7/217: mknod d1/d3/d22/c42 0 2024-04-12T13:41:56.554 INFO:tasks.workunit.client.0.smithi060.stdout:6/317: read - d1/d7/da/dc/d24/d30/d52/d5e/f68 zero size 2024-04-12T13:41:56.556 INFO:tasks.workunit.client.1.smithi110.stdout:7/218: stat d1/d3/d4/f2e 0 2024-04-12T13:41:56.557 INFO:tasks.workunit.client.0.smithi060.stdout:5/293: mknod d6/dd/d1f/d25/d42/d52/c69 0 2024-04-12T13:41:56.557 INFO:tasks.workunit.client.1.smithi110.stdout:7/219: write d1/f23 [3979515,17194] 0 2024-04-12T13:41:56.560 INFO:tasks.workunit.client.1.smithi110.stdout:5/181: write da/d35/f41 [813939,46451] 0 2024-04-12T13:41:56.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/232: rename c6 to d7/d9/d14/d4a/c58 0 2024-04-12T13:41:56.560 INFO:tasks.workunit.client.0.smithi060.stdout:8/252: mkdir d9/d1b/d37/d4d/d54 0 2024-04-12T13:41:56.561 INFO:tasks.workunit.client.1.smithi110.stdout:6/271: symlink d7/d25/d30/l51 0 2024-04-12T13:41:56.562 INFO:tasks.workunit.client.0.smithi060.stdout:7/218: dread - d0/d7/f45 zero size 2024-04-12T13:41:56.563 INFO:tasks.workunit.client.1.smithi110.stdout:5/182: write da/d2e/f30 [303048,75359] 0 2024-04-12T13:41:56.566 INFO:tasks.workunit.client.0.smithi060.stdout:0/233: fdatasync d7/d9/f1a 0 2024-04-12T13:41:56.568 INFO:tasks.workunit.client.1.smithi110.stdout:4/304: mkdir d0/d19/d26/d65 0 2024-04-12T13:41:56.569 INFO:tasks.workunit.client.0.smithi060.stdout:4/265: creat d6/d7/dd/d1a/d56/f5c x:0 0 0 2024-04-12T13:41:56.569 INFO:tasks.workunit.client.0.smithi060.stdout:2/204: dwrite d6/d13/d31/d33/f39 [0,4194304] 0 2024-04-12T13:41:56.572 INFO:tasks.workunit.client.1.smithi110.stdout:9/299: sync 2024-04-12T13:41:56.572 INFO:tasks.workunit.client.1.smithi110.stdout:1/185: dread de/d15/f1c [0,4194304] 0 2024-04-12T13:41:56.573 INFO:tasks.workunit.client.0.smithi060.stdout:9/199: dwrite d4/d25/f2b [0,4194304] 0 2024-04-12T13:41:56.574 INFO:tasks.workunit.client.1.smithi110.stdout:1/186: write de/d15/f31 [160754,119664] 0 2024-04-12T13:41:56.577 INFO:tasks.workunit.client.0.smithi060.stdout:2/205: readlink d6/lb 0 2024-04-12T13:41:56.579 INFO:tasks.workunit.client.0.smithi060.stdout:3/205: link d7/d17/f28 d7/da/f3e 0 2024-04-12T13:41:56.582 INFO:tasks.workunit.client.1.smithi110.stdout:6/272: truncate d7/d10/f35 3150388 0 2024-04-12T13:41:56.583 INFO:tasks.workunit.client.1.smithi110.stdout:3/210: dwrite d5/f40 [0,4194304] 0 2024-04-12T13:41:56.583 INFO:tasks.workunit.client.0.smithi060.stdout:3/206: read d7/f10 [1466372,85609] 0 2024-04-12T13:41:56.583 INFO:tasks.workunit.client.0.smithi060.stdout:8/253: creat d9/d1b/d2b/f55 x:0 0 0 2024-04-12T13:41:56.586 INFO:tasks.workunit.client.1.smithi110.stdout:5/183: symlink da/d2e/l42 0 2024-04-12T13:41:56.587 INFO:tasks.workunit.client.1.smithi110.stdout:5/184: write da/f11 [3635154,102078] 0 2024-04-12T13:41:56.588 INFO:tasks.workunit.client.0.smithi060.stdout:8/254: chown d9/d1b/d37/d48 124871156 1 2024-04-12T13:41:56.588 INFO:tasks.workunit.client.0.smithi060.stdout:1/243: truncate d1e/d23/f25 5222043 0 2024-04-12T13:41:56.592 INFO:tasks.workunit.client.0.smithi060.stdout:0/234: mknod d7/d9/d14/d35/d3c/c59 0 2024-04-12T13:41:56.593 INFO:tasks.workunit.client.1.smithi110.stdout:0/185: write d1/d8/f24 [1213842,122550] 0 2024-04-12T13:41:56.596 INFO:tasks.workunit.client.0.smithi060.stdout:4/266: creat d6/d21/f5d x:0 0 0 2024-04-12T13:41:56.600 INFO:tasks.workunit.client.0.smithi060.stdout:5/294: dread d6/d10/d12/d38/f47 [0,4194304] 0 2024-04-12T13:41:56.601 INFO:tasks.workunit.client.0.smithi060.stdout:9/200: dread d4/d9/d19/f34 [0,4194304] 0 2024-04-12T13:41:56.602 INFO:tasks.workunit.client.0.smithi060.stdout:7/219: mknod d0/d7/d43/c52 0 2024-04-12T13:41:56.606 INFO:tasks.workunit.client.1.smithi110.stdout:8/205: sync 2024-04-12T13:41:56.607 INFO:tasks.workunit.client.1.smithi110.stdout:9/300: mknod df/d13/d2c/d2d/d39/d4f/d58/d63/c6b 0 2024-04-12T13:41:56.607 INFO:tasks.workunit.client.1.smithi110.stdout:8/206: readlink d1/d7/l18 0 2024-04-12T13:41:56.608 INFO:tasks.workunit.client.1.smithi110.stdout:1/187: mknod de/d14/c47 0 2024-04-12T13:41:56.609 INFO:tasks.workunit.client.0.smithi060.stdout:7/220: truncate d0/f2f 935101 0 2024-04-12T13:41:56.612 INFO:tasks.workunit.client.1.smithi110.stdout:7/220: mkdir d1/d3/d43 0 2024-04-12T13:41:56.613 INFO:tasks.workunit.client.0.smithi060.stdout:3/207: unlink d7/d17/f20 0 2024-04-12T13:41:56.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.611+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f98b8107b10 con 0x7f98b80ff020 2024-04-12T13:41:56.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.612+0000 7f98b4c00700 1 -- 172.21.15.60:0/96514508 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f98ac057040 con 0x7f98b80ff020 2024-04-12T13:41:56.615 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:41:56.616 INFO:tasks.workunit.client.0.smithi060.stdout:8/255: dwrite d9/d1b/d2b/f50 [0,4194304] 0 2024-04-12T13:41:56.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.617+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 msgr2=0x7f98a006e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:56.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.617+0000 7f98bfa00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 0x7f98a006e2b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98a4013870 tx=0x7f98a4009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:56.619 INFO:tasks.workunit.client.0.smithi060.stdout:3/208: fdatasync f0 0 2024-04-12T13:41:56.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.617+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 msgr2=0x7f98b810fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:41:56.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.617+0000 7f98bfa00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0096d0 tx=0x7f98ac009e30 comp rx=0 tx=0).stop 2024-04-12T13:41:56.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.618+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 shutdown_connections 2024-04-12T13:41:56.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.618+0000 7f98bfa00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f98a006be00 0x7f98a006e2b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.618+0000 7f98bfa00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98b80ff020 0x7f98b810fad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.618+0000 7f98bfa00700 1 --2- 172.21.15.60:0/96514508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b81002d0 0x7f98b8110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:41:56.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.618+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 >> 172.21.15.60:0/96514508 conn(0x7f98b80fa950 msgr2=0x7f98b80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:41:56.620 INFO:tasks.workunit.client.1.smithi110.stdout:3/211: symlink d5/dc/l46 0 2024-04-12T13:41:56.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.619+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 shutdown_connections 2024-04-12T13:41:56.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:41:56.619+0000 7f98bfa00700 1 -- 172.21.15.60:0/96514508 wait complete. 2024-04-12T13:41:56.622 INFO:tasks.workunit.client.1.smithi110.stdout:1/188: dread f5 [0,4194304] 0 2024-04-12T13:41:56.625 INFO:tasks.workunit.client.0.smithi060.stdout:2/206: dread d6/f19 [0,4194304] 0 2024-04-12T13:41:56.635 INFO:tasks.workunit.client.0.smithi060.stdout:5/295: write d6/dd/d1f/d32/d46/f62 [2937119,2168] 0 2024-04-12T13:41:56.638 INFO:tasks.workunit.client.1.smithi110.stdout:4/305: unlink d0/c7 0 2024-04-12T13:41:56.638 INFO:tasks.workunit.client.0.smithi060.stdout:5/296: truncate d6/d10/f68 222655 0 2024-04-12T13:41:56.642 INFO:tasks.workunit.client.1.smithi110.stdout:2/247: link d6/dc/f2b d6/dc/d13/f43 0 2024-04-12T13:41:56.643 INFO:tasks.workunit.client.1.smithi110.stdout:2/248: stat d6/dc/dd/f10 0 2024-04-12T13:41:56.644 INFO:tasks.workunit.client.1.smithi110.stdout:2/249: chown d6/f8 4 1 2024-04-12T13:41:56.644 INFO:tasks.workunit.client.0.smithi060.stdout:4/267: link d6/d7/dd/d1a/d19/f52 d6/d7/dd/d1a/d19/f5e 0 2024-04-12T13:41:56.651 INFO:tasks.workunit.client.0.smithi060.stdout:0/235: rename d7/d9/d14/d35/d44/l4e to d7/d9/d14/d4a/l5a 0 2024-04-12T13:41:56.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/236: fdatasync d7/d9/f48 0 2024-04-12T13:41:56.654 INFO:tasks.workunit.client.0.smithi060.stdout:5/297: dread d6/d10/d12/d15/f22 [0,4194304] 0 2024-04-12T13:41:56.655 INFO:tasks.workunit.client.0.smithi060.stdout:0/237: write d7/d9/f21 [482036,75388] 0 2024-04-12T13:41:56.660 INFO:tasks.workunit.client.1.smithi110.stdout:3/212: unlink d5/dc/fd 0 2024-04-12T13:41:56.661 INFO:tasks.workunit.client.0.smithi060.stdout:0/238: write d7/d9/d14/d35/d44/d49/f51 [919096,129678] 0 2024-04-12T13:41:56.662 INFO:tasks.workunit.client.0.smithi060.stdout:1/244: dwrite d1e/d23/d2e/f3a [4194304,4194304] 0 2024-04-12T13:41:56.664 INFO:tasks.workunit.client.0.smithi060.stdout:6/318: link d1/d7/da/dc/l6c d1/d7/da/dc/d24/d2d/l73 0 2024-04-12T13:41:56.664 INFO:tasks.workunit.client.0.smithi060.stdout:1/245: stat f7 0 2024-04-12T13:41:56.664 INFO:tasks.workunit.client.1.smithi110.stdout:4/306: symlink d0/de/d32/l66 0 2024-04-12T13:41:56.666 INFO:tasks.workunit.client.1.smithi110.stdout:0/186: symlink d1/d8/l3f 0 2024-04-12T13:41:56.667 INFO:tasks.workunit.client.0.smithi060.stdout:6/319: dread - d1/d7/da/dc/d24/d30/d52/f60 zero size 2024-04-12T13:41:56.670 INFO:tasks.workunit.client.1.smithi110.stdout:2/250: unlink d6/dc/dd/f10 0 2024-04-12T13:41:56.671 INFO:tasks.workunit.client.1.smithi110.stdout:2/251: chown d6/d18/d3b/d3c 284 1 2024-04-12T13:41:56.671 INFO:tasks.workunit.client.0.smithi060.stdout:2/207: rename d6/d10/d16/d26 to d6/d13/d31/d33/d3d 0 2024-04-12T13:41:56.673 INFO:tasks.workunit.client.0.smithi060.stdout:3/209: mkdir d7/da/d3f 0 2024-04-12T13:41:56.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/256: creat d9/d1b/d3c/f56 x:0 0 0 2024-04-12T13:41:56.680 INFO:tasks.workunit.client.0.smithi060.stdout:9/201: creat d4/d9/f3f x:0 0 0 2024-04-12T13:41:56.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/298: creat d6/dd/d1f/d25/f6a x:0 0 0 2024-04-12T13:41:56.688 INFO:tasks.workunit.client.0.smithi060.stdout:0/239: mkdir d7/d33/d5b 0 2024-04-12T13:41:56.694 INFO:tasks.workunit.client.0.smithi060.stdout:2/208: symlink d6/d13/d17/d21/l3e 0 2024-04-12T13:41:56.696 INFO:tasks.workunit.client.1.smithi110.stdout:2/252: creat d6/d18/d3b/d3c/f44 x:0 0 0 2024-04-12T13:41:56.700 INFO:tasks.workunit.client.1.smithi110.stdout:4/307: dread d0/d19/f23 [0,4194304] 0 2024-04-12T13:41:56.701 INFO:tasks.workunit.client.0.smithi060.stdout:8/257: mknod d9/d1b/d37/d48/c57 0 2024-04-12T13:41:56.701 INFO:tasks.workunit.client.1.smithi110.stdout:7/221: rename d1/d3/d22/c40 to d1/d3/c44 0 2024-04-12T13:41:56.702 INFO:tasks.workunit.client.0.smithi060.stdout:9/202: rmdir d4/d8/d32 39 2024-04-12T13:41:56.702 INFO:tasks.workunit.client.1.smithi110.stdout:6/273: link d7/d10/l16 d7/d10/d1c/d4d/l52 0 2024-04-12T13:41:56.702 INFO:tasks.workunit.client.0.smithi060.stdout:1/246: dwrite d1e/f31 [0,4194304] 0 2024-04-12T13:41:56.703 INFO:tasks.workunit.client.1.smithi110.stdout:5/185: getdents da/d35 0 2024-04-12T13:41:56.703 INFO:tasks.workunit.client.1.smithi110.stdout:4/308: chown d0/d19/d1c/l63 44571 1 2024-04-12T13:41:56.704 INFO:tasks.workunit.client.0.smithi060.stdout:7/221: getdents d0/d7/d43 0 2024-04-12T13:41:56.704 INFO:tasks.workunit.client.0.smithi060.stdout:5/299: mkdir d6/dd/d1f/d25/d42/d6b 0 2024-04-12T13:41:56.706 INFO:tasks.workunit.client.1.smithi110.stdout:3/213: symlink d5/dc/d31/d3b/d32/l47 0 2024-04-12T13:41:56.707 INFO:tasks.workunit.client.0.smithi060.stdout:7/222: chown d0/l3b 226016 1 2024-04-12T13:41:56.707 INFO:tasks.workunit.client.1.smithi110.stdout:9/301: getdents df/d13/d2c 0 2024-04-12T13:41:56.711 INFO:tasks.workunit.client.1.smithi110.stdout:3/214: chown d5/dc/d20/d2d 14 1 2024-04-12T13:41:56.711 INFO:tasks.workunit.client.1.smithi110.stdout:8/207: getdents d1/d3/d35 0 2024-04-12T13:41:56.714 INFO:tasks.workunit.client.1.smithi110.stdout:1/189: rename de to de/d48 22 2024-04-12T13:41:56.715 INFO:tasks.workunit.client.1.smithi110.stdout:3/215: read d5/dc/f12 [1542287,74260] 0 2024-04-12T13:41:56.716 INFO:tasks.workunit.client.0.smithi060.stdout:1/247: rename d1e/d23/f43 to d1e/d23/d49/d4e/f58 0 2024-04-12T13:41:56.717 INFO:tasks.workunit.client.1.smithi110.stdout:7/222: mknod d1/c45 0 2024-04-12T13:41:56.718 INFO:tasks.workunit.client.0.smithi060.stdout:0/240: dread d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:56.719 INFO:tasks.workunit.client.0.smithi060.stdout:7/223: unlink d0/f2f 0 2024-04-12T13:41:56.719 INFO:tasks.workunit.client.1.smithi110.stdout:7/223: write d1/f23 [2536688,40891] 0 2024-04-12T13:41:56.719 INFO:tasks.workunit.client.1.smithi110.stdout:0/187: dwrite d1/f22 [4194304,4194304] 0 2024-04-12T13:41:56.721 INFO:tasks.workunit.client.0.smithi060.stdout:3/210: link d7/da/l24 d7/d17/d19/d33/l40 0 2024-04-12T13:41:56.723 INFO:tasks.workunit.client.0.smithi060.stdout:3/211: readlink d7/d17/l32 0 2024-04-12T13:41:56.725 INFO:tasks.workunit.client.0.smithi060.stdout:6/320: truncate d1/d7/da/d20/f4a 921411 0 2024-04-12T13:41:56.726 INFO:tasks.workunit.client.1.smithi110.stdout:4/309: dread d0/d19/d26/f40 [0,4194304] 0 2024-04-12T13:41:56.726 INFO:tasks.workunit.client.0.smithi060.stdout:3/212: write d7/d17/d19/f23 [3256055,73843] 0 2024-04-12T13:41:56.731 INFO:tasks.workunit.client.1.smithi110.stdout:9/302: fsync df/f25 0 2024-04-12T13:41:56.731 INFO:tasks.workunit.client.0.smithi060.stdout:5/300: rename d6/l56 to d6/d10/d12/d38/l6c 0 2024-04-12T13:41:56.735 INFO:tasks.workunit.client.1.smithi110.stdout:1/190: mknod de/d15/c49 0 2024-04-12T13:41:56.739 INFO:tasks.workunit.client.0.smithi060.stdout:5/301: write d6/dd/d1f/d25/d42/d52/f5e [688697,89170] 0 2024-04-12T13:41:56.740 INFO:tasks.workunit.client.0.smithi060.stdout:2/209: dwrite d6/f32 [0,4194304] 0 2024-04-12T13:41:56.741 INFO:tasks.workunit.client.1.smithi110.stdout:3/216: mknod d5/dc/d31/d3b/d32/d3e/c48 0 2024-04-12T13:41:56.743 INFO:tasks.workunit.client.0.smithi060.stdout:2/210: write d6/f24 [240250,57899] 0 2024-04-12T13:41:56.745 INFO:tasks.workunit.client.1.smithi110.stdout:6/274: mknod d7/d10/c53 0 2024-04-12T13:41:56.750 INFO:tasks.workunit.client.1.smithi110.stdout:0/188: stat d1/d8/d36 0 2024-04-12T13:41:56.751 INFO:tasks.workunit.client.1.smithi110.stdout:0/189: chown d1/d8/f2e 48987 1 2024-04-12T13:41:56.753 INFO:tasks.workunit.client.1.smithi110.stdout:2/253: truncate d6/d18/d20/f2f 1732915 0 2024-04-12T13:41:56.754 INFO:tasks.workunit.client.1.smithi110.stdout:7/224: symlink d1/d3/d22/l46 0 2024-04-12T13:41:56.757 INFO:tasks.workunit.client.0.smithi060.stdout:9/203: creat d4/d8/f40 x:0 0 0 2024-04-12T13:41:56.758 INFO:tasks.workunit.client.0.smithi060.stdout:6/321: creat d1/d7/da/dc/f74 x:0 0 0 2024-04-12T13:41:56.759 INFO:tasks.workunit.client.0.smithi060.stdout:0/241: dread d7/d9/f21 [0,4194304] 0 2024-04-12T13:41:56.761 INFO:tasks.workunit.client.0.smithi060.stdout:2/211: symlink d6/d13/d31/d33/l3f 0 2024-04-12T13:41:56.763 INFO:tasks.workunit.client.1.smithi110.stdout:9/303: rename f5 to df/d13/d3b/d40/d56/f6c 0 2024-04-12T13:41:56.764 INFO:tasks.workunit.client.1.smithi110.stdout:9/304: fdatasync df/f1e 0 2024-04-12T13:41:56.765 INFO:tasks.workunit.client.0.smithi060.stdout:9/204: dread d4/d8/f2c [0,4194304] 0 2024-04-12T13:41:56.766 INFO:tasks.workunit.client.0.smithi060.stdout:3/213: dread d7/f8 [8388608,4194304] 0 2024-04-12T13:41:56.768 INFO:tasks.workunit.client.0.smithi060.stdout:5/302: rename d6/d10/d12/d38/f47 to d6/dd/d1f/f6d 0 2024-04-12T13:41:56.769 INFO:tasks.workunit.client.1.smithi110.stdout:8/208: mkdir d1/d3/d35/d3a/d3e 0 2024-04-12T13:41:56.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/248: dwrite d1e/d23/d49/d4e/f58 [0,4194304] 0 2024-04-12T13:41:56.772 INFO:tasks.workunit.client.1.smithi110.stdout:1/191: fdatasync de/f10 0 2024-04-12T13:41:56.775 INFO:tasks.workunit.client.1.smithi110.stdout:6/275: chown d7/d25/d2c/l2e 872241 1 2024-04-12T13:41:56.780 INFO:tasks.workunit.client.1.smithi110.stdout:2/254: mkdir d6/dc/d1b/d45 0 2024-04-12T13:41:56.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/224: dread d0/d7/f33 [0,4194304] 0 2024-04-12T13:41:56.782 INFO:tasks.workunit.client.1.smithi110.stdout:8/209: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:56.783 INFO:tasks.workunit.client.1.smithi110.stdout:7/225: chown d1/d3/d4/d36/l39 5297005 1 2024-04-12T13:41:56.785 INFO:tasks.workunit.client.0.smithi060.stdout:3/214: rmdir d7/d17/d19/d33 39 2024-04-12T13:41:56.785 INFO:tasks.workunit.client.1.smithi110.stdout:5/186: creat da/db/d15/d17/d25/f43 x:0 0 0 2024-04-12T13:41:56.787 INFO:tasks.workunit.client.0.smithi060.stdout:1/249: stat d1e/d23/f25 0 2024-04-12T13:41:56.791 INFO:tasks.workunit.client.0.smithi060.stdout:9/205: fdatasync d4/d8/fa 0 2024-04-12T13:41:56.794 INFO:tasks.workunit.client.0.smithi060.stdout:3/215: unlink d7/da/c2d 0 2024-04-12T13:41:56.795 INFO:tasks.workunit.client.1.smithi110.stdout:4/310: truncate d0/d13/f2a 5930556 0 2024-04-12T13:41:56.797 INFO:tasks.workunit.client.1.smithi110.stdout:2/255: dwrite d6/dc/dd/f22 [0,4194304] 0 2024-04-12T13:41:56.797 INFO:tasks.workunit.client.1.smithi110.stdout:4/311: write d0/d19/d26/f53 [1334508,42390] 0 2024-04-12T13:41:56.800 INFO:tasks.workunit.client.1.smithi110.stdout:3/217: rename d5/dc/d31/d3b/l2c to d5/dc/d31/d3b/d32/d3e/l49 0 2024-04-12T13:41:56.802 INFO:tasks.workunit.client.0.smithi060.stdout:6/322: rename d1/d7/da/d20/f4a to d1/d7/da/dc/f75 0 2024-04-12T13:41:56.802 INFO:tasks.workunit.client.1.smithi110.stdout:3/218: truncate d5/dc/d20/d2d/f35 4405041 0 2024-04-12T13:41:56.804 INFO:tasks.workunit.client.0.smithi060.stdout:0/242: creat d7/d9/d14/f5c x:0 0 0 2024-04-12T13:41:56.805 INFO:tasks.workunit.client.1.smithi110.stdout:9/305: write df/f24 [824092,73456] 0 2024-04-12T13:41:56.815 INFO:tasks.workunit.client.1.smithi110.stdout:2/256: fsync d6/dc/dd/f22 0 2024-04-12T13:41:56.817 INFO:tasks.workunit.client.0.smithi060.stdout:5/303: rename d6/dd/d1f/f6d to d6/dd/d1f/d25/d53/f6e 0 2024-04-12T13:41:56.819 INFO:tasks.workunit.client.0.smithi060.stdout:6/323: symlink d1/d7/da/dc/d24/d30/d52/d5e/l76 0 2024-04-12T13:41:56.820 INFO:tasks.workunit.client.1.smithi110.stdout:8/210: creat d1/d7/f3f x:0 0 0 2024-04-12T13:41:56.820 INFO:tasks.workunit.client.0.smithi060.stdout:6/324: stat d1/d7/c2b 0 2024-04-12T13:41:56.821 INFO:tasks.workunit.client.1.smithi110.stdout:7/226: truncate d1/d3/d22/f25 840019 0 2024-04-12T13:41:56.822 INFO:tasks.workunit.client.1.smithi110.stdout:7/227: chown d1/f18 0 1 2024-04-12T13:41:56.822 INFO:tasks.workunit.client.0.smithi060.stdout:3/216: creat d7/da/d3f/f41 x:0 0 0 2024-04-12T13:41:56.823 INFO:tasks.workunit.client.1.smithi110.stdout:7/228: readlink d1/d3/l8 0 2024-04-12T13:41:56.826 INFO:tasks.workunit.client.0.smithi060.stdout:6/325: symlink d1/d7/da/dc/d24/d30/l77 0 2024-04-12T13:41:56.828 INFO:tasks.workunit.client.0.smithi060.stdout:9/206: dwrite d4/d8/fa [0,4194304] 0 2024-04-12T13:41:56.833 INFO:tasks.workunit.client.0.smithi060.stdout:7/225: rename d0/f1a to d0/d1b/f53 0 2024-04-12T13:41:56.834 INFO:tasks.workunit.client.0.smithi060.stdout:7/226: chown d0/d7/f45 41736357 1 2024-04-12T13:41:56.835 INFO:tasks.workunit.client.1.smithi110.stdout:3/219: creat d5/dc/d31/d3b/f4a x:0 0 0 2024-04-12T13:41:56.835 INFO:tasks.workunit.client.0.smithi060.stdout:1/250: dwrite d1e/d1f/f4b [0,4194304] 0 2024-04-12T13:41:56.839 INFO:tasks.workunit.client.1.smithi110.stdout:9/306: rmdir df/d13/d2c/d2d/d39 39 2024-04-12T13:41:56.842 INFO:tasks.workunit.client.1.smithi110.stdout:6/276: mkdir d7/d10/d1c/d2b/d48/d54 0 2024-04-12T13:41:56.844 INFO:tasks.workunit.client.0.smithi060.stdout:6/326: mkdir d1/d7/da/dc/d24/d30/d52/d78 0 2024-04-12T13:41:56.847 INFO:tasks.workunit.client.0.smithi060.stdout:9/207: fdatasync d4/d9/f3e 0 2024-04-12T13:41:56.847 INFO:tasks.workunit.client.0.smithi060.stdout:5/304: rename d6/fc to d6/dd/d1f/d32/f6f 0 2024-04-12T13:41:56.848 INFO:tasks.workunit.client.0.smithi060.stdout:7/227: dread d0/d7/f33 [0,4194304] 0 2024-04-12T13:41:56.848 INFO:tasks.workunit.client.1.smithi110.stdout:2/257: symlink d6/dc/dd/l46 0 2024-04-12T13:41:56.850 INFO:tasks.workunit.client.1.smithi110.stdout:2/258: fsync d6/d18/d3b/d3c/f44 0 2024-04-12T13:41:56.850 INFO:tasks.workunit.client.0.smithi060.stdout:1/251: mknod d1e/d23/d49/d4e/c59 0 2024-04-12T13:41:56.851 INFO:tasks.workunit.client.1.smithi110.stdout:2/259: chown d6/dc/d1b/d45 3518304 1 2024-04-12T13:41:56.851 INFO:tasks.workunit.client.1.smithi110.stdout:8/211: symlink d1/d3/d35/l40 0 2024-04-12T13:41:56.851 INFO:tasks.workunit.client.0.smithi060.stdout:1/252: write d1e/d1f/f4a [2189386,46616] 0 2024-04-12T13:41:56.853 INFO:tasks.workunit.client.0.smithi060.stdout:3/217: creat d7/d17/f42 x:0 0 0 2024-04-12T13:41:56.855 INFO:tasks.workunit.client.0.smithi060.stdout:7/228: symlink d0/d1b/l54 0 2024-04-12T13:41:56.856 INFO:tasks.workunit.client.1.smithi110.stdout:3/220: readlink d5/l15 0 2024-04-12T13:41:56.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/229: fsync d0/d7/f45 0 2024-04-12T13:41:56.860 INFO:tasks.workunit.client.1.smithi110.stdout:4/312: chown d0/d19/f20 148599912 1 2024-04-12T13:41:56.862 INFO:tasks.workunit.client.1.smithi110.stdout:0/190: link d1/l1b d1/d11/l40 0 2024-04-12T13:41:56.863 INFO:tasks.workunit.client.0.smithi060.stdout:3/218: write d7/d17/d19/d33/f39 [572982,47226] 0 2024-04-12T13:41:56.864 INFO:tasks.workunit.client.0.smithi060.stdout:3/219: readlink d7/l1c 0 2024-04-12T13:41:56.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/305: dwrite d6/dd/d1f/d32/d46/f62 [0,4194304] 0 2024-04-12T13:41:56.873 INFO:tasks.workunit.client.1.smithi110.stdout:1/192: rename de/d14/c47 to de/d1d/c4a 0 2024-04-12T13:41:56.873 INFO:tasks.workunit.client.1.smithi110.stdout:8/212: write d1/d7/f32 [346433,52149] 0 2024-04-12T13:41:56.875 INFO:tasks.workunit.client.1.smithi110.stdout:3/221: creat d5/dc/d31/d3b/f4b x:0 0 0 2024-04-12T13:41:56.876 INFO:tasks.workunit.client.0.smithi060.stdout:1/253: rename d1e/d23/d49/d4e/c59 to d1e/d23/d49/d4e/c5a 0 2024-04-12T13:41:56.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/230: write d0/d1b/f48 [955975,118978] 0 2024-04-12T13:41:56.878 INFO:tasks.workunit.client.1.smithi110.stdout:9/307: mknod df/d13/d2c/d2d/d39/d3a/d4e/c6d 0 2024-04-12T13:41:56.878 INFO:tasks.workunit.client.0.smithi060.stdout:1/254: write d1e/d29/d37/f56 [500436,26297] 0 2024-04-12T13:41:56.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/327: rename d1/d7/da/dc/d24/d30/l77 to d1/d7/l79 0 2024-04-12T13:41:56.881 INFO:tasks.workunit.client.0.smithi060.stdout:5/306: dread d6/d10/d12/d15/f22 [0,4194304] 0 2024-04-12T13:41:56.882 INFO:tasks.workunit.client.0.smithi060.stdout:3/220: stat d7/l11 0 2024-04-12T13:41:56.883 INFO:tasks.workunit.client.0.smithi060.stdout:5/307: chown d6/dd/d27/l33 32998589 1 2024-04-12T13:41:56.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/208: rmdir d4/d9/d37 0 2024-04-12T13:41:56.884 INFO:tasks.workunit.client.1.smithi110.stdout:4/313: creat d0/d19/d1c/d50/f67 x:0 0 0 2024-04-12T13:41:56.887 INFO:tasks.workunit.client.0.smithi060.stdout:6/328: mkdir d1/d7/da/dc/d7a 0 2024-04-12T13:41:56.889 INFO:tasks.workunit.client.0.smithi060.stdout:9/209: stat d4/d9/c11 0 2024-04-12T13:41:56.893 INFO:tasks.workunit.client.1.smithi110.stdout:1/193: symlink de/d14/d34/l4b 0 2024-04-12T13:41:56.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/210: rmdir d4/d8 39 2024-04-12T13:41:56.896 INFO:tasks.workunit.client.0.smithi060.stdout:1/255: dwrite d1e/d1f/f4b [0,4194304] 0 2024-04-12T13:41:56.896 INFO:tasks.workunit.client.1.smithi110.stdout:3/222: mknod d5/dc/d31/d3b/c4c 0 2024-04-12T13:41:56.898 INFO:tasks.workunit.client.1.smithi110.stdout:3/223: write d5/dc/f27 [581952,48711] 0 2024-04-12T13:41:56.901 INFO:tasks.workunit.client.0.smithi060.stdout:6/329: rmdir d1/d7/da/dc/d24/d30/d52 39 2024-04-12T13:41:56.903 INFO:tasks.workunit.client.1.smithi110.stdout:2/260: rmdir d6/dc/d1b/d45 0 2024-04-12T13:41:56.906 INFO:tasks.workunit.client.0.smithi060.stdout:3/221: dread d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:41:56.906 INFO:tasks.workunit.client.0.smithi060.stdout:3/222: chown d7/da 16629190 1 2024-04-12T13:41:56.907 INFO:tasks.workunit.client.1.smithi110.stdout:6/277: dwrite d7/d25/d30/d44/f31 [0,4194304] 0 2024-04-12T13:41:56.911 INFO:tasks.workunit.client.0.smithi060.stdout:1/256: symlink d1e/d29/d37/l5b 0 2024-04-12T13:41:56.916 INFO:tasks.workunit.client.0.smithi060.stdout:3/223: rename d7/d17/d19/c3d to d7/da/dd/d25/c43 0 2024-04-12T13:41:56.917 INFO:tasks.workunit.client.1.smithi110.stdout:1/194: chown de/d1d/c37 20457765 1 2024-04-12T13:41:56.919 INFO:tasks.workunit.client.1.smithi110.stdout:8/213: write d1/d3/f13 [865460,61524] 0 2024-04-12T13:41:56.921 INFO:tasks.workunit.client.1.smithi110.stdout:3/224: symlink d5/dc/l4d 0 2024-04-12T13:41:56.921 INFO:tasks.workunit.client.0.smithi060.stdout:6/330: mkdir d1/d7/da/dc/d24/d30/d52/d5e/d7b 0 2024-04-12T13:41:56.923 INFO:tasks.workunit.client.1.smithi110.stdout:8/214: truncate d1/d5/dd/d31/f3d 317416 0 2024-04-12T13:41:56.924 INFO:tasks.workunit.client.0.smithi060.stdout:3/224: creat d7/da/dd/d25/f44 x:0 0 0 2024-04-12T13:41:56.924 INFO:tasks.workunit.client.1.smithi110.stdout:3/225: write d5/dc/f13 [4285041,59573] 0 2024-04-12T13:41:56.925 INFO:tasks.workunit.client.1.smithi110.stdout:5/187: rename da/db/d15/d17/f19 to da/db/d15/d17/d25/f44 0 2024-04-12T13:41:56.928 INFO:tasks.workunit.client.0.smithi060.stdout:1/257: dwrite d1e/d29/d37/f56 [0,4194304] 0 2024-04-12T13:41:56.928 INFO:tasks.workunit.client.0.smithi060.stdout:6/331: rename d1/f14 to d1/d7/da/dc/f7c 0 2024-04-12T13:41:56.929 INFO:tasks.workunit.client.1.smithi110.stdout:1/195: mknod de/d15/c4c 0 2024-04-12T13:41:56.930 INFO:tasks.workunit.client.1.smithi110.stdout:1/196: chown de/d15 1103947075 1 2024-04-12T13:41:56.931 INFO:tasks.workunit.client.0.smithi060.stdout:9/211: creat d4/d8/f41 x:0 0 0 2024-04-12T13:41:56.933 INFO:tasks.workunit.client.0.smithi060.stdout:9/212: write d4/f2d [3426946,22078] 0 2024-04-12T13:41:56.935 INFO:tasks.workunit.client.1.smithi110.stdout:2/261: write d6/dc/f2b [535686,119894] 0 2024-04-12T13:41:56.937 INFO:tasks.workunit.client.0.smithi060.stdout:3/225: creat d7/d17/d27/f45 x:0 0 0 2024-04-12T13:41:56.941 INFO:tasks.workunit.client.1.smithi110.stdout:6/278: symlink d7/d10/l55 0 2024-04-12T13:41:56.945 INFO:tasks.workunit.client.0.smithi060.stdout:1/258: dwrite d1e/d23/d49/d4e/f58 [0,4194304] 0 2024-04-12T13:41:56.949 INFO:tasks.workunit.client.1.smithi110.stdout:3/226: mkdir d5/dc/d20/d2d/d4e 0 2024-04-12T13:41:56.950 INFO:tasks.workunit.client.0.smithi060.stdout:6/332: mkdir d1/d7d 0 2024-04-12T13:41:56.951 INFO:tasks.workunit.client.1.smithi110.stdout:3/227: write d5/dc/d20/f36 [3595902,97133] 0 2024-04-12T13:41:56.952 INFO:tasks.workunit.client.0.smithi060.stdout:6/333: fsync d1/d7/f5d 0 2024-04-12T13:41:56.952 INFO:tasks.workunit.client.0.smithi060.stdout:9/213: dwrite d4/d8/f41 [0,4194304] 0 2024-04-12T13:41:56.955 INFO:tasks.workunit.client.1.smithi110.stdout:7/229: rename d1/d3/d22 to d1/d3/d43/d47 0 2024-04-12T13:41:56.956 INFO:tasks.workunit.client.1.smithi110.stdout:8/215: dwrite d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:41:56.957 INFO:tasks.workunit.client.0.smithi060.stdout:3/226: truncate d7/da/f3e 3456489 0 2024-04-12T13:41:56.961 INFO:tasks.workunit.client.1.smithi110.stdout:2/262: creat d6/dc/dd/f47 x:0 0 0 2024-04-12T13:41:56.963 INFO:tasks.workunit.client.1.smithi110.stdout:2/263: chown d6/dc/dd/f16 1065 1 2024-04-12T13:41:56.963 INFO:tasks.workunit.client.1.smithi110.stdout:4/314: link d0/de/c35 d0/de/d2c/d57/c68 0 2024-04-12T13:41:56.967 INFO:tasks.workunit.client.1.smithi110.stdout:2/264: truncate d6/dc/dd/f22 4889861 0 2024-04-12T13:41:56.967 INFO:tasks.workunit.client.1.smithi110.stdout:2/265: readlink d6/la 0 2024-04-12T13:41:56.968 INFO:tasks.workunit.client.1.smithi110.stdout:2/266: stat d6/d18/d19/c2d 0 2024-04-12T13:41:56.968 INFO:tasks.workunit.client.0.smithi060.stdout:1/259: creat d1e/d23/d2e/d30/f5c x:0 0 0 2024-04-12T13:41:56.970 INFO:tasks.workunit.client.1.smithi110.stdout:2/267: truncate d6/dc/f2b 1180883 0 2024-04-12T13:41:56.971 INFO:tasks.workunit.client.1.smithi110.stdout:2/268: readlink d6/dc/l34 0 2024-04-12T13:41:56.974 INFO:tasks.workunit.client.1.smithi110.stdout:6/279: write d7/d25/d2c/f40 [750761,124149] 0 2024-04-12T13:41:56.975 INFO:tasks.workunit.client.0.smithi060.stdout:9/214: dwrite d4/d9/f2a [0,4194304] 0 2024-04-12T13:41:56.984 INFO:tasks.workunit.client.1.smithi110.stdout:3/228: mkdir d5/dc/d20/d2d/d4f 0 2024-04-12T13:41:56.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/227: rename d7/f38 to d7/d17/d27/d36/f46 0 2024-04-12T13:41:56.986 INFO:tasks.workunit.client.0.smithi060.stdout:1/260: mknod d1e/d23/d49/d4e/c5d 0 2024-04-12T13:41:56.986 INFO:tasks.workunit.client.1.smithi110.stdout:2/269: dwrite d6/d18/d19/f2c [0,4194304] 0 2024-04-12T13:41:56.987 INFO:tasks.workunit.client.0.smithi060.stdout:1/261: fsync d1e/f2b 0 2024-04-12T13:41:56.989 INFO:tasks.workunit.client.1.smithi110.stdout:3/229: truncate d5/dc/d20/d2d/f42 384359 0 2024-04-12T13:41:56.989 INFO:tasks.workunit.client.0.smithi060.stdout:1/262: write d1e/f28 [2768621,10582] 0 2024-04-12T13:41:56.992 INFO:tasks.workunit.client.1.smithi110.stdout:0/191: rename d1/d8/f24 to d1/d11/f41 0 2024-04-12T13:41:56.993 INFO:tasks.workunit.client.1.smithi110.stdout:9/308: sync 2024-04-12T13:41:56.993 INFO:tasks.workunit.client.1.smithi110.stdout:8/216: mkdir d1/d3/d35/d3a/d41 0 2024-04-12T13:41:56.997 INFO:tasks.workunit.client.1.smithi110.stdout:4/315: truncate d0/d19/f20 4931221 0 2024-04-12T13:41:57.000 INFO:tasks.workunit.client.1.smithi110.stdout:7/230: dread d1/f2b [0,4194304] 0 2024-04-12T13:41:57.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/334: dwrite d1/d7/da/dc/f7c [0,4194304] 0 2024-04-12T13:41:57.003 INFO:tasks.workunit.client.0.smithi060.stdout:9/215: dread d4/fd [0,4194304] 0 2024-04-12T13:41:57.006 INFO:tasks.workunit.client.0.smithi060.stdout:6/335: write d1/d7/f5d [582195,125625] 0 2024-04-12T13:41:57.007 INFO:tasks.workunit.client.1.smithi110.stdout:3/230: dwrite d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:41:57.008 INFO:tasks.workunit.client.0.smithi060.stdout:1/263: mkdir d1e/d23/d2e/d5e 0 2024-04-12T13:41:57.009 INFO:tasks.workunit.client.1.smithi110.stdout:3/231: dread - d5/dc/d31/d3b/d32/d3e/f41 zero size 2024-04-12T13:41:57.013 INFO:tasks.workunit.client.0.smithi060.stdout:6/336: fdatasync d1/d7/da/dc/f3b 0 2024-04-12T13:41:57.023 INFO:tasks.workunit.client.1.smithi110.stdout:5/188: rename da/db/d15/d17 to da/d2e/d45 0 2024-04-12T13:41:57.023 INFO:tasks.workunit.client.0.smithi060.stdout:9/216: symlink d4/d9/d19/d21/l42 0 2024-04-12T13:41:57.026 INFO:tasks.workunit.client.1.smithi110.stdout:4/316: creat d0/d19/d1c/d50/f69 x:0 0 0 2024-04-12T13:41:57.029 INFO:tasks.workunit.client.1.smithi110.stdout:7/231: symlink d1/d3/d4/d36/l48 0 2024-04-12T13:41:57.030 INFO:tasks.workunit.client.1.smithi110.stdout:3/232: creat d5/dc/d31/d3b/d32/d3e/f50 x:0 0 0 2024-04-12T13:41:57.032 INFO:tasks.workunit.client.0.smithi060.stdout:1/264: creat d1e/d23/d2e/d30/f5f x:0 0 0 2024-04-12T13:41:57.033 INFO:tasks.workunit.client.0.smithi060.stdout:3/228: creat d7/f47 x:0 0 0 2024-04-12T13:41:57.037 INFO:tasks.workunit.client.1.smithi110.stdout:3/233: creat d5/dc/d20/d2d/f51 x:0 0 0 2024-04-12T13:41:57.038 INFO:tasks.workunit.client.0.smithi060.stdout:1/265: creat d1e/d23/d49/d4e/f60 x:0 0 0 2024-04-12T13:41:57.040 INFO:tasks.workunit.client.0.smithi060.stdout:6/337: dread d1/d7/da/dc/d24/f37 [0,4194304] 0 2024-04-12T13:41:57.045 INFO:tasks.workunit.client.1.smithi110.stdout:1/197: rename de/d1d/f45 to de/f4d 0 2024-04-12T13:41:57.047 INFO:tasks.workunit.client.1.smithi110.stdout:7/232: creat d1/d1b/f49 x:0 0 0 2024-04-12T13:41:57.049 INFO:tasks.workunit.client.0.smithi060.stdout:3/229: creat d7/d17/d19/f48 x:0 0 0 2024-04-12T13:41:57.050 INFO:tasks.workunit.client.0.smithi060.stdout:3/230: chown d7 1795129 1 2024-04-12T13:41:57.050 INFO:tasks.workunit.client.0.smithi060.stdout:9/217: link d4/d8/d32/c3c d4/d8/d32/c43 0 2024-04-12T13:41:57.053 INFO:tasks.workunit.client.0.smithi060.stdout:3/231: write d7/d17/f1a [332497,60830] 0 2024-04-12T13:41:57.053 INFO:tasks.workunit.client.1.smithi110.stdout:5/189: dwrite da/db/f31 [0,4194304] 0 2024-04-12T13:41:57.054 INFO:tasks.workunit.client.1.smithi110.stdout:1/198: write de/d15/f31 [580049,129197] 0 2024-04-12T13:41:57.055 INFO:tasks.workunit.client.1.smithi110.stdout:0/192: rename d1/d8/l3f to d1/d11/l42 0 2024-04-12T13:41:57.057 INFO:tasks.workunit.client.1.smithi110.stdout:7/233: read d1/d3/d4/f2e [1171707,81624] 0 2024-04-12T13:41:57.060 INFO:tasks.workunit.client.0.smithi060.stdout:6/338: dwrite d1/d7/da/d20/f50 [0,4194304] 0 2024-04-12T13:41:57.060 INFO:tasks.workunit.client.1.smithi110.stdout:6/280: dwrite d7/f39 [4194304,4194304] 0 2024-04-12T13:41:57.062 INFO:tasks.workunit.client.0.smithi060.stdout:1/266: dwrite d1e/d23/d49/d4e/f58 [4194304,4194304] 0 2024-04-12T13:41:57.066 INFO:tasks.workunit.client.0.smithi060.stdout:6/339: chown d1/d7/da/dc/d24/d30/c47 822977 1 2024-04-12T13:41:57.067 INFO:tasks.workunit.client.1.smithi110.stdout:9/309: dwrite df/d13/f5e [0,4194304] 0 2024-04-12T13:41:57.068 INFO:tasks.workunit.client.1.smithi110.stdout:5/190: chown da/d2e/d45 878865664 1 2024-04-12T13:41:57.070 INFO:tasks.workunit.client.1.smithi110.stdout:0/193: mkdir d1/d27/d43 0 2024-04-12T13:41:57.075 INFO:tasks.workunit.client.1.smithi110.stdout:8/217: rename d1/d7/l18 to d1/d3/d3c/l42 0 2024-04-12T13:41:57.076 INFO:tasks.workunit.client.0.smithi060.stdout:6/340: mkdir d1/d7/da/dc/d24/d30/d52/d5e/d7e 0 2024-04-12T13:41:57.078 INFO:tasks.workunit.client.0.smithi060.stdout:9/218: dwrite d4/d25/f2b [0,4194304] 0 2024-04-12T13:41:57.081 INFO:tasks.workunit.client.1.smithi110.stdout:4/317: dwrite d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:41:57.082 INFO:tasks.workunit.client.1.smithi110.stdout:2/270: dwrite f4 [4194304,4194304] 0 2024-04-12T13:41:57.083 INFO:tasks.workunit.client.0.smithi060.stdout:1/267: write d1e/f45 [502487,50205] 0 2024-04-12T13:41:57.089 INFO:tasks.workunit.client.1.smithi110.stdout:5/191: dread - da/d2e/d45/d25/d3d/f3e zero size 2024-04-12T13:41:57.089 INFO:tasks.workunit.client.1.smithi110.stdout:4/318: read - d0/d19/d26/f59 zero size 2024-04-12T13:41:57.089 INFO:tasks.workunit.client.1.smithi110.stdout:2/271: read f4 [4603204,18980] 0 2024-04-12T13:41:57.091 INFO:tasks.workunit.client.1.smithi110.stdout:4/319: readlink d0/de/d32/l66 0 2024-04-12T13:41:57.094 INFO:tasks.workunit.client.0.smithi060.stdout:3/232: dwrite d7/d17/d27/f30 [0,4194304] 0 2024-04-12T13:41:57.099 INFO:tasks.workunit.client.0.smithi060.stdout:6/341: creat d1/d2c/f7f x:0 0 0 2024-04-12T13:41:57.099 INFO:tasks.workunit.client.1.smithi110.stdout:1/199: rename de/d15/c49 to de/d14/d34/c4e 0 2024-04-12T13:41:57.101 INFO:tasks.workunit.client.0.smithi060.stdout:9/219: mkdir d4/d33/d44 0 2024-04-12T13:41:57.102 INFO:tasks.workunit.client.0.smithi060.stdout:3/233: write f0 [2516040,34543] 0 2024-04-12T13:41:57.102 INFO:tasks.workunit.client.0.smithi060.stdout:6/342: stat d1/d7/da/d20/l5b 0 2024-04-12T13:41:57.104 INFO:tasks.workunit.client.0.smithi060.stdout:9/220: chown d4/d8/fb 5 1 2024-04-12T13:41:57.106 INFO:tasks.workunit.client.1.smithi110.stdout:9/310: dread df/f34 [0,4194304] 0 2024-04-12T13:41:57.107 INFO:tasks.workunit.client.1.smithi110.stdout:4/320: dread d0/d19/d26/f40 [0,4194304] 0 2024-04-12T13:41:57.107 INFO:tasks.workunit.client.1.smithi110.stdout:6/281: dwrite d7/d25/d30/d44/d3d/f49 [0,4194304] 0 2024-04-12T13:41:57.108 INFO:tasks.workunit.client.1.smithi110.stdout:8/218: fsync d1/d3/f24 0 2024-04-12T13:41:57.110 INFO:tasks.workunit.client.1.smithi110.stdout:4/321: stat d0/de/f24 0 2024-04-12T13:41:57.114 INFO:tasks.workunit.client.1.smithi110.stdout:0/194: dread f0 [0,4194304] 0 2024-04-12T13:41:57.114 INFO:tasks.workunit.client.1.smithi110.stdout:8/219: chown d1/d5/dd/ff 230648 1 2024-04-12T13:41:57.115 INFO:tasks.workunit.client.1.smithi110.stdout:4/322: readlink d0/d19/d1c/l63 0 2024-04-12T13:41:57.117 INFO:tasks.workunit.client.1.smithi110.stdout:8/220: truncate d1/d7/f32 1044679 0 2024-04-12T13:41:57.117 INFO:tasks.workunit.client.0.smithi060.stdout:3/234: read d7/da/dd/d25/f26 [87586,54033] 0 2024-04-12T13:41:57.119 INFO:tasks.workunit.client.1.smithi110.stdout:8/221: chown d1/d7/d20 42 1 2024-04-12T13:41:57.120 INFO:tasks.workunit.client.0.smithi060.stdout:3/235: readlink d7/l11 0 2024-04-12T13:41:57.122 INFO:tasks.workunit.client.0.smithi060.stdout:3/236: dread - d7/d17/d27/f45 zero size 2024-04-12T13:41:57.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/343: dread d1/d7/da/dc/f6d [0,4194304] 0 2024-04-12T13:41:57.126 INFO:tasks.workunit.client.0.smithi060.stdout:3/237: chown d7/f47 659 1 2024-04-12T13:41:57.126 INFO:tasks.workunit.client.0.smithi060.stdout:6/344: write d1/d7/da/dc/d24/d2d/f55 [885356,22451] 0 2024-04-12T13:41:57.127 INFO:tasks.workunit.client.0.smithi060.stdout:9/221: rmdir d4/d33/d44 0 2024-04-12T13:41:57.131 INFO:tasks.workunit.client.1.smithi110.stdout:6/282: write d7/f3e [411509,36420] 0 2024-04-12T13:41:57.135 INFO:tasks.workunit.client.1.smithi110.stdout:9/311: mkdir df/d38/d6e 0 2024-04-12T13:41:57.136 INFO:tasks.workunit.client.1.smithi110.stdout:6/283: readlink d7/d10/l55 0 2024-04-12T13:41:57.136 INFO:tasks.workunit.client.0.smithi060.stdout:3/238: symlink d7/d17/d27/d36/l49 0 2024-04-12T13:41:57.137 INFO:tasks.workunit.client.0.smithi060.stdout:3/239: fdatasync d7/d17/d19/f48 0 2024-04-12T13:41:57.138 INFO:tasks.workunit.client.1.smithi110.stdout:9/312: stat df/d13/d26/f28 0 2024-04-12T13:41:57.139 INFO:tasks.workunit.client.0.smithi060.stdout:3/240: dread - d7/d17/f42 zero size 2024-04-12T13:41:57.140 INFO:tasks.workunit.client.1.smithi110.stdout:0/195: chown d1/l6 52394128 1 2024-04-12T13:41:57.144 INFO:tasks.workunit.client.1.smithi110.stdout:3/234: sync 2024-04-12T13:41:57.146 INFO:tasks.workunit.client.1.smithi110.stdout:5/192: mknod da/c46 0 2024-04-12T13:41:57.148 INFO:tasks.workunit.client.1.smithi110.stdout:4/323: dread d0/d13/f2d [0,4194304] 0 2024-04-12T13:41:57.148 INFO:tasks.workunit.client.0.smithi060.stdout:1/268: dread fb [0,4194304] 0 2024-04-12T13:41:57.150 INFO:tasks.workunit.client.0.smithi060.stdout:9/222: rename d4/d8/d32/c43 to d4/d33/c45 0 2024-04-12T13:41:57.154 INFO:tasks.workunit.client.1.smithi110.stdout:5/193: dread da/db/f1d [0,4194304] 0 2024-04-12T13:41:57.156 INFO:tasks.workunit.client.0.smithi060.stdout:9/223: truncate d4/d25/f39 637788 0 2024-04-12T13:41:57.157 INFO:tasks.workunit.client.0.smithi060.stdout:6/345: mkdir d1/d7/da/dc/d24/d30/d52/d78/d80 0 2024-04-12T13:41:57.159 INFO:tasks.workunit.client.0.smithi060.stdout:3/241: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:41:57.159 INFO:tasks.workunit.client.1.smithi110.stdout:5/194: chown da/d2e/d45/d29/d32/f36 28396064 1 2024-04-12T13:41:57.162 INFO:tasks.workunit.client.0.smithi060.stdout:6/346: readlink d1/d7/da/dc/d24/l2a 0 2024-04-12T13:41:57.162 INFO:tasks.workunit.client.0.smithi060.stdout:1/269: mknod d1e/d29/d37/c61 0 2024-04-12T13:41:57.163 INFO:tasks.workunit.client.1.smithi110.stdout:4/324: dread d0/ff [0,4194304] 0 2024-04-12T13:41:57.165 INFO:tasks.workunit.client.0.smithi060.stdout:3/242: fsync d7/d17/d27/d36/f3c 0 2024-04-12T13:41:57.174 INFO:tasks.workunit.client.0.smithi060.stdout:6/347: creat d1/d7/da/dc/d24/d30/d52/f81 x:0 0 0 2024-04-12T13:41:57.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/348: stat d1/f57 0 2024-04-12T13:41:57.175 INFO:tasks.workunit.client.1.smithi110.stdout:3/235: mknod d5/dc/d20/c52 0 2024-04-12T13:41:57.176 INFO:tasks.workunit.client.0.smithi060.stdout:9/224: mknod d4/c46 0 2024-04-12T13:41:57.177 INFO:tasks.workunit.client.1.smithi110.stdout:3/236: dread - d5/dc/d20/d2d/f51 zero size 2024-04-12T13:41:57.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/349: chown d1/d7/da/dc/d24/l41 217 1 2024-04-12T13:41:57.179 INFO:tasks.workunit.client.1.smithi110.stdout:3/237: dread - d5/dc/d31/d3b/d32/d3e/f41 zero size 2024-04-12T13:41:57.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:56 smithi060 ceph-mon[29097]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:57.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:56 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/96514508' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:41:57.179 INFO:tasks.workunit.client.1.smithi110.stdout:2/272: creat d6/f48 x:0 0 0 2024-04-12T13:41:57.180 INFO:tasks.workunit.client.0.smithi060.stdout:3/243: symlink d7/d17/d19/l4a 0 2024-04-12T13:41:57.181 INFO:tasks.workunit.client.0.smithi060.stdout:3/244: dread - d7/d17/d27/d36/f3c zero size 2024-04-12T13:41:57.182 INFO:tasks.workunit.client.0.smithi060.stdout:9/225: mknod d4/d33/c47 0 2024-04-12T13:41:57.182 INFO:tasks.workunit.client.1.smithi110.stdout:9/313: dwrite df/f11 [0,4194304] 0 2024-04-12T13:41:57.184 INFO:tasks.workunit.client.0.smithi060.stdout:9/226: read d4/d25/f2b [2619810,86328] 0 2024-04-12T13:41:57.185 INFO:tasks.workunit.client.0.smithi060.stdout:1/270: link d1e/d23/d49/f54 d1e/d46/f62 0 2024-04-12T13:41:57.186 INFO:tasks.workunit.client.1.smithi110.stdout:5/195: creat da/db/d3b/d40/f47 x:0 0 0 2024-04-12T13:41:57.187 INFO:tasks.workunit.client.1.smithi110.stdout:5/196: stat f1 0 2024-04-12T13:41:57.189 INFO:tasks.workunit.client.0.smithi060.stdout:3/245: creat d7/d17/d27/d36/f4b x:0 0 0 2024-04-12T13:41:57.190 INFO:tasks.workunit.client.1.smithi110.stdout:7/234: link d1/d3/c44 d1/d1b/c4a 0 2024-04-12T13:41:57.192 INFO:tasks.workunit.client.0.smithi060.stdout:6/350: mkdir d1/d7/da/dc/d7a/d82 0 2024-04-12T13:41:57.192 INFO:tasks.workunit.client.1.smithi110.stdout:8/222: write d1/d5/dd/ff [1100933,113345] 0 2024-04-12T13:41:57.195 INFO:tasks.workunit.client.0.smithi060.stdout:1/271: creat d1e/d46/f63 x:0 0 0 2024-04-12T13:41:57.196 INFO:tasks.workunit.client.1.smithi110.stdout:1/200: write de/d14/f3a [1948501,1553] 0 2024-04-12T13:41:57.199 INFO:tasks.workunit.client.1.smithi110.stdout:2/273: mkdir d6/dc/dd/d49 0 2024-04-12T13:41:57.199 INFO:tasks.workunit.client.0.smithi060.stdout:3/246: mknod d7/da/dd/c4c 0 2024-04-12T13:41:57.202 INFO:tasks.workunit.client.0.smithi060.stdout:1/272: creat d1e/d23/d2e/f64 x:0 0 0 2024-04-12T13:41:57.204 INFO:tasks.workunit.client.0.smithi060.stdout:3/247: mkdir d7/da/dd/d25/d4d 0 2024-04-12T13:41:57.205 INFO:tasks.workunit.client.0.smithi060.stdout:3/248: readlink d7/l11 0 2024-04-12T13:41:57.207 INFO:tasks.workunit.client.0.smithi060.stdout:1/273: mkdir d1e/d29/d65 0 2024-04-12T13:41:57.209 INFO:tasks.workunit.client.1.smithi110.stdout:5/197: creat da/d2e/d45/d29/f48 x:0 0 0 2024-04-12T13:41:57.209 INFO:tasks.workunit.client.0.smithi060.stdout:6/351: dwrite d1/d7/da/dc/d24/d30/d52/f60 [0,4194304] 0 2024-04-12T13:41:57.210 INFO:tasks.workunit.client.1.smithi110.stdout:7/235: chown d1/d1b/d33 2039840240 1 2024-04-12T13:41:57.212 INFO:tasks.workunit.client.1.smithi110.stdout:2/274: dwrite d6/dc/f2b [0,4194304] 0 2024-04-12T13:41:57.214 INFO:tasks.workunit.client.1.smithi110.stdout:8/223: rmdir d1/d3/d35/d3a 39 2024-04-12T13:41:57.215 INFO:tasks.workunit.client.1.smithi110.stdout:1/201: creat de/d14/f4f x:0 0 0 2024-04-12T13:41:57.217 INFO:tasks.workunit.client.0.smithi060.stdout:6/352: symlink d1/d7/da/dc/d24/d2d/l83 0 2024-04-12T13:41:57.222 INFO:tasks.workunit.client.0.smithi060.stdout:6/353: read d1/d7/da/dc/f3b [1551184,18834] 0 2024-04-12T13:41:57.224 INFO:tasks.workunit.client.0.smithi060.stdout:3/249: creat d7/d17/d19/f4e x:0 0 0 2024-04-12T13:41:57.226 INFO:tasks.workunit.client.0.smithi060.stdout:3/250: fdatasync d7/da/f35 0 2024-04-12T13:41:57.226 INFO:tasks.workunit.client.0.smithi060.stdout:6/354: write d1/d7/da/dc/d24/d30/f71 [690288,6165] 0 2024-04-12T13:41:57.227 INFO:tasks.workunit.client.1.smithi110.stdout:3/238: link d5/dc/d20/d2d/f42 d5/dc/f53 0 2024-04-12T13:41:57.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:56 smithi110 ceph-mon[36055]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:41:57.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:56 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/96514508' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:41:57.228 INFO:tasks.workunit.client.1.smithi110.stdout:9/314: fsync df/f17 0 2024-04-12T13:41:57.229 INFO:tasks.workunit.client.1.smithi110.stdout:4/325: link d0/d19/c30 d0/d19/d26/c6a 0 2024-04-12T13:41:57.229 INFO:tasks.workunit.client.1.smithi110.stdout:3/239: write d5/f40 [16368,90214] 0 2024-04-12T13:41:57.232 INFO:tasks.workunit.client.0.smithi060.stdout:1/274: dwrite d1e/d23/d2e/f39 [0,4194304] 0 2024-04-12T13:41:57.232 INFO:tasks.workunit.client.0.smithi060.stdout:3/251: creat d7/da/d3f/f4f x:0 0 0 2024-04-12T13:41:57.234 INFO:tasks.workunit.client.1.smithi110.stdout:6/284: getdents d7/d10/d1c/d4d 0 2024-04-12T13:41:57.234 INFO:tasks.workunit.client.1.smithi110.stdout:5/198: dread da/db/f1d [0,4194304] 0 2024-04-12T13:41:57.235 INFO:tasks.workunit.client.0.smithi060.stdout:3/252: write d7/f47 [333211,100668] 0 2024-04-12T13:41:57.237 INFO:tasks.workunit.client.0.smithi060.stdout:6/355: creat d1/d7/da/dc/d3a/f84 x:0 0 0 2024-04-12T13:41:57.238 INFO:tasks.workunit.client.0.smithi060.stdout:3/253: write d7/da/dd/d25/f44 [68467,30896] 0 2024-04-12T13:41:57.239 INFO:tasks.workunit.client.0.smithi060.stdout:1/275: stat d1e/d29/c35 0 2024-04-12T13:41:57.240 INFO:tasks.workunit.client.1.smithi110.stdout:0/196: sync 2024-04-12T13:41:57.242 INFO:tasks.workunit.client.0.smithi060.stdout:1/276: dread - d1e/d29/d37/f50 zero size 2024-04-12T13:41:57.250 INFO:tasks.workunit.client.0.smithi060.stdout:1/277: creat d1e/d29/d37/f66 x:0 0 0 2024-04-12T13:41:57.251 INFO:tasks.workunit.client.0.smithi060.stdout:3/254: rmdir d7 39 2024-04-12T13:41:57.253 INFO:tasks.workunit.client.1.smithi110.stdout:3/240: rmdir d5 39 2024-04-12T13:41:57.255 INFO:tasks.workunit.client.0.smithi060.stdout:6/356: creat d1/d7/da/dc/d24/d30/d52/d78/d80/f85 x:0 0 0 2024-04-12T13:41:57.256 INFO:tasks.workunit.client.0.smithi060.stdout:1/278: creat d1e/d46/f67 x:0 0 0 2024-04-12T13:41:57.257 INFO:tasks.workunit.client.1.smithi110.stdout:9/315: write df/f25 [1464128,98365] 0 2024-04-12T13:41:57.259 INFO:tasks.workunit.client.1.smithi110.stdout:9/316: write df/d13/f27 [154341,42996] 0 2024-04-12T13:41:57.262 INFO:tasks.workunit.client.0.smithi060.stdout:3/255: creat d7/d17/d19/d33/f50 x:0 0 0 2024-04-12T13:41:57.263 INFO:tasks.workunit.client.1.smithi110.stdout:8/224: mkdir d1/d3/d35/d43 0 2024-04-12T13:41:57.266 INFO:tasks.workunit.client.0.smithi060.stdout:3/256: mknod d7/da/dd/d25/c51 0 2024-04-12T13:41:57.270 INFO:tasks.workunit.client.0.smithi060.stdout:6/357: getdents d1/d7/da/dc/d24/d30/d52/d78 0 2024-04-12T13:41:57.272 INFO:tasks.workunit.client.0.smithi060.stdout:1/279: getdents d1e/d29 0 2024-04-12T13:41:57.273 INFO:tasks.workunit.client.0.smithi060.stdout:1/280: chown d1e/d1f/f4a 51 1 2024-04-12T13:41:57.274 INFO:tasks.workunit.client.1.smithi110.stdout:5/199: dwrite da/f21 [4194304,4194304] 0 2024-04-12T13:41:57.276 INFO:tasks.workunit.client.1.smithi110.stdout:5/200: write f8 [4764033,53181] 0 2024-04-12T13:41:57.276 INFO:tasks.workunit.client.0.smithi060.stdout:6/358: chown d1/d7/da/c21 63 1 2024-04-12T13:41:57.278 INFO:tasks.workunit.client.0.smithi060.stdout:6/359: chown d1/d7/da/dc/d3a/f4b 2691 1 2024-04-12T13:41:57.278 INFO:tasks.workunit.client.1.smithi110.stdout:2/275: rename d6/d18/d3b to d6/d18/d19/d4a 0 2024-04-12T13:41:57.278 INFO:tasks.workunit.client.1.smithi110.stdout:9/317: rmdir df/d13/d2c/d2d/d39/d4f/d58/d63 39 2024-04-12T13:41:57.281 INFO:tasks.workunit.client.0.smithi060.stdout:3/257: creat d7/f52 x:0 0 0 2024-04-12T13:41:57.282 INFO:tasks.workunit.client.1.smithi110.stdout:4/326: truncate d0/de/f36 8131620 0 2024-04-12T13:41:57.282 INFO:tasks.workunit.client.0.smithi060.stdout:6/360: write d1/d7/da/dc/d24/d34/f23 [3406326,21890] 0 2024-04-12T13:41:57.283 INFO:tasks.workunit.client.0.smithi060.stdout:3/258: chown d7/d17/d19/d33/l34 30870 1 2024-04-12T13:41:57.285 INFO:tasks.workunit.client.1.smithi110.stdout:6/285: write d7/d10/f20 [2899338,124885] 0 2024-04-12T13:41:57.286 INFO:tasks.workunit.client.1.smithi110.stdout:7/236: getdents d1/d1b/d3d 0 2024-04-12T13:41:57.288 INFO:tasks.workunit.client.1.smithi110.stdout:6/286: write d7/d25/d2c/f3c [278341,68009] 0 2024-04-12T13:41:57.290 INFO:tasks.workunit.client.1.smithi110.stdout:3/241: dread d5/dc/f27 [0,4194304] 0 2024-04-12T13:41:57.290 INFO:tasks.workunit.client.1.smithi110.stdout:9/318: unlink df/d13/d26/c33 0 2024-04-12T13:41:57.291 INFO:tasks.workunit.client.0.smithi060.stdout:3/259: mkdir d7/d17/d27/d36/d53 0 2024-04-12T13:41:57.291 INFO:tasks.workunit.client.1.smithi110.stdout:9/319: chown df/d13 53 1 2024-04-12T13:41:57.291 INFO:tasks.workunit.client.1.smithi110.stdout:1/202: link de/d1d/c41 de/d15/c50 0 2024-04-12T13:41:57.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/281: dwrite d1e/d23/d2e/d30/f5f [0,4194304] 0 2024-04-12T13:41:57.292 INFO:tasks.workunit.client.1.smithi110.stdout:9/320: stat df/d38 0 2024-04-12T13:41:57.293 INFO:tasks.workunit.client.0.smithi060.stdout:1/282: chown d1e/d23/d49 13772695 1 2024-04-12T13:41:57.293 INFO:tasks.workunit.client.1.smithi110.stdout:2/276: rmdir d6/d18/d19 39 2024-04-12T13:41:57.294 INFO:tasks.workunit.client.0.smithi060.stdout:6/361: rename d1/d7/da/dc to d1/d7/da/dc/d24/d30/d86 22 2024-04-12T13:41:57.298 INFO:tasks.workunit.client.1.smithi110.stdout:8/225: write d1/d3/fe [3105255,122310] 0 2024-04-12T13:41:57.301 INFO:tasks.workunit.client.0.smithi060.stdout:3/260: rename d7/d17/d27/f45 to d7/da/dd/f54 0 2024-04-12T13:41:57.305 INFO:tasks.workunit.client.1.smithi110.stdout:7/237: rename d1/d3/d43/d47 to d1/d3/d4/d36/d4b 0 2024-04-12T13:41:57.305 INFO:tasks.workunit.client.1.smithi110.stdout:7/238: fdatasync d1/d3/d4/d36/d4b/f3b 0 2024-04-12T13:41:57.307 INFO:tasks.workunit.client.1.smithi110.stdout:7/239: write d1/f38 [1467391,65251] 0 2024-04-12T13:41:57.310 INFO:tasks.workunit.client.1.smithi110.stdout:9/321: symlink df/l6f 0 2024-04-12T13:41:57.311 INFO:tasks.workunit.client.1.smithi110.stdout:9/322: fsync df/d13/f5e 0 2024-04-12T13:41:57.311 INFO:tasks.workunit.client.0.smithi060.stdout:1/283: truncate d1e/f2b 1346700 0 2024-04-12T13:41:57.312 INFO:tasks.workunit.client.1.smithi110.stdout:4/327: symlink d0/de/d2c/d57/l6b 0 2024-04-12T13:41:57.313 INFO:tasks.workunit.client.0.smithi060.stdout:3/261: symlink d7/da/dd/l55 0 2024-04-12T13:41:57.315 INFO:tasks.workunit.client.1.smithi110.stdout:0/197: sync 2024-04-12T13:41:57.317 INFO:tasks.workunit.client.1.smithi110.stdout:1/203: dread de/d15/f1c [0,4194304] 0 2024-04-12T13:41:57.317 INFO:tasks.workunit.client.1.smithi110.stdout:0/198: dread - d1/d8/f3d zero size 2024-04-12T13:41:57.320 INFO:tasks.workunit.client.0.smithi060.stdout:3/262: symlink d7/d17/d27/d36/l56 0 2024-04-12T13:41:57.321 INFO:tasks.workunit.client.0.smithi060.stdout:3/263: chown d7/d17/d19/d33 2955 1 2024-04-12T13:41:57.323 INFO:tasks.workunit.client.0.smithi060.stdout:1/284: mkdir d1e/d23/d2e/d5e/d68 0 2024-04-12T13:41:57.324 INFO:tasks.workunit.client.1.smithi110.stdout:7/240: dwrite d1/d3/d4/f9 [4194304,4194304] 0 2024-04-12T13:41:57.326 INFO:tasks.workunit.client.0.smithi060.stdout:3/264: fdatasync d7/f10 0 2024-04-12T13:41:57.327 INFO:tasks.workunit.client.0.smithi060.stdout:6/362: getdents d1/d7/da/dc/d24 0 2024-04-12T13:41:57.330 INFO:tasks.workunit.client.1.smithi110.stdout:5/201: getdents da/d2e/d45/d25/d3d 0 2024-04-12T13:41:57.330 INFO:tasks.workunit.client.1.smithi110.stdout:9/323: dwrite df/d13/d2c/d2d/d39/d4f/d58/f68 [0,4194304] 0 2024-04-12T13:41:57.331 INFO:tasks.workunit.client.1.smithi110.stdout:9/324: stat df/d13/f1f 0 2024-04-12T13:41:57.333 INFO:tasks.workunit.client.1.smithi110.stdout:8/226: symlink d1/d3/d35/d3a/l44 0 2024-04-12T13:41:57.337 INFO:tasks.workunit.client.1.smithi110.stdout:1/204: unlink de/d15/c4c 0 2024-04-12T13:41:57.338 INFO:tasks.workunit.client.1.smithi110.stdout:0/199: unlink d1/d27/f37 0 2024-04-12T13:41:57.338 INFO:tasks.workunit.client.1.smithi110.stdout:1/205: readlink de/d15/l33 0 2024-04-12T13:41:57.340 INFO:tasks.workunit.client.0.smithi060.stdout:6/363: creat d1/d7/da/dc/d24/d34/d51/d59/f87 x:0 0 0 2024-04-12T13:41:57.341 INFO:tasks.workunit.client.1.smithi110.stdout:2/277: creat d6/f4b x:0 0 0 2024-04-12T13:41:57.342 INFO:tasks.workunit.client.1.smithi110.stdout:4/328: fdatasync d0/d19/f20 0 2024-04-12T13:41:57.344 INFO:tasks.workunit.client.1.smithi110.stdout:2/278: write d6/dc/dd/f22 [5509978,110636] 0 2024-04-12T13:41:57.344 INFO:tasks.workunit.client.1.smithi110.stdout:9/325: mknod df/d13/d2c/c70 0 2024-04-12T13:41:57.346 INFO:tasks.workunit.client.1.smithi110.stdout:4/329: write d0/d13/f52 [1108833,66042] 0 2024-04-12T13:41:57.347 INFO:tasks.workunit.client.0.smithi060.stdout:3/265: creat d7/d17/f57 x:0 0 0 2024-04-12T13:41:57.349 INFO:tasks.workunit.client.1.smithi110.stdout:8/227: unlink d1/d5/f28 0 2024-04-12T13:41:57.350 INFO:tasks.workunit.client.1.smithi110.stdout:6/287: rename d7/f3e to d7/d25/f56 0 2024-04-12T13:41:57.353 INFO:tasks.workunit.client.1.smithi110.stdout:7/241: dread d1/d3/d4/f2e [0,4194304] 0 2024-04-12T13:41:57.355 INFO:tasks.workunit.client.1.smithi110.stdout:7/242: chown d1/l16 107835248 1 2024-04-12T13:41:57.356 INFO:tasks.workunit.client.1.smithi110.stdout:7/243: dread - d1/d3/d4/f35 zero size 2024-04-12T13:41:57.357 INFO:tasks.workunit.client.0.smithi060.stdout:6/364: dread d1/d7/da/dc/d3a/f4b [0,4194304] 0 2024-04-12T13:41:57.357 INFO:tasks.workunit.client.0.smithi060.stdout:1/285: dread d1e/f2b [0,4194304] 0 2024-04-12T13:41:57.358 INFO:tasks.workunit.client.1.smithi110.stdout:2/279: symlink d6/dc/dd/l4c 0 2024-04-12T13:41:57.359 INFO:tasks.workunit.client.1.smithi110.stdout:4/330: write d0/d13/f2d [6558431,111662] 0 2024-04-12T13:41:57.360 INFO:tasks.workunit.client.1.smithi110.stdout:8/228: unlink d1/d5/dd/c2a 0 2024-04-12T13:41:57.361 INFO:tasks.workunit.client.1.smithi110.stdout:4/331: write d0/d13/f52 [401470,95225] 0 2024-04-12T13:41:57.363 INFO:tasks.workunit.client.1.smithi110.stdout:4/332: chown d0/f4 1132 1 2024-04-12T13:41:57.363 INFO:tasks.workunit.client.1.smithi110.stdout:3/242: rename d5/dc/d31/d3b/d32/l38 to d5/dc/d31/d3b/d32/d3e/l54 0 2024-04-12T13:41:57.364 INFO:tasks.workunit.client.0.smithi060.stdout:1/286: rmdir d1e/d29/d37 39 2024-04-12T13:41:57.365 INFO:tasks.workunit.client.1.smithi110.stdout:4/333: readlink d0/d19/d1c/l1f 0 2024-04-12T13:41:57.367 INFO:tasks.workunit.client.1.smithi110.stdout:6/288: creat d7/d25/d2c/f57 x:0 0 0 2024-04-12T13:41:57.367 INFO:tasks.workunit.client.0.smithi060.stdout:3/266: dwrite d7/d17/d19/d33/f39 [0,4194304] 0 2024-04-12T13:41:57.368 INFO:tasks.workunit.client.1.smithi110.stdout:0/200: dwrite d1/f2c [0,4194304] 0 2024-04-12T13:41:57.368 INFO:tasks.workunit.client.1.smithi110.stdout:4/334: dread - d0/de/d32/f5d zero size 2024-04-12T13:41:57.368 INFO:tasks.workunit.client.1.smithi110.stdout:6/289: chown l3 1 1 2024-04-12T13:41:57.369 INFO:tasks.workunit.client.0.smithi060.stdout:3/267: stat d7/d17/l1b 0 2024-04-12T13:41:57.370 INFO:tasks.workunit.client.1.smithi110.stdout:0/201: write d1/d8/f2e [1327679,35642] 0 2024-04-12T13:41:57.370 INFO:tasks.workunit.client.0.smithi060.stdout:3/268: chown d7/d17/d27/f30 3273 1 2024-04-12T13:41:57.373 INFO:tasks.workunit.client.0.smithi060.stdout:3/269: fsync d7/d17/d19/f1f 0 2024-04-12T13:41:57.373 INFO:tasks.workunit.client.1.smithi110.stdout:2/280: chown d6/d18/d19/d4a/d3c/c3d 466656 1 2024-04-12T13:41:57.380 INFO:tasks.workunit.client.1.smithi110.stdout:3/243: symlink d5/dc/d20/l55 0 2024-04-12T13:41:57.382 INFO:tasks.workunit.client.0.smithi060.stdout:6/365: dwrite d1/d7/da/dc/d24/d30/d52/d5e/f67 [0,4194304] 0 2024-04-12T13:41:57.382 INFO:tasks.workunit.client.1.smithi110.stdout:5/202: getdents da/d2e/d45/d29/d32 0 2024-04-12T13:41:57.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/270: readlink d7/d17/d27/d36/l56 0 2024-04-12T13:41:57.385 INFO:tasks.workunit.client.0.smithi060.stdout:3/271: write d7/f8 [5021454,33273] 0 2024-04-12T13:41:57.386 INFO:tasks.workunit.client.0.smithi060.stdout:6/366: read - d1/d7/da/dc/d24/d30/d52/d5e/f72 zero size 2024-04-12T13:41:57.387 INFO:tasks.workunit.client.1.smithi110.stdout:6/290: dread d7/d10/d1c/f29 [0,4194304] 0 2024-04-12T13:41:57.391 INFO:tasks.workunit.client.1.smithi110.stdout:4/335: mknod d0/de/d32/c6c 0 2024-04-12T13:41:57.392 INFO:tasks.workunit.client.0.smithi060.stdout:1/287: write d1e/f2d [1389311,41224] 0 2024-04-12T13:41:57.393 INFO:tasks.workunit.client.1.smithi110.stdout:4/336: read - d0/d19/f62 zero size 2024-04-12T13:41:57.393 INFO:tasks.workunit.client.0.smithi060.stdout:6/367: symlink d1/d7/da/dc/d24/d34/l88 0 2024-04-12T13:41:57.394 INFO:tasks.workunit.client.1.smithi110.stdout:8/229: write d1/d3/f24 [2184690,109883] 0 2024-04-12T13:41:57.397 INFO:tasks.workunit.client.1.smithi110.stdout:4/337: fsync d0/d19/f23 0 2024-04-12T13:41:57.399 INFO:tasks.workunit.client.1.smithi110.stdout:0/202: creat d1/d8/d36/f44 x:0 0 0 2024-04-12T13:41:57.401 INFO:tasks.workunit.client.0.smithi060.stdout:1/288: fsync d1e/d29/d37/f4c 0 2024-04-12T13:41:57.401 INFO:tasks.workunit.client.1.smithi110.stdout:5/203: dwrite da/f11 [0,4194304] 0 2024-04-12T13:41:57.402 INFO:tasks.workunit.client.0.smithi060.stdout:6/368: mknod d1/d7/da/dc/d24/c89 0 2024-04-12T13:41:57.402 INFO:tasks.workunit.client.1.smithi110.stdout:5/204: chown da/db/d3b/d40 7498468 1 2024-04-12T13:41:57.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/244: truncate d5/dc/f12 1123277 0 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:0/243: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:9/227: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/231: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:4/268: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:2/212: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:8/258: sync 2024-04-12T13:41:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/308: sync 2024-04-12T13:41:57.406 INFO:tasks.workunit.client.1.smithi110.stdout:7/244: creat d1/d3/f4c x:0 0 0 2024-04-12T13:41:57.408 INFO:tasks.workunit.client.1.smithi110.stdout:5/205: write da/d2e/d45/d25/f43 [186413,13425] 0 2024-04-12T13:41:57.409 INFO:tasks.workunit.client.1.smithi110.stdout:1/206: sync 2024-04-12T13:41:57.409 INFO:tasks.workunit.client.1.smithi110.stdout:3/245: write d5/dc/d31/d3b/d32/d3e/f50 [956843,70425] 0 2024-04-12T13:41:57.409 INFO:tasks.workunit.client.1.smithi110.stdout:9/326: getdents df/d13/d2c 0 2024-04-12T13:41:57.410 INFO:tasks.workunit.client.0.smithi060.stdout:6/369: write d1/d7/da/dc/f19 [1908400,118069] 0 2024-04-12T13:41:57.411 INFO:tasks.workunit.client.1.smithi110.stdout:1/207: rename de/d15 to de/d15/d32/d51 22 2024-04-12T13:41:57.412 INFO:tasks.workunit.client.0.smithi060.stdout:1/289: symlink d1e/d23/d2e/d30/l69 0 2024-04-12T13:41:57.412 INFO:tasks.workunit.client.0.smithi060.stdout:9/228: read d4/d9/d19/d21/f31 [7129553,104123] 0 2024-04-12T13:41:57.413 INFO:tasks.workunit.client.0.smithi060.stdout:3/272: dwrite d7/da/f2c [0,4194304] 0 2024-04-12T13:41:57.413 INFO:tasks.workunit.client.0.smithi060.stdout:5/309: read - d6/d10/d12/d15/f3a zero size 2024-04-12T13:41:57.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/244: dread - d7/d9/d14/d4a/f4f zero size 2024-04-12T13:41:57.419 INFO:tasks.workunit.client.0.smithi060.stdout:8/259: stat d9/d1b/d37/d48/c52 0 2024-04-12T13:41:57.419 INFO:tasks.workunit.client.1.smithi110.stdout:6/291: dread d7/d25/d30/d44/f1d [0,4194304] 0 2024-04-12T13:41:57.419 INFO:tasks.workunit.client.0.smithi060.stdout:5/310: readlink d6/dd/d27/l33 0 2024-04-12T13:41:57.423 INFO:tasks.workunit.client.1.smithi110.stdout:8/230: mkdir d1/d45 0 2024-04-12T13:41:57.429 INFO:tasks.workunit.client.1.smithi110.stdout:4/338: creat d0/d19/f6d x:0 0 0 2024-04-12T13:41:57.429 INFO:tasks.workunit.client.1.smithi110.stdout:3/246: dwrite d5/dc/d31/d3b/f4a [0,4194304] 0 2024-04-12T13:41:57.429 INFO:tasks.workunit.client.0.smithi060.stdout:2/213: rmdir d6/d10/d2b 39 2024-04-12T13:41:57.432 INFO:tasks.workunit.client.0.smithi060.stdout:2/214: truncate d6/f25 534061 0 2024-04-12T13:41:57.433 INFO:tasks.workunit.client.0.smithi060.stdout:4/269: symlink d6/d7/dd/df/l5f 0 2024-04-12T13:41:57.434 INFO:tasks.workunit.client.1.smithi110.stdout:3/247: write d5/dc/d31/d3b/f4b [274422,52644] 0 2024-04-12T13:41:57.434 INFO:tasks.workunit.client.1.smithi110.stdout:7/245: mknod d1/d3/d4/c4d 0 2024-04-12T13:41:57.436 INFO:tasks.workunit.client.1.smithi110.stdout:5/206: rmdir da/d2e/d45 39 2024-04-12T13:41:57.437 INFO:tasks.workunit.client.0.smithi060.stdout:7/232: fsync d0/d7/f11 0 2024-04-12T13:41:57.441 INFO:tasks.workunit.client.0.smithi060.stdout:6/370: creat d1/d7/da/dc/d24/d30/d52/f8a x:0 0 0 2024-04-12T13:41:57.443 INFO:tasks.workunit.client.0.smithi060.stdout:6/371: readlink d1/l10 0 2024-04-12T13:41:57.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/233: dread - d0/d1b/f37 zero size 2024-04-12T13:41:57.445 INFO:tasks.workunit.client.0.smithi060.stdout:3/273: creat d7/d17/d27/f58 x:0 0 0 2024-04-12T13:41:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:5/311: rmdir d6/dd 39 2024-04-12T13:41:57.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/274: truncate d7/da/dd/d25/f44 659629 0 2024-04-12T13:41:57.449 INFO:tasks.workunit.client.1.smithi110.stdout:8/231: chown d1/l10 119 1 2024-04-12T13:41:57.450 INFO:tasks.workunit.client.0.smithi060.stdout:8/260: mknod d9/da/c58 0 2024-04-12T13:41:57.451 INFO:tasks.workunit.client.0.smithi060.stdout:8/261: readlink d9/d1b/l29 0 2024-04-12T13:41:57.454 INFO:tasks.workunit.client.1.smithi110.stdout:8/232: dread d1/d5/d1f/f25 [0,4194304] 0 2024-04-12T13:41:57.454 INFO:tasks.workunit.client.0.smithi060.stdout:1/290: symlink d1e/d29/l6a 0 2024-04-12T13:41:57.455 INFO:tasks.workunit.client.1.smithi110.stdout:8/233: dread - d1/d7/f3f zero size 2024-04-12T13:41:57.457 INFO:tasks.workunit.client.0.smithi060.stdout:1/291: fsync d1e/f2d 0 2024-04-12T13:41:57.457 INFO:tasks.workunit.client.0.smithi060.stdout:9/229: symlink d4/l48 0 2024-04-12T13:41:57.459 INFO:tasks.workunit.client.1.smithi110.stdout:2/281: creat d6/d18/f4d x:0 0 0 2024-04-12T13:41:57.460 INFO:tasks.workunit.client.1.smithi110.stdout:2/282: chown d6/f8 4 1 2024-04-12T13:41:57.461 INFO:tasks.workunit.client.1.smithi110.stdout:4/339: dread d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:41:57.461 INFO:tasks.workunit.client.1.smithi110.stdout:2/283: dread - d6/d18/f4d zero size 2024-04-12T13:41:57.467 INFO:tasks.workunit.client.1.smithi110.stdout:9/327: mknod df/d13/d2c/d2d/c71 0 2024-04-12T13:41:57.469 INFO:tasks.workunit.client.1.smithi110.stdout:3/248: rename d5/dc/d31/d3b/d32/d3e/f50 to d5/dc/d31/d3b/d32/f56 0 2024-04-12T13:41:57.471 INFO:tasks.workunit.client.1.smithi110.stdout:6/292: mknod d7/d10/d1c/d2b/c58 0 2024-04-12T13:41:57.473 INFO:tasks.workunit.client.1.smithi110.stdout:8/234: mkdir d1/d3/d46 0 2024-04-12T13:41:57.475 INFO:tasks.workunit.client.1.smithi110.stdout:5/207: symlink da/db/d15/l49 0 2024-04-12T13:41:57.479 INFO:tasks.workunit.client.1.smithi110.stdout:0/203: dwrite d1/f7 [0,4194304] 0 2024-04-12T13:41:57.481 INFO:tasks.workunit.client.1.smithi110.stdout:9/328: fsync df/d13/d2c/d2d/f64 0 2024-04-12T13:41:57.487 INFO:tasks.workunit.client.1.smithi110.stdout:4/340: fdatasync d0/de/f36 0 2024-04-12T13:41:57.487 INFO:tasks.workunit.client.1.smithi110.stdout:5/208: creat da/db/f4a x:0 0 0 2024-04-12T13:41:57.488 INFO:tasks.workunit.client.1.smithi110.stdout:7/246: link d1/d3/d4/d36/d4b/c42 d1/d31/c4e 0 2024-04-12T13:41:57.488 INFO:tasks.workunit.client.1.smithi110.stdout:0/204: symlink d1/d27/l45 0 2024-04-12T13:41:57.489 INFO:tasks.workunit.client.1.smithi110.stdout:3/249: symlink d5/l57 0 2024-04-12T13:41:57.494 INFO:tasks.workunit.client.1.smithi110.stdout:8/235: creat d1/d3/d46/f47 x:0 0 0 2024-04-12T13:41:57.494 INFO:tasks.workunit.client.1.smithi110.stdout:4/341: fsync d0/d19/d1c/f60 0 2024-04-12T13:41:57.495 INFO:tasks.workunit.client.1.smithi110.stdout:2/284: dwrite d6/dc/f36 [0,4194304] 0 2024-04-12T13:41:57.496 INFO:tasks.workunit.client.1.smithi110.stdout:7/247: rmdir d1/d31 39 2024-04-12T13:41:57.503 INFO:tasks.workunit.client.1.smithi110.stdout:5/209: write da/d2e/d45/d25/f43 [238881,10705] 0 2024-04-12T13:41:57.503 INFO:tasks.workunit.client.1.smithi110.stdout:6/293: creat d7/d25/f59 x:0 0 0 2024-04-12T13:41:57.503 INFO:tasks.workunit.client.1.smithi110.stdout:4/342: mkdir d0/de/d6e 0 2024-04-12T13:41:57.503 INFO:tasks.workunit.client.1.smithi110.stdout:7/248: rename d1/l16 to d1/d3/d43/l4f 0 2024-04-12T13:41:57.506 INFO:tasks.workunit.client.1.smithi110.stdout:3/250: creat d5/dc/d20/d2d/d4f/f58 x:0 0 0 2024-04-12T13:41:57.512 INFO:tasks.workunit.client.1.smithi110.stdout:4/343: chown d0/de/c35 2339 1 2024-04-12T13:41:57.518 INFO:tasks.workunit.client.1.smithi110.stdout:4/344: mkdir d0/d19/d1c/d50/d6f 0 2024-04-12T13:41:57.520 INFO:tasks.workunit.client.1.smithi110.stdout:4/345: readlink d0/l39 0 2024-04-12T13:41:57.520 INFO:tasks.workunit.client.1.smithi110.stdout:0/205: dread d1/d8/f21 [0,4194304] 0 2024-04-12T13:41:57.524 INFO:tasks.workunit.client.1.smithi110.stdout:2/285: dwrite d6/d18/f4d [0,4194304] 0 2024-04-12T13:41:57.530 INFO:tasks.workunit.client.1.smithi110.stdout:3/251: dread d5/dc/d20/f2a [0,4194304] 0 2024-04-12T13:41:57.530 INFO:tasks.workunit.client.1.smithi110.stdout:7/249: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:41:57.530 INFO:tasks.workunit.client.1.smithi110.stdout:9/329: dread df/d13/d26/f32 [0,4194304] 0 2024-04-12T13:41:57.533 INFO:tasks.workunit.client.1.smithi110.stdout:8/236: dread d1/d7/d20/f36 [0,4194304] 0 2024-04-12T13:41:57.537 INFO:tasks.workunit.client.1.smithi110.stdout:9/330: read - df/d13/d26/d37/d49/f55 zero size 2024-04-12T13:41:57.539 INFO:tasks.workunit.client.1.smithi110.stdout:8/237: write d1/d3/f13 [1864447,49884] 0 2024-04-12T13:41:57.542 INFO:tasks.workunit.client.1.smithi110.stdout:0/206: truncate d1/d8/ff 4142606 0 2024-04-12T13:41:57.543 INFO:tasks.workunit.client.1.smithi110.stdout:7/250: truncate d1/d3/d4/fb 2059594 0 2024-04-12T13:41:57.548 INFO:tasks.workunit.client.1.smithi110.stdout:9/331: mkdir df/d13/d2c/d2d/d39/d4f/d58/d63/d72 0 2024-04-12T13:41:57.549 INFO:tasks.workunit.client.1.smithi110.stdout:8/238: dread d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:41:57.551 INFO:tasks.workunit.client.1.smithi110.stdout:4/346: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:41:57.551 INFO:tasks.workunit.client.1.smithi110.stdout:0/207: creat d1/d27/d43/f46 x:0 0 0 2024-04-12T13:41:57.554 INFO:tasks.workunit.client.1.smithi110.stdout:2/286: dwrite d6/f12 [0,4194304] 0 2024-04-12T13:41:57.555 INFO:tasks.workunit.client.1.smithi110.stdout:4/347: write d0/d13/f2d [231774,73627] 0 2024-04-12T13:41:57.558 INFO:tasks.workunit.client.1.smithi110.stdout:8/239: rename d1/l1e to d1/d5/d1f/l48 0 2024-04-12T13:41:57.559 INFO:tasks.workunit.client.1.smithi110.stdout:3/252: dwrite d5/dc/d31/d3b/f4b [0,4194304] 0 2024-04-12T13:41:57.561 INFO:tasks.workunit.client.1.smithi110.stdout:2/287: creat d6/dc/d1b/f4e x:0 0 0 2024-04-12T13:41:57.563 INFO:tasks.workunit.client.1.smithi110.stdout:3/253: chown d5/dc 252 1 2024-04-12T13:41:57.564 INFO:tasks.workunit.client.1.smithi110.stdout:0/208: getdents d1 0 2024-04-12T13:41:57.566 INFO:tasks.workunit.client.1.smithi110.stdout:3/254: readlink d5/l15 0 2024-04-12T13:41:57.567 INFO:tasks.workunit.client.1.smithi110.stdout:4/348: symlink d0/de/d6e/l70 0 2024-04-12T13:41:57.572 INFO:tasks.workunit.client.1.smithi110.stdout:2/288: write d6/dc/f2b [336394,72545] 0 2024-04-12T13:41:57.572 INFO:tasks.workunit.client.1.smithi110.stdout:4/349: readlink d0/l11 0 2024-04-12T13:41:57.576 INFO:tasks.workunit.client.1.smithi110.stdout:3/255: stat d5/dc/d20/d2d/f51 0 2024-04-12T13:41:57.578 INFO:tasks.workunit.client.1.smithi110.stdout:0/209: mknod d1/d8/d36/c47 0 2024-04-12T13:41:57.580 INFO:tasks.workunit.client.1.smithi110.stdout:7/251: dwrite d1/d3/d4/f30 [0,4194304] 0 2024-04-12T13:41:57.583 INFO:tasks.workunit.client.1.smithi110.stdout:4/350: mkdir d0/de/d32/d5f/d71 0 2024-04-12T13:41:57.586 INFO:tasks.workunit.client.1.smithi110.stdout:0/210: mkdir d1/d48 0 2024-04-12T13:41:57.590 INFO:tasks.workunit.client.1.smithi110.stdout:9/332: dwrite df/d13/d2c/d2d/d39/d3a/d4e/f5b [0,4194304] 0 2024-04-12T13:41:57.594 INFO:tasks.workunit.client.1.smithi110.stdout:2/289: rename d6/d18/d19/d4a/d3c/f1e to d6/d18/d20/f4f 0 2024-04-12T13:41:57.595 INFO:tasks.workunit.client.1.smithi110.stdout:7/252: creat d1/d3/d43/f50 x:0 0 0 2024-04-12T13:41:57.597 INFO:tasks.workunit.client.0.smithi060.stdout:0/245: dwrite d7/d9/de/f40 [0,4194304] 0 2024-04-12T13:41:57.600 INFO:tasks.workunit.client.0.smithi060.stdout:4/270: rename d6/d7/dd/d1a/d19/d42/f49 to d6/d7/dd/d1a/f60 0 2024-04-12T13:41:57.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/271: readlink d6/l2c 0 2024-04-12T13:41:57.604 INFO:tasks.workunit.client.0.smithi060.stdout:2/215: symlink d6/d10/d2b/l40 0 2024-04-12T13:41:57.604 INFO:tasks.workunit.client.1.smithi110.stdout:2/290: rmdir d6/dc/dd 39 2024-04-12T13:41:57.605 INFO:tasks.workunit.client.1.smithi110.stdout:7/253: symlink d1/d3/d4/d36/l51 0 2024-04-12T13:41:57.605 INFO:tasks.workunit.client.0.smithi060.stdout:9/230: creat d4/d25/f49 x:0 0 0 2024-04-12T13:41:57.611 INFO:tasks.workunit.client.1.smithi110.stdout:2/291: dread - d6/d18/f41 zero size 2024-04-12T13:41:57.612 INFO:tasks.workunit.client.1.smithi110.stdout:2/292: dread - d6/f4b zero size 2024-04-12T13:41:57.613 INFO:tasks.workunit.client.1.smithi110.stdout:1/208: sync 2024-04-12T13:41:57.613 INFO:tasks.workunit.client.0.smithi060.stdout:6/372: dread d1/d7/f5d [0,4194304] 0 2024-04-12T13:41:57.614 INFO:tasks.workunit.client.1.smithi110.stdout:3/256: getdents d5/dc/d31/d3b 0 2024-04-12T13:41:57.614 INFO:tasks.workunit.client.1.smithi110.stdout:8/240: dread d1/d7/f1d [0,4194304] 0 2024-04-12T13:41:57.616 INFO:tasks.workunit.client.1.smithi110.stdout:2/293: chown d6/dc/l17 8297837 1 2024-04-12T13:41:57.616 INFO:tasks.workunit.client.1.smithi110.stdout:1/209: fsync de/d15/f31 0 2024-04-12T13:41:57.617 INFO:tasks.workunit.client.1.smithi110.stdout:4/351: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:41:57.618 INFO:tasks.workunit.client.0.smithi060.stdout:1/292: dwrite d1e/f4d [0,4194304] 0 2024-04-12T13:41:57.618 INFO:tasks.workunit.client.1.smithi110.stdout:7/254: read d1/d3/d4/d36/d4b/f25 [474439,64068] 0 2024-04-12T13:41:57.619 INFO:tasks.workunit.client.1.smithi110.stdout:1/210: truncate de/f4d 585813 0 2024-04-12T13:41:57.620 INFO:tasks.workunit.client.0.smithi060.stdout:0/246: mknod d7/d9/d4c/c5d 0 2024-04-12T13:41:57.620 INFO:tasks.workunit.client.0.smithi060.stdout:8/262: dread d9/da/f24 [0,4194304] 0 2024-04-12T13:41:57.630 INFO:tasks.workunit.client.0.smithi060.stdout:9/231: dread d4/d9/f3e [0,4194304] 0 2024-04-12T13:41:57.630 INFO:tasks.workunit.client.0.smithi060.stdout:2/216: unlink d6/f19 0 2024-04-12T13:41:57.631 INFO:tasks.workunit.client.0.smithi060.stdout:0/247: dread - d7/d9/d14/d35/d3c/f42 zero size 2024-04-12T13:41:57.631 INFO:tasks.workunit.client.0.smithi060.stdout:4/272: symlink d6/d7/dd/d1a/d56/l61 0 2024-04-12T13:41:57.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/293: truncate d1e/d23/d2e/d30/f5c 789314 0 2024-04-12T13:41:57.632 INFO:tasks.workunit.client.1.smithi110.stdout:4/352: rename d0/de/d32/c47 to d0/de/c72 0 2024-04-12T13:41:57.635 INFO:tasks.workunit.client.0.smithi060.stdout:2/217: write d6/f15 [1329449,21150] 0 2024-04-12T13:41:57.635 INFO:tasks.workunit.client.0.smithi060.stdout:1/294: chown d1e/d23/d2e/d30/l69 100999004 1 2024-04-12T13:41:57.641 INFO:tasks.workunit.client.1.smithi110.stdout:8/241: link d1/d3/d46/f47 d1/d3/d35/d3a/d3e/f49 0 2024-04-12T13:41:57.643 INFO:tasks.workunit.client.1.smithi110.stdout:3/257: dwrite d5/dc/d31/d3b/d32/f37 [0,4194304] 0 2024-04-12T13:41:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:8/263: dread d9/d1b/d2b/f50 [0,4194304] 0 2024-04-12T13:41:57.644 INFO:tasks.workunit.client.1.smithi110.stdout:8/242: chown d1/d3/d35/d43 42290 1 2024-04-12T13:41:57.647 INFO:tasks.workunit.client.0.smithi060.stdout:7/234: getdents d0 0 2024-04-12T13:41:57.649 INFO:tasks.workunit.client.1.smithi110.stdout:7/255: dwrite d1/d3/d43/f50 [0,4194304] 0 2024-04-12T13:41:57.650 INFO:tasks.workunit.client.0.smithi060.stdout:4/273: dwrite d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:41:57.652 INFO:tasks.workunit.client.1.smithi110.stdout:2/294: truncate d6/dc/f33 3751983 0 2024-04-12T13:41:57.652 INFO:tasks.workunit.client.1.smithi110.stdout:0/211: dread d1/d11/f2b [0,4194304] 0 2024-04-12T13:41:57.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/248: rename d7/d9/d14/l56 to d7/d9/d14/d4a/l5e 0 2024-04-12T13:41:57.656 INFO:tasks.workunit.client.0.smithi060.stdout:1/295: rmdir d1e/d46 39 2024-04-12T13:41:57.659 INFO:tasks.workunit.client.0.smithi060.stdout:2/218: creat d6/d13/d31/f41 x:0 0 0 2024-04-12T13:41:57.659 INFO:tasks.workunit.client.1.smithi110.stdout:1/211: getdents de/d1d 0 2024-04-12T13:41:57.660 INFO:tasks.workunit.client.1.smithi110.stdout:4/353: creat d0/de/d32/d5f/d71/f73 x:0 0 0 2024-04-12T13:41:57.662 INFO:tasks.workunit.client.0.smithi060.stdout:9/232: symlink d4/d9/l4a 0 2024-04-12T13:41:57.664 INFO:tasks.workunit.client.1.smithi110.stdout:8/243: creat d1/d5/f4a x:0 0 0 2024-04-12T13:41:57.665 INFO:tasks.workunit.client.0.smithi060.stdout:8/264: unlink d9/da/f53 0 2024-04-12T13:41:57.666 INFO:tasks.workunit.client.0.smithi060.stdout:8/265: fsync d9/d1b/d2b/f32 0 2024-04-12T13:41:57.667 INFO:tasks.workunit.client.1.smithi110.stdout:2/295: mkdir d6/d18/d19/d4a/d3c/d50 0 2024-04-12T13:41:57.668 INFO:tasks.workunit.client.0.smithi060.stdout:6/373: rmdir d1/d7/da/dc/d7a/d82 0 2024-04-12T13:41:57.668 INFO:tasks.workunit.client.1.smithi110.stdout:8/244: dread - d1/d3/d35/d3a/d3e/f49 zero size 2024-04-12T13:41:57.669 INFO:tasks.workunit.client.1.smithi110.stdout:3/258: dwrite d5/f43 [0,4194304] 0 2024-04-12T13:41:57.672 INFO:tasks.workunit.client.0.smithi060.stdout:0/249: creat d7/d9/d14/d4a/f5f x:0 0 0 2024-04-12T13:41:57.674 INFO:tasks.workunit.client.1.smithi110.stdout:1/212: creat de/d15/d32/f52 x:0 0 0 2024-04-12T13:41:57.675 INFO:tasks.workunit.client.0.smithi060.stdout:5/312: getdents d6/dd/d1f 0 2024-04-12T13:41:57.676 INFO:tasks.workunit.client.1.smithi110.stdout:7/256: write d1/f1e [1656442,75450] 0 2024-04-12T13:41:57.681 INFO:tasks.workunit.client.1.smithi110.stdout:8/245: symlink d1/d3/d3c/l4b 0 2024-04-12T13:41:57.682 INFO:tasks.workunit.client.1.smithi110.stdout:1/213: rmdir de/d14/d34 39 2024-04-12T13:41:57.683 INFO:tasks.workunit.client.0.smithi060.stdout:8/266: symlink d9/d1b/d37/d48/l59 0 2024-04-12T13:41:57.684 INFO:tasks.workunit.client.1.smithi110.stdout:7/257: creat d1/d3/d4/f52 x:0 0 0 2024-04-12T13:41:57.685 INFO:tasks.workunit.client.0.smithi060.stdout:6/374: mkdir d1/d7/da/dc/d24/d8b 0 2024-04-12T13:41:57.688 INFO:tasks.workunit.client.0.smithi060.stdout:6/375: write d1/d7/da/dc/f3b [1332723,117108] 0 2024-04-12T13:41:57.691 INFO:tasks.workunit.client.1.smithi110.stdout:8/246: mknod d1/c4c 0 2024-04-12T13:41:57.692 INFO:tasks.workunit.client.0.smithi060.stdout:6/376: write d1/d7/da/dc/d24/d34/f23 [3657294,22543] 0 2024-04-12T13:41:57.693 INFO:tasks.workunit.client.0.smithi060.stdout:7/235: creat d0/d7/f55 x:0 0 0 2024-04-12T13:41:57.696 INFO:tasks.workunit.client.1.smithi110.stdout:2/296: dwrite d6/dc/f14 [0,4194304] 0 2024-04-12T13:41:57.698 INFO:tasks.workunit.client.1.smithi110.stdout:7/258: rename d1/d3/d4/fb to d1/d3/d43/f53 0 2024-04-12T13:41:57.698 INFO:tasks.workunit.client.1.smithi110.stdout:3/259: getdents d5 0 2024-04-12T13:41:57.711 INFO:tasks.workunit.client.1.smithi110.stdout:2/297: truncate d6/f11 819625 0 2024-04-12T13:41:57.713 INFO:tasks.workunit.client.0.smithi060.stdout:2/219: write d6/d13/d17/d21/f2d [705432,53371] 0 2024-04-12T13:41:57.714 INFO:tasks.workunit.client.1.smithi110.stdout:0/212: truncate d1/d11/f2b 1375576 0 2024-04-12T13:41:57.715 INFO:tasks.workunit.client.1.smithi110.stdout:1/214: dwrite de/f2f [0,4194304] 0 2024-04-12T13:41:57.718 INFO:tasks.workunit.client.1.smithi110.stdout:3/260: creat d5/dc/d31/d3b/f59 x:0 0 0 2024-04-12T13:41:57.719 INFO:tasks.workunit.client.0.smithi060.stdout:1/296: dwrite f2 [0,4194304] 0 2024-04-12T13:41:57.721 INFO:tasks.workunit.client.0.smithi060.stdout:6/377: mknod d1/d7/da/dc/d3a/c8c 0 2024-04-12T13:41:57.725 INFO:tasks.workunit.client.1.smithi110.stdout:8/247: symlink d1/d3/d35/d3a/d41/l4d 0 2024-04-12T13:41:57.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/267: dread d9/d1b/d2b/f40 [0,4194304] 0 2024-04-12T13:41:57.727 INFO:tasks.workunit.client.0.smithi060.stdout:9/233: link d4/d33/c45 d4/d9/d19/d21/c4b 0 2024-04-12T13:41:57.728 INFO:tasks.workunit.client.1.smithi110.stdout:6/294: sync 2024-04-12T13:41:57.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/234: stat d4/d9/d19/d21/f27 0 2024-04-12T13:41:57.730 INFO:tasks.workunit.client.0.smithi060.stdout:2/220: truncate d6/f8 1227165 0 2024-04-12T13:41:57.730 INFO:tasks.workunit.client.1.smithi110.stdout:0/213: write d1/f22 [1530323,4511] 0 2024-04-12T13:41:57.731 INFO:tasks.workunit.client.1.smithi110.stdout:6/295: stat d7/d25/d30/d44/f2d 0 2024-04-12T13:41:57.732 INFO:tasks.workunit.client.1.smithi110.stdout:0/214: chown d1/d11/l28 25724991 1 2024-04-12T13:41:57.733 INFO:tasks.workunit.client.1.smithi110.stdout:3/261: dwrite d5/dc/d31/d3b/f59 [0,4194304] 0 2024-04-12T13:41:57.738 INFO:tasks.workunit.client.0.smithi060.stdout:5/313: write d6/f17 [1530018,23991] 0 2024-04-12T13:41:57.740 INFO:tasks.workunit.client.0.smithi060.stdout:6/378: mknod d1/d7/da/dc/d24/d34/d51/d59/c8d 0 2024-04-12T13:41:57.741 INFO:tasks.workunit.client.1.smithi110.stdout:2/298: rename d6/d18/d20 to d6/d18/d19/d4a/d51 0 2024-04-12T13:41:57.744 INFO:tasks.workunit.client.0.smithi060.stdout:5/314: stat d6/dd/d1f/d25/d35/d50/c67 0 2024-04-12T13:41:57.745 INFO:tasks.workunit.client.0.smithi060.stdout:0/250: truncate d7/d9/d14/d35/f39 556749 0 2024-04-12T13:41:57.746 INFO:tasks.workunit.client.1.smithi110.stdout:8/248: dwrite d1/d7/f32 [0,4194304] 0 2024-04-12T13:41:57.746 INFO:tasks.workunit.client.1.smithi110.stdout:7/259: link d1/d3/c26 d1/d31/c54 0 2024-04-12T13:41:57.748 INFO:tasks.workunit.client.1.smithi110.stdout:8/249: fdatasync d1/d3/d3c/f2f 0 2024-04-12T13:41:57.749 INFO:tasks.workunit.client.0.smithi060.stdout:8/268: creat d9/d1b/d37/d4d/f5a x:0 0 0 2024-04-12T13:41:57.750 INFO:tasks.workunit.client.0.smithi060.stdout:2/221: dwrite f3 [0,4194304] 0 2024-04-12T13:41:57.755 INFO:tasks.workunit.client.0.smithi060.stdout:2/222: dread - d6/d13/f2f zero size 2024-04-12T13:41:57.756 INFO:tasks.workunit.client.0.smithi060.stdout:1/297: mknod d1e/d23/d2e/d5e/d68/c6b 0 2024-04-12T13:41:57.759 INFO:tasks.workunit.client.0.smithi060.stdout:6/379: readlink d1/d7/l79 0 2024-04-12T13:41:57.760 INFO:tasks.workunit.client.1.smithi110.stdout:3/262: mknod d5/c5a 0 2024-04-12T13:41:57.761 INFO:tasks.workunit.client.0.smithi060.stdout:7/236: link d0/d1b/f53 d0/d3d/f56 0 2024-04-12T13:41:57.763 INFO:tasks.workunit.client.0.smithi060.stdout:7/237: chown d0/f47 115 1 2024-04-12T13:41:57.766 INFO:tasks.workunit.client.0.smithi060.stdout:8/269: mknod d9/d1b/d37/d4d/c5b 0 2024-04-12T13:41:57.769 INFO:tasks.workunit.client.1.smithi110.stdout:7/260: mkdir d1/d3/d4/d55 0 2024-04-12T13:41:57.773 INFO:tasks.workunit.client.1.smithi110.stdout:8/250: creat d1/f4e x:0 0 0 2024-04-12T13:41:57.775 INFO:tasks.workunit.client.1.smithi110.stdout:8/251: stat d1/d3/d35/d3a/d41 0 2024-04-12T13:41:57.776 INFO:tasks.workunit.client.1.smithi110.stdout:7/261: dread d1/f38 [0,4194304] 0 2024-04-12T13:41:57.777 INFO:tasks.workunit.client.0.smithi060.stdout:2/223: creat d6/d13/d31/f42 x:0 0 0 2024-04-12T13:41:57.779 INFO:tasks.workunit.client.1.smithi110.stdout:1/215: creat de/d14/f53 x:0 0 0 2024-04-12T13:41:57.783 INFO:tasks.workunit.client.1.smithi110.stdout:2/299: dwrite d6/dc/dd/f28 [0,4194304] 0 2024-04-12T13:41:57.784 INFO:tasks.workunit.client.1.smithi110.stdout:6/296: link d7/d25/d30/d44/d3d/f47 d7/d10/d1c/d2b/d3a/f5a 0 2024-04-12T13:41:57.791 INFO:tasks.workunit.client.1.smithi110.stdout:6/297: dread d7/f19 [0,4194304] 0 2024-04-12T13:41:57.792 INFO:tasks.workunit.client.0.smithi060.stdout:8/270: creat d9/d1b/d2b/f5c x:0 0 0 2024-04-12T13:41:57.796 INFO:tasks.workunit.client.0.smithi060.stdout:8/271: dread d9/d1d/f33 [0,4194304] 0 2024-04-12T13:41:57.797 INFO:tasks.workunit.client.0.smithi060.stdout:6/380: write d1/d7/da/dc/f6d [1414417,3138] 0 2024-04-12T13:41:57.799 INFO:tasks.workunit.client.0.smithi060.stdout:8/272: write d9/f3b [97969,117000] 0 2024-04-12T13:41:57.799 INFO:tasks.workunit.client.0.smithi060.stdout:2/224: chown d6/d13/c29 111 1 2024-04-12T13:41:57.801 INFO:tasks.workunit.client.0.smithi060.stdout:2/225: fsync d6/d13/d31/f42 0 2024-04-12T13:41:57.802 INFO:tasks.workunit.client.0.smithi060.stdout:8/273: write d9/d1b/d3c/f56 [818295,91132] 0 2024-04-12T13:41:57.804 INFO:tasks.workunit.client.0.smithi060.stdout:0/251: link d7/c46 d7/d33/c60 0 2024-04-12T13:41:57.806 INFO:tasks.workunit.client.0.smithi060.stdout:9/235: link d4/c46 d4/c4c 0 2024-04-12T13:41:57.807 INFO:tasks.workunit.client.0.smithi060.stdout:5/315: link d6/dd/d1f/d25/d42/d52/c69 d6/dd/d1f/d25/d42/d52/c70 0 2024-04-12T13:41:57.808 INFO:tasks.workunit.client.1.smithi110.stdout:3/263: readlink d5/dc/l4d 0 2024-04-12T13:41:57.809 INFO:tasks.workunit.client.0.smithi060.stdout:6/381: symlink d1/d7/da/dc/l8e 0 2024-04-12T13:41:57.811 INFO:tasks.workunit.client.1.smithi110.stdout:8/252: dwrite d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:41:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:1/298: creat d1e/d29/f6c x:0 0 0 2024-04-12T13:41:57.814 INFO:tasks.workunit.client.0.smithi060.stdout:2/226: rmdir d6/d13/d17 39 2024-04-12T13:41:57.815 INFO:tasks.workunit.client.0.smithi060.stdout:1/299: write d1e/d23/d2e/d30/f5f [2003234,71271] 0 2024-04-12T13:41:57.815 INFO:tasks.workunit.client.0.smithi060.stdout:2/227: stat d6/f1b 0 2024-04-12T13:41:57.816 INFO:tasks.workunit.client.0.smithi060.stdout:2/228: dread - d6/f2a zero size 2024-04-12T13:41:57.816 INFO:tasks.workunit.client.1.smithi110.stdout:1/216: write de/d15/f3f [508009,91384] 0 2024-04-12T13:41:57.817 INFO:tasks.workunit.client.1.smithi110.stdout:9/333: sync 2024-04-12T13:41:57.817 INFO:tasks.workunit.client.1.smithi110.stdout:5/210: sync 2024-04-12T13:41:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:8/274: rename d9/d1b/l2a to d9/d1d/l5d 0 2024-04-12T13:41:57.818 INFO:tasks.workunit.client.1.smithi110.stdout:4/354: sync 2024-04-12T13:41:57.819 INFO:tasks.workunit.client.0.smithi060.stdout:1/300: write d1e/d23/d2e/f3a [1153374,129151] 0 2024-04-12T13:41:57.820 INFO:tasks.workunit.client.1.smithi110.stdout:5/211: chown da/d2e/d45/d25/f2c 3361946 1 2024-04-12T13:41:57.820 INFO:tasks.workunit.client.0.smithi060.stdout:0/252: creat d7/d41/f61 x:0 0 0 2024-04-12T13:41:57.823 INFO:tasks.workunit.client.0.smithi060.stdout:5/316: rmdir d6/dd/d1f/d25/d35 39 2024-04-12T13:41:57.826 INFO:tasks.workunit.client.1.smithi110.stdout:6/298: rename d7/d25/f46 to d7/d25/d30/d44/d3d/f5b 0 2024-04-12T13:41:57.826 INFO:tasks.workunit.client.0.smithi060.stdout:2/229: dread d6/d10/d16/f37 [0,4194304] 0 2024-04-12T13:41:57.828 INFO:tasks.workunit.client.0.smithi060.stdout:2/230: chown d6/d10/d16/f18 21846 1 2024-04-12T13:41:57.829 INFO:tasks.workunit.client.1.smithi110.stdout:7/262: truncate d1/d3/f20 5189093 0 2024-04-12T13:41:57.833 INFO:tasks.workunit.client.1.smithi110.stdout:4/355: dread d0/d19/d1c/f58 [0,4194304] 0 2024-04-12T13:41:57.834 INFO:tasks.workunit.client.1.smithi110.stdout:9/334: dread df/d13/d26/f28 [0,4194304] 0 2024-04-12T13:41:57.835 INFO:tasks.workunit.client.1.smithi110.stdout:2/300: creat d6/dc/d13/f52 x:0 0 0 2024-04-12T13:41:57.840 INFO:tasks.workunit.client.1.smithi110.stdout:8/253: mkdir d1/d3/d35/d3a/d3e/d4f 0 2024-04-12T13:41:57.843 INFO:tasks.workunit.client.0.smithi060.stdout:0/253: symlink d7/d9/d14/d35/d3c/l62 0 2024-04-12T13:41:57.843 INFO:tasks.workunit.client.1.smithi110.stdout:5/212: dread da/d2e/d45/d25/f44 [0,4194304] 0 2024-04-12T13:41:57.844 INFO:tasks.workunit.client.0.smithi060.stdout:0/254: chown d7/d9/d14/d35/l3a 233343 1 2024-04-12T13:41:57.845 INFO:tasks.workunit.client.0.smithi060.stdout:0/255: readlink d7/d9/l18 0 2024-04-12T13:41:57.846 INFO:tasks.workunit.client.0.smithi060.stdout:5/317: unlink d6/d10/d12/l19 0 2024-04-12T13:41:57.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/275: write d9/f2c [784035,109991] 0 2024-04-12T13:41:57.857 INFO:tasks.workunit.client.0.smithi060.stdout:6/382: write d1/d7/da/dc/f75 [1738065,109878] 0 2024-04-12T13:41:57.858 INFO:tasks.workunit.client.0.smithi060.stdout:1/301: mkdir d1e/d29/d6d 0 2024-04-12T13:41:57.860 INFO:tasks.workunit.client.0.smithi060.stdout:9/236: creat d4/d8/f4d x:0 0 0 2024-04-12T13:41:57.862 INFO:tasks.workunit.client.0.smithi060.stdout:5/318: mknod d6/d10/d12/d15/c71 0 2024-04-12T13:41:57.863 INFO:tasks.workunit.client.0.smithi060.stdout:6/383: dread - d1/d7/da/dc/d24/d30/d52/d5e/f68 zero size 2024-04-12T13:41:57.864 INFO:tasks.workunit.client.0.smithi060.stdout:9/237: truncate d4/d8/f2e 32866 0 2024-04-12T13:41:57.864 INFO:tasks.workunit.client.0.smithi060.stdout:8/276: write d9/d1b/d2b/f40 [1959953,72230] 0 2024-04-12T13:41:57.865 INFO:tasks.workunit.client.0.smithi060.stdout:2/231: mkdir d6/d13/d17/d21/d43 0 2024-04-12T13:41:57.866 INFO:tasks.workunit.client.1.smithi110.stdout:1/217: truncate de/d15/f31 496623 0 2024-04-12T13:41:57.867 INFO:tasks.workunit.client.0.smithi060.stdout:8/277: readlink d9/d1b/l29 0 2024-04-12T13:41:57.867 INFO:tasks.workunit.client.0.smithi060.stdout:5/319: dread - d6/d10/d12/d38/f66 zero size 2024-04-12T13:41:57.868 INFO:tasks.workunit.client.1.smithi110.stdout:8/254: unlink d1/d3/d35/d3a/d41/l4d 0 2024-04-12T13:41:57.868 INFO:tasks.workunit.client.1.smithi110.stdout:5/213: stat da/d35 0 2024-04-12T13:41:57.868 INFO:tasks.workunit.client.1.smithi110.stdout:7/263: write d1/d3/d4/f2e [4370581,100770] 0 2024-04-12T13:41:57.868 INFO:tasks.workunit.client.0.smithi060.stdout:0/256: dread d7/d9/d14/f25 [0,4194304] 0 2024-04-12T13:41:57.869 INFO:tasks.workunit.client.1.smithi110.stdout:4/356: chown d0/l16 188595815 1 2024-04-12T13:41:57.870 INFO:tasks.workunit.client.0.smithi060.stdout:9/238: write d4/d9/d19/f1a [2180465,106753] 0 2024-04-12T13:41:57.870 INFO:tasks.workunit.client.1.smithi110.stdout:4/357: stat d0/d19/d1c/d50/f69 0 2024-04-12T13:41:57.872 INFO:tasks.workunit.client.0.smithi060.stdout:8/278: dread d9/f3b [0,4194304] 0 2024-04-12T13:41:57.873 INFO:tasks.workunit.client.1.smithi110.stdout:8/255: readlink d1/d3/d3c/l42 0 2024-04-12T13:41:57.873 INFO:tasks.workunit.client.0.smithi060.stdout:0/257: chown d7/d9/d14/d1b/c2d 0 1 2024-04-12T13:41:57.875 INFO:tasks.workunit.client.0.smithi060.stdout:6/384: dread d1/d7/da/dc/d3a/f4b [0,4194304] 0 2024-04-12T13:41:57.875 INFO:tasks.workunit.client.1.smithi110.stdout:9/335: link fd df/d13/d26/d37/d49/f73 0 2024-04-12T13:41:57.876 INFO:tasks.workunit.client.0.smithi060.stdout:5/320: readlink d6/l29 0 2024-04-12T13:41:57.878 INFO:tasks.workunit.client.0.smithi060.stdout:1/302: truncate d1e/d23/d2e/d30/f36 13304 0 2024-04-12T13:41:57.880 INFO:tasks.workunit.client.0.smithi060.stdout:5/321: chown d6/dd/d1f/d25/d42/d52/f5e 16478 1 2024-04-12T13:41:57.880 INFO:tasks.workunit.client.0.smithi060.stdout:9/239: creat d4/d9/d19/f4e x:0 0 0 2024-04-12T13:41:57.882 INFO:tasks.workunit.client.0.smithi060.stdout:8/279: mkdir d9/d1d/d5e 0 2024-04-12T13:41:57.885 INFO:tasks.workunit.client.0.smithi060.stdout:1/303: dread d1e/f38 [0,4194304] 0 2024-04-12T13:41:57.889 INFO:tasks.workunit.client.0.smithi060.stdout:2/232: rename d6/d13/f2f to d6/d10/f44 0 2024-04-12T13:41:57.894 INFO:tasks.workunit.client.0.smithi060.stdout:5/322: unlink d6/dd/d1f/d25/f6a 0 2024-04-12T13:41:57.898 INFO:tasks.workunit.client.0.smithi060.stdout:6/385: creat d1/d7/da/dc/d24/d8b/f8f x:0 0 0 2024-04-12T13:41:57.899 INFO:tasks.workunit.client.0.smithi060.stdout:3/275: sync 2024-04-12T13:41:57.901 INFO:tasks.workunit.client.0.smithi060.stdout:0/258: dwrite d7/d9/d14/d35/d3c/f45 [0,4194304] 0 2024-04-12T13:41:57.906 INFO:tasks.workunit.client.0.smithi060.stdout:1/304: dread d1e/f33 [0,4194304] 0 2024-04-12T13:41:57.906 INFO:tasks.workunit.client.0.smithi060.stdout:3/276: dread - d7/d17/d27/d36/f4b zero size 2024-04-12T13:41:57.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/280: link d9/d1b/d37/c49 d9/da/c5f 0 2024-04-12T13:41:57.907 INFO:tasks.workunit.client.0.smithi060.stdout:5/323: creat d6/dd/d1f/d25/d35/f72 x:0 0 0 2024-04-12T13:41:57.910 INFO:tasks.workunit.client.0.smithi060.stdout:3/277: dread - d7/d17/f42 zero size 2024-04-12T13:41:57.916 INFO:tasks.workunit.client.0.smithi060.stdout:2/233: getdents d6/d13/d31 0 2024-04-12T13:41:57.916 INFO:tasks.workunit.client.0.smithi060.stdout:5/324: chown d6/dd/d1f/d25/d42/d52 2990 1 2024-04-12T13:41:57.916 INFO:tasks.workunit.client.0.smithi060.stdout:8/281: mkdir d9/d1b/d3c/d60 0 2024-04-12T13:41:57.917 INFO:tasks.workunit.client.0.smithi060.stdout:1/305: rename d1e/d23/d49/d4e/f60 to d1e/d1f/f6e 0 2024-04-12T13:41:57.920 INFO:tasks.workunit.client.0.smithi060.stdout:9/240: dwrite d4/fd [0,4194304] 0 2024-04-12T13:41:57.924 INFO:tasks.workunit.client.1.smithi110.stdout:0/215: sync 2024-04-12T13:41:57.925 INFO:tasks.workunit.client.0.smithi060.stdout:6/386: dread d1/d7/da/dc/d24/d2d/f3d [4194304,4194304] 0 2024-04-12T13:41:57.925 INFO:tasks.workunit.client.0.smithi060.stdout:0/259: truncate d7/d9/d14/d35/f39 91714 0 2024-04-12T13:41:57.925 INFO:tasks.workunit.client.0.smithi060.stdout:5/325: symlink d6/d10/d12/d38/l73 0 2024-04-12T13:41:57.926 INFO:tasks.workunit.client.0.smithi060.stdout:3/278: mknod d7/d17/d27/d36/d53/c59 0 2024-04-12T13:41:57.927 INFO:tasks.workunit.client.1.smithi110.stdout:4/358: unlink d0/de/d2c/l33 0 2024-04-12T13:41:57.928 INFO:tasks.workunit.client.1.smithi110.stdout:8/256: mknod d1/d3/d3c/c50 0 2024-04-12T13:41:57.929 INFO:tasks.workunit.client.1.smithi110.stdout:7/264: write d1/d3/d4/d36/d4b/f25 [1619942,13671] 0 2024-04-12T13:41:57.930 INFO:tasks.workunit.client.1.smithi110.stdout:5/214: mknod da/d2e/d45/d25/c4b 0 2024-04-12T13:41:57.931 INFO:tasks.workunit.client.0.smithi060.stdout:9/241: chown d4/d9/d19/d21/c4b 247 1 2024-04-12T13:41:57.932 INFO:tasks.workunit.client.1.smithi110.stdout:5/215: stat da/db/d15/l49 0 2024-04-12T13:41:57.932 INFO:tasks.workunit.client.0.smithi060.stdout:0/260: write d7/d9/d14/d1b/f2a [287675,68250] 0 2024-04-12T13:41:57.933 INFO:tasks.workunit.client.1.smithi110.stdout:0/216: write f0 [798383,124323] 0 2024-04-12T13:41:57.933 INFO:tasks.workunit.client.1.smithi110.stdout:5/216: readlink da/db/l34 0 2024-04-12T13:41:57.933 INFO:tasks.workunit.client.1.smithi110.stdout:5/217: fsync f1 0 2024-04-12T13:41:57.935 INFO:tasks.workunit.client.1.smithi110.stdout:5/218: write da/db/f4a [91913,64387] 0 2024-04-12T13:41:57.937 INFO:tasks.workunit.client.1.smithi110.stdout:9/336: creat df/d13/d2c/d2d/d39/d3a/d4e/f74 x:0 0 0 2024-04-12T13:41:57.938 INFO:tasks.workunit.client.1.smithi110.stdout:9/337: stat df/d13/d26/d37/d6a 0 2024-04-12T13:41:57.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/279: truncate d7/d17/d19/f31 544358 0 2024-04-12T13:41:57.940 INFO:tasks.workunit.client.0.smithi060.stdout:2/234: dwrite d6/d10/d16/f1c [0,4194304] 0 2024-04-12T13:41:57.947 INFO:tasks.workunit.client.0.smithi060.stdout:4/274: sync 2024-04-12T13:41:57.947 INFO:tasks.workunit.client.0.smithi060.stdout:1/306: link d1e/d23/d2e/d30/f5c d1e/d46/f6f 0 2024-04-12T13:41:57.948 INFO:tasks.workunit.client.1.smithi110.stdout:4/359: creat d0/d19/f74 x:0 0 0 2024-04-12T13:41:57.948 INFO:tasks.workunit.client.0.smithi060.stdout:1/307: fdatasync d1e/f2d 0 2024-04-12T13:41:57.958 INFO:tasks.workunit.client.0.smithi060.stdout:0/261: dread d7/d9/d14/d35/d3c/f45 [0,4194304] 0 2024-04-12T13:41:57.958 INFO:tasks.workunit.client.1.smithi110.stdout:8/257: unlink d1/d3/d3c/l34 0 2024-04-12T13:41:57.959 INFO:tasks.workunit.client.0.smithi060.stdout:5/326: write d6/dd/d27/f44 [2950789,23141] 0 2024-04-12T13:41:57.960 INFO:tasks.workunit.client.1.smithi110.stdout:1/218: getdents de/d15 0 2024-04-12T13:41:57.961 INFO:tasks.workunit.client.1.smithi110.stdout:1/219: dread - de/d14/f53 zero size 2024-04-12T13:41:57.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/235: rename d6/lb to d6/d13/d31/d33/l45 0 2024-04-12T13:41:57.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/242: mkdir d4/d4f 0 2024-04-12T13:41:57.977 INFO:tasks.workunit.client.0.smithi060.stdout:8/282: dwrite d9/d1d/f33 [0,4194304] 0 2024-04-12T13:41:57.978 INFO:tasks.workunit.client.0.smithi060.stdout:1/308: dwrite d1e/d23/d2e/f64 [0,4194304] 0 2024-04-12T13:41:57.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/387: mkdir d1/d7/da/dc/d24/d30/d90 0 2024-04-12T13:41:57.985 INFO:tasks.workunit.client.0.smithi060.stdout:5/327: mknod d6/d10/d12/d15/c74 0 2024-04-12T13:41:57.989 INFO:tasks.workunit.client.0.smithi060.stdout:7/238: sync 2024-04-12T13:41:57.989 INFO:tasks.workunit.client.0.smithi060.stdout:0/262: mkdir d7/d9/de/d63 0 2024-04-12T13:41:57.990 INFO:tasks.workunit.client.0.smithi060.stdout:3/280: symlink d7/da/dd/d25/d4d/l5a 0 2024-04-12T13:41:57.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/239: fdatasync d0/d1b/f1d 0 2024-04-12T13:41:57.994 INFO:tasks.workunit.client.0.smithi060.stdout:2/236: mknod d6/d13/d31/d33/d3d/c46 0 2024-04-12T13:41:57.995 INFO:tasks.workunit.client.0.smithi060.stdout:9/243: mkdir d4/d33/d50 0 2024-04-12T13:41:57.997 INFO:tasks.workunit.client.0.smithi060.stdout:1/309: symlink d1e/d23/d2e/d30/l70 0 2024-04-12T13:41:58.000 INFO:tasks.workunit.client.0.smithi060.stdout:6/388: creat d1/d7/da/dc/d24/f91 x:0 0 0 2024-04-12T13:41:58.000 INFO:tasks.workunit.client.0.smithi060.stdout:4/275: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:41:58.001 INFO:tasks.workunit.client.0.smithi060.stdout:5/328: creat d6/dd/d1f/d25/d42/d52/f75 x:0 0 0 2024-04-12T13:41:58.003 INFO:tasks.workunit.client.0.smithi060.stdout:3/281: rmdir d7/d17/d27/d36/d53 39 2024-04-12T13:41:58.004 INFO:tasks.workunit.client.1.smithi110.stdout:8/258: rename d1/f4e to d1/d3/d35/d3a/d41/f51 0 2024-04-12T13:41:58.004 INFO:tasks.workunit.client.1.smithi110.stdout:5/219: unlink da/d2e/l42 0 2024-04-12T13:41:58.004 INFO:tasks.workunit.client.0.smithi060.stdout:3/282: fdatasync d7/da/f35 0 2024-04-12T13:41:58.005 INFO:tasks.workunit.client.1.smithi110.stdout:7/265: mkdir d1/d3/d4/d55/d56 0 2024-04-12T13:41:58.007 INFO:tasks.workunit.client.0.smithi060.stdout:1/310: creat d1e/d1f/f71 x:0 0 0 2024-04-12T13:41:58.009 INFO:tasks.workunit.client.1.smithi110.stdout:4/360: mkdir d0/d75 0 2024-04-12T13:41:58.015 INFO:tasks.workunit.client.1.smithi110.stdout:7/266: symlink d1/d31/l57 0 2024-04-12T13:41:58.017 INFO:tasks.workunit.client.0.smithi060.stdout:4/276: mkdir d6/d7/db/d62 0 2024-04-12T13:41:58.018 INFO:tasks.workunit.client.0.smithi060.stdout:1/311: stat d1e/l20 0 2024-04-12T13:41:58.018 INFO:tasks.workunit.client.0.smithi060.stdout:3/283: creat d7/d17/d19/d33/f5b x:0 0 0 2024-04-12T13:41:58.019 INFO:tasks.workunit.client.1.smithi110.stdout:8/259: rename d1/d5/dd/l21 to d1/d3/d35/d43/l52 0 2024-04-12T13:41:58.020 INFO:tasks.workunit.client.0.smithi060.stdout:4/277: chown f2 122 1 2024-04-12T13:41:58.021 INFO:tasks.workunit.client.1.smithi110.stdout:9/338: dwrite df/d13/d2c/d2d/f64 [0,4194304] 0 2024-04-12T13:41:58.021 INFO:tasks.workunit.client.0.smithi060.stdout:1/312: chown d1e/d29/d6d 346 1 2024-04-12T13:41:58.022 INFO:tasks.workunit.client.0.smithi060.stdout:7/240: creat d0/d7/d43/d4d/f57 x:0 0 0 2024-04-12T13:41:58.022 INFO:tasks.workunit.client.1.smithi110.stdout:9/339: dread - df/d13/d2c/d2d/d39/f44 zero size 2024-04-12T13:41:58.023 INFO:tasks.workunit.client.0.smithi060.stdout:8/283: write f1 [2422977,53842] 0 2024-04-12T13:41:58.025 INFO:tasks.workunit.client.0.smithi060.stdout:1/313: fdatasync d1e/d46/f63 0 2024-04-12T13:41:58.029 INFO:tasks.workunit.client.1.smithi110.stdout:1/220: write de/f22 [949113,124527] 0 2024-04-12T13:41:58.032 INFO:tasks.workunit.client.0.smithi060.stdout:7/241: chown d0/d7/d43/d4d/f57 168198031 1 2024-04-12T13:41:58.034 INFO:tasks.workunit.client.0.smithi060.stdout:2/237: dread d6/d10/d16/f2e [0,4194304] 0 2024-04-12T13:41:58.034 INFO:tasks.workunit.client.0.smithi060.stdout:0/263: dwrite d7/d9/d14/d35/d3c/f42 [0,4194304] 0 2024-04-12T13:41:58.035 INFO:tasks.workunit.client.1.smithi110.stdout:6/299: sync 2024-04-12T13:41:58.035 INFO:tasks.workunit.client.1.smithi110.stdout:3/264: sync 2024-04-12T13:41:58.035 INFO:tasks.workunit.client.1.smithi110.stdout:7/267: dwrite d1/d3/d4/f9 [8388608,4194304] 0 2024-04-12T13:41:58.036 INFO:tasks.workunit.client.0.smithi060.stdout:3/284: dread d7/da/dd/d25/f26 [0,4194304] 0 2024-04-12T13:41:58.039 INFO:tasks.workunit.client.1.smithi110.stdout:6/300: truncate d7/d10/d1c/d2b/d3a/f5a 582940 0 2024-04-12T13:41:58.040 INFO:tasks.workunit.client.1.smithi110.stdout:9/340: symlink df/d13/d2c/d2d/d39/d4f/l75 0 2024-04-12T13:41:58.042 INFO:tasks.workunit.client.1.smithi110.stdout:8/260: creat d1/d3/d35/d3a/d41/f53 x:0 0 0 2024-04-12T13:41:58.044 INFO:tasks.workunit.client.0.smithi060.stdout:5/329: creat d6/dd/d1f/d25/d42/d6b/f76 x:0 0 0 2024-04-12T13:41:58.044 INFO:tasks.workunit.client.1.smithi110.stdout:7/268: mknod d1/d1b/d33/c58 0 2024-04-12T13:41:58.045 INFO:tasks.workunit.client.1.smithi110.stdout:6/301: dread - d7/d10/d1c/f42 zero size 2024-04-12T13:41:58.046 INFO:tasks.workunit.client.1.smithi110.stdout:3/265: rename d5/dc/d33 to d5/dc/d31/d3b/d5b 0 2024-04-12T13:41:58.049 INFO:tasks.workunit.client.1.smithi110.stdout:4/361: getdents d0/d13 0 2024-04-12T13:41:58.050 INFO:tasks.workunit.client.1.smithi110.stdout:1/221: creat de/d14/d34/f54 x:0 0 0 2024-04-12T13:41:58.052 INFO:tasks.workunit.client.1.smithi110.stdout:4/362: chown d0/d19/d26/f53 1 1 2024-04-12T13:41:58.053 INFO:tasks.workunit.client.1.smithi110.stdout:4/363: fdatasync d0/d19/d26/f53 0 2024-04-12T13:41:58.054 INFO:tasks.workunit.client.0.smithi060.stdout:8/284: dwrite d9/fc [0,4194304] 0 2024-04-12T13:41:58.054 INFO:tasks.workunit.client.1.smithi110.stdout:5/220: dwrite da/d2e/d45/f1e [0,4194304] 0 2024-04-12T13:41:58.057 INFO:tasks.workunit.client.1.smithi110.stdout:5/221: fdatasync da/d2e/d45/d25/f43 0 2024-04-12T13:41:58.057 INFO:tasks.workunit.client.0.smithi060.stdout:1/314: mknod d1e/d1f/c72 0 2024-04-12T13:41:58.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/242: creat d0/d3d/f58 x:0 0 0 2024-04-12T13:41:58.065 INFO:tasks.workunit.client.1.smithi110.stdout:6/302: mknod d7/d25/d2c/c5c 0 2024-04-12T13:41:58.066 INFO:tasks.workunit.client.1.smithi110.stdout:7/269: dwrite d1/d3/d4/f1c [0,4194304] 0 2024-04-12T13:41:58.067 INFO:tasks.workunit.client.0.smithi060.stdout:2/238: dread d6/d13/d17/d21/f2d [0,4194304] 0 2024-04-12T13:41:58.067 INFO:tasks.workunit.client.1.smithi110.stdout:3/266: symlink d5/dc/d31/d3b/d32/d3e/l5c 0 2024-04-12T13:41:58.071 INFO:tasks.workunit.client.0.smithi060.stdout:9/244: rename d4/d33/l3a to d4/d8/l51 0 2024-04-12T13:41:58.074 INFO:tasks.workunit.client.0.smithi060.stdout:2/239: truncate d6/f2a 396415 0 2024-04-12T13:41:58.075 INFO:tasks.workunit.client.0.smithi060.stdout:6/389: rmdir d1/d7/da/dc/d24/d30/d90 0 2024-04-12T13:41:58.076 INFO:tasks.workunit.client.1.smithi110.stdout:1/222: mkdir de/d14/d34/d55 0 2024-04-12T13:41:58.077 INFO:tasks.workunit.client.1.smithi110.stdout:9/341: write df/d13/f1b [1699979,97650] 0 2024-04-12T13:41:58.077 INFO:tasks.workunit.client.0.smithi060.stdout:4/278: mkdir d6/d7/dd/d1a/d57/d63 0 2024-04-12T13:41:58.078 INFO:tasks.workunit.client.1.smithi110.stdout:5/222: dwrite da/db/d15/f1b [0,4194304] 0 2024-04-12T13:41:58.080 INFO:tasks.workunit.client.0.smithi060.stdout:0/264: creat d7/d33/d5b/f64 x:0 0 0 2024-04-12T13:41:58.081 INFO:tasks.workunit.client.0.smithi060.stdout:4/279: chown d6/d21/c16 13 1 2024-04-12T13:41:58.082 INFO:tasks.workunit.client.0.smithi060.stdout:1/315: creat d1e/d29/d37/f73 x:0 0 0 2024-04-12T13:41:58.082 INFO:tasks.workunit.client.1.smithi110.stdout:8/261: unlink d1/d5/d1f/l48 0 2024-04-12T13:41:58.082 INFO:tasks.workunit.client.1.smithi110.stdout:4/364: dwrite d0/d19/d26/f64 [0,4194304] 0 2024-04-12T13:41:58.084 INFO:tasks.workunit.client.1.smithi110.stdout:8/262: stat d1/d5/dd 0 2024-04-12T13:41:58.086 INFO:tasks.workunit.client.1.smithi110.stdout:4/365: chown d0/de/d32/d5f/c4e 423 1 2024-04-12T13:41:58.086 INFO:tasks.workunit.client.0.smithi060.stdout:0/265: write d7/d9/d14/f34 [1126389,113054] 0 2024-04-12T13:41:58.087 INFO:tasks.workunit.client.0.smithi060.stdout:1/316: dread - d1e/d29/d37/f66 zero size 2024-04-12T13:41:58.088 INFO:tasks.workunit.client.0.smithi060.stdout:8/285: dwrite d9/d1b/d2b/f45 [0,4194304] 0 2024-04-12T13:41:58.089 INFO:tasks.workunit.client.1.smithi110.stdout:4/366: chown d0/d19/d1c 7 1 2024-04-12T13:41:58.090 INFO:tasks.workunit.client.0.smithi060.stdout:1/317: write f2 [2808761,100956] 0 2024-04-12T13:41:58.091 INFO:tasks.workunit.client.1.smithi110.stdout:0/217: sync 2024-04-12T13:41:58.091 INFO:tasks.workunit.client.1.smithi110.stdout:2/301: sync 2024-04-12T13:41:58.091 INFO:tasks.workunit.client.0.smithi060.stdout:7/243: creat d0/f59 x:0 0 0 2024-04-12T13:41:58.093 INFO:tasks.workunit.client.1.smithi110.stdout:3/267: symlink d5/dc/d20/l5d 0 2024-04-12T13:41:58.095 INFO:tasks.workunit.client.0.smithi060.stdout:3/285: rename d7/da/dd to d7/da/d3f/d5c 0 2024-04-12T13:41:58.103 INFO:tasks.workunit.client.1.smithi110.stdout:1/223: dwrite de/d14/f4f [0,4194304] 0 2024-04-12T13:41:58.106 INFO:tasks.workunit.client.0.smithi060.stdout:1/318: dwrite f2 [0,4194304] 0 2024-04-12T13:41:58.117 INFO:tasks.workunit.client.1.smithi110.stdout:2/302: dread d6/dc/dd/f24 [0,4194304] 0 2024-04-12T13:41:58.123 INFO:tasks.workunit.client.1.smithi110.stdout:6/303: rename d7/d25/d30/d44/f37 to d7/d10/d1c/d2b/d48/d54/f5d 0 2024-04-12T13:41:58.125 INFO:tasks.workunit.client.0.smithi060.stdout:6/390: dread d1/f15 [0,4194304] 0 2024-04-12T13:41:58.126 INFO:tasks.workunit.client.0.smithi060.stdout:2/240: mknod d6/d10/d2b/c47 0 2024-04-12T13:41:58.128 INFO:tasks.workunit.client.1.smithi110.stdout:5/223: unlink l3 0 2024-04-12T13:41:58.133 INFO:tasks.workunit.client.1.smithi110.stdout:0/218: read d1/d8/f10 [460133,36087] 0 2024-04-12T13:41:58.135 INFO:tasks.workunit.client.0.smithi060.stdout:6/391: truncate d1/d7/da/dc/d24/d30/d52/d5e/f72 873043 0 2024-04-12T13:41:58.136 INFO:tasks.workunit.client.0.smithi060.stdout:6/392: dread - d1/f6b zero size 2024-04-12T13:41:58.136 INFO:tasks.workunit.client.0.smithi060.stdout:4/280: rmdir d6/d2f 39 2024-04-12T13:41:58.137 INFO:tasks.workunit.client.0.smithi060.stdout:4/281: stat d6/d7/db 0 2024-04-12T13:41:58.138 INFO:tasks.workunit.client.1.smithi110.stdout:5/224: dread da/d2e/d45/d25/f2c [0,4194304] 0 2024-04-12T13:41:58.141 INFO:tasks.workunit.client.0.smithi060.stdout:4/282: truncate d6/f3a 187299 0 2024-04-12T13:41:58.146 INFO:tasks.workunit.client.0.smithi060.stdout:4/283: truncate d6/d7/dd/d1a/f60 507417 0 2024-04-12T13:41:58.150 INFO:tasks.workunit.client.0.smithi060.stdout:4/284: read d6/f55 [545220,15014] 0 2024-04-12T13:41:58.153 INFO:tasks.workunit.client.0.smithi060.stdout:5/330: rename d6/d10/d12/d15/f22 to d6/dd/d1f/d25/d53/f77 0 2024-04-12T13:41:58.156 INFO:tasks.workunit.client.0.smithi060.stdout:3/286: mknod d7/d17/d19/d33/c5d 0 2024-04-12T13:41:58.166 INFO:tasks.workunit.client.1.smithi110.stdout:5/225: creat da/db/f4c x:0 0 0 2024-04-12T13:41:58.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/266: truncate d7/d9/f2b 2666997 0 2024-04-12T13:41:58.169 INFO:tasks.workunit.client.0.smithi060.stdout:4/285: truncate d6/f2e 439401 0 2024-04-12T13:41:58.171 INFO:tasks.workunit.client.0.smithi060.stdout:4/286: truncate d6/d7/f3b 658458 0 2024-04-12T13:41:58.172 INFO:tasks.workunit.client.1.smithi110.stdout:2/303: mkdir d6/d53 0 2024-04-12T13:41:58.173 INFO:tasks.workunit.client.0.smithi060.stdout:4/287: fsync d6/d7/dd/df/f37 0 2024-04-12T13:41:58.174 INFO:tasks.workunit.client.0.smithi060.stdout:7/244: dread - d0/d7/d43/d4d/f57 zero size 2024-04-12T13:41:58.174 INFO:tasks.workunit.client.1.smithi110.stdout:4/367: rename d0/l8 to d0/de/d32/d61/l76 0 2024-04-12T13:41:58.176 INFO:tasks.workunit.client.0.smithi060.stdout:3/287: mkdir d7/da/d3f/d5c/d25/d5e 0 2024-04-12T13:41:58.176 INFO:tasks.workunit.client.1.smithi110.stdout:4/368: dread - d0/de/d32/f5d zero size 2024-04-12T13:41:58.178 INFO:tasks.workunit.client.1.smithi110.stdout:7/270: dwrite d1/d3/f20 [4194304,4194304] 0 2024-04-12T13:41:58.179 INFO:tasks.workunit.client.0.smithi060.stdout:9/245: rmdir d4/d4f 0 2024-04-12T13:41:58.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:57 smithi060 ceph-mon[29097]: pgmap v23: 65 pgs: 65 active+clean; 695 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 76 MiB/s wr, 144 op/s 2024-04-12T13:41:58.180 INFO:tasks.workunit.client.1.smithi110.stdout:7/271: truncate d1/d3/f4c 450597 0 2024-04-12T13:41:58.181 INFO:tasks.workunit.client.1.smithi110.stdout:9/342: sync 2024-04-12T13:41:58.181 INFO:tasks.workunit.client.0.smithi060.stdout:2/241: creat d6/d10/d2b/d35/f48 x:0 0 0 2024-04-12T13:41:58.182 INFO:tasks.workunit.client.0.smithi060.stdout:2/242: dread - d6/d13/f34 zero size 2024-04-12T13:41:58.182 INFO:tasks.workunit.client.1.smithi110.stdout:0/219: creat d1/d27/d31/f49 x:0 0 0 2024-04-12T13:41:58.184 INFO:tasks.workunit.client.0.smithi060.stdout:2/243: truncate d6/d13/d31/f41 317962 0 2024-04-12T13:41:58.184 INFO:tasks.workunit.client.1.smithi110.stdout:3/268: link d5/c5a d5/dc/d31/d3b/c5e 0 2024-04-12T13:41:58.185 INFO:tasks.workunit.client.1.smithi110.stdout:3/269: readlink d5/dc/d20/l55 0 2024-04-12T13:41:58.189 INFO:tasks.workunit.client.0.smithi060.stdout:0/267: mknod d7/d41/c65 0 2024-04-12T13:41:58.196 INFO:tasks.workunit.client.1.smithi110.stdout:8/263: truncate d1/d3/f24 4013408 0 2024-04-12T13:41:58.197 INFO:tasks.workunit.client.1.smithi110.stdout:4/369: creat d0/de/d6e/f77 x:0 0 0 2024-04-12T13:41:58.197 INFO:tasks.workunit.client.0.smithi060.stdout:1/319: dwrite d1e/f2b [0,4194304] 0 2024-04-12T13:41:58.200 INFO:tasks.workunit.client.0.smithi060.stdout:1/320: chown d1e/d23/d2e/d30/f5c 33 1 2024-04-12T13:41:58.205 INFO:tasks.workunit.client.0.smithi060.stdout:7/245: truncate d0/d7/f39 721973 0 2024-04-12T13:41:58.206 INFO:tasks.workunit.client.0.smithi060.stdout:3/288: creat d7/da/d3f/d5c/d25/f5f x:0 0 0 2024-04-12T13:41:58.208 INFO:tasks.workunit.client.1.smithi110.stdout:3/270: mkdir d5/dc/d31/d3b/d32/d3e/d5f 0 2024-04-12T13:41:58.210 INFO:tasks.workunit.client.1.smithi110.stdout:7/272: dwrite d1/f1e [0,4194304] 0 2024-04-12T13:41:58.216 INFO:tasks.workunit.client.0.smithi060.stdout:2/244: stat d6/d13/d17/f1f 0 2024-04-12T13:41:58.216 INFO:tasks.workunit.client.1.smithi110.stdout:1/224: rename cd to de/d15/c56 0 2024-04-12T13:41:58.219 INFO:tasks.workunit.client.0.smithi060.stdout:6/393: link d1/d7/da/dc/l6c d1/d7/da/dc/d24/d30/d52/d78/d80/l92 0 2024-04-12T13:41:58.219 INFO:tasks.workunit.client.1.smithi110.stdout:8/264: symlink d1/d3/d35/d3a/l54 0 2024-04-12T13:41:58.223 INFO:tasks.workunit.client.0.smithi060.stdout:5/331: write f2 [5918689,6592] 0 2024-04-12T13:41:58.224 INFO:tasks.workunit.client.0.smithi060.stdout:2/245: dread d6/f24 [0,4194304] 0 2024-04-12T13:41:58.225 INFO:tasks.workunit.client.1.smithi110.stdout:9/343: creat df/d13/d26/d37/d6a/f76 x:0 0 0 2024-04-12T13:41:58.226 INFO:tasks.workunit.client.0.smithi060.stdout:1/321: mknod d1e/d23/d2e/c74 0 2024-04-12T13:41:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:57 smithi110 ceph-mon[36055]: pgmap v23: 65 pgs: 65 active+clean; 695 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 2.4 MiB/s rd, 76 MiB/s wr, 144 op/s 2024-04-12T13:41:58.228 INFO:tasks.workunit.client.1.smithi110.stdout:6/304: sync 2024-04-12T13:41:58.230 INFO:tasks.workunit.client.1.smithi110.stdout:7/273: creat d1/d31/f59 x:0 0 0 2024-04-12T13:41:58.231 INFO:tasks.workunit.client.1.smithi110.stdout:3/271: dwrite d5/dc/d20/f36 [4194304,4194304] 0 2024-04-12T13:41:58.231 INFO:tasks.workunit.client.0.smithi060.stdout:9/246: mknod d4/d33/d50/c52 0 2024-04-12T13:41:58.232 INFO:tasks.workunit.client.1.smithi110.stdout:7/274: fsync d1/f28 0 2024-04-12T13:41:58.233 INFO:tasks.workunit.client.1.smithi110.stdout:8/265: mknod d1/d5/dd/c55 0 2024-04-12T13:41:58.234 INFO:tasks.workunit.client.0.smithi060.stdout:9/247: read d4/d8/fb [3721860,100236] 0 2024-04-12T13:41:58.234 INFO:tasks.workunit.client.1.smithi110.stdout:4/370: mkdir d0/d78 0 2024-04-12T13:41:58.237 INFO:tasks.workunit.client.1.smithi110.stdout:0/220: rmdir d1/d8/d3e 0 2024-04-12T13:41:58.237 INFO:tasks.workunit.client.1.smithi110.stdout:7/275: dread - d1/d3/d4/f52 zero size 2024-04-12T13:41:58.238 INFO:tasks.workunit.client.1.smithi110.stdout:2/304: getdents d6/d18/d19/d25 0 2024-04-12T13:41:58.240 INFO:tasks.workunit.client.1.smithi110.stdout:1/225: dwrite de/f26 [0,4194304] 0 2024-04-12T13:41:58.242 INFO:tasks.workunit.client.0.smithi060.stdout:1/322: dread d1e/f2b [0,4194304] 0 2024-04-12T13:41:58.243 INFO:tasks.workunit.client.1.smithi110.stdout:9/344: creat df/d13/d2c/d2d/d39/d3a/f77 x:0 0 0 2024-04-12T13:41:58.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/266: write d1/d3/d35/d3a/d41/f53 [549177,18744] 0 2024-04-12T13:41:58.243 INFO:tasks.workunit.client.1.smithi110.stdout:7/276: stat d1/d3/d4/d36/d4b/l46 0 2024-04-12T13:41:58.245 INFO:tasks.workunit.client.1.smithi110.stdout:1/226: chown de/d14/f38 52246148 1 2024-04-12T13:41:58.247 INFO:tasks.workunit.client.1.smithi110.stdout:1/227: chown de/d14/f53 398778 1 2024-04-12T13:41:58.247 INFO:tasks.workunit.client.1.smithi110.stdout:1/228: stat de/d14/f38 0 2024-04-12T13:41:58.248 INFO:tasks.workunit.client.0.smithi060.stdout:2/246: creat d6/d13/d31/d33/f49 x:0 0 0 2024-04-12T13:41:58.252 INFO:tasks.workunit.client.0.smithi060.stdout:3/289: symlink d7/d17/d19/l60 0 2024-04-12T13:41:58.252 INFO:tasks.workunit.client.0.smithi060.stdout:2/247: write d6/d13/d17/f3c [427794,49008] 0 2024-04-12T13:41:58.253 INFO:tasks.workunit.client.1.smithi110.stdout:3/272: symlink d5/dc/d31/d3b/d32/d3e/l60 0 2024-04-12T13:41:58.255 INFO:tasks.workunit.client.0.smithi060.stdout:2/248: write d6/f9 [2821078,30741] 0 2024-04-12T13:41:58.256 INFO:tasks.workunit.client.0.smithi060.stdout:6/394: dread d1/d7/da/dc/f3c [0,4194304] 0 2024-04-12T13:41:58.257 INFO:tasks.workunit.client.0.smithi060.stdout:9/248: stat d4/d9/l22 0 2024-04-12T13:41:58.257 INFO:tasks.workunit.client.1.smithi110.stdout:2/305: unlink d6/dc/d13/f52 0 2024-04-12T13:41:58.259 INFO:tasks.workunit.client.0.smithi060.stdout:2/249: write d6/f14 [3436344,127342] 0 2024-04-12T13:41:58.260 INFO:tasks.workunit.client.0.smithi060.stdout:9/249: write d4/d8/f17 [106835,50777] 0 2024-04-12T13:41:58.262 INFO:tasks.workunit.client.1.smithi110.stdout:7/277: symlink d1/d3/d4/d55/l5a 0 2024-04-12T13:41:58.262 INFO:tasks.workunit.client.0.smithi060.stdout:6/395: readlink d1/d7/da/dc/d24/d2d/l73 0 2024-04-12T13:41:58.265 INFO:tasks.workunit.client.1.smithi110.stdout:1/229: creat de/d1d/f57 x:0 0 0 2024-04-12T13:41:58.265 INFO:tasks.workunit.client.1.smithi110.stdout:7/278: write d1/d3/d4/d36/d4b/f3b [256214,11482] 0 2024-04-12T13:41:58.265 INFO:tasks.workunit.client.0.smithi060.stdout:2/250: write d6/d13/d17/f3c [1082699,129595] 0 2024-04-12T13:41:58.266 INFO:tasks.workunit.client.0.smithi060.stdout:1/323: creat d1e/d46/f75 x:0 0 0 2024-04-12T13:41:58.266 INFO:tasks.workunit.client.1.smithi110.stdout:4/371: creat d0/d75/f79 x:0 0 0 2024-04-12T13:41:58.273 INFO:tasks.workunit.client.1.smithi110.stdout:0/221: dwrite d1/d8/f21 [4194304,4194304] 0 2024-04-12T13:41:58.276 INFO:tasks.workunit.client.1.smithi110.stdout:9/345: dread df/d13/d26/f41 [0,4194304] 0 2024-04-12T13:41:58.278 INFO:tasks.workunit.client.0.smithi060.stdout:1/324: dread d1e/f4d [0,4194304] 0 2024-04-12T13:41:58.286 INFO:tasks.workunit.client.0.smithi060.stdout:0/268: rename d7/d9/d14/d35/f39 to d7/f66 0 2024-04-12T13:41:58.286 INFO:tasks.workunit.client.0.smithi060.stdout:7/246: rename d0 to d0/d3d/d5a 22 2024-04-12T13:41:58.288 INFO:tasks.workunit.client.1.smithi110.stdout:4/372: rename d0/d19/d26/f53 to d0/de/d32/d61/f7a 0 2024-04-12T13:41:58.290 INFO:tasks.workunit.client.1.smithi110.stdout:4/373: readlink d0/de/d32/l66 0 2024-04-12T13:41:58.290 INFO:tasks.workunit.client.0.smithi060.stdout:4/288: link d6/d7/dd/df/c10 d6/d7/c64 0 2024-04-12T13:41:58.291 INFO:tasks.workunit.client.1.smithi110.stdout:7/279: dread d1/d3/d4/f30 [0,4194304] 0 2024-04-12T13:41:58.293 INFO:tasks.workunit.client.0.smithi060.stdout:2/251: write d6/f24 [252912,33326] 0 2024-04-12T13:41:58.295 INFO:tasks.workunit.client.0.smithi060.stdout:6/396: mkdir d1/d7/da/dc/d24/d30/d52/d78/d80/d93 0 2024-04-12T13:41:58.296 INFO:tasks.workunit.client.0.smithi060.stdout:3/290: symlink d7/l61 0 2024-04-12T13:41:58.296 INFO:tasks.workunit.client.1.smithi110.stdout:0/222: dwrite d1/d27/f32 [0,4194304] 0 2024-04-12T13:41:58.298 INFO:tasks.workunit.client.0.smithi060.stdout:7/247: dread - d0/d7/f45 zero size 2024-04-12T13:41:58.298 INFO:tasks.workunit.client.1.smithi110.stdout:9/346: dwrite df/d13/d2c/d2d/d39/d4f/d58/d5d/f67 [0,4194304] 0 2024-04-12T13:41:58.299 INFO:tasks.workunit.client.0.smithi060.stdout:3/291: readlink d7/da/d3f/d5c/l14 0 2024-04-12T13:41:58.299 INFO:tasks.workunit.client.0.smithi060.stdout:0/269: mkdir d7/d9/d14/d35/d44/d49/d67 0 2024-04-12T13:41:58.301 INFO:tasks.workunit.client.0.smithi060.stdout:1/325: dwrite d1e/d23/d49/d4e/f58 [0,4194304] 0 2024-04-12T13:41:58.305 INFO:tasks.workunit.client.1.smithi110.stdout:1/230: creat de/f58 x:0 0 0 2024-04-12T13:41:58.305 INFO:tasks.workunit.client.1.smithi110.stdout:9/347: rmdir df/d13/d26/d37/d49 39 2024-04-12T13:41:58.306 INFO:tasks.workunit.client.0.smithi060.stdout:4/289: truncate d6/f55 4511557 0 2024-04-12T13:41:58.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/397: mkdir d1/d7/da/dc/d24/d34/d51/d59/d94 0 2024-04-12T13:41:58.308 INFO:tasks.workunit.client.1.smithi110.stdout:5/226: sync 2024-04-12T13:41:58.310 INFO:tasks.workunit.client.0.smithi060.stdout:2/252: creat d6/d13/d17/d21/d43/f4a x:0 0 0 2024-04-12T13:41:58.312 INFO:tasks.workunit.client.0.smithi060.stdout:1/326: mknod d1e/d29/c76 0 2024-04-12T13:41:58.314 INFO:tasks.workunit.client.1.smithi110.stdout:9/348: read df/d13/f1f [3380445,97284] 0 2024-04-12T13:41:58.315 INFO:tasks.workunit.client.0.smithi060.stdout:2/253: write d6/d13/d31/d33/f39 [143593,87539] 0 2024-04-12T13:41:58.316 INFO:tasks.workunit.client.1.smithi110.stdout:5/227: symlink da/db/d3b/l4d 0 2024-04-12T13:41:58.318 INFO:tasks.workunit.client.0.smithi060.stdout:6/398: symlink d1/d7/da/dc/d24/d34/l95 0 2024-04-12T13:41:58.322 INFO:tasks.workunit.client.0.smithi060.stdout:6/399: fdatasync d1/d7/da/dc/d24/d30/d52/f81 0 2024-04-12T13:41:58.325 INFO:tasks.workunit.client.0.smithi060.stdout:2/254: chown d6/f8 1432836 1 2024-04-12T13:41:58.325 INFO:tasks.workunit.client.0.smithi060.stdout:6/400: write d1/d7/da/dc/f7c [2883961,59095] 0 2024-04-12T13:41:58.326 INFO:tasks.workunit.client.1.smithi110.stdout:9/349: creat df/d13/d2c/d2d/d39/d3a/f78 x:0 0 0 2024-04-12T13:41:58.327 INFO:tasks.workunit.client.0.smithi060.stdout:1/327: creat d1e/d23/d49/d4e/f77 x:0 0 0 2024-04-12T13:41:58.328 INFO:tasks.workunit.client.0.smithi060.stdout:4/290: link d6/d7/db/c17 d6/d21/d29/c65 0 2024-04-12T13:41:58.329 INFO:tasks.workunit.client.0.smithi060.stdout:0/270: read d7/f11 [2344110,130891] 0 2024-04-12T13:41:58.329 INFO:tasks.workunit.client.1.smithi110.stdout:9/350: write df/d13/d2c/d2d/f64 [4219682,44775] 0 2024-04-12T13:41:58.333 INFO:tasks.workunit.client.1.smithi110.stdout:9/351: read - df/d13/d2c/d2d/d39/d3a/f62 zero size 2024-04-12T13:41:58.335 INFO:tasks.workunit.client.0.smithi060.stdout:4/291: mknod d6/d21/c66 0 2024-04-12T13:41:58.337 INFO:tasks.workunit.client.1.smithi110.stdout:8/267: write d1/d3/f24 [4640305,48668] 0 2024-04-12T13:41:58.338 INFO:tasks.workunit.client.0.smithi060.stdout:4/292: truncate d6/d7/db/f22 5138912 0 2024-04-12T13:41:58.339 INFO:tasks.workunit.client.0.smithi060.stdout:2/255: mkdir d6/d10/d4b 0 2024-04-12T13:41:58.342 INFO:tasks.workunit.client.0.smithi060.stdout:1/328: dwrite f13 [0,4194304] 0 2024-04-12T13:41:58.342 INFO:tasks.workunit.client.1.smithi110.stdout:9/352: rename df/d13/f5e to df/d13/d2c/d2d/d39/f79 0 2024-04-12T13:41:58.344 INFO:tasks.workunit.client.1.smithi110.stdout:8/268: creat d1/d5/d1f/f56 x:0 0 0 2024-04-12T13:41:58.345 INFO:tasks.workunit.client.0.smithi060.stdout:1/329: truncate d1e/d46/f63 17688 0 2024-04-12T13:41:58.347 INFO:tasks.workunit.client.0.smithi060.stdout:4/293: rename d6/d7/dd/d4d/f58 to d6/d7/db/d5b/f67 0 2024-04-12T13:41:58.349 INFO:tasks.workunit.client.1.smithi110.stdout:7/280: rmdir d1 39 2024-04-12T13:41:58.350 INFO:tasks.workunit.client.0.smithi060.stdout:0/271: creat d7/d9/f68 x:0 0 0 2024-04-12T13:41:58.354 INFO:tasks.workunit.client.1.smithi110.stdout:4/374: fsync d0/d75/f79 0 2024-04-12T13:41:58.354 INFO:tasks.workunit.client.1.smithi110.stdout:8/269: creat d1/d3/d3c/f57 x:0 0 0 2024-04-12T13:41:58.355 INFO:tasks.workunit.client.0.smithi060.stdout:0/272: write d7/d9/f48 [23929,12670] 0 2024-04-12T13:41:58.356 INFO:tasks.workunit.client.1.smithi110.stdout:4/375: chown d0/d13/f2a 29415 1 2024-04-12T13:41:58.356 INFO:tasks.workunit.client.1.smithi110.stdout:8/270: fsync d1/d5/dd/d31/f3d 0 2024-04-12T13:41:58.357 INFO:tasks.workunit.client.0.smithi060.stdout:0/273: fdatasync d7/d9/de/f40 0 2024-04-12T13:41:58.358 INFO:tasks.workunit.client.1.smithi110.stdout:8/271: readlink d1/d7/d20/l26 0 2024-04-12T13:41:58.360 INFO:tasks.workunit.client.0.smithi060.stdout:2/256: dwrite d6/d13/d31/f42 [0,4194304] 0 2024-04-12T13:41:58.360 INFO:tasks.workunit.client.0.smithi060.stdout:0/274: fdatasync d7/d9/d14/d35/d3c/f42 0 2024-04-12T13:41:58.362 INFO:tasks.workunit.client.0.smithi060.stdout:0/275: write d7/f26 [828878,46288] 0 2024-04-12T13:41:58.363 INFO:tasks.workunit.client.0.smithi060.stdout:1/330: mknod d1e/d23/d2e/d30/d51/c78 0 2024-04-12T13:41:58.363 INFO:tasks.workunit.client.0.smithi060.stdout:2/257: fdatasync d6/d13/d31/d33/f49 0 2024-04-12T13:41:58.364 INFO:tasks.workunit.client.1.smithi110.stdout:3/273: dwrite d5/dc/f19 [0,4194304] 0 2024-04-12T13:41:58.365 INFO:tasks.workunit.client.0.smithi060.stdout:0/276: dread - d7/d9/de/f43 zero size 2024-04-12T13:41:58.365 INFO:tasks.workunit.client.0.smithi060.stdout:2/258: stat d6/d13/d17/f1f 0 2024-04-12T13:41:58.369 INFO:tasks.workunit.client.1.smithi110.stdout:7/281: symlink d1/d1b/d33/l5b 0 2024-04-12T13:41:58.373 INFO:tasks.workunit.client.1.smithi110.stdout:4/376: rmdir d0/de/d32/d61 39 2024-04-12T13:41:58.375 INFO:tasks.workunit.client.1.smithi110.stdout:4/377: readlink d0/d19/d1c/d50/l55 0 2024-04-12T13:41:58.376 INFO:tasks.workunit.client.1.smithi110.stdout:9/353: link df/f24 df/d13/d2c/d2d/d39/d4f/d58/f7a 0 2024-04-12T13:41:58.376 INFO:tasks.workunit.client.1.smithi110.stdout:4/378: fsync d0/d19/f2e 0 2024-04-12T13:41:58.380 INFO:tasks.workunit.client.1.smithi110.stdout:3/274: fsync d5/dc/d31/d3b/d32/f56 0 2024-04-12T13:41:58.385 INFO:tasks.workunit.client.1.smithi110.stdout:1/231: link de/d1d/c37 de/d1d/c59 0 2024-04-12T13:41:58.386 INFO:tasks.workunit.client.1.smithi110.stdout:3/275: truncate d5/dc/d20/d2d/f42 575050 0 2024-04-12T13:41:58.390 INFO:tasks.workunit.client.1.smithi110.stdout:3/276: mkdir d5/dc/d20/d61 0 2024-04-12T13:41:58.390 INFO:tasks.workunit.client.1.smithi110.stdout:5/228: write da/d2e/d45/d25/f2c [4790630,13764] 0 2024-04-12T13:41:58.394 INFO:tasks.workunit.client.1.smithi110.stdout:4/379: dwrite d0/d75/f79 [0,4194304] 0 2024-04-12T13:41:58.394 INFO:tasks.workunit.client.1.smithi110.stdout:9/354: dwrite df/d13/d2c/d2d/d39/d3a/f78 [0,4194304] 0 2024-04-12T13:41:58.398 INFO:tasks.workunit.client.1.smithi110.stdout:5/229: rename f8 to da/d35/f4e 0 2024-04-12T13:41:58.399 INFO:tasks.workunit.client.1.smithi110.stdout:1/232: getdents de/d14 0 2024-04-12T13:41:58.403 INFO:tasks.workunit.client.1.smithi110.stdout:9/355: unlink df/f17 0 2024-04-12T13:41:58.407 INFO:tasks.workunit.client.1.smithi110.stdout:3/277: creat d5/dc/d20/d61/f62 x:0 0 0 2024-04-12T13:41:58.407 INFO:tasks.workunit.client.1.smithi110.stdout:1/233: mknod de/d15/c5a 0 2024-04-12T13:41:58.410 INFO:tasks.workunit.client.1.smithi110.stdout:4/380: dread d0/d13/f52 [0,4194304] 0 2024-04-12T13:41:58.410 INFO:tasks.workunit.client.1.smithi110.stdout:5/230: mkdir da/d4f 0 2024-04-12T13:41:58.410 INFO:tasks.workunit.client.1.smithi110.stdout:1/234: stat de/d15/d32/f39 0 2024-04-12T13:41:58.413 INFO:tasks.workunit.client.1.smithi110.stdout:9/356: dread fa [0,4194304] 0 2024-04-12T13:41:58.413 INFO:tasks.workunit.client.1.smithi110.stdout:5/231: chown da/d2e/d45/d25/f2a 37326959 1 2024-04-12T13:41:58.414 INFO:tasks.workunit.client.1.smithi110.stdout:8/272: truncate d1/d3/fe 6354368 0 2024-04-12T13:41:58.414 INFO:tasks.workunit.client.1.smithi110.stdout:1/235: creat de/f5b x:0 0 0 2024-04-12T13:41:58.417 INFO:tasks.workunit.client.1.smithi110.stdout:8/273: truncate d1/d5/d1f/f56 406226 0 2024-04-12T13:41:58.418 INFO:tasks.workunit.client.1.smithi110.stdout:5/232: creat da/d2e/d45/d29/f50 x:0 0 0 2024-04-12T13:41:58.419 INFO:tasks.workunit.client.1.smithi110.stdout:8/274: truncate d1/d5/f4a 295385 0 2024-04-12T13:41:58.420 INFO:tasks.workunit.client.1.smithi110.stdout:5/233: write da/db/f4a [1060989,85054] 0 2024-04-12T13:41:58.423 INFO:tasks.workunit.client.1.smithi110.stdout:9/357: creat df/d13/d2c/d2d/d39/d4f/d58/d63/d72/f7b x:0 0 0 2024-04-12T13:41:58.426 INFO:tasks.workunit.client.1.smithi110.stdout:5/234: creat da/d2e/d45/d29/d32/f51 x:0 0 0 2024-04-12T13:41:58.426 INFO:tasks.workunit.client.1.smithi110.stdout:8/275: mknod d1/d3/d35/c58 0 2024-04-12T13:41:58.427 INFO:tasks.workunit.client.1.smithi110.stdout:3/278: truncate d5/dc/d20/d2d/f35 486510 0 2024-04-12T13:41:58.428 INFO:tasks.workunit.client.1.smithi110.stdout:5/235: chown da/db/l34 14 1 2024-04-12T13:41:58.428 INFO:tasks.workunit.client.1.smithi110.stdout:4/381: truncate d0/d13/f2d 4762380 0 2024-04-12T13:41:58.430 INFO:tasks.workunit.client.1.smithi110.stdout:9/358: write df/d13/d2c/d2d/d39/d3a/d4e/f5b [3298758,91305] 0 2024-04-12T13:41:58.430 INFO:tasks.workunit.client.1.smithi110.stdout:8/276: fsync d1/d5/f4a 0 2024-04-12T13:41:58.432 INFO:tasks.workunit.client.1.smithi110.stdout:4/382: chown d0/d78 5340652 1 2024-04-12T13:41:58.433 INFO:tasks.workunit.client.1.smithi110.stdout:5/236: read da/d35/f4e [969285,33732] 0 2024-04-12T13:41:58.436 INFO:tasks.workunit.client.1.smithi110.stdout:2/306: sync 2024-04-12T13:41:58.436 INFO:tasks.workunit.client.1.smithi110.stdout:0/223: sync 2024-04-12T13:41:58.436 INFO:tasks.workunit.client.1.smithi110.stdout:6/305: sync 2024-04-12T13:41:58.436 INFO:tasks.workunit.client.1.smithi110.stdout:3/279: write d5/dc/d31/d3b/d32/d3e/f41 [464416,66407] 0 2024-04-12T13:41:58.438 INFO:tasks.workunit.client.1.smithi110.stdout:4/383: getdents d0/d78 0 2024-04-12T13:41:58.441 INFO:tasks.workunit.client.1.smithi110.stdout:1/236: dwrite de/d1d/f42 [0,4194304] 0 2024-04-12T13:41:58.441 INFO:tasks.workunit.client.1.smithi110.stdout:0/224: stat d1/d27/d31/f49 0 2024-04-12T13:41:58.442 INFO:tasks.workunit.client.0.smithi060.stdout:4/294: mkdir d6/d7/dd/d1a/d57/d63/d68 0 2024-04-12T13:41:58.443 INFO:tasks.workunit.client.0.smithi060.stdout:1/331: creat d1e/d23/f79 x:0 0 0 2024-04-12T13:41:58.443 INFO:tasks.workunit.client.1.smithi110.stdout:2/307: dread - d6/dc/d1b/f4e zero size 2024-04-12T13:41:58.444 INFO:tasks.workunit.client.0.smithi060.stdout:1/332: stat d1e/f45 0 2024-04-12T13:41:58.444 INFO:tasks.workunit.client.0.smithi060.stdout:2/259: creat d6/d10/d2b/d35/f4c x:0 0 0 2024-04-12T13:41:58.445 INFO:tasks.workunit.client.1.smithi110.stdout:0/225: truncate d1/d8/f3d 899678 0 2024-04-12T13:41:58.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/333: read d1e/d46/f6f [620479,33966] 0 2024-04-12T13:41:58.446 INFO:tasks.workunit.client.1.smithi110.stdout:6/306: creat d7/d10/d1c/d2b/d48/f5e x:0 0 0 2024-04-12T13:41:58.448 INFO:tasks.workunit.client.0.smithi060.stdout:0/277: rename d7/l16 to d7/d9/d14/d35/d3c/l69 0 2024-04-12T13:41:58.449 INFO:tasks.workunit.client.1.smithi110.stdout:8/277: truncate d1/d3/d35/d3a/d3e/f49 625037 0 2024-04-12T13:41:58.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/260: symlink d6/d13/d31/l4d 0 2024-04-12T13:41:58.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/278: chown d7/f26 2477294 1 2024-04-12T13:41:58.455 INFO:tasks.workunit.client.1.smithi110.stdout:4/384: rename d0/l9 to d0/d19/d1c/d50/l7b 0 2024-04-12T13:41:58.456 INFO:tasks.workunit.client.1.smithi110.stdout:9/359: dwrite df/d13/d26/f28 [4194304,4194304] 0 2024-04-12T13:41:58.457 INFO:tasks.workunit.client.1.smithi110.stdout:3/280: fsync d5/f40 0 2024-04-12T13:41:58.458 INFO:tasks.workunit.client.0.smithi060.stdout:2/261: creat d6/d10/d2b/d35/f4e x:0 0 0 2024-04-12T13:41:58.459 INFO:tasks.workunit.client.1.smithi110.stdout:9/360: stat df/d13/f1c 0 2024-04-12T13:41:58.460 INFO:tasks.workunit.client.0.smithi060.stdout:1/334: creat d1e/d29/d65/f7a x:0 0 0 2024-04-12T13:41:58.460 INFO:tasks.workunit.client.1.smithi110.stdout:5/237: dwrite da/d35/f4e [4194304,4194304] 0 2024-04-12T13:41:58.463 INFO:tasks.workunit.client.1.smithi110.stdout:5/238: stat da/d2e/d45/d29/f50 0 2024-04-12T13:41:58.463 INFO:tasks.workunit.client.0.smithi060.stdout:2/262: readlink d6/d13/d31/d33/l45 0 2024-04-12T13:41:58.466 INFO:tasks.workunit.client.1.smithi110.stdout:6/307: creat d7/d25/d30/d44/d3d/f5f x:0 0 0 2024-04-12T13:41:58.467 INFO:tasks.workunit.client.1.smithi110.stdout:8/278: dread d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:58.469 INFO:tasks.workunit.client.1.smithi110.stdout:7/282: sync 2024-04-12T13:41:58.470 INFO:tasks.workunit.client.0.smithi060.stdout:2/263: mknod d6/d13/d31/d33/c4f 0 2024-04-12T13:41:58.473 INFO:tasks.workunit.client.1.smithi110.stdout:4/385: creat d0/de/d32/d5f/f7c x:0 0 0 2024-04-12T13:41:58.475 INFO:tasks.workunit.client.1.smithi110.stdout:9/361: rename df/c16 to df/d38/d6e/c7c 0 2024-04-12T13:41:58.475 INFO:tasks.workunit.client.1.smithi110.stdout:1/237: creat de/d14/d34/d55/f5c x:0 0 0 2024-04-12T13:41:58.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/279: dwrite d7/d9/f21 [0,4194304] 0 2024-04-12T13:41:58.478 INFO:tasks.workunit.client.1.smithi110.stdout:9/362: chown df/d13/d2c/d2d/d39/d3a/d4e/f5b 3 1 2024-04-12T13:41:58.479 INFO:tasks.workunit.client.1.smithi110.stdout:5/239: mkdir da/db/d52 0 2024-04-12T13:41:58.482 INFO:tasks.workunit.client.1.smithi110.stdout:8/279: unlink d1/d7/f1d 0 2024-04-12T13:41:58.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/335: dwrite d1e/d29/f6c [0,4194304] 0 2024-04-12T13:41:58.489 INFO:tasks.workunit.client.1.smithi110.stdout:5/240: dread da/d2e/d45/d25/f2c [0,4194304] 0 2024-04-12T13:41:58.490 INFO:tasks.workunit.client.0.smithi060.stdout:0/280: mkdir d7/d9/d6a 0 2024-04-12T13:41:58.495 INFO:tasks.workunit.client.1.smithi110.stdout:2/308: dwrite d6/dc/d1b/f2a [0,4194304] 0 2024-04-12T13:41:58.496 INFO:tasks.workunit.client.1.smithi110.stdout:7/283: rename d1/f5 to d1/d3/d4/d36/f5c 0 2024-04-12T13:41:58.498 INFO:tasks.workunit.client.1.smithi110.stdout:2/309: write d6/dc/dd/fe [4648569,99304] 0 2024-04-12T13:41:58.500 INFO:tasks.workunit.client.0.smithi060.stdout:2/264: dwrite d6/f25 [0,4194304] 0 2024-04-12T13:41:58.503 INFO:tasks.workunit.client.1.smithi110.stdout:1/238: mknod de/d14/d34/d55/c5d 0 2024-04-12T13:41:58.503 INFO:tasks.workunit.client.1.smithi110.stdout:1/239: stat de/d15/c17 0 2024-04-12T13:41:58.505 INFO:tasks.workunit.client.1.smithi110.stdout:3/281: truncate d5/dc/d20/f2a 1768548 0 2024-04-12T13:41:58.507 INFO:tasks.workunit.client.1.smithi110.stdout:9/363: fdatasync df/d13/f1c 0 2024-04-12T13:41:58.507 INFO:tasks.workunit.client.1.smithi110.stdout:1/240: write de/d15/f3e [51439,70314] 0 2024-04-12T13:41:58.508 INFO:tasks.workunit.client.0.smithi060.stdout:1/336: link d1e/d1f/f6e d1e/d1f/f7b 0 2024-04-12T13:41:58.510 INFO:tasks.workunit.client.1.smithi110.stdout:1/241: readlink de/d14/l36 0 2024-04-12T13:41:58.511 INFO:tasks.workunit.client.0.smithi060.stdout:2/265: creat d6/d13/d17/d21/d43/f50 x:0 0 0 2024-04-12T13:41:58.511 INFO:tasks.workunit.client.0.smithi060.stdout:1/337: chown d1e/d46/f48 3 1 2024-04-12T13:41:58.512 INFO:tasks.workunit.client.1.smithi110.stdout:1/242: chown de/d15 185823 1 2024-04-12T13:41:58.512 INFO:tasks.workunit.client.1.smithi110.stdout:8/280: mknod d1/d3/d35/d3a/d41/c59 0 2024-04-12T13:41:58.513 INFO:tasks.workunit.client.1.smithi110.stdout:6/308: link d7/d25/d2c/f40 d7/d25/d2c/f60 0 2024-04-12T13:41:58.513 INFO:tasks.workunit.client.1.smithi110.stdout:1/243: chown de/l43 312104 1 2024-04-12T13:41:58.514 INFO:tasks.workunit.client.1.smithi110.stdout:8/281: dread - d1/d3/d3c/f2f zero size 2024-04-12T13:41:58.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/281: creat d7/d9/d14/d35/f6b x:0 0 0 2024-04-12T13:41:58.517 INFO:tasks.workunit.client.1.smithi110.stdout:0/226: getdents d1/d8 0 2024-04-12T13:41:58.522 INFO:tasks.workunit.client.1.smithi110.stdout:5/241: mknod da/d2e/d45/d29/d32/c53 0 2024-04-12T13:41:58.526 INFO:tasks.workunit.client.1.smithi110.stdout:3/282: dwrite d5/dc/d31/f45 [0,4194304] 0 2024-04-12T13:41:58.531 INFO:tasks.workunit.client.1.smithi110.stdout:7/284: mkdir d1/d31/d5d 0 2024-04-12T13:41:58.532 INFO:tasks.workunit.client.1.smithi110.stdout:7/285: read - d1/d31/f59 zero size 2024-04-12T13:41:58.532 INFO:tasks.workunit.client.0.smithi060.stdout:1/338: creat d1e/f7c x:0 0 0 2024-04-12T13:41:58.537 INFO:tasks.workunit.client.0.smithi060.stdout:1/339: rmdir d1e/d23/d49 39 2024-04-12T13:41:58.537 INFO:tasks.workunit.client.0.smithi060.stdout:2/266: getdents d6/d13/d17/d21 0 2024-04-12T13:41:58.539 INFO:tasks.workunit.client.1.smithi110.stdout:9/364: dread df/d13/d2c/d2d/d39/f79 [0,4194304] 0 2024-04-12T13:41:58.541 INFO:tasks.workunit.client.1.smithi110.stdout:4/386: creat d0/de/d32/f7d x:0 0 0 2024-04-12T13:41:58.543 INFO:tasks.workunit.client.1.smithi110.stdout:5/242: dwrite da/f21 [4194304,4194304] 0 2024-04-12T13:41:58.544 INFO:tasks.workunit.client.1.smithi110.stdout:9/365: write df/d13/d2c/d2d/d39/d3a/f62 [879190,46526] 0 2024-04-12T13:41:58.546 INFO:tasks.workunit.client.1.smithi110.stdout:0/227: dread d1/d8/fb [0,4194304] 0 2024-04-12T13:41:58.547 INFO:tasks.workunit.client.0.smithi060.stdout:2/267: getdents d6/d10/d16/d36 0 2024-04-12T13:41:58.547 INFO:tasks.workunit.client.1.smithi110.stdout:0/228: fsync d1/d27/f32 0 2024-04-12T13:41:58.549 INFO:tasks.workunit.client.1.smithi110.stdout:2/310: getdents d6/dc/dd/d49 0 2024-04-12T13:41:58.553 INFO:tasks.workunit.client.1.smithi110.stdout:9/366: dread df/f34 [0,4194304] 0 2024-04-12T13:41:58.554 INFO:tasks.workunit.client.0.smithi060.stdout:0/282: dwrite d7/d9/f2b [0,4194304] 0 2024-04-12T13:41:58.557 INFO:tasks.workunit.client.1.smithi110.stdout:3/283: rename d5/l1d to d5/dc/d31/d3b/d32/l63 0 2024-04-12T13:41:58.557 INFO:tasks.workunit.client.1.smithi110.stdout:0/229: unlink d1/d8/f20 0 2024-04-12T13:41:58.558 INFO:tasks.workunit.client.1.smithi110.stdout:7/286: mknod d1/d1b/c5e 0 2024-04-12T13:41:58.560 INFO:tasks.workunit.client.1.smithi110.stdout:7/287: stat d1/d3/d4/d36/d4b/f3b 0 2024-04-12T13:41:58.562 INFO:tasks.workunit.client.1.smithi110.stdout:6/309: creat d7/d25/d30/d44/f61 x:0 0 0 2024-04-12T13:41:58.563 INFO:tasks.workunit.client.0.smithi060.stdout:1/340: write d1e/d23/f25 [3640459,62935] 0 2024-04-12T13:41:58.564 INFO:tasks.workunit.client.1.smithi110.stdout:4/387: mkdir d0/d19/d26/d65/d7e 0 2024-04-12T13:41:58.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/341: write d1e/f7c [879444,48382] 0 2024-04-12T13:41:58.566 INFO:tasks.workunit.client.0.smithi060.stdout:2/268: dread d6/f25 [0,4194304] 0 2024-04-12T13:41:58.572 INFO:tasks.workunit.client.1.smithi110.stdout:6/310: write d7/d25/d2c/f57 [70290,83011] 0 2024-04-12T13:41:58.572 INFO:tasks.workunit.client.1.smithi110.stdout:8/282: getdents d1/d7 0 2024-04-12T13:41:58.572 INFO:tasks.workunit.client.1.smithi110.stdout:7/288: mknod d1/d3/d4/d36/d4b/c5f 0 2024-04-12T13:41:58.573 INFO:tasks.workunit.client.1.smithi110.stdout:6/311: readlink d7/d25/d2c/l2e 0 2024-04-12T13:41:58.574 INFO:tasks.workunit.client.1.smithi110.stdout:2/311: dwrite d6/dc/dd/f16 [0,4194304] 0 2024-04-12T13:41:58.574 INFO:tasks.workunit.client.1.smithi110.stdout:1/244: getdents de/d14/d34 0 2024-04-12T13:41:58.576 INFO:tasks.workunit.client.0.smithi060.stdout:1/342: mknod d1e/d23/d2e/d30/d51/c7d 0 2024-04-12T13:41:58.576 INFO:tasks.workunit.client.1.smithi110.stdout:7/289: chown d1/d3/d4/l14 7328199 1 2024-04-12T13:41:58.578 INFO:tasks.workunit.client.1.smithi110.stdout:4/388: creat d0/de/f7f x:0 0 0 2024-04-12T13:41:58.578 INFO:tasks.workunit.client.1.smithi110.stdout:6/312: write d7/d10/d1c/f43 [851540,115686] 0 2024-04-12T13:41:58.579 INFO:tasks.workunit.client.0.smithi060.stdout:2/269: creat d6/d13/d17/d21/f51 x:0 0 0 2024-04-12T13:41:58.579 INFO:tasks.workunit.client.0.smithi060.stdout:1/343: fsync d1e/d29/d37/f66 0 2024-04-12T13:41:58.580 INFO:tasks.workunit.client.0.smithi060.stdout:0/283: dwrite d7/d9/f68 [0,4194304] 0 2024-04-12T13:41:58.581 INFO:tasks.workunit.client.1.smithi110.stdout:8/283: rmdir d1/d7/d20 39 2024-04-12T13:41:58.583 INFO:tasks.workunit.client.1.smithi110.stdout:1/245: truncate de/d15/f3e 363154 0 2024-04-12T13:41:58.587 INFO:tasks.workunit.client.0.smithi060.stdout:0/284: rmdir d7/d41 39 2024-04-12T13:41:58.587 INFO:tasks.workunit.client.1.smithi110.stdout:4/389: chown d0/d19/f62 10 1 2024-04-12T13:41:58.589 INFO:tasks.workunit.client.1.smithi110.stdout:6/313: chown d7/d25/d30/d44/f2d 0 1 2024-04-12T13:41:58.589 INFO:tasks.workunit.client.1.smithi110.stdout:5/243: dread f1 [0,4194304] 0 2024-04-12T13:41:58.590 INFO:tasks.workunit.client.0.smithi060.stdout:2/270: rename d6/f32 to d6/d10/d2b/d35/f52 0 2024-04-12T13:41:58.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/344: mknod d1e/d23/c7e 0 2024-04-12T13:41:58.593 INFO:tasks.workunit.client.1.smithi110.stdout:5/244: chown da/db/d15/f24 1597149091 1 2024-04-12T13:41:58.594 INFO:tasks.workunit.client.1.smithi110.stdout:3/284: dread d5/dc/f53 [0,4194304] 0 2024-04-12T13:41:58.594 INFO:tasks.workunit.client.1.smithi110.stdout:7/290: write d1/d3/d4/f30 [4173306,61355] 0 2024-04-12T13:41:58.596 INFO:tasks.workunit.client.1.smithi110.stdout:2/312: getdents d6/dc/dd/d49 0 2024-04-12T13:41:58.600 INFO:tasks.workunit.client.0.smithi060.stdout:1/345: creat d1e/d29/d65/f7f x:0 0 0 2024-04-12T13:41:58.601 INFO:tasks.workunit.client.1.smithi110.stdout:1/246: mkdir de/d15/d32/d5e 0 2024-04-12T13:41:58.601 INFO:tasks.workunit.client.1.smithi110.stdout:3/285: fdatasync d5/dc/d31/d3b/d32/f37 0 2024-04-12T13:41:58.601 INFO:tasks.workunit.client.1.smithi110.stdout:9/367: link df/d13/d26/d37/d49/f55 df/d13/d2c/d2d/d39/d4f/d58/f7d 0 2024-04-12T13:41:58.602 INFO:tasks.workunit.client.0.smithi060.stdout:2/271: mknod d6/d10/d4b/c53 0 2024-04-12T13:41:58.604 INFO:tasks.workunit.client.0.smithi060.stdout:2/272: chown d6/d13/d17/d21/d43 0 1 2024-04-12T13:41:58.605 INFO:tasks.workunit.client.1.smithi110.stdout:9/368: read df/d13/f27 [2441104,71495] 0 2024-04-12T13:41:58.608 INFO:tasks.workunit.client.1.smithi110.stdout:5/245: rmdir da/d2e/d45/d29/d32 39 2024-04-12T13:41:58.609 INFO:tasks.workunit.client.1.smithi110.stdout:2/313: rmdir d6/d18/d19 39 2024-04-12T13:41:58.611 INFO:tasks.workunit.client.0.smithi060.stdout:1/346: symlink d1e/d23/d49/d4e/l80 0 2024-04-12T13:41:58.613 INFO:tasks.workunit.client.0.smithi060.stdout:2/273: rename d6/d13/d17/f1f to d6/d13/d17/d21/f54 0 2024-04-12T13:41:58.614 INFO:tasks.workunit.client.0.smithi060.stdout:0/285: dwrite d7/d9/d14/d1b/f2a [0,4194304] 0 2024-04-12T13:41:58.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/274: write f3 [1269844,84778] 0 2024-04-12T13:41:58.617 INFO:tasks.workunit.client.0.smithi060.stdout:2/275: readlink d6/d13/d31/d33/l45 0 2024-04-12T13:41:58.619 INFO:tasks.workunit.client.1.smithi110.stdout:0/230: truncate d1/d8/f10 4391990 0 2024-04-12T13:41:58.619 INFO:tasks.workunit.client.0.smithi060.stdout:2/276: write d6/d10/d16/f1c [3782354,85716] 0 2024-04-12T13:41:58.626 INFO:tasks.workunit.client.1.smithi110.stdout:2/314: dread d6/dc/dd/f1f [0,4194304] 0 2024-04-12T13:41:58.629 INFO:tasks.workunit.client.1.smithi110.stdout:3/286: dread d5/f40 [0,4194304] 0 2024-04-12T13:41:58.634 INFO:tasks.workunit.client.1.smithi110.stdout:0/231: mkdir d1/d27/d43/d4a 0 2024-04-12T13:41:58.634 INFO:tasks.workunit.client.1.smithi110.stdout:4/390: link d0/ld d0/d78/l80 0 2024-04-12T13:41:58.638 INFO:tasks.workunit.client.1.smithi110.stdout:2/315: dread d6/dc/dd/f24 [0,4194304] 0 2024-04-12T13:41:58.639 INFO:tasks.workunit.client.1.smithi110.stdout:5/246: creat da/d2e/d45/d29/d32/f54 x:0 0 0 2024-04-12T13:41:58.640 INFO:tasks.workunit.client.1.smithi110.stdout:3/287: mknod d5/dc/d31/d3b/d32/c64 0 2024-04-12T13:41:58.641 INFO:tasks.workunit.client.1.smithi110.stdout:7/291: truncate d1/d3/d4/f2e 2514143 0 2024-04-12T13:41:58.642 INFO:tasks.workunit.client.1.smithi110.stdout:9/369: link df/d13/d2c/d2d/d39/d3a/d4e/f74 df/d13/d2c/d2d/d39/d4f/d58/d5d/f7e 0 2024-04-12T13:41:58.643 INFO:tasks.workunit.client.1.smithi110.stdout:0/232: mknod d1/d27/d31/c4b 0 2024-04-12T13:41:58.644 INFO:tasks.workunit.client.1.smithi110.stdout:1/247: getdents de/d14/d34 0 2024-04-12T13:41:58.644 INFO:tasks.workunit.client.1.smithi110.stdout:6/314: getdents d7/d10/d1c/d2b/d48 0 2024-04-12T13:41:58.646 INFO:tasks.workunit.client.1.smithi110.stdout:0/233: write d1/d27/d31/f49 [841321,25691] 0 2024-04-12T13:41:58.646 INFO:tasks.workunit.client.1.smithi110.stdout:3/288: creat d5/dc/d31/d3b/d32/f65 x:0 0 0 2024-04-12T13:41:58.648 INFO:tasks.workunit.client.1.smithi110.stdout:2/316: write d6/d18/d19/d25/f40 [964251,117604] 0 2024-04-12T13:41:58.648 INFO:tasks.workunit.client.1.smithi110.stdout:9/370: mkdir df/d38/d6e/d7f 0 2024-04-12T13:41:58.649 INFO:tasks.workunit.client.1.smithi110.stdout:4/391: creat d0/d78/f81 x:0 0 0 2024-04-12T13:41:58.649 INFO:tasks.workunit.client.1.smithi110.stdout:5/247: mkdir da/d55 0 2024-04-12T13:41:58.650 INFO:tasks.workunit.client.1.smithi110.stdout:1/248: rename de/f26 to de/d14/d34/f5f 0 2024-04-12T13:41:58.651 INFO:tasks.workunit.client.1.smithi110.stdout:7/292: creat d1/d3/d4/d55/d56/f60 x:0 0 0 2024-04-12T13:41:58.680 INFO:tasks.workunit.client.1.smithi110.stdout:5/248: read - da/db/d3b/d40/f47 zero size 2024-04-12T13:41:58.680 INFO:tasks.workunit.client.1.smithi110.stdout:1/249: rmdir de/d14 39 2024-04-12T13:41:58.680 INFO:tasks.workunit.client.1.smithi110.stdout:3/289: creat d5/dc/d20/d2d/d4e/f66 x:0 0 0 2024-04-12T13:41:58.681 INFO:tasks.workunit.client.0.smithi060.stdout:1/347: getdents d1e/d23/d2e/d5e 0 2024-04-12T13:41:58.681 INFO:tasks.workunit.client.1.smithi110.stdout:2/317: rename d6/d18/f4d to d6/dc/dd/f54 0 2024-04-12T13:41:58.681 INFO:tasks.workunit.client.1.smithi110.stdout:1/250: fdatasync de/f5b 0 2024-04-12T13:41:58.683 INFO:tasks.workunit.client.1.smithi110.stdout:7/293: symlink d1/l61 0 2024-04-12T13:41:58.684 INFO:tasks.workunit.client.0.smithi060.stdout:2/277: getdents d6/d13/d31/d33 0 2024-04-12T13:41:58.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/286: dwrite d7/d9/d14/d1b/f3b [0,4194304] 0 2024-04-12T13:41:58.688 INFO:tasks.workunit.client.0.smithi060.stdout:2/278: write d6/d13/d31/d33/f39 [1235610,6805] 0 2024-04-12T13:41:58.690 INFO:tasks.workunit.client.0.smithi060.stdout:1/348: link d1e/f28 d1e/d23/d2e/d30/d51/f81 0 2024-04-12T13:41:58.692 INFO:tasks.workunit.client.1.smithi110.stdout:3/290: creat d5/dc/f67 x:0 0 0 2024-04-12T13:41:58.693 INFO:tasks.workunit.client.1.smithi110.stdout:3/291: write d5/dc/f11 [295670,50334] 0 2024-04-12T13:41:58.696 INFO:tasks.workunit.client.1.smithi110.stdout:4/392: rename d0/d19/l44 to d0/de/d2c/l82 0 2024-04-12T13:41:58.696 INFO:tasks.workunit.client.0.smithi060.stdout:2/279: mkdir d6/d13/d17/d21/d55 0 2024-04-12T13:41:58.697 INFO:tasks.workunit.client.1.smithi110.stdout:5/249: dread da/db/f37 [0,4194304] 0 2024-04-12T13:41:58.698 INFO:tasks.workunit.client.1.smithi110.stdout:3/292: chown d5/dc/c3a 44260 1 2024-04-12T13:41:58.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/287: symlink d7/d9/l6c 0 2024-04-12T13:41:58.699 INFO:tasks.workunit.client.0.smithi060.stdout:2/280: fsync d6/d10/d2b/d35/f48 0 2024-04-12T13:41:58.701 INFO:tasks.workunit.client.1.smithi110.stdout:7/294: creat d1/d3/d4/d55/f62 x:0 0 0 2024-04-12T13:41:58.704 INFO:tasks.workunit.client.1.smithi110.stdout:6/315: dread d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:41:58.704 INFO:tasks.workunit.client.1.smithi110.stdout:7/295: stat d1/d3/d4/f27 0 2024-04-12T13:41:58.706 INFO:tasks.workunit.client.1.smithi110.stdout:9/371: dwrite df/d13/d2c/d2d/d39/d3a/d4e/f57 [0,4194304] 0 2024-04-12T13:41:58.709 INFO:tasks.workunit.client.1.smithi110.stdout:1/251: dwrite de/f2f [0,4194304] 0 2024-04-12T13:41:58.709 INFO:tasks.workunit.client.1.smithi110.stdout:7/296: write d1/d3/d4/f52 [279974,31162] 0 2024-04-12T13:41:58.710 INFO:tasks.workunit.client.0.smithi060.stdout:1/349: dwrite d1e/d23/d2e/d30/f52 [0,4194304] 0 2024-04-12T13:41:58.713 INFO:tasks.workunit.client.1.smithi110.stdout:2/318: dread d6/dc/f14 [0,4194304] 0 2024-04-12T13:41:58.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/350: truncate d1e/d29/d65/f7f 167400 0 2024-04-12T13:41:58.713 INFO:tasks.workunit.client.1.smithi110.stdout:1/252: write de/f58 [748417,4414] 0 2024-04-12T13:41:58.717 INFO:tasks.workunit.client.1.smithi110.stdout:4/393: mknod d0/d19/d26/c83 0 2024-04-12T13:41:58.720 INFO:tasks.workunit.client.0.smithi060.stdout:0/288: getdents d7/d9 0 2024-04-12T13:41:58.723 INFO:tasks.workunit.client.0.smithi060.stdout:2/281: write d6/f8 [2626,9732] 0 2024-04-12T13:41:58.724 INFO:tasks.workunit.client.1.smithi110.stdout:7/297: creat d1/d1b/d3d/f63 x:0 0 0 2024-04-12T13:41:58.725 INFO:tasks.workunit.client.1.smithi110.stdout:2/319: read d6/d18/d19/d25/f40 [163277,17379] 0 2024-04-12T13:41:58.725 INFO:tasks.workunit.client.1.smithi110.stdout:9/372: mknod df/d13/d3b/d40/c80 0 2024-04-12T13:41:58.726 INFO:tasks.workunit.client.1.smithi110.stdout:7/298: fsync d1/f2a 0 2024-04-12T13:41:58.727 INFO:tasks.workunit.client.0.smithi060.stdout:2/282: stat d6/d10/d16/d36 0 2024-04-12T13:41:58.728 INFO:tasks.workunit.client.1.smithi110.stdout:3/293: dwrite d5/dc/f24 [0,4194304] 0 2024-04-12T13:41:58.729 INFO:tasks.workunit.client.0.smithi060.stdout:1/351: write d1e/d23/d2e/d30/d51/f81 [1237979,88756] 0 2024-04-12T13:41:58.731 INFO:tasks.workunit.client.0.smithi060.stdout:0/289: read d7/fa [675578,103211] 0 2024-04-12T13:41:58.732 INFO:tasks.workunit.client.1.smithi110.stdout:4/394: rename d0/de/d6e to d0/d75/d84 0 2024-04-12T13:41:58.735 INFO:tasks.workunit.client.1.smithi110.stdout:6/316: write d7/d25/d2c/f60 [1558560,111287] 0 2024-04-12T13:41:58.735 INFO:tasks.workunit.client.1.smithi110.stdout:4/395: chown d0/d19/d1c/d50 32 1 2024-04-12T13:41:58.736 INFO:tasks.workunit.client.1.smithi110.stdout:3/294: dread d5/dc/d20/d2d/f35 [0,4194304] 0 2024-04-12T13:41:58.739 INFO:tasks.workunit.client.0.smithi060.stdout:0/290: mknod d7/d9/d14/d35/d44/c6d 0 2024-04-12T13:41:58.741 INFO:tasks.workunit.client.1.smithi110.stdout:5/250: creat da/d2e/f56 x:0 0 0 2024-04-12T13:41:58.742 INFO:tasks.workunit.client.1.smithi110.stdout:7/299: mknod d1/d3/d4/d55/d56/c64 0 2024-04-12T13:41:58.744 INFO:tasks.workunit.client.1.smithi110.stdout:2/320: mkdir d6/d18/d19/d4a/d55 0 2024-04-12T13:41:58.746 INFO:tasks.workunit.client.1.smithi110.stdout:2/321: read - d6/dc/f3f zero size 2024-04-12T13:41:58.747 INFO:tasks.workunit.client.0.smithi060.stdout:0/291: mknod d7/d9/d14/d35/d3c/c6e 0 2024-04-12T13:41:58.751 INFO:tasks.workunit.client.0.smithi060.stdout:2/283: rename d6/d13/d17/d21 to d6/d56 0 2024-04-12T13:41:58.752 INFO:tasks.workunit.client.1.smithi110.stdout:4/396: rename d0/d19/f20 to d0/d19/f85 0 2024-04-12T13:41:58.753 INFO:tasks.workunit.client.0.smithi060.stdout:1/352: dwrite d1e/d23/d2e/f64 [4194304,4194304] 0 2024-04-12T13:41:58.757 INFO:tasks.workunit.client.1.smithi110.stdout:1/253: dwrite f6 [0,4194304] 0 2024-04-12T13:41:58.757 INFO:tasks.workunit.client.1.smithi110.stdout:7/300: creat d1/d3/d4/d55/f65 x:0 0 0 2024-04-12T13:41:58.761 INFO:tasks.workunit.client.0.smithi060.stdout:1/353: rename d1e/d29/d37/f66 to d1e/d46/f82 0 2024-04-12T13:41:58.766 INFO:tasks.workunit.client.0.smithi060.stdout:2/284: creat d6/d10/f57 x:0 0 0 2024-04-12T13:41:58.766 INFO:tasks.workunit.client.1.smithi110.stdout:8/284: sync 2024-04-12T13:41:58.768 INFO:tasks.workunit.client.1.smithi110.stdout:9/373: truncate df/d13/d2c/d2d/d39/d4f/d58/d5d/f67 983582 0 2024-04-12T13:41:58.770 INFO:tasks.workunit.client.1.smithi110.stdout:1/254: fdatasync de/d14/f53 0 2024-04-12T13:41:58.771 INFO:tasks.workunit.client.1.smithi110.stdout:6/317: rename d7/d25/d2c/f60 to d7/d10/f62 0 2024-04-12T13:41:58.772 INFO:tasks.workunit.client.1.smithi110.stdout:2/322: symlink d6/d18/d19/d4a/d55/l56 0 2024-04-12T13:41:58.773 INFO:tasks.workunit.client.1.smithi110.stdout:8/285: mkdir d1/d3/d3c/d5a 0 2024-04-12T13:41:58.775 INFO:tasks.workunit.client.0.smithi060.stdout:1/354: unlink d1e/d23/d2e/f64 0 2024-04-12T13:41:58.775 INFO:tasks.workunit.client.1.smithi110.stdout:8/286: write d1/d5/f4a [213815,43467] 0 2024-04-12T13:41:58.776 INFO:tasks.workunit.client.1.smithi110.stdout:4/397: mknod d0/de/d32/d61/c86 0 2024-04-12T13:41:58.776 INFO:tasks.workunit.client.1.smithi110.stdout:3/295: dread d5/dc/d20/f36 [0,4194304] 0 2024-04-12T13:41:58.779 INFO:tasks.workunit.client.1.smithi110.stdout:4/398: write d0/fc [5151236,94616] 0 2024-04-12T13:41:58.779 INFO:tasks.workunit.client.1.smithi110.stdout:5/251: rename da/db/ld to da/d2e/d45/d29/d32/l57 0 2024-04-12T13:41:58.781 INFO:tasks.workunit.client.1.smithi110.stdout:5/252: write f9 [9056851,36268] 0 2024-04-12T13:41:58.781 INFO:tasks.workunit.client.0.smithi060.stdout:1/355: creat d1e/d23/d49/f83 x:0 0 0 2024-04-12T13:41:58.782 INFO:tasks.workunit.client.1.smithi110.stdout:4/399: chown d0/de/d2c/f3d 1 1 2024-04-12T13:41:58.787 INFO:tasks.workunit.client.1.smithi110.stdout:6/318: mknod d7/d25/d30/d44/d3d/c63 0 2024-04-12T13:41:58.787 INFO:tasks.workunit.client.0.smithi060.stdout:1/356: mknod d1e/d23/d2e/d5e/c84 0 2024-04-12T13:41:58.789 INFO:tasks.workunit.client.1.smithi110.stdout:8/287: mknod d1/d3/d35/d3a/c5b 0 2024-04-12T13:41:58.790 INFO:tasks.workunit.client.1.smithi110.stdout:8/288: stat d1/d45 0 2024-04-12T13:41:58.790 INFO:tasks.workunit.client.1.smithi110.stdout:9/374: dwrite df/d13/d2c/d2d/d39/d3a/f78 [0,4194304] 0 2024-04-12T13:41:58.792 INFO:tasks.workunit.client.0.smithi060.stdout:1/357: mkdir d1e/d23/d2e/d30/d51/d85 0 2024-04-12T13:41:58.793 INFO:tasks.workunit.client.1.smithi110.stdout:7/301: rename d1/d3/d4/f3e to d1/d1b/d33/f66 0 2024-04-12T13:41:58.795 INFO:tasks.workunit.client.1.smithi110.stdout:3/296: unlink d5/c22 0 2024-04-12T13:41:58.795 INFO:tasks.workunit.client.0.smithi060.stdout:1/358: stat d1e/d23/d49/d4e/c5a 0 2024-04-12T13:41:58.796 INFO:tasks.workunit.client.0.smithi060.stdout:1/359: readlink lc 0 2024-04-12T13:41:58.798 INFO:tasks.workunit.client.1.smithi110.stdout:5/253: mkdir da/d2e/d45/d29/d58 0 2024-04-12T13:41:58.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/360: mkdir d1e/d23/d2e/d86 0 2024-04-12T13:41:58.799 INFO:tasks.workunit.client.1.smithi110.stdout:1/255: dwrite de/d14/d34/f5f [0,4194304] 0 2024-04-12T13:41:58.800 INFO:tasks.workunit.client.0.smithi060.stdout:1/361: write d1e/d46/f75 [638129,30525] 0 2024-04-12T13:41:58.806 INFO:tasks.workunit.client.0.smithi060.stdout:1/362: creat d1e/f87 x:0 0 0 2024-04-12T13:41:58.807 INFO:tasks.workunit.client.1.smithi110.stdout:7/302: truncate d1/d1b/d3d/f63 909610 0 2024-04-12T13:41:58.808 INFO:tasks.workunit.client.0.smithi060.stdout:1/363: stat d1e/d23/d2e/d30/d51/d85 0 2024-04-12T13:41:58.809 INFO:tasks.workunit.client.0.smithi060.stdout:1/364: chown l8 7 1 2024-04-12T13:41:58.811 INFO:tasks.workunit.client.1.smithi110.stdout:9/375: rename df/d13/d2c/c3e to df/d13/d2c/d2d/c81 0 2024-04-12T13:41:58.813 INFO:tasks.workunit.client.0.smithi060.stdout:1/365: dread d1e/d29/d65/f7f [0,4194304] 0 2024-04-12T13:41:58.815 INFO:tasks.workunit.client.0.smithi060.stdout:1/366: write d1e/d29/f6c [2902905,29847] 0 2024-04-12T13:41:58.816 INFO:tasks.workunit.client.1.smithi110.stdout:7/303: write d1/d3/d4/d55/f65 [740679,129383] 0 2024-04-12T13:41:58.817 INFO:tasks.workunit.client.1.smithi110.stdout:1/256: dread de/f58 [0,4194304] 0 2024-04-12T13:41:58.817 INFO:tasks.workunit.client.1.smithi110.stdout:4/400: dwrite d0/d19/d26/f64 [4194304,4194304] 0 2024-04-12T13:41:58.818 INFO:tasks.workunit.client.0.smithi060.stdout:1/367: chown d1e/d23/d2e/f39 6015 1 2024-04-12T13:41:58.821 INFO:tasks.workunit.client.1.smithi110.stdout:9/376: creat df/d13/d2c/d2d/d39/d4f/d58/d63/d72/f82 x:0 0 0 2024-04-12T13:41:58.822 INFO:tasks.workunit.client.0.smithi060.stdout:1/368: getdents d1e/d23/d2e/d5e/d68 0 2024-04-12T13:41:58.824 INFO:tasks.workunit.client.0.smithi060.stdout:1/369: symlink d1e/d23/d2e/l88 0 2024-04-12T13:41:58.827 INFO:tasks.workunit.client.1.smithi110.stdout:7/304: symlink d1/d3/l67 0 2024-04-12T13:41:58.828 INFO:tasks.workunit.client.0.smithi060.stdout:1/370: dread d1e/d23/d2e/d30/f36 [0,4194304] 0 2024-04-12T13:41:58.829 INFO:tasks.workunit.client.1.smithi110.stdout:4/401: symlink d0/de/d32/d5f/l87 0 2024-04-12T13:41:58.829 INFO:tasks.workunit.client.0.smithi060.stdout:1/371: chown d1e/l20 6389152 1 2024-04-12T13:41:58.830 INFO:tasks.workunit.client.1.smithi110.stdout:8/289: dread d1/d5/dd/ff [0,4194304] 0 2024-04-12T13:41:58.830 INFO:tasks.workunit.client.1.smithi110.stdout:3/297: dwrite d5/dc/d31/d3b/d32/f37 [0,4194304] 0 2024-04-12T13:41:58.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/372: fsync d1e/d23/d2e/f3a 0 2024-04-12T13:41:58.832 INFO:tasks.workunit.client.0.smithi060.stdout:1/373: stat d1e/d23/d2e/d30 0 2024-04-12T13:41:58.836 INFO:tasks.workunit.client.0.smithi060.stdout:1/374: read f14 [773898,88623] 0 2024-04-12T13:41:58.836 INFO:tasks.workunit.client.1.smithi110.stdout:4/402: chown d0/de/d32/d61/l76 119596306 1 2024-04-12T13:41:58.838 INFO:tasks.workunit.client.1.smithi110.stdout:5/254: write da/d2e/d45/f1e [1002660,82222] 0 2024-04-12T13:41:58.838 INFO:tasks.workunit.client.0.smithi060.stdout:1/375: chown d1e/d29/d37/c61 252945831 1 2024-04-12T13:41:58.846 INFO:tasks.workunit.client.1.smithi110.stdout:4/403: symlink d0/d19/d1c/d50/d6f/l88 0 2024-04-12T13:41:58.847 INFO:tasks.workunit.client.1.smithi110.stdout:6/319: truncate d7/d25/d30/d44/f33 515935 0 2024-04-12T13:41:58.847 INFO:tasks.workunit.client.1.smithi110.stdout:0/234: sync 2024-04-12T13:41:58.851 INFO:tasks.workunit.client.1.smithi110.stdout:9/377: rename df/d13/d2c/d2d/d39/d4f/d58 to df/d13/d2c/d2d/d39/d3a/d4e/d83 0 2024-04-12T13:41:58.853 INFO:tasks.workunit.client.1.smithi110.stdout:7/305: dwrite d1/d3/d4/d36/f5c [0,4194304] 0 2024-04-12T13:41:58.854 INFO:tasks.workunit.client.1.smithi110.stdout:3/298: dread d5/dc/f19 [0,4194304] 0 2024-04-12T13:41:58.856 INFO:tasks.workunit.client.1.smithi110.stdout:1/257: write f5 [4669759,38446] 0 2024-04-12T13:41:58.856 INFO:tasks.workunit.client.0.smithi060.stdout:1/376: dwrite d1e/f87 [0,4194304] 0 2024-04-12T13:41:58.858 INFO:tasks.workunit.client.0.smithi060.stdout:1/377: write d1e/d29/d37/f73 [970633,189] 0 2024-04-12T13:41:58.859 INFO:tasks.workunit.client.1.smithi110.stdout:8/290: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:58.860 INFO:tasks.workunit.client.1.smithi110.stdout:1/258: chown de/d14/c2e 154089033 1 2024-04-12T13:41:58.865 INFO:tasks.workunit.client.1.smithi110.stdout:6/320: mkdir d7/d10/d1c/d64 0 2024-04-12T13:41:58.868 INFO:tasks.workunit.client.0.smithi060.stdout:1/378: creat d1e/d23/f89 x:0 0 0 2024-04-12T13:41:58.871 INFO:tasks.workunit.client.0.smithi060.stdout:1/379: rmdir d1e/d23/d2e/d30 39 2024-04-12T13:41:58.873 INFO:tasks.workunit.client.1.smithi110.stdout:9/378: symlink df/d13/d2c/d2d/d39/d3a/d4e/l84 0 2024-04-12T13:41:58.873 INFO:tasks.workunit.client.1.smithi110.stdout:3/299: chown d5/dc/l26 754086 1 2024-04-12T13:41:58.874 INFO:tasks.workunit.client.1.smithi110.stdout:0/235: write d1/f2f [1512879,10239] 0 2024-04-12T13:41:58.875 INFO:tasks.workunit.client.1.smithi110.stdout:1/259: unlink de/c3d 0 2024-04-12T13:41:58.878 INFO:tasks.workunit.client.1.smithi110.stdout:5/255: rename da/d2e/d45/d25/f2c to da/db/d15/f59 0 2024-04-12T13:41:58.884 INFO:tasks.workunit.client.1.smithi110.stdout:9/379: mknod df/d13/d2c/d2d/d39/c85 0 2024-04-12T13:41:58.888 INFO:tasks.workunit.client.1.smithi110.stdout:5/256: stat da/d2e/d45/d29/d32/l57 0 2024-04-12T13:41:58.890 INFO:tasks.workunit.client.0.smithi060.stdout:1/380: write d1e/f2b [1302930,28612] 0 2024-04-12T13:41:58.890 INFO:tasks.workunit.client.1.smithi110.stdout:1/260: mknod de/d15/d32/d5e/c60 0 2024-04-12T13:41:58.891 INFO:tasks.workunit.client.1.smithi110.stdout:8/291: dread d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:58.891 INFO:tasks.workunit.client.1.smithi110.stdout:6/321: dread d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:41:58.891 INFO:tasks.workunit.client.1.smithi110.stdout:0/236: getdents d1/d8 0 2024-04-12T13:41:58.894 INFO:tasks.workunit.client.0.smithi060.stdout:1/381: creat d1e/d23/d2e/d30/d51/f8a x:0 0 0 2024-04-12T13:41:58.896 INFO:tasks.workunit.client.1.smithi110.stdout:2/323: sync 2024-04-12T13:41:58.896 INFO:tasks.workunit.client.1.smithi110.stdout:6/322: chown d7/d25/d30 5 1 2024-04-12T13:41:58.897 INFO:tasks.workunit.client.0.smithi060.stdout:1/382: unlink d1e/d23/f79 0 2024-04-12T13:41:58.897 INFO:tasks.workunit.client.1.smithi110.stdout:4/404: dread d0/d13/f2a [0,4194304] 0 2024-04-12T13:41:58.898 INFO:tasks.workunit.client.1.smithi110.stdout:1/261: mkdir de/d15/d32/d61 0 2024-04-12T13:41:58.899 INFO:tasks.workunit.client.1.smithi110.stdout:3/300: dread d5/dc/d20/f36 [0,4194304] 0 2024-04-12T13:41:58.902 INFO:tasks.workunit.client.1.smithi110.stdout:0/237: symlink d1/d27/d43/l4c 0 2024-04-12T13:41:58.903 INFO:tasks.workunit.client.1.smithi110.stdout:7/306: dwrite d1/d3/d4/f2e [0,4194304] 0 2024-04-12T13:41:58.905 INFO:tasks.workunit.client.1.smithi110.stdout:8/292: dread d1/d3/d35/d3a/d3e/f49 [0,4194304] 0 2024-04-12T13:41:58.905 INFO:tasks.workunit.client.1.smithi110.stdout:7/307: stat d1/d1b/f49 0 2024-04-12T13:41:58.907 INFO:tasks.workunit.client.1.smithi110.stdout:5/257: rename da/d2e/d45/d29/d32/f51 to da/d2e/d45/d25/f5a 0 2024-04-12T13:41:58.907 INFO:tasks.workunit.client.1.smithi110.stdout:7/308: write d1/d3/f11 [2574725,42023] 0 2024-04-12T13:41:58.909 INFO:tasks.workunit.client.1.smithi110.stdout:7/309: chown d1/f23 224294609 1 2024-04-12T13:41:58.910 INFO:tasks.workunit.client.1.smithi110.stdout:4/405: mkdir d0/d75/d84/d89 0 2024-04-12T13:41:58.910 INFO:tasks.workunit.client.1.smithi110.stdout:0/238: mkdir d1/d27/d4d 0 2024-04-12T13:41:58.911 INFO:tasks.workunit.client.1.smithi110.stdout:8/293: rmdir d1/d3/d35/d43 39 2024-04-12T13:41:58.912 INFO:tasks.workunit.client.1.smithi110.stdout:1/262: rename de/d15/c27 to de/d14/d34/d55/c62 0 2024-04-12T13:41:58.915 INFO:tasks.workunit.client.1.smithi110.stdout:7/310: mkdir d1/d1b/d3d/d68 0 2024-04-12T13:41:58.915 INFO:tasks.workunit.client.1.smithi110.stdout:9/380: getdents df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72 0 2024-04-12T13:41:58.915 INFO:tasks.workunit.client.1.smithi110.stdout:1/263: stat de/f22 0 2024-04-12T13:41:58.915 INFO:tasks.workunit.client.1.smithi110.stdout:4/406: mkdir d0/d19/d26/d8a 0 2024-04-12T13:41:58.916 INFO:tasks.workunit.client.1.smithi110.stdout:0/239: truncate d1/d8/d36/f44 290627 0 2024-04-12T13:41:58.916 INFO:tasks.workunit.client.1.smithi110.stdout:5/258: creat da/d55/f5b x:0 0 0 2024-04-12T13:41:58.917 INFO:tasks.workunit.client.0.smithi060.stdout:1/383: dwrite d1e/d23/d2e/d30/f5f [0,4194304] 0 2024-04-12T13:41:58.919 INFO:tasks.workunit.client.1.smithi110.stdout:8/294: creat d1/f5c x:0 0 0 2024-04-12T13:41:58.919 INFO:tasks.workunit.client.1.smithi110.stdout:4/407: readlink d0/d19/d1c/l28 0 2024-04-12T13:41:58.920 INFO:tasks.workunit.client.0.smithi060.stdout:1/384: unlink f13 0 2024-04-12T13:41:58.923 INFO:tasks.workunit.client.1.smithi110.stdout:6/323: rename d7/d10/d1c/f43 to d7/d10/d41/f65 0 2024-04-12T13:41:58.927 INFO:tasks.workunit.client.1.smithi110.stdout:8/295: fdatasync d1/d3/d35/d3a/d3e/f49 0 2024-04-12T13:41:58.928 INFO:tasks.workunit.client.0.smithi060.stdout:1/385: chown d1e/d1f/c3d 479013 1 2024-04-12T13:41:58.931 INFO:tasks.workunit.client.1.smithi110.stdout:3/301: dwrite d5/dc/d20/d2d/d4f/f58 [0,4194304] 0 2024-04-12T13:41:58.933 INFO:tasks.workunit.client.1.smithi110.stdout:2/324: dread d6/dc/f2b [0,4194304] 0 2024-04-12T13:41:58.933 INFO:tasks.workunit.client.1.smithi110.stdout:1/264: truncate de/f10 2801207 0 2024-04-12T13:41:58.933 INFO:tasks.workunit.client.1.smithi110.stdout:7/311: getdents d1/d31/d5d 0 2024-04-12T13:41:58.934 INFO:tasks.workunit.client.0.smithi060.stdout:1/386: dread f14 [0,4194304] 0 2024-04-12T13:41:58.940 INFO:tasks.workunit.client.1.smithi110.stdout:3/302: symlink d5/dc/d31/d3b/d32/l68 0 2024-04-12T13:41:58.941 INFO:tasks.workunit.client.1.smithi110.stdout:7/312: write d1/d3/f4c [501707,94448] 0 2024-04-12T13:41:58.942 INFO:tasks.workunit.client.1.smithi110.stdout:2/325: unlink d6/dc/c38 0 2024-04-12T13:41:58.950 INFO:tasks.workunit.client.0.smithi060.stdout:5/332: sync 2024-04-12T13:41:58.950 INFO:tasks.workunit.client.0.smithi060.stdout:8/286: sync 2024-04-12T13:41:58.952 INFO:tasks.workunit.client.1.smithi110.stdout:9/381: dwrite df/f1e [4194304,4194304] 0 2024-04-12T13:41:58.954 INFO:tasks.workunit.client.1.smithi110.stdout:5/259: dread da/d2e/d45/d25/f44 [0,4194304] 0 2024-04-12T13:41:58.955 INFO:tasks.workunit.client.0.smithi060.stdout:1/387: dwrite d1e/f28 [0,4194304] 0 2024-04-12T13:41:58.957 INFO:tasks.workunit.client.0.smithi060.stdout:1/388: chown d1e/d23/d2e/d5e 988709 1 2024-04-12T13:41:58.959 INFO:tasks.workunit.client.1.smithi110.stdout:8/296: dwrite d1/d5/d1f/f56 [0,4194304] 0 2024-04-12T13:41:58.959 INFO:tasks.workunit.client.1.smithi110.stdout:6/324: dwrite d7/d10/d1c/f42 [0,4194304] 0 2024-04-12T13:41:58.962 INFO:tasks.workunit.client.1.smithi110.stdout:4/408: dwrite d0/d19/d1c/f60 [0,4194304] 0 2024-04-12T13:41:58.965 INFO:tasks.workunit.client.1.smithi110.stdout:4/409: stat d0/de/d2c/c48 0 2024-04-12T13:41:58.975 INFO:tasks.workunit.client.1.smithi110.stdout:0/240: dread f0 [0,4194304] 0 2024-04-12T13:41:58.977 INFO:tasks.workunit.client.0.smithi060.stdout:5/333: dwrite d6/d10/d12/d38/f66 [0,4194304] 0 2024-04-12T13:41:58.994 INFO:tasks.workunit.client.1.smithi110.stdout:1/265: creat de/d14/d34/d55/f63 x:0 0 0 2024-04-12T13:41:58.995 INFO:tasks.workunit.client.1.smithi110.stdout:3/303: readlink d5/dc/d31/d3b/d32/d3e/l54 0 2024-04-12T13:41:58.997 INFO:tasks.workunit.client.1.smithi110.stdout:2/326: mkdir d6/dc/d1b/d57 0 2024-04-12T13:41:58.998 INFO:tasks.workunit.client.0.smithi060.stdout:1/389: symlink d1e/d23/d2e/d5e/d68/l8b 0 2024-04-12T13:41:59.004 INFO:tasks.workunit.client.0.smithi060.stdout:5/334: rmdir d6/d10/d12/d15 39 2024-04-12T13:41:59.007 INFO:tasks.workunit.client.0.smithi060.stdout:8/287: creat d9/d1d/d5e/f61 x:0 0 0 2024-04-12T13:41:59.009 INFO:tasks.workunit.client.1.smithi110.stdout:1/266: dwrite de/f5b [0,4194304] 0 2024-04-12T13:41:59.009 INFO:tasks.workunit.client.0.smithi060.stdout:8/288: chown d9/d1d/d2f/f4b 5629 1 2024-04-12T13:41:59.010 INFO:tasks.workunit.client.0.smithi060.stdout:1/390: mknod d1e/d29/d65/c8c 0 2024-04-12T13:41:59.011 INFO:tasks.workunit.client.1.smithi110.stdout:5/260: rmdir da/d2e/d45/d25/d3d 39 2024-04-12T13:41:59.012 INFO:tasks.workunit.client.0.smithi060.stdout:8/289: fsync d9/d1b/d2b/f55 0 2024-04-12T13:41:59.014 INFO:tasks.workunit.client.0.smithi060.stdout:8/290: dread - d9/d1b/d37/f3a zero size 2024-04-12T13:41:59.015 INFO:tasks.workunit.client.0.smithi060.stdout:5/335: rename d6/dd/d1f/d25/d35/d50/c67 to d6/dd/d1f/c78 0 2024-04-12T13:41:59.016 INFO:tasks.workunit.client.0.smithi060.stdout:8/291: fsync d9/d1d/f4c 0 2024-04-12T13:41:59.016 INFO:tasks.workunit.client.1.smithi110.stdout:8/297: fsync d1/d7/d20/f36 0 2024-04-12T13:41:59.019 INFO:tasks.workunit.client.0.smithi060.stdout:1/391: mkdir d1e/d46/d8d 0 2024-04-12T13:41:59.021 INFO:tasks.workunit.client.0.smithi060.stdout:8/292: truncate d9/da/f4e 255156 0 2024-04-12T13:41:59.023 INFO:tasks.workunit.client.1.smithi110.stdout:4/410: unlink d0/de/d2c/f3d 0 2024-04-12T13:41:59.025 INFO:tasks.workunit.client.1.smithi110.stdout:4/411: write d0/d19/f74 [996618,41830] 0 2024-04-12T13:41:59.029 INFO:tasks.workunit.client.1.smithi110.stdout:0/241: rmdir d1/d8/d36 39 2024-04-12T13:41:59.029 INFO:tasks.workunit.client.1.smithi110.stdout:3/304: truncate d5/dc/f53 428876 0 2024-04-12T13:41:59.031 INFO:tasks.workunit.client.1.smithi110.stdout:2/327: rename d6/d18/d19/d25/l3e to d6/dc/d1b/l58 0 2024-04-12T13:41:59.032 INFO:tasks.workunit.client.1.smithi110.stdout:3/305: write d5/dc/d20/d2d/f35 [752835,59249] 0 2024-04-12T13:41:59.034 INFO:tasks.workunit.client.1.smithi110.stdout:5/261: dread da/db/f14 [0,4194304] 0 2024-04-12T13:41:59.036 INFO:tasks.workunit.client.1.smithi110.stdout:9/382: symlink df/d38/d6e/d7f/l86 0 2024-04-12T13:41:59.036 INFO:tasks.workunit.client.0.smithi060.stdout:8/293: dwrite d9/d1d/f4c [0,4194304] 0 2024-04-12T13:41:59.037 INFO:tasks.workunit.client.1.smithi110.stdout:9/383: chown df/d13/d2c/d2d/d39/d4f 6358122 1 2024-04-12T13:41:59.038 INFO:tasks.workunit.client.1.smithi110.stdout:7/313: sync 2024-04-12T13:41:59.042 INFO:tasks.workunit.client.1.smithi110.stdout:7/314: write d1/d3/d4/f1c [954906,90656] 0 2024-04-12T13:41:59.043 INFO:tasks.workunit.client.1.smithi110.stdout:6/325: symlink d7/d10/d1c/d2b/d48/d4b/l66 0 2024-04-12T13:41:59.055 INFO:tasks.workunit.client.1.smithi110.stdout:9/384: dwrite df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/f82 [0,4194304] 0 2024-04-12T13:41:59.057 INFO:tasks.workunit.client.0.smithi060.stdout:8/294: creat d9/d1b/d37/d48/f62 x:0 0 0 2024-04-12T13:41:59.057 INFO:tasks.workunit.client.1.smithi110.stdout:8/298: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T13:41:59.059 INFO:tasks.workunit.client.0.smithi060.stdout:1/392: mkdir d1e/d23/d2e/d8e 0 2024-04-12T13:41:59.063 INFO:tasks.workunit.client.0.smithi060.stdout:1/393: write d1e/d29/d65/f7a [126484,91636] 0 2024-04-12T13:41:59.066 INFO:tasks.workunit.client.1.smithi110.stdout:7/315: truncate d1/f38 1055846 0 2024-04-12T13:41:59.068 INFO:tasks.workunit.client.1.smithi110.stdout:4/412: link d0/d13/f52 d0/d19/d1c/f8b 0 2024-04-12T13:41:59.068 INFO:tasks.workunit.client.0.smithi060.stdout:5/336: dwrite d6/dd/d1f/d25/d53/f77 [4194304,4194304] 0 2024-04-12T13:41:59.070 INFO:tasks.workunit.client.0.smithi060.stdout:1/394: mknod d1e/d23/d49/d4e/c8f 0 2024-04-12T13:41:59.070 INFO:tasks.workunit.client.1.smithi110.stdout:4/413: dread - d0/d19/d1c/d50/f69 zero size 2024-04-12T13:41:59.070 INFO:tasks.workunit.client.0.smithi060.stdout:8/295: truncate d9/d1b/d37/f39 687863 0 2024-04-12T13:41:59.072 INFO:tasks.workunit.client.0.smithi060.stdout:8/296: fdatasync f1 0 2024-04-12T13:41:59.073 INFO:tasks.workunit.client.1.smithi110.stdout:0/242: mknod d1/c4e 0 2024-04-12T13:41:59.076 INFO:tasks.workunit.client.0.smithi060.stdout:5/337: mkdir d6/d10/d12/d79 0 2024-04-12T13:41:59.077 INFO:tasks.workunit.client.0.smithi060.stdout:5/338: fdatasync d6/f20 0 2024-04-12T13:41:59.077 INFO:tasks.workunit.client.1.smithi110.stdout:2/328: mknod d6/dc/d1b/d57/c59 0 2024-04-12T13:41:59.079 INFO:tasks.workunit.client.1.smithi110.stdout:5/262: mkdir da/d5c 0 2024-04-12T13:41:59.080 INFO:tasks.workunit.client.0.smithi060.stdout:8/297: mkdir d9/d1b/d37/d4d/d63 0 2024-04-12T13:41:59.082 INFO:tasks.workunit.client.0.smithi060.stdout:8/298: fdatasync d9/d1b/d37/f3a 0 2024-04-12T13:41:59.084 INFO:tasks.workunit.client.1.smithi110.stdout:1/267: creat de/f64 x:0 0 0 2024-04-12T13:41:59.087 INFO:tasks.workunit.client.1.smithi110.stdout:7/316: mknod d1/d31/c69 0 2024-04-12T13:41:59.093 INFO:tasks.workunit.client.1.smithi110.stdout:4/414: rmdir d0/de/d32/d5f 39 2024-04-12T13:41:59.093 INFO:tasks.workunit.client.1.smithi110.stdout:4/415: chown d0 862505907 1 2024-04-12T13:41:59.094 INFO:tasks.workunit.client.0.smithi060.stdout:8/299: readlink d9/da/lf 0 2024-04-12T13:41:59.099 INFO:tasks.workunit.client.1.smithi110.stdout:1/268: dwrite de/f22 [0,4194304] 0 2024-04-12T13:41:59.102 INFO:tasks.workunit.client.0.smithi060.stdout:1/395: truncate d1e/d23/d2e/d30/f5f 833096 0 2024-04-12T13:41:59.103 INFO:tasks.workunit.client.0.smithi060.stdout:5/339: truncate d6/d10/d12/d15/f60 3625259 0 2024-04-12T13:41:59.103 INFO:tasks.workunit.client.1.smithi110.stdout:8/299: symlink d1/d3/d35/l5d 0 2024-04-12T13:41:59.107 INFO:tasks.workunit.client.1.smithi110.stdout:8/300: write d1/d5/dd/f27 [1086086,40990] 0 2024-04-12T13:41:59.107 INFO:tasks.workunit.client.1.smithi110.stdout:5/263: write da/d2e/d45/d25/f5a [251619,31052] 0 2024-04-12T13:41:59.107 INFO:tasks.workunit.client.1.smithi110.stdout:7/317: dread d1/d3/d4/f1c [0,4194304] 0 2024-04-12T13:41:59.109 INFO:tasks.workunit.client.0.smithi060.stdout:1/396: symlink d1e/d23/d2e/d30/d51/l90 0 2024-04-12T13:41:59.111 INFO:tasks.workunit.client.0.smithi060.stdout:5/340: mkdir d6/dd/d1f/d25/d42/d52/d7a 0 2024-04-12T13:41:59.114 INFO:tasks.workunit.client.0.smithi060.stdout:1/397: chown d1e/d23/d2e/d30/d51/c78 0 1 2024-04-12T13:41:59.115 INFO:tasks.workunit.client.1.smithi110.stdout:9/385: creat df/d13/f87 x:0 0 0 2024-04-12T13:41:59.116 INFO:tasks.workunit.client.1.smithi110.stdout:3/306: getdents d5/dc/d20/d2d/d4f 0 2024-04-12T13:41:59.117 INFO:tasks.workunit.client.1.smithi110.stdout:0/243: write d1/d8/f21 [5178541,100555] 0 2024-04-12T13:41:59.117 INFO:tasks.workunit.client.0.smithi060.stdout:8/300: dwrite d9/d1b/d2b/f45 [4194304,4194304] 0 2024-04-12T13:41:59.121 INFO:tasks.workunit.client.1.smithi110.stdout:8/301: write d1/d3/d35/d3a/d41/f51 [43810,5120] 0 2024-04-12T13:41:59.122 INFO:tasks.workunit.client.0.smithi060.stdout:5/341: symlink d6/d10/d12/l7b 0 2024-04-12T13:41:59.122 INFO:tasks.workunit.client.1.smithi110.stdout:6/326: getdents d7/d10/d41 0 2024-04-12T13:41:59.122 INFO:tasks.workunit.client.1.smithi110.stdout:7/318: creat d1/d1b/d33/f6a x:0 0 0 2024-04-12T13:41:59.122 INFO:tasks.workunit.client.1.smithi110.stdout:6/327: fdatasync d7/d25/f59 0 2024-04-12T13:41:59.122 INFO:tasks.workunit.client.1.smithi110.stdout:2/329: creat d6/d18/d19/f5a x:0 0 0 2024-04-12T13:41:59.124 INFO:tasks.workunit.client.1.smithi110.stdout:9/386: creat df/d38/f88 x:0 0 0 2024-04-12T13:41:59.125 INFO:tasks.workunit.client.1.smithi110.stdout:2/330: chown d6/d18/d19/d4a/d3c/f26 11157497 1 2024-04-12T13:41:59.127 INFO:tasks.workunit.client.1.smithi110.stdout:3/307: unlink d5/dc/d20/d2d/f35 0 2024-04-12T13:41:59.128 INFO:tasks.workunit.client.0.smithi060.stdout:1/398: symlink d1e/d23/d2e/d30/d51/d85/l91 0 2024-04-12T13:41:59.129 INFO:tasks.workunit.client.1.smithi110.stdout:5/264: dwrite da/d2e/d45/d29/f48 [0,4194304] 0 2024-04-12T13:41:59.129 INFO:tasks.workunit.client.1.smithi110.stdout:9/387: fsync df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/f82 0 2024-04-12T13:41:59.131 INFO:tasks.workunit.client.1.smithi110.stdout:4/416: creat d0/de/d32/f8c x:0 0 0 2024-04-12T13:41:59.132 INFO:tasks.workunit.client.1.smithi110.stdout:5/265: dread - da/d2e/d45/f1f zero size 2024-04-12T13:41:59.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/301: rename d9/d1b/d2b/f50 to d9/d1d/f64 0 2024-04-12T13:41:59.134 INFO:tasks.workunit.client.0.smithi060.stdout:1/399: rmdir d1e/d23/d2e/d5e/d68 39 2024-04-12T13:41:59.135 INFO:tasks.workunit.client.1.smithi110.stdout:5/266: fsync da/d2e/f30 0 2024-04-12T13:41:59.137 INFO:tasks.workunit.client.1.smithi110.stdout:8/302: dwrite d1/d7/f3f [0,4194304] 0 2024-04-12T13:41:59.147 INFO:tasks.workunit.client.1.smithi110.stdout:2/331: creat d6/d18/d19/d4a/f5b x:0 0 0 2024-04-12T13:41:59.147 INFO:tasks.workunit.client.0.smithi060.stdout:5/342: dwrite d6/f20 [0,4194304] 0 2024-04-12T13:41:59.156 INFO:tasks.workunit.client.0.smithi060.stdout:5/343: unlink d6/d10/d12/d38/f3c 0 2024-04-12T13:41:59.157 INFO:tasks.workunit.client.1.smithi110.stdout:9/388: mkdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/d89 0 2024-04-12T13:41:59.160 INFO:tasks.workunit.client.0.smithi060.stdout:5/344: dread - d6/dd/d1f/d25/d42/d6b/f76 zero size 2024-04-12T13:41:59.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/302: mkdir d9/d1b/d3c/d60/d65 0 2024-04-12T13:41:59.161 INFO:tasks.workunit.client.0.smithi060.stdout:8/303: chown d9/da/f24 1 1 2024-04-12T13:41:59.164 INFO:tasks.workunit.client.1.smithi110.stdout:5/267: dwrite da/d2e/d45/d29/f50 [0,4194304] 0 2024-04-12T13:41:59.169 INFO:tasks.workunit.client.0.smithi060.stdout:5/345: truncate d6/d10/f31 64758 0 2024-04-12T13:41:59.171 INFO:tasks.workunit.client.0.smithi060.stdout:1/400: dread f7 [0,4194304] 0 2024-04-12T13:41:59.172 INFO:tasks.workunit.client.1.smithi110.stdout:7/319: creat d1/f6b x:0 0 0 2024-04-12T13:41:59.172 INFO:tasks.workunit.client.0.smithi060.stdout:5/346: write d6/d10/d12/d15/f4f [919854,27646] 0 2024-04-12T13:41:59.172 INFO:tasks.workunit.client.0.smithi060.stdout:9/250: sync 2024-04-12T13:41:59.172 INFO:tasks.workunit.client.0.smithi060.stdout:7/248: sync 2024-04-12T13:41:59.173 INFO:tasks.workunit.client.0.smithi060.stdout:8/304: mkdir d9/d1b/d37/d4d/d63/d66 0 2024-04-12T13:41:59.174 INFO:tasks.workunit.client.0.smithi060.stdout:1/401: write d1e/d29/f6c [1939252,116694] 0 2024-04-12T13:41:59.182 INFO:tasks.workunit.client.0.smithi060.stdout:9/251: rmdir d4/d8 39 2024-04-12T13:41:59.183 INFO:tasks.workunit.client.1.smithi110.stdout:4/417: creat d0/d19/d26/d8a/f8d x:0 0 0 2024-04-12T13:41:59.186 INFO:tasks.workunit.client.1.smithi110.stdout:5/268: rmdir da 39 2024-04-12T13:41:59.188 INFO:tasks.workunit.client.1.smithi110.stdout:8/303: creat d1/d3/d35/d3a/d3e/d4f/f5e x:0 0 0 2024-04-12T13:41:59.189 INFO:tasks.workunit.client.0.smithi060.stdout:1/402: chown d1e/d23/d2e/d5e/d68/l8b 32189896 1 2024-04-12T13:41:59.189 INFO:tasks.workunit.client.1.smithi110.stdout:2/332: symlink d6/d18/d19/l5c 0 2024-04-12T13:41:59.191 INFO:tasks.workunit.client.0.smithi060.stdout:1/403: write d1e/d46/f48 [31775,6520] 0 2024-04-12T13:41:59.192 INFO:tasks.workunit.client.0.smithi060.stdout:7/249: unlink d0/f30 0 2024-04-12T13:41:59.192 INFO:tasks.workunit.client.0.smithi060.stdout:1/404: readlink d1e/d23/d2e/d30/l69 0 2024-04-12T13:41:59.194 INFO:tasks.workunit.client.0.smithi060.stdout:1/405: write d1e/d1f/f4a [1384862,114892] 0 2024-04-12T13:41:59.198 INFO:tasks.workunit.client.0.smithi060.stdout:9/252: mknod d4/d25/c53 0 2024-04-12T13:41:59.203 INFO:tasks.workunit.client.0.smithi060.stdout:8/305: creat d9/d1b/d3c/d60/d65/f67 x:0 0 0 2024-04-12T13:41:59.204 INFO:tasks.workunit.client.1.smithi110.stdout:6/328: getdents d7/d10 0 2024-04-12T13:41:59.205 INFO:tasks.workunit.client.1.smithi110.stdout:3/308: dwrite d5/dc/d20/d2d/f42 [0,4194304] 0 2024-04-12T13:41:59.206 INFO:tasks.workunit.client.1.smithi110.stdout:6/329: write d7/d25/d30/d44/d3d/f5f [345818,81617] 0 2024-04-12T13:41:59.211 INFO:tasks.workunit.client.0.smithi060.stdout:1/406: dwrite d1e/f28 [4194304,4194304] 0 2024-04-12T13:41:59.212 INFO:tasks.workunit.client.1.smithi110.stdout:4/418: read d0/d13/f2d [4263219,113132] 0 2024-04-12T13:41:59.217 INFO:tasks.workunit.client.1.smithi110.stdout:8/304: creat d1/d7/d20/f5f x:0 0 0 2024-04-12T13:41:59.218 INFO:tasks.workunit.client.0.smithi060.stdout:3/292: sync 2024-04-12T13:41:59.218 INFO:tasks.workunit.client.0.smithi060.stdout:6/401: sync 2024-04-12T13:41:59.218 INFO:tasks.workunit.client.0.smithi060.stdout:4/295: sync 2024-04-12T13:41:59.218 INFO:tasks.workunit.client.0.smithi060.stdout:0/292: sync 2024-04-12T13:41:59.218 INFO:tasks.workunit.client.0.smithi060.stdout:2/285: sync 2024-04-12T13:41:59.219 INFO:tasks.workunit.client.1.smithi110.stdout:8/305: fsync d1/d5/f4a 0 2024-04-12T13:41:59.222 INFO:tasks.workunit.client.0.smithi060.stdout:2/286: stat d6/d10/d16/f1c 0 2024-04-12T13:41:59.222 INFO:tasks.workunit.client.1.smithi110.stdout:1/269: sync 2024-04-12T13:41:59.222 INFO:tasks.workunit.client.0.smithi060.stdout:6/402: read d1/d7/da/dc/f3c [2982670,94133] 0 2024-04-12T13:41:59.227 INFO:tasks.workunit.client.1.smithi110.stdout:9/389: truncate df/d13/d2c/d2d/d39/d3a/d4e/f57 3868288 0 2024-04-12T13:41:59.229 INFO:tasks.workunit.client.0.smithi060.stdout:8/306: mknod d9/da/c68 0 2024-04-12T13:41:59.235 INFO:tasks.workunit.client.0.smithi060.stdout:0/293: dwrite d7/d9/f48 [0,4194304] 0 2024-04-12T13:41:59.241 INFO:tasks.workunit.client.0.smithi060.stdout:4/296: mkdir d6/d7/dd/d4d/d69 0 2024-04-12T13:41:59.243 INFO:tasks.workunit.client.0.smithi060.stdout:9/253: symlink d4/d9/l54 0 2024-04-12T13:41:59.244 INFO:tasks.workunit.client.0.smithi060.stdout:4/297: truncate d6/d21/f41 842820 0 2024-04-12T13:41:59.245 INFO:tasks.workunit.client.1.smithi110.stdout:2/333: mkdir d6/d18/d19/d5d 0 2024-04-12T13:41:59.246 INFO:tasks.workunit.client.0.smithi060.stdout:2/287: mkdir d6/d56/d58 0 2024-04-12T13:41:59.247 INFO:tasks.workunit.client.1.smithi110.stdout:6/330: dwrite d7/d10/d1c/f29 [0,4194304] 0 2024-04-12T13:41:59.247 INFO:tasks.workunit.client.1.smithi110.stdout:2/334: chown d6/dc/dd/l4c 281 1 2024-04-12T13:41:59.248 INFO:tasks.workunit.client.0.smithi060.stdout:2/288: dread - d6/d56/d43/f4a zero size 2024-04-12T13:41:59.249 INFO:tasks.workunit.client.0.smithi060.stdout:6/403: unlink d1/d7/da/dc/d24/d34/f23 0 2024-04-12T13:41:59.250 INFO:tasks.workunit.client.0.smithi060.stdout:2/289: chown d6/d13/d31/d33/l3a 2441 1 2024-04-12T13:41:59.251 INFO:tasks.workunit.client.1.smithi110.stdout:9/390: unlink df/d13/d3b/l48 0 2024-04-12T13:41:59.251 INFO:tasks.workunit.client.0.smithi060.stdout:6/404: stat d1/d7/da/dc/d3a/f4b 0 2024-04-12T13:41:59.252 INFO:tasks.workunit.client.1.smithi110.stdout:5/269: mkdir da/d2e/d45/d25/d5d 0 2024-04-12T13:41:59.255 INFO:tasks.workunit.client.1.smithi110.stdout:4/419: creat d0/de/d32/d5f/d71/f8e x:0 0 0 2024-04-12T13:41:59.255 INFO:tasks.workunit.client.0.smithi060.stdout:8/307: mknod d9/d1b/d37/d4d/c69 0 2024-04-12T13:41:59.256 INFO:tasks.workunit.client.1.smithi110.stdout:4/420: chown d0/d19/l3f 28 1 2024-04-12T13:41:59.256 INFO:tasks.workunit.client.0.smithi060.stdout:7/250: write d0/d7/f33 [3498348,22473] 0 2024-04-12T13:41:59.257 INFO:tasks.workunit.client.1.smithi110.stdout:1/270: unlink de/l1a 0 2024-04-12T13:41:59.257 INFO:tasks.workunit.client.0.smithi060.stdout:1/407: mknod d1e/d46/d8d/c92 0 2024-04-12T13:41:59.257 INFO:tasks.workunit.client.0.smithi060.stdout:8/308: stat d9/d1d/c27 0 2024-04-12T13:41:59.258 INFO:tasks.workunit.client.0.smithi060.stdout:8/309: stat d9/fc 0 2024-04-12T13:41:59.259 INFO:tasks.workunit.client.1.smithi110.stdout:8/306: mkdir d1/d3/d3c/d5a/d60 0 2024-04-12T13:41:59.260 INFO:tasks.workunit.client.0.smithi060.stdout:5/347: read d6/d10/d12/d15/f60 [3111281,49964] 0 2024-04-12T13:41:59.262 INFO:tasks.workunit.client.1.smithi110.stdout:2/335: unlink d6/dc/dd/l46 0 2024-04-12T13:41:59.262 INFO:tasks.workunit.client.0.smithi060.stdout:5/348: dread - d6/d10/d12/d15/f3a zero size 2024-04-12T13:41:59.263 INFO:tasks.workunit.client.1.smithi110.stdout:6/331: symlink d7/d10/d1c/d2b/d48/d54/l67 0 2024-04-12T13:41:59.265 INFO:tasks.workunit.client.1.smithi110.stdout:2/336: write d6/dc/d1b/f4e [963856,7122] 0 2024-04-12T13:41:59.266 INFO:tasks.workunit.client.0.smithi060.stdout:5/349: write d6/f17 [3565337,34889] 0 2024-04-12T13:41:59.266 INFO:tasks.workunit.client.0.smithi060.stdout:4/298: mknod d6/d7/dd/d1a/d19/d42/c6a 0 2024-04-12T13:41:59.268 INFO:tasks.workunit.client.1.smithi110.stdout:4/421: mkdir d0/d19/d8f 0 2024-04-12T13:41:59.270 INFO:tasks.workunit.client.0.smithi060.stdout:2/290: write d6/d10/d16/f2e [4145702,42219] 0 2024-04-12T13:41:59.272 INFO:tasks.workunit.client.1.smithi110.stdout:8/307: unlink d1/l11 0 2024-04-12T13:41:59.273 INFO:tasks.workunit.client.0.smithi060.stdout:2/291: fsync d6/d13/d31/f41 0 2024-04-12T13:41:59.279 INFO:tasks.workunit.client.0.smithi060.stdout:8/310: dwrite d9/da/f43 [0,4194304] 0 2024-04-12T13:41:59.279 INFO:tasks.workunit.client.1.smithi110.stdout:0/244: sync 2024-04-12T13:41:59.281 INFO:tasks.workunit.client.0.smithi060.stdout:1/408: unlink d1e/d29/d65/c8c 0 2024-04-12T13:41:59.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/332: write d7/d25/d30/d44/f21 [4562819,84663] 0 2024-04-12T13:41:59.286 INFO:tasks.workunit.client.1.smithi110.stdout:8/308: dwrite d1/d3/d3c/f2f [0,4194304] 0 2024-04-12T13:41:59.291 INFO:tasks.workunit.client.0.smithi060.stdout:3/293: creat d7/d17/d27/d36/f62 x:0 0 0 2024-04-12T13:41:59.293 INFO:tasks.workunit.client.0.smithi060.stdout:1/409: dread d1e/f7c [0,4194304] 0 2024-04-12T13:41:59.295 INFO:tasks.workunit.client.0.smithi060.stdout:5/350: dread d6/dd/d1f/d25/d53/f77 [0,4194304] 0 2024-04-12T13:41:59.297 INFO:tasks.workunit.client.1.smithi110.stdout:5/270: symlink da/d2e/d45/d29/d58/l5e 0 2024-04-12T13:41:59.297 INFO:tasks.workunit.client.0.smithi060.stdout:9/254: write d4/d8/fa [3818289,79917] 0 2024-04-12T13:41:59.300 INFO:tasks.workunit.client.1.smithi110.stdout:5/271: read da/db/f31 [2097836,75326] 0 2024-04-12T13:41:59.301 INFO:tasks.workunit.client.1.smithi110.stdout:4/422: creat d0/d75/d84/f90 x:0 0 0 2024-04-12T13:41:59.303 INFO:tasks.workunit.client.1.smithi110.stdout:9/391: write df/d13/f27 [1949034,40379] 0 2024-04-12T13:41:59.303 INFO:tasks.workunit.client.1.smithi110.stdout:4/423: fsync d0/d75/f79 0 2024-04-12T13:41:59.310 INFO:tasks.workunit.client.0.smithi060.stdout:7/251: chown d0/d1b/f53 1141 1 2024-04-12T13:41:59.311 INFO:tasks.workunit.client.1.smithi110.stdout:8/309: mknod d1/d3/d35/d3a/d3e/c61 0 2024-04-12T13:41:59.313 INFO:tasks.workunit.client.0.smithi060.stdout:0/294: creat d7/d9/d14/f6f x:0 0 0 2024-04-12T13:41:59.315 INFO:tasks.workunit.client.0.smithi060.stdout:0/295: read d7/d9/d14/d35/d3c/f42 [1512532,32831] 0 2024-04-12T13:41:59.315 INFO:tasks.workunit.client.1.smithi110.stdout:2/337: fsync d6/f11 0 2024-04-12T13:41:59.318 INFO:tasks.workunit.client.1.smithi110.stdout:6/333: mknod d7/d10/d1c/d2b/d48/c68 0 2024-04-12T13:41:59.319 INFO:tasks.workunit.client.0.smithi060.stdout:0/296: truncate d7/d9/d14/d1b/f2a 4587971 0 2024-04-12T13:41:59.320 INFO:tasks.workunit.client.1.smithi110.stdout:7/320: sync 2024-04-12T13:41:59.321 INFO:tasks.workunit.client.0.smithi060.stdout:0/297: fdatasync d7/d33/d5b/f64 0 2024-04-12T13:41:59.326 INFO:tasks.workunit.client.1.smithi110.stdout:1/271: truncate f5 897690 0 2024-04-12T13:41:59.326 INFO:tasks.workunit.client.1.smithi110.stdout:5/272: rmdir da/d2e 39 2024-04-12T13:41:59.326 INFO:tasks.workunit.client.0.smithi060.stdout:5/351: dread f2 [0,4194304] 0 2024-04-12T13:41:59.326 INFO:tasks.workunit.client.0.smithi060.stdout:3/294: mkdir d7/d17/d19/d33/d63 0 2024-04-12T13:41:59.327 INFO:tasks.workunit.client.0.smithi060.stdout:3/295: dread - d7/d17/d27/d36/f46 zero size 2024-04-12T13:41:59.327 INFO:tasks.workunit.client.0.smithi060.stdout:9/255: fsync d4/d9/d19/f1a 0 2024-04-12T13:41:59.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/296: write d7/da/d3f/f41 [383117,102253] 0 2024-04-12T13:41:59.330 INFO:tasks.workunit.client.1.smithi110.stdout:4/424: mkdir d0/d75/d91 0 2024-04-12T13:41:59.333 INFO:tasks.workunit.client.1.smithi110.stdout:9/392: unlink df/d13/d2c/d2d/d39/d4f/l5c 0 2024-04-12T13:41:59.334 INFO:tasks.workunit.client.1.smithi110.stdout:9/393: dread - df/d13/f87 zero size 2024-04-12T13:41:59.334 INFO:tasks.workunit.client.0.smithi060.stdout:4/299: symlink d6/d7/dd/d4d/d69/l6b 0 2024-04-12T13:41:59.337 INFO:tasks.workunit.client.0.smithi060.stdout:1/410: write d1e/d23/d49/f54 [1030519,34107] 0 2024-04-12T13:41:59.338 INFO:tasks.workunit.client.1.smithi110.stdout:3/309: link d5/l57 d5/dc/d20/l69 0 2024-04-12T13:41:59.339 INFO:tasks.workunit.client.1.smithi110.stdout:1/272: dwrite de/d14/d34/f40 [0,4194304] 0 2024-04-12T13:41:59.340 INFO:tasks.workunit.client.1.smithi110.stdout:8/310: mknod d1/d5/dd/d31/c62 0 2024-04-12T13:41:59.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/298: symlink d7/d9/d14/d35/d3c/l70 0 2024-04-12T13:41:59.354 INFO:tasks.workunit.client.0.smithi060.stdout:5/352: dread d6/d10/f2b [0,4194304] 0 2024-04-12T13:41:59.355 INFO:tasks.workunit.client.1.smithi110.stdout:0/245: write d1/d8/f2e [1149909,3843] 0 2024-04-12T13:41:59.356 INFO:tasks.workunit.client.0.smithi060.stdout:9/256: mknod d4/d25/c55 0 2024-04-12T13:41:59.357 INFO:tasks.workunit.client.0.smithi060.stdout:5/353: write d6/d10/f2a [135101,112558] 0 2024-04-12T13:41:59.358 INFO:tasks.workunit.client.0.smithi060.stdout:4/300: dwrite d6/d21/f53 [0,4194304] 0 2024-04-12T13:41:59.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/405: getdents d1/d7/da/dc/d3a 0 2024-04-12T13:41:59.362 INFO:tasks.workunit.client.0.smithi060.stdout:1/411: rmdir d1e/d23 39 2024-04-12T13:41:59.362 INFO:tasks.workunit.client.0.smithi060.stdout:1/412: readlink l12 0 2024-04-12T13:41:59.363 INFO:tasks.workunit.client.1.smithi110.stdout:4/425: mknod d0/de/c92 0 2024-04-12T13:41:59.364 INFO:tasks.workunit.client.0.smithi060.stdout:1/413: write d1e/f28 [9393735,12314] 0 2024-04-12T13:41:59.368 INFO:tasks.workunit.client.1.smithi110.stdout:1/273: rename de/d1d/f57 to de/d14/f65 0 2024-04-12T13:41:59.370 INFO:tasks.workunit.client.1.smithi110.stdout:1/274: chown de/d15/d32 2443 1 2024-04-12T13:41:59.370 INFO:tasks.workunit.client.1.smithi110.stdout:8/311: creat d1/d3/d46/f63 x:0 0 0 2024-04-12T13:41:59.372 INFO:tasks.workunit.client.0.smithi060.stdout:1/414: rmdir d1e/d46/d8d 39 2024-04-12T13:41:59.373 INFO:tasks.workunit.client.1.smithi110.stdout:5/273: dread da/d2e/d45/f1e [0,4194304] 0 2024-04-12T13:41:59.374 INFO:tasks.workunit.client.0.smithi060.stdout:4/301: creat d6/d7/dd/d1a/d57/d63/d68/f6c x:0 0 0 2024-04-12T13:41:59.375 INFO:tasks.workunit.client.1.smithi110.stdout:5/274: chown da/d2e/f30 488 1 2024-04-12T13:41:59.380 INFO:tasks.workunit.client.1.smithi110.stdout:6/334: sync 2024-04-12T13:41:59.380 INFO:tasks.workunit.client.0.smithi060.stdout:4/302: mknod d6/d21/c6d 0 2024-04-12T13:41:59.381 INFO:tasks.workunit.client.1.smithi110.stdout:9/394: getdents df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/d89 0 2024-04-12T13:41:59.382 INFO:tasks.workunit.client.1.smithi110.stdout:9/395: stat df/c10 0 2024-04-12T13:41:59.382 INFO:tasks.workunit.client.1.smithi110.stdout:8/312: dread d1/d5/dd/ff [0,4194304] 0 2024-04-12T13:41:59.383 INFO:tasks.workunit.client.1.smithi110.stdout:9/396: chown df/d13/d2c/d2d/d39 498600 1 2024-04-12T13:41:59.383 INFO:tasks.workunit.client.0.smithi060.stdout:0/299: getdents d7/d9/d14/d4a 0 2024-04-12T13:41:59.383 INFO:tasks.workunit.client.1.smithi110.stdout:7/321: truncate d1/d3/f20 7089910 0 2024-04-12T13:41:59.387 INFO:tasks.workunit.client.0.smithi060.stdout:1/415: rmdir d1e/d46/d8d 39 2024-04-12T13:41:59.388 INFO:tasks.workunit.client.0.smithi060.stdout:9/257: dwrite d4/d9/d19/f1a [0,4194304] 0 2024-04-12T13:41:59.389 INFO:tasks.workunit.client.1.smithi110.stdout:2/338: creat d6/d18/d19/f5e x:0 0 0 2024-04-12T13:41:59.391 INFO:tasks.workunit.client.0.smithi060.stdout:4/303: symlink d6/d7/dd/d1a/d56/l6e 0 2024-04-12T13:41:59.392 INFO:tasks.workunit.client.1.smithi110.stdout:8/313: mkdir d1/d3/d35/d3a/d3e/d64 0 2024-04-12T13:41:59.393 INFO:tasks.workunit.client.1.smithi110.stdout:4/426: dwrite d0/d19/d26/f40 [0,4194304] 0 2024-04-12T13:41:59.394 INFO:tasks.workunit.client.1.smithi110.stdout:4/427: fsync d0/de/d32/f7d 0 2024-04-12T13:41:59.395 INFO:tasks.workunit.client.1.smithi110.stdout:9/397: mkdir df/d8a 0 2024-04-12T13:41:59.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/304: truncate d6/d7/db/f3c 1287001 0 2024-04-12T13:41:59.396 INFO:tasks.workunit.client.0.smithi060.stdout:9/258: truncate d4/d9/d19/f34 365466 0 2024-04-12T13:41:59.399 INFO:tasks.workunit.client.1.smithi110.stdout:7/322: unlink d1/d3/d4/l14 0 2024-04-12T13:41:59.401 INFO:tasks.workunit.client.0.smithi060.stdout:1/416: mknod d1e/d29/d6d/c93 0 2024-04-12T13:41:59.402 INFO:tasks.workunit.client.1.smithi110.stdout:3/310: link d5/dc/d20/c29 d5/dc/d20/d61/c6a 0 2024-04-12T13:41:59.403 INFO:tasks.workunit.client.1.smithi110.stdout:1/275: fsync de/f30 0 2024-04-12T13:41:59.405 INFO:tasks.workunit.client.1.smithi110.stdout:0/246: creat d1/d27/d43/d4a/f4f x:0 0 0 2024-04-12T13:41:59.405 INFO:tasks.workunit.client.1.smithi110.stdout:5/275: symlink da/db/d52/l5f 0 2024-04-12T13:41:59.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/300: dwrite d7/d9/d14/d35/f6b [0,4194304] 0 2024-04-12T13:41:59.415 INFO:tasks.workunit.client.1.smithi110.stdout:8/314: dread d1/d3/f24 [0,4194304] 0 2024-04-12T13:41:59.443 INFO:tasks.workunit.client.0.smithi060.stdout:9/259: rename d4/d9/d19/d21/l42 to d4/d33/d50/l56 0 2024-04-12T13:41:59.445 INFO:tasks.workunit.client.1.smithi110.stdout:6/335: unlink d7/d25/f36 0 2024-04-12T13:41:59.454 INFO:tasks.workunit.client.1.smithi110.stdout:7/323: rename d1/d1b/d33/l5b to d1/d3/d4/d55/l6c 0 2024-04-12T13:41:59.464 INFO:tasks.workunit.client.1.smithi110.stdout:9/398: dread df/d13/d2c/d2d/d39/d3a/d4e/f57 [0,4194304] 0 2024-04-12T13:41:59.466 INFO:tasks.workunit.client.1.smithi110.stdout:4/428: dread d0/d19/f2e [0,4194304] 0 2024-04-12T13:41:59.467 INFO:tasks.workunit.client.1.smithi110.stdout:4/429: chown d0/d19/d1c/f60 18728 1 2024-04-12T13:41:59.467 INFO:tasks.workunit.client.0.smithi060.stdout:9/260: dread d4/d9/f3e [0,4194304] 0 2024-04-12T13:41:59.469 INFO:tasks.workunit.client.0.smithi060.stdout:9/261: write d4/d25/f49 [902736,105632] 0 2024-04-12T13:41:59.476 INFO:tasks.workunit.client.1.smithi110.stdout:9/399: dwrite df/d38/f88 [0,4194304] 0 2024-04-12T13:41:59.479 INFO:tasks.workunit.client.1.smithi110.stdout:9/400: dread - df/d13/d26/d37/d6a/f76 zero size 2024-04-12T13:41:59.595 INFO:tasks.workunit.client.1.smithi110.stdout:3/311: creat d5/dc/d31/d3b/f6b x:0 0 0 2024-04-12T13:41:59.600 INFO:tasks.workunit.client.0.smithi060.stdout:1/417: fdatasync d1e/d23/d2e/d30/f5f 0 2024-04-12T13:41:59.603 INFO:tasks.workunit.client.0.smithi060.stdout:0/301: getdents d7/d9/d14/d35/d44/d49/d67 0 2024-04-12T13:41:59.603 INFO:tasks.workunit.client.1.smithi110.stdout:5/276: creat da/db/d3b/d40/f60 x:0 0 0 2024-04-12T13:41:59.604 INFO:tasks.workunit.client.1.smithi110.stdout:8/315: symlink d1/d5/d1f/l65 0 2024-04-12T13:41:59.606 INFO:tasks.workunit.client.1.smithi110.stdout:6/336: creat d7/d25/d30/d44/d3d/f69 x:0 0 0 2024-04-12T13:41:59.608 INFO:tasks.workunit.client.1.smithi110.stdout:6/337: readlink d7/d10/d1c/d4d/l52 0 2024-04-12T13:41:59.610 INFO:tasks.workunit.client.1.smithi110.stdout:2/339: creat d6/d18/d19/d5d/f5f x:0 0 0 2024-04-12T13:41:59.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/305: link d6/d7/dd/d1a/c1c d6/d7/dd/d1a/d57/d63/d68/c6f 0 2024-04-12T13:41:59.627 INFO:tasks.workunit.client.0.smithi060.stdout:0/302: unlink d7/d33/c60 0 2024-04-12T13:41:59.627 INFO:tasks.workunit.client.1.smithi110.stdout:6/338: dwrite d7/d25/d30/f4e [0,4194304] 0 2024-04-12T13:41:59.632 INFO:tasks.workunit.client.0.smithi060.stdout:9/262: dread d4/d9/d19/d21/f1c [0,4194304] 0 2024-04-12T13:41:59.634 INFO:tasks.workunit.client.0.smithi060.stdout:9/263: fsync d4/d9/d19/f1a 0 2024-04-12T13:41:59.636 INFO:tasks.workunit.client.1.smithi110.stdout:3/312: symlink d5/dc/d20/d2d/d4e/l6c 0 2024-04-12T13:41:59.637 INFO:tasks.workunit.client.0.smithi060.stdout:9/264: truncate d4/d9/f3f 709844 0 2024-04-12T13:41:59.638 INFO:tasks.workunit.client.0.smithi060.stdout:9/265: stat d4/l48 0 2024-04-12T13:41:59.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/266: rename d4/d33 to d4/d33/d57 22 2024-04-12T13:41:59.645 INFO:tasks.workunit.client.0.smithi060.stdout:4/306: link d6/d7/db/f4b d6/f70 0 2024-04-12T13:41:59.649 INFO:tasks.workunit.client.1.smithi110.stdout:2/340: creat d6/d18/d19/d4a/d55/f60 x:0 0 0 2024-04-12T13:41:59.650 INFO:tasks.workunit.client.0.smithi060.stdout:0/303: dwrite d7/d9/f1a [0,4194304] 0 2024-04-12T13:41:59.653 INFO:tasks.workunit.client.1.smithi110.stdout:3/313: dwrite d5/dc/f11 [0,4194304] 0 2024-04-12T13:41:59.654 INFO:tasks.workunit.client.0.smithi060.stdout:8/311: sync 2024-04-12T13:41:59.654 INFO:tasks.workunit.client.0.smithi060.stdout:2/292: sync 2024-04-12T13:41:59.658 INFO:tasks.workunit.client.1.smithi110.stdout:3/314: write d5/dc/d31/d3b/d32/f37 [3984920,13794] 0 2024-04-12T13:41:59.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/307: dwrite d6/f3a [0,4194304] 0 2024-04-12T13:41:59.673 INFO:tasks.workunit.client.0.smithi060.stdout:9/267: rename d4/d25/c36 to d4/d8/d32/c58 0 2024-04-12T13:41:59.674 INFO:tasks.workunit.client.1.smithi110.stdout:6/339: dwrite d7/d25/d30/d44/f1d [0,4194304] 0 2024-04-12T13:41:59.679 INFO:tasks.workunit.client.1.smithi110.stdout:2/341: unlink d6/d18/d19/d4a/d3c/f44 0 2024-04-12T13:41:59.679 INFO:tasks.workunit.client.1.smithi110.stdout:6/340: write d7/d25/d30/d44/f1d [4807329,89512] 0 2024-04-12T13:41:59.680 INFO:tasks.workunit.client.0.smithi060.stdout:2/293: dwrite d6/d13/d31/f41 [0,4194304] 0 2024-04-12T13:41:59.682 INFO:tasks.workunit.client.1.smithi110.stdout:2/342: read - d6/d18/d19/d4a/f5b zero size 2024-04-12T13:41:59.694 INFO:tasks.workunit.client.0.smithi060.stdout:9/268: mknod d4/d33/c59 0 2024-04-12T13:41:59.695 INFO:tasks.workunit.client.1.smithi110.stdout:3/315: creat d5/dc/d20/d2d/d4e/f6d x:0 0 0 2024-04-12T13:41:59.696 INFO:tasks.workunit.client.0.smithi060.stdout:9/269: readlink d4/d9/l54 0 2024-04-12T13:41:59.697 INFO:tasks.workunit.client.1.smithi110.stdout:3/316: write d5/dc/d31/d3b/d32/f3f [216119,23217] 0 2024-04-12T13:41:59.697 INFO:tasks.workunit.client.0.smithi060.stdout:9/270: fdatasync d4/d25/f49 0 2024-04-12T13:41:59.699 INFO:tasks.workunit.client.0.smithi060.stdout:9/271: chown d4/d8/f2e 13306 1 2024-04-12T13:41:59.710 INFO:tasks.workunit.client.0.smithi060.stdout:2/294: dread d6/f1b [0,4194304] 0 2024-04-12T13:41:59.711 INFO:tasks.workunit.client.0.smithi060.stdout:4/308: truncate d6/d7/dd/d1a/d19/f52 1444412 0 2024-04-12T13:41:59.712 INFO:tasks.workunit.client.0.smithi060.stdout:2/295: chown d6/d10/d16/f1c 1199 1 2024-04-12T13:41:59.714 INFO:tasks.workunit.client.1.smithi110.stdout:3/317: mknod d5/dc/d20/d2d/c6e 0 2024-04-12T13:41:59.716 INFO:tasks.workunit.client.1.smithi110.stdout:1/276: rename de/l2a to de/d14/l66 0 2024-04-12T13:41:59.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/272: mknod d4/d25/c5a 0 2024-04-12T13:41:59.717 INFO:tasks.workunit.client.0.smithi060.stdout:0/304: link d7/d9/d14/d35/d3c/l69 d7/d9/d14/d35/d3c/l71 0 2024-04-12T13:41:59.720 INFO:tasks.workunit.client.1.smithi110.stdout:3/318: readlink d5/dc/d31/d3b/d32/l63 0 2024-04-12T13:41:59.720 INFO:tasks.workunit.client.1.smithi110.stdout:6/341: dwrite d7/d25/d30/d44/d3d/f5b [0,4194304] 0 2024-04-12T13:41:59.720 INFO:tasks.workunit.client.0.smithi060.stdout:0/305: truncate d7/d9/de/f43 810530 0 2024-04-12T13:41:59.723 INFO:tasks.workunit.client.1.smithi110.stdout:3/319: write d5/dc/d20/d61/f62 [389083,72584] 0 2024-04-12T13:41:59.725 INFO:tasks.workunit.client.1.smithi110.stdout:6/342: write d7/d25/d30/d44/d3d/f69 [526916,42740] 0 2024-04-12T13:41:59.726 INFO:tasks.workunit.client.1.smithi110.stdout:1/277: readlink de/d15/d32/l3b 0 2024-04-12T13:41:59.727 INFO:tasks.workunit.client.0.smithi060.stdout:9/273: creat d4/d8/d32/f5b x:0 0 0 2024-04-12T13:41:59.728 INFO:tasks.workunit.client.0.smithi060.stdout:0/306: creat d7/d33/d5b/f72 x:0 0 0 2024-04-12T13:41:59.729 INFO:tasks.workunit.client.1.smithi110.stdout:2/343: dwrite d6/dc/d13/f43 [0,4194304] 0 2024-04-12T13:41:59.729 INFO:tasks.workunit.client.1.smithi110.stdout:1/278: fsync f6 0 2024-04-12T13:41:59.732 INFO:tasks.workunit.client.1.smithi110.stdout:1/279: stat de/d14 0 2024-04-12T13:41:59.732 INFO:tasks.workunit.client.0.smithi060.stdout:2/296: dwrite d6/d10/f57 [0,4194304] 0 2024-04-12T13:41:59.740 INFO:tasks.workunit.client.0.smithi060.stdout:9/274: mkdir d4/d33/d50/d5c 0 2024-04-12T13:41:59.745 INFO:tasks.workunit.client.1.smithi110.stdout:0/247: write d1/d8/f10 [831957,107785] 0 2024-04-12T13:41:59.745 INFO:tasks.workunit.client.0.smithi060.stdout:4/309: link d6/d7/db/f3c d6/d2f/d51/f71 0 2024-04-12T13:41:59.747 INFO:tasks.workunit.client.1.smithi110.stdout:4/430: symlink d0/d19/l93 0 2024-04-12T13:41:59.748 INFO:tasks.workunit.client.0.smithi060.stdout:2/297: truncate d6/d56/f2d 1111664 0 2024-04-12T13:41:59.751 INFO:tasks.workunit.client.1.smithi110.stdout:6/343: link d7/d25/d2c/f40 d7/d10/d1c/f6a 0 2024-04-12T13:41:59.751 INFO:tasks.workunit.client.0.smithi060.stdout:0/307: dwrite d7/d9/d14/d35/d3c/f42 [0,4194304] 0 2024-04-12T13:41:59.752 INFO:tasks.workunit.client.1.smithi110.stdout:4/431: fsync d0/d19/d26/d8a/f8d 0 2024-04-12T13:41:59.754 INFO:tasks.workunit.client.1.smithi110.stdout:3/320: dwrite d5/dc/d31/f45 [0,4194304] 0 2024-04-12T13:41:59.755 INFO:tasks.workunit.client.1.smithi110.stdout:2/344: creat d6/dc/dd/d49/f61 x:0 0 0 2024-04-12T13:41:59.756 INFO:tasks.workunit.client.0.smithi060.stdout:4/310: creat d6/d7/db/f72 x:0 0 0 2024-04-12T13:41:59.757 INFO:tasks.workunit.client.1.smithi110.stdout:1/280: dwrite de/d14/d34/d55/f63 [0,4194304] 0 2024-04-12T13:41:59.757 INFO:tasks.workunit.client.1.smithi110.stdout:4/432: write d0/d78/f81 [128342,103545] 0 2024-04-12T13:41:59.760 INFO:tasks.workunit.client.1.smithi110.stdout:4/433: truncate d0/de/d2c/f4d 1168067 0 2024-04-12T13:41:59.761 INFO:tasks.workunit.client.1.smithi110.stdout:0/248: truncate d1/f26 1183140 0 2024-04-12T13:41:59.768 INFO:tasks.workunit.client.0.smithi060.stdout:2/298: link d6/d13/f34 d6/d13/d31/d33/d3d/f59 0 2024-04-12T13:41:59.773 INFO:tasks.workunit.client.1.smithi110.stdout:3/321: dread d5/dc/d31/d3b/d32/f37 [0,4194304] 0 2024-04-12T13:41:59.775 INFO:tasks.workunit.client.1.smithi110.stdout:3/322: write d5/dc/d20/d2d/f42 [258401,54262] 0 2024-04-12T13:41:59.777 INFO:tasks.workunit.client.0.smithi060.stdout:0/308: dwrite d7/f3e [0,4194304] 0 2024-04-12T13:41:59.791 INFO:tasks.workunit.client.1.smithi110.stdout:4/434: creat d0/de/d2c/d57/f94 x:0 0 0 2024-04-12T13:41:59.791 INFO:tasks.workunit.client.1.smithi110.stdout:2/345: fdatasync d6/dc/f33 0 2024-04-12T13:41:59.793 INFO:tasks.workunit.client.0.smithi060.stdout:0/309: readlink d7/d41/l54 0 2024-04-12T13:41:59.794 INFO:tasks.workunit.client.0.smithi060.stdout:2/299: dwrite d6/d10/d16/f1c [0,4194304] 0 2024-04-12T13:41:59.795 INFO:tasks.workunit.client.1.smithi110.stdout:2/346: write d6/dc/dd/f22 [1996057,79302] 0 2024-04-12T13:41:59.797 INFO:tasks.workunit.client.1.smithi110.stdout:2/347: chown d6/d18/d19/d4a/d3c/d50 42458 1 2024-04-12T13:41:59.801 INFO:tasks.workunit.client.1.smithi110.stdout:9/401: write df/d13/d2c/d2d/d39/d3a/d4e/d83/f7d [352366,124114] 0 2024-04-12T13:41:59.803 INFO:tasks.workunit.client.0.smithi060.stdout:2/300: dread d6/f1b [0,4194304] 0 2024-04-12T13:41:59.805 INFO:tasks.workunit.client.0.smithi060.stdout:2/301: dread - d6/d10/f44 zero size 2024-04-12T13:41:59.807 INFO:tasks.workunit.client.0.smithi060.stdout:0/310: mknod d7/d9/d4c/c73 0 2024-04-12T13:41:59.808 INFO:tasks.workunit.client.0.smithi060.stdout:0/311: readlink d7/d9/l1d 0 2024-04-12T13:41:59.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/302: truncate d6/d13/d31/f41 5124958 0 2024-04-12T13:41:59.810 INFO:tasks.workunit.client.1.smithi110.stdout:6/344: mkdir d7/d25/d30/d6b 0 2024-04-12T13:41:59.811 INFO:tasks.workunit.client.0.smithi060.stdout:2/303: chown d6/f8 43 1 2024-04-12T13:41:59.813 INFO:tasks.workunit.client.0.smithi060.stdout:7/252: sync 2024-04-12T13:41:59.814 INFO:tasks.workunit.client.0.smithi060.stdout:3/297: sync 2024-04-12T13:41:59.815 INFO:tasks.workunit.client.0.smithi060.stdout:0/312: mkdir d7/d9/d14/d35/d44/d49/d74 0 2024-04-12T13:41:59.816 INFO:tasks.workunit.client.1.smithi110.stdout:6/345: chown d7/d10/d1c/d2b/d48/d54/f5d 1347550641 1 2024-04-12T13:41:59.816 INFO:tasks.workunit.client.0.smithi060.stdout:3/298: chown d7/da/f2c 15014084 1 2024-04-12T13:41:59.817 INFO:tasks.workunit.client.1.smithi110.stdout:6/346: readlink l6 0 2024-04-12T13:41:59.817 INFO:tasks.workunit.client.0.smithi060.stdout:3/299: chown d7/da/d3f/d5c/d25/f44 0 1 2024-04-12T13:41:59.818 INFO:tasks.workunit.client.1.smithi110.stdout:3/323: dread d5/dc/d31/d3b/f4b [0,4194304] 0 2024-04-12T13:41:59.820 INFO:tasks.workunit.client.1.smithi110.stdout:0/249: dread d1/d11/f41 [0,4194304] 0 2024-04-12T13:41:59.821 INFO:tasks.workunit.client.0.smithi060.stdout:0/313: creat d7/d9/d4c/f75 x:0 0 0 2024-04-12T13:41:59.822 INFO:tasks.workunit.client.0.smithi060.stdout:0/314: write d7/f26 [60777,78087] 0 2024-04-12T13:41:59.823 INFO:tasks.workunit.client.1.smithi110.stdout:7/324: dwrite d1/f38 [0,4194304] 0 2024-04-12T13:41:59.823 INFO:tasks.workunit.client.1.smithi110.stdout:9/402: dwrite df/f11 [0,4194304] 0 2024-04-12T13:41:59.824 INFO:tasks.workunit.client.0.smithi060.stdout:3/300: symlink d7/da/d3f/d5c/d25/l64 0 2024-04-12T13:41:59.825 INFO:tasks.workunit.client.1.smithi110.stdout:7/325: fsync d1/d31/f59 0 2024-04-12T13:41:59.825 INFO:tasks.workunit.client.1.smithi110.stdout:6/347: dread d7/d25/f56 [0,4194304] 0 2024-04-12T13:41:59.826 INFO:tasks.workunit.client.0.smithi060.stdout:3/301: dread - d7/d17/d19/f4e zero size 2024-04-12T13:41:59.828 INFO:tasks.workunit.client.1.smithi110.stdout:8/316: dwrite d1/d3/fe [4194304,4194304] 0 2024-04-12T13:41:59.828 INFO:tasks.workunit.client.0.smithi060.stdout:7/253: dwrite d0/d7/f55 [0,4194304] 0 2024-04-12T13:41:59.831 INFO:tasks.workunit.client.1.smithi110.stdout:8/317: truncate d1/d3/d46/f63 88528 0 2024-04-12T13:41:59.832 INFO:tasks.workunit.client.1.smithi110.stdout:8/318: dread - d1/f5c zero size 2024-04-12T13:41:59.834 INFO:tasks.workunit.client.1.smithi110.stdout:8/319: chown d1/d7/d20/l2e 441 1 2024-04-12T13:41:59.835 INFO:tasks.workunit.client.0.smithi060.stdout:2/304: creat d6/f5a x:0 0 0 2024-04-12T13:41:59.836 INFO:tasks.workunit.client.0.smithi060.stdout:2/305: read d6/d10/f57 [144255,20653] 0 2024-04-12T13:41:59.836 INFO:tasks.workunit.client.0.smithi060.stdout:7/254: write d0/d7/f33 [1938319,66590] 0 2024-04-12T13:41:59.841 INFO:tasks.workunit.client.0.smithi060.stdout:2/306: readlink d6/d13/d31/d33/l45 0 2024-04-12T13:41:59.844 INFO:tasks.workunit.client.1.smithi110.stdout:4/435: mknod d0/d19/d8f/c95 0 2024-04-12T13:41:59.846 INFO:tasks.workunit.client.1.smithi110.stdout:4/436: chown d0/de/d32/d5f/f7c 16096 1 2024-04-12T13:41:59.847 INFO:tasks.workunit.client.1.smithi110.stdout:3/324: chown d5/l7 0 1 2024-04-12T13:41:59.849 INFO:tasks.workunit.client.1.smithi110.stdout:4/437: chown d0/d19/d1c/d50/d6f/l88 235 1 2024-04-12T13:41:59.849 INFO:tasks.workunit.client.1.smithi110.stdout:3/325: dread - d5/dc/d20/d2d/d4e/f66 zero size 2024-04-12T13:41:59.850 INFO:tasks.workunit.client.1.smithi110.stdout:0/250: creat d1/d27/d31/f50 x:0 0 0 2024-04-12T13:41:59.859 INFO:tasks.workunit.client.0.smithi060.stdout:7/255: dread d0/d7/f10 [0,4194304] 0 2024-04-12T13:41:59.860 INFO:tasks.workunit.client.0.smithi060.stdout:1/418: mkdir d1e/d94 0 2024-04-12T13:41:59.861 INFO:tasks.workunit.client.0.smithi060.stdout:2/307: rmdir d6/d56 39 2024-04-12T13:41:59.861 INFO:tasks.workunit.client.0.smithi060.stdout:1/419: chown d1e/d23/d2e/f39 22 1 2024-04-12T13:41:59.864 INFO:tasks.workunit.client.1.smithi110.stdout:3/326: dread d5/dc/f19 [0,4194304] 0 2024-04-12T13:41:59.867 INFO:tasks.workunit.client.0.smithi060.stdout:3/302: rmdir d7/da/d3f/d5c/d25/d5e 0 2024-04-12T13:41:59.868 INFO:tasks.workunit.client.0.smithi060.stdout:3/303: truncate f0 2849224 0 2024-04-12T13:41:59.869 INFO:tasks.workunit.client.1.smithi110.stdout:4/438: fdatasync d0/de/f36 0 2024-04-12T13:41:59.870 INFO:tasks.workunit.client.0.smithi060.stdout:7/256: creat d0/d1b/f5b x:0 0 0 2024-04-12T13:41:59.872 INFO:tasks.workunit.client.1.smithi110.stdout:0/251: write d1/f22 [8600012,40085] 0 2024-04-12T13:41:59.873 INFO:tasks.workunit.client.1.smithi110.stdout:9/403: dread fd [0,4194304] 0 2024-04-12T13:41:59.878 INFO:tasks.workunit.client.1.smithi110.stdout:0/252: dread d1/d8/f2e [0,4194304] 0 2024-04-12T13:41:59.951 INFO:tasks.workunit.client.1.smithi110.stdout:8/320: link d1/d3/d35/d3a/d41/f51 d1/d5/d1f/f66 0 2024-04-12T13:41:59.954 INFO:tasks.workunit.client.1.smithi110.stdout:3/327: symlink d5/dc/d20/d61/l6f 0 2024-04-12T13:41:59.955 INFO:tasks.workunit.client.1.smithi110.stdout:8/321: read d1/d3/d3c/f2f [2044908,66109] 0 2024-04-12T13:41:59.955 INFO:tasks.workunit.client.0.smithi060.stdout:2/308: mkdir d6/d13/d5b 0 2024-04-12T13:41:59.957 INFO:tasks.workunit.client.0.smithi060.stdout:2/309: readlink d6/d13/d31/d33/l45 0 2024-04-12T13:41:59.960 INFO:tasks.workunit.client.1.smithi110.stdout:4/439: mknod d0/de/c96 0 2024-04-12T13:41:59.960 INFO:tasks.workunit.client.1.smithi110.stdout:8/322: read d1/d5/f4a [158715,43331] 0 2024-04-12T13:41:59.963 INFO:tasks.workunit.client.1.smithi110.stdout:8/323: chown d1/d5/dd 112401635 1 2024-04-12T13:41:59.969 INFO:tasks.workunit.client.1.smithi110.stdout:9/404: unlink df/c10 0 2024-04-12T13:41:59.971 INFO:tasks.workunit.client.0.smithi060.stdout:2/310: creat d6/d13/d17/f5c x:0 0 0 2024-04-12T13:41:59.972 INFO:tasks.workunit.client.1.smithi110.stdout:9/405: chown df/d13/d26/d37/d49 364483 1 2024-04-12T13:41:59.973 INFO:tasks.workunit.client.1.smithi110.stdout:5/277: rename da/d2e/d45/d25/d3d to da/db/d61 0 2024-04-12T13:41:59.977 INFO:tasks.workunit.client.0.smithi060.stdout:9/275: rename d4/c1d to d4/d9/d19/c5d 0 2024-04-12T13:41:59.978 INFO:tasks.workunit.client.1.smithi110.stdout:0/253: read d1/d8/fb [2470253,30985] 0 2024-04-12T13:41:59.979 INFO:tasks.workunit.client.1.smithi110.stdout:7/326: creat d1/d3/f6d x:0 0 0 2024-04-12T13:41:59.983 INFO:tasks.workunit.client.0.smithi060.stdout:3/304: getdents d7/da/d3f/d5c 0 2024-04-12T13:41:59.988 INFO:tasks.workunit.client.1.smithi110.stdout:3/328: symlink d5/dc/d31/d3b/d5b/l70 0 2024-04-12T13:41:59.992 INFO:tasks.workunit.client.1.smithi110.stdout:4/440: creat d0/d19/d1c/d50/d6f/f97 x:0 0 0 2024-04-12T13:41:59.997 INFO:tasks.workunit.client.0.smithi060.stdout:0/315: rename d7/d9/d14/d35/d44/d49/f51 to d7/d9/d14/d35/d44/d49/d67/f76 0 2024-04-12T13:41:59.999 INFO:tasks.workunit.client.0.smithi060.stdout:4/311: dwrite d6/d7/dd/df/f18 [0,4194304] 0 2024-04-12T13:42:00.000 INFO:tasks.workunit.client.1.smithi110.stdout:1/281: rename de/f2f to de/d15/d32/d61/f67 0 2024-04-12T13:42:00.001 INFO:tasks.workunit.client.0.smithi060.stdout:2/311: symlink d6/d13/l5d 0 2024-04-12T13:42:00.003 INFO:tasks.workunit.client.0.smithi060.stdout:8/312: sync 2024-04-12T13:42:00.003 INFO:tasks.workunit.client.0.smithi060.stdout:6/406: sync 2024-04-12T13:42:00.003 INFO:tasks.workunit.client.0.smithi060.stdout:5/354: sync 2024-04-12T13:42:00.004 INFO:tasks.workunit.client.0.smithi060.stdout:7/257: link d0/d7/l20 d0/l5c 0 2024-04-12T13:42:00.004 INFO:tasks.workunit.client.1.smithi110.stdout:1/282: chown de/d15/d32/f44 16321935 1 2024-04-12T13:42:00.009 INFO:tasks.workunit.client.1.smithi110.stdout:6/348: getdents d7/d25 0 2024-04-12T13:42:00.009 INFO:tasks.workunit.client.0.smithi060.stdout:9/276: dread d4/d9/f3e [0,4194304] 0 2024-04-12T13:42:00.010 INFO:tasks.workunit.client.1.smithi110.stdout:1/283: chown de/d14/d34/d55/f63 335 1 2024-04-12T13:42:00.011 INFO:tasks.workunit.client.0.smithi060.stdout:3/305: dread d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:42:00.013 INFO:tasks.workunit.client.1.smithi110.stdout:0/254: write d1/d8/f2e [586901,5329] 0 2024-04-12T13:42:00.014 INFO:tasks.workunit.client.1.smithi110.stdout:7/327: symlink d1/d3/d43/l6e 0 2024-04-12T13:42:00.014 INFO:tasks.workunit.client.0.smithi060.stdout:0/316: creat d7/d9/d14/d35/d44/f77 x:0 0 0 2024-04-12T13:42:00.015 INFO:tasks.workunit.client.0.smithi060.stdout:0/317: chown d7/d9/d14/f5c 515234 1 2024-04-12T13:42:00.016 INFO:tasks.workunit.client.0.smithi060.stdout:4/312: creat d6/d21/d29/f73 x:0 0 0 2024-04-12T13:42:00.017 INFO:tasks.workunit.client.1.smithi110.stdout:3/329: symlink d5/dc/d31/d3b/d5b/l71 0 2024-04-12T13:42:00.022 INFO:tasks.workunit.client.1.smithi110.stdout:3/330: chown d5/dc/f13 1 1 2024-04-12T13:42:00.023 INFO:tasks.workunit.client.0.smithi060.stdout:6/407: creat d1/d7/da/dc/d24/f96 x:0 0 0 2024-04-12T13:42:00.024 INFO:tasks.workunit.client.0.smithi060.stdout:6/408: readlink d1/l13 0 2024-04-12T13:42:00.029 INFO:tasks.workunit.client.1.smithi110.stdout:9/406: link df/d13/d26/f28 df/d38/d6e/d7f/f8b 0 2024-04-12T13:42:00.031 INFO:tasks.workunit.client.1.smithi110.stdout:2/348: truncate d6/dc/d13/f43 68129 0 2024-04-12T13:42:00.031 INFO:tasks.workunit.client.0.smithi060.stdout:9/277: rename d4/d9/d19/d21/f1c to d4/d25/f5e 0 2024-04-12T13:42:00.033 INFO:tasks.workunit.client.1.smithi110.stdout:4/441: mkdir d0/d19/d26/d65/d7e/d98 0 2024-04-12T13:42:00.035 INFO:tasks.workunit.client.1.smithi110.stdout:4/442: stat d0/c3a 0 2024-04-12T13:42:00.035 INFO:tasks.workunit.client.1.smithi110.stdout:0/255: write d1/d8/f3d [613007,34065] 0 2024-04-12T13:42:00.036 INFO:tasks.workunit.client.0.smithi060.stdout:7/258: fsync d0/d1b/f5b 0 2024-04-12T13:42:00.039 INFO:tasks.workunit.client.1.smithi110.stdout:2/349: write d6/d18/d19/f2c [3270633,70129] 0 2024-04-12T13:42:00.041 INFO:tasks.workunit.client.1.smithi110.stdout:3/331: rename d5/dc/d20/d61/l6f to d5/dc/d20/d2d/l72 0 2024-04-12T13:42:00.043 INFO:tasks.workunit.client.1.smithi110.stdout:5/278: dwrite da/db/f31 [4194304,4194304] 0 2024-04-12T13:42:00.044 INFO:tasks.workunit.client.1.smithi110.stdout:0/256: write d1/d27/d31/f50 [974070,44678] 0 2024-04-12T13:42:00.047 INFO:tasks.workunit.client.1.smithi110.stdout:3/332: readlink d5/dc/d31/d3b/d5b/l71 0 2024-04-12T13:42:00.048 INFO:tasks.workunit.client.0.smithi060.stdout:1/420: sync 2024-04-12T13:42:00.049 INFO:tasks.workunit.client.0.smithi060.stdout:9/278: dwrite d4/d9/d19/f4e [0,4194304] 0 2024-04-12T13:42:00.053 INFO:tasks.workunit.client.1.smithi110.stdout:5/279: read da/db/f1d [616553,110098] 0 2024-04-12T13:42:00.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/312: creat d6/d56/d43/f5e x:0 0 0 2024-04-12T13:42:00.053 INFO:tasks.workunit.client.0.smithi060.stdout:9/279: write d4/d9/d19/d21/f2f [491032,22038] 0 2024-04-12T13:42:00.058 INFO:tasks.workunit.client.0.smithi060.stdout:6/409: mkdir d1/d7/da/dc/d24/d34/d51/d97 0 2024-04-12T13:42:00.065 INFO:tasks.workunit.client.0.smithi060.stdout:3/306: mknod d7/c65 0 2024-04-12T13:42:00.067 INFO:tasks.workunit.client.0.smithi060.stdout:1/421: dread d1e/d23/d49/f54 [0,4194304] 0 2024-04-12T13:42:00.069 INFO:tasks.workunit.client.0.smithi060.stdout:1/422: stat d1e/d1f/f22 0 2024-04-12T13:42:00.069 INFO:tasks.workunit.client.1.smithi110.stdout:2/350: dwrite d6/d18/d19/d4a/f5b [0,4194304] 0 2024-04-12T13:42:00.069 INFO:tasks.workunit.client.1.smithi110.stdout:7/328: link d1/d3/d43/l6e d1/d31/l6f 0 2024-04-12T13:42:00.072 INFO:tasks.workunit.client.1.smithi110.stdout:0/257: dwrite d1/d8/f21 [0,4194304] 0 2024-04-12T13:42:00.074 INFO:tasks.workunit.client.1.smithi110.stdout:3/333: symlink d5/dc/d20/l73 0 2024-04-12T13:42:00.075 INFO:tasks.workunit.client.0.smithi060.stdout:7/259: chown d0/d3d 0 1 2024-04-12T13:42:00.078 INFO:tasks.workunit.client.0.smithi060.stdout:7/260: chown d0/d7/d43/c52 556686830 1 2024-04-12T13:42:00.079 INFO:tasks.workunit.client.1.smithi110.stdout:5/280: dwrite da/d2e/d45/d29/f2d [0,4194304] 0 2024-04-12T13:42:00.080 INFO:tasks.workunit.client.0.smithi060.stdout:2/313: dwrite d6/f14 [4194304,4194304] 0 2024-04-12T13:42:00.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/314: write d6/d56/f51 [855,86749] 0 2024-04-12T13:42:00.084 INFO:tasks.workunit.client.1.smithi110.stdout:8/324: sync 2024-04-12T13:42:00.089 INFO:tasks.workunit.client.1.smithi110.stdout:2/351: mkdir d6/dc/d1b/d57/d62 0 2024-04-12T13:42:00.095 INFO:tasks.workunit.client.0.smithi060.stdout:6/410: creat d1/d7/da/dc/d24/d30/d52/d5e/f98 x:0 0 0 2024-04-12T13:42:00.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/325: dread d1/d3/d3c/f33 [0,4194304] 0 2024-04-12T13:42:00.109 INFO:tasks.workunit.client.1.smithi110.stdout:8/326: chown d1/d5/d1f/f56 34045 1 2024-04-12T13:42:00.110 INFO:tasks.workunit.client.0.smithi060.stdout:0/318: creat d7/f78 x:0 0 0 2024-04-12T13:42:00.110 INFO:tasks.workunit.client.1.smithi110.stdout:5/281: mknod da/db/d3b/c62 0 2024-04-12T13:42:00.112 INFO:tasks.workunit.client.0.smithi060.stdout:1/423: mknod d1e/d29/d6d/c95 0 2024-04-12T13:42:00.113 INFO:tasks.workunit.client.1.smithi110.stdout:1/284: dwrite de/f10 [0,4194304] 0 2024-04-12T13:42:00.115 INFO:tasks.workunit.client.1.smithi110.stdout:9/407: link df/d13/d2c/d2d/d39/d3a/d4e/f74 df/d13/d2c/d2d/d39/d3a/f8c 0 2024-04-12T13:42:00.116 INFO:tasks.workunit.client.1.smithi110.stdout:6/349: truncate d7/d25/d30/d44/d3d/f47 52750 0 2024-04-12T13:42:00.118 INFO:tasks.workunit.client.0.smithi060.stdout:8/313: write d9/d1b/d37/f39 [538049,130913] 0 2024-04-12T13:42:00.118 INFO:tasks.workunit.client.1.smithi110.stdout:6/350: write d7/d25/f59 [988445,34197] 0 2024-04-12T13:42:00.122 INFO:tasks.workunit.client.1.smithi110.stdout:2/352: creat d6/dc/d1b/d57/f63 x:0 0 0 2024-04-12T13:42:00.125 INFO:tasks.workunit.client.1.smithi110.stdout:4/443: link d0/d19/d1c/l28 d0/l99 0 2024-04-12T13:42:00.125 INFO:tasks.workunit.client.0.smithi060.stdout:2/315: creat d6/d13/d17/f5f x:0 0 0 2024-04-12T13:42:00.125 INFO:tasks.workunit.client.0.smithi060.stdout:3/307: dwrite d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:42:00.126 INFO:tasks.workunit.client.1.smithi110.stdout:4/444: chown d0/d75/d91 351 1 2024-04-12T13:42:00.127 INFO:tasks.workunit.client.1.smithi110.stdout:4/445: stat d0/d19/d1c/l63 0 2024-04-12T13:42:00.128 INFO:tasks.workunit.client.0.smithi060.stdout:5/355: getdents d6/d10/d12/d4c 0 2024-04-12T13:42:00.131 INFO:tasks.workunit.client.0.smithi060.stdout:5/356: stat d6/d10/d12/d15/c37 0 2024-04-12T13:42:00.133 INFO:tasks.workunit.client.0.smithi060.stdout:2/316: dread d6/f24 [0,4194304] 0 2024-04-12T13:42:00.139 INFO:tasks.workunit.client.0.smithi060.stdout:9/280: truncate d4/d9/fc 224128 0 2024-04-12T13:42:00.140 INFO:tasks.workunit.client.1.smithi110.stdout:5/282: mknod da/db/d52/c63 0 2024-04-12T13:42:00.142 INFO:tasks.workunit.client.1.smithi110.stdout:1/285: creat de/d15/d32/f68 x:0 0 0 2024-04-12T13:42:00.145 INFO:tasks.workunit.client.1.smithi110.stdout:1/286: chown de/d14/d34/l4b 525071164 1 2024-04-12T13:42:00.146 INFO:tasks.workunit.client.1.smithi110.stdout:7/329: write d1/d3/d4/f27 [1481053,114241] 0 2024-04-12T13:42:00.146 INFO:tasks.workunit.client.1.smithi110.stdout:4/446: dwrite d0/d78/f81 [0,4194304] 0 2024-04-12T13:42:00.147 INFO:tasks.workunit.client.0.smithi060.stdout:3/308: dwrite d7/f52 [0,4194304] 0 2024-04-12T13:42:00.148 INFO:tasks.workunit.client.1.smithi110.stdout:4/447: write d0/de/d32/f5d [700207,84187] 0 2024-04-12T13:42:00.148 INFO:tasks.workunit.client.0.smithi060.stdout:0/319: symlink d7/d9/d14/d4a/l79 0 2024-04-12T13:42:00.149 INFO:tasks.workunit.client.1.smithi110.stdout:4/448: chown d0/de/d2c/d57/f94 1638 1 2024-04-12T13:42:00.163 INFO:tasks.workunit.client.0.smithi060.stdout:5/357: mkdir d6/d10/d12/d4c/d7c 0 2024-04-12T13:42:00.164 INFO:tasks.workunit.client.1.smithi110.stdout:1/287: dwrite de/d1d/f42 [0,4194304] 0 2024-04-12T13:42:00.166 INFO:tasks.workunit.client.1.smithi110.stdout:3/334: rename d5/dc/d20/d61 to d5/dc/d31/d74 0 2024-04-12T13:42:00.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/327: symlink d1/d45/l67 0 2024-04-12T13:42:00.169 INFO:tasks.workunit.client.0.smithi060.stdout:7/261: write d0/d7/d43/f46 [63356,125186] 0 2024-04-12T13:42:00.171 INFO:tasks.workunit.client.1.smithi110.stdout:8/328: write d1/d5/dd/f27 [2769292,27136] 0 2024-04-12T13:42:00.181 INFO:tasks.workunit.client.1.smithi110.stdout:7/330: unlink d1/d1b/d3d/f3f 0 2024-04-12T13:42:00.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:41:59 smithi060 ceph-mon[29097]: pgmap v24: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 165 MiB/s wr, 300 op/s 2024-04-12T13:42:00.183 INFO:tasks.workunit.client.1.smithi110.stdout:7/331: dread - d1/d3/d4/d55/f62 zero size 2024-04-12T13:42:00.184 INFO:tasks.workunit.client.1.smithi110.stdout:7/332: dread - d1/d31/f59 zero size 2024-04-12T13:42:00.196 INFO:tasks.workunit.client.0.smithi060.stdout:0/320: creat d7/d9/d14/d1b/f7a x:0 0 0 2024-04-12T13:42:00.197 INFO:tasks.workunit.client.1.smithi110.stdout:6/351: dwrite d7/d10/f62 [0,4194304] 0 2024-04-12T13:42:00.199 INFO:tasks.workunit.client.0.smithi060.stdout:0/321: readlink d7/d9/d14/d4a/l5e 0 2024-04-12T13:42:00.199 INFO:tasks.workunit.client.0.smithi060.stdout:8/314: link d9/d1d/d2f/f51 d9/d1b/d37/f6a 0 2024-04-12T13:42:00.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/313: dwrite d6/d7/dd/d1a/d19/f5e [0,4194304] 0 2024-04-12T13:42:00.202 INFO:tasks.workunit.client.1.smithi110.stdout:0/258: rename d1/d27/d4d to d1/d8/d36/d51 0 2024-04-12T13:42:00.203 INFO:tasks.workunit.client.0.smithi060.stdout:6/411: truncate d1/d7/da/dc/f19 1561574 0 2024-04-12T13:42:00.205 INFO:tasks.workunit.client.1.smithi110.stdout:7/333: dread d1/d3/d43/f50 [0,4194304] 0 2024-04-12T13:42:00.208 INFO:tasks.workunit.client.1.smithi110.stdout:9/408: write df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 [1925796,1453] 0 2024-04-12T13:42:00.211 INFO:tasks.workunit.client.1.smithi110.stdout:4/449: unlink d0/ld 0 2024-04-12T13:42:00.212 INFO:tasks.workunit.client.0.smithi060.stdout:3/309: mknod d7/d17/d19/c66 0 2024-04-12T13:42:00.217 INFO:tasks.workunit.client.0.smithi060.stdout:3/310: chown d7/da/d3f/d5c/d25/f5f 53631 1 2024-04-12T13:42:00.221 INFO:tasks.workunit.client.0.smithi060.stdout:0/322: mknod d7/d9/d14/d1b/c7b 0 2024-04-12T13:42:00.221 INFO:tasks.workunit.client.0.smithi060.stdout:9/281: dwrite d4/f2d [0,4194304] 0 2024-04-12T13:42:00.221 INFO:tasks.workunit.client.0.smithi060.stdout:4/314: rename d6/d21/c32 to d6/d7/dd/d1a/d57/d63/c74 0 2024-04-12T13:42:00.222 INFO:tasks.workunit.client.1.smithi110.stdout:1/288: dread fb [0,4194304] 0 2024-04-12T13:42:00.222 INFO:tasks.workunit.client.0.smithi060.stdout:3/311: write d7/d17/d27/d36/f62 [180812,650] 0 2024-04-12T13:42:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:41:59 smithi110 ceph-mon[36055]: pgmap v24: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 165 MiB/s wr, 300 op/s 2024-04-12T13:42:00.229 INFO:tasks.workunit.client.1.smithi110.stdout:9/409: dread df/d13/f1f [0,4194304] 0 2024-04-12T13:42:00.231 INFO:tasks.workunit.client.1.smithi110.stdout:2/353: rename d6/d18/d19 to d6/dc/dd/d49/d64 0 2024-04-12T13:42:00.232 INFO:tasks.workunit.client.1.smithi110.stdout:0/259: creat d1/d27/d31/f52 x:0 0 0 2024-04-12T13:42:00.236 INFO:tasks.workunit.client.0.smithi060.stdout:7/262: mknod d0/c5d 0 2024-04-12T13:42:00.238 INFO:tasks.workunit.client.1.smithi110.stdout:8/329: symlink d1/d3/d35/l68 0 2024-04-12T13:42:00.241 INFO:tasks.workunit.client.1.smithi110.stdout:4/450: creat d0/d75/f9a x:0 0 0 2024-04-12T13:42:00.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/412: truncate d1/d7/da/dc/d24/d34/f28 1082287 0 2024-04-12T13:42:00.244 INFO:tasks.workunit.client.1.smithi110.stdout:9/410: dread df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 [0,4194304] 0 2024-04-12T13:42:00.244 INFO:tasks.workunit.client.1.smithi110.stdout:3/335: write d5/f40 [280758,40002] 0 2024-04-12T13:42:00.245 INFO:tasks.workunit.client.0.smithi060.stdout:3/312: dwrite d7/f47 [0,4194304] 0 2024-04-12T13:42:00.247 INFO:tasks.workunit.client.1.smithi110.stdout:9/411: write df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/f82 [356951,61119] 0 2024-04-12T13:42:00.247 INFO:tasks.workunit.client.0.smithi060.stdout:3/313: chown d7/da/d3f 42321049 1 2024-04-12T13:42:00.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/323: mkdir d7/d9/de/d7c 0 2024-04-12T13:42:00.249 INFO:tasks.workunit.client.1.smithi110.stdout:6/352: mkdir d7/d6c 0 2024-04-12T13:42:00.251 INFO:tasks.workunit.client.0.smithi060.stdout:2/317: dwrite d6/d56/f54 [0,4194304] 0 2024-04-12T13:42:00.251 INFO:tasks.workunit.client.0.smithi060.stdout:5/358: truncate d6/f20 471502 0 2024-04-12T13:42:00.255 INFO:tasks.workunit.client.0.smithi060.stdout:4/315: rmdir d6/d21/d29 39 2024-04-12T13:42:00.256 INFO:tasks.workunit.client.1.smithi110.stdout:1/289: mknod de/d15/c69 0 2024-04-12T13:42:00.260 INFO:tasks.workunit.client.1.smithi110.stdout:5/283: rename da/d2e/d45/c2f to da/d2e/d45/d25/d5d/c64 0 2024-04-12T13:42:00.261 INFO:tasks.workunit.client.1.smithi110.stdout:2/354: mknod d6/dc/dd/d49/c65 0 2024-04-12T13:42:00.262 INFO:tasks.workunit.client.0.smithi060.stdout:7/263: readlink d0/d7/l13 0 2024-04-12T13:42:00.263 INFO:tasks.workunit.client.1.smithi110.stdout:2/355: write d6/dc/dd/f28 [318553,59485] 0 2024-04-12T13:42:00.265 INFO:tasks.workunit.client.1.smithi110.stdout:2/356: fsync d6/dc/dd/f24 0 2024-04-12T13:42:00.266 INFO:tasks.workunit.client.1.smithi110.stdout:2/357: write d6/d18/f29 [4422060,78201] 0 2024-04-12T13:42:00.269 INFO:tasks.workunit.client.0.smithi060.stdout:9/282: rename d4/l12 to d4/d8/d32/l5f 0 2024-04-12T13:42:00.271 INFO:tasks.workunit.client.1.smithi110.stdout:7/334: mkdir d1/d1b/d70 0 2024-04-12T13:42:00.272 INFO:tasks.workunit.client.1.smithi110.stdout:7/335: stat d1/d3/d4/d36/l48 0 2024-04-12T13:42:00.274 INFO:tasks.workunit.client.1.smithi110.stdout:8/330: creat d1/d3/d35/d3a/d41/f69 x:0 0 0 2024-04-12T13:42:00.276 INFO:tasks.workunit.client.0.smithi060.stdout:3/314: symlink d7/da/d3f/d5c/d25/l67 0 2024-04-12T13:42:00.277 INFO:tasks.workunit.client.1.smithi110.stdout:3/336: mkdir d5/dc/d31/d74/d75 0 2024-04-12T13:42:00.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/318: mkdir d6/d10/d2b/d60 0 2024-04-12T13:42:00.280 INFO:tasks.workunit.client.1.smithi110.stdout:9/412: symlink df/d13/d2c/d2d/d39/l8d 0 2024-04-12T13:42:00.282 INFO:tasks.workunit.client.1.smithi110.stdout:6/353: creat d7/d10/d1c/f6d x:0 0 0 2024-04-12T13:42:00.282 INFO:tasks.workunit.client.1.smithi110.stdout:9/413: write df/d13/d3b/d40/d56/f6c [32790,15608] 0 2024-04-12T13:42:00.286 INFO:tasks.workunit.client.1.smithi110.stdout:1/290: mkdir de/d15/d32/d61/d6a 0 2024-04-12T13:42:00.287 INFO:tasks.workunit.client.1.smithi110.stdout:2/358: dread d6/dc/f14 [0,4194304] 0 2024-04-12T13:42:00.287 INFO:tasks.workunit.client.1.smithi110.stdout:2/359: fsync d6/d18/f29 0 2024-04-12T13:42:00.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/315: getdents d9/d1d/d2f 0 2024-04-12T13:42:00.288 INFO:tasks.workunit.client.1.smithi110.stdout:5/284: fsync da/d2e/d45/d25/f44 0 2024-04-12T13:42:00.291 INFO:tasks.workunit.client.0.smithi060.stdout:8/316: chown d9/d1d/f64 68160 1 2024-04-12T13:42:00.291 INFO:tasks.workunit.client.0.smithi060.stdout:9/283: mknod d4/d33/c60 0 2024-04-12T13:42:00.293 INFO:tasks.workunit.client.0.smithi060.stdout:6/413: write d1/d7/da/d20/f4e [611065,103408] 0 2024-04-12T13:42:00.295 INFO:tasks.workunit.client.0.smithi060.stdout:8/317: chown d9/d1d/d5e 784265821 1 2024-04-12T13:42:00.295 INFO:tasks.workunit.client.0.smithi060.stdout:0/324: rename d7/d9/d14/d1b to d7/d9/d14/d35/d44/d7d 0 2024-04-12T13:42:00.298 INFO:tasks.workunit.client.0.smithi060.stdout:0/325: chown d7/d33 298 1 2024-04-12T13:42:00.301 INFO:tasks.workunit.client.0.smithi060.stdout:6/414: write d1/d7/da/dc/d24/d2d/f66 [239454,94056] 0 2024-04-12T13:42:00.302 INFO:tasks.workunit.client.0.smithi060.stdout:0/326: fdatasync d7/d9/d4c/f55 0 2024-04-12T13:42:00.304 INFO:tasks.workunit.client.0.smithi060.stdout:3/315: dwrite d7/d17/f1a [0,4194304] 0 2024-04-12T13:42:00.305 INFO:tasks.workunit.client.1.smithi110.stdout:7/336: unlink d1/d3/d4/f52 0 2024-04-12T13:42:00.306 INFO:tasks.workunit.client.0.smithi060.stdout:2/319: dwrite d6/d13/d31/f41 [0,4194304] 0 2024-04-12T13:42:00.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/316: write d7/da/d3f/f4f [1006264,20660] 0 2024-04-12T13:42:00.315 INFO:tasks.workunit.client.1.smithi110.stdout:8/331: mknod d1/d5/dd/d31/c6a 0 2024-04-12T13:42:00.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/327: dread d7/f26 [0,4194304] 0 2024-04-12T13:42:00.319 INFO:tasks.workunit.client.1.smithi110.stdout:3/337: mkdir d5/dc/d20/d2d/d4f/d76 0 2024-04-12T13:42:00.320 INFO:tasks.workunit.client.0.smithi060.stdout:9/284: creat d4/d33/d50/f61 x:0 0 0 2024-04-12T13:42:00.321 INFO:tasks.workunit.client.0.smithi060.stdout:5/359: rename d6/d10/d12/d79 to d6/dd/d27/d7d 0 2024-04-12T13:42:00.322 INFO:tasks.workunit.client.1.smithi110.stdout:3/338: read - d5/dc/d20/d2d/d4e/f66 zero size 2024-04-12T13:42:00.322 INFO:tasks.workunit.client.1.smithi110.stdout:2/360: dread d6/dc/dd/f16 [0,4194304] 0 2024-04-12T13:42:00.328 INFO:tasks.workunit.client.1.smithi110.stdout:6/354: unlink d7/d25/f56 0 2024-04-12T13:42:00.329 INFO:tasks.workunit.client.0.smithi060.stdout:6/415: mkdir d1/d7/da/d20/d99 0 2024-04-12T13:42:00.330 INFO:tasks.workunit.client.1.smithi110.stdout:1/291: mkdir de/d14/d34/d55/d6b 0 2024-04-12T13:42:00.332 INFO:tasks.workunit.client.1.smithi110.stdout:1/292: write de/d14/d34/d55/f5c [1023319,121996] 0 2024-04-12T13:42:00.335 INFO:tasks.workunit.client.0.smithi060.stdout:7/264: creat d0/d7/f5e x:0 0 0 2024-04-12T13:42:00.336 INFO:tasks.workunit.client.0.smithi060.stdout:0/328: unlink d7/d9/d14/c30 0 2024-04-12T13:42:00.337 INFO:tasks.workunit.client.1.smithi110.stdout:5/285: mknod da/db/d3b/c65 0 2024-04-12T13:42:00.338 INFO:tasks.workunit.client.1.smithi110.stdout:0/260: creat d1/d8/f53 x:0 0 0 2024-04-12T13:42:00.341 INFO:tasks.workunit.client.0.smithi060.stdout:3/317: rename d7/d17 to d7/d17/d27/d36/d68 22 2024-04-12T13:42:00.344 INFO:tasks.workunit.client.0.smithi060.stdout:5/360: mkdir d6/d10/d12/d15/d7e 0 2024-04-12T13:42:00.346 INFO:tasks.workunit.client.1.smithi110.stdout:6/355: dread d7/d10/d1c/f42 [0,4194304] 0 2024-04-12T13:42:00.347 INFO:tasks.workunit.client.0.smithi060.stdout:8/318: link d9/da/f24 d9/d1b/d37/d4d/f6b 0 2024-04-12T13:42:00.349 INFO:tasks.workunit.client.1.smithi110.stdout:8/332: fdatasync d1/d3/d46/f47 0 2024-04-12T13:42:00.349 INFO:tasks.workunit.client.0.smithi060.stdout:5/361: read d6/dd/d27/f44 [193537,109376] 0 2024-04-12T13:42:00.351 INFO:tasks.workunit.client.1.smithi110.stdout:8/333: read d1/d5/dd/f27 [2139711,108589] 0 2024-04-12T13:42:00.352 INFO:tasks.workunit.client.0.smithi060.stdout:6/416: write d1/d7/da/dc/d24/d2d/f3d [2092028,128823] 0 2024-04-12T13:42:00.352 INFO:tasks.workunit.client.1.smithi110.stdout:9/414: creat df/d8a/f8e x:0 0 0 2024-04-12T13:42:00.353 INFO:tasks.workunit.client.0.smithi060.stdout:0/329: dwrite d7/d9/f2b [0,4194304] 0 2024-04-12T13:42:00.355 INFO:tasks.workunit.client.1.smithi110.stdout:1/293: readlink de/l13 0 2024-04-12T13:42:00.359 INFO:tasks.workunit.client.0.smithi060.stdout:9/285: mknod d4/c62 0 2024-04-12T13:42:00.361 INFO:tasks.workunit.client.1.smithi110.stdout:0/261: mknod d1/d11/c54 0 2024-04-12T13:42:00.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/417: dread - d1/d7/da/dc/d24/d30/d52/f81 zero size 2024-04-12T13:42:00.365 INFO:tasks.workunit.client.0.smithi060.stdout:2/320: dwrite d6/f24 [0,4194304] 0 2024-04-12T13:42:00.367 INFO:tasks.workunit.client.1.smithi110.stdout:0/262: truncate d1/d27/d43/d4a/f4f 207274 0 2024-04-12T13:42:00.368 INFO:tasks.workunit.client.1.smithi110.stdout:4/451: getdents d0/d19/d8f 0 2024-04-12T13:42:00.370 INFO:tasks.workunit.client.1.smithi110.stdout:4/452: readlink d0/d19/d1c/d50/l55 0 2024-04-12T13:42:00.373 INFO:tasks.workunit.client.0.smithi060.stdout:5/362: dread d6/d10/d12/f4e [0,4194304] 0 2024-04-12T13:42:00.379 INFO:tasks.workunit.client.1.smithi110.stdout:1/294: dread de/d15/d32/f44 [0,4194304] 0 2024-04-12T13:42:00.381 INFO:tasks.workunit.client.1.smithi110.stdout:2/361: mknod d6/dc/dd/d49/d64/d4a/d3c/d50/c66 0 2024-04-12T13:42:00.384 INFO:tasks.workunit.client.0.smithi060.stdout:9/286: rmdir d4 39 2024-04-12T13:42:00.386 INFO:tasks.workunit.client.1.smithi110.stdout:7/337: truncate d1/d3/d4/d36/f3a 1600754 0 2024-04-12T13:42:00.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/321: creat d6/d13/d31/d33/f61 x:0 0 0 2024-04-12T13:42:00.392 INFO:tasks.workunit.client.1.smithi110.stdout:5/286: mkdir da/d2e/d45/d29/d66 0 2024-04-12T13:42:00.393 INFO:tasks.workunit.client.0.smithi060.stdout:7/265: dwrite d0/d1b/f53 [0,4194304] 0 2024-04-12T13:42:00.394 INFO:tasks.workunit.client.0.smithi060.stdout:2/322: fdatasync d6/f9 0 2024-04-12T13:42:00.394 INFO:tasks.workunit.client.1.smithi110.stdout:2/362: dwrite d6/dc/dd/f22 [0,4194304] 0 2024-04-12T13:42:00.395 INFO:tasks.workunit.client.1.smithi110.stdout:0/263: rename d1/d11/l28 to d1/d11/l55 0 2024-04-12T13:42:00.396 INFO:tasks.workunit.client.0.smithi060.stdout:6/418: dwrite d1/d7/da/dc/d24/d30/d52/f60 [0,4194304] 0 2024-04-12T13:42:00.396 INFO:tasks.workunit.client.0.smithi060.stdout:3/318: dread d7/da/f3e [0,4194304] 0 2024-04-12T13:42:00.397 INFO:tasks.workunit.client.0.smithi060.stdout:3/319: readlink d7/d17/l1b 0 2024-04-12T13:42:00.398 INFO:tasks.workunit.client.0.smithi060.stdout:3/320: dread - d7/d17/f57 zero size 2024-04-12T13:42:00.399 INFO:tasks.workunit.client.1.smithi110.stdout:4/453: creat d0/de/d32/d61/f9b x:0 0 0 2024-04-12T13:42:00.407 INFO:tasks.workunit.client.1.smithi110.stdout:9/415: write df/d13/d26/f28 [2181448,116912] 0 2024-04-12T13:42:00.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/424: sync 2024-04-12T13:42:00.411 INFO:tasks.workunit.client.0.smithi060.stdout:4/316: sync 2024-04-12T13:42:00.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/323: symlink d6/d13/d17/l62 0 2024-04-12T13:42:00.416 INFO:tasks.workunit.client.1.smithi110.stdout:6/356: dread d7/d25/d2c/f40 [0,4194304] 0 2024-04-12T13:42:00.417 INFO:tasks.workunit.client.0.smithi060.stdout:7/266: creat d0/d1b/f5f x:0 0 0 2024-04-12T13:42:00.417 INFO:tasks.workunit.client.0.smithi060.stdout:8/319: getdents d9/da 0 2024-04-12T13:42:00.418 INFO:tasks.workunit.client.1.smithi110.stdout:6/357: stat d7/d10/d1c/d64 0 2024-04-12T13:42:00.418 INFO:tasks.workunit.client.0.smithi060.stdout:2/324: read d6/d13/d31/f42 [1497329,4118] 0 2024-04-12T13:42:00.424 INFO:tasks.workunit.client.0.smithi060.stdout:0/330: getdents d7/d9/d14/d35/d3c 0 2024-04-12T13:42:00.424 INFO:tasks.workunit.client.0.smithi060.stdout:8/320: chown d9/d1b/d2b/f55 258 1 2024-04-12T13:42:00.428 INFO:tasks.workunit.client.1.smithi110.stdout:3/339: link d5/l15 d5/dc/d20/d2d/l77 0 2024-04-12T13:42:00.429 INFO:tasks.workunit.client.0.smithi060.stdout:4/317: mknod d6/d7/dd/d4d/d69/c75 0 2024-04-12T13:42:00.432 INFO:tasks.workunit.client.0.smithi060.stdout:4/318: fdatasync d6/d21/f2d 0 2024-04-12T13:42:00.433 INFO:tasks.workunit.client.1.smithi110.stdout:8/334: creat d1/d3/d35/f6b x:0 0 0 2024-04-12T13:42:00.435 INFO:tasks.workunit.client.1.smithi110.stdout:2/363: dwrite f4 [0,4194304] 0 2024-04-12T13:42:00.436 INFO:tasks.workunit.client.0.smithi060.stdout:4/319: dread - d6/d7/db/f4b zero size 2024-04-12T13:42:00.436 INFO:tasks.workunit.client.0.smithi060.stdout:5/363: dwrite d6/dd/d1f/d25/d53/f6e [0,4194304] 0 2024-04-12T13:42:00.437 INFO:tasks.workunit.client.0.smithi060.stdout:1/425: dwrite d1e/f2d [0,4194304] 0 2024-04-12T13:42:00.437 INFO:tasks.workunit.client.1.smithi110.stdout:2/364: write d6/dc/d1b/f4e [1971256,125686] 0 2024-04-12T13:42:00.439 INFO:tasks.workunit.client.1.smithi110.stdout:0/264: dwrite d1/d11/f41 [0,4194304] 0 2024-04-12T13:42:00.440 INFO:tasks.workunit.client.0.smithi060.stdout:3/321: symlink d7/d17/d27/d36/l69 0 2024-04-12T13:42:00.444 INFO:tasks.workunit.client.1.smithi110.stdout:7/338: mkdir d1/d31/d5d/d71 0 2024-04-12T13:42:00.445 INFO:tasks.workunit.client.0.smithi060.stdout:2/325: creat d6/d13/d31/d33/d3d/f63 x:0 0 0 2024-04-12T13:42:00.447 INFO:tasks.workunit.client.1.smithi110.stdout:6/358: symlink d7/d10/d1c/l6e 0 2024-04-12T13:42:00.448 INFO:tasks.workunit.client.1.smithi110.stdout:6/359: fdatasync d7/d10/f20 0 2024-04-12T13:42:00.450 INFO:tasks.workunit.client.1.smithi110.stdout:5/287: mknod da/d5c/c67 0 2024-04-12T13:42:00.453 INFO:tasks.workunit.client.1.smithi110.stdout:1/295: rename de/d14/l36 to de/l6c 0 2024-04-12T13:42:00.454 INFO:tasks.workunit.client.1.smithi110.stdout:1/296: chown de/d15 6 1 2024-04-12T13:42:00.455 INFO:tasks.workunit.client.1.smithi110.stdout:1/297: dread - de/d15/d32/f68 zero size 2024-04-12T13:42:00.459 INFO:tasks.workunit.client.1.smithi110.stdout:3/340: creat d5/dc/d31/d3b/d32/f78 x:0 0 0 2024-04-12T13:42:00.460 INFO:tasks.workunit.client.0.smithi060.stdout:6/419: link d1/d7/l79 d1/d7/da/dc/d3a/l9a 0 2024-04-12T13:42:00.469 INFO:tasks.workunit.client.1.smithi110.stdout:2/365: dread d6/dc/d13/f43 [0,4194304] 0 2024-04-12T13:42:00.469 INFO:tasks.workunit.client.0.smithi060.stdout:9/287: write d4/d9/d19/d21/f31 [9342184,15846] 0 2024-04-12T13:42:00.472 INFO:tasks.workunit.client.1.smithi110.stdout:7/339: mkdir d1/d3/d4/d55/d56/d72 0 2024-04-12T13:42:00.473 INFO:tasks.workunit.client.0.smithi060.stdout:9/288: chown d4/d9/d19/d21/c26 31 1 2024-04-12T13:42:00.474 INFO:tasks.workunit.client.0.smithi060.stdout:4/320: rmdir d6/d7 39 2024-04-12T13:42:00.474 INFO:tasks.workunit.client.1.smithi110.stdout:7/340: write d1/d3/f4c [542645,53406] 0 2024-04-12T13:42:00.475 INFO:tasks.workunit.client.0.smithi060.stdout:9/289: chown d4/d9/d19 55284472 1 2024-04-12T13:42:00.477 INFO:tasks.workunit.client.0.smithi060.stdout:3/322: unlink d7/da/d3f/f4f 0 2024-04-12T13:42:00.478 INFO:tasks.workunit.client.0.smithi060.stdout:3/323: chown d7/d17/l32 1066033313 1 2024-04-12T13:42:00.479 INFO:tasks.workunit.client.1.smithi110.stdout:5/288: symlink da/d5c/l68 0 2024-04-12T13:42:00.479 INFO:tasks.workunit.client.0.smithi060.stdout:3/324: fsync d7/da/f2c 0 2024-04-12T13:42:00.480 INFO:tasks.workunit.client.1.smithi110.stdout:5/289: readlink da/db/l1c 0 2024-04-12T13:42:00.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/426: rename d1e/d46/f63 to d1e/d23/d2e/d30/f96 0 2024-04-12T13:42:00.481 INFO:tasks.workunit.client.1.smithi110.stdout:5/290: write da/f21 [6600662,8358] 0 2024-04-12T13:42:00.482 INFO:tasks.workunit.client.0.smithi060.stdout:3/325: write d7/d17/f57 [895204,98739] 0 2024-04-12T13:42:00.482 INFO:tasks.workunit.client.1.smithi110.stdout:4/454: rename d0/c56 to d0/d19/d26/d65/d7e/c9c 0 2024-04-12T13:42:00.484 INFO:tasks.workunit.client.0.smithi060.stdout:1/427: write d1e/d23/d2e/d30/d51/f8a [627453,6029] 0 2024-04-12T13:42:00.486 INFO:tasks.workunit.client.1.smithi110.stdout:4/455: truncate d0/d75/f9a 857320 0 2024-04-12T13:42:00.486 INFO:tasks.workunit.client.1.smithi110.stdout:0/265: mkdir d1/d56 0 2024-04-12T13:42:00.487 INFO:tasks.workunit.client.1.smithi110.stdout:2/366: mknod d6/dc/dd/d49/c67 0 2024-04-12T13:42:00.489 INFO:tasks.workunit.client.1.smithi110.stdout:4/456: fdatasync d0/de/d2c/d57/f94 0 2024-04-12T13:42:00.491 INFO:tasks.workunit.client.1.smithi110.stdout:2/367: truncate d6/d18/f41 430253 0 2024-04-12T13:42:00.491 INFO:tasks.workunit.client.1.smithi110.stdout:4/457: dread - d0/de/d32/f8c zero size 2024-04-12T13:42:00.492 INFO:tasks.workunit.client.1.smithi110.stdout:2/368: chown d6/dc/d1b/d57/d62 49238763 1 2024-04-12T13:42:00.493 INFO:tasks.workunit.client.1.smithi110.stdout:6/360: dwrite d7/d25/d30/d44/f1d [4194304,4194304] 0 2024-04-12T13:42:00.499 INFO:tasks.workunit.client.0.smithi060.stdout:4/321: read d6/d7/dd/df/f18 [2429139,58590] 0 2024-04-12T13:42:00.500 INFO:tasks.workunit.client.0.smithi060.stdout:7/267: truncate d0/d1b/f53 1156487 0 2024-04-12T13:42:00.501 INFO:tasks.workunit.client.0.smithi060.stdout:4/322: dread - d6/d7/db/f4b zero size 2024-04-12T13:42:00.504 INFO:tasks.workunit.client.1.smithi110.stdout:1/298: mknod de/d1d/c6d 0 2024-04-12T13:42:00.505 INFO:tasks.workunit.client.0.smithi060.stdout:9/290: creat d4/d9/d19/f63 x:0 0 0 2024-04-12T13:42:00.509 INFO:tasks.workunit.client.1.smithi110.stdout:9/416: rename df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/f82 to df/d13/d2c/f8f 0 2024-04-12T13:42:00.511 INFO:tasks.workunit.client.0.smithi060.stdout:5/364: creat d6/dd/d1f/d25/d35/d50/d5f/f7f x:0 0 0 2024-04-12T13:42:00.511 INFO:tasks.workunit.client.1.smithi110.stdout:8/335: link d1/d3/d35/l40 d1/d3/l6c 0 2024-04-12T13:42:00.513 INFO:tasks.workunit.client.0.smithi060.stdout:0/331: truncate d7/d9/f1a 2570337 0 2024-04-12T13:42:00.513 INFO:tasks.workunit.client.1.smithi110.stdout:8/336: dread - d1/d3/d35/d3a/d41/f69 zero size 2024-04-12T13:42:00.514 INFO:tasks.workunit.client.1.smithi110.stdout:0/266: chown d1/f2c 16788 1 2024-04-12T13:42:00.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/332: chown d7/d9/l18 19306 1 2024-04-12T13:42:00.515 INFO:tasks.workunit.client.1.smithi110.stdout:7/341: symlink d1/d1b/d70/l73 0 2024-04-12T13:42:00.517 INFO:tasks.workunit.client.1.smithi110.stdout:1/299: dread de/d15/d32/f44 [0,4194304] 0 2024-04-12T13:42:00.518 INFO:tasks.workunit.client.1.smithi110.stdout:4/458: chown d0/d19/d26/c6a 11744 1 2024-04-12T13:42:00.518 INFO:tasks.workunit.client.0.smithi060.stdout:2/326: mkdir d6/d64 0 2024-04-12T13:42:00.518 INFO:tasks.workunit.client.0.smithi060.stdout:9/291: dread d4/d9/d19/f1a [0,4194304] 0 2024-04-12T13:42:00.519 INFO:tasks.workunit.client.1.smithi110.stdout:4/459: readlink d0/de/d2c/d57/l6b 0 2024-04-12T13:42:00.519 INFO:tasks.workunit.client.0.smithi060.stdout:2/327: dread - d6/d13/f34 zero size 2024-04-12T13:42:00.522 INFO:tasks.workunit.client.0.smithi060.stdout:9/292: write d4/d8/f17 [1613855,55541] 0 2024-04-12T13:42:00.523 INFO:tasks.workunit.client.1.smithi110.stdout:5/291: mknod da/d2e/c69 0 2024-04-12T13:42:00.524 INFO:tasks.workunit.client.0.smithi060.stdout:8/321: link d9/d1b/d37/l4a d9/d1b/d37/l6c 0 2024-04-12T13:42:00.524 INFO:tasks.workunit.client.0.smithi060.stdout:6/420: dwrite d1/d7/da/d20/f26 [4194304,4194304] 0 2024-04-12T13:42:00.538 INFO:tasks.workunit.client.1.smithi110.stdout:8/337: creat d1/d3/d3c/d5a/f6d x:0 0 0 2024-04-12T13:42:00.540 INFO:tasks.workunit.client.0.smithi060.stdout:7/268: creat d0/d1b/f60 x:0 0 0 2024-04-12T13:42:00.546 INFO:tasks.workunit.client.1.smithi110.stdout:7/342: rmdir d1/d3/d4/d36 39 2024-04-12T13:42:00.547 INFO:tasks.workunit.client.1.smithi110.stdout:9/417: write df/d13/d26/d37/d49/f73 [2621720,43130] 0 2024-04-12T13:42:00.547 INFO:tasks.workunit.client.1.smithi110.stdout:1/300: mknod de/d14/d34/d55/c6e 0 2024-04-12T13:42:00.550 INFO:tasks.workunit.client.1.smithi110.stdout:9/418: chown df/d13/d2c/d66 8317860 1 2024-04-12T13:42:00.551 INFO:tasks.workunit.client.0.smithi060.stdout:5/365: rmdir d6/dd/d1f 39 2024-04-12T13:42:00.552 INFO:tasks.workunit.client.1.smithi110.stdout:1/301: write de/d15/d32/f39 [722759,129059] 0 2024-04-12T13:42:00.552 INFO:tasks.workunit.client.1.smithi110.stdout:6/361: fsync d7/d10/d1c/f28 0 2024-04-12T13:42:00.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/333: rename d7/d9/l6c to d7/d41/l7e 0 2024-04-12T13:42:00.555 INFO:tasks.workunit.client.0.smithi060.stdout:9/293: dwrite d4/d9/d19/d21/f2f [0,4194304] 0 2024-04-12T13:42:00.555 INFO:tasks.workunit.client.1.smithi110.stdout:5/292: rename f1 to da/db/d3b/f6a 0 2024-04-12T13:42:00.556 INFO:tasks.workunit.client.1.smithi110.stdout:6/362: dread d7/d25/d30/d44/f2d [0,4194304] 0 2024-04-12T13:42:00.560 INFO:tasks.workunit.client.0.smithi060.stdout:3/326: creat d7/d17/d27/d36/d53/f6a x:0 0 0 2024-04-12T13:42:00.561 INFO:tasks.workunit.client.1.smithi110.stdout:0/267: dwrite d1/d11/f18 [0,4194304] 0 2024-04-12T13:42:00.563 INFO:tasks.workunit.client.0.smithi060.stdout:2/328: creat d6/d56/d43/f65 x:0 0 0 2024-04-12T13:42:00.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/428: symlink d1e/d23/d2e/l97 0 2024-04-12T13:42:00.567 INFO:tasks.workunit.client.1.smithi110.stdout:1/302: chown de/d14/l24 49 1 2024-04-12T13:42:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:6/421: unlink d1/d7/da/l22 0 2024-04-12T13:42:00.572 INFO:tasks.workunit.client.1.smithi110.stdout:5/293: unlink da/db/l34 0 2024-04-12T13:42:00.573 INFO:tasks.workunit.client.0.smithi060.stdout:8/322: mknod d9/d1d/c6d 0 2024-04-12T13:42:00.574 INFO:tasks.workunit.client.1.smithi110.stdout:6/363: mknod d7/d10/d1c/d2b/d48/c6f 0 2024-04-12T13:42:00.576 INFO:tasks.workunit.client.1.smithi110.stdout:8/338: symlink d1/d3/d35/d43/l6e 0 2024-04-12T13:42:00.579 INFO:tasks.workunit.client.1.smithi110.stdout:7/343: mkdir d1/d1b/d74 0 2024-04-12T13:42:00.582 INFO:tasks.workunit.client.1.smithi110.stdout:0/268: symlink d1/d8/l57 0 2024-04-12T13:42:00.583 INFO:tasks.workunit.client.1.smithi110.stdout:8/339: rmdir d1/d3/d35/d3a/d3e 39 2024-04-12T13:42:00.584 INFO:tasks.workunit.client.0.smithi060.stdout:1/429: rmdir d1e/d23/d2e/d5e 39 2024-04-12T13:42:00.584 INFO:tasks.workunit.client.1.smithi110.stdout:6/364: truncate d7/d25/d30/d44/d3d/f5f 585717 0 2024-04-12T13:42:00.585 INFO:tasks.workunit.client.0.smithi060.stdout:6/422: creat d1/d7/da/dc/d24/d34/d51/d59/f9b x:0 0 0 2024-04-12T13:42:00.586 INFO:tasks.workunit.client.0.smithi060.stdout:8/323: unlink d9/da/f4e 0 2024-04-12T13:42:00.587 INFO:tasks.workunit.client.0.smithi060.stdout:6/423: dread - d1/d7/da/dc/d24/d8b/f8f zero size 2024-04-12T13:42:00.587 INFO:tasks.workunit.client.1.smithi110.stdout:6/365: chown d7/d10/d1c/d2b/f38 88575587 1 2024-04-12T13:42:00.588 INFO:tasks.workunit.client.1.smithi110.stdout:1/303: dwrite de/d1d/f42 [0,4194304] 0 2024-04-12T13:42:00.589 INFO:tasks.workunit.client.0.smithi060.stdout:7/269: symlink d0/l61 0 2024-04-12T13:42:00.590 INFO:tasks.workunit.client.1.smithi110.stdout:5/294: creat da/f6b x:0 0 0 2024-04-12T13:42:00.592 INFO:tasks.workunit.client.0.smithi060.stdout:5/366: rmdir d6/dd/d1f/d25/d42/d52 39 2024-04-12T13:42:00.594 INFO:tasks.workunit.client.1.smithi110.stdout:6/366: dread d7/d25/d2c/f3c [0,4194304] 0 2024-04-12T13:42:00.594 INFO:tasks.workunit.client.0.smithi060.stdout:5/367: stat d6/d10/d12/f4e 0 2024-04-12T13:42:00.594 INFO:tasks.workunit.client.1.smithi110.stdout:8/340: mkdir d1/d3/d3c/d5a/d6f 0 2024-04-12T13:42:00.596 INFO:tasks.workunit.client.0.smithi060.stdout:3/327: symlink d7/d17/d19/l6b 0 2024-04-12T13:42:00.599 INFO:tasks.workunit.client.1.smithi110.stdout:0/269: dwrite d1/d11/f41 [4194304,4194304] 0 2024-04-12T13:42:00.600 INFO:tasks.workunit.client.1.smithi110.stdout:5/295: mknod da/db/c6c 0 2024-04-12T13:42:00.601 INFO:tasks.workunit.client.0.smithi060.stdout:3/328: write d7/d17/d19/f31 [883295,9260] 0 2024-04-12T13:42:00.603 INFO:tasks.workunit.client.1.smithi110.stdout:0/270: write d1/d27/d31/f52 [67661,1520] 0 2024-04-12T13:42:00.608 INFO:tasks.workunit.client.1.smithi110.stdout:6/367: fdatasync d7/d25/f59 0 2024-04-12T13:42:00.610 INFO:tasks.workunit.client.0.smithi060.stdout:8/324: unlink d9/f3b 0 2024-04-12T13:42:00.611 INFO:tasks.workunit.client.1.smithi110.stdout:8/341: symlink d1/d3/d46/l70 0 2024-04-12T13:42:00.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/342: chown d1/d3/d3c 122330 1 2024-04-12T13:42:00.612 INFO:tasks.workunit.client.0.smithi060.stdout:4/323: getdents d6/d2f/d51 0 2024-04-12T13:42:00.613 INFO:tasks.workunit.client.1.smithi110.stdout:1/304: dread de/d1d/f28 [0,4194304] 0 2024-04-12T13:42:00.613 INFO:tasks.workunit.client.0.smithi060.stdout:8/325: write d9/f11 [5195804,127786] 0 2024-04-12T13:42:00.616 INFO:tasks.workunit.client.0.smithi060.stdout:6/424: creat d1/d7/da/dc/d24/d34/f9c x:0 0 0 2024-04-12T13:42:00.617 INFO:tasks.workunit.client.0.smithi060.stdout:7/270: symlink d0/d7/d43/d4d/l62 0 2024-04-12T13:42:00.618 INFO:tasks.workunit.client.1.smithi110.stdout:7/344: dread d1/d3/d4/f30 [0,4194304] 0 2024-04-12T13:42:00.619 INFO:tasks.workunit.client.1.smithi110.stdout:5/296: creat da/d2e/d45/d29/d58/f6d x:0 0 0 2024-04-12T13:42:00.619 INFO:tasks.workunit.client.0.smithi060.stdout:6/425: readlink d1/d7/da/dc/d24/d30/d52/d78/d80/l92 0 2024-04-12T13:42:00.622 INFO:tasks.workunit.client.0.smithi060.stdout:5/368: creat d6/dd/d1f/d25/d42/d6b/f80 x:0 0 0 2024-04-12T13:42:00.625 INFO:tasks.workunit.client.0.smithi060.stdout:2/329: link d6/d13/d17/f30 d6/d13/d5b/f66 0 2024-04-12T13:42:00.625 INFO:tasks.workunit.client.1.smithi110.stdout:6/368: rmdir d7/d25 39 2024-04-12T13:42:00.627 INFO:tasks.workunit.client.0.smithi060.stdout:1/430: mkdir d1e/d23/d2e/d8e/d98 0 2024-04-12T13:42:00.629 INFO:tasks.workunit.client.0.smithi060.stdout:1/431: read d1e/f2d [2916432,25435] 0 2024-04-12T13:42:00.630 INFO:tasks.workunit.client.0.smithi060.stdout:3/329: creat d7/d17/d19/d33/f6c x:0 0 0 2024-04-12T13:42:00.633 INFO:tasks.workunit.client.1.smithi110.stdout:7/345: mknod d1/d3/d43/c75 0 2024-04-12T13:42:00.633 INFO:tasks.workunit.client.0.smithi060.stdout:8/326: mkdir d9/d1b/d3c/d6e 0 2024-04-12T13:42:00.636 INFO:tasks.workunit.client.1.smithi110.stdout:5/297: unlink da/d2e/d45/d25/f2a 0 2024-04-12T13:42:00.637 INFO:tasks.workunit.client.0.smithi060.stdout:1/432: dread d1e/d1f/f22 [0,4194304] 0 2024-04-12T13:42:00.637 INFO:tasks.workunit.client.0.smithi060.stdout:4/324: mkdir d6/d7/dd/d1a/d57/d63/d68/d76 0 2024-04-12T13:42:00.638 INFO:tasks.workunit.client.1.smithi110.stdout:0/271: symlink d1/d56/l58 0 2024-04-12T13:42:00.640 INFO:tasks.workunit.client.0.smithi060.stdout:0/334: rmdir d7/d9/d14/d4a 39 2024-04-12T13:42:00.640 INFO:tasks.workunit.client.0.smithi060.stdout:4/325: chown d6/d21/c6d 41843291 1 2024-04-12T13:42:00.641 INFO:tasks.workunit.client.1.smithi110.stdout:6/369: write d7/d10/d1c/f42 [2375311,87288] 0 2024-04-12T13:42:00.641 INFO:tasks.workunit.client.0.smithi060.stdout:5/369: dwrite d6/dd/d1f/d25/d53/f6e [4194304,4194304] 0 2024-04-12T13:42:00.642 INFO:tasks.workunit.client.1.smithi110.stdout:1/305: link de/d14/d34/f54 de/d14/d34/d55/d6b/f6f 0 2024-04-12T13:42:00.643 INFO:tasks.workunit.client.0.smithi060.stdout:8/327: dread d9/d1b/d37/f39 [0,4194304] 0 2024-04-12T13:42:00.643 INFO:tasks.workunit.client.1.smithi110.stdout:8/343: dwrite d1/d5/dd/ff [0,4194304] 0 2024-04-12T13:42:00.644 INFO:tasks.workunit.client.1.smithi110.stdout:3/341: sync 2024-04-12T13:42:00.649 INFO:tasks.workunit.client.1.smithi110.stdout:5/298: mknod da/db/d52/c6e 0 2024-04-12T13:42:00.649 INFO:tasks.workunit.client.1.smithi110.stdout:0/272: rmdir d1 39 2024-04-12T13:42:00.653 INFO:tasks.workunit.client.1.smithi110.stdout:6/370: creat d7/d10/d1c/d2b/d48/f70 x:0 0 0 2024-04-12T13:42:00.654 INFO:tasks.workunit.client.1.smithi110.stdout:3/342: mknod d5/dc/d31/d3b/d32/d3e/c79 0 2024-04-12T13:42:00.654 INFO:tasks.workunit.client.1.smithi110.stdout:1/306: chown de/l6c 1894531991 1 2024-04-12T13:42:00.657 INFO:tasks.workunit.client.1.smithi110.stdout:1/307: chown de/d14/f4f 879526 1 2024-04-12T13:42:00.658 INFO:tasks.workunit.client.0.smithi060.stdout:6/426: creat d1/d7/da/dc/d24/d34/d51/d97/f9d x:0 0 0 2024-04-12T13:42:00.660 INFO:tasks.workunit.client.1.smithi110.stdout:5/299: creat da/d2e/d45/f6f x:0 0 0 2024-04-12T13:42:00.661 INFO:tasks.workunit.client.1.smithi110.stdout:5/300: chown da/d2e 550033 1 2024-04-12T13:42:00.666 INFO:tasks.workunit.client.1.smithi110.stdout:0/273: fsync d1/d8/f34 0 2024-04-12T13:42:00.668 INFO:tasks.workunit.client.1.smithi110.stdout:6/371: truncate d7/d25/f59 1513640 0 2024-04-12T13:42:00.674 INFO:tasks.workunit.client.0.smithi060.stdout:5/370: write d6/dd/d1f/d25/d42/d52/f75 [746795,55828] 0 2024-04-12T13:42:00.674 INFO:tasks.workunit.client.0.smithi060.stdout:3/330: mkdir d7/d17/d19/d33/d63/d6d 0 2024-04-12T13:42:00.674 INFO:tasks.workunit.client.0.smithi060.stdout:4/326: dwrite d6/d7/dd/d1a/f50 [0,4194304] 0 2024-04-12T13:42:00.674 INFO:tasks.workunit.client.0.smithi060.stdout:0/335: dwrite d7/d33/d5b/f72 [0,4194304] 0 2024-04-12T13:42:00.674 INFO:tasks.workunit.client.1.smithi110.stdout:1/308: dwrite de/d15/d32/f52 [0,4194304] 0 2024-04-12T13:42:00.676 INFO:tasks.workunit.client.1.smithi110.stdout:5/301: creat da/d2e/d45/d29/d66/f70 x:0 0 0 2024-04-12T13:42:00.677 INFO:tasks.workunit.client.1.smithi110.stdout:5/302: dread - da/d2e/d45/f1f zero size 2024-04-12T13:42:00.679 INFO:tasks.workunit.client.1.smithi110.stdout:0/274: chown d1/l1b 381260 1 2024-04-12T13:42:00.681 INFO:tasks.workunit.client.0.smithi060.stdout:2/330: rename d6/d10/d2b/d35/f48 to d6/d13/f67 0 2024-04-12T13:42:00.682 INFO:tasks.workunit.client.1.smithi110.stdout:2/369: sync 2024-04-12T13:42:00.682 INFO:tasks.workunit.client.1.smithi110.stdout:3/343: dwrite d5/dc/d20/f36 [4194304,4194304] 0 2024-04-12T13:42:00.688 INFO:tasks.workunit.client.1.smithi110.stdout:7/346: dread d1/d3/f20 [0,4194304] 0 2024-04-12T13:42:00.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/427: dwrite d1/f6b [0,4194304] 0 2024-04-12T13:42:00.696 INFO:tasks.workunit.client.1.smithi110.stdout:2/370: dread f4 [0,4194304] 0 2024-04-12T13:42:00.698 INFO:tasks.workunit.client.0.smithi060.stdout:8/328: unlink d9/d1d/l5d 0 2024-04-12T13:42:00.699 INFO:tasks.workunit.client.1.smithi110.stdout:2/371: write d6/dc/dd/f22 [2088674,44346] 0 2024-04-12T13:42:00.699 INFO:tasks.workunit.client.1.smithi110.stdout:1/309: dread de/f30 [0,4194304] 0 2024-04-12T13:42:00.703 INFO:tasks.workunit.client.0.smithi060.stdout:8/329: chown d9/d1b/d37/l3f 0 1 2024-04-12T13:42:00.704 INFO:tasks.workunit.client.1.smithi110.stdout:8/344: link d1/d3/d35/d3a/d3e/f49 d1/d3/d46/f71 0 2024-04-12T13:42:00.706 INFO:tasks.workunit.client.1.smithi110.stdout:5/303: mkdir da/d35/d71 0 2024-04-12T13:42:00.708 INFO:tasks.workunit.client.1.smithi110.stdout:5/304: chown da/db/d15/f1b 185 1 2024-04-12T13:42:00.710 INFO:tasks.workunit.client.0.smithi060.stdout:1/433: creat d1e/d23/d2e/f99 x:0 0 0 2024-04-12T13:42:00.712 INFO:tasks.workunit.client.1.smithi110.stdout:0/275: unlink d1/d27/d43/l4c 0 2024-04-12T13:42:00.714 INFO:tasks.workunit.client.1.smithi110.stdout:2/372: dread d6/dc/f14 [0,4194304] 0 2024-04-12T13:42:00.715 INFO:tasks.workunit.client.0.smithi060.stdout:5/371: symlink d6/dd/d1f/d25/d42/d6b/l81 0 2024-04-12T13:42:00.717 INFO:tasks.workunit.client.1.smithi110.stdout:5/305: dread da/d2e/d45/d25/f43 [0,4194304] 0 2024-04-12T13:42:00.717 INFO:tasks.workunit.client.0.smithi060.stdout:3/331: creat d7/da/d3f/d5c/d25/d4d/f6e x:0 0 0 2024-04-12T13:42:00.718 INFO:tasks.workunit.client.0.smithi060.stdout:5/372: write d6/d10/d12/d38/f66 [3759198,111516] 0 2024-04-12T13:42:00.720 INFO:tasks.workunit.client.0.smithi060.stdout:3/332: write d7/d17/d27/d36/f3c [563792,107849] 0 2024-04-12T13:42:00.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/327: symlink d6/d7/dd/d4d/l77 0 2024-04-12T13:42:00.723 INFO:tasks.workunit.client.0.smithi060.stdout:3/333: write d7/d17/d27/d36/f4b [105353,43677] 0 2024-04-12T13:42:00.724 INFO:tasks.workunit.client.0.smithi060.stdout:4/328: chown d6 11457 1 2024-04-12T13:42:00.725 INFO:tasks.workunit.client.1.smithi110.stdout:3/344: creat d5/dc/d20/f7a x:0 0 0 2024-04-12T13:42:00.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/334: fdatasync d7/f47 0 2024-04-12T13:42:00.725 INFO:tasks.workunit.client.0.smithi060.stdout:4/329: stat d6/d7/db/f3c 0 2024-04-12T13:42:00.727 INFO:tasks.workunit.client.1.smithi110.stdout:3/345: chown d5/dc/d20/l73 2064 1 2024-04-12T13:42:00.727 INFO:tasks.workunit.client.1.smithi110.stdout:7/347: fdatasync d1/d3/d4/f2d 0 2024-04-12T13:42:00.730 INFO:tasks.workunit.client.1.smithi110.stdout:9/419: sync 2024-04-12T13:42:00.731 INFO:tasks.workunit.client.1.smithi110.stdout:4/460: sync 2024-04-12T13:42:00.732 INFO:tasks.workunit.client.0.smithi060.stdout:0/336: rename d7/f78 to d7/d41/f7f 0 2024-04-12T13:42:00.732 INFO:tasks.workunit.client.1.smithi110.stdout:4/461: fsync d0/de/d32/d5f/d71/f73 0 2024-04-12T13:42:00.733 INFO:tasks.workunit.client.0.smithi060.stdout:2/331: write d6/d10/f44 [168797,30260] 0 2024-04-12T13:42:00.735 INFO:tasks.workunit.client.0.smithi060.stdout:6/428: creat d1/d7/da/dc/d24/d30/d52/d5e/f9e x:0 0 0 2024-04-12T13:42:00.737 INFO:tasks.workunit.client.1.smithi110.stdout:0/276: unlink d1/d27/f32 0 2024-04-12T13:42:00.739 INFO:tasks.workunit.client.0.smithi060.stdout:8/330: creat d9/d1d/f6f x:0 0 0 2024-04-12T13:42:00.739 INFO:tasks.workunit.client.0.smithi060.stdout:7/271: dwrite d0/d7/f11 [0,4194304] 0 2024-04-12T13:42:00.741 INFO:tasks.workunit.client.0.smithi060.stdout:6/429: write d1/d7/da/dc/d3a/f49 [942878,117808] 0 2024-04-12T13:42:00.742 INFO:tasks.workunit.client.1.smithi110.stdout:5/306: symlink da/db/d3b/d40/l72 0 2024-04-12T13:42:00.743 INFO:tasks.workunit.client.1.smithi110.stdout:5/307: write da/db/d61/f3e [374970,20802] 0 2024-04-12T13:42:00.745 INFO:tasks.workunit.client.0.smithi060.stdout:5/373: rmdir d6/dd/d1f/d32/d46 39 2024-04-12T13:42:00.754 INFO:tasks.workunit.client.1.smithi110.stdout:3/346: creat d5/dc/d20/d2d/d4f/f7b x:0 0 0 2024-04-12T13:42:00.763 INFO:tasks.workunit.client.1.smithi110.stdout:6/372: dwrite d7/d10/d1c/d2b/d3a/f5a [0,4194304] 0 2024-04-12T13:42:00.764 INFO:tasks.workunit.client.0.smithi060.stdout:9/294: sync 2024-04-12T13:42:00.765 INFO:tasks.workunit.client.0.smithi060.stdout:9/295: chown d4/d33 27226 1 2024-04-12T13:42:00.766 INFO:tasks.workunit.client.0.smithi060.stdout:8/331: creat d9/d1b/f70 x:0 0 0 2024-04-12T13:42:00.767 INFO:tasks.workunit.client.0.smithi060.stdout:9/296: chown d4/d9/d19/d21/c4b 9607182 1 2024-04-12T13:42:00.768 INFO:tasks.workunit.client.0.smithi060.stdout:8/332: chown d9/d1d/c26 19168854 1 2024-04-12T13:42:00.769 INFO:tasks.workunit.client.0.smithi060.stdout:7/272: mkdir d0/d7/d43/d63 0 2024-04-12T13:42:00.769 INFO:tasks.workunit.client.0.smithi060.stdout:9/297: write d4/d9/d19/d21/f2f [2127542,46854] 0 2024-04-12T13:42:00.770 INFO:tasks.workunit.client.1.smithi110.stdout:8/345: dwrite d1/d7/f32 [4194304,4194304] 0 2024-04-12T13:42:00.770 INFO:tasks.workunit.client.1.smithi110.stdout:7/348: chown d1/d3/d4/d36/d4b/c42 0 1 2024-04-12T13:42:00.772 INFO:tasks.workunit.client.0.smithi060.stdout:9/298: dread - d4/d8/f40 zero size 2024-04-12T13:42:00.774 INFO:tasks.workunit.client.1.smithi110.stdout:1/310: rename de/d14/d34/d55/c6e to de/c70 0 2024-04-12T13:42:00.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/299: write d4/d8/f41 [48155,15390] 0 2024-04-12T13:42:00.776 INFO:tasks.workunit.client.0.smithi060.stdout:1/434: truncate d1e/f2b 2606720 0 2024-04-12T13:42:00.777 INFO:tasks.workunit.client.0.smithi060.stdout:3/335: symlink d7/d17/d27/d36/l6f 0 2024-04-12T13:42:00.779 INFO:tasks.workunit.client.0.smithi060.stdout:4/330: mknod d6/d7/dd/d1a/d57/d63/d68/d76/c78 0 2024-04-12T13:42:00.781 INFO:tasks.workunit.client.1.smithi110.stdout:9/420: creat df/d13/d26/d37/f90 x:0 0 0 2024-04-12T13:42:00.781 INFO:tasks.workunit.client.0.smithi060.stdout:0/337: mkdir d7/d9/de/d80 0 2024-04-12T13:42:00.782 INFO:tasks.workunit.client.1.smithi110.stdout:3/347: mknod d5/dc/d31/d74/d75/c7c 0 2024-04-12T13:42:00.788 INFO:tasks.workunit.client.0.smithi060.stdout:7/273: chown d0/d7/c36 603948796 1 2024-04-12T13:42:00.789 INFO:tasks.workunit.client.1.smithi110.stdout:2/373: rename d6/f11 to d6/dc/dd/d49/d64/d4a/d55/f68 0 2024-04-12T13:42:00.790 INFO:tasks.workunit.client.0.smithi060.stdout:6/430: symlink d1/d7/l9f 0 2024-04-12T13:42:00.793 INFO:tasks.workunit.client.1.smithi110.stdout:4/462: dread d0/f5 [0,4194304] 0 2024-04-12T13:42:00.796 INFO:tasks.workunit.client.1.smithi110.stdout:8/346: dread d1/d3/f13 [0,4194304] 0 2024-04-12T13:42:00.797 INFO:tasks.workunit.client.1.smithi110.stdout:9/421: creat df/d13/d2c/d2d/d39/f91 x:0 0 0 2024-04-12T13:42:00.799 INFO:tasks.workunit.client.0.smithi060.stdout:9/300: symlink d4/d33/d50/l64 0 2024-04-12T13:42:00.802 INFO:tasks.workunit.client.0.smithi060.stdout:2/332: truncate d6/f25 1987293 0 2024-04-12T13:42:00.803 INFO:tasks.workunit.client.1.smithi110.stdout:6/373: dwrite d7/d10/f62 [0,4194304] 0 2024-04-12T13:42:00.804 INFO:tasks.workunit.client.0.smithi060.stdout:2/333: write d6/d56/f54 [2881606,113698] 0 2024-04-12T13:42:00.806 INFO:tasks.workunit.client.1.smithi110.stdout:6/374: chown d7/d25/d30/d44/d3d/f47 281924 1 2024-04-12T13:42:00.807 INFO:tasks.workunit.client.1.smithi110.stdout:2/374: dwrite d6/dc/dd/fe [4194304,4194304] 0 2024-04-12T13:42:00.808 INFO:tasks.workunit.client.1.smithi110.stdout:7/349: write d1/f2b [2014577,72113] 0 2024-04-12T13:42:00.813 INFO:tasks.workunit.client.0.smithi060.stdout:5/374: truncate d6/d10/f2b 1141439 0 2024-04-12T13:42:00.814 INFO:tasks.workunit.client.0.smithi060.stdout:9/301: mkdir d4/d33/d65 0 2024-04-12T13:42:00.816 INFO:tasks.workunit.client.0.smithi060.stdout:1/435: mkdir d1e/d23/d2e/d5e/d68/d9a 0 2024-04-12T13:42:00.816 INFO:tasks.workunit.client.0.smithi060.stdout:9/302: write d4/d8/f2e [1003299,47858] 0 2024-04-12T13:42:00.817 INFO:tasks.workunit.client.0.smithi060.stdout:3/336: mknod d7/d17/d19/d33/d63/d6d/c70 0 2024-04-12T13:42:00.817 INFO:tasks.workunit.client.1.smithi110.stdout:0/277: link d1/d8/d36/c47 d1/d8/c59 0 2024-04-12T13:42:00.819 INFO:tasks.workunit.client.1.smithi110.stdout:3/348: dwrite d5/dc/d31/d3b/d32/d3e/f44 [0,4194304] 0 2024-04-12T13:42:00.819 INFO:tasks.workunit.client.1.smithi110.stdout:0/278: write d1/d8/fb [1891227,66799] 0 2024-04-12T13:42:00.821 INFO:tasks.workunit.client.0.smithi060.stdout:0/338: symlink d7/d9/de/d63/l81 0 2024-04-12T13:42:00.823 INFO:tasks.workunit.client.0.smithi060.stdout:3/337: dread d7/d17/d27/d36/f4b [0,4194304] 0 2024-04-12T13:42:00.825 INFO:tasks.workunit.client.0.smithi060.stdout:2/334: symlink d6/d56/l68 0 2024-04-12T13:42:00.828 INFO:tasks.workunit.client.1.smithi110.stdout:4/463: stat d0/de/d32/c4a 0 2024-04-12T13:42:00.830 INFO:tasks.workunit.client.1.smithi110.stdout:4/464: truncate d0/de/d32/d61/f9b 839223 0 2024-04-12T13:42:00.832 INFO:tasks.workunit.client.1.smithi110.stdout:5/308: sync 2024-04-12T13:42:00.833 INFO:tasks.workunit.client.1.smithi110.stdout:5/309: chown da/db/d15/l49 40 1 2024-04-12T13:42:00.834 INFO:tasks.workunit.client.1.smithi110.stdout:5/310: fsync da/db/d61/f3e 0 2024-04-12T13:42:00.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/333: creat d9/f71 x:0 0 0 2024-04-12T13:42:00.835 INFO:tasks.workunit.client.1.smithi110.stdout:9/422: rmdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d 39 2024-04-12T13:42:00.836 INFO:tasks.workunit.client.1.smithi110.stdout:9/423: chown df/d13/d26/d37/d49/l4d 3 1 2024-04-12T13:42:00.839 INFO:tasks.workunit.client.1.smithi110.stdout:5/311: dread da/db/d15/f59 [4194304,4194304] 0 2024-04-12T13:42:00.841 INFO:tasks.workunit.client.1.smithi110.stdout:7/350: mkdir d1/d3/d4/d36/d76 0 2024-04-12T13:42:00.842 INFO:tasks.workunit.client.1.smithi110.stdout:7/351: truncate d1/f1e 4697124 0 2024-04-12T13:42:00.848 INFO:tasks.workunit.client.1.smithi110.stdout:3/349: rename d5/dc/d31/d3b/d32/c64 to d5/dc/d20/d2d/d4f/d76/c7d 0 2024-04-12T13:42:00.849 INFO:tasks.workunit.client.0.smithi060.stdout:9/303: creat d4/d9/d19/d21/f66 x:0 0 0 2024-04-12T13:42:00.850 INFO:tasks.workunit.client.1.smithi110.stdout:3/350: fsync d5/dc/d20/d2d/d4e/f6d 0 2024-04-12T13:42:00.851 INFO:tasks.workunit.client.0.smithi060.stdout:9/304: read - d4/d8/f4d zero size 2024-04-12T13:42:00.851 INFO:tasks.workunit.client.1.smithi110.stdout:1/311: truncate de/d15/d32/f52 869904 0 2024-04-12T13:42:00.853 INFO:tasks.workunit.client.1.smithi110.stdout:3/351: truncate d5/dc/d31/d3b/d32/f78 540561 0 2024-04-12T13:42:00.854 INFO:tasks.workunit.client.1.smithi110.stdout:4/465: mknod d0/de/d32/d5f/c9d 0 2024-04-12T13:42:00.855 INFO:tasks.workunit.client.0.smithi060.stdout:4/331: truncate d6/d7/dd/d1a/d19/f52 1177424 0 2024-04-12T13:42:00.856 INFO:tasks.workunit.client.1.smithi110.stdout:7/352: dwrite d1/d3/d4/d55/d56/f60 [0,4194304] 0 2024-04-12T13:42:00.862 INFO:tasks.workunit.client.0.smithi060.stdout:3/338: creat d7/d17/d27/d36/d53/f71 x:0 0 0 2024-04-12T13:42:00.862 INFO:tasks.workunit.client.0.smithi060.stdout:2/335: unlink d6/c7 0 2024-04-12T13:42:00.864 INFO:tasks.workunit.client.1.smithi110.stdout:9/424: mknod df/d13/d3b/d40/d56/c92 0 2024-04-12T13:42:00.865 INFO:tasks.workunit.client.0.smithi060.stdout:3/339: chown d7/d17/d19/d33/c5d 260340 1 2024-04-12T13:42:00.865 INFO:tasks.workunit.client.1.smithi110.stdout:9/425: fdatasync df/d13/d26/f28 0 2024-04-12T13:42:00.866 INFO:tasks.workunit.client.0.smithi060.stdout:1/436: dread d1e/f4d [0,4194304] 0 2024-04-12T13:42:00.866 INFO:tasks.workunit.client.0.smithi060.stdout:8/334: symlink d9/d1d/l72 0 2024-04-12T13:42:00.867 INFO:tasks.workunit.client.1.smithi110.stdout:9/426: stat df/d13/d3b/d40/l69 0 2024-04-12T13:42:00.868 INFO:tasks.workunit.client.0.smithi060.stdout:7/274: creat d0/f64 x:0 0 0 2024-04-12T13:42:00.869 INFO:tasks.workunit.client.1.smithi110.stdout:5/312: mknod da/d2e/d45/d25/d5d/c73 0 2024-04-12T13:42:00.869 INFO:tasks.workunit.client.1.smithi110.stdout:9/427: truncate df/f11 4441162 0 2024-04-12T13:42:00.871 INFO:tasks.workunit.client.1.smithi110.stdout:0/279: mknod d1/c5a 0 2024-04-12T13:42:00.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/375: creat d6/dd/d1f/d32/d46/f82 x:0 0 0 2024-04-12T13:42:00.874 INFO:tasks.workunit.client.0.smithi060.stdout:9/305: dwrite d4/d9/d19/d21/f27 [0,4194304] 0 2024-04-12T13:42:00.874 INFO:tasks.workunit.client.1.smithi110.stdout:0/280: dread d1/d8/f34 [0,4194304] 0 2024-04-12T13:42:00.881 INFO:tasks.workunit.client.1.smithi110.stdout:3/352: unlink d5/dc/f11 0 2024-04-12T13:42:00.888 INFO:tasks.workunit.client.1.smithi110.stdout:4/466: chown d0/d78/l80 20938 1 2024-04-12T13:42:00.892 INFO:tasks.workunit.client.1.smithi110.stdout:2/375: creat d6/dc/d13/f69 x:0 0 0 2024-04-12T13:42:00.892 INFO:tasks.workunit.client.0.smithi060.stdout:3/340: dread d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:42:00.893 INFO:tasks.workunit.client.1.smithi110.stdout:0/281: dwrite d1/d8/f2e [0,4194304] 0 2024-04-12T13:42:00.894 INFO:tasks.workunit.client.0.smithi060.stdout:1/437: mkdir d1e/d23/d49/d4e/d9b 0 2024-04-12T13:42:00.895 INFO:tasks.workunit.client.1.smithi110.stdout:0/282: chown d1/d27/d31/f50 0 1 2024-04-12T13:42:00.896 INFO:tasks.workunit.client.0.smithi060.stdout:6/431: getdents d1/d7/da/dc/d24/d2d 0 2024-04-12T13:42:00.896 INFO:tasks.workunit.client.0.smithi060.stdout:2/336: fdatasync d6/d13/f34 0 2024-04-12T13:42:00.897 INFO:tasks.workunit.client.0.smithi060.stdout:8/335: symlink d9/d1b/d37/d48/l73 0 2024-04-12T13:42:00.897 INFO:tasks.workunit.client.1.smithi110.stdout:9/428: stat df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d 0 2024-04-12T13:42:00.897 INFO:tasks.workunit.client.1.smithi110.stdout:8/347: getdents d1/d7/d20 0 2024-04-12T13:42:00.899 INFO:tasks.workunit.client.0.smithi060.stdout:2/337: write d6/d56/d43/f65 [217065,108001] 0 2024-04-12T13:42:00.900 INFO:tasks.workunit.client.0.smithi060.stdout:9/306: stat d4/d8/l51 0 2024-04-12T13:42:00.902 INFO:tasks.workunit.client.0.smithi060.stdout:0/339: creat d7/d9/f82 x:0 0 0 2024-04-12T13:42:00.904 INFO:tasks.workunit.client.1.smithi110.stdout:6/375: getdents d7 0 2024-04-12T13:42:00.905 INFO:tasks.workunit.client.1.smithi110.stdout:6/376: dread - d7/d10/d1c/d2b/d48/f5e zero size 2024-04-12T13:42:00.907 INFO:tasks.workunit.client.0.smithi060.stdout:7/275: mknod d0/c65 0 2024-04-12T13:42:00.909 INFO:tasks.workunit.client.0.smithi060.stdout:1/438: fsync d1e/d23/d49/f54 0 2024-04-12T13:42:00.910 INFO:tasks.workunit.client.1.smithi110.stdout:4/467: symlink d0/d19/d26/d65/l9e 0 2024-04-12T13:42:00.910 INFO:tasks.workunit.client.1.smithi110.stdout:2/376: rmdir d6/dc/dd/d49/d64/d4a/d3c 39 2024-04-12T13:42:00.910 INFO:tasks.workunit.client.0.smithi060.stdout:8/336: unlink d9/da/f43 0 2024-04-12T13:42:00.911 INFO:tasks.workunit.client.1.smithi110.stdout:4/468: chown d0 393 1 2024-04-12T13:42:00.917 INFO:tasks.workunit.client.1.smithi110.stdout:6/377: dwrite d7/f39 [0,4194304] 0 2024-04-12T13:42:00.918 INFO:tasks.workunit.client.1.smithi110.stdout:6/378: fsync d7/d10/f62 0 2024-04-12T13:42:00.919 INFO:tasks.workunit.client.0.smithi060.stdout:6/432: fdatasync d1/d7/da/dc/f19 0 2024-04-12T13:42:00.920 INFO:tasks.workunit.client.1.smithi110.stdout:6/379: fdatasync d7/d25/d30/d44/d3d/f49 0 2024-04-12T13:42:00.921 INFO:tasks.workunit.client.0.smithi060.stdout:1/439: dread f7 [0,4194304] 0 2024-04-12T13:42:00.921 INFO:tasks.workunit.client.0.smithi060.stdout:2/338: fsync d6/f25 0 2024-04-12T13:42:00.929 INFO:tasks.workunit.client.0.smithi060.stdout:7/276: fdatasync d0/f21 0 2024-04-12T13:42:00.929 INFO:tasks.workunit.client.0.smithi060.stdout:3/341: creat d7/d17/f72 x:0 0 0 2024-04-12T13:42:00.931 INFO:tasks.workunit.client.0.smithi060.stdout:5/376: link d6/d10/d12/d15/l65 d6/dd/d1f/d25/l83 0 2024-04-12T13:42:00.935 INFO:tasks.workunit.client.0.smithi060.stdout:7/277: unlink d0/d7/f45 0 2024-04-12T13:42:00.941 INFO:tasks.workunit.client.0.smithi060.stdout:3/342: mkdir d7/d17/d27/d36/d53/d73 0 2024-04-12T13:42:00.945 INFO:tasks.workunit.client.0.smithi060.stdout:2/339: dwrite d6/d10/d2b/d35/f4c [0,4194304] 0 2024-04-12T13:42:00.947 INFO:tasks.workunit.client.0.smithi060.stdout:6/433: creat d1/fa0 x:0 0 0 2024-04-12T13:42:00.949 INFO:tasks.workunit.client.1.smithi110.stdout:8/348: symlink d1/d3/d35/d3a/d3e/d4f/l72 0 2024-04-12T13:42:00.951 INFO:tasks.workunit.client.1.smithi110.stdout:8/349: stat d1/d5/c38 0 2024-04-12T13:42:00.953 INFO:tasks.workunit.client.0.smithi060.stdout:0/340: dread d7/d9/f21 [0,4194304] 0 2024-04-12T13:42:00.954 INFO:tasks.workunit.client.0.smithi060.stdout:1/440: getdents d1e/d29/d6d 0 2024-04-12T13:42:00.956 INFO:tasks.workunit.client.1.smithi110.stdout:3/353: rename d5/dc/d20/d2d/d4f/d76/c7d to d5/dc/d31/d3b/d5b/c7e 0 2024-04-12T13:42:00.957 INFO:tasks.workunit.client.0.smithi060.stdout:5/377: dwrite d6/dd/d1f/d25/d42/d6b/f76 [0,4194304] 0 2024-04-12T13:42:00.964 INFO:tasks.workunit.client.0.smithi060.stdout:4/332: truncate d6/f30 2450371 0 2024-04-12T13:42:00.973 INFO:tasks.workunit.client.0.smithi060.stdout:6/434: unlink d1/d7/da/dc/l8e 0 2024-04-12T13:42:00.976 INFO:tasks.workunit.client.1.smithi110.stdout:4/469: symlink d0/d13/l9f 0 2024-04-12T13:42:00.982 INFO:tasks.workunit.client.0.smithi060.stdout:9/307: truncate d4/d9/d19/f4e 3093435 0 2024-04-12T13:42:00.983 INFO:tasks.workunit.client.0.smithi060.stdout:5/378: rmdir d6/d10/d12/d15 39 2024-04-12T13:42:00.983 INFO:tasks.workunit.client.0.smithi060.stdout:8/337: write d9/d1b/d37/f39 [1156986,114625] 0 2024-04-12T13:42:00.984 INFO:tasks.workunit.client.0.smithi060.stdout:2/340: symlink d6/d10/d2b/d60/l69 0 2024-04-12T13:42:00.987 INFO:tasks.workunit.client.0.smithi060.stdout:5/379: stat d6/dd/d1f/d25/d42/d6b/f80 0 2024-04-12T13:42:00.989 INFO:tasks.workunit.client.0.smithi060.stdout:8/338: write d9/d1b/d2b/f55 [743295,57616] 0 2024-04-12T13:42:00.989 INFO:tasks.workunit.client.1.smithi110.stdout:1/312: sync 2024-04-12T13:42:00.989 INFO:tasks.workunit.client.1.smithi110.stdout:7/353: sync 2024-04-12T13:42:00.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/341: read d6/d13/d17/f3c [1189353,16812] 0 2024-04-12T13:42:00.992 INFO:tasks.workunit.client.1.smithi110.stdout:7/354: chown d1/d1b/d3d/d68 1 1 2024-04-12T13:42:00.994 INFO:tasks.workunit.client.1.smithi110.stdout:3/354: fdatasync d5/dc/d31/d3b/d32/f37 0 2024-04-12T13:42:00.995 INFO:tasks.workunit.client.0.smithi060.stdout:1/441: creat d1e/d23/d2e/d86/f9c x:0 0 0 2024-04-12T13:42:00.996 INFO:tasks.workunit.client.1.smithi110.stdout:7/355: chown d1/d3/d43/c75 204364 1 2024-04-12T13:42:00.997 INFO:tasks.workunit.client.0.smithi060.stdout:1/442: stat d1e/d1f/c3c 0 2024-04-12T13:42:00.998 INFO:tasks.workunit.client.1.smithi110.stdout:5/313: getdents da 0 2024-04-12T13:42:00.999 INFO:tasks.workunit.client.0.smithi060.stdout:0/341: write d7/d9/d14/f25 [2897566,122839] 0 2024-04-12T13:42:00.999 INFO:tasks.workunit.client.1.smithi110.stdout:7/356: readlink d1/d31/l57 0 2024-04-12T13:42:01.001 INFO:tasks.workunit.client.1.smithi110.stdout:3/355: write d5/dc/d31/d3b/d32/d3e/f41 [1159132,128752] 0 2024-04-12T13:42:01.001 INFO:tasks.workunit.client.1.smithi110.stdout:4/470: dwrite d0/de/d32/d5f/f7c [0,4194304] 0 2024-04-12T13:42:01.003 INFO:tasks.workunit.client.1.smithi110.stdout:7/357: chown d1/d1b/d33/c37 2504 1 2024-04-12T13:42:01.005 INFO:tasks.workunit.client.1.smithi110.stdout:3/356: write d5/dc/d31/d3b/d32/f78 [178307,111779] 0 2024-04-12T13:42:01.006 INFO:tasks.workunit.client.1.smithi110.stdout:7/358: write d1/d3/d4/d55/f65 [1133038,42502] 0 2024-04-12T13:42:01.007 INFO:tasks.workunit.client.0.smithi060.stdout:9/308: rename d4/d25 to d4/d33/d50/d5c/d67 0 2024-04-12T13:42:01.012 INFO:tasks.workunit.client.0.smithi060.stdout:3/343: dwrite d7/da/f3e [0,4194304] 0 2024-04-12T13:42:01.014 INFO:tasks.workunit.client.1.smithi110.stdout:1/313: fdatasync de/d14/d34/f54 0 2024-04-12T13:42:01.023 INFO:tasks.workunit.client.1.smithi110.stdout:2/377: dwrite d6/dc/dd/f1f [0,4194304] 0 2024-04-12T13:42:01.025 INFO:tasks.workunit.client.1.smithi110.stdout:5/314: dwrite da/d2e/d45/d25/f44 [4194304,4194304] 0 2024-04-12T13:42:01.027 INFO:tasks.workunit.client.0.smithi060.stdout:6/435: write d1/d7/da/dc/d24/f1f [978166,24959] 0 2024-04-12T13:42:01.028 INFO:tasks.workunit.client.0.smithi060.stdout:1/443: dwrite d1e/d29/d37/f73 [0,4194304] 0 2024-04-12T13:42:01.036 INFO:tasks.workunit.client.1.smithi110.stdout:8/350: write d1/d3/d35/d3a/d3e/f49 [1459685,22773] 0 2024-04-12T13:42:01.036 INFO:tasks.workunit.client.0.smithi060.stdout:9/309: chown d4/d8/f2c 109 1 2024-04-12T13:42:01.037 INFO:tasks.workunit.client.1.smithi110.stdout:0/283: dwrite d1/f14 [0,4194304] 0 2024-04-12T13:42:01.038 INFO:tasks.workunit.client.0.smithi060.stdout:4/333: dwrite d6/f70 [0,4194304] 0 2024-04-12T13:42:01.041 INFO:tasks.workunit.client.1.smithi110.stdout:8/351: chown d1/d3/d3c/c50 1952693024 1 2024-04-12T13:42:01.042 INFO:tasks.workunit.client.0.smithi060.stdout:9/310: chown d4/d8/f17 1013 1 2024-04-12T13:42:01.042 INFO:tasks.workunit.client.0.smithi060.stdout:2/342: getdents d6/d10/d16/d36 0 2024-04-12T13:42:01.044 INFO:tasks.workunit.client.0.smithi060.stdout:9/311: dread - d4/d8/f4d zero size 2024-04-12T13:42:01.044 INFO:tasks.workunit.client.1.smithi110.stdout:6/380: creat d7/d10/d1c/d2b/f71 x:0 0 0 2024-04-12T13:42:01.045 INFO:tasks.workunit.client.1.smithi110.stdout:1/314: creat de/d15/d32/f71 x:0 0 0 2024-04-12T13:42:01.045 INFO:tasks.workunit.client.1.smithi110.stdout:9/429: rename df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/f65 to df/d13/d2c/d2d/f93 0 2024-04-12T13:42:01.046 INFO:tasks.workunit.client.0.smithi060.stdout:4/334: truncate d6/d7/dd/df/f37 1976087 0 2024-04-12T13:42:01.051 INFO:tasks.workunit.client.1.smithi110.stdout:2/378: dwrite d6/dc/dd/d49/d64/f2c [0,4194304] 0 2024-04-12T13:42:01.051 INFO:tasks.workunit.client.1.smithi110.stdout:5/315: creat da/d2e/d45/d29/d66/f74 x:0 0 0 2024-04-12T13:42:01.053 INFO:tasks.workunit.client.0.smithi060.stdout:8/339: write d9/d1b/d37/f6a [660693,3508] 0 2024-04-12T13:42:01.057 INFO:tasks.workunit.client.1.smithi110.stdout:5/316: chown da/db/f37 33124914 1 2024-04-12T13:42:01.060 INFO:tasks.workunit.client.1.smithi110.stdout:5/317: write f9 [3362368,122157] 0 2024-04-12T13:42:01.068 INFO:tasks.workunit.client.1.smithi110.stdout:4/471: rename d0/d19/d26/d65/d7e/d98 to d0/de/da0 0 2024-04-12T13:42:01.071 INFO:tasks.workunit.client.1.smithi110.stdout:6/381: write d7/f1a [6905523,66353] 0 2024-04-12T13:42:01.072 INFO:tasks.workunit.client.1.smithi110.stdout:1/315: chown de/d1d/c59 297335490 1 2024-04-12T13:42:01.074 INFO:tasks.workunit.client.1.smithi110.stdout:0/284: creat d1/d48/f5b x:0 0 0 2024-04-12T13:42:01.076 INFO:tasks.workunit.client.1.smithi110.stdout:0/285: stat d1/d8/f21 0 2024-04-12T13:42:01.080 INFO:tasks.workunit.client.0.smithi060.stdout:8/340: dwrite d9/d1d/f6f [0,4194304] 0 2024-04-12T13:42:01.091 INFO:tasks.workunit.client.1.smithi110.stdout:7/359: truncate d1/d1b/d3d/f63 713746 0 2024-04-12T13:42:01.093 INFO:tasks.workunit.client.1.smithi110.stdout:0/286: symlink d1/d27/l5c 0 2024-04-12T13:42:01.093 INFO:tasks.workunit.client.1.smithi110.stdout:2/379: getdents d6/dc/d1b/d57/d62 0 2024-04-12T13:42:01.097 INFO:tasks.workunit.client.1.smithi110.stdout:3/357: rename d5/dc/d31/d3b/d5b/c7e to d5/dc/d31/d74/d75/c7f 0 2024-04-12T13:42:01.102 INFO:tasks.workunit.client.1.smithi110.stdout:1/316: mkdir de/d15/d32/d61/d6a/d72 0 2024-04-12T13:42:01.103 INFO:tasks.workunit.client.1.smithi110.stdout:1/317: stat de/d14/d34/d55/c5d 0 2024-04-12T13:42:01.110 INFO:tasks.workunit.client.1.smithi110.stdout:4/472: write d0/d13/f52 [330347,79295] 0 2024-04-12T13:42:01.113 INFO:tasks.workunit.client.1.smithi110.stdout:8/352: rename d1/d5/l6 to d1/d3/d35/d3a/d3e/l73 0 2024-04-12T13:42:01.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/436: rename d1/d7/l9f to d1/d7/da/dc/d24/d30/d52/d5e/la1 0 2024-04-12T13:42:01.119 INFO:tasks.workunit.client.0.smithi060.stdout:6/437: chown d1/d7/da/dc/d24/l41 64038 1 2024-04-12T13:42:01.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/438: chown d1/d7/da/dc/d24/d34 19511504 1 2024-04-12T13:42:01.124 INFO:tasks.workunit.client.1.smithi110.stdout:6/382: link d7/d10/l23 d7/d25/d30/d44/d3d/l72 0 2024-04-12T13:42:01.126 INFO:tasks.workunit.client.1.smithi110.stdout:9/430: getdents df/d13/d26/d37 0 2024-04-12T13:42:01.130 INFO:tasks.workunit.client.0.smithi060.stdout:2/343: creat d6/d13/d31/d33/f6a x:0 0 0 2024-04-12T13:42:01.131 INFO:tasks.workunit.client.1.smithi110.stdout:0/287: dread d1/f7 [0,4194304] 0 2024-04-12T13:42:01.133 INFO:tasks.workunit.client.0.smithi060.stdout:9/312: symlink d4/d33/d50/l68 0 2024-04-12T13:42:01.134 INFO:tasks.workunit.client.1.smithi110.stdout:2/380: symlink d6/d18/l6a 0 2024-04-12T13:42:01.136 INFO:tasks.workunit.client.1.smithi110.stdout:4/473: symlink d0/d19/la1 0 2024-04-12T13:42:01.137 INFO:tasks.workunit.client.1.smithi110.stdout:0/288: dread d1/d27/d31/f49 [0,4194304] 0 2024-04-12T13:42:01.138 INFO:tasks.workunit.client.1.smithi110.stdout:4/474: chown d0/de/d32/d5f/d71/f73 1335 1 2024-04-12T13:42:01.138 INFO:tasks.workunit.client.1.smithi110.stdout:0/289: chown d1/d56/l58 98078352 1 2024-04-12T13:42:01.138 INFO:tasks.workunit.client.1.smithi110.stdout:5/318: rename da/db/d3b/f6a to da/d35/f75 0 2024-04-12T13:42:01.141 INFO:tasks.workunit.client.1.smithi110.stdout:0/290: read d1/d27/d31/f50 [4775,76470] 0 2024-04-12T13:42:01.141 INFO:tasks.workunit.client.0.smithi060.stdout:0/342: getdents d7/d9/de/d80 0 2024-04-12T13:42:01.142 INFO:tasks.workunit.client.0.smithi060.stdout:0/343: readlink d7/d41/l54 0 2024-04-12T13:42:01.142 INFO:tasks.workunit.client.0.smithi060.stdout:1/444: mknod d1e/d23/d2e/d5e/c9d 0 2024-04-12T13:42:01.142 INFO:tasks.workunit.client.1.smithi110.stdout:7/360: link d1/d3/d4/f1c d1/d3/d4/d55/f77 0 2024-04-12T13:42:01.144 INFO:tasks.workunit.client.0.smithi060.stdout:5/380: link d6/d10/d12/d38/l6c d6/dd/d1f/d25/d35/d50/d5f/l84 0 2024-04-12T13:42:01.150 INFO:tasks.workunit.client.1.smithi110.stdout:1/318: rename de/d15/f3e to de/d15/d32/d61/f73 0 2024-04-12T13:42:01.151 INFO:tasks.workunit.client.0.smithi060.stdout:9/313: mknod d4/d33/d50/d5c/d67/c69 0 2024-04-12T13:42:01.152 INFO:tasks.workunit.client.1.smithi110.stdout:1/319: write de/f10 [1885377,50311] 0 2024-04-12T13:42:01.152 INFO:tasks.workunit.client.0.smithi060.stdout:3/344: truncate d7/d17/f1a 2993043 0 2024-04-12T13:42:01.155 INFO:tasks.workunit.client.0.smithi060.stdout:8/341: mknod d9/c74 0 2024-04-12T13:42:01.157 INFO:tasks.workunit.client.0.smithi060.stdout:0/344: chown d7/d9/f1a 13429843 1 2024-04-12T13:42:01.158 INFO:tasks.workunit.client.0.smithi060.stdout:8/342: write d9/f71 [504165,9567] 0 2024-04-12T13:42:01.159 INFO:tasks.workunit.client.1.smithi110.stdout:4/475: creat d0/de/d32/d61/fa2 x:0 0 0 2024-04-12T13:42:01.159 INFO:tasks.workunit.client.0.smithi060.stdout:0/345: fdatasync d7/d33/d5b/f72 0 2024-04-12T13:42:01.161 INFO:tasks.workunit.client.1.smithi110.stdout:5/319: symlink da/db/d61/l76 0 2024-04-12T13:42:01.162 INFO:tasks.workunit.client.1.smithi110.stdout:5/320: stat da/db/f4a 0 2024-04-12T13:42:01.163 INFO:tasks.workunit.client.1.smithi110.stdout:9/431: mkdir df/d13/d2c/d2d/d94 0 2024-04-12T13:42:01.165 INFO:tasks.workunit.client.0.smithi060.stdout:2/344: mkdir d6/d10/d6b 0 2024-04-12T13:42:01.166 INFO:tasks.workunit.client.1.smithi110.stdout:0/291: creat d1/d27/d43/f5d x:0 0 0 2024-04-12T13:42:01.170 INFO:tasks.workunit.client.0.smithi060.stdout:9/314: fdatasync d4/fd 0 2024-04-12T13:42:01.170 INFO:tasks.workunit.client.0.smithi060.stdout:3/345: dwrite d7/d17/d19/f31 [0,4194304] 0 2024-04-12T13:42:01.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/346: truncate d7/da/f35 678280 0 2024-04-12T13:42:01.173 INFO:tasks.workunit.client.1.smithi110.stdout:2/381: fsync d6/dc/dd/d49/d64/d4a/d51/f2f 0 2024-04-12T13:42:01.174 INFO:tasks.workunit.client.0.smithi060.stdout:5/381: dread d6/dd/d1f/d25/d53/f77 [0,4194304] 0 2024-04-12T13:42:01.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/347: read - d7/d17/d27/d36/d53/f6a zero size 2024-04-12T13:42:01.178 INFO:tasks.workunit.client.1.smithi110.stdout:9/432: dwrite df/d38/f88 [0,4194304] 0 2024-04-12T13:42:01.178 INFO:tasks.workunit.client.1.smithi110.stdout:2/382: dread d6/dc/d13/f43 [0,4194304] 0 2024-04-12T13:42:01.178 INFO:tasks.workunit.client.1.smithi110.stdout:9/433: fsync df/d8a/f8e 0 2024-04-12T13:42:01.178 INFO:tasks.workunit.client.0.smithi060.stdout:5/382: chown d6/dd/d27/l51 103 1 2024-04-12T13:42:01.182 INFO:tasks.workunit.client.0.smithi060.stdout:5/383: chown d6/dd/d1f/d32/d46/l4d 228 1 2024-04-12T13:42:01.195 INFO:tasks.workunit.client.0.smithi060.stdout:4/335: getdents d6/d7/db 0 2024-04-12T13:42:01.196 INFO:tasks.workunit.client.0.smithi060.stdout:9/315: creat d4/d9/d19/f6a x:0 0 0 2024-04-12T13:42:01.197 INFO:tasks.workunit.client.1.smithi110.stdout:3/358: link d5/dc/d20/f2a d5/dc/d31/d74/f80 0 2024-04-12T13:42:01.199 INFO:tasks.workunit.client.1.smithi110.stdout:6/383: sync 2024-04-12T13:42:01.201 INFO:tasks.workunit.client.1.smithi110.stdout:4/476: symlink d0/d75/d84/la3 0 2024-04-12T13:42:01.201 INFO:tasks.workunit.client.1.smithi110.stdout:6/384: fsync d7/d25/d30/d44/d3d/f49 0 2024-04-12T13:42:01.202 INFO:tasks.workunit.client.1.smithi110.stdout:4/477: stat d0/d19/d1c/d50/d6f 0 2024-04-12T13:42:01.205 INFO:tasks.workunit.client.1.smithi110.stdout:6/385: dread d7/d25/d30/d44/f2d [0,4194304] 0 2024-04-12T13:42:01.205 INFO:tasks.workunit.client.1.smithi110.stdout:5/321: write da/db/f14 [3980290,85197] 0 2024-04-12T13:42:01.205 INFO:tasks.workunit.client.0.smithi060.stdout:2/345: mknod d6/d56/d55/c6c 0 2024-04-12T13:42:01.208 INFO:tasks.workunit.client.1.smithi110.stdout:5/322: truncate da/db/f4a 1459614 0 2024-04-12T13:42:01.210 INFO:tasks.workunit.client.0.smithi060.stdout:4/336: symlink d6/d7/dd/d1a/d56/l79 0 2024-04-12T13:42:01.211 INFO:tasks.workunit.client.1.smithi110.stdout:5/323: dread - da/d2e/d45/d29/d58/f6d zero size 2024-04-12T13:42:01.211 INFO:tasks.workunit.client.1.smithi110.stdout:7/361: getdents d1/d1b/d74 0 2024-04-12T13:42:01.213 INFO:tasks.workunit.client.1.smithi110.stdout:5/324: chown da/d2e/d45/f1e 14412890 1 2024-04-12T13:42:01.213 INFO:tasks.workunit.client.1.smithi110.stdout:7/362: read - d1/d1b/d33/f66 zero size 2024-04-12T13:42:01.214 INFO:tasks.workunit.client.0.smithi060.stdout:1/445: getdents d1e/d23/d49/d4e 0 2024-04-12T13:42:01.214 INFO:tasks.workunit.client.1.smithi110.stdout:9/434: creat df/d38/f95 x:0 0 0 2024-04-12T13:42:01.215 INFO:tasks.workunit.client.1.smithi110.stdout:3/359: dwrite d5/dc/f67 [0,4194304] 0 2024-04-12T13:42:01.217 INFO:tasks.workunit.client.1.smithi110.stdout:3/360: fdatasync d5/dc/d20/d2d/f42 0 2024-04-12T13:42:01.219 INFO:tasks.workunit.client.1.smithi110.stdout:8/353: rename d1/d3/d35/d43/l52 to d1/d3/d35/d3a/d41/l74 0 2024-04-12T13:42:01.222 INFO:tasks.workunit.client.0.smithi060.stdout:3/348: link d7/d17/d27/d36/d53/f6a d7/d17/d19/f74 0 2024-04-12T13:42:01.224 INFO:tasks.workunit.client.1.smithi110.stdout:1/320: truncate de/f30 2444494 0 2024-04-12T13:42:01.224 INFO:tasks.workunit.client.1.smithi110.stdout:4/478: creat d0/de/d2c/d57/fa4 x:0 0 0 2024-04-12T13:42:01.224 INFO:tasks.workunit.client.1.smithi110.stdout:0/292: mkdir d1/d5e 0 2024-04-12T13:42:01.225 INFO:tasks.workunit.client.1.smithi110.stdout:8/354: chown d1/d3/d3c/d5a/d6f 60444449 1 2024-04-12T13:42:01.226 INFO:tasks.workunit.client.1.smithi110.stdout:8/355: chown d1/d3/d3c/l42 37019 1 2024-04-12T13:42:01.227 INFO:tasks.workunit.client.0.smithi060.stdout:0/346: dwrite d7/f11 [4194304,4194304] 0 2024-04-12T13:42:01.228 INFO:tasks.workunit.client.1.smithi110.stdout:5/325: mknod da/db/d52/c77 0 2024-04-12T13:42:01.230 INFO:tasks.workunit.client.0.smithi060.stdout:9/316: dwrite d4/d9/d19/f1a [4194304,4194304] 0 2024-04-12T13:42:01.230 INFO:tasks.workunit.client.0.smithi060.stdout:1/446: symlink d1e/d23/d2e/d86/l9e 0 2024-04-12T13:42:01.232 INFO:tasks.workunit.client.0.smithi060.stdout:4/337: truncate d6/d21/d29/f73 63739 0 2024-04-12T13:42:01.232 INFO:tasks.workunit.client.1.smithi110.stdout:6/386: rename d7/d25/d30/d44/d3d/f5f to d7/f73 0 2024-04-12T13:42:01.234 INFO:tasks.workunit.client.0.smithi060.stdout:2/346: truncate d6/d56/f2d 46299 0 2024-04-12T13:42:01.235 INFO:tasks.workunit.client.1.smithi110.stdout:4/479: truncate d0/de/f24 1926631 0 2024-04-12T13:42:01.237 INFO:tasks.workunit.client.1.smithi110.stdout:4/480: truncate d0/d19/f5c 829514 0 2024-04-12T13:42:01.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/347: truncate f3 4206819 0 2024-04-12T13:42:01.238 INFO:tasks.workunit.client.0.smithi060.stdout:5/384: dwrite d6/dd/d1f/d32/f6f [0,4194304] 0 2024-04-12T13:42:01.243 INFO:tasks.workunit.client.1.smithi110.stdout:4/481: dread d0/d19/d1c/f58 [0,4194304] 0 2024-04-12T13:42:01.244 INFO:tasks.workunit.client.0.smithi060.stdout:2/348: chown d6/d56/d43/f5e 130784043 1 2024-04-12T13:42:01.245 INFO:tasks.workunit.client.0.smithi060.stdout:5/385: chown d6/dd/d1f/d25/d35/c48 1031 1 2024-04-12T13:42:01.249 INFO:tasks.workunit.client.1.smithi110.stdout:1/321: unlink de/c70 0 2024-04-12T13:42:01.249 INFO:tasks.workunit.client.0.smithi060.stdout:5/386: write d6/dd/d1f/d25/d53/f6e [7206047,8555] 0 2024-04-12T13:42:01.251 INFO:tasks.workunit.client.1.smithi110.stdout:9/435: rename df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/f7b to df/d13/d26/d37/d49/f96 0 2024-04-12T13:42:01.259 INFO:tasks.workunit.client.1.smithi110.stdout:7/363: link d1/d3/d4/c10 d1/d1b/d70/c78 0 2024-04-12T13:42:01.262 INFO:tasks.workunit.client.1.smithi110.stdout:4/482: unlink d0/d19/d1c/d50/d6f/f97 0 2024-04-12T13:42:01.263 INFO:tasks.workunit.client.1.smithi110.stdout:2/383: truncate d6/dc/dd/f22 663165 0 2024-04-12T13:42:01.263 INFO:tasks.workunit.client.1.smithi110.stdout:4/483: chown d0/de/da0 15315 1 2024-04-12T13:42:01.265 INFO:tasks.workunit.client.1.smithi110.stdout:4/484: dread - d0/d19/f62 zero size 2024-04-12T13:42:01.266 INFO:tasks.workunit.client.0.smithi060.stdout:3/349: rmdir d7/d17/d27/d36/d53/d73 0 2024-04-12T13:42:01.267 INFO:tasks.workunit.client.1.smithi110.stdout:4/485: read d0/d78/f81 [1374321,49178] 0 2024-04-12T13:42:01.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/387: rename d6/dd/d1f/d25/d35/f39 to d6/d10/d12/d4c/f85 0 2024-04-12T13:42:01.273 INFO:tasks.workunit.client.0.smithi060.stdout:0/347: creat d7/d9/d14/d4a/f83 x:0 0 0 2024-04-12T13:42:01.273 INFO:tasks.workunit.client.1.smithi110.stdout:3/361: link d5/dc/d20/l55 d5/dc/d31/d3b/d32/l81 0 2024-04-12T13:42:01.274 INFO:tasks.workunit.client.0.smithi060.stdout:1/447: write d1e/f4d [2344975,115023] 0 2024-04-12T13:42:01.276 INFO:tasks.workunit.client.0.smithi060.stdout:2/349: mkdir d6/d13/d5b/d6d 0 2024-04-12T13:42:01.279 INFO:tasks.workunit.client.1.smithi110.stdout:0/293: link d1/d11/f18 d1/d3c/f5f 0 2024-04-12T13:42:01.280 INFO:tasks.workunit.client.0.smithi060.stdout:3/350: creat d7/da/d3f/d5c/d25/d4d/f75 x:0 0 0 2024-04-12T13:42:01.281 INFO:tasks.workunit.client.1.smithi110.stdout:0/294: write d1/d8/f3d [792221,36245] 0 2024-04-12T13:42:01.282 INFO:tasks.workunit.client.0.smithi060.stdout:3/351: write d7/d17/f72 [726382,37912] 0 2024-04-12T13:42:01.284 INFO:tasks.workunit.client.1.smithi110.stdout:7/364: rmdir d1/d3/d4 39 2024-04-12T13:42:01.291 INFO:tasks.workunit.client.1.smithi110.stdout:1/322: mknod de/c74 0 2024-04-12T13:42:01.294 INFO:tasks.workunit.client.1.smithi110.stdout:2/384: rename d6/dc/dd/fe to d6/dc/dd/d49/d64/d4a/d55/f6b 0 2024-04-12T13:42:01.295 INFO:tasks.workunit.client.0.smithi060.stdout:1/448: dwrite d1e/d23/d2e/f99 [0,4194304] 0 2024-04-12T13:42:01.295 INFO:tasks.workunit.client.1.smithi110.stdout:9/436: write fc [5049438,40934] 0 2024-04-12T13:42:01.296 INFO:tasks.workunit.client.0.smithi060.stdout:1/449: chown d1e/d1f/f6e 1763230641 1 2024-04-12T13:42:01.300 INFO:tasks.workunit.client.0.smithi060.stdout:3/352: rename d7/d17/d27/d36/l49 to d7/d17/d19/d33/d63/d6d/l76 0 2024-04-12T13:42:01.301 INFO:tasks.workunit.client.1.smithi110.stdout:4/486: rmdir d0/d19/d8f 39 2024-04-12T13:42:01.302 INFO:tasks.workunit.client.0.smithi060.stdout:3/353: write d7/d17/f42 [521657,45078] 0 2024-04-12T13:42:01.303 INFO:tasks.workunit.client.1.smithi110.stdout:4/487: fsync d0/d19/f62 0 2024-04-12T13:42:01.303 INFO:tasks.workunit.client.0.smithi060.stdout:5/388: unlink d6/d10/d12/d15/c74 0 2024-04-12T13:42:01.309 INFO:tasks.workunit.client.0.smithi060.stdout:0/348: truncate d7/f66 1124885 0 2024-04-12T13:42:01.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/317: getdents d4/d8/d32 0 2024-04-12T13:42:01.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/350: creat d6/d13/d5b/d6d/f6e x:0 0 0 2024-04-12T13:42:01.316 INFO:tasks.workunit.client.0.smithi060.stdout:1/450: dwrite d1e/d29/d37/f4c [0,4194304] 0 2024-04-12T13:42:01.316 INFO:tasks.workunit.client.0.smithi060.stdout:9/318: write d4/d33/d50/d5c/d67/f49 [1146469,117600] 0 2024-04-12T13:42:01.317 INFO:tasks.workunit.client.0.smithi060.stdout:5/389: unlink d6/dd/d1f/d25/d35/f54 0 2024-04-12T13:42:01.319 INFO:tasks.workunit.client.0.smithi060.stdout:1/451: write d1e/d29/f44 [4683338,40635] 0 2024-04-12T13:42:01.319 INFO:tasks.workunit.client.0.smithi060.stdout:9/319: chown d4/l14 704533708 1 2024-04-12T13:42:01.325 INFO:tasks.workunit.client.1.smithi110.stdout:9/437: fdatasync fa 0 2024-04-12T13:42:01.327 INFO:tasks.workunit.client.0.smithi060.stdout:0/349: unlink d7/d9/de/f40 0 2024-04-12T13:42:01.328 INFO:tasks.workunit.client.1.smithi110.stdout:9/438: stat df/d13/d2c/d2d/d39/d3a/d4e/d83 0 2024-04-12T13:42:01.329 INFO:tasks.workunit.client.0.smithi060.stdout:9/320: dread d4/d33/d50/d5c/d67/f5e [8388608,4194304] 0 2024-04-12T13:42:01.330 INFO:tasks.workunit.client.1.smithi110.stdout:7/365: rename d1/d3/d43/f50 to d1/d1b/d74/f79 0 2024-04-12T13:42:01.331 INFO:tasks.workunit.client.0.smithi060.stdout:3/354: link d7/d17/d19/f4e d7/d17/d19/d33/f77 0 2024-04-12T13:42:01.331 INFO:tasks.workunit.client.1.smithi110.stdout:8/356: sync 2024-04-12T13:42:01.331 INFO:tasks.workunit.client.1.smithi110.stdout:9/439: chown df/d13/d3b/d40/c80 13905 1 2024-04-12T13:42:01.332 INFO:tasks.workunit.client.1.smithi110.stdout:8/357: stat d1/l29 0 2024-04-12T13:42:01.335 INFO:tasks.workunit.client.1.smithi110.stdout:8/358: chown d1/d3/d35/d3a/d41/f51 6770023 1 2024-04-12T13:42:01.336 INFO:tasks.workunit.client.1.smithi110.stdout:4/488: rmdir d0/d19 39 2024-04-12T13:42:01.338 INFO:tasks.workunit.client.1.smithi110.stdout:8/359: write d1/d3/d35/f6b [980482,8566] 0 2024-04-12T13:42:01.343 INFO:tasks.workunit.client.1.smithi110.stdout:3/362: truncate d5/dc/f2e 548190 0 2024-04-12T13:42:01.352 INFO:tasks.workunit.client.1.smithi110.stdout:4/489: symlink d0/de/d2c/d57/la5 0 2024-04-12T13:42:01.353 INFO:tasks.workunit.client.1.smithi110.stdout:8/360: mkdir d1/d3/d3c/d75 0 2024-04-12T13:42:01.354 INFO:tasks.workunit.client.1.smithi110.stdout:2/385: dwrite d6/dc/d13/f43 [0,4194304] 0 2024-04-12T13:42:01.355 INFO:tasks.workunit.client.1.smithi110.stdout:8/361: chown d1/d5/dd 6376967 1 2024-04-12T13:42:01.358 INFO:tasks.workunit.client.1.smithi110.stdout:6/387: rename d7/d25/d30/d44/c18 to d7/d10/d1c/d2b/d48/c74 0 2024-04-12T13:42:01.359 INFO:tasks.workunit.client.1.smithi110.stdout:8/362: chown d1/d3/d3c/d5a/d6f 25232678 1 2024-04-12T13:42:01.361 INFO:tasks.workunit.client.1.smithi110.stdout:2/386: dread d6/d18/f41 [0,4194304] 0 2024-04-12T13:42:01.361 INFO:tasks.workunit.client.1.smithi110.stdout:9/440: symlink df/d13/d2c/d2d/d94/l97 0 2024-04-12T13:42:01.365 INFO:tasks.workunit.client.1.smithi110.stdout:1/323: getdents de 0 2024-04-12T13:42:01.367 INFO:tasks.workunit.client.1.smithi110.stdout:6/388: read d7/d10/d1c/f29 [1503787,115140] 0 2024-04-12T13:42:01.369 INFO:tasks.workunit.client.1.smithi110.stdout:7/366: truncate d1/f18 982992 0 2024-04-12T13:42:01.374 INFO:tasks.workunit.client.1.smithi110.stdout:4/490: mknod d0/de/d32/ca6 0 2024-04-12T13:42:01.374 INFO:tasks.workunit.client.1.smithi110.stdout:1/324: creat de/d14/d34/f75 x:0 0 0 2024-04-12T13:42:01.377 INFO:tasks.workunit.client.1.smithi110.stdout:4/491: readlink d0/de/d2c/l1b 0 2024-04-12T13:42:01.377 INFO:tasks.workunit.client.1.smithi110.stdout:2/387: link d6/dc/d13/f69 d6/dc/dd/d49/f6c 0 2024-04-12T13:42:01.377 INFO:tasks.workunit.client.1.smithi110.stdout:7/367: creat d1/d31/f7a x:0 0 0 2024-04-12T13:42:01.381 INFO:tasks.workunit.client.1.smithi110.stdout:1/325: creat de/d15/f76 x:0 0 0 2024-04-12T13:42:01.384 INFO:tasks.workunit.client.1.smithi110.stdout:5/326: sync 2024-04-12T13:42:01.384 INFO:tasks.workunit.client.1.smithi110.stdout:0/295: sync 2024-04-12T13:42:01.386 INFO:tasks.workunit.client.1.smithi110.stdout:6/389: getdents d7/d10/d1c/d2b/d48 0 2024-04-12T13:42:01.387 INFO:tasks.workunit.client.1.smithi110.stdout:4/492: creat d0/d19/d1c/d50/d6f/fa7 x:0 0 0 2024-04-12T13:42:01.388 INFO:tasks.workunit.client.1.smithi110.stdout:1/326: chown de/d15/d32/d5e/c60 270763900 1 2024-04-12T13:42:01.390 INFO:tasks.workunit.client.1.smithi110.stdout:0/296: rmdir d1/d56 39 2024-04-12T13:42:01.392 INFO:tasks.workunit.client.1.smithi110.stdout:4/493: dread - d0/d19/f6d zero size 2024-04-12T13:42:01.392 INFO:tasks.workunit.client.1.smithi110.stdout:9/441: dwrite df/d8a/f8e [0,4194304] 0 2024-04-12T13:42:01.392 INFO:tasks.workunit.client.1.smithi110.stdout:2/388: rename d6/dc/dd/f24 to d6/dc/dd/d49/d64/d25/f6d 0 2024-04-12T13:42:01.395 INFO:tasks.workunit.client.1.smithi110.stdout:3/363: dwrite d5/f28 [0,4194304] 0 2024-04-12T13:42:01.397 INFO:tasks.workunit.client.1.smithi110.stdout:1/327: read de/d14/d34/f40 [3097728,122599] 0 2024-04-12T13:42:01.402 INFO:tasks.workunit.client.1.smithi110.stdout:8/363: dwrite d1/d3/d3c/f33 [0,4194304] 0 2024-04-12T13:42:01.404 INFO:tasks.workunit.client.1.smithi110.stdout:4/494: dread d0/d19/d1c/f58 [0,4194304] 0 2024-04-12T13:42:01.406 INFO:tasks.workunit.client.1.smithi110.stdout:3/364: write d5/dc/d31/d3b/d32/f78 [1505991,67726] 0 2024-04-12T13:42:01.407 INFO:tasks.workunit.client.0.smithi060.stdout:0/350: rmdir d7/d33/d5b 39 2024-04-12T13:42:01.408 INFO:tasks.workunit.client.1.smithi110.stdout:9/442: write df/d13/f1f [564896,130136] 0 2024-04-12T13:42:01.408 INFO:tasks.workunit.client.1.smithi110.stdout:6/390: dread d7/d25/d30/d44/d3d/f69 [0,4194304] 0 2024-04-12T13:42:01.408 INFO:tasks.workunit.client.1.smithi110.stdout:1/328: dread de/d1d/f28 [0,4194304] 0 2024-04-12T13:42:01.409 INFO:tasks.workunit.client.1.smithi110.stdout:0/297: write d1/d3c/f5f [1654257,81284] 0 2024-04-12T13:42:01.411 INFO:tasks.workunit.client.1.smithi110.stdout:2/389: truncate d6/dc/dd/d49/f6c 118709 0 2024-04-12T13:42:01.412 INFO:tasks.workunit.client.0.smithi060.stdout:5/390: fdatasync d6/d10/f2b 0 2024-04-12T13:42:01.414 INFO:tasks.workunit.client.1.smithi110.stdout:3/365: fsync d5/dc/d20/f7a 0 2024-04-12T13:42:01.416 INFO:tasks.workunit.client.0.smithi060.stdout:1/452: mknod d1e/d46/d8d/c9f 0 2024-04-12T13:42:01.416 INFO:tasks.workunit.client.1.smithi110.stdout:7/368: dwrite d1/d3/d4/d36/d4b/f3b [0,4194304] 0 2024-04-12T13:42:01.416 INFO:tasks.workunit.client.1.smithi110.stdout:5/327: creat da/d2e/d45/d29/f78 x:0 0 0 2024-04-12T13:42:01.418 INFO:tasks.workunit.client.1.smithi110.stdout:5/328: dread - da/d55/f5b zero size 2024-04-12T13:42:01.418 INFO:tasks.workunit.client.1.smithi110.stdout:8/364: truncate d1/d3/d35/d3a/d3e/d4f/f5e 905363 0 2024-04-12T13:42:01.430 INFO:tasks.workunit.client.1.smithi110.stdout:9/443: mknod df/d13/d26/d37/d49/c98 0 2024-04-12T13:42:01.432 INFO:tasks.workunit.client.1.smithi110.stdout:0/298: rename d1/d11 to d1/d8/d36/d51/d60 0 2024-04-12T13:42:01.435 INFO:tasks.workunit.client.1.smithi110.stdout:5/329: mkdir da/db/d61/d79 0 2024-04-12T13:42:01.436 INFO:tasks.workunit.client.1.smithi110.stdout:8/365: symlink d1/d7/d20/l76 0 2024-04-12T13:42:01.441 INFO:tasks.workunit.client.1.smithi110.stdout:1/329: rename de/d14/f38 to de/d14/d34/d55/d6b/f77 0 2024-04-12T13:42:01.442 INFO:tasks.workunit.client.1.smithi110.stdout:5/330: mkdir da/db/d61/d7a 0 2024-04-12T13:42:01.444 INFO:tasks.workunit.client.1.smithi110.stdout:4/495: link d0/de/c92 d0/de/d32/d61/ca8 0 2024-04-12T13:42:01.444 INFO:tasks.workunit.client.1.smithi110.stdout:8/366: mkdir d1/d3/d35/d3a/d41/d77 0 2024-04-12T13:42:01.447 INFO:tasks.workunit.client.1.smithi110.stdout:0/299: rename d1/c5a to d1/d27/d43/d4a/c61 0 2024-04-12T13:42:01.447 INFO:tasks.workunit.client.1.smithi110.stdout:9/444: dwrite df/f1e [4194304,4194304] 0 2024-04-12T13:42:01.454 INFO:tasks.workunit.client.1.smithi110.stdout:3/366: write d5/dc/f12 [1335540,12325] 0 2024-04-12T13:42:01.457 INFO:tasks.workunit.client.1.smithi110.stdout:0/300: creat d1/d8/d36/d51/f62 x:0 0 0 2024-04-12T13:42:01.458 INFO:tasks.workunit.client.1.smithi110.stdout:7/369: dwrite d1/d1b/d74/f79 [0,4194304] 0 2024-04-12T13:42:01.460 INFO:tasks.workunit.client.1.smithi110.stdout:8/367: creat d1/d3/d35/d3a/d41/d77/f78 x:0 0 0 2024-04-12T13:42:01.461 INFO:tasks.workunit.client.1.smithi110.stdout:1/330: dread de/d15/d32/f52 [0,4194304] 0 2024-04-12T13:42:01.462 INFO:tasks.workunit.client.1.smithi110.stdout:6/391: dwrite d7/d25/d2c/f3c [0,4194304] 0 2024-04-12T13:42:01.465 INFO:tasks.workunit.client.1.smithi110.stdout:2/390: dwrite d6/dc/f33 [0,4194304] 0 2024-04-12T13:42:01.465 INFO:tasks.workunit.client.1.smithi110.stdout:9/445: rename df/d38/d6e/d7f/l86 to df/d38/l99 0 2024-04-12T13:42:01.470 INFO:tasks.workunit.client.1.smithi110.stdout:7/370: chown d1/d3/d4/l1d 1523221 1 2024-04-12T13:42:01.471 INFO:tasks.workunit.client.1.smithi110.stdout:1/331: fdatasync de/d14/d34/d55/d6b/f6f 0 2024-04-12T13:42:01.474 INFO:tasks.workunit.client.1.smithi110.stdout:6/392: write d7/d25/d30/d44/f1d [364692,110449] 0 2024-04-12T13:42:01.476 INFO:tasks.workunit.client.1.smithi110.stdout:2/391: fsync d6/dc/dd/f16 0 2024-04-12T13:42:01.478 INFO:tasks.workunit.client.1.smithi110.stdout:0/301: rename d1/d27/d43 to d1/d8/d36/d63 0 2024-04-12T13:42:01.480 INFO:tasks.workunit.client.1.smithi110.stdout:9/446: chown df/d13/d2c/d2d/d39/d3a/d4e/d83/f7d 8 1 2024-04-12T13:42:01.480 INFO:tasks.workunit.client.1.smithi110.stdout:3/367: getdents d5/dc 0 2024-04-12T13:42:01.481 INFO:tasks.workunit.client.1.smithi110.stdout:2/392: read d6/f8 [581512,38852] 0 2024-04-12T13:42:01.482 INFO:tasks.workunit.client.1.smithi110.stdout:8/368: mkdir d1/d3/d3c/d75/d79 0 2024-04-12T13:42:01.485 INFO:tasks.workunit.client.1.smithi110.stdout:9/447: stat df/d13/d26/f41 0 2024-04-12T13:42:01.485 INFO:tasks.workunit.client.1.smithi110.stdout:0/302: read d1/d8/f2e [2400141,111870] 0 2024-04-12T13:42:01.486 INFO:tasks.workunit.client.1.smithi110.stdout:2/393: fdatasync d6/dc/d1b/f4e 0 2024-04-12T13:42:01.487 INFO:tasks.workunit.client.1.smithi110.stdout:9/448: chown df/d13/d3b/d40 899 1 2024-04-12T13:42:01.490 INFO:tasks.workunit.client.1.smithi110.stdout:7/371: truncate d1/f2a 3691369 0 2024-04-12T13:42:01.490 INFO:tasks.workunit.client.1.smithi110.stdout:9/449: readlink df/d13/d3b/d40/l69 0 2024-04-12T13:42:01.492 INFO:tasks.workunit.client.1.smithi110.stdout:7/372: chown d1/d1b/d74/f79 1904278 1 2024-04-12T13:42:01.493 INFO:tasks.workunit.client.1.smithi110.stdout:9/450: truncate df/d38/f95 819407 0 2024-04-12T13:42:01.494 INFO:tasks.workunit.client.1.smithi110.stdout:1/332: truncate de/d14/d34/d55/d6b/f77 418713 0 2024-04-12T13:42:01.496 INFO:tasks.workunit.client.1.smithi110.stdout:7/373: mkdir d1/d31/d7b 0 2024-04-12T13:42:01.498 INFO:tasks.workunit.client.1.smithi110.stdout:3/368: rmdir d5/dc/d20/d2d/d4f/d76 0 2024-04-12T13:42:01.499 INFO:tasks.workunit.client.1.smithi110.stdout:6/393: dwrite d7/d10/d1c/d2b/d48/f70 [0,4194304] 0 2024-04-12T13:42:01.499 INFO:tasks.workunit.client.1.smithi110.stdout:2/394: mkdir d6/dc/dd/d49/d64/d4a/d3c/d6e 0 2024-04-12T13:42:01.502 INFO:tasks.workunit.client.1.smithi110.stdout:3/369: truncate d5/dc/d31/d3b/d32/f78 2209037 0 2024-04-12T13:42:01.503 INFO:tasks.workunit.client.1.smithi110.stdout:1/333: creat de/d14/f78 x:0 0 0 2024-04-12T13:42:01.505 INFO:tasks.workunit.client.1.smithi110.stdout:8/369: rename d1/d5/d1f/c3b to d1/d3/d35/c7a 0 2024-04-12T13:42:01.507 INFO:tasks.workunit.client.1.smithi110.stdout:7/374: creat d1/d3/d43/f7c x:0 0 0 2024-04-12T13:42:01.510 INFO:tasks.workunit.client.1.smithi110.stdout:6/394: unlink d7/d10/d1c/d2b/d3a/f5a 0 2024-04-12T13:42:01.512 INFO:tasks.workunit.client.1.smithi110.stdout:6/395: chown d7/d10/f62 10 1 2024-04-12T13:42:01.513 INFO:tasks.workunit.client.1.smithi110.stdout:0/303: getdents d1/d8 0 2024-04-12T13:42:01.514 INFO:tasks.workunit.client.1.smithi110.stdout:3/370: creat d5/dc/f82 x:0 0 0 2024-04-12T13:42:01.516 INFO:tasks.workunit.client.1.smithi110.stdout:2/395: mkdir d6/dc/d6f 0 2024-04-12T13:42:01.520 INFO:tasks.workunit.client.1.smithi110.stdout:9/451: dread df/d13/d2c/d2d/d39/d3a/d4e/f57 [0,4194304] 0 2024-04-12T13:42:01.520 INFO:tasks.workunit.client.1.smithi110.stdout:2/396: chown d6/dc/dd/d49/d64/d4a/d51/f2f 3 1 2024-04-12T13:42:01.526 INFO:tasks.workunit.client.1.smithi110.stdout:7/375: link d1/d3/l67 d1/d1b/d74/l7d 0 2024-04-12T13:42:01.528 INFO:tasks.workunit.client.1.smithi110.stdout:3/371: write d5/dc/f27 [1219404,75491] 0 2024-04-12T13:42:01.529 INFO:tasks.workunit.client.1.smithi110.stdout:7/376: readlink d1/d3/d4/d55/l5a 0 2024-04-12T13:42:01.540 INFO:tasks.workunit.client.1.smithi110.stdout:6/396: rename d7/d10/d1c/c32 to d7/d10/d1c/d2b/c75 0 2024-04-12T13:42:01.542 INFO:tasks.workunit.client.1.smithi110.stdout:8/370: dread d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:42:01.542 INFO:tasks.workunit.client.1.smithi110.stdout:0/304: dwrite d1/f26 [0,4194304] 0 2024-04-12T13:42:01.542 INFO:tasks.workunit.client.1.smithi110.stdout:3/372: chown d5/dc/c3a 0 1 2024-04-12T13:42:01.546 INFO:tasks.workunit.client.1.smithi110.stdout:9/452: dread df/d13/f1f [0,4194304] 0 2024-04-12T13:42:01.547 INFO:tasks.workunit.client.1.smithi110.stdout:3/373: write d5/dc/f27 [2162028,58728] 0 2024-04-12T13:42:01.547 INFO:tasks.workunit.client.1.smithi110.stdout:6/397: creat d7/d25/d30/d44/d3d/f76 x:0 0 0 2024-04-12T13:42:01.549 INFO:tasks.workunit.client.1.smithi110.stdout:0/305: creat d1/d27/d31/f64 x:0 0 0 2024-04-12T13:42:01.551 INFO:tasks.workunit.client.1.smithi110.stdout:7/377: write d1/d3/d4/d36/f3a [611864,13356] 0 2024-04-12T13:42:01.551 INFO:tasks.workunit.client.1.smithi110.stdout:9/453: chown df/l6f 485 1 2024-04-12T13:42:01.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/278: sync 2024-04-12T13:42:01.552 INFO:tasks.workunit.client.1.smithi110.stdout:8/371: creat d1/d7/f7b x:0 0 0 2024-04-12T13:42:01.553 INFO:tasks.workunit.client.1.smithi110.stdout:3/374: write d5/dc/d20/f36 [9236068,51427] 0 2024-04-12T13:42:01.553 INFO:tasks.workunit.client.0.smithi060.stdout:2/351: rename d6/d10/d16/f37 to d6/d13/d17/f6f 0 2024-04-12T13:42:01.554 INFO:tasks.workunit.client.1.smithi110.stdout:1/334: dread de/d14/f4f [0,4194304] 0 2024-04-12T13:42:01.554 INFO:tasks.workunit.client.0.smithi060.stdout:1/453: chown lc 617355 1 2024-04-12T13:42:01.555 INFO:tasks.workunit.client.1.smithi110.stdout:6/398: mkdir d7/d25/d2c/d4c/d77 0 2024-04-12T13:42:01.555 INFO:tasks.workunit.client.0.smithi060.stdout:3/355: dwrite d7/d17/f42 [0,4194304] 0 2024-04-12T13:42:01.557 INFO:tasks.workunit.client.0.smithi060.stdout:2/352: readlink d6/d13/d31/d33/l3f 0 2024-04-12T13:42:01.557 INFO:tasks.workunit.client.1.smithi110.stdout:3/375: fdatasync d5/dc/d31/d3b/f59 0 2024-04-12T13:42:01.558 INFO:tasks.workunit.client.0.smithi060.stdout:0/351: write d7/f26 [1608508,42299] 0 2024-04-12T13:42:01.559 INFO:tasks.workunit.client.1.smithi110.stdout:6/399: truncate d7/f73 617872 0 2024-04-12T13:42:01.562 INFO:tasks.workunit.client.1.smithi110.stdout:8/372: unlink d1/d5/dd/ff 0 2024-04-12T13:42:01.562 INFO:tasks.workunit.client.1.smithi110.stdout:7/378: mknod d1/d3/d4/d55/c7e 0 2024-04-12T13:42:01.567 INFO:tasks.workunit.client.1.smithi110.stdout:1/335: mkdir de/d15/d32/d5e/d79 0 2024-04-12T13:42:01.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/353: truncate d6/d13/d31/d33/d3d/f63 67005 0 2024-04-12T13:42:01.570 INFO:tasks.workunit.client.1.smithi110.stdout:1/336: stat de/d15/d32/f44 0 2024-04-12T13:42:01.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/356: rename d7/d17/d27/d36/f4b to d7/da/d3f/f78 0 2024-04-12T13:42:01.574 INFO:tasks.workunit.client.1.smithi110.stdout:4/496: sync 2024-04-12T13:42:01.574 INFO:tasks.workunit.client.1.smithi110.stdout:5/331: sync 2024-04-12T13:42:01.574 INFO:tasks.workunit.client.1.smithi110.stdout:5/332: stat f5 0 2024-04-12T13:42:01.576 INFO:tasks.workunit.client.1.smithi110.stdout:6/400: symlink d7/d25/d2c/l78 0 2024-04-12T13:42:01.576 INFO:tasks.workunit.client.1.smithi110.stdout:9/454: dwrite df/d13/d2c/d2d/d39/d3a/f78 [0,4194304] 0 2024-04-12T13:42:01.576 INFO:tasks.workunit.client.1.smithi110.stdout:5/333: readlink da/db/d3b/l4d 0 2024-04-12T13:42:01.577 INFO:tasks.workunit.client.0.smithi060.stdout:0/352: symlink d7/d9/d14/d35/d44/d7d/l84 0 2024-04-12T13:42:01.582 INFO:tasks.workunit.client.1.smithi110.stdout:8/373: symlink d1/d7/d20/l7c 0 2024-04-12T13:42:01.582 INFO:tasks.workunit.client.1.smithi110.stdout:0/306: truncate d1/f2f 5215453 0 2024-04-12T13:42:01.589 INFO:tasks.workunit.client.0.smithi060.stdout:1/454: getdents d1e/d23/d49/d4e 0 2024-04-12T13:42:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:2/354: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:42:01.590 INFO:tasks.workunit.client.1.smithi110.stdout:9/455: stat df/d38/l99 0 2024-04-12T13:42:01.590 INFO:tasks.workunit.client.1.smithi110.stdout:1/337: readlink de/d1d/l1f 0 2024-04-12T13:42:01.590 INFO:tasks.workunit.client.1.smithi110.stdout:6/401: mknod d7/d25/d30/d44/d3d/c79 0 2024-04-12T13:42:01.591 INFO:tasks.workunit.client.1.smithi110.stdout:9/456: truncate df/d38/f88 5220517 0 2024-04-12T13:42:01.591 INFO:tasks.workunit.client.1.smithi110.stdout:0/307: fdatasync d1/f7 0 2024-04-12T13:42:01.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/279: dread d0/d7/f33 [0,4194304] 0 2024-04-12T13:42:01.592 INFO:tasks.workunit.client.1.smithi110.stdout:8/374: mknod d1/d5/d1f/c7d 0 2024-04-12T13:42:01.594 INFO:tasks.workunit.client.0.smithi060.stdout:5/391: dread d6/dd/d27/f2d [0,4194304] 0 2024-04-12T13:42:01.595 INFO:tasks.workunit.client.1.smithi110.stdout:4/497: dwrite d0/d19/f6d [0,4194304] 0 2024-04-12T13:42:01.595 INFO:tasks.workunit.client.1.smithi110.stdout:7/379: rename d1/d3/l67 to d1/d3/d4/d36/d76/l7f 0 2024-04-12T13:42:01.596 INFO:tasks.workunit.client.0.smithi060.stdout:1/455: fsync d1e/f2d 0 2024-04-12T13:42:01.596 INFO:tasks.workunit.client.0.smithi060.stdout:7/280: read - d0/d1b/f37 zero size 2024-04-12T13:42:01.596 INFO:tasks.workunit.client.0.smithi060.stdout:2/355: truncate d6/d10/f44 873220 0 2024-04-12T13:42:01.597 INFO:tasks.workunit.client.0.smithi060.stdout:3/357: creat d7/d17/d27/d36/f79 x:0 0 0 2024-04-12T13:42:01.598 INFO:tasks.workunit.client.1.smithi110.stdout:8/375: dread d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:01.598 INFO:tasks.workunit.client.1.smithi110.stdout:3/376: dread d5/dc/f19 [0,4194304] 0 2024-04-12T13:42:01.599 INFO:tasks.workunit.client.1.smithi110.stdout:4/498: write d0/d19/f74 [503202,81390] 0 2024-04-12T13:42:01.599 INFO:tasks.workunit.client.0.smithi060.stdout:0/353: creat d7/d9/d14/f85 x:0 0 0 2024-04-12T13:42:01.602 INFO:tasks.workunit.client.0.smithi060.stdout:2/356: stat d6/d13/d31/d33/l45 0 2024-04-12T13:42:01.604 INFO:tasks.workunit.client.1.smithi110.stdout:2/397: sync 2024-04-12T13:42:01.607 INFO:tasks.workunit.client.1.smithi110.stdout:9/457: unlink fa 0 2024-04-12T13:42:01.609 INFO:tasks.workunit.client.0.smithi060.stdout:2/357: truncate d6/d56/f51 304836 0 2024-04-12T13:42:01.614 INFO:tasks.workunit.client.1.smithi110.stdout:0/308: mkdir d1/d8/d36/d65 0 2024-04-12T13:42:01.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/358: dread - d6/d13/d31/d33/d3d/f59 zero size 2024-04-12T13:42:01.615 INFO:tasks.workunit.client.1.smithi110.stdout:0/309: readlink d1/l1b 0 2024-04-12T13:42:01.616 INFO:tasks.workunit.client.1.smithi110.stdout:4/499: dwrite d0/de/d32/f8c [0,4194304] 0 2024-04-12T13:42:01.618 INFO:tasks.workunit.client.1.smithi110.stdout:0/310: write d1/d8/d36/d51/d60/f18 [40681,98040] 0 2024-04-12T13:42:01.618 INFO:tasks.workunit.client.1.smithi110.stdout:4/500: fsync d0/de/d32/f7d 0 2024-04-12T13:42:01.618 INFO:tasks.workunit.client.0.smithi060.stdout:2/359: readlink d6/d56/l3e 0 2024-04-12T13:42:01.621 INFO:tasks.workunit.client.1.smithi110.stdout:5/334: rename da/f21 to da/d55/f7b 0 2024-04-12T13:42:01.623 INFO:tasks.workunit.client.0.smithi060.stdout:3/358: dread d7/d17/f42 [0,4194304] 0 2024-04-12T13:42:01.623 INFO:tasks.workunit.client.0.smithi060.stdout:5/392: dwrite f2 [4194304,4194304] 0 2024-04-12T13:42:01.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/456: rename f7 to d1e/d23/d2e/d5e/d68/fa0 0 2024-04-12T13:42:01.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/457: chown d1e/d29/d65/f7f 3307780 1 2024-04-12T13:42:01.630 INFO:tasks.workunit.client.0.smithi060.stdout:5/393: write d6/dd/d1f/d25/d53/f6e [4550115,44241] 0 2024-04-12T13:42:01.634 INFO:tasks.workunit.client.0.smithi060.stdout:5/394: chown d6/d10/d12/d4c/l61 218 1 2024-04-12T13:42:01.636 INFO:tasks.workunit.client.1.smithi110.stdout:4/501: dwrite d0/de/f7f [0,4194304] 0 2024-04-12T13:42:01.640 INFO:tasks.workunit.client.0.smithi060.stdout:3/359: dread d7/d17/f57 [0,4194304] 0 2024-04-12T13:42:01.640 INFO:tasks.workunit.client.0.smithi060.stdout:7/281: symlink d0/d7/d43/d63/l66 0 2024-04-12T13:42:01.642 INFO:tasks.workunit.client.1.smithi110.stdout:8/376: chown d1/d7/d20/l26 323522962 1 2024-04-12T13:42:01.644 INFO:tasks.workunit.client.1.smithi110.stdout:3/377: symlink d5/dc/d31/d3b/d32/d3e/l83 0 2024-04-12T13:42:01.644 INFO:tasks.workunit.client.0.smithi060.stdout:0/354: dread d7/d9/d14/d35/d44/d7d/f2a [0,4194304] 0 2024-04-12T13:42:01.645 INFO:tasks.workunit.client.1.smithi110.stdout:1/338: write de/d15/f31 [60163,32346] 0 2024-04-12T13:42:01.647 INFO:tasks.workunit.client.1.smithi110.stdout:2/398: mknod d6/dc/dd/c70 0 2024-04-12T13:42:01.648 INFO:tasks.workunit.client.1.smithi110.stdout:2/399: chown d6/dc/d1b 133542214 1 2024-04-12T13:42:01.649 INFO:tasks.workunit.client.0.smithi060.stdout:3/360: dread - d7/d17/d27/d36/f46 zero size 2024-04-12T13:42:01.652 INFO:tasks.workunit.client.1.smithi110.stdout:9/458: rmdir df/d13/d26/d37 39 2024-04-12T13:42:01.653 INFO:tasks.workunit.client.1.smithi110.stdout:9/459: write df/f1e [542590,85571] 0 2024-04-12T13:42:01.658 INFO:tasks.workunit.client.1.smithi110.stdout:8/377: dwrite d1/d3/d35/d3a/d41/f69 [0,4194304] 0 2024-04-12T13:42:01.659 INFO:tasks.workunit.client.0.smithi060.stdout:5/395: creat d6/d10/d12/d38/f86 x:0 0 0 2024-04-12T13:42:01.661 INFO:tasks.workunit.client.1.smithi110.stdout:0/311: mknod d1/d8/d36/c66 0 2024-04-12T13:42:01.662 INFO:tasks.workunit.client.0.smithi060.stdout:5/396: stat d6/d10/d12/d38/f40 0 2024-04-12T13:42:01.663 INFO:tasks.workunit.client.0.smithi060.stdout:7/282: creat d0/d7/d43/d63/f67 x:0 0 0 2024-04-12T13:42:01.665 INFO:tasks.workunit.client.0.smithi060.stdout:2/360: dread d6/d10/d16/f18 [0,4194304] 0 2024-04-12T13:42:01.669 INFO:tasks.workunit.client.0.smithi060.stdout:0/355: creat d7/d9/d14/d35/d44/d49/d67/f86 x:0 0 0 2024-04-12T13:42:01.671 INFO:tasks.workunit.client.0.smithi060.stdout:0/356: chown d7/l4d 48026305 1 2024-04-12T13:42:01.673 INFO:tasks.workunit.client.0.smithi060.stdout:2/361: write d6/d56/f51 [76894,104020] 0 2024-04-12T13:42:01.676 INFO:tasks.workunit.client.1.smithi110.stdout:4/502: fsync d0/ff 0 2024-04-12T13:42:01.681 INFO:tasks.workunit.client.1.smithi110.stdout:2/400: creat d6/dc/dd/d49/d64/d5d/f71 x:0 0 0 2024-04-12T13:42:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:3/361: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:42:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:0/357: dread d7/d9/de/f43 [0,4194304] 0 2024-04-12T13:42:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/343: sync 2024-04-12T13:42:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:6/439: sync 2024-04-12T13:42:01.685 INFO:tasks.workunit.client.0.smithi060.stdout:5/397: rename d6/d10/d12/d15 to d6/dd/d1f/d25/d53/d87 0 2024-04-12T13:42:01.686 INFO:tasks.workunit.client.0.smithi060.stdout:1/458: dread d1e/d23/d2e/d30/d51/f81 [4194304,4194304] 0 2024-04-12T13:42:01.688 INFO:tasks.workunit.client.0.smithi060.stdout:0/358: write d7/d9/d14/d35/d44/f77 [992817,73880] 0 2024-04-12T13:42:01.696 INFO:tasks.workunit.client.0.smithi060.stdout:6/440: rmdir d1 39 2024-04-12T13:42:01.701 INFO:tasks.workunit.client.0.smithi060.stdout:8/344: rename d9/d1d/d2f/f51 to d9/d1b/d3c/d60/f75 0 2024-04-12T13:42:01.704 INFO:tasks.workunit.client.0.smithi060.stdout:8/345: write d9/d1d/f4c [5071089,98131] 0 2024-04-12T13:42:01.705 INFO:tasks.workunit.client.0.smithi060.stdout:3/362: dread d7/da/f3e [0,4194304] 0 2024-04-12T13:42:01.705 INFO:tasks.workunit.client.0.smithi060.stdout:8/346: chown d9/d1b/d2b 11458258 1 2024-04-12T13:42:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:8/347: chown d9/c31 0 1 2024-04-12T13:42:01.708 INFO:tasks.workunit.client.0.smithi060.stdout:5/398: unlink d6/dd/d1f/d25/d35/c48 0 2024-04-12T13:42:01.717 INFO:tasks.workunit.client.1.smithi110.stdout:1/339: creat de/d15/d32/d5e/d79/f7a x:0 0 0 2024-04-12T13:42:01.719 INFO:tasks.workunit.client.0.smithi060.stdout:7/283: getdents d0/d7/d43 0 2024-04-12T13:42:01.721 INFO:tasks.workunit.client.1.smithi110.stdout:9/460: mkdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d9a 0 2024-04-12T13:42:01.722 INFO:tasks.workunit.client.1.smithi110.stdout:3/378: truncate d5/dc/f24 2485725 0 2024-04-12T13:42:01.723 INFO:tasks.workunit.client.0.smithi060.stdout:8/348: stat d9/d1b/d37/c49 0 2024-04-12T13:42:01.724 INFO:tasks.workunit.client.1.smithi110.stdout:0/312: fsync d1/d8/d36/d51/d60/f2b 0 2024-04-12T13:42:01.725 INFO:tasks.workunit.client.1.smithi110.stdout:5/335: mkdir da/d2e/d45/d29/d66/d7c 0 2024-04-12T13:42:01.727 INFO:tasks.workunit.client.1.smithi110.stdout:6/402: rename d7/d10/d1c/f6a to d7/d10/d1c/d2b/f7a 0 2024-04-12T13:42:01.729 INFO:tasks.workunit.client.0.smithi060.stdout:6/441: mknod d1/d7/da/dc/ca2 0 2024-04-12T13:42:01.730 INFO:tasks.workunit.client.1.smithi110.stdout:7/380: link d1/d3/f11 d1/d31/d5d/d71/f80 0 2024-04-12T13:42:01.733 INFO:tasks.workunit.client.0.smithi060.stdout:4/338: sync 2024-04-12T13:42:01.733 INFO:tasks.workunit.client.0.smithi060.stdout:9/321: sync 2024-04-12T13:42:01.734 INFO:tasks.workunit.client.0.smithi060.stdout:5/399: write d6/d10/f2c [1728798,10141] 0 2024-04-12T13:42:01.735 INFO:tasks.workunit.client.1.smithi110.stdout:4/503: fsync d0/de/f24 0 2024-04-12T13:42:01.736 INFO:tasks.workunit.client.1.smithi110.stdout:4/504: stat d0/d19/d26/f40 0 2024-04-12T13:42:01.737 INFO:tasks.workunit.client.0.smithi060.stdout:3/363: symlink d7/d17/d19/l7a 0 2024-04-12T13:42:01.738 INFO:tasks.workunit.client.1.smithi110.stdout:2/401: getdents d6/dc/dd/d49/d64/d4a/d3c/d6e 0 2024-04-12T13:42:01.738 INFO:tasks.workunit.client.0.smithi060.stdout:8/349: mknod d9/d1d/d2f/c76 0 2024-04-12T13:42:01.745 INFO:tasks.workunit.client.0.smithi060.stdout:0/359: creat d7/f87 x:0 0 0 2024-04-12T13:42:01.746 INFO:tasks.workunit.client.0.smithi060.stdout:1/459: rename d1e/d23/d2e/d5e/c9d to d1e/d29/ca1 0 2024-04-12T13:42:01.747 INFO:tasks.workunit.client.0.smithi060.stdout:8/350: dread d9/d1b/d3c/d60/f75 [0,4194304] 0 2024-04-12T13:42:01.749 INFO:tasks.workunit.client.0.smithi060.stdout:6/442: mknod d1/d7/da/dc/d24/d30/d52/d5e/ca3 0 2024-04-12T13:42:01.750 INFO:tasks.workunit.client.1.smithi110.stdout:3/379: readlink d5/dc/d31/d3b/d32/l81 0 2024-04-12T13:42:01.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/284: symlink d0/l68 0 2024-04-12T13:42:01.752 INFO:tasks.workunit.client.1.smithi110.stdout:3/380: chown d5/dc/d20/l69 18 1 2024-04-12T13:42:01.753 INFO:tasks.workunit.client.1.smithi110.stdout:0/313: rmdir d1/d48 39 2024-04-12T13:42:01.754 INFO:tasks.workunit.client.1.smithi110.stdout:3/381: chown d5/dc/d31/c3d 6368 1 2024-04-12T13:42:01.754 INFO:tasks.workunit.client.0.smithi060.stdout:6/443: readlink d1/d7/da/dc/d24/d2d/l83 0 2024-04-12T13:42:01.756 INFO:tasks.workunit.client.0.smithi060.stdout:4/339: mkdir d6/d7/dd/d1a/d19/d7a 0 2024-04-12T13:42:01.758 INFO:tasks.workunit.client.0.smithi060.stdout:3/364: creat d7/da/d3f/d5c/d25/f7b x:0 0 0 2024-04-12T13:42:01.760 INFO:tasks.workunit.client.0.smithi060.stdout:9/322: dwrite d4/d8/d32/f5b [0,4194304] 0 2024-04-12T13:42:01.760 INFO:tasks.workunit.client.0.smithi060.stdout:4/340: chown l3 10 1 2024-04-12T13:42:01.763 INFO:tasks.workunit.client.1.smithi110.stdout:7/381: rmdir d1/d3/d4/d36/d4b 39 2024-04-12T13:42:01.764 INFO:tasks.workunit.client.0.smithi060.stdout:5/400: dwrite d6/dd/d1f/d25/d42/d6b/f80 [0,4194304] 0 2024-04-12T13:42:01.766 INFO:tasks.workunit.client.0.smithi060.stdout:9/323: fdatasync d4/d33/d50/d5c/d67/f39 0 2024-04-12T13:42:01.766 INFO:tasks.workunit.client.1.smithi110.stdout:4/505: symlink d0/d75/d84/la9 0 2024-04-12T13:42:01.768 INFO:tasks.workunit.client.0.smithi060.stdout:7/285: mknod d0/d7/d43/d63/c69 0 2024-04-12T13:42:01.772 INFO:tasks.workunit.client.0.smithi060.stdout:0/360: mkdir d7/d33/d88 0 2024-04-12T13:42:01.773 INFO:tasks.workunit.client.1.smithi110.stdout:8/378: getdents d1/d3 0 2024-04-12T13:42:01.773 INFO:tasks.workunit.client.0.smithi060.stdout:3/365: mknod d7/d17/d19/d33/d63/d6d/c7c 0 2024-04-12T13:42:01.775 INFO:tasks.workunit.client.0.smithi060.stdout:8/351: dwrite d9/f2c [0,4194304] 0 2024-04-12T13:42:01.777 INFO:tasks.workunit.client.0.smithi060.stdout:9/324: rmdir d4/d33 39 2024-04-12T13:42:01.778 INFO:tasks.workunit.client.0.smithi060.stdout:1/460: dread d1e/d23/d2e/d30/d51/f81 [4194304,4194304] 0 2024-04-12T13:42:01.778 INFO:tasks.workunit.client.0.smithi060.stdout:8/352: stat d9/d1b/d37/f39 0 2024-04-12T13:42:01.779 INFO:tasks.workunit.client.1.smithi110.stdout:0/314: mkdir d1/d27/d31/d67 0 2024-04-12T13:42:01.781 INFO:tasks.workunit.client.0.smithi060.stdout:8/353: readlink d9/l2e 0 2024-04-12T13:42:01.782 INFO:tasks.workunit.client.1.smithi110.stdout:5/336: rmdir da/d55 39 2024-04-12T13:42:01.786 INFO:tasks.workunit.client.0.smithi060.stdout:6/444: link d1/d2c/f7f d1/d7/da/dc/d24/d30/d52/fa4 0 2024-04-12T13:42:01.787 INFO:tasks.workunit.client.0.smithi060.stdout:4/341: getdents d6/d7/dd/d1a/d19/d7a 0 2024-04-12T13:42:01.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/366: mkdir d7/da/d3f/d5c/d25/d7d 0 2024-04-12T13:42:01.790 INFO:tasks.workunit.client.0.smithi060.stdout:6/445: chown d1/d7/da/dc/d3a 106725909 1 2024-04-12T13:42:01.792 INFO:tasks.workunit.client.1.smithi110.stdout:7/382: dwrite d1/d1b/d74/f79 [0,4194304] 0 2024-04-12T13:42:01.792 INFO:tasks.workunit.client.1.smithi110.stdout:1/340: write de/d14/d34/d55/d6b/f77 [439597,106137] 0 2024-04-12T13:42:01.794 INFO:tasks.workunit.client.0.smithi060.stdout:9/325: write d4/d33/d50/f61 [505478,72180] 0 2024-04-12T13:42:01.798 INFO:tasks.workunit.client.0.smithi060.stdout:5/401: symlink d6/dd/d1f/d25/d53/d87/d7e/l88 0 2024-04-12T13:42:01.798 INFO:tasks.workunit.client.0.smithi060.stdout:1/461: symlink d1e/d46/d8d/la2 0 2024-04-12T13:42:01.800 INFO:tasks.workunit.client.0.smithi060.stdout:8/354: creat d9/d1b/d3c/f77 x:0 0 0 2024-04-12T13:42:01.803 INFO:tasks.workunit.client.0.smithi060.stdout:4/342: stat d6/f55 0 2024-04-12T13:42:01.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/286: dread d0/d7/f11 [0,4194304] 0 2024-04-12T13:42:01.803 INFO:tasks.workunit.client.1.smithi110.stdout:3/382: mkdir d5/dc/d31/d84 0 2024-04-12T13:42:01.803 INFO:tasks.workunit.client.1.smithi110.stdout:8/379: dwrite d1/d3/fe [0,4194304] 0 2024-04-12T13:42:01.804 INFO:tasks.workunit.client.1.smithi110.stdout:6/403: creat d7/d6c/f7b x:0 0 0 2024-04-12T13:42:01.807 INFO:tasks.workunit.client.1.smithi110.stdout:8/380: write d1/d7/f32 [1254672,99697] 0 2024-04-12T13:42:01.808 INFO:tasks.workunit.client.0.smithi060.stdout:6/446: rename d1/d7/da/dc/d24/d2d/f66 to d1/d7/da/dc/d24/d8b/fa5 0 2024-04-12T13:42:01.809 INFO:tasks.workunit.client.1.smithi110.stdout:8/381: dread - d1/d3/d35/d3a/d41/d77/f78 zero size 2024-04-12T13:42:01.812 INFO:tasks.workunit.client.1.smithi110.stdout:8/382: truncate d1/d3/d3c/f57 442805 0 2024-04-12T13:42:01.814 INFO:tasks.workunit.client.1.smithi110.stdout:8/383: write d1/f5c [872767,18115] 0 2024-04-12T13:42:01.817 INFO:tasks.workunit.client.1.smithi110.stdout:1/341: dwrite de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:01.818 INFO:tasks.workunit.client.1.smithi110.stdout:1/342: readlink de/d14/l1e 0 2024-04-12T13:42:01.818 INFO:tasks.workunit.client.0.smithi060.stdout:8/355: mknod d9/da/c78 0 2024-04-12T13:42:01.826 INFO:tasks.workunit.client.0.smithi060.stdout:3/367: dwrite d7/da/d3f/d5c/d25/f7b [0,4194304] 0 2024-04-12T13:42:01.827 INFO:tasks.workunit.client.0.smithi060.stdout:8/356: write d9/d1b/d2b/f55 [1433729,12962] 0 2024-04-12T13:42:01.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/462: mknod d1e/d29/ca3 0 2024-04-12T13:42:01.831 INFO:tasks.workunit.client.1.smithi110.stdout:2/402: creat d6/dc/dd/d49/d64/d4a/f72 x:0 0 0 2024-04-12T13:42:01.831 INFO:tasks.workunit.client.1.smithi110.stdout:0/315: write d1/d27/d31/f49 [333957,13225] 0 2024-04-12T13:42:01.834 INFO:tasks.workunit.client.1.smithi110.stdout:2/403: chown d6/dc/dd/d49/d64/d4a/d3c/d50/c66 39111 1 2024-04-12T13:42:01.834 INFO:tasks.workunit.client.0.smithi060.stdout:4/343: dwrite d6/d7/dd/d1a/f50 [4194304,4194304] 0 2024-04-12T13:42:01.836 INFO:tasks.workunit.client.0.smithi060.stdout:3/368: write d7/da/d3f/d5c/d25/f7b [821228,10227] 0 2024-04-12T13:42:01.838 INFO:tasks.workunit.client.0.smithi060.stdout:1/463: dread - d1e/d23/d2e/d86/f9c zero size 2024-04-12T13:42:01.839 INFO:tasks.workunit.client.1.smithi110.stdout:7/383: creat d1/d31/f81 x:0 0 0 2024-04-12T13:42:01.841 INFO:tasks.workunit.client.0.smithi060.stdout:6/447: dwrite d1/d7/da/dc/d3a/f49 [0,4194304] 0 2024-04-12T13:42:01.841 INFO:tasks.workunit.client.0.smithi060.stdout:1/464: fdatasync d1e/d23/d2e/f99 0 2024-04-12T13:42:01.846 INFO:tasks.workunit.client.1.smithi110.stdout:7/384: dread d1/d3/d4/f27 [0,4194304] 0 2024-04-12T13:42:01.852 INFO:tasks.workunit.client.0.smithi060.stdout:6/448: read d1/d7/da/dc/d24/d2d/f3d [1106669,11865] 0 2024-04-12T13:42:01.853 INFO:tasks.workunit.client.1.smithi110.stdout:9/461: link df/d13/c59 df/d13/d2c/d2d/c9b 0 2024-04-12T13:42:01.854 INFO:tasks.workunit.client.1.smithi110.stdout:9/462: chown df/d13/l2a 5796456 1 2024-04-12T13:42:01.856 INFO:tasks.workunit.client.1.smithi110.stdout:7/385: dread d1/d31/d5d/d71/f80 [0,4194304] 0 2024-04-12T13:42:01.858 INFO:tasks.workunit.client.1.smithi110.stdout:3/383: creat d5/dc/f85 x:0 0 0 2024-04-12T13:42:01.858 INFO:tasks.workunit.client.1.smithi110.stdout:7/386: dread - d1/f6b zero size 2024-04-12T13:42:01.858 INFO:tasks.workunit.client.0.smithi060.stdout:6/449: chown d1/d7/da/dc/d24/c89 0 1 2024-04-12T13:42:01.859 INFO:tasks.workunit.client.0.smithi060.stdout:8/357: mkdir d9/d1b/d3c/d60/d79 0 2024-04-12T13:42:01.859 INFO:tasks.workunit.client.1.smithi110.stdout:4/506: sync 2024-04-12T13:42:01.861 INFO:tasks.workunit.client.1.smithi110.stdout:7/387: chown d1/d3/le 385 1 2024-04-12T13:42:01.861 INFO:tasks.workunit.client.1.smithi110.stdout:3/384: write d5/dc/d31/f45 [1770899,8260] 0 2024-04-12T13:42:01.863 INFO:tasks.workunit.client.1.smithi110.stdout:4/507: dread - d0/de/d32/d5f/d71/f73 zero size 2024-04-12T13:42:01.864 INFO:tasks.workunit.client.1.smithi110.stdout:7/388: chown d1/d1b/d74/f79 31075 1 2024-04-12T13:42:01.866 INFO:tasks.workunit.client.1.smithi110.stdout:4/508: write d0/de/d32/d61/fa2 [385485,34084] 0 2024-04-12T13:42:01.866 INFO:tasks.workunit.client.1.smithi110.stdout:1/343: rmdir de/d15/d32/d61/d6a 39 2024-04-12T13:42:01.871 INFO:tasks.workunit.client.0.smithi060.stdout:3/369: fsync d7/d17/d19/d33/f77 0 2024-04-12T13:42:01.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/370: read d7/d17/d27/f30 [2599569,66397] 0 2024-04-12T13:42:01.873 INFO:tasks.workunit.client.1.smithi110.stdout:5/337: dwrite da/d55/f7b [8388608,4194304] 0 2024-04-12T13:42:01.873 INFO:tasks.workunit.client.0.smithi060.stdout:1/465: dread d1e/f4d [0,4194304] 0 2024-04-12T13:42:01.874 INFO:tasks.workunit.client.0.smithi060.stdout:4/344: symlink d6/l7b 0 2024-04-12T13:42:01.875 INFO:tasks.workunit.client.1.smithi110.stdout:0/316: creat d1/d8/d36/d51/f68 x:0 0 0 2024-04-12T13:42:01.876 INFO:tasks.workunit.client.1.smithi110.stdout:9/463: rename df/d13/d2c/d2d/d94/l97 to df/d13/d3b/d40/d56/l9c 0 2024-04-12T13:42:01.879 INFO:tasks.workunit.client.1.smithi110.stdout:3/385: dwrite d5/dc/d31/d3b/f59 [0,4194304] 0 2024-04-12T13:42:01.881 INFO:tasks.workunit.client.1.smithi110.stdout:3/386: read d5/dc/d20/f2a [2182561,115547] 0 2024-04-12T13:42:01.884 INFO:tasks.workunit.client.1.smithi110.stdout:6/404: symlink d7/d25/d30/l7c 0 2024-04-12T13:42:01.886 INFO:tasks.workunit.client.1.smithi110.stdout:1/344: mkdir de/d7b 0 2024-04-12T13:42:01.887 INFO:tasks.workunit.client.0.smithi060.stdout:1/466: chown d1e/d23/d2e/d30/l69 7 1 2024-04-12T13:42:01.887 INFO:tasks.workunit.client.0.smithi060.stdout:5/402: dwrite d6/f20 [0,4194304] 0 2024-04-12T13:42:01.900 INFO:tasks.workunit.client.1.smithi110.stdout:7/389: rename d1/d1b/d33 to d1/d3/d4/d55/d82 0 2024-04-12T13:42:01.903 INFO:tasks.workunit.client.1.smithi110.stdout:8/384: dwrite d1/d3/d3c/f2f [0,4194304] 0 2024-04-12T13:42:01.904 INFO:tasks.workunit.client.0.smithi060.stdout:6/450: dwrite d1/f6b [4194304,4194304] 0 2024-04-12T13:42:01.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/358: dwrite d9/f11 [0,4194304] 0 2024-04-12T13:42:01.909 INFO:tasks.workunit.client.0.smithi060.stdout:6/451: fsync d1/d7/da/dc/d24/f91 0 2024-04-12T13:42:01.910 INFO:tasks.workunit.client.1.smithi110.stdout:2/404: dwrite d6/dc/dd/d49/d64/d25/f40 [0,4194304] 0 2024-04-12T13:42:01.911 INFO:tasks.workunit.client.0.smithi060.stdout:7/287: dwrite d0/f3a [0,4194304] 0 2024-04-12T13:42:01.911 INFO:tasks.workunit.client.0.smithi060.stdout:5/403: chown d6/d10/f31 1 1 2024-04-12T13:42:01.912 INFO:tasks.workunit.client.0.smithi060.stdout:8/359: write d9/d1d/f33 [4545026,56513] 0 2024-04-12T13:42:01.917 INFO:tasks.workunit.client.0.smithi060.stdout:3/371: rename d7/c65 to d7/d17/d19/d33/d63/d6d/c7e 0 2024-04-12T13:42:01.917 INFO:tasks.workunit.client.0.smithi060.stdout:1/467: write fb [2471833,107389] 0 2024-04-12T13:42:01.917 INFO:tasks.workunit.client.0.smithi060.stdout:8/360: stat d9/d1d/c28 0 2024-04-12T13:42:01.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/372: chown d7/d17/d19/c3b 517012 1 2024-04-12T13:42:01.920 INFO:tasks.workunit.client.0.smithi060.stdout:1/468: chown d1e/d23/d2e/d30/c3e 496654 1 2024-04-12T13:42:01.921 INFO:tasks.workunit.client.0.smithi060.stdout:3/373: stat d7/da/d3f/d5c/d25/d4d/l5a 0 2024-04-12T13:42:01.921 INFO:tasks.workunit.client.1.smithi110.stdout:0/317: link d1/f2c d1/d8/d36/d51/f69 0 2024-04-12T13:42:01.922 INFO:tasks.workunit.client.0.smithi060.stdout:5/404: truncate d6/dd/d1f/d25/f34 4667079 0 2024-04-12T13:42:01.928 INFO:tasks.workunit.client.1.smithi110.stdout:9/464: symlink df/d13/d26/d37/d49/l9d 0 2024-04-12T13:42:01.929 INFO:tasks.workunit.client.1.smithi110.stdout:4/509: write d0/de/d2c/f2b [2166377,86185] 0 2024-04-12T13:42:01.931 INFO:tasks.workunit.client.1.smithi110.stdout:7/390: rename d1/d3/d4/d55/d56/f60 to d1/d31/d5d/f83 0 2024-04-12T13:42:01.933 INFO:tasks.workunit.client.0.smithi060.stdout:7/288: symlink d0/d7/d43/d4d/l6a 0 2024-04-12T13:42:01.933 INFO:tasks.workunit.client.1.smithi110.stdout:6/405: dwrite d7/d10/d1c/d2b/f7a [4194304,4194304] 0 2024-04-12T13:42:01.934 INFO:tasks.workunit.client.0.smithi060.stdout:6/452: write d1/d7/f5d [1249006,98868] 0 2024-04-12T13:42:01.935 INFO:tasks.workunit.client.1.smithi110.stdout:7/391: fsync d1/d3/d4/d55/d82/f6a 0 2024-04-12T13:42:01.935 INFO:tasks.workunit.client.0.smithi060.stdout:8/361: symlink d9/d1b/d37/d4d/l7a 0 2024-04-12T13:42:01.938 INFO:tasks.workunit.client.0.smithi060.stdout:3/374: fdatasync d7/d17/d19/f74 0 2024-04-12T13:42:01.939 INFO:tasks.workunit.client.1.smithi110.stdout:2/405: unlink d6/d18/f41 0 2024-04-12T13:42:01.940 INFO:tasks.workunit.client.1.smithi110.stdout:1/345: chown de/d1d 2583 1 2024-04-12T13:42:01.943 INFO:tasks.workunit.client.0.smithi060.stdout:3/375: fsync d7/d17/d19/f23 0 2024-04-12T13:42:01.944 INFO:tasks.workunit.client.1.smithi110.stdout:4/510: mkdir d0/d19/d26/d65/d7e/daa 0 2024-04-12T13:42:01.946 INFO:tasks.workunit.client.1.smithi110.stdout:0/318: dread d1/d8/d36/d51/d60/f2b [0,4194304] 0 2024-04-12T13:42:01.948 INFO:tasks.workunit.client.0.smithi060.stdout:1/469: creat d1e/d23/d2e/d5e/fa4 x:0 0 0 2024-04-12T13:42:01.948 INFO:tasks.workunit.client.0.smithi060.stdout:5/405: dwrite d6/dd/d1f/d25/d42/d6b/f80 [0,4194304] 0 2024-04-12T13:42:01.949 INFO:tasks.workunit.client.1.smithi110.stdout:2/406: creat d6/dc/dd/d49/d64/d25/f73 x:0 0 0 2024-04-12T13:42:01.950 INFO:tasks.workunit.client.1.smithi110.stdout:7/392: mkdir d1/d3/d84 0 2024-04-12T13:42:01.950 INFO:tasks.workunit.client.0.smithi060.stdout:3/376: read - d7/d17/d27/d36/f79 zero size 2024-04-12T13:42:01.951 INFO:tasks.workunit.client.1.smithi110.stdout:4/511: rmdir d0/d19/d1c/d50 39 2024-04-12T13:42:01.956 INFO:tasks.workunit.client.1.smithi110.stdout:1/346: creat de/d14/d34/d55/d6b/f7c x:0 0 0 2024-04-12T13:42:01.957 INFO:tasks.workunit.client.1.smithi110.stdout:7/393: dread d1/d3/d4/d36/f5c [4194304,4194304] 0 2024-04-12T13:42:01.959 INFO:tasks.workunit.client.1.smithi110.stdout:2/407: dread d6/dc/dd/f1f [0,4194304] 0 2024-04-12T13:42:01.961 INFO:tasks.workunit.client.1.smithi110.stdout:2/408: write d6/dc/dd/d49/d64/f2c [3984719,89188] 0 2024-04-12T13:42:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:7/289: dwrite d0/d7/f11 [4194304,4194304] 0 2024-04-12T13:42:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:5/406: mkdir d6/d89 0 2024-04-12T13:42:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:3/377: rename d7/d17/d27/d36/d53/c59 to d7/d17/d19/d33/d63/c7f 0 2024-04-12T13:42:01.968 INFO:tasks.workunit.client.1.smithi110.stdout:1/347: chown de/f30 23 1 2024-04-12T13:42:01.974 INFO:tasks.workunit.client.0.smithi060.stdout:7/290: chown d0/c14 3173524 1 2024-04-12T13:42:01.977 INFO:tasks.workunit.client.1.smithi110.stdout:7/394: creat d1/d3/d43/f85 x:0 0 0 2024-04-12T13:42:01.977 INFO:tasks.workunit.client.0.smithi060.stdout:6/453: dwrite d1/d7/da/dc/d24/d30/d52/f60 [0,4194304] 0 2024-04-12T13:42:01.983 INFO:tasks.workunit.client.1.smithi110.stdout:1/348: dwrite de/d1d/f42 [0,4194304] 0 2024-04-12T13:42:01.986 INFO:tasks.workunit.client.0.smithi060.stdout:7/291: dread d0/d7/f39 [0,4194304] 0 2024-04-12T13:42:01.988 INFO:tasks.workunit.client.1.smithi110.stdout:0/319: rename d1/d8/fb to d1/f6a 0 2024-04-12T13:42:01.992 INFO:tasks.workunit.client.1.smithi110.stdout:1/349: stat de/d1d/c41 0 2024-04-12T13:42:01.993 INFO:tasks.workunit.client.0.smithi060.stdout:6/454: truncate d1/d7/da/dc/d24/d30/d52/d5e/f9e 364488 0 2024-04-12T13:42:01.994 INFO:tasks.workunit.client.0.smithi060.stdout:7/292: rmdir d0/d3d 39 2024-04-12T13:42:01.998 INFO:tasks.workunit.client.1.smithi110.stdout:0/320: read d1/d27/d31/f50 [46501,92048] 0 2024-04-12T13:42:01.998 INFO:tasks.workunit.client.1.smithi110.stdout:1/350: chown de/l43 19451 1 2024-04-12T13:42:01.998 INFO:tasks.workunit.client.0.smithi060.stdout:5/407: dwrite d6/dd/d1f/d25/d42/d52/f5e [0,4194304] 0 2024-04-12T13:42:02.002 INFO:tasks.workunit.client.1.smithi110.stdout:0/321: mkdir d1/d3c/d6b 0 2024-04-12T13:42:02.007 INFO:tasks.workunit.client.0.smithi060.stdout:7/293: symlink d0/d3d/l6b 0 2024-04-12T13:42:02.009 INFO:tasks.workunit.client.1.smithi110.stdout:1/351: rename de/f30 to de/d15/d32/d61/d6a/d72/f7d 0 2024-04-12T13:42:02.010 INFO:tasks.workunit.client.1.smithi110.stdout:5/338: sync 2024-04-12T13:42:02.010 INFO:tasks.workunit.client.1.smithi110.stdout:3/387: sync 2024-04-12T13:42:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:5/408: chown d6/dd/d1f/d25/d35/d50/d5f/l84 22289331 1 2024-04-12T13:42:02.013 INFO:tasks.workunit.client.0.smithi060.stdout:6/455: mknod d1/d7/da/dc/d24/d34/d51/d59/d94/ca6 0 2024-04-12T13:42:02.015 INFO:tasks.workunit.client.1.smithi110.stdout:9/465: read df/f24 [1157143,12394] 0 2024-04-12T13:42:02.020 INFO:tasks.workunit.client.0.smithi060.stdout:6/456: chown d1/d7/l79 52 1 2024-04-12T13:42:02.025 INFO:tasks.workunit.client.0.smithi060.stdout:6/457: readlink d1/d7/da/dc/d24/d30/d52/d78/d80/l92 0 2024-04-12T13:42:02.032 INFO:tasks.workunit.client.1.smithi110.stdout:9/466: dread df/f1e [0,4194304] 0 2024-04-12T13:42:02.034 INFO:tasks.workunit.client.1.smithi110.stdout:9/467: fsync df/d13/d26/d37/d49/f55 0 2024-04-12T13:42:02.037 INFO:tasks.workunit.client.0.smithi060.stdout:5/409: dwrite d6/dd/d1f/d32/d46/f82 [0,4194304] 0 2024-04-12T13:42:02.043 INFO:tasks.workunit.client.0.smithi060.stdout:5/410: truncate d6/d10/d12/f4e 1408317 0 2024-04-12T13:42:02.046 INFO:tasks.workunit.client.1.smithi110.stdout:6/406: dread d7/d25/d30/d44/f33 [0,4194304] 0 2024-04-12T13:42:02.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/345: truncate d6/f70 3434773 0 2024-04-12T13:42:02.059 INFO:tasks.workunit.client.1.smithi110.stdout:2/409: dread d6/dc/dd/f54 [0,4194304] 0 2024-04-12T13:42:02.060 INFO:tasks.workunit.client.1.smithi110.stdout:2/410: chown d6/f48 46 1 2024-04-12T13:42:02.061 INFO:tasks.workunit.client.1.smithi110.stdout:2/411: chown d6/dc/dd/d49/d64/f2c 1051131259 1 2024-04-12T13:42:02.062 INFO:tasks.workunit.client.1.smithi110.stdout:6/407: creat d7/d25/d30/d44/f7d x:0 0 0 2024-04-12T13:42:02.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/294: dread d0/d7/f55 [0,4194304] 0 2024-04-12T13:42:02.066 INFO:tasks.workunit.client.1.smithi110.stdout:2/412: symlink d6/dc/d1b/l74 0 2024-04-12T13:42:02.071 INFO:tasks.workunit.client.1.smithi110.stdout:8/385: truncate d1/d3/fe 1422571 0 2024-04-12T13:42:02.071 INFO:tasks.workunit.client.1.smithi110.stdout:8/386: chown d1/d3/d46 189 1 2024-04-12T13:42:02.072 INFO:tasks.workunit.client.0.smithi060.stdout:5/411: creat d6/dd/f8a x:0 0 0 2024-04-12T13:42:02.074 INFO:tasks.workunit.client.0.smithi060.stdout:5/412: fdatasync d6/d10/d12/d38/f66 0 2024-04-12T13:42:02.076 INFO:tasks.workunit.client.0.smithi060.stdout:1/470: write d1e/d46/f62 [563966,73053] 0 2024-04-12T13:42:02.076 INFO:tasks.workunit.client.0.smithi060.stdout:4/346: getdents d6/d7/db/d5b 0 2024-04-12T13:42:02.078 INFO:tasks.workunit.client.0.smithi060.stdout:4/347: stat d6/d21/d29/f73 0 2024-04-12T13:42:02.084 INFO:tasks.workunit.client.0.smithi060.stdout:7/295: getdents d0/d7 0 2024-04-12T13:42:02.088 INFO:tasks.workunit.client.0.smithi060.stdout:5/413: getdents d6/dd/d1f 0 2024-04-12T13:42:02.090 INFO:tasks.workunit.client.0.smithi060.stdout:3/378: write d7/d17/f1a [2649821,37153] 0 2024-04-12T13:42:02.092 INFO:tasks.workunit.client.1.smithi110.stdout:4/512: dwrite d0/d13/f2d [0,4194304] 0 2024-04-12T13:42:02.092 INFO:tasks.workunit.client.0.smithi060.stdout:5/414: symlink d6/dd/d1f/d25/d53/d87/d7e/l8b 0 2024-04-12T13:42:02.095 INFO:tasks.workunit.client.1.smithi110.stdout:4/513: fdatasync d0/d19/d1c/f8b 0 2024-04-12T13:42:02.095 INFO:tasks.workunit.client.1.smithi110.stdout:2/413: dwrite d6/dc/dd/f54 [0,4194304] 0 2024-04-12T13:42:02.096 INFO:tasks.workunit.client.1.smithi110.stdout:4/514: readlink d0/d19/la1 0 2024-04-12T13:42:02.100 INFO:tasks.workunit.client.0.smithi060.stdout:7/296: dwrite d0/d1b/f37 [0,4194304] 0 2024-04-12T13:42:02.101 INFO:tasks.workunit.client.1.smithi110.stdout:2/414: chown d6/dc/dd/d49/d64/d4a 2 1 2024-04-12T13:42:02.101 INFO:tasks.workunit.client.1.smithi110.stdout:8/387: dread d1/d5/d1f/f56 [0,4194304] 0 2024-04-12T13:42:02.102 INFO:tasks.workunit.client.1.smithi110.stdout:2/415: truncate d6/f8 1506878 0 2024-04-12T13:42:02.104 INFO:tasks.workunit.client.1.smithi110.stdout:8/388: write d1/d3/d46/f47 [1260567,81543] 0 2024-04-12T13:42:02.134 INFO:tasks.workunit.client.1.smithi110.stdout:3/388: sync 2024-04-12T13:42:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:01 smithi060 ceph-mon[29097]: pgmap v25: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 158 MiB/s wr, 253 op/s 2024-04-12T13:42:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:01 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:02.208 INFO:tasks.workunit.client.1.smithi110.stdout:7/395: write d1/d3/d4/f2d [381899,130945] 0 2024-04-12T13:42:02.210 INFO:tasks.workunit.client.1.smithi110.stdout:0/322: fdatasync d1/d8/d36/d51/f68 0 2024-04-12T13:42:02.212 INFO:tasks.workunit.client.0.smithi060.stdout:3/379: mknod d7/da/d3f/d5c/d25/d4d/c80 0 2024-04-12T13:42:02.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/415: rename d6/d10/d12/f4e to d6/dd/d1f/d25/d42/d52/f8c 0 2024-04-12T13:42:02.224 INFO:tasks.workunit.client.1.smithi110.stdout:5/339: write da/db/d15/f1a [686979,64559] 0 2024-04-12T13:42:02.225 INFO:tasks.workunit.client.0.smithi060.stdout:3/380: rename d7/da/d3f/d5c/l55 to d7/da/d3f/d5c/d25/d4d/l81 0 2024-04-12T13:42:02.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:01 smithi110 ceph-mon[36055]: pgmap v25: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 158 MiB/s wr, 253 op/s 2024-04-12T13:42:02.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:01 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:02.229 INFO:tasks.workunit.client.1.smithi110.stdout:8/389: rename d1/d3/d46 to d1/d3/d3c/d5a/d6f/d7e 0 2024-04-12T13:42:02.231 INFO:tasks.workunit.client.0.smithi060.stdout:5/416: mkdir d6/dd/d1f/d25/d53/d8d 0 2024-04-12T13:42:02.232 INFO:tasks.workunit.client.0.smithi060.stdout:7/297: chown d0/fe 11359156 1 2024-04-12T13:42:02.235 INFO:tasks.workunit.client.0.smithi060.stdout:5/417: chown d6/dd/d1f/d25/d42/d52/f75 1996 1 2024-04-12T13:42:02.239 INFO:tasks.workunit.client.0.smithi060.stdout:7/298: mknod d0/d7/d43/c6c 0 2024-04-12T13:42:02.243 INFO:tasks.workunit.client.1.smithi110.stdout:4/515: symlink d0/d19/d8f/lab 0 2024-04-12T13:42:02.244 INFO:tasks.workunit.client.0.smithi060.stdout:7/299: symlink d0/d1b/l6d 0 2024-04-12T13:42:02.248 INFO:tasks.workunit.client.1.smithi110.stdout:2/416: symlink d6/dc/dd/d49/d64/d4a/d3c/d6e/l75 0 2024-04-12T13:42:02.248 INFO:tasks.workunit.client.0.smithi060.stdout:5/418: mkdir d6/dd/d1f/d25/d8e 0 2024-04-12T13:42:02.254 INFO:tasks.workunit.client.1.smithi110.stdout:3/389: mkdir d5/d86 0 2024-04-12T13:42:02.260 INFO:tasks.workunit.client.1.smithi110.stdout:7/396: symlink d1/d31/d5d/d71/l86 0 2024-04-12T13:42:02.260 INFO:tasks.workunit.client.1.smithi110.stdout:8/390: mknod d1/d7/d20/c7f 0 2024-04-12T13:42:02.262 INFO:tasks.workunit.client.0.smithi060.stdout:6/458: truncate d1/d7/da/dc/d24/d30/d52/d5e/f9e 4739 0 2024-04-12T13:42:02.265 INFO:tasks.workunit.client.1.smithi110.stdout:6/408: truncate d7/d10/d1c/d2b/d48/f70 13621 0 2024-04-12T13:42:02.271 INFO:tasks.workunit.client.1.smithi110.stdout:5/340: creat da/d4f/f7d x:0 0 0 2024-04-12T13:42:02.271 INFO:tasks.workunit.client.0.smithi060.stdout:6/459: creat d1/d7/da/dc/d24/d2d/fa7 x:0 0 0 2024-04-12T13:42:02.272 INFO:tasks.workunit.client.0.smithi060.stdout:5/419: dread d6/f17 [0,4194304] 0 2024-04-12T13:42:02.273 INFO:tasks.workunit.client.1.smithi110.stdout:6/409: chown d7/d10/f35 18609183 1 2024-04-12T13:42:02.273 INFO:tasks.workunit.client.1.smithi110.stdout:8/391: symlink d1/d3/d3c/d5a/d6f/d7e/l80 0 2024-04-12T13:42:02.274 INFO:tasks.workunit.client.1.smithi110.stdout:9/468: dwrite df/f2e [0,4194304] 0 2024-04-12T13:42:02.276 INFO:tasks.workunit.client.1.smithi110.stdout:5/341: write da/d2e/d45/d29/f2d [887808,60986] 0 2024-04-12T13:42:02.277 INFO:tasks.workunit.client.1.smithi110.stdout:8/392: chown d1/d3/d35/d3a/d3e 7 1 2024-04-12T13:42:02.278 INFO:tasks.workunit.client.1.smithi110.stdout:3/390: mkdir d5/dc/d31/d3b/d32/d3e/d87 0 2024-04-12T13:42:02.279 INFO:tasks.workunit.client.1.smithi110.stdout:4/516: truncate d0/d19/d1c/f8b 1129499 0 2024-04-12T13:42:02.283 INFO:tasks.workunit.client.1.smithi110.stdout:3/391: write d5/dc/d31/d3b/d32/f78 [1869486,23876] 0 2024-04-12T13:42:02.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/410: mkdir d7/d10/d7e 0 2024-04-12T13:42:02.286 INFO:tasks.workunit.client.0.smithi060.stdout:5/420: link d6/d10/d12/d38/f40 d6/d89/f8f 0 2024-04-12T13:42:02.289 INFO:tasks.workunit.client.1.smithi110.stdout:2/417: dread d6/d18/f29 [0,4194304] 0 2024-04-12T13:42:02.289 INFO:tasks.workunit.client.1.smithi110.stdout:1/352: dread de/d15/f1c [0,4194304] 0 2024-04-12T13:42:02.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/460: dwrite d1/d7/da/d20/f26 [0,4194304] 0 2024-04-12T13:42:02.295 INFO:tasks.workunit.client.0.smithi060.stdout:3/381: chown d7/da/d3f/d5c/d25/d4d/l81 24 1 2024-04-12T13:42:02.299 INFO:tasks.workunit.client.1.smithi110.stdout:4/517: rename d0/d19/d1c/l1f to d0/de/da0/lac 0 2024-04-12T13:42:02.301 INFO:tasks.workunit.client.0.smithi060.stdout:3/382: write d7/da/f35 [658871,129448] 0 2024-04-12T13:42:02.301 INFO:tasks.workunit.client.1.smithi110.stdout:4/518: chown d0/d19/d1c/f58 68612480 1 2024-04-12T13:42:02.304 INFO:tasks.workunit.client.0.smithi060.stdout:3/383: dread - d7/da/d3f/d5c/d25/d4d/f6e zero size 2024-04-12T13:42:02.306 INFO:tasks.workunit.client.1.smithi110.stdout:3/392: dwrite d5/dc/d31/d3b/d32/d3e/f44 [0,4194304] 0 2024-04-12T13:42:02.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/384: truncate d7/d17/d19/f48 133969 0 2024-04-12T13:42:02.308 INFO:tasks.workunit.client.1.smithi110.stdout:0/323: write d1/d8/d36/d51/d60/f2b [1052786,109325] 0 2024-04-12T13:42:02.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/385: write d7/f52 [3402800,100541] 0 2024-04-12T13:42:02.313 INFO:tasks.workunit.client.1.smithi110.stdout:8/393: link d1/d5/c38 d1/d3/d3c/d5a/c81 0 2024-04-12T13:42:02.315 INFO:tasks.workunit.client.1.smithi110.stdout:8/394: dread - d1/d3/d35/d3a/d41/d77/f78 zero size 2024-04-12T13:42:02.317 INFO:tasks.workunit.client.1.smithi110.stdout:8/395: read d1/d3/d3c/f57 [393794,58438] 0 2024-04-12T13:42:02.319 INFO:tasks.workunit.client.0.smithi060.stdout:3/386: truncate d7/d17/d19/d33/f77 943224 0 2024-04-12T13:42:02.321 INFO:tasks.workunit.client.1.smithi110.stdout:3/393: rename l2 to d5/dc/d20/d2d/l88 0 2024-04-12T13:42:02.322 INFO:tasks.workunit.client.1.smithi110.stdout:8/396: dread d1/d3/d35/d3a/d41/f53 [0,4194304] 0 2024-04-12T13:42:02.325 INFO:tasks.workunit.client.0.smithi060.stdout:7/300: write d0/d1b/f53 [2052805,88593] 0 2024-04-12T13:42:02.328 INFO:tasks.workunit.client.1.smithi110.stdout:1/353: rmdir de/d14 39 2024-04-12T13:42:02.332 INFO:tasks.workunit.client.1.smithi110.stdout:6/411: rmdir d7/d10/d1c/d64 0 2024-04-12T13:42:02.333 INFO:tasks.workunit.client.0.smithi060.stdout:4/348: dwrite d6/d7/db/f4b [0,4194304] 0 2024-04-12T13:42:02.341 INFO:tasks.workunit.client.0.smithi060.stdout:3/387: rmdir d7/da/d3f/d5c/d25/d7d 0 2024-04-12T13:42:02.343 INFO:tasks.workunit.client.1.smithi110.stdout:2/418: creat d6/f76 x:0 0 0 2024-04-12T13:42:02.345 INFO:tasks.workunit.client.0.smithi060.stdout:4/349: mkdir d6/d7/dd/d1a/d19/d42/d7c 0 2024-04-12T13:42:02.345 INFO:tasks.workunit.client.1.smithi110.stdout:2/419: chown d6/dc/dd/c70 1 1 2024-04-12T13:42:02.347 INFO:tasks.workunit.client.1.smithi110.stdout:2/420: chown d6/d18/f29 75476 1 2024-04-12T13:42:02.348 INFO:tasks.workunit.client.0.smithi060.stdout:3/388: rmdir d7/d17/d19/d33/d63 39 2024-04-12T13:42:02.349 INFO:tasks.workunit.client.1.smithi110.stdout:2/421: fdatasync d6/dc/dd/d49/d64/f5a 0 2024-04-12T13:42:02.350 INFO:tasks.workunit.client.0.smithi060.stdout:3/389: write d7/da/d3f/f41 [128642,53878] 0 2024-04-12T13:42:02.355 INFO:tasks.workunit.client.1.smithi110.stdout:8/397: rename d1/d7/f7b to d1/d3/d3c/d5a/f82 0 2024-04-12T13:42:02.359 INFO:tasks.workunit.client.1.smithi110.stdout:6/412: mkdir d7/d10/d1c/d7f 0 2024-04-12T13:42:02.360 INFO:tasks.workunit.client.1.smithi110.stdout:0/324: creat d1/d8/d36/d65/f6c x:0 0 0 2024-04-12T13:42:02.361 INFO:tasks.workunit.client.0.smithi060.stdout:4/350: dwrite d6/d7/db/f72 [0,4194304] 0 2024-04-12T13:42:02.362 INFO:tasks.workunit.client.1.smithi110.stdout:0/325: read d1/f14 [2486893,24151] 0 2024-04-12T13:42:02.362 INFO:tasks.workunit.client.1.smithi110.stdout:6/413: chown d7/d25/d30/d44/d3d/f69 63047753 1 2024-04-12T13:42:02.365 INFO:tasks.workunit.client.0.smithi060.stdout:3/390: creat d7/da/f82 x:0 0 0 2024-04-12T13:42:02.366 INFO:tasks.workunit.client.1.smithi110.stdout:9/469: dwrite df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 [0,4194304] 0 2024-04-12T13:42:02.367 INFO:tasks.workunit.client.0.smithi060.stdout:4/351: mkdir d6/d2f/d7d 0 2024-04-12T13:42:02.369 INFO:tasks.workunit.client.0.smithi060.stdout:5/421: dwrite d6/d10/f68 [0,4194304] 0 2024-04-12T13:42:02.373 INFO:tasks.workunit.client.1.smithi110.stdout:7/397: truncate d1/d3/d4/d36/d4b/f25 885352 0 2024-04-12T13:42:02.377 INFO:tasks.workunit.client.1.smithi110.stdout:8/398: dread d1/d3/f13 [0,4194304] 0 2024-04-12T13:42:02.377 INFO:tasks.workunit.client.1.smithi110.stdout:4/519: dwrite d0/de/f36 [0,4194304] 0 2024-04-12T13:42:02.380 INFO:tasks.workunit.client.1.smithi110.stdout:4/520: chown d0/de/d32/d61/c86 1 1 2024-04-12T13:42:02.380 INFO:tasks.workunit.client.0.smithi060.stdout:3/391: rename d7/da/d3f/d5c/c3a to d7/da/d3f/d5c/d25/c83 0 2024-04-12T13:42:02.385 INFO:tasks.workunit.client.1.smithi110.stdout:5/342: truncate da/d35/f4e 7785517 0 2024-04-12T13:42:02.390 INFO:tasks.workunit.client.1.smithi110.stdout:5/343: write da/db/d15/f1a [223881,67015] 0 2024-04-12T13:42:02.394 INFO:tasks.workunit.client.0.smithi060.stdout:5/422: creat d6/dd/d1f/d25/f90 x:0 0 0 2024-04-12T13:42:02.395 INFO:tasks.workunit.client.1.smithi110.stdout:6/414: write d7/f1a [6017812,120281] 0 2024-04-12T13:42:02.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/392: dread d7/da/f3e [0,4194304] 0 2024-04-12T13:42:02.396 INFO:tasks.workunit.client.1.smithi110.stdout:0/326: mknod d1/d3c/c6d 0 2024-04-12T13:42:02.398 INFO:tasks.workunit.client.1.smithi110.stdout:0/327: readlink d1/d8/d36/d51/d60/l23 0 2024-04-12T13:42:02.398 INFO:tasks.workunit.client.0.smithi060.stdout:5/423: read - d6/dd/f8a zero size 2024-04-12T13:42:02.399 INFO:tasks.workunit.client.0.smithi060.stdout:7/301: dwrite d0/d1b/f48 [0,4194304] 0 2024-04-12T13:42:02.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/302: write d0/d7/d43/d4d/f57 [127568,2526] 0 2024-04-12T13:42:02.406 INFO:tasks.workunit.client.1.smithi110.stdout:4/521: chown d0/l99 0 1 2024-04-12T13:42:02.408 INFO:tasks.workunit.client.1.smithi110.stdout:8/399: write d1/d3/d3c/d5a/f82 [114445,123208] 0 2024-04-12T13:42:02.409 INFO:tasks.workunit.client.1.smithi110.stdout:3/394: rmdir d5/dc/d31/d84 0 2024-04-12T13:42:02.418 INFO:tasks.workunit.client.0.smithi060.stdout:2/362: sync 2024-04-12T13:42:02.419 INFO:tasks.workunit.client.1.smithi110.stdout:1/354: creat de/d14/f7e x:0 0 0 2024-04-12T13:42:02.420 INFO:tasks.workunit.client.1.smithi110.stdout:1/355: read - de/d14/d34/d55/d6b/f7c zero size 2024-04-12T13:42:02.422 INFO:tasks.workunit.client.0.smithi060.stdout:4/352: dwrite d6/d21/d29/f45 [4194304,4194304] 0 2024-04-12T13:42:02.425 INFO:tasks.workunit.client.0.smithi060.stdout:3/393: rename d7/d17/d19/d33/f39 to d7/da/f84 0 2024-04-12T13:42:02.426 INFO:tasks.workunit.client.0.smithi060.stdout:4/353: fsync d6/d7/dd/d1a/d57/d63/d68/f6c 0 2024-04-12T13:42:02.426 INFO:tasks.workunit.client.0.smithi060.stdout:3/394: readlink l5 0 2024-04-12T13:42:02.426 INFO:tasks.workunit.client.1.smithi110.stdout:5/344: truncate da/db/f1d 1903376 0 2024-04-12T13:42:02.429 INFO:tasks.workunit.client.1.smithi110.stdout:6/415: fdatasync d7/f73 0 2024-04-12T13:42:02.430 INFO:tasks.workunit.client.1.smithi110.stdout:6/416: readlink d7/d25/d2c/l2e 0 2024-04-12T13:42:02.436 INFO:tasks.workunit.client.1.smithi110.stdout:0/328: fsync d1/d8/d36/d51/f69 0 2024-04-12T13:42:02.437 INFO:tasks.workunit.client.0.smithi060.stdout:4/354: symlink d6/d7/dd/d1a/d19/d42/l7e 0 2024-04-12T13:42:02.439 INFO:tasks.workunit.client.0.smithi060.stdout:7/303: truncate d0/d7/f11 3376538 0 2024-04-12T13:42:02.439 INFO:tasks.workunit.client.1.smithi110.stdout:2/422: creat d6/dc/dd/d49/d64/d4a/f77 x:0 0 0 2024-04-12T13:42:02.440 INFO:tasks.workunit.client.1.smithi110.stdout:2/423: readlink d6/dc/l34 0 2024-04-12T13:42:02.440 INFO:tasks.workunit.client.0.smithi060.stdout:5/424: dwrite d6/d10/d12/d4c/f85 [0,4194304] 0 2024-04-12T13:42:02.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/304: write d0/f3a [2370208,92797] 0 2024-04-12T13:42:02.445 INFO:tasks.workunit.client.1.smithi110.stdout:8/400: mkdir d1/d3/d3c/d5a/d6f/d83 0 2024-04-12T13:42:02.447 INFO:tasks.workunit.client.1.smithi110.stdout:3/395: mkdir d5/dc/d20/d2d/d4e/d89 0 2024-04-12T13:42:02.449 INFO:tasks.workunit.client.1.smithi110.stdout:1/356: rename de/d14/d34/f54 to de/d14/d34/f7f 0 2024-04-12T13:42:02.450 INFO:tasks.workunit.client.1.smithi110.stdout:9/470: write df/d13/d2c/d2d/d39/d3a/f8c [979281,67855] 0 2024-04-12T13:42:02.450 INFO:tasks.workunit.client.0.smithi060.stdout:8/362: sync 2024-04-12T13:42:02.450 INFO:tasks.workunit.client.0.smithi060.stdout:6/461: sync 2024-04-12T13:42:02.451 INFO:tasks.workunit.client.0.smithi060.stdout:9/326: sync 2024-04-12T13:42:02.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/361: sync 2024-04-12T13:42:02.451 INFO:tasks.workunit.client.0.smithi060.stdout:1/471: sync 2024-04-12T13:42:02.455 INFO:tasks.workunit.client.1.smithi110.stdout:4/522: dread d0/d19/d1c/f8b [0,4194304] 0 2024-04-12T13:42:02.456 INFO:tasks.workunit.client.0.smithi060.stdout:6/462: chown d1/d7/c2b 1116772 1 2024-04-12T13:42:02.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/363: dread - d9/d1b/d3c/f77 zero size 2024-04-12T13:42:02.456 INFO:tasks.workunit.client.0.smithi060.stdout:9/327: chown d4/d8/l51 0 1 2024-04-12T13:42:02.457 INFO:tasks.workunit.client.1.smithi110.stdout:4/523: write d0/fc [2873525,32883] 0 2024-04-12T13:42:02.459 INFO:tasks.workunit.client.0.smithi060.stdout:7/305: mknod d0/d3d/c6e 0 2024-04-12T13:42:02.462 INFO:tasks.workunit.client.0.smithi060.stdout:3/395: rename d7/d17/f57 to d7/d17/d19/f85 0 2024-04-12T13:42:02.465 INFO:tasks.workunit.client.0.smithi060.stdout:6/463: dread - d1/d7/da/dc/d24/d30/d52/d78/d80/f85 zero size 2024-04-12T13:42:02.465 INFO:tasks.workunit.client.0.smithi060.stdout:1/472: creat d1e/d29/d65/fa5 x:0 0 0 2024-04-12T13:42:02.467 INFO:tasks.workunit.client.1.smithi110.stdout:0/329: mkdir d1/d27/d6e 0 2024-04-12T13:42:02.467 INFO:tasks.workunit.client.0.smithi060.stdout:3/396: dread - d7/d17/d27/d36/d53/f71 zero size 2024-04-12T13:42:02.469 INFO:tasks.workunit.client.1.smithi110.stdout:7/398: link d1/d3/d4/d55/d82/c34 d1/d3/d4/d55/d56/c87 0 2024-04-12T13:42:02.470 INFO:tasks.workunit.client.0.smithi060.stdout:6/464: write d1/d7/da/dc/f7c [4717231,57419] 0 2024-04-12T13:42:02.471 INFO:tasks.workunit.client.0.smithi060.stdout:2/363: getdents d6/d10/d4b 0 2024-04-12T13:42:02.473 INFO:tasks.workunit.client.0.smithi060.stdout:6/465: chown d1/c45 2908458 1 2024-04-12T13:42:02.473 INFO:tasks.workunit.client.0.smithi060.stdout:2/364: dread - d6/d13/d31/d33/f49 zero size 2024-04-12T13:42:02.477 INFO:tasks.workunit.client.0.smithi060.stdout:6/466: readlink d1/d7/da/dc/d24/d30/d52/d78/d80/l92 0 2024-04-12T13:42:02.479 INFO:tasks.workunit.client.1.smithi110.stdout:8/401: read d1/d3/fe [139960,75382] 0 2024-04-12T13:42:02.479 INFO:tasks.workunit.client.0.smithi060.stdout:0/362: write d7/d9/d14/f5c [165811,49033] 0 2024-04-12T13:42:02.481 INFO:tasks.workunit.client.0.smithi060.stdout:9/328: read d4/d9/d19/f4e [1194116,66755] 0 2024-04-12T13:42:02.481 INFO:tasks.workunit.client.0.smithi060.stdout:0/363: write d7/f11 [5329346,92270] 0 2024-04-12T13:42:02.481 INFO:tasks.workunit.client.1.smithi110.stdout:3/396: rename d5/dc/d31/d3b/d32/c39 to d5/d86/c8a 0 2024-04-12T13:42:02.482 INFO:tasks.workunit.client.1.smithi110.stdout:2/424: dread d6/dc/dd/d49/d64/d4a/d51/f2f [0,4194304] 0 2024-04-12T13:42:02.482 INFO:tasks.workunit.client.0.smithi060.stdout:5/425: truncate d6/d10/f68 1288326 0 2024-04-12T13:42:02.484 INFO:tasks.workunit.client.0.smithi060.stdout:7/306: mkdir d0/d7/d43/d63/d6f 0 2024-04-12T13:42:02.484 INFO:tasks.workunit.client.0.smithi060.stdout:5/426: readlink d6/d10/d12/l7b 0 2024-04-12T13:42:02.484 INFO:tasks.workunit.client.0.smithi060.stdout:4/355: link d6/d2f/d51/f71 d6/d21/d29/f7f 0 2024-04-12T13:42:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/307: chown d0/d7 10270927 1 2024-04-12T13:42:02.487 INFO:tasks.workunit.client.1.smithi110.stdout:9/471: unlink df/d13/d2c/d2d/d39/d3a/d4e/f57 0 2024-04-12T13:42:02.490 INFO:tasks.workunit.client.1.smithi110.stdout:6/417: symlink d7/d25/l80 0 2024-04-12T13:42:02.492 INFO:tasks.workunit.client.1.smithi110.stdout:0/330: symlink d1/d8/d36/d51/d60/l6f 0 2024-04-12T13:42:02.493 INFO:tasks.workunit.client.1.smithi110.stdout:6/418: read d7/f1a [6677081,79043] 0 2024-04-12T13:42:02.494 INFO:tasks.workunit.client.0.smithi060.stdout:6/467: mkdir d1/d7/da/d20/da8 0 2024-04-12T13:42:02.495 INFO:tasks.workunit.client.0.smithi060.stdout:0/364: mknod d7/d9/d14/d4a/c89 0 2024-04-12T13:42:02.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/308: mknod d0/d1b/c70 0 2024-04-12T13:42:02.498 INFO:tasks.workunit.client.1.smithi110.stdout:3/397: dwrite d5/f28 [4194304,4194304] 0 2024-04-12T13:42:02.499 INFO:tasks.workunit.client.0.smithi060.stdout:6/468: truncate d1/d7/da/dc/d24/d8b/f8f 859861 0 2024-04-12T13:42:02.499 INFO:tasks.workunit.client.1.smithi110.stdout:2/425: creat d6/dc/dd/d49/d64/d4a/d51/f78 x:0 0 0 2024-04-12T13:42:02.501 INFO:tasks.workunit.client.1.smithi110.stdout:0/331: dread d1/d27/d31/f50 [0,4194304] 0 2024-04-12T13:42:02.501 INFO:tasks.workunit.client.0.smithi060.stdout:4/356: write d6/d7/db/d5b/f67 [564303,102780] 0 2024-04-12T13:42:02.502 INFO:tasks.workunit.client.1.smithi110.stdout:2/426: stat d6/dc/dd/d49/d64 0 2024-04-12T13:42:02.505 INFO:tasks.workunit.client.0.smithi060.stdout:4/357: chown d6/d7/dd/d1a/d19/f1f 6483399 1 2024-04-12T13:42:02.506 INFO:tasks.workunit.client.1.smithi110.stdout:5/345: creat da/d2e/d45/d29/f7e x:0 0 0 2024-04-12T13:42:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:1/473: creat d1e/d23/d2e/d8e/d98/fa6 x:0 0 0 2024-04-12T13:42:02.510 INFO:tasks.workunit.client.1.smithi110.stdout:7/399: creat d1/d3/d4/d55/d56/d72/f88 x:0 0 0 2024-04-12T13:42:02.512 INFO:tasks.workunit.client.0.smithi060.stdout:2/365: link d6/f8 d6/d13/d17/f70 0 2024-04-12T13:42:02.513 INFO:tasks.workunit.client.0.smithi060.stdout:2/366: readlink d6/d10/d2b/d60/l69 0 2024-04-12T13:42:02.516 INFO:tasks.workunit.client.0.smithi060.stdout:2/367: write f3 [1362058,70226] 0 2024-04-12T13:42:02.516 INFO:tasks.workunit.client.1.smithi110.stdout:8/402: mkdir d1/d3/d35/d3a/d84 0 2024-04-12T13:42:02.517 INFO:tasks.workunit.client.1.smithi110.stdout:9/472: dread df/f11 [0,4194304] 0 2024-04-12T13:42:02.522 INFO:tasks.workunit.client.0.smithi060.stdout:4/358: dwrite d6/f3a [0,4194304] 0 2024-04-12T13:42:02.523 INFO:tasks.workunit.client.0.smithi060.stdout:6/469: mkdir d1/d7/da/dc/d24/d34/d51/d97/da9 0 2024-04-12T13:42:02.525 INFO:tasks.workunit.client.1.smithi110.stdout:3/398: rmdir d5/dc/d31/d3b/d32 39 2024-04-12T13:42:02.527 INFO:tasks.workunit.client.1.smithi110.stdout:3/399: write d5/f28 [2795780,73156] 0 2024-04-12T13:42:02.528 INFO:tasks.workunit.client.0.smithi060.stdout:5/427: getdents d6/dd/d27/d7d 0 2024-04-12T13:42:02.529 INFO:tasks.workunit.client.0.smithi060.stdout:6/470: write d1/d7/da/dc/d24/f91 [377588,6303] 0 2024-04-12T13:42:02.529 INFO:tasks.workunit.client.0.smithi060.stdout:5/428: stat d6/dd/d27/f44 0 2024-04-12T13:42:02.535 INFO:tasks.workunit.client.0.smithi060.stdout:1/474: write d1e/d46/f82 [303330,6479] 0 2024-04-12T13:42:02.537 INFO:tasks.workunit.client.0.smithi060.stdout:3/397: creat d7/d17/d19/d33/f86 x:0 0 0 2024-04-12T13:42:02.538 INFO:tasks.workunit.client.0.smithi060.stdout:6/471: write d1/d7/da/dc/d24/d30/d52/d5e/f68 [548484,129866] 0 2024-04-12T13:42:02.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/329: link d4/d33/d50/d5c/d67/c55 d4/d8/d32/c6b 0 2024-04-12T13:42:02.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/365: write d7/d9/d14/d35/d44/d7d/f32 [2680102,13233] 0 2024-04-12T13:42:02.548 INFO:tasks.workunit.client.0.smithi060.stdout:9/330: read d4/d8/f17 [910811,109657] 0 2024-04-12T13:42:02.550 INFO:tasks.workunit.client.0.smithi060.stdout:4/359: dread d6/d21/f53 [0,4194304] 0 2024-04-12T13:42:02.550 INFO:tasks.workunit.client.0.smithi060.stdout:9/331: truncate d4/d9/f3f 1702279 0 2024-04-12T13:42:02.551 INFO:tasks.workunit.client.0.smithi060.stdout:2/368: rename d6/d56/l3e to d6/d13/d31/l71 0 2024-04-12T13:42:02.556 INFO:tasks.workunit.client.0.smithi060.stdout:5/429: truncate d6/d10/d12/f36 2659227 0 2024-04-12T13:42:02.558 INFO:tasks.workunit.client.0.smithi060.stdout:1/475: creat d1e/d29/d65/fa7 x:0 0 0 2024-04-12T13:42:02.558 INFO:tasks.workunit.client.0.smithi060.stdout:6/472: creat d1/d2c/faa x:0 0 0 2024-04-12T13:42:02.559 INFO:tasks.workunit.client.0.smithi060.stdout:1/476: fsync d1e/d29/d65/f7a 0 2024-04-12T13:42:02.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/477: write d1e/d29/d65/f7a [696754,55054] 0 2024-04-12T13:42:02.567 INFO:tasks.workunit.client.0.smithi060.stdout:7/309: creat d0/f71 x:0 0 0 2024-04-12T13:42:02.569 INFO:tasks.workunit.client.0.smithi060.stdout:0/366: dwrite d7/d9/f82 [0,4194304] 0 2024-04-12T13:42:02.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/398: mknod d7/d17/d19/c87 0 2024-04-12T13:42:02.575 INFO:tasks.workunit.client.1.smithi110.stdout:2/427: symlink d6/dc/dd/d49/d64/d4a/d3c/d6e/l79 0 2024-04-12T13:42:02.579 INFO:tasks.workunit.client.0.smithi060.stdout:7/310: creat d0/d1b/f72 x:0 0 0 2024-04-12T13:42:02.579 INFO:tasks.workunit.client.1.smithi110.stdout:7/400: symlink d1/d3/d4/d36/d76/l89 0 2024-04-12T13:42:02.579 INFO:tasks.workunit.client.1.smithi110.stdout:9/473: mkdir df/d13/d2c/d9e 0 2024-04-12T13:42:02.579 INFO:tasks.workunit.client.0.smithi060.stdout:9/332: write d4/d8/f3b [885587,30516] 0 2024-04-12T13:42:02.580 INFO:tasks.workunit.client.1.smithi110.stdout:1/357: getdents de/d14/d34/d55/d6b 0 2024-04-12T13:42:02.580 INFO:tasks.workunit.client.1.smithi110.stdout:3/400: stat d5/dc/d20/d2d/d4e/d89 0 2024-04-12T13:42:02.582 INFO:tasks.workunit.client.0.smithi060.stdout:5/430: fdatasync d6/d10/d12/d38/f40 0 2024-04-12T13:42:02.583 INFO:tasks.workunit.client.1.smithi110.stdout:8/403: mkdir d1/d3/d35/d3a/d3e/d64/d85 0 2024-04-12T13:42:02.586 INFO:tasks.workunit.client.0.smithi060.stdout:5/431: readlink d6/dd/d1f/l24 0 2024-04-12T13:42:02.589 INFO:tasks.workunit.client.0.smithi060.stdout:0/367: rename d7/d9/d14/d4a/c89 to d7/d9/d14/d35/d44/d7d/c8a 0 2024-04-12T13:42:02.590 INFO:tasks.workunit.client.0.smithi060.stdout:2/369: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:42:02.595 INFO:tasks.workunit.client.0.smithi060.stdout:1/478: dread d1e/d29/f44 [0,4194304] 0 2024-04-12T13:42:02.596 INFO:tasks.workunit.client.1.smithi110.stdout:7/401: creat d1/d3/d4/d36/d76/f8a x:0 0 0 2024-04-12T13:42:02.599 INFO:tasks.workunit.client.1.smithi110.stdout:7/402: readlink d1/d31/l57 0 2024-04-12T13:42:02.600 INFO:tasks.workunit.client.0.smithi060.stdout:3/399: symlink d7/d17/d27/l88 0 2024-04-12T13:42:02.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/473: symlink d1/d7/da/dc/d24/d30/d52/d5e/d7e/lab 0 2024-04-12T13:42:02.602 INFO:tasks.workunit.client.1.smithi110.stdout:5/346: dwrite da/d35/f75 [4194304,4194304] 0 2024-04-12T13:42:02.602 INFO:tasks.workunit.client.1.smithi110.stdout:7/403: chown d1/d3/d4/d55/d82/f6a 3720 1 2024-04-12T13:42:02.603 INFO:tasks.workunit.client.0.smithi060.stdout:4/360: truncate d6/d7/dd/df/f18 2703779 0 2024-04-12T13:42:02.605 INFO:tasks.workunit.client.1.smithi110.stdout:7/404: chown d1/d3/le 8192866 1 2024-04-12T13:42:02.606 INFO:tasks.workunit.client.0.smithi060.stdout:7/311: dwrite d0/d1b/f72 [0,4194304] 0 2024-04-12T13:42:02.607 INFO:tasks.workunit.client.1.smithi110.stdout:9/474: mkdir df/d13/d2c/d2d/d39/d3a/d4e/d9f 0 2024-04-12T13:42:02.607 INFO:tasks.workunit.client.1.smithi110.stdout:9/475: stat fd 0 2024-04-12T13:42:02.609 INFO:tasks.workunit.client.1.smithi110.stdout:6/419: getdents d7/d10/d1c/d2b/d3a 0 2024-04-12T13:42:02.610 INFO:tasks.workunit.client.1.smithi110.stdout:2/428: write d6/dc/d13/f69 [572952,5901] 0 2024-04-12T13:42:02.611 INFO:tasks.workunit.client.1.smithi110.stdout:8/404: symlink d1/d3/d35/d3a/d3e/l86 0 2024-04-12T13:42:02.611 INFO:tasks.workunit.client.0.smithi060.stdout:2/370: creat d6/d56/d43/f72 x:0 0 0 2024-04-12T13:42:02.612 INFO:tasks.workunit.client.1.smithi110.stdout:2/429: chown d6/dc/d1b 493 1 2024-04-12T13:42:02.616 INFO:tasks.workunit.client.0.smithi060.stdout:1/479: rmdir d1e/d23/d49/d4e 39 2024-04-12T13:42:02.616 INFO:tasks.workunit.client.1.smithi110.stdout:2/430: write d6/dc/dd/d49/d64/f5e [269759,93911] 0 2024-04-12T13:42:02.617 INFO:tasks.workunit.client.0.smithi060.stdout:2/371: write d6/d56/d43/f72 [125354,20027] 0 2024-04-12T13:42:02.618 INFO:tasks.workunit.client.0.smithi060.stdout:9/333: getdents d4/d33/d65 0 2024-04-12T13:42:02.619 INFO:tasks.workunit.client.1.smithi110.stdout:6/420: creat d7/d10/d1c/d2b/d3a/f81 x:0 0 0 2024-04-12T13:42:02.622 INFO:tasks.workunit.client.1.smithi110.stdout:1/358: creat de/f80 x:0 0 0 2024-04-12T13:42:02.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/372: readlink d6/d10/d2b/d60/l69 0 2024-04-12T13:42:02.623 INFO:tasks.workunit.client.0.smithi060.stdout:3/400: creat d7/d17/d27/d36/d53/f89 x:0 0 0 2024-04-12T13:42:02.624 INFO:tasks.workunit.client.1.smithi110.stdout:3/401: creat d5/dc/d31/d3b/d32/d3e/d5f/f8b x:0 0 0 2024-04-12T13:42:02.625 INFO:tasks.workunit.client.1.smithi110.stdout:3/402: fsync d5/dc/d20/f7a 0 2024-04-12T13:42:02.626 INFO:tasks.workunit.client.0.smithi060.stdout:6/474: dwrite d1/d7/da/dc/d24/d30/d52/d5e/f68 [0,4194304] 0 2024-04-12T13:42:02.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/312: creat d0/d7/f73 x:0 0 0 2024-04-12T13:42:02.627 INFO:tasks.workunit.client.1.smithi110.stdout:8/405: creat d1/d3/d35/d3a/d3e/d4f/f87 x:0 0 0 2024-04-12T13:42:02.628 INFO:tasks.workunit.client.0.smithi060.stdout:3/401: stat d7/da/d3f/d5c/d25/d4d 0 2024-04-12T13:42:02.629 INFO:tasks.workunit.client.0.smithi060.stdout:7/313: readlink d0/d1b/l54 0 2024-04-12T13:42:02.630 INFO:tasks.workunit.client.1.smithi110.stdout:4/524: sync 2024-04-12T13:42:02.634 INFO:tasks.workunit.client.1.smithi110.stdout:6/421: rename d7/d6c to d7/d10/d1c/d2b/d3a/d82 0 2024-04-12T13:42:02.635 INFO:tasks.workunit.client.0.smithi060.stdout:7/314: write d0/d1b/f5b [420659,7477] 0 2024-04-12T13:42:02.637 INFO:tasks.workunit.client.0.smithi060.stdout:0/368: mkdir d7/d9/de/d80/d8b 0 2024-04-12T13:42:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:0/369: write d7/d9/d14/d35/d44/d7d/f32 [2447042,17634] 0 2024-04-12T13:42:02.647 INFO:tasks.workunit.client.1.smithi110.stdout:3/403: dwrite d5/dc/d31/d74/f62 [0,4194304] 0 2024-04-12T13:42:02.648 INFO:tasks.workunit.client.1.smithi110.stdout:8/406: dwrite d1/d3/d35/d3a/d3e/f49 [0,4194304] 0 2024-04-12T13:42:02.649 INFO:tasks.workunit.client.0.smithi060.stdout:0/370: read d7/d9/d14/d35/d44/f77 [257544,68008] 0 2024-04-12T13:42:02.649 INFO:tasks.workunit.client.0.smithi060.stdout:1/480: dwrite d1e/d46/f62 [0,4194304] 0 2024-04-12T13:42:02.661 INFO:tasks.workunit.client.0.smithi060.stdout:1/481: dread d1e/d46/f82 [0,4194304] 0 2024-04-12T13:42:02.662 INFO:tasks.workunit.client.0.smithi060.stdout:1/482: readlink d1e/d23/d2e/d30/l69 0 2024-04-12T13:42:02.662 INFO:tasks.workunit.client.1.smithi110.stdout:9/476: write df/d13/d26/f45 [391030,42826] 0 2024-04-12T13:42:02.666 INFO:tasks.workunit.client.0.smithi060.stdout:5/432: truncate d6/d10/d12/d4c/f85 1989768 0 2024-04-12T13:42:02.667 INFO:tasks.workunit.client.0.smithi060.stdout:7/315: mkdir d0/d3d/d74 0 2024-04-12T13:42:02.668 INFO:tasks.workunit.client.1.smithi110.stdout:5/347: getdents da/db/d3b/d40 0 2024-04-12T13:42:02.671 INFO:tasks.workunit.client.0.smithi060.stdout:4/361: link d6/d2f/l31 d6/d2f/d51/l80 0 2024-04-12T13:42:02.672 INFO:tasks.workunit.client.1.smithi110.stdout:9/477: rename df/f11 to df/d13/d3b/d40/d56/fa0 0 2024-04-12T13:42:02.675 INFO:tasks.workunit.client.1.smithi110.stdout:3/404: mkdir d5/dc/d20/d2d/d4e/d89/d8c 0 2024-04-12T13:42:02.675 INFO:tasks.workunit.client.0.smithi060.stdout:8/364: sync 2024-04-12T13:42:02.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/365: chown d9/d1b/l29 2065 1 2024-04-12T13:42:02.678 INFO:tasks.workunit.client.0.smithi060.stdout:0/371: mkdir d7/d9/d14/d35/d44/d8c 0 2024-04-12T13:42:02.682 INFO:tasks.workunit.client.0.smithi060.stdout:6/475: fdatasync d1/d7/da/dc/d24/d34/f28 0 2024-04-12T13:42:02.684 INFO:tasks.workunit.client.1.smithi110.stdout:4/525: write d0/f5 [3200965,79763] 0 2024-04-12T13:42:02.684 INFO:tasks.workunit.client.0.smithi060.stdout:6/476: chown d1/d2c 116179 1 2024-04-12T13:42:02.685 INFO:tasks.workunit.client.1.smithi110.stdout:4/526: readlink d0/l99 0 2024-04-12T13:42:02.694 INFO:tasks.workunit.client.0.smithi060.stdout:7/316: dread d0/fe [0,4194304] 0 2024-04-12T13:42:02.699 INFO:tasks.workunit.client.0.smithi060.stdout:2/373: rename d6/d13/d17/l62 to d6/l73 0 2024-04-12T13:42:02.703 INFO:tasks.workunit.client.0.smithi060.stdout:1/483: write d1e/d29/d37/f56 [4510992,17454] 0 2024-04-12T13:42:02.705 INFO:tasks.workunit.client.1.smithi110.stdout:5/348: truncate f5 525636 0 2024-04-12T13:42:02.706 INFO:tasks.workunit.client.1.smithi110.stdout:6/422: truncate d7/d10/d1c/d2b/f7a 219982 0 2024-04-12T13:42:02.706 INFO:tasks.workunit.client.1.smithi110.stdout:1/359: link de/d15/c19 de/d15/d32/d61/c81 0 2024-04-12T13:42:02.708 INFO:tasks.workunit.client.1.smithi110.stdout:5/349: readlink da/db/d3b/d40/l72 0 2024-04-12T13:42:02.708 INFO:tasks.workunit.client.1.smithi110.stdout:1/360: dread - de/d14/f53 zero size 2024-04-12T13:42:02.708 INFO:tasks.workunit.client.1.smithi110.stdout:9/478: rmdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d9a 0 2024-04-12T13:42:02.709 INFO:tasks.workunit.client.0.smithi060.stdout:4/362: write d6/d7/dd/fe [2276828,61214] 0 2024-04-12T13:42:02.711 INFO:tasks.workunit.client.1.smithi110.stdout:4/527: dread d0/d78/f81 [0,4194304] 0 2024-04-12T13:42:02.712 INFO:tasks.workunit.client.1.smithi110.stdout:1/361: truncate de/d14/f3a 3010119 0 2024-04-12T13:42:02.714 INFO:tasks.workunit.client.1.smithi110.stdout:5/350: stat da/db/l28 0 2024-04-12T13:42:02.717 INFO:tasks.workunit.client.1.smithi110.stdout:9/479: stat df/d13/d3b/d40/d56/f6c 0 2024-04-12T13:42:02.717 INFO:tasks.workunit.client.0.smithi060.stdout:6/477: write d1/d7/da/dc/d24/d34/f28 [1778606,40714] 0 2024-04-12T13:42:02.719 INFO:tasks.workunit.client.0.smithi060.stdout:9/334: getdents d4/d33/d50/d5c 0 2024-04-12T13:42:02.720 INFO:tasks.workunit.client.1.smithi110.stdout:4/528: truncate d0/d13/f52 1683455 0 2024-04-12T13:42:02.722 INFO:tasks.workunit.client.1.smithi110.stdout:1/362: creat de/d14/d34/d55/d6b/f82 x:0 0 0 2024-04-12T13:42:02.724 INFO:tasks.workunit.client.0.smithi060.stdout:7/317: unlink d0/d1b/c70 0 2024-04-12T13:42:02.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/366: rename d9/d1b/d37/d4d/d54 to d9/d1b/d3c/d6e/d7b 0 2024-04-12T13:42:02.726 INFO:tasks.workunit.client.1.smithi110.stdout:6/423: fdatasync d7/d25/d30/d44/d3d/f47 0 2024-04-12T13:42:02.729 INFO:tasks.workunit.client.1.smithi110.stdout:9/480: creat df/d13/d2c/d2d/d94/fa1 x:0 0 0 2024-04-12T13:42:02.730 INFO:tasks.workunit.client.0.smithi060.stdout:6/478: dread d1/d7/da/dc/d24/d30/d52/d5e/f68 [0,4194304] 0 2024-04-12T13:42:02.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/484: symlink d1e/d29/d6d/la8 0 2024-04-12T13:42:02.734 INFO:tasks.workunit.client.0.smithi060.stdout:3/402: getdents d7 0 2024-04-12T13:42:02.735 INFO:tasks.workunit.client.1.smithi110.stdout:1/363: fsync fb 0 2024-04-12T13:42:02.738 INFO:tasks.workunit.client.1.smithi110.stdout:5/351: symlink da/d35/d71/l7f 0 2024-04-12T13:42:02.739 INFO:tasks.workunit.client.1.smithi110.stdout:5/352: chown da/d35 835 1 2024-04-12T13:42:02.740 INFO:tasks.workunit.client.0.smithi060.stdout:2/374: write d6/f1b [961798,105203] 0 2024-04-12T13:42:02.746 INFO:tasks.workunit.client.0.smithi060.stdout:2/375: read - d6/d13/d17/f5f zero size 2024-04-12T13:42:02.752 INFO:tasks.workunit.client.0.smithi060.stdout:0/372: truncate d7/d9/d14/d35/d44/d49/d67/f76 330603 0 2024-04-12T13:42:02.754 INFO:tasks.workunit.client.1.smithi110.stdout:1/364: dwrite de/d15/d32/d5e/d79/f7a [0,4194304] 0 2024-04-12T13:42:02.754 INFO:tasks.workunit.client.1.smithi110.stdout:0/332: sync 2024-04-12T13:42:02.755 INFO:tasks.workunit.client.0.smithi060.stdout:8/367: symlink d9/d1b/d3c/d60/d65/l7c 0 2024-04-12T13:42:02.757 INFO:tasks.workunit.client.1.smithi110.stdout:4/529: creat d0/d19/d1c/fad x:0 0 0 2024-04-12T13:42:02.757 INFO:tasks.workunit.client.1.smithi110.stdout:0/333: write d1/d27/d31/f52 [78422,40051] 0 2024-04-12T13:42:02.759 INFO:tasks.workunit.client.0.smithi060.stdout:6/479: mkdir d1/d7/da/dc/dac 0 2024-04-12T13:42:02.760 INFO:tasks.workunit.client.1.smithi110.stdout:0/334: truncate d1/f26 4991687 0 2024-04-12T13:42:02.761 INFO:tasks.workunit.client.1.smithi110.stdout:9/481: dread df/d13/d26/f41 [4194304,4194304] 0 2024-04-12T13:42:02.761 INFO:tasks.workunit.client.1.smithi110.stdout:4/530: chown d0/de/d2c/d57 206379 1 2024-04-12T13:42:02.761 INFO:tasks.workunit.client.0.smithi060.stdout:1/485: mknod d1e/d23/d2e/d5e/d68/ca9 0 2024-04-12T13:42:02.763 INFO:tasks.workunit.client.0.smithi060.stdout:9/335: dwrite d4/d8/f17 [0,4194304] 0 2024-04-12T13:42:02.763 INFO:tasks.workunit.client.1.smithi110.stdout:4/531: chown d0/de/f4c 27 1 2024-04-12T13:42:02.773 INFO:tasks.workunit.client.1.smithi110.stdout:1/365: mkdir de/d14/d83 0 2024-04-12T13:42:02.774 INFO:tasks.workunit.client.1.smithi110.stdout:0/335: creat d1/d8/d36/d51/d60/f70 x:0 0 0 2024-04-12T13:42:02.776 INFO:tasks.workunit.client.0.smithi060.stdout:2/376: symlink d6/d10/d2b/d35/l74 0 2024-04-12T13:42:02.777 INFO:tasks.workunit.client.0.smithi060.stdout:5/433: getdents d6/dd/d1f/d25/d53/d87 0 2024-04-12T13:42:02.778 INFO:tasks.workunit.client.1.smithi110.stdout:6/424: rename d7/d10/d1c/d2b/c75 to d7/d10/d1c/d2b/c83 0 2024-04-12T13:42:02.780 INFO:tasks.workunit.client.0.smithi060.stdout:2/377: write d6/d56/d43/f4a [290066,38476] 0 2024-04-12T13:42:02.780 INFO:tasks.workunit.client.1.smithi110.stdout:6/425: stat d7/d10/d1c/l6e 0 2024-04-12T13:42:02.782 INFO:tasks.workunit.client.1.smithi110.stdout:9/482: dwrite df/d8a/f8e [0,4194304] 0 2024-04-12T13:42:02.791 INFO:tasks.workunit.client.0.smithi060.stdout:0/373: dread d7/d9/d14/d35/d44/d7d/f3b [0,4194304] 0 2024-04-12T13:42:02.791 INFO:tasks.workunit.client.1.smithi110.stdout:6/426: mknod d7/d25/d2c/d4c/c84 0 2024-04-12T13:42:02.795 INFO:tasks.workunit.client.1.smithi110.stdout:1/366: symlink de/l84 0 2024-04-12T13:42:02.796 INFO:tasks.workunit.client.0.smithi060.stdout:3/403: symlink d7/d17/d19/d33/l8a 0 2024-04-12T13:42:02.800 INFO:tasks.workunit.client.0.smithi060.stdout:6/480: dread d1/d7/da/dc/d24/f1f [0,4194304] 0 2024-04-12T13:42:02.801 INFO:tasks.workunit.client.1.smithi110.stdout:5/353: dwrite f5 [0,4194304] 0 2024-04-12T13:42:02.802 INFO:tasks.workunit.client.0.smithi060.stdout:4/363: truncate d6/d7/db/f4b 2349132 0 2024-04-12T13:42:02.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/404: write d7/d17/d27/d36/d53/f89 [798263,66269] 0 2024-04-12T13:42:02.804 INFO:tasks.workunit.client.1.smithi110.stdout:6/427: chown d7/l26 2367261 1 2024-04-12T13:42:02.806 INFO:tasks.workunit.client.0.smithi060.stdout:2/378: creat d6/d56/f75 x:0 0 0 2024-04-12T13:42:02.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/379: stat d6/d10/d16 0 2024-04-12T13:42:02.810 INFO:tasks.workunit.client.0.smithi060.stdout:5/434: dwrite d6/dd/d1f/d25/d53/d87/f60 [0,4194304] 0 2024-04-12T13:42:02.810 INFO:tasks.workunit.client.1.smithi110.stdout:7/405: sync 2024-04-12T13:42:02.810 INFO:tasks.workunit.client.1.smithi110.stdout:2/431: sync 2024-04-12T13:42:02.816 INFO:tasks.workunit.client.0.smithi060.stdout:0/374: read d7/d9/de/f43 [607855,68708] 0 2024-04-12T13:42:02.817 INFO:tasks.workunit.client.1.smithi110.stdout:9/483: fdatasync df/d8a/f8e 0 2024-04-12T13:42:02.826 INFO:tasks.workunit.client.0.smithi060.stdout:4/364: symlink d6/d7/dd/d1a/d57/d63/d68/l81 0 2024-04-12T13:42:02.828 INFO:tasks.workunit.client.0.smithi060.stdout:7/318: dwrite d0/f47 [0,4194304] 0 2024-04-12T13:42:02.828 INFO:tasks.workunit.client.1.smithi110.stdout:7/406: dwrite d1/f6b [0,4194304] 0 2024-04-12T13:42:02.829 INFO:tasks.workunit.client.0.smithi060.stdout:8/368: truncate d9/f11 2251558 0 2024-04-12T13:42:02.834 INFO:tasks.workunit.client.0.smithi060.stdout:1/486: creat d1e/d46/faa x:0 0 0 2024-04-12T13:42:02.836 INFO:tasks.workunit.client.0.smithi060.stdout:2/380: rmdir d6/d56/d43 39 2024-04-12T13:42:02.838 INFO:tasks.workunit.client.0.smithi060.stdout:2/381: stat d6/d13/d17 0 2024-04-12T13:42:02.838 INFO:tasks.workunit.client.0.smithi060.stdout:5/435: rmdir d6/dd/d1f 39 2024-04-12T13:42:02.840 INFO:tasks.workunit.client.0.smithi060.stdout:2/382: fsync d6/f24 0 2024-04-12T13:42:02.844 INFO:tasks.workunit.client.0.smithi060.stdout:4/365: mkdir d6/d2f/d82 0 2024-04-12T13:42:02.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/366: stat d6/d7/db/d5b 0 2024-04-12T13:42:02.847 INFO:tasks.workunit.client.1.smithi110.stdout:9/484: dread df/d13/d2c/d2d/f64 [0,4194304] 0 2024-04-12T13:42:02.848 INFO:tasks.workunit.client.1.smithi110.stdout:3/405: sync 2024-04-12T13:42:02.848 INFO:tasks.workunit.client.1.smithi110.stdout:8/407: sync 2024-04-12T13:42:02.849 INFO:tasks.workunit.client.0.smithi060.stdout:0/375: mkdir d7/d9/d14/d35/d44/d8c/d8d 0 2024-04-12T13:42:02.849 INFO:tasks.workunit.client.0.smithi060.stdout:7/319: dwrite d0/d1b/f5f [0,4194304] 0 2024-04-12T13:42:02.850 INFO:tasks.workunit.client.1.smithi110.stdout:8/408: fdatasync d1/f5c 0 2024-04-12T13:42:02.852 INFO:tasks.workunit.client.0.smithi060.stdout:7/320: truncate d0/d3d/f58 784044 0 2024-04-12T13:42:02.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/436: readlink d6/dd/d1f/l21 0 2024-04-12T13:42:02.861 INFO:tasks.workunit.client.0.smithi060.stdout:2/383: rmdir d6/d10/d2b 39 2024-04-12T13:42:02.862 INFO:tasks.workunit.client.1.smithi110.stdout:1/367: chown de/d15/d32/d61/c81 751014 1 2024-04-12T13:42:02.866 INFO:tasks.workunit.client.1.smithi110.stdout:4/532: getdents d0/de/d32 0 2024-04-12T13:42:02.870 INFO:tasks.workunit.client.0.smithi060.stdout:3/405: rename l4 to d7/d17/l8b 0 2024-04-12T13:42:02.873 INFO:tasks.workunit.client.0.smithi060.stdout:3/406: dread - d7/da/d3f/d5c/d25/f5f zero size 2024-04-12T13:42:02.876 INFO:tasks.workunit.client.1.smithi110.stdout:5/354: rename da/db/d52/c63 to da/d55/c80 0 2024-04-12T13:42:02.878 INFO:tasks.workunit.client.0.smithi060.stdout:1/487: symlink d1e/d23/d2e/d5e/lab 0 2024-04-12T13:42:02.879 INFO:tasks.workunit.client.1.smithi110.stdout:5/355: write da/d2e/f30 [869072,71296] 0 2024-04-12T13:42:02.882 INFO:tasks.workunit.client.0.smithi060.stdout:1/488: stat d1e/d23/d2e/d5e/d68/c6b 0 2024-04-12T13:42:02.884 INFO:tasks.workunit.client.1.smithi110.stdout:2/432: mknod d6/dc/dd/d49/c7a 0 2024-04-12T13:42:02.884 INFO:tasks.workunit.client.0.smithi060.stdout:2/384: dread d6/f15 [0,4194304] 0 2024-04-12T13:42:02.887 INFO:tasks.workunit.client.0.smithi060.stdout:2/385: read d6/f14 [7516621,105684] 0 2024-04-12T13:42:02.892 INFO:tasks.workunit.client.0.smithi060.stdout:5/437: write d6/f17 [3364554,116627] 0 2024-04-12T13:42:02.895 INFO:tasks.workunit.client.1.smithi110.stdout:5/356: dwrite da/d2e/d45/d29/f2d [0,4194304] 0 2024-04-12T13:42:02.901 INFO:tasks.workunit.client.1.smithi110.stdout:9/485: unlink df/d13/d2c/d2d/d39/d3a/d4e/d83/f7a 0 2024-04-12T13:42:02.901 INFO:tasks.workunit.client.0.smithi060.stdout:8/369: link d9/d1d/l72 d9/d1b/d37/l7d 0 2024-04-12T13:42:02.902 INFO:tasks.workunit.client.1.smithi110.stdout:9/486: stat df/d13/d2c/f8f 0 2024-04-12T13:42:02.902 INFO:tasks.workunit.client.1.smithi110.stdout:2/433: dwrite d6/dc/dd/d49/f61 [0,4194304] 0 2024-04-12T13:42:02.904 INFO:tasks.workunit.client.0.smithi060.stdout:8/370: stat d9/d1b/d3c/d6e/d7b 0 2024-04-12T13:42:02.904 INFO:tasks.workunit.client.1.smithi110.stdout:3/406: creat d5/dc/d31/d3b/d5b/f8d x:0 0 0 2024-04-12T13:42:02.907 INFO:tasks.workunit.client.1.smithi110.stdout:2/434: dread - d6/dc/f3f zero size 2024-04-12T13:42:02.907 INFO:tasks.workunit.client.0.smithi060.stdout:3/407: rename d7/da/d3f/d5c/f12 to d7/d17/d27/d36/d53/f8c 0 2024-04-12T13:42:02.912 INFO:tasks.workunit.client.0.smithi060.stdout:5/438: dwrite f2 [0,4194304] 0 2024-04-12T13:42:02.914 INFO:tasks.workunit.client.1.smithi110.stdout:9/487: dread df/d13/d2c/d2d/d39/d3a/d4e/f74 [0,4194304] 0 2024-04-12T13:42:02.918 INFO:tasks.workunit.client.1.smithi110.stdout:0/336: link d1/d8/c33 d1/d3c/d6b/c71 0 2024-04-12T13:42:02.918 INFO:tasks.workunit.client.1.smithi110.stdout:9/488: truncate df/d13/d2c/d2d/d39/f44 66483 0 2024-04-12T13:42:02.919 INFO:tasks.workunit.client.1.smithi110.stdout:0/337: chown d1/f14 230959144 1 2024-04-12T13:42:02.923 INFO:tasks.workunit.client.1.smithi110.stdout:6/428: mkdir d7/d10/d7e/d85 0 2024-04-12T13:42:02.928 INFO:tasks.workunit.client.0.smithi060.stdout:7/321: truncate d0/d7/f5e 750818 0 2024-04-12T13:42:02.930 INFO:tasks.workunit.client.0.smithi060.stdout:7/322: stat d0/d3d/d74 0 2024-04-12T13:42:02.930 INFO:tasks.workunit.client.0.smithi060.stdout:2/386: truncate d6/d56/d43/f5e 998141 0 2024-04-12T13:42:02.932 INFO:tasks.workunit.client.1.smithi110.stdout:7/407: dwrite d1/f1f [0,4194304] 0 2024-04-12T13:42:02.933 INFO:tasks.workunit.client.0.smithi060.stdout:7/323: dread - d0/f59 zero size 2024-04-12T13:42:02.934 INFO:tasks.workunit.client.1.smithi110.stdout:7/408: write d1/d1b/d74/f79 [1459080,66499] 0 2024-04-12T13:42:02.935 INFO:tasks.workunit.client.0.smithi060.stdout:4/367: dwrite d6/d21/f53 [0,4194304] 0 2024-04-12T13:42:02.938 INFO:tasks.workunit.client.0.smithi060.stdout:2/387: truncate d6/d13/d31/d33/f61 1012555 0 2024-04-12T13:42:02.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/388: fdatasync d6/f2a 0 2024-04-12T13:42:02.939 INFO:tasks.workunit.client.1.smithi110.stdout:8/409: symlink d1/d3/d3c/d75/d79/l88 0 2024-04-12T13:42:02.942 INFO:tasks.workunit.client.0.smithi060.stdout:1/489: write d1e/d23/d2e/d30/f36 [766354,72939] 0 2024-04-12T13:42:02.943 INFO:tasks.workunit.client.0.smithi060.stdout:8/371: creat d9/d1b/d37/d4d/f7e x:0 0 0 2024-04-12T13:42:02.944 INFO:tasks.workunit.client.0.smithi060.stdout:0/376: write d7/d9/f31 [175136,104592] 0 2024-04-12T13:42:02.945 INFO:tasks.workunit.client.1.smithi110.stdout:2/435: unlink d6/c7 0 2024-04-12T13:42:02.946 INFO:tasks.workunit.client.0.smithi060.stdout:0/377: chown d7/d9/de 1064557936 1 2024-04-12T13:42:02.949 INFO:tasks.workunit.client.1.smithi110.stdout:4/533: creat d0/d19/d1c/d50/d6f/fae x:0 0 0 2024-04-12T13:42:02.951 INFO:tasks.workunit.client.1.smithi110.stdout:0/338: fdatasync d1/d8/f3d 0 2024-04-12T13:42:02.952 INFO:tasks.workunit.client.0.smithi060.stdout:5/439: mkdir d6/dd/d1f/d32/d46/d91 0 2024-04-12T13:42:02.953 INFO:tasks.workunit.client.1.smithi110.stdout:4/534: truncate d0/de/d32/d61/f7a 1661669 0 2024-04-12T13:42:02.954 INFO:tasks.workunit.client.1.smithi110.stdout:9/489: rmdir df/d13/d2c/d2d/d94 39 2024-04-12T13:42:02.957 INFO:tasks.workunit.client.1.smithi110.stdout:9/490: chown df/d13/d2c/d2d/d39/d3a/d4e/d83/f68 1299863 1 2024-04-12T13:42:02.958 INFO:tasks.workunit.client.1.smithi110.stdout:9/491: fdatasync fd 0 2024-04-12T13:42:02.965 INFO:tasks.workunit.client.1.smithi110.stdout:8/410: truncate d1/d5/dd/f27 4996982 0 2024-04-12T13:42:02.966 INFO:tasks.workunit.client.1.smithi110.stdout:3/407: dwrite d5/dc/f27 [0,4194304] 0 2024-04-12T13:42:02.966 INFO:tasks.workunit.client.1.smithi110.stdout:2/436: rmdir d6/d18 39 2024-04-12T13:42:02.967 INFO:tasks.workunit.client.1.smithi110.stdout:3/408: chown d5/dc/f2e 390959885 1 2024-04-12T13:42:02.969 INFO:tasks.workunit.client.0.smithi060.stdout:8/372: mknod d9/d1b/d3c/d6e/c7f 0 2024-04-12T13:42:02.969 INFO:tasks.workunit.client.1.smithi110.stdout:3/409: stat d5/dc/d31/d3b/d32/d3e/d87 0 2024-04-12T13:42:02.971 INFO:tasks.workunit.client.1.smithi110.stdout:3/410: dread - d5/dc/d20/d2d/d4f/f7b zero size 2024-04-12T13:42:02.974 INFO:tasks.workunit.client.1.smithi110.stdout:4/535: creat d0/d78/faf x:0 0 0 2024-04-12T13:42:02.975 INFO:tasks.workunit.client.0.smithi060.stdout:5/440: rename d6/f8 to d6/dd/d1f/d32/d46/f92 0 2024-04-12T13:42:02.979 INFO:tasks.workunit.client.0.smithi060.stdout:7/324: symlink d0/d3d/d74/l75 0 2024-04-12T13:42:02.980 INFO:tasks.workunit.client.0.smithi060.stdout:2/389: mknod d6/d56/d58/c76 0 2024-04-12T13:42:02.982 INFO:tasks.workunit.client.1.smithi110.stdout:9/492: rename df/f34 to df/d38/fa2 0 2024-04-12T13:42:02.984 INFO:tasks.workunit.client.1.smithi110.stdout:9/493: chown df/f3d 2133941296 1 2024-04-12T13:42:02.985 INFO:tasks.workunit.client.1.smithi110.stdout:9/494: stat df/d13/d2c/d2d/d39/l47 0 2024-04-12T13:42:02.986 INFO:tasks.workunit.client.1.smithi110.stdout:1/368: sync 2024-04-12T13:42:02.987 INFO:tasks.workunit.client.0.smithi060.stdout:3/408: write d7/d17/d19/d33/f77 [1386540,54079] 0 2024-04-12T13:42:02.993 INFO:tasks.workunit.client.0.smithi060.stdout:0/378: mkdir d7/d9/d4c/d8e 0 2024-04-12T13:42:02.994 INFO:tasks.workunit.client.1.smithi110.stdout:0/339: dread d1/d8/ff [0,4194304] 0 2024-04-12T13:42:02.994 INFO:tasks.workunit.client.1.smithi110.stdout:6/429: truncate d7/d25/d30/d44/d3d/f5b 3556454 0 2024-04-12T13:42:02.997 INFO:tasks.workunit.client.0.smithi060.stdout:4/368: write d6/f30 [3022241,102464] 0 2024-04-12T13:42:03.000 INFO:tasks.workunit.client.1.smithi110.stdout:3/411: chown d5/l10 13 1 2024-04-12T13:42:03.001 INFO:tasks.workunit.client.1.smithi110.stdout:7/409: truncate d1/d3/d4/f9 11527877 0 2024-04-12T13:42:03.002 INFO:tasks.workunit.client.0.smithi060.stdout:8/373: dread d9/f11 [0,4194304] 0 2024-04-12T13:42:03.002 INFO:tasks.workunit.client.0.smithi060.stdout:2/390: dwrite d6/d10/f44 [0,4194304] 0 2024-04-12T13:42:03.002 INFO:tasks.workunit.client.1.smithi110.stdout:1/369: dwrite f6 [0,4194304] 0 2024-04-12T13:42:03.003 INFO:tasks.workunit.client.1.smithi110.stdout:1/370: chown de/d14/l24 36 1 2024-04-12T13:42:03.004 INFO:tasks.workunit.client.1.smithi110.stdout:4/536: creat d0/de/fb0 x:0 0 0 2024-04-12T13:42:03.004 INFO:tasks.workunit.client.0.smithi060.stdout:5/441: creat d6/dd/d1f/d32/d46/f93 x:0 0 0 2024-04-12T13:42:03.006 INFO:tasks.workunit.client.1.smithi110.stdout:4/537: dread - d0/d19/d1c/d50/d6f/fae zero size 2024-04-12T13:42:03.013 INFO:tasks.workunit.client.0.smithi060.stdout:1/490: creat d1e/d23/d49/d4e/d9b/fac x:0 0 0 2024-04-12T13:42:03.017 INFO:tasks.workunit.client.1.smithi110.stdout:8/411: write d1/d3/fe [1897882,11459] 0 2024-04-12T13:42:03.025 INFO:tasks.workunit.client.1.smithi110.stdout:8/412: write d1/d3/d3c/d5a/f82 [477196,72699] 0 2024-04-12T13:42:03.027 INFO:tasks.workunit.client.1.smithi110.stdout:8/413: chown d1/d3/d35/d3a/d3e/d64 6833379 1 2024-04-12T13:42:03.028 INFO:tasks.workunit.client.1.smithi110.stdout:5/357: sync 2024-04-12T13:42:03.028 INFO:tasks.workunit.client.0.smithi060.stdout:4/369: rename d6/f3a to d6/d7/dd/d1a/d57/f83 0 2024-04-12T13:42:03.029 INFO:tasks.workunit.client.0.smithi060.stdout:3/409: dread d7/f52 [0,4194304] 0 2024-04-12T13:42:03.029 INFO:tasks.workunit.client.1.smithi110.stdout:7/410: creat d1/d1b/d74/f8b x:0 0 0 2024-04-12T13:42:03.034 INFO:tasks.workunit.client.0.smithi060.stdout:8/374: mkdir d9/da/d80 0 2024-04-12T13:42:03.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/442: symlink d6/dd/d1f/d25/d42/d52/l94 0 2024-04-12T13:42:03.039 INFO:tasks.workunit.client.0.smithi060.stdout:0/379: mknod d7/d9/d14/c8f 0 2024-04-12T13:42:03.039 INFO:tasks.workunit.client.1.smithi110.stdout:3/412: dread d5/f40 [0,4194304] 0 2024-04-12T13:42:03.039 INFO:tasks.workunit.client.0.smithi060.stdout:5/443: write d6/dd/d1f/d25/d53/d87/f60 [3432215,10017] 0 2024-04-12T13:42:03.040 INFO:tasks.workunit.client.1.smithi110.stdout:3/413: readlink d5/dc/d20/l55 0 2024-04-12T13:42:03.047 INFO:tasks.workunit.client.1.smithi110.stdout:2/437: creat d6/dc/d13/f7b x:0 0 0 2024-04-12T13:42:03.050 INFO:tasks.workunit.client.1.smithi110.stdout:1/371: dwrite de/f4d [0,4194304] 0 2024-04-12T13:42:03.052 INFO:tasks.workunit.client.1.smithi110.stdout:0/340: dwrite d1/d8/ff [0,4194304] 0 2024-04-12T13:42:03.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/391: dwrite d6/f15 [0,4194304] 0 2024-04-12T13:42:03.058 INFO:tasks.workunit.client.1.smithi110.stdout:9/495: truncate df/f2e 1412755 0 2024-04-12T13:42:03.060 INFO:tasks.workunit.client.0.smithi060.stdout:5/444: dwrite d6/dd/d1f/d32/f6f [0,4194304] 0 2024-04-12T13:42:03.061 INFO:tasks.workunit.client.1.smithi110.stdout:7/411: creat d1/d3/d4/d55/d56/f8c x:0 0 0 2024-04-12T13:42:03.062 INFO:tasks.workunit.client.1.smithi110.stdout:8/414: chown d1/d3/d35/d3a/d41/l74 14 1 2024-04-12T13:42:03.073 INFO:tasks.workunit.client.0.smithi060.stdout:4/370: dwrite d6/d7/dd/df/f23 [0,4194304] 0 2024-04-12T13:42:03.073 INFO:tasks.workunit.client.1.smithi110.stdout:3/414: mkdir d5/dc/d31/d74/d8e 0 2024-04-12T13:42:03.074 INFO:tasks.workunit.client.1.smithi110.stdout:8/415: chown d1/d5/dd/d31/f3d 2 1 2024-04-12T13:42:03.075 INFO:tasks.workunit.client.0.smithi060.stdout:3/410: dwrite d7/d17/d27/d36/d53/f8c [0,4194304] 0 2024-04-12T13:42:03.076 INFO:tasks.workunit.client.1.smithi110.stdout:4/538: dwrite d0/d19/d26/f59 [0,4194304] 0 2024-04-12T13:42:03.086 INFO:tasks.workunit.client.0.smithi060.stdout:9/336: sync 2024-04-12T13:42:03.086 INFO:tasks.workunit.client.0.smithi060.stdout:6/481: sync 2024-04-12T13:42:03.087 INFO:tasks.workunit.client.1.smithi110.stdout:9/496: mkdir df/d13/d26/d37/d49/da3 0 2024-04-12T13:42:03.087 INFO:tasks.workunit.client.1.smithi110.stdout:0/341: dwrite d1/d27/d31/f49 [0,4194304] 0 2024-04-12T13:42:03.087 INFO:tasks.workunit.client.1.smithi110.stdout:5/358: link da/db/f37 da/d2e/d45/d29/d32/f81 0 2024-04-12T13:42:03.087 INFO:tasks.workunit.client.1.smithi110.stdout:4/539: chown d0/de/d32/d61/l76 1 1 2024-04-12T13:42:03.088 INFO:tasks.workunit.client.1.smithi110.stdout:7/412: write d1/d31/d5d/f83 [488062,33597] 0 2024-04-12T13:42:03.092 INFO:tasks.workunit.client.1.smithi110.stdout:6/430: link d7/f19 d7/d10/d1c/d2b/d48/d54/f86 0 2024-04-12T13:42:03.093 INFO:tasks.workunit.client.1.smithi110.stdout:1/372: symlink de/d14/d83/l85 0 2024-04-12T13:42:03.095 INFO:tasks.workunit.client.1.smithi110.stdout:8/416: mknod d1/d3/d35/d3a/d41/d77/c89 0 2024-04-12T13:42:03.098 INFO:tasks.workunit.client.1.smithi110.stdout:6/431: read - d7/d10/d1c/d2b/d48/f5e zero size 2024-04-12T13:42:03.098 INFO:tasks.workunit.client.1.smithi110.stdout:7/413: rmdir d1/d1b/d3d 39 2024-04-12T13:42:03.104 INFO:tasks.workunit.client.1.smithi110.stdout:4/540: symlink d0/d19/d26/d65/d7e/lb1 0 2024-04-12T13:42:03.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/417: truncate d1/d3/d35/d3a/d3e/d4f/f87 1009903 0 2024-04-12T13:42:03.107 INFO:tasks.workunit.client.1.smithi110.stdout:0/342: creat d1/d8/d36/d63/d4a/f72 x:0 0 0 2024-04-12T13:42:03.109 INFO:tasks.workunit.client.1.smithi110.stdout:2/438: creat d6/dc/dd/d49/d64/d4a/f7c x:0 0 0 2024-04-12T13:42:03.110 INFO:tasks.workunit.client.1.smithi110.stdout:5/359: mkdir da/db/d61/d79/d82 0 2024-04-12T13:42:03.111 INFO:tasks.workunit.client.1.smithi110.stdout:9/497: dwrite df/d38/d6e/d7f/f8b [0,4194304] 0 2024-04-12T13:42:03.120 INFO:tasks.workunit.client.1.smithi110.stdout:9/498: chown df/d13/d2c/d2d/d39/d3a/f78 78 1 2024-04-12T13:42:03.120 INFO:tasks.workunit.client.1.smithi110.stdout:5/360: fdatasync da/d2e/d45/d29/d66/f70 0 2024-04-12T13:42:03.120 INFO:tasks.workunit.client.0.smithi060.stdout:7/325: mknod d0/d7/d43/d63/d6f/c76 0 2024-04-12T13:42:03.122 INFO:tasks.workunit.client.1.smithi110.stdout:0/343: dread d1/d8/f34 [0,4194304] 0 2024-04-12T13:42:03.123 INFO:tasks.workunit.client.0.smithi060.stdout:8/375: mkdir d9/d1b/d2b/d81 0 2024-04-12T13:42:03.125 INFO:tasks.workunit.client.1.smithi110.stdout:5/361: fsync da/d2e/d45/d29/f78 0 2024-04-12T13:42:03.126 INFO:tasks.workunit.client.1.smithi110.stdout:2/439: rename d6/dc/f37 to d6/dc/dd/d49/f7d 0 2024-04-12T13:42:03.127 INFO:tasks.workunit.client.1.smithi110.stdout:3/415: dread d5/dc/d20/f36 [0,4194304] 0 2024-04-12T13:42:03.127 INFO:tasks.workunit.client.1.smithi110.stdout:5/362: chown da/db/d61/d79/d82 52 1 2024-04-12T13:42:03.130 INFO:tasks.workunit.client.1.smithi110.stdout:7/414: creat d1/d3/d84/f8d x:0 0 0 2024-04-12T13:42:03.131 INFO:tasks.workunit.client.1.smithi110.stdout:1/373: mkdir de/d1d/d86 0 2024-04-12T13:42:03.134 INFO:tasks.workunit.client.1.smithi110.stdout:4/541: dwrite d0/de/f7f [4194304,4194304] 0 2024-04-12T13:42:03.135 INFO:tasks.workunit.client.1.smithi110.stdout:1/374: fdatasync de/d14/d34/d55/f63 0 2024-04-12T13:42:03.135 INFO:tasks.workunit.client.0.smithi060.stdout:1/491: truncate d1e/d23/d2e/f99 3438061 0 2024-04-12T13:42:03.136 INFO:tasks.workunit.client.1.smithi110.stdout:4/542: chown d0/de/f4c 16108538 1 2024-04-12T13:42:03.136 INFO:tasks.workunit.client.0.smithi060.stdout:1/492: chown d1e/d23/d2e/d30/d51 2 1 2024-04-12T13:42:03.137 INFO:tasks.workunit.client.1.smithi110.stdout:9/499: write df/d13/d26/f41 [449306,96623] 0 2024-04-12T13:42:03.138 INFO:tasks.workunit.client.1.smithi110.stdout:6/432: rename d7/d25/f59 to d7/d25/f87 0 2024-04-12T13:42:03.139 INFO:tasks.workunit.client.1.smithi110.stdout:1/375: truncate de/d15/d32/f71 774018 0 2024-04-12T13:42:03.140 INFO:tasks.workunit.client.1.smithi110.stdout:9/500: read fc [603975,80105] 0 2024-04-12T13:42:03.141 INFO:tasks.workunit.client.1.smithi110.stdout:0/344: creat d1/d8/d36/d63/d4a/f73 x:0 0 0 2024-04-12T13:42:03.141 INFO:tasks.workunit.client.0.smithi060.stdout:2/392: rmdir d6/d10/d4b 39 2024-04-12T13:42:03.143 INFO:tasks.workunit.client.1.smithi110.stdout:0/345: chown d1/d8/d36/l38 199 1 2024-04-12T13:42:03.144 INFO:tasks.workunit.client.1.smithi110.stdout:1/376: write de/d14/d34/d55/d6b/f77 [538056,86032] 0 2024-04-12T13:42:03.144 INFO:tasks.workunit.client.1.smithi110.stdout:2/440: rmdir d6/dc/dd/d49/d64/d4a/d55 39 2024-04-12T13:42:03.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/371: rmdir d6/d7 39 2024-04-12T13:42:03.147 INFO:tasks.workunit.client.1.smithi110.stdout:0/346: write d1/d27/d31/f64 [68755,81797] 0 2024-04-12T13:42:03.148 INFO:tasks.workunit.client.0.smithi060.stdout:3/411: creat d7/da/d3f/d5c/f8d x:0 0 0 2024-04-12T13:42:03.149 INFO:tasks.workunit.client.1.smithi110.stdout:5/363: mknod da/d2e/d45/d29/d58/c83 0 2024-04-12T13:42:03.151 INFO:tasks.workunit.client.0.smithi060.stdout:9/337: creat d4/d33/d50/f6c x:0 0 0 2024-04-12T13:42:03.151 INFO:tasks.workunit.client.1.smithi110.stdout:8/418: link d1/d3/d3c/f57 d1/d3/d3c/d5a/f8a 0 2024-04-12T13:42:03.152 INFO:tasks.workunit.client.0.smithi060.stdout:9/338: chown d4/d8/f41 233751319 1 2024-04-12T13:42:03.153 INFO:tasks.workunit.client.1.smithi110.stdout:8/419: fsync d1/d3/fe 0 2024-04-12T13:42:03.159 INFO:tasks.workunit.client.0.smithi060.stdout:0/380: creat d7/d33/d5b/f90 x:0 0 0 2024-04-12T13:42:03.161 INFO:tasks.workunit.client.0.smithi060.stdout:0/381: write d7/d9/d14/d35/d44/d7d/f7a [92776,27714] 0 2024-04-12T13:42:03.162 INFO:tasks.workunit.client.0.smithi060.stdout:1/493: creat d1e/d1f/fad x:0 0 0 2024-04-12T13:42:03.166 INFO:tasks.workunit.client.0.smithi060.stdout:5/445: symlink d6/dd/l95 0 2024-04-12T13:42:03.166 INFO:tasks.workunit.client.1.smithi110.stdout:9/501: rmdir df/d13/d2c/d2d 39 2024-04-12T13:42:03.168 INFO:tasks.workunit.client.0.smithi060.stdout:5/446: write d6/d10/f2a [1245695,125892] 0 2024-04-12T13:42:03.169 INFO:tasks.workunit.client.0.smithi060.stdout:5/447: chown d6/d10 0 1 2024-04-12T13:42:03.169 INFO:tasks.workunit.client.1.smithi110.stdout:1/377: mkdir de/d14/d34/d87 0 2024-04-12T13:42:03.171 INFO:tasks.workunit.client.0.smithi060.stdout:6/482: getdents d1/d7/da/dc/d24/d34/d51/d97/da9 0 2024-04-12T13:42:03.172 INFO:tasks.workunit.client.1.smithi110.stdout:0/347: chown d1/d56/l58 2015 1 2024-04-12T13:42:03.174 INFO:tasks.workunit.client.0.smithi060.stdout:3/412: dread d7/da/d3f/d5c/d25/f44 [0,4194304] 0 2024-04-12T13:42:03.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/483: stat d1/d7/da/dc/d24/d30/d52/d5e 0 2024-04-12T13:42:03.176 INFO:tasks.workunit.client.0.smithi060.stdout:7/326: truncate d0/d7/f10 1356393 0 2024-04-12T13:42:03.177 INFO:tasks.workunit.client.1.smithi110.stdout:6/433: dread d7/d25/d30/d44/d3d/f5b [0,4194304] 0 2024-04-12T13:42:03.178 INFO:tasks.workunit.client.1.smithi110.stdout:5/364: symlink da/db/d3b/d40/l84 0 2024-04-12T13:42:03.181 INFO:tasks.workunit.client.0.smithi060.stdout:0/382: creat d7/d9/de/f91 x:0 0 0 2024-04-12T13:42:03.183 INFO:tasks.workunit.client.0.smithi060.stdout:1/494: mkdir d1e/d23/d2e/d8e/d98/dae 0 2024-04-12T13:42:03.183 INFO:tasks.workunit.client.0.smithi060.stdout:0/383: truncate d7/d9/f31 826655 0 2024-04-12T13:42:03.187 INFO:tasks.workunit.client.1.smithi110.stdout:4/543: rename d0/la to d0/d19/d1c/d50/d6f/lb2 0 2024-04-12T13:42:03.190 INFO:tasks.workunit.client.0.smithi060.stdout:1/495: dread d1e/f33 [0,4194304] 0 2024-04-12T13:42:03.190 INFO:tasks.workunit.client.1.smithi110.stdout:9/502: creat df/d13/d26/d37/fa4 x:0 0 0 2024-04-12T13:42:03.191 INFO:tasks.workunit.client.1.smithi110.stdout:9/503: fsync df/d13/f27 0 2024-04-12T13:42:03.192 INFO:tasks.workunit.client.0.smithi060.stdout:1/496: write d1e/d23/f89 [810521,45982] 0 2024-04-12T13:42:03.196 INFO:tasks.workunit.client.0.smithi060.stdout:8/376: write d9/d1b/d2b/f32 [8586113,80120] 0 2024-04-12T13:42:03.196 INFO:tasks.workunit.client.1.smithi110.stdout:7/415: creat d1/d1b/d3d/d68/f8e x:0 0 0 2024-04-12T13:42:03.198 INFO:tasks.workunit.client.0.smithi060.stdout:3/413: rmdir d7 39 2024-04-12T13:42:03.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/377: fsync d9/d1b/d3c/f77 0 2024-04-12T13:42:03.200 INFO:tasks.workunit.client.1.smithi110.stdout:0/348: creat d1/d8/d36/d51/d60/f74 x:0 0 0 2024-04-12T13:42:03.201 INFO:tasks.workunit.client.0.smithi060.stdout:7/327: mknod d0/d7/d43/d63/c77 0 2024-04-12T13:42:03.202 INFO:tasks.workunit.client.1.smithi110.stdout:6/434: creat d7/d10/d1c/d2b/d48/d54/f88 x:0 0 0 2024-04-12T13:42:03.205 INFO:tasks.workunit.client.0.smithi060.stdout:6/484: rename d1/d7/da/d20/l5b to d1/d7/da/dc/d24/d34/d51/d59/d94/lad 0 2024-04-12T13:42:03.206 INFO:tasks.workunit.client.0.smithi060.stdout:4/372: dwrite d6/d7/dd/d1a/f60 [0,4194304] 0 2024-04-12T13:42:03.208 INFO:tasks.workunit.client.0.smithi060.stdout:9/339: write d4/d33/d50/d5c/d67/f5e [10326355,36036] 0 2024-04-12T13:42:03.210 INFO:tasks.workunit.client.1.smithi110.stdout:3/416: dwrite d5/f1f [0,4194304] 0 2024-04-12T13:42:03.212 INFO:tasks.workunit.client.1.smithi110.stdout:8/420: symlink d1/d5/l8b 0 2024-04-12T13:42:03.215 INFO:tasks.workunit.client.0.smithi060.stdout:2/393: creat d6/f77 x:0 0 0 2024-04-12T13:42:03.216 INFO:tasks.workunit.client.1.smithi110.stdout:3/417: truncate d5/dc/d20/d2d/d4f/f7b 784524 0 2024-04-12T13:42:03.217 INFO:tasks.workunit.client.1.smithi110.stdout:2/441: dwrite d6/dc/dd/d49/d64/d4a/d51/f2f [0,4194304] 0 2024-04-12T13:42:03.218 INFO:tasks.workunit.client.1.smithi110.stdout:3/418: truncate d5/f40 1719565 0 2024-04-12T13:42:03.220 INFO:tasks.workunit.client.1.smithi110.stdout:4/544: creat d0/d19/d26/d65/fb3 x:0 0 0 2024-04-12T13:42:03.226 INFO:tasks.workunit.client.1.smithi110.stdout:3/419: write d5/f1f [1523788,101088] 0 2024-04-12T13:42:03.230 INFO:tasks.workunit.client.0.smithi060.stdout:5/448: write d6/dd/d1f/d25/d53/f77 [7461398,98125] 0 2024-04-12T13:42:03.231 INFO:tasks.workunit.client.0.smithi060.stdout:5/449: chown d6/dd/f8a 108 1 2024-04-12T13:42:03.232 INFO:tasks.workunit.client.1.smithi110.stdout:7/416: rename d1/d1b/d70/l73 to d1/d31/d5d/l8f 0 2024-04-12T13:42:03.237 INFO:tasks.workunit.client.1.smithi110.stdout:7/417: write d1/d3/d4/d36/f3a [490475,19427] 0 2024-04-12T13:42:03.238 INFO:tasks.workunit.client.0.smithi060.stdout:8/378: mkdir d9/d1b/d2b/d82 0 2024-04-12T13:42:03.239 INFO:tasks.workunit.client.0.smithi060.stdout:3/414: truncate d7/d17/d27/d36/d53/f8c 4285609 0 2024-04-12T13:42:03.241 INFO:tasks.workunit.client.1.smithi110.stdout:4/545: dwrite d0/d19/d1c/f60 [0,4194304] 0 2024-04-12T13:42:03.241 INFO:tasks.workunit.client.0.smithi060.stdout:8/379: write d9/d1b/d3c/f77 [838722,53736] 0 2024-04-12T13:42:03.242 INFO:tasks.workunit.client.0.smithi060.stdout:3/415: fdatasync d7/da/f2c 0 2024-04-12T13:42:03.248 INFO:tasks.workunit.client.1.smithi110.stdout:5/365: truncate da/f11 136545 0 2024-04-12T13:42:03.250 INFO:tasks.workunit.client.1.smithi110.stdout:5/366: write da/db/f31 [4732184,38943] 0 2024-04-12T13:42:03.252 INFO:tasks.workunit.client.0.smithi060.stdout:6/485: creat d1/d2c/fae x:0 0 0 2024-04-12T13:42:03.253 INFO:tasks.workunit.client.0.smithi060.stdout:1/497: write d1e/f31 [608430,26870] 0 2024-04-12T13:42:03.255 INFO:tasks.workunit.client.1.smithi110.stdout:1/378: write de/d14/d34/d55/d6b/f6f [262717,9925] 0 2024-04-12T13:42:03.257 INFO:tasks.workunit.client.0.smithi060.stdout:2/394: rmdir d6/d56/d43 39 2024-04-12T13:42:03.260 INFO:tasks.workunit.client.1.smithi110.stdout:8/421: rename d1/d5/d1f/f25 to d1/d3/d3c/d5a/d6f/d83/f8c 0 2024-04-12T13:42:03.260 INFO:tasks.workunit.client.1.smithi110.stdout:3/420: rename d5/dc to d5/dc/d31/d3b/d32/d3e/d8f 22 2024-04-12T13:42:03.266 INFO:tasks.workunit.client.0.smithi060.stdout:7/328: mkdir d0/d78 0 2024-04-12T13:42:03.268 INFO:tasks.workunit.client.1.smithi110.stdout:9/504: truncate df/f1e 5287544 0 2024-04-12T13:42:03.268 INFO:tasks.workunit.client.0.smithi060.stdout:3/416: creat d7/d17/d27/f8e x:0 0 0 2024-04-12T13:42:03.268 INFO:tasks.workunit.client.1.smithi110.stdout:6/435: mknod d7/d10/d1c/d7f/c89 0 2024-04-12T13:42:03.270 INFO:tasks.workunit.client.0.smithi060.stdout:3/417: chown d7/d17/d19/d33/l34 16204520 1 2024-04-12T13:42:03.272 INFO:tasks.workunit.client.1.smithi110.stdout:7/418: unlink d1/d1b/f49 0 2024-04-12T13:42:03.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/373: symlink d6/d7/l84 0 2024-04-12T13:42:03.275 INFO:tasks.workunit.client.0.smithi060.stdout:6/486: mknod d1/d7/da/dc/caf 0 2024-04-12T13:42:03.276 INFO:tasks.workunit.client.1.smithi110.stdout:0/349: truncate d1/d27/d31/f64 103536 0 2024-04-12T13:42:03.278 INFO:tasks.workunit.client.1.smithi110.stdout:0/350: chown d1/d8/f3d 9852 1 2024-04-12T13:42:03.278 INFO:tasks.workunit.client.0.smithi060.stdout:0/384: creat d7/d9/f92 x:0 0 0 2024-04-12T13:42:03.281 INFO:tasks.workunit.client.0.smithi060.stdout:2/395: dread d6/d10/d16/f1c [0,4194304] 0 2024-04-12T13:42:03.281 INFO:tasks.workunit.client.0.smithi060.stdout:0/385: dread - d7/d9/d4c/f55 zero size 2024-04-12T13:42:03.282 INFO:tasks.workunit.client.0.smithi060.stdout:0/386: dread - d7/d9/f92 zero size 2024-04-12T13:42:03.283 INFO:tasks.workunit.client.0.smithi060.stdout:8/380: write d9/d1d/d2f/f4f [253999,89379] 0 2024-04-12T13:42:03.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/436: dwrite d7/d25/d30/d44/f7d [0,4194304] 0 2024-04-12T13:42:03.286 INFO:tasks.workunit.client.0.smithi060.stdout:8/381: read d9/d1b/d3c/d60/f75 [594170,91218] 0 2024-04-12T13:42:03.287 INFO:tasks.workunit.client.0.smithi060.stdout:9/340: truncate d4/d33/d50/d5c/d67/f39 413609 0 2024-04-12T13:42:03.288 INFO:tasks.workunit.client.1.smithi110.stdout:9/505: dread fd [0,4194304] 0 2024-04-12T13:42:03.289 INFO:tasks.workunit.client.1.smithi110.stdout:6/437: write d7/d25/d30/d44/d3d/f76 [673083,69146] 0 2024-04-12T13:42:03.289 INFO:tasks.workunit.client.1.smithi110.stdout:2/442: rename d6/dc/dd/d49/d64/d4a/d55/l56 to d6/d53/l7e 0 2024-04-12T13:42:03.292 INFO:tasks.workunit.client.1.smithi110.stdout:3/421: fsync d5/dc/f13 0 2024-04-12T13:42:03.294 INFO:tasks.workunit.client.0.smithi060.stdout:7/329: creat d0/d7/d43/d4d/f79 x:0 0 0 2024-04-12T13:42:03.295 INFO:tasks.workunit.client.1.smithi110.stdout:7/419: symlink d1/d3/d4/d36/d76/l90 0 2024-04-12T13:42:03.299 INFO:tasks.workunit.client.0.smithi060.stdout:3/418: write d7/f52 [1044173,71431] 0 2024-04-12T13:42:03.300 INFO:tasks.workunit.client.1.smithi110.stdout:4/546: fsync d0/d19/d1c/f8b 0 2024-04-12T13:42:03.302 INFO:tasks.workunit.client.0.smithi060.stdout:4/374: rename d6/d7/db/d5b to d6/d7/db/d85 0 2024-04-12T13:42:03.305 INFO:tasks.workunit.client.1.smithi110.stdout:5/367: creat da/db/d61/d79/d82/f85 x:0 0 0 2024-04-12T13:42:03.305 INFO:tasks.workunit.client.1.smithi110.stdout:5/368: fdatasync da/db/d15/f1a 0 2024-04-12T13:42:03.305 INFO:tasks.workunit.client.0.smithi060.stdout:6/487: mkdir d1/d7/da/dc/d24/d2d/db0 0 2024-04-12T13:42:03.306 INFO:tasks.workunit.client.0.smithi060.stdout:1/498: dwrite d1e/d1f/f4b [4194304,4194304] 0 2024-04-12T13:42:03.306 INFO:tasks.workunit.client.0.smithi060.stdout:4/375: write d6/d7/db/f72 [5089694,126393] 0 2024-04-12T13:42:03.306 INFO:tasks.workunit.client.1.smithi110.stdout:0/351: fsync d1/d8/f53 0 2024-04-12T13:42:03.309 INFO:tasks.workunit.client.0.smithi060.stdout:2/396: chown d6/d56/f2d 4037053 1 2024-04-12T13:42:03.312 INFO:tasks.workunit.client.1.smithi110.stdout:1/379: mknod de/d15/d32/d61/c88 0 2024-04-12T13:42:03.313 INFO:tasks.workunit.client.1.smithi110.stdout:0/352: dread d1/d8/d36/d51/d60/f2b [0,4194304] 0 2024-04-12T13:42:03.315 INFO:tasks.workunit.client.1.smithi110.stdout:4/547: dwrite d0/de/d2c/f2b [0,4194304] 0 2024-04-12T13:42:03.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/376: read d6/d2f/d51/f71 [322525,100861] 0 2024-04-12T13:42:03.317 INFO:tasks.workunit.client.0.smithi060.stdout:9/341: stat d4/d8/d32/l5f 0 2024-04-12T13:42:03.323 INFO:tasks.workunit.client.1.smithi110.stdout:8/422: mkdir d1/d3/d35/d3a/d3e/d64/d85/d8d 0 2024-04-12T13:42:03.326 INFO:tasks.workunit.client.1.smithi110.stdout:6/438: rename d7/d25/d30/d44/f33 to d7/d25/d2c/d4c/d77/f8a 0 2024-04-12T13:42:03.326 INFO:tasks.workunit.client.0.smithi060.stdout:7/330: stat d0/d7/c50 0 2024-04-12T13:42:03.329 INFO:tasks.workunit.client.1.smithi110.stdout:3/422: chown d5/dc/c16 20 1 2024-04-12T13:42:03.329 INFO:tasks.workunit.client.1.smithi110.stdout:7/420: readlink d1/d3/d4/d55/l6c 0 2024-04-12T13:42:03.331 INFO:tasks.workunit.client.0.smithi060.stdout:3/419: dread d7/da/d3f/f78 [0,4194304] 0 2024-04-12T13:42:03.341 INFO:tasks.workunit.client.0.smithi060.stdout:6/488: truncate d1/d7/da/dc/f75 339558 0 2024-04-12T13:42:03.342 INFO:tasks.workunit.client.1.smithi110.stdout:1/380: symlink de/d14/d34/l89 0 2024-04-12T13:42:03.344 INFO:tasks.workunit.client.1.smithi110.stdout:6/439: dread d7/d10/f35 [0,4194304] 0 2024-04-12T13:42:03.345 INFO:tasks.workunit.client.1.smithi110.stdout:4/548: creat d0/d78/fb4 x:0 0 0 2024-04-12T13:42:03.346 INFO:tasks.workunit.client.0.smithi060.stdout:2/397: dwrite d6/d13/f67 [0,4194304] 0 2024-04-12T13:42:03.348 INFO:tasks.workunit.client.0.smithi060.stdout:8/382: symlink d9/d1b/d37/d4d/d63/d66/l83 0 2024-04-12T13:42:03.349 INFO:tasks.workunit.client.1.smithi110.stdout:3/423: dwrite d5/dc/d31/d3b/f6b [0,4194304] 0 2024-04-12T13:42:03.349 INFO:tasks.workunit.client.1.smithi110.stdout:7/421: dwrite d1/d3/d43/f53 [4194304,4194304] 0 2024-04-12T13:42:03.350 INFO:tasks.workunit.client.0.smithi060.stdout:5/450: getdents d6/d10/d12/d38 0 2024-04-12T13:42:03.352 INFO:tasks.workunit.client.0.smithi060.stdout:5/451: fsync f1 0 2024-04-12T13:42:03.352 INFO:tasks.workunit.client.1.smithi110.stdout:8/423: creat d1/d3/d3c/d5a/d6f/d7e/f8e x:0 0 0 2024-04-12T13:42:03.352 INFO:tasks.workunit.client.1.smithi110.stdout:7/422: fsync d1/d3/d4/d55/f62 0 2024-04-12T13:42:03.358 INFO:tasks.workunit.client.0.smithi060.stdout:1/499: dwrite d1e/d23/d49/f54 [4194304,4194304] 0 2024-04-12T13:42:03.363 INFO:tasks.workunit.client.1.smithi110.stdout:2/443: truncate d6/f12 8346157 0 2024-04-12T13:42:03.372 INFO:tasks.workunit.client.0.smithi060.stdout:6/489: write d1/d7/da/dc/d24/f1f [2949706,49167] 0 2024-04-12T13:42:03.374 INFO:tasks.workunit.client.0.smithi060.stdout:4/377: mknod d6/c86 0 2024-04-12T13:42:03.378 INFO:tasks.workunit.client.0.smithi060.stdout:7/331: dread d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:03.379 INFO:tasks.workunit.client.1.smithi110.stdout:5/369: truncate da/d55/f7b 9390569 0 2024-04-12T13:42:03.380 INFO:tasks.workunit.client.0.smithi060.stdout:2/398: fdatasync d6/d56/d43/f65 0 2024-04-12T13:42:03.381 INFO:tasks.workunit.client.1.smithi110.stdout:9/506: creat df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/d89/fa5 x:0 0 0 2024-04-12T13:42:03.381 INFO:tasks.workunit.client.1.smithi110.stdout:4/549: mknod d0/de/d32/d5f/cb5 0 2024-04-12T13:42:03.383 INFO:tasks.workunit.client.1.smithi110.stdout:7/423: rmdir d1/d31/d5d 39 2024-04-12T13:42:03.385 INFO:tasks.workunit.client.1.smithi110.stdout:3/424: dwrite d5/dc/d20/d2d/d4e/f6d [0,4194304] 0 2024-04-12T13:42:03.385 INFO:tasks.workunit.client.0.smithi060.stdout:1/500: creat d1e/d23/d2e/d8e/d98/faf x:0 0 0 2024-04-12T13:42:03.386 INFO:tasks.workunit.client.0.smithi060.stdout:0/387: rmdir d7/d9/d6a 0 2024-04-12T13:42:03.391 INFO:tasks.workunit.client.1.smithi110.stdout:5/370: rmdir da/db/d15 39 2024-04-12T13:42:03.394 INFO:tasks.workunit.client.1.smithi110.stdout:2/444: getdents d6/dc/d1b/d57/d62 0 2024-04-12T13:42:03.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/420: mknod d7/d17/d19/d33/c8f 0 2024-04-12T13:42:03.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/388: truncate d7/d9/d14/d35/d44/d7d/f32 3068377 0 2024-04-12T13:42:03.395 INFO:tasks.workunit.client.0.smithi060.stdout:9/342: creat d4/d8/f6d x:0 0 0 2024-04-12T13:42:03.398 INFO:tasks.workunit.client.0.smithi060.stdout:8/383: dread d9/d1b/d2b/f45 [4194304,4194304] 0 2024-04-12T13:42:03.400 INFO:tasks.workunit.client.1.smithi110.stdout:0/353: getdents d1/d8/d36 0 2024-04-12T13:42:03.400 INFO:tasks.workunit.client.1.smithi110.stdout:7/424: mknod d1/d1b/d3d/c91 0 2024-04-12T13:42:03.401 INFO:tasks.workunit.client.0.smithi060.stdout:8/384: fdatasync d9/f71 0 2024-04-12T13:42:03.402 INFO:tasks.workunit.client.0.smithi060.stdout:9/343: dread d4/d8/f2c [0,4194304] 0 2024-04-12T13:42:03.404 INFO:tasks.workunit.client.1.smithi110.stdout:1/381: dwrite de/d15/d32/d61/f73 [0,4194304] 0 2024-04-12T13:42:03.405 INFO:tasks.workunit.client.1.smithi110.stdout:4/550: rename d0/l99 to d0/de/d2c/d57/lb6 0 2024-04-12T13:42:03.409 INFO:tasks.workunit.client.1.smithi110.stdout:8/424: dread d1/d3/d3c/f33 [0,4194304] 0 2024-04-12T13:42:03.410 INFO:tasks.workunit.client.1.smithi110.stdout:4/551: dread - d0/de/d2c/d57/fa4 zero size 2024-04-12T13:42:03.410 INFO:tasks.workunit.client.1.smithi110.stdout:1/382: chown de/d14/d34/d55/f63 11104 1 2024-04-12T13:42:03.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/399: creat d6/d13/d5b/f78 x:0 0 0 2024-04-12T13:42:03.411 INFO:tasks.workunit.client.1.smithi110.stdout:5/371: write da/f6b [1006281,54608] 0 2024-04-12T13:42:03.415 INFO:tasks.workunit.client.1.smithi110.stdout:2/445: creat d6/dc/d1b/f7f x:0 0 0 2024-04-12T13:42:03.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/389: mkdir d7/d9/d4c/d93 0 2024-04-12T13:42:03.417 INFO:tasks.workunit.client.1.smithi110.stdout:3/425: symlink d5/dc/d31/d3b/l90 0 2024-04-12T13:42:03.419 INFO:tasks.workunit.client.1.smithi110.stdout:2/446: stat d6/dc/dd/f47 0 2024-04-12T13:42:03.419 INFO:tasks.workunit.client.0.smithi060.stdout:8/385: mkdir d9/d1b/d84 0 2024-04-12T13:42:03.421 INFO:tasks.workunit.client.1.smithi110.stdout:9/507: dwrite df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 [0,4194304] 0 2024-04-12T13:42:03.421 INFO:tasks.workunit.client.0.smithi060.stdout:8/386: fdatasync d9/d1b/d37/d48/f62 0 2024-04-12T13:42:03.424 INFO:tasks.workunit.client.0.smithi060.stdout:8/387: stat d9/fc 0 2024-04-12T13:42:03.425 INFO:tasks.workunit.client.1.smithi110.stdout:9/508: readlink df/d13/d2c/d2d/d39/l47 0 2024-04-12T13:42:03.425 INFO:tasks.workunit.client.1.smithi110.stdout:1/383: symlink de/d14/d34/d55/d6b/l8a 0 2024-04-12T13:42:03.429 INFO:tasks.workunit.client.1.smithi110.stdout:5/372: creat da/d2e/d45/d25/d5d/f86 x:0 0 0 2024-04-12T13:42:03.433 INFO:tasks.workunit.client.1.smithi110.stdout:7/425: creat d1/d31/d5d/d71/f92 x:0 0 0 2024-04-12T13:42:03.436 INFO:tasks.workunit.client.0.smithi060.stdout:6/490: dwrite d1/d7/da/dc/d24/d2d/f5a [0,4194304] 0 2024-04-12T13:42:03.437 INFO:tasks.workunit.client.1.smithi110.stdout:7/426: read d1/d3/f11 [594995,82373] 0 2024-04-12T13:42:03.437 INFO:tasks.workunit.client.1.smithi110.stdout:3/426: dwrite d5/dc/f12 [0,4194304] 0 2024-04-12T13:42:03.438 INFO:tasks.workunit.client.1.smithi110.stdout:4/552: creat d0/d75/d91/fb7 x:0 0 0 2024-04-12T13:42:03.442 INFO:tasks.workunit.client.0.smithi060.stdout:9/344: write d4/d9/d19/f34 [568859,65082] 0 2024-04-12T13:42:03.444 INFO:tasks.workunit.client.1.smithi110.stdout:0/354: dread d1/f22 [4194304,4194304] 0 2024-04-12T13:42:03.445 INFO:tasks.workunit.client.1.smithi110.stdout:2/447: read - d6/dc/dd/f47 zero size 2024-04-12T13:42:03.446 INFO:tasks.workunit.client.1.smithi110.stdout:1/384: mkdir de/d15/d32/d61/d6a/d8b 0 2024-04-12T13:42:03.447 INFO:tasks.workunit.client.0.smithi060.stdout:4/378: link d6/d7/dd/df/c24 d6/d2f/d7d/c87 0 2024-04-12T13:42:03.447 INFO:tasks.workunit.client.0.smithi060.stdout:9/345: dread - d4/d8/f4d zero size 2024-04-12T13:42:03.447 INFO:tasks.workunit.client.0.smithi060.stdout:8/388: dread - d9/d1b/d37/d4d/f5a zero size 2024-04-12T13:42:03.448 INFO:tasks.workunit.client.1.smithi110.stdout:0/355: stat d1/d27 0 2024-04-12T13:42:03.449 INFO:tasks.workunit.client.1.smithi110.stdout:7/427: creat d1/d1b/d74/f93 x:0 0 0 2024-04-12T13:42:03.451 INFO:tasks.workunit.client.1.smithi110.stdout:0/356: readlink d1/d27/l45 0 2024-04-12T13:42:03.452 INFO:tasks.workunit.client.1.smithi110.stdout:4/553: symlink d0/d19/d26/lb8 0 2024-04-12T13:42:03.456 INFO:tasks.workunit.client.1.smithi110.stdout:0/357: write d1/d27/d31/f49 [3412352,14503] 0 2024-04-12T13:42:03.457 INFO:tasks.workunit.client.0.smithi060.stdout:1/501: truncate d1e/d29/f44 2659292 0 2024-04-12T13:42:03.459 INFO:tasks.workunit.client.1.smithi110.stdout:4/554: fsync d0/d19/d1c/d50/d6f/fa7 0 2024-04-12T13:42:03.461 INFO:tasks.workunit.client.0.smithi060.stdout:5/452: rename d6/dd/d1f/d32/d46/c5b to d6/dd/d1f/d25/c96 0 2024-04-12T13:42:03.462 INFO:tasks.workunit.client.1.smithi110.stdout:4/555: dread - d0/d19/d1c/fad zero size 2024-04-12T13:42:03.463 INFO:tasks.workunit.client.0.smithi060.stdout:8/389: readlink d9/d1b/d37/l6c 0 2024-04-12T13:42:03.463 INFO:tasks.workunit.client.0.smithi060.stdout:3/421: creat d7/d17/f90 x:0 0 0 2024-04-12T13:42:03.463 INFO:tasks.workunit.client.1.smithi110.stdout:5/373: link da/d2e/d45/d29/f50 da/db/d61/d7a/f87 0 2024-04-12T13:42:03.464 INFO:tasks.workunit.client.0.smithi060.stdout:4/379: readlink d6/d7/dd/d1a/d56/l79 0 2024-04-12T13:42:03.466 INFO:tasks.workunit.client.1.smithi110.stdout:5/374: fsync da/d2e/d45/d29/d66/f70 0 2024-04-12T13:42:03.466 INFO:tasks.workunit.client.1.smithi110.stdout:9/509: dread df/d38/f88 [0,4194304] 0 2024-04-12T13:42:03.466 INFO:tasks.workunit.client.1.smithi110.stdout:9/510: fdatasync fd 0 2024-04-12T13:42:03.469 INFO:tasks.workunit.client.1.smithi110.stdout:1/385: dread de/d15/d32/f52 [0,4194304] 0 2024-04-12T13:42:03.469 INFO:tasks.workunit.client.0.smithi060.stdout:3/422: chown d7/d17/d19/c22 396908 1 2024-04-12T13:42:03.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/380: chown d6/c86 985 1 2024-04-12T13:42:03.470 INFO:tasks.workunit.client.1.smithi110.stdout:1/386: write de/d14/d34/d55/d6b/f7c [68563,5614] 0 2024-04-12T13:42:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:7/332: dwrite d0/f4c [0,4194304] 0 2024-04-12T13:42:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:3/423: read - d7/d17/d19/f74 zero size 2024-04-12T13:42:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:8/390: dread d9/d1d/d2f/f4f [0,4194304] 0 2024-04-12T13:42:03.481 INFO:tasks.workunit.client.1.smithi110.stdout:4/556: dread d0/fc [4194304,4194304] 0 2024-04-12T13:42:03.482 INFO:tasks.workunit.client.1.smithi110.stdout:3/427: dwrite d5/dc/d20/d2d/f51 [0,4194304] 0 2024-04-12T13:42:03.484 INFO:tasks.workunit.client.0.smithi060.stdout:9/346: readlink d4/d9/l23 0 2024-04-12T13:42:03.484 INFO:tasks.workunit.client.0.smithi060.stdout:1/502: mknod d1e/d23/d2e/d8e/d98/cb0 0 2024-04-12T13:42:03.485 INFO:tasks.workunit.client.1.smithi110.stdout:2/448: mkdir d6/dc/d13/d80 0 2024-04-12T13:42:03.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/503: write d1e/d29/d65/fa5 [247313,46724] 0 2024-04-12T13:42:03.492 INFO:tasks.workunit.client.1.smithi110.stdout:5/375: unlink da/db/d3b/d40/f60 0 2024-04-12T13:42:03.492 INFO:tasks.workunit.client.0.smithi060.stdout:6/491: symlink d1/d7/lb1 0 2024-04-12T13:42:03.493 INFO:tasks.workunit.client.1.smithi110.stdout:9/511: mknod df/d13/d3b/d40/d56/ca6 0 2024-04-12T13:42:03.496 INFO:tasks.workunit.client.1.smithi110.stdout:6/440: sync 2024-04-12T13:42:03.496 INFO:tasks.workunit.client.0.smithi060.stdout:0/390: creat d7/d9/d14/d35/f94 x:0 0 0 2024-04-12T13:42:03.497 INFO:tasks.workunit.client.1.smithi110.stdout:6/441: chown l6 24254 1 2024-04-12T13:42:03.497 INFO:tasks.workunit.client.1.smithi110.stdout:7/428: dwrite d1/d3/d4/f35 [0,4194304] 0 2024-04-12T13:42:03.498 INFO:tasks.workunit.client.0.smithi060.stdout:2/400: link d6/d10/d2b/c47 d6/d64/c79 0 2024-04-12T13:42:03.502 INFO:tasks.workunit.client.1.smithi110.stdout:7/429: truncate d1/d3/d4/d55/f62 553633 0 2024-04-12T13:42:03.505 INFO:tasks.workunit.client.1.smithi110.stdout:7/430: write d1/d3/d84/f8d [913622,1957] 0 2024-04-12T13:42:03.506 INFO:tasks.workunit.client.0.smithi060.stdout:4/381: truncate d6/d7/dd/d1a/d56/f5c 755036 0 2024-04-12T13:42:03.506 INFO:tasks.workunit.client.0.smithi060.stdout:8/391: fsync d9/d1b/d37/f6a 0 2024-04-12T13:42:03.514 INFO:tasks.workunit.client.0.smithi060.stdout:1/504: write d1e/d23/d2e/d30/d51/f81 [8185802,8807] 0 2024-04-12T13:42:03.514 INFO:tasks.workunit.client.0.smithi060.stdout:5/453: mknod d6/d10/d12/d4c/d7c/c97 0 2024-04-12T13:42:03.522 INFO:tasks.workunit.client.1.smithi110.stdout:8/425: sync 2024-04-12T13:42:03.524 INFO:tasks.workunit.client.1.smithi110.stdout:1/387: mknod de/d14/d34/d87/c8c 0 2024-04-12T13:42:03.526 INFO:tasks.workunit.client.0.smithi060.stdout:0/391: read d7/d9/d14/d35/d44/f77 [177137,88299] 0 2024-04-12T13:42:03.526 INFO:tasks.workunit.client.1.smithi110.stdout:1/388: write de/d14/d34/d55/f63 [3294709,77496] 0 2024-04-12T13:42:03.528 INFO:tasks.workunit.client.1.smithi110.stdout:2/449: dread d6/dc/dd/d49/d64/f2c [0,4194304] 0 2024-04-12T13:42:03.528 INFO:tasks.workunit.client.1.smithi110.stdout:1/389: fsync de/d14/d34/f7f 0 2024-04-12T13:42:03.530 INFO:tasks.workunit.client.1.smithi110.stdout:0/358: truncate d1/f26 449783 0 2024-04-12T13:42:03.530 INFO:tasks.workunit.client.1.smithi110.stdout:1/390: chown de/d14/d34 5198733 1 2024-04-12T13:42:03.532 INFO:tasks.workunit.client.1.smithi110.stdout:1/391: dread - de/d14/f78 zero size 2024-04-12T13:42:03.532 INFO:tasks.workunit.client.0.smithi060.stdout:9/347: mknod d4/d33/d65/c6e 0 2024-04-12T13:42:03.535 INFO:tasks.workunit.client.0.smithi060.stdout:7/333: dwrite d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:03.538 INFO:tasks.workunit.client.0.smithi060.stdout:8/392: creat d9/d1b/d37/d4d/d63/f85 x:0 0 0 2024-04-12T13:42:03.541 INFO:tasks.workunit.client.1.smithi110.stdout:6/442: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:42:03.545 INFO:tasks.workunit.client.0.smithi060.stdout:5/454: creat d6/dd/d1f/f98 x:0 0 0 2024-04-12T13:42:03.548 INFO:tasks.workunit.client.1.smithi110.stdout:5/376: dwrite da/d35/f41 [0,4194304] 0 2024-04-12T13:42:03.549 INFO:tasks.workunit.client.0.smithi060.stdout:6/492: mkdir d1/d7/da/dc/d24/d2d/db0/db2 0 2024-04-12T13:42:03.550 INFO:tasks.workunit.client.1.smithi110.stdout:8/426: mkdir d1/d5/d1f/d8f 0 2024-04-12T13:42:03.552 INFO:tasks.workunit.client.0.smithi060.stdout:6/493: dread - d1/fa0 zero size 2024-04-12T13:42:03.552 INFO:tasks.workunit.client.1.smithi110.stdout:8/427: chown d1/d3/d3c/c50 1156603 1 2024-04-12T13:42:03.553 INFO:tasks.workunit.client.0.smithi060.stdout:2/401: mknod d6/d56/c7a 0 2024-04-12T13:42:03.559 INFO:tasks.workunit.client.1.smithi110.stdout:2/450: rename d6/f76 to d6/dc/dd/f81 0 2024-04-12T13:42:03.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/392: dwrite d7/d33/d5b/f90 [0,4194304] 0 2024-04-12T13:42:03.560 INFO:tasks.workunit.client.1.smithi110.stdout:7/431: dwrite d1/d31/d5d/d71/f80 [0,4194304] 0 2024-04-12T13:42:03.562 INFO:tasks.workunit.client.0.smithi060.stdout:7/334: dwrite d0/f71 [0,4194304] 0 2024-04-12T13:42:03.564 INFO:tasks.workunit.client.0.smithi060.stdout:7/335: read d0/f3a [3586857,104374] 0 2024-04-12T13:42:03.565 INFO:tasks.workunit.client.0.smithi060.stdout:0/393: read d7/d9/f31 [345477,99013] 0 2024-04-12T13:42:03.582 INFO:tasks.workunit.client.1.smithi110.stdout:1/392: mknod de/d15/d32/d61/d6a/d72/c8d 0 2024-04-12T13:42:03.582 INFO:tasks.workunit.client.0.smithi060.stdout:4/382: fdatasync d6/d7/dd/df/f18 0 2024-04-12T13:42:03.585 INFO:tasks.workunit.client.0.smithi060.stdout:4/383: readlink d6/d7/dd/df/l3f 0 2024-04-12T13:42:03.587 INFO:tasks.workunit.client.1.smithi110.stdout:0/359: dwrite d1/f22 [8388608,4194304] 0 2024-04-12T13:42:03.589 INFO:tasks.workunit.client.1.smithi110.stdout:3/428: rmdir d5/dc/d31/d74/d8e 0 2024-04-12T13:42:03.590 INFO:tasks.workunit.client.0.smithi060.stdout:7/336: dwrite d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:03.590 INFO:tasks.workunit.client.1.smithi110.stdout:0/360: write d1/d8/d36/d63/d4a/f4f [362838,7615] 0 2024-04-12T13:42:03.592 INFO:tasks.workunit.client.1.smithi110.stdout:0/361: dread - d1/d8/d36/d65/f6c zero size 2024-04-12T13:42:03.592 INFO:tasks.workunit.client.1.smithi110.stdout:3/429: truncate d5/dc/d20/f2a 4924911 0 2024-04-12T13:42:03.592 INFO:tasks.workunit.client.0.smithi060.stdout:8/393: creat d9/d1b/d3c/d6e/f86 x:0 0 0 2024-04-12T13:42:03.594 INFO:tasks.workunit.client.1.smithi110.stdout:3/430: fdatasync d5/dc/d31/d3b/d32/d3e/f44 0 2024-04-12T13:42:03.601 INFO:tasks.workunit.client.0.smithi060.stdout:3/424: getdents d7/da/d3f/d5c/d25 0 2024-04-12T13:42:03.601 INFO:tasks.workunit.client.1.smithi110.stdout:6/443: read d7/f39 [5993943,38098] 0 2024-04-12T13:42:03.606 INFO:tasks.workunit.client.1.smithi110.stdout:5/377: mkdir da/db/d61/d79/d88 0 2024-04-12T13:42:03.611 INFO:tasks.workunit.client.0.smithi060.stdout:6/494: mkdir d1/d7/da/dc/d24/d2d/db3 0 2024-04-12T13:42:03.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/425: dread d7/d17/f72 [0,4194304] 0 2024-04-12T13:42:03.613 INFO:tasks.workunit.client.0.smithi060.stdout:2/402: mknod d6/d10/d2b/d60/c7b 0 2024-04-12T13:42:03.614 INFO:tasks.workunit.client.1.smithi110.stdout:8/428: fdatasync d1/d3/f13 0 2024-04-12T13:42:03.618 INFO:tasks.workunit.client.1.smithi110.stdout:6/444: dwrite d7/d25/d2c/f3c [4194304,4194304] 0 2024-04-12T13:42:03.622 INFO:tasks.workunit.client.1.smithi110.stdout:8/429: dread d1/d3/d3c/d5a/f82 [0,4194304] 0 2024-04-12T13:42:03.627 INFO:tasks.workunit.client.1.smithi110.stdout:8/430: truncate d1/d3/d3c/d5a/d6f/d7e/f63 159175 0 2024-04-12T13:42:03.629 INFO:tasks.workunit.client.1.smithi110.stdout:8/431: write d1/d3/f24 [2363129,58063] 0 2024-04-12T13:42:03.630 INFO:tasks.workunit.client.1.smithi110.stdout:2/451: fsync d6/dc/dd/f1f 0 2024-04-12T13:42:03.633 INFO:tasks.workunit.client.0.smithi060.stdout:0/394: rename d7/d33/d5b/f72 to d7/d9/d14/d35/d44/d49/d74/f95 0 2024-04-12T13:42:03.633 INFO:tasks.workunit.client.1.smithi110.stdout:2/452: chown d6/dc/dd/l3a 2629 1 2024-04-12T13:42:03.639 INFO:tasks.workunit.client.1.smithi110.stdout:0/362: dread f0 [0,4194304] 0 2024-04-12T13:42:03.639 INFO:tasks.workunit.client.1.smithi110.stdout:4/557: getdents d0/d75/d84 0 2024-04-12T13:42:03.641 INFO:tasks.workunit.client.1.smithi110.stdout:4/558: chown d0/de/d32/d5f/c4e 109612999 1 2024-04-12T13:42:03.641 INFO:tasks.workunit.client.1.smithi110.stdout:4/559: readlink d0/d19/l51 0 2024-04-12T13:42:03.655 INFO:tasks.workunit.client.0.smithi060.stdout:0/395: dwrite d7/d9/de/f91 [0,4194304] 0 2024-04-12T13:42:03.656 INFO:tasks.workunit.client.1.smithi110.stdout:3/431: mknod d5/dc/d31/d3b/d32/d3e/c91 0 2024-04-12T13:42:03.658 INFO:tasks.workunit.client.0.smithi060.stdout:3/426: fsync d7/f8 0 2024-04-12T13:42:03.664 INFO:tasks.workunit.client.0.smithi060.stdout:2/403: fdatasync d6/d13/d31/f42 0 2024-04-12T13:42:03.666 INFO:tasks.workunit.client.1.smithi110.stdout:9/512: link df/d13/d26/f41 df/d13/d26/d37/d49/fa7 0 2024-04-12T13:42:03.666 INFO:tasks.workunit.client.0.smithi060.stdout:3/427: write d7/d17/d19/d33/f86 [901989,130454] 0 2024-04-12T13:42:03.669 INFO:tasks.workunit.client.0.smithi060.stdout:5/455: dwrite d6/d10/d12/f36 [0,4194304] 0 2024-04-12T13:42:03.673 INFO:tasks.workunit.client.1.smithi110.stdout:6/445: creat d7/d25/d2c/d4c/f8b x:0 0 0 2024-04-12T13:42:03.674 INFO:tasks.workunit.client.0.smithi060.stdout:5/456: chown d6/dd/d1f/d32/d46/f93 2 1 2024-04-12T13:42:03.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/348: link d4/d8/fb d4/f6f 0 2024-04-12T13:42:03.675 INFO:tasks.workunit.client.0.smithi060.stdout:6/495: write d1/d7/da/dc/d24/d30/d52/fa4 [624777,53000] 0 2024-04-12T13:42:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:9/349: stat d4/c6 0 2024-04-12T13:42:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:8/394: dwrite d9/da/f24 [4194304,4194304] 0 2024-04-12T13:42:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:5/457: chown d6/dd/d1f/d25/d53/d87/f3a 818 1 2024-04-12T13:42:03.679 INFO:tasks.workunit.client.1.smithi110.stdout:8/432: mknod d1/d3/d3c/d5a/d6f/c90 0 2024-04-12T13:42:03.679 INFO:tasks.workunit.client.1.smithi110.stdout:7/432: mkdir d1/d1b/d94 0 2024-04-12T13:42:03.679 INFO:tasks.workunit.client.0.smithi060.stdout:5/458: stat d6/dd/f45 0 2024-04-12T13:42:03.681 INFO:tasks.workunit.client.1.smithi110.stdout:7/433: stat d1/d3/d4/d36/d4b/c42 0 2024-04-12T13:42:03.681 INFO:tasks.workunit.client.1.smithi110.stdout:2/453: mkdir d6/dc/dd/d49/d64/d4a/d55/d82 0 2024-04-12T13:42:03.682 INFO:tasks.workunit.client.0.smithi060.stdout:8/395: chown d9/d1b/d3c/d6e/f86 0 1 2024-04-12T13:42:03.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/384: mkdir d6/d21/d88 0 2024-04-12T13:42:03.683 INFO:tasks.workunit.client.1.smithi110.stdout:5/378: dread da/d35/f4e [0,4194304] 0 2024-04-12T13:42:03.684 INFO:tasks.workunit.client.1.smithi110.stdout:1/393: link de/d15/d32/f44 de/d15/d32/d61/d6a/d8b/f8e 0 2024-04-12T13:42:03.688 INFO:tasks.workunit.client.1.smithi110.stdout:1/394: write de/d14/d34/d55/f5c [1868004,110481] 0 2024-04-12T13:42:03.693 INFO:tasks.workunit.client.1.smithi110.stdout:3/432: symlink d5/dc/d20/d2d/d4e/l92 0 2024-04-12T13:42:03.696 INFO:tasks.workunit.client.0.smithi060.stdout:0/396: chown d7/d9/l13 868384 1 2024-04-12T13:42:03.697 INFO:tasks.workunit.client.1.smithi110.stdout:6/446: dread d7/d10/f62 [0,4194304] 0 2024-04-12T13:42:03.697 INFO:tasks.workunit.client.1.smithi110.stdout:0/363: mknod d1/d3c/d6b/c75 0 2024-04-12T13:42:03.698 INFO:tasks.workunit.client.0.smithi060.stdout:0/397: chown d7/d9/d14/f24 0 1 2024-04-12T13:42:03.699 INFO:tasks.workunit.client.1.smithi110.stdout:5/379: mkdir da/d35/d71/d89 0 2024-04-12T13:42:03.703 INFO:tasks.workunit.client.1.smithi110.stdout:2/454: mknod d6/dc/d1b/d57/c83 0 2024-04-12T13:42:03.710 INFO:tasks.workunit.client.1.smithi110.stdout:9/513: dread df/d38/d6e/d7f/f8b [4194304,4194304] 0 2024-04-12T13:42:03.712 INFO:tasks.workunit.client.1.smithi110.stdout:3/433: creat d5/d86/f93 x:0 0 0 2024-04-12T13:42:03.712 INFO:tasks.workunit.client.0.smithi060.stdout:4/385: rmdir d6/d7/dd/d1a 39 2024-04-12T13:42:03.712 INFO:tasks.workunit.client.0.smithi060.stdout:4/386: chown d6 1760424 1 2024-04-12T13:42:03.713 INFO:tasks.workunit.client.1.smithi110.stdout:6/447: dwrite d7/d10/d1c/d2b/d3a/f81 [0,4194304] 0 2024-04-12T13:42:03.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/350: rename d4/d33/d50/d5c/d67/c55 to d4/d8/d32/c70 0 2024-04-12T13:42:03.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/351: fdatasync d4/d8/f40 0 2024-04-12T13:42:03.721 INFO:tasks.workunit.client.0.smithi060.stdout:3/428: mkdir d7/d17/d19/d33/d63/d6d/d91 0 2024-04-12T13:42:03.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/429: write d7/da/d3f/d5c/d25/d4d/f6e [360884,8202] 0 2024-04-12T13:42:03.725 INFO:tasks.workunit.client.1.smithi110.stdout:4/560: dwrite d0/d13/f2a [0,4194304] 0 2024-04-12T13:42:03.726 INFO:tasks.workunit.client.0.smithi060.stdout:3/430: dread - d7/d17/f90 zero size 2024-04-12T13:42:03.726 INFO:tasks.workunit.client.0.smithi060.stdout:6/496: creat d1/d7/da/dc/d24/d2d/db0/db2/fb4 x:0 0 0 2024-04-12T13:42:03.727 INFO:tasks.workunit.client.1.smithi110.stdout:9/514: creat df/d13/d26/d37/d49/fa8 x:0 0 0 2024-04-12T13:42:03.731 INFO:tasks.workunit.client.1.smithi110.stdout:8/433: rmdir d1/d3/d3c/d5a/d60 0 2024-04-12T13:42:03.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/404: rename d6/d10/f44 to d6/d10/d4b/f7c 0 2024-04-12T13:42:03.735 INFO:tasks.workunit.client.0.smithi060.stdout:3/431: dread d7/d17/d27/d36/f3c [0,4194304] 0 2024-04-12T13:42:03.736 INFO:tasks.workunit.client.0.smithi060.stdout:3/432: readlink d7/d17/l37 0 2024-04-12T13:42:03.737 INFO:tasks.workunit.client.0.smithi060.stdout:7/337: getdents d0/d1b 0 2024-04-12T13:42:03.737 INFO:tasks.workunit.client.0.smithi060.stdout:2/405: readlink d6/d13/d31/d33/l3f 0 2024-04-12T13:42:03.740 INFO:tasks.workunit.client.1.smithi110.stdout:6/448: rename l3 to d7/d10/d1c/d7f/l8c 0 2024-04-12T13:42:03.741 INFO:tasks.workunit.client.1.smithi110.stdout:0/364: symlink d1/d48/l76 0 2024-04-12T13:42:03.743 INFO:tasks.workunit.client.0.smithi060.stdout:5/459: creat d6/f99 x:0 0 0 2024-04-12T13:42:03.744 INFO:tasks.workunit.client.1.smithi110.stdout:0/365: stat d1/d8/d36/d63/d4a/f4f 0 2024-04-12T13:42:03.744 INFO:tasks.workunit.client.1.smithi110.stdout:5/380: mkdir da/d2e/d45/d29/d66/d7c/d8a 0 2024-04-12T13:42:03.746 INFO:tasks.workunit.client.1.smithi110.stdout:2/455: mkdir d6/dc/dd/d49/d64/d4a/d55/d82/d84 0 2024-04-12T13:42:03.748 INFO:tasks.workunit.client.0.smithi060.stdout:4/387: stat d6/d7/dd/d1a/d19/f5e 0 2024-04-12T13:42:03.749 INFO:tasks.workunit.client.0.smithi060.stdout:6/497: creat d1/d7/da/dc/d24/d30/d52/d78/d80/fb5 x:0 0 0 2024-04-12T13:42:03.751 INFO:tasks.workunit.client.1.smithi110.stdout:4/561: rename d0/de/d32/d5f/d71 to d0/d19/d1c/d50/d6f/db9 0 2024-04-12T13:42:03.757 INFO:tasks.workunit.client.1.smithi110.stdout:6/449: symlink d7/d10/d1c/d2b/d48/d54/l8d 0 2024-04-12T13:42:03.757 INFO:tasks.workunit.client.1.smithi110.stdout:9/515: dread df/d13/f1b [0,4194304] 0 2024-04-12T13:42:03.759 INFO:tasks.workunit.client.1.smithi110.stdout:2/456: dread d6/dc/dd/d49/d64/f2c [0,4194304] 0 2024-04-12T13:42:03.763 INFO:tasks.workunit.client.0.smithi060.stdout:2/406: dread d6/f14 [4194304,4194304] 0 2024-04-12T13:42:03.764 INFO:tasks.workunit.client.1.smithi110.stdout:8/434: rename d1/d3/d3c/f2f to d1/d3/d35/d3a/d3e/d64/d85/d8d/f91 0 2024-04-12T13:42:03.766 INFO:tasks.workunit.client.0.smithi060.stdout:4/388: creat d6/d2f/d51/f89 x:0 0 0 2024-04-12T13:42:03.767 INFO:tasks.workunit.client.1.smithi110.stdout:2/457: dread d6/f8 [0,4194304] 0 2024-04-12T13:42:03.767 INFO:tasks.workunit.client.1.smithi110.stdout:4/562: dwrite d0/de/d32/f7d [0,4194304] 0 2024-04-12T13:42:03.767 INFO:tasks.workunit.client.1.smithi110.stdout:6/450: creat d7/d10/d1c/d4d/f8e x:0 0 0 2024-04-12T13:42:03.769 INFO:tasks.workunit.client.0.smithi060.stdout:7/338: dread d0/d1b/f1d [0,4194304] 0 2024-04-12T13:42:03.770 INFO:tasks.workunit.client.0.smithi060.stdout:6/498: unlink d1/d7/ce 0 2024-04-12T13:42:03.771 INFO:tasks.workunit.client.1.smithi110.stdout:0/366: truncate d1/f2f 4313203 0 2024-04-12T13:42:03.771 INFO:tasks.workunit.client.0.smithi060.stdout:9/352: dread d4/d33/d50/d5c/d67/f2b [0,4194304] 0 2024-04-12T13:42:03.773 INFO:tasks.workunit.client.1.smithi110.stdout:0/367: stat d1/d27/d31/f50 0 2024-04-12T13:42:03.774 INFO:tasks.workunit.client.0.smithi060.stdout:9/353: write d4/d9/d19/f34 [794317,99912] 0 2024-04-12T13:42:03.774 INFO:tasks.workunit.client.1.smithi110.stdout:5/381: creat da/d5c/f8b x:0 0 0 2024-04-12T13:42:03.775 INFO:tasks.workunit.client.1.smithi110.stdout:5/382: stat da/db/d3b/d40 0 2024-04-12T13:42:03.777 INFO:tasks.workunit.client.1.smithi110.stdout:9/516: dread - df/d13/d2c/d2d/d94/fa1 zero size 2024-04-12T13:42:03.779 INFO:tasks.workunit.client.1.smithi110.stdout:3/434: getdents d5/dc/d31/d3b/d32/d3e 0 2024-04-12T13:42:03.779 INFO:tasks.workunit.client.1.smithi110.stdout:1/395: sync 2024-04-12T13:42:03.780 INFO:tasks.workunit.client.1.smithi110.stdout:7/434: sync 2024-04-12T13:42:03.781 INFO:tasks.workunit.client.0.smithi060.stdout:7/339: fsync d0/f21 0 2024-04-12T13:42:03.784 INFO:tasks.workunit.client.1.smithi110.stdout:3/435: dread d5/f40 [0,4194304] 0 2024-04-12T13:42:03.785 INFO:tasks.workunit.client.0.smithi060.stdout:7/340: chown d0/d7/d43/d63/c69 32408115 1 2024-04-12T13:42:03.787 INFO:tasks.workunit.client.0.smithi060.stdout:3/433: rename d7/da/l2e to d7/da/l92 0 2024-04-12T13:42:03.788 INFO:tasks.workunit.client.0.smithi060.stdout:7/341: read - d0/d7/d43/d63/f67 zero size 2024-04-12T13:42:03.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/434: truncate d7/da/f84 5111902 0 2024-04-12T13:42:03.791 INFO:tasks.workunit.client.1.smithi110.stdout:6/451: symlink d7/d10/d7e/l8f 0 2024-04-12T13:42:03.795 INFO:tasks.workunit.client.0.smithi060.stdout:3/435: read d7/da/d3f/d5c/d25/f7b [1302917,69893] 0 2024-04-12T13:42:03.804 INFO:tasks.workunit.client.0.smithi060.stdout:0/398: rename d7/d9/d14/d35/d3c/l69 to d7/d9/l96 0 2024-04-12T13:42:03.804 INFO:tasks.workunit.client.0.smithi060.stdout:7/342: dwrite d0/f4c [0,4194304] 0 2024-04-12T13:42:03.804 INFO:tasks.workunit.client.0.smithi060.stdout:2/407: rename d6/d10 to d6/d10/d4b/d7d 22 2024-04-12T13:42:03.806 INFO:tasks.workunit.client.0.smithi060.stdout:7/343: write d0/d7/f10 [2839574,34010] 0 2024-04-12T13:42:03.807 INFO:tasks.workunit.client.0.smithi060.stdout:2/408: write d6/d13/d5b/f78 [229505,51948] 0 2024-04-12T13:42:03.811 INFO:tasks.workunit.client.0.smithi060.stdout:2/409: dread - d6/d13/d17/f5c zero size 2024-04-12T13:42:03.817 INFO:tasks.workunit.client.0.smithi060.stdout:6/499: dwrite d1/d2c/f70 [0,4194304] 0 2024-04-12T13:42:03.817 INFO:tasks.workunit.client.0.smithi060.stdout:9/354: mknod d4/d9/c71 0 2024-04-12T13:42:03.817 INFO:tasks.workunit.client.1.smithi110.stdout:1/396: chown de/d1d/c46 167 1 2024-04-12T13:42:03.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/460: getdents d6/dd/d1f 0 2024-04-12T13:42:03.820 INFO:tasks.workunit.client.1.smithi110.stdout:3/436: unlink d5/dc/d31/d3b/d32/d3e/l54 0 2024-04-12T13:42:03.820 INFO:tasks.workunit.client.0.smithi060.stdout:5/461: stat d6/d10/d12/d38/f40 0 2024-04-12T13:42:03.821 INFO:tasks.workunit.client.0.smithi060.stdout:4/389: rmdir d6/d2f/d82 0 2024-04-12T13:42:03.824 INFO:tasks.workunit.client.1.smithi110.stdout:6/452: write d7/d10/d41/f65 [1490834,65421] 0 2024-04-12T13:42:03.825 INFO:tasks.workunit.client.0.smithi060.stdout:5/462: write d6/f17 [2093762,56761] 0 2024-04-12T13:42:03.828 INFO:tasks.workunit.client.1.smithi110.stdout:4/563: creat d0/d75/d84/d89/fba x:0 0 0 2024-04-12T13:42:03.831 INFO:tasks.workunit.client.1.smithi110.stdout:0/368: symlink d1/d27/d6e/l77 0 2024-04-12T13:42:03.832 INFO:tasks.workunit.client.0.smithi060.stdout:2/410: rmdir d6/d56 39 2024-04-12T13:42:03.833 INFO:tasks.workunit.client.1.smithi110.stdout:0/369: chown d1/d8/d36/d51/d60/f74 1070613 1 2024-04-12T13:42:03.836 INFO:tasks.workunit.client.1.smithi110.stdout:0/370: chown d1/d8/d36/d63/d4a/f72 290 1 2024-04-12T13:42:03.837 INFO:tasks.workunit.client.0.smithi060.stdout:6/500: dwrite d1/f6b [0,4194304] 0 2024-04-12T13:42:03.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/390: creat d6/d7/dd/d4d/d69/f8a x:0 0 0 2024-04-12T13:42:03.846 INFO:tasks.workunit.client.0.smithi060.stdout:7/344: write d0/fe [5781016,89648] 0 2024-04-12T13:42:03.849 INFO:tasks.workunit.client.0.smithi060.stdout:2/411: chown d6/d56/d55 0 1 2024-04-12T13:42:03.850 INFO:tasks.workunit.client.0.smithi060.stdout:3/436: rename d7/da/d3f/d5c/d25/d4d/l81 to d7/d17/d19/l93 0 2024-04-12T13:42:03.852 INFO:tasks.workunit.client.0.smithi060.stdout:5/463: symlink d6/dd/l9a 0 2024-04-12T13:42:03.853 INFO:tasks.workunit.client.0.smithi060.stdout:0/399: dwrite d7/d9/d14/d4a/f4f [0,4194304] 0 2024-04-12T13:42:03.860 INFO:tasks.workunit.client.1.smithi110.stdout:9/517: truncate df/f1e 3885547 0 2024-04-12T13:42:03.861 INFO:tasks.workunit.client.0.smithi060.stdout:6/501: truncate d1/d7/da/dc/f3b 45702 0 2024-04-12T13:42:03.862 INFO:tasks.workunit.client.1.smithi110.stdout:9/518: chown df/d13/d3b/d40/l69 0 1 2024-04-12T13:42:03.863 INFO:tasks.workunit.client.0.smithi060.stdout:9/355: rename d4/d9/d19/d21/c26 to d4/d33/d50/c72 0 2024-04-12T13:42:03.865 INFO:tasks.workunit.client.0.smithi060.stdout:9/356: read d4/d8/f2c [217753,118350] 0 2024-04-12T13:42:03.865 INFO:tasks.workunit.client.0.smithi060.stdout:3/437: creat d7/d17/d27/d36/d53/f94 x:0 0 0 2024-04-12T13:42:03.867 INFO:tasks.workunit.client.1.smithi110.stdout:7/435: link d1/d3/f6d d1/d1b/d94/f95 0 2024-04-12T13:42:03.869 INFO:tasks.workunit.client.0.smithi060.stdout:2/412: symlink d6/d56/l7e 0 2024-04-12T13:42:03.870 INFO:tasks.workunit.client.1.smithi110.stdout:1/397: mknod de/d14/d34/c8f 0 2024-04-12T13:42:03.872 INFO:tasks.workunit.client.1.smithi110.stdout:1/398: chown de/d15/c17 117858 1 2024-04-12T13:42:03.874 INFO:tasks.workunit.client.1.smithi110.stdout:1/399: write de/f4d [1838809,117858] 0 2024-04-12T13:42:03.878 INFO:tasks.workunit.client.0.smithi060.stdout:4/391: write d6/d21/f2a [3140461,61549] 0 2024-04-12T13:42:03.880 INFO:tasks.workunit.client.1.smithi110.stdout:4/564: fdatasync d0/d19/d1c/f8b 0 2024-04-12T13:42:03.882 INFO:tasks.workunit.client.0.smithi060.stdout:5/464: truncate d6/dd/d1f/d25/d35/f72 68493 0 2024-04-12T13:42:03.882 INFO:tasks.workunit.client.1.smithi110.stdout:0/371: creat d1/d8/d36/d63/d4a/f78 x:0 0 0 2024-04-12T13:42:03.883 INFO:tasks.workunit.client.0.smithi060.stdout:3/438: truncate d7/f8 9045325 0 2024-04-12T13:42:03.884 INFO:tasks.workunit.client.0.smithi060.stdout:7/345: write d0/f21 [4561348,94643] 0 2024-04-12T13:42:03.884 INFO:tasks.workunit.client.1.smithi110.stdout:0/372: write d1/d8/d36/f44 [47543,24078] 0 2024-04-12T13:42:03.887 INFO:tasks.workunit.client.0.smithi060.stdout:9/357: rename d4/d33/d50/d5c to d4/d9/d19/d21/d73 0 2024-04-12T13:42:03.887 INFO:tasks.workunit.client.1.smithi110.stdout:5/383: write da/d55/f7b [3631368,15562] 0 2024-04-12T13:42:03.888 INFO:tasks.workunit.client.0.smithi060.stdout:9/358: chown d4/d9/d19/d21/d73 3860080 1 2024-04-12T13:42:03.890 INFO:tasks.workunit.client.0.smithi060.stdout:3/439: fsync d7/da/d3f/d5c/d25/d4d/f75 0 2024-04-12T13:42:03.892 INFO:tasks.workunit.client.1.smithi110.stdout:8/435: getdents d1/d3/d3c/d5a/d6f/d83 0 2024-04-12T13:42:03.894 INFO:tasks.workunit.client.0.smithi060.stdout:2/413: creat d6/d13/d31/d33/d3d/f7f x:0 0 0 2024-04-12T13:42:03.894 INFO:tasks.workunit.client.1.smithi110.stdout:1/400: dwrite de/d15/d32/d5e/d79/f7a [0,4194304] 0 2024-04-12T13:42:03.900 INFO:tasks.workunit.client.1.smithi110.stdout:2/458: getdents d6/dc/d13 0 2024-04-12T13:42:03.903 INFO:tasks.workunit.client.0.smithi060.stdout:4/392: mknod d6/d7/db/d85/c8b 0 2024-04-12T13:42:03.904 INFO:tasks.workunit.client.0.smithi060.stdout:0/400: write d7/d9/f1a [273518,113996] 0 2024-04-12T13:42:03.908 INFO:tasks.workunit.client.0.smithi060.stdout:0/401: chown d7/d9/d14/d35 90106287 1 2024-04-12T13:42:03.911 INFO:tasks.workunit.client.0.smithi060.stdout:0/402: dread - d7/d9/d14/f6f zero size 2024-04-12T13:42:03.911 INFO:tasks.workunit.client.1.smithi110.stdout:3/437: dwrite d5/dc/d31/d3b/d32/f65 [0,4194304] 0 2024-04-12T13:42:03.912 INFO:tasks.workunit.client.0.smithi060.stdout:7/346: chown d0/c29 2 1 2024-04-12T13:42:03.915 INFO:tasks.workunit.client.0.smithi060.stdout:0/403: read d7/f11 [1265687,84265] 0 2024-04-12T13:42:03.916 INFO:tasks.workunit.client.0.smithi060.stdout:2/414: dwrite d6/d13/d31/f41 [0,4194304] 0 2024-04-12T13:42:03.918 INFO:tasks.workunit.client.0.smithi060.stdout:9/359: creat d4/d33/d50/f74 x:0 0 0 2024-04-12T13:42:03.920 INFO:tasks.workunit.client.0.smithi060.stdout:2/415: chown d6/d56/d58/c76 2958 1 2024-04-12T13:42:03.930 INFO:tasks.workunit.client.0.smithi060.stdout:3/440: creat d7/da/d3f/d5c/d25/d4d/f95 x:0 0 0 2024-04-12T13:42:03.936 INFO:tasks.workunit.client.1.smithi110.stdout:6/453: truncate d7/d25/d30/d44/f21 3693088 0 2024-04-12T13:42:03.939 INFO:tasks.workunit.client.1.smithi110.stdout:4/565: mknod d0/d19/d8f/cbb 0 2024-04-12T13:42:03.940 INFO:tasks.workunit.client.0.smithi060.stdout:6/502: creat d1/fb6 x:0 0 0 2024-04-12T13:42:03.940 INFO:tasks.workunit.client.1.smithi110.stdout:4/566: fdatasync d0/d19/f2e 0 2024-04-12T13:42:03.941 INFO:tasks.workunit.client.1.smithi110.stdout:4/567: read - d0/d75/d84/f90 zero size 2024-04-12T13:42:03.942 INFO:tasks.workunit.client.0.smithi060.stdout:6/503: fdatasync d1/d7/da/dc/f7c 0 2024-04-12T13:42:03.942 INFO:tasks.workunit.client.1.smithi110.stdout:4/568: chown d0/d19/f5c 397064 1 2024-04-12T13:42:03.943 INFO:tasks.workunit.client.1.smithi110.stdout:0/373: symlink d1/d8/d36/d63/d4a/l79 0 2024-04-12T13:42:03.946 INFO:tasks.workunit.client.0.smithi060.stdout:5/465: truncate d6/d10/f68 1555688 0 2024-04-12T13:42:03.946 INFO:tasks.workunit.client.1.smithi110.stdout:9/519: symlink df/d13/d2c/d9e/la9 0 2024-04-12T13:42:03.950 INFO:tasks.workunit.client.1.smithi110.stdout:1/401: chown c7 10207 1 2024-04-12T13:42:03.951 INFO:tasks.workunit.client.0.smithi060.stdout:2/416: readlink d6/d13/d31/l71 0 2024-04-12T13:42:03.955 INFO:tasks.workunit.client.0.smithi060.stdout:0/404: dread d7/d9/d14/d35/d44/d49/d74/f95 [0,4194304] 0 2024-04-12T13:42:03.955 INFO:tasks.workunit.client.1.smithi110.stdout:3/438: symlink d5/dc/d20/d2d/l94 0 2024-04-12T13:42:03.958 INFO:tasks.workunit.client.1.smithi110.stdout:6/454: mknod d7/d10/d41/c90 0 2024-04-12T13:42:03.960 INFO:tasks.workunit.client.1.smithi110.stdout:0/374: fdatasync d1/f6a 0 2024-04-12T13:42:03.962 INFO:tasks.workunit.client.0.smithi060.stdout:2/417: dread d6/f8 [0,4194304] 0 2024-04-12T13:42:03.965 INFO:tasks.workunit.client.0.smithi060.stdout:3/441: mkdir d7/d17/d19/d96 0 2024-04-12T13:42:03.970 INFO:tasks.workunit.client.0.smithi060.stdout:4/393: rename d6/d21/d29/f45 to d6/d7/f8c 0 2024-04-12T13:42:03.972 INFO:tasks.workunit.client.0.smithi060.stdout:7/347: link d0/d7/d43/d63/c69 d0/d7/d43/d4d/c7a 0 2024-04-12T13:42:03.974 INFO:tasks.workunit.client.1.smithi110.stdout:2/459: write d6/f48 [967762,14454] 0 2024-04-12T13:42:03.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/442: fsync d7/d17/d27/d36/f46 0 2024-04-12T13:42:03.978 INFO:tasks.workunit.client.1.smithi110.stdout:3/439: fdatasync d5/dc/d31/d3b/f4a 0 2024-04-12T13:42:03.980 INFO:tasks.workunit.client.1.smithi110.stdout:2/460: readlink d6/dc/dd/d49/d64/d4a/d3c/d6e/l79 0 2024-04-12T13:42:03.981 INFO:tasks.workunit.client.1.smithi110.stdout:0/375: mknod d1/d48/c7a 0 2024-04-12T13:42:03.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/504: rename d1/d7/da/dc/d24/f1f to d1/d7/da/dc/d24/d34/d51/d97/da9/fb7 0 2024-04-12T13:42:03.985 INFO:tasks.workunit.client.1.smithi110.stdout:2/461: chown d6/dc/dd/d49/d64/d5d/f5f 109187784 1 2024-04-12T13:42:03.986 INFO:tasks.workunit.client.1.smithi110.stdout:6/455: truncate d7/d25/d30/d44/d3d/f47 4710841 0 2024-04-12T13:42:03.987 INFO:tasks.workunit.client.1.smithi110.stdout:5/384: dwrite da/d35/f4e [8388608,4194304] 0 2024-04-12T13:42:03.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/394: mkdir d6/d7/dd/d1a/d56/d8d 0 2024-04-12T13:42:03.988 INFO:tasks.workunit.client.1.smithi110.stdout:3/440: dread d5/dc/f2e [0,4194304] 0 2024-04-12T13:42:03.991 INFO:tasks.workunit.client.0.smithi060.stdout:7/348: symlink d0/d7/d43/d63/d6f/l7b 0 2024-04-12T13:42:03.992 INFO:tasks.workunit.client.0.smithi060.stdout:4/395: chown d6/d7/dd/d4d/l77 1305501 1 2024-04-12T13:42:03.992 INFO:tasks.workunit.client.1.smithi110.stdout:3/441: dread - d5/dc/f82 zero size 2024-04-12T13:42:03.993 INFO:tasks.workunit.client.0.smithi060.stdout:3/443: dwrite d7/d17/d27/d36/d53/f8c [0,4194304] 0 2024-04-12T13:42:03.994 INFO:tasks.workunit.client.1.smithi110.stdout:7/436: rename d1/f23 to d1/d31/f96 0 2024-04-12T13:42:03.996 INFO:tasks.workunit.client.1.smithi110.stdout:8/436: truncate d1/d3/d35/f6b 475584 0 2024-04-12T13:42:03.997 INFO:tasks.workunit.client.1.smithi110.stdout:7/437: chown d1/d3/le 813 1 2024-04-12T13:42:03.998 INFO:tasks.workunit.client.1.smithi110.stdout:1/402: dwrite de/f64 [0,4194304] 0 2024-04-12T13:42:03.999 INFO:tasks.workunit.client.1.smithi110.stdout:8/437: stat d1/d5/d1f/f66 0 2024-04-12T13:42:04.000 INFO:tasks.workunit.client.0.smithi060.stdout:3/444: chown d7/l1c 741 1 2024-04-12T13:42:04.002 INFO:tasks.workunit.client.0.smithi060.stdout:3/445: chown d7/d17/f42 11209 1 2024-04-12T13:42:04.002 INFO:tasks.workunit.client.1.smithi110.stdout:8/438: chown d1/d7/d20/f36 70090463 1 2024-04-12T13:42:04.002 INFO:tasks.workunit.client.1.smithi110.stdout:0/376: mknod d1/d8/d36/d65/c7b 0 2024-04-12T13:42:04.003 INFO:tasks.workunit.client.0.smithi060.stdout:3/446: stat d7/d17/d19/d33 0 2024-04-12T13:42:04.004 INFO:tasks.workunit.client.1.smithi110.stdout:7/438: read - d1/d1b/d3d/d68/f8e zero size 2024-04-12T13:42:04.012 INFO:tasks.workunit.client.0.smithi060.stdout:6/505: creat d1/d7/da/dc/d24/d2d/db0/fb8 x:0 0 0 2024-04-12T13:42:04.015 INFO:tasks.workunit.client.1.smithi110.stdout:7/439: dread d1/d3/d84/f8d [0,4194304] 0 2024-04-12T13:42:04.017 INFO:tasks.workunit.client.1.smithi110.stdout:5/385: dread da/d2e/d45/d29/f50 [0,4194304] 0 2024-04-12T13:42:04.019 INFO:tasks.workunit.client.1.smithi110.stdout:5/386: readlink da/d35/d71/l7f 0 2024-04-12T13:42:04.021 INFO:tasks.workunit.client.1.smithi110.stdout:9/520: dwrite df/f2e [0,4194304] 0 2024-04-12T13:42:04.024 INFO:tasks.workunit.client.0.smithi060.stdout:3/447: rmdir d7/da/d3f/d5c 39 2024-04-12T13:42:04.028 INFO:tasks.workunit.client.0.smithi060.stdout:0/405: rename d7/d9/l1d to d7/d9/d14/d35/d44/d8c/l97 0 2024-04-12T13:42:04.031 INFO:tasks.workunit.client.0.smithi060.stdout:0/406: fdatasync d7/d33/d5b/f64 0 2024-04-12T13:42:04.031 INFO:tasks.workunit.client.0.smithi060.stdout:6/506: dread d1/d7/da/dc/d24/d34/f28 [0,4194304] 0 2024-04-12T13:42:04.038 INFO:tasks.workunit.client.0.smithi060.stdout:2/418: getdents d6/d10/d2b/d35 0 2024-04-12T13:42:04.039 INFO:tasks.workunit.client.1.smithi110.stdout:8/439: unlink d1/d7/d20/l2e 0 2024-04-12T13:42:04.041 INFO:tasks.workunit.client.1.smithi110.stdout:8/440: readlink d1/d3/d35/d3a/l44 0 2024-04-12T13:42:04.041 INFO:tasks.workunit.client.0.smithi060.stdout:0/407: mknod d7/d9/de/c98 0 2024-04-12T13:42:04.042 INFO:tasks.workunit.client.1.smithi110.stdout:7/440: mkdir d1/d1b/d3d/d68/d97 0 2024-04-12T13:42:04.043 INFO:tasks.workunit.client.0.smithi060.stdout:0/408: stat d7/d9/d4c/f50 0 2024-04-12T13:42:04.043 INFO:tasks.workunit.client.0.smithi060.stdout:3/448: dread f0 [0,4194304] 0 2024-04-12T13:42:04.045 INFO:tasks.workunit.client.1.smithi110.stdout:2/462: symlink d6/dc/d13/d80/l85 0 2024-04-12T13:42:04.045 INFO:tasks.workunit.client.0.smithi060.stdout:3/449: chown d7/d17/f1a 10962 1 2024-04-12T13:42:04.046 INFO:tasks.workunit.client.0.smithi060.stdout:3/450: chown d7/l18 31789980 1 2024-04-12T13:42:04.046 INFO:tasks.workunit.client.1.smithi110.stdout:2/463: readlink d6/dc/l17 0 2024-04-12T13:42:04.049 INFO:tasks.workunit.client.1.smithi110.stdout:5/387: rename da/d2e/d45/d29/d66/f74 to da/db/d61/d79/d88/f8c 0 2024-04-12T13:42:04.057 INFO:tasks.workunit.client.1.smithi110.stdout:9/521: dwrite df/d13/f1b [0,4194304] 0 2024-04-12T13:42:04.059 INFO:tasks.workunit.client.1.smithi110.stdout:1/403: mknod de/d15/d32/d61/c90 0 2024-04-12T13:42:04.062 INFO:tasks.workunit.client.1.smithi110.stdout:3/442: truncate d5/dc/d20/d2d/f51 254081 0 2024-04-12T13:42:04.063 INFO:tasks.workunit.client.1.smithi110.stdout:4/569: sync 2024-04-12T13:42:04.065 INFO:tasks.workunit.client.1.smithi110.stdout:6/456: creat d7/d10/d1c/d2b/f91 x:0 0 0 2024-04-12T13:42:04.068 INFO:tasks.workunit.client.1.smithi110.stdout:7/441: mknod d1/d1b/d3d/c98 0 2024-04-12T13:42:04.068 INFO:tasks.workunit.client.1.smithi110.stdout:0/377: write d1/f2f [2528547,65574] 0 2024-04-12T13:42:04.075 INFO:tasks.workunit.client.1.smithi110.stdout:3/443: creat d5/dc/d20/d2d/d4f/f95 x:0 0 0 2024-04-12T13:42:04.076 INFO:tasks.workunit.client.1.smithi110.stdout:4/570: creat d0/de/fbc x:0 0 0 2024-04-12T13:42:04.078 INFO:tasks.workunit.client.0.smithi060.stdout:4/396: getdents d6/d7 0 2024-04-12T13:42:04.078 INFO:tasks.workunit.client.1.smithi110.stdout:3/444: chown d5/dc/d31/d3b/d32/d3e/d5f/f8b 5 1 2024-04-12T13:42:04.079 INFO:tasks.workunit.client.0.smithi060.stdout:4/397: chown d6/d7/dd/d1a 11479 1 2024-04-12T13:42:04.080 INFO:tasks.workunit.client.0.smithi060.stdout:7/349: getdents d0 0 2024-04-12T13:42:04.083 INFO:tasks.workunit.client.1.smithi110.stdout:2/464: creat d6/dc/d1b/d57/d62/f86 x:0 0 0 2024-04-12T13:42:04.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/419: fdatasync d6/d10/f57 0 2024-04-12T13:42:04.084 INFO:tasks.workunit.client.0.smithi060.stdout:2/420: chown d6/d13/d17 1869644 1 2024-04-12T13:42:04.085 INFO:tasks.workunit.client.1.smithi110.stdout:7/442: symlink d1/d1b/d74/l99 0 2024-04-12T13:42:04.086 INFO:tasks.workunit.client.1.smithi110.stdout:0/378: mkdir d1/d8/d36/d51/d7c 0 2024-04-12T13:42:04.087 INFO:tasks.workunit.client.1.smithi110.stdout:0/379: fsync d1/f22 0 2024-04-12T13:42:04.087 INFO:tasks.workunit.client.0.smithi060.stdout:6/507: creat d1/d7/da/dc/dac/fb9 x:0 0 0 2024-04-12T13:42:04.089 INFO:tasks.workunit.client.0.smithi060.stdout:6/508: fdatasync d1/d7/da/dc/d24/f96 0 2024-04-12T13:42:04.089 INFO:tasks.workunit.client.0.smithi060.stdout:7/350: creat d0/d3d/f7c x:0 0 0 2024-04-12T13:42:04.094 INFO:tasks.workunit.client.0.smithi060.stdout:3/451: mknod d7/d17/d19/d96/c97 0 2024-04-12T13:42:04.095 INFO:tasks.workunit.client.1.smithi110.stdout:3/445: creat d5/dc/d31/d3b/d5b/f96 x:0 0 0 2024-04-12T13:42:04.096 INFO:tasks.workunit.client.0.smithi060.stdout:2/421: mknod d6/d10/d16/c80 0 2024-04-12T13:42:04.101 INFO:tasks.workunit.client.0.smithi060.stdout:6/509: symlink d1/d7/da/dc/d24/d2d/db0/lba 0 2024-04-12T13:42:04.101 INFO:tasks.workunit.client.1.smithi110.stdout:7/443: dwrite d1/d3/d43/f85 [0,4194304] 0 2024-04-12T13:42:04.104 INFO:tasks.workunit.client.1.smithi110.stdout:9/522: dwrite df/d13/d2c/d2d/d39/d3a/d4e/f5b [4194304,4194304] 0 2024-04-12T13:42:04.104 INFO:tasks.workunit.client.0.smithi060.stdout:3/452: read d7/d17/d19/f85 [715414,83411] 0 2024-04-12T13:42:04.107 INFO:tasks.workunit.client.1.smithi110.stdout:4/571: write d0/fc [5514591,46623] 0 2024-04-12T13:42:04.110 INFO:tasks.workunit.client.1.smithi110.stdout:0/380: chown d1/d8/cc 0 1 2024-04-12T13:42:04.110 INFO:tasks.workunit.client.1.smithi110.stdout:5/388: creat da/db/f8d x:0 0 0 2024-04-12T13:42:04.111 INFO:tasks.workunit.client.0.smithi060.stdout:4/398: link d6/d7/dd/d1a/d19/f33 d6/d7/db/f8e 0 2024-04-12T13:42:04.114 INFO:tasks.workunit.client.0.smithi060.stdout:1/505: sync 2024-04-12T13:42:04.114 INFO:tasks.workunit.client.1.smithi110.stdout:1/404: dwrite de/f58 [0,4194304] 0 2024-04-12T13:42:04.116 INFO:tasks.workunit.client.0.smithi060.stdout:2/422: read d6/d13/d31/d33/d3d/f28 [226087,22035] 0 2024-04-12T13:42:04.117 INFO:tasks.workunit.client.0.smithi060.stdout:1/506: dread - d1e/d1f/fad zero size 2024-04-12T13:42:04.117 INFO:tasks.workunit.client.1.smithi110.stdout:0/381: dread - d1/d8/d36/d51/f68 zero size 2024-04-12T13:42:04.118 INFO:tasks.workunit.client.1.smithi110.stdout:8/441: dwrite d1/d3/d3c/f57 [0,4194304] 0 2024-04-12T13:42:04.118 INFO:tasks.workunit.client.0.smithi060.stdout:4/399: dread - d6/d7/dd/d4d/d69/f8a zero size 2024-04-12T13:42:04.124 INFO:tasks.workunit.client.0.smithi060.stdout:1/507: chown d1e/d1f/f4a 14 1 2024-04-12T13:42:04.128 INFO:tasks.workunit.client.1.smithi110.stdout:7/444: dwrite d1/d3/d43/f53 [4194304,4194304] 0 2024-04-12T13:42:04.129 INFO:tasks.workunit.client.1.smithi110.stdout:7/445: chown d1/d1b/d3d/c98 2 1 2024-04-12T13:42:04.130 INFO:tasks.workunit.client.0.smithi060.stdout:3/453: dwrite d7/da/f82 [0,4194304] 0 2024-04-12T13:42:04.130 INFO:tasks.workunit.client.1.smithi110.stdout:3/446: rename d5/dc/d20/f7a to d5/dc/d20/d2d/d4e/d89/f97 0 2024-04-12T13:42:04.131 INFO:tasks.workunit.client.1.smithi110.stdout:7/446: chown d1/c45 13 1 2024-04-12T13:42:04.132 INFO:tasks.workunit.client.1.smithi110.stdout:7/447: write d1/f1e [2317281,39961] 0 2024-04-12T13:42:04.132 INFO:tasks.workunit.client.1.smithi110.stdout:3/447: chown d5/dc/d20/d2d/d4e/l92 2942193 1 2024-04-12T13:42:04.134 INFO:tasks.workunit.client.1.smithi110.stdout:3/448: readlink d5/dc/d31/d3b/d32/l47 0 2024-04-12T13:42:04.135 INFO:tasks.workunit.client.0.smithi060.stdout:6/510: write d1/d7/da/dc/d24/d30/d52/d5e/f9e [1018682,126458] 0 2024-04-12T13:42:04.136 INFO:tasks.workunit.client.1.smithi110.stdout:7/448: write d1/d31/d5d/f83 [882114,120462] 0 2024-04-12T13:42:04.138 INFO:tasks.workunit.client.1.smithi110.stdout:9/523: creat df/d38/d6e/faa x:0 0 0 2024-04-12T13:42:04.143 INFO:tasks.workunit.client.1.smithi110.stdout:4/572: mknod d0/de/d2c/cbd 0 2024-04-12T13:42:04.145 INFO:tasks.workunit.client.1.smithi110.stdout:6/457: getdents d7/d10/d1c/d2b/d3a/d82 0 2024-04-12T13:42:04.146 INFO:tasks.workunit.client.0.smithi060.stdout:7/351: dwrite d0/d7/f6 [0,4194304] 0 2024-04-12T13:42:04.147 INFO:tasks.workunit.client.1.smithi110.stdout:5/389: mknod da/d4f/c8e 0 2024-04-12T13:42:04.148 INFO:tasks.workunit.client.1.smithi110.stdout:6/458: chown d7/d10/l16 5863 1 2024-04-12T13:42:04.148 INFO:tasks.workunit.client.0.smithi060.stdout:1/508: dread d1e/d23/d49/f54 [0,4194304] 0 2024-04-12T13:42:04.150 INFO:tasks.workunit.client.0.smithi060.stdout:3/454: creat d7/d17/d19/d33/d63/d6d/f98 x:0 0 0 2024-04-12T13:42:04.153 INFO:tasks.workunit.client.0.smithi060.stdout:1/509: fsync d1e/d23/d49/d4e/d9b/fac 0 2024-04-12T13:42:04.153 INFO:tasks.workunit.client.1.smithi110.stdout:1/405: unlink de/d15/d32/l3b 0 2024-04-12T13:42:04.154 INFO:tasks.workunit.client.1.smithi110.stdout:1/406: write de/f80 [173042,61749] 0 2024-04-12T13:42:04.156 INFO:tasks.workunit.client.0.smithi060.stdout:6/511: creat d1/d7/da/dc/d24/d30/d52/d5e/fbb x:0 0 0 2024-04-12T13:42:04.159 INFO:tasks.workunit.client.0.smithi060.stdout:2/423: getdents d6/d10/d2b/d35 0 2024-04-12T13:42:04.163 INFO:tasks.workunit.client.1.smithi110.stdout:5/390: dwrite da/db/f31 [4194304,4194304] 0 2024-04-12T13:42:04.165 INFO:tasks.workunit.client.1.smithi110.stdout:5/391: write f5 [2634973,92620] 0 2024-04-12T13:42:04.166 INFO:tasks.workunit.client.0.smithi060.stdout:4/400: creat d6/f8f x:0 0 0 2024-04-12T13:42:04.166 INFO:tasks.workunit.client.1.smithi110.stdout:2/465: creat d6/dc/dd/d49/d64/f87 x:0 0 0 2024-04-12T13:42:04.168 INFO:tasks.workunit.client.1.smithi110.stdout:5/392: chown da/d2e/d45/d29/d32/c53 621254 1 2024-04-12T13:42:04.171 INFO:tasks.workunit.client.0.smithi060.stdout:7/352: unlink d0/d7/d43/c6c 0 2024-04-12T13:42:04.172 INFO:tasks.workunit.client.1.smithi110.stdout:7/449: rename d1/d3/d4/d36/d4b/c5f to d1/d1b/d3d/d68/c9a 0 2024-04-12T13:42:04.175 INFO:tasks.workunit.client.0.smithi060.stdout:3/455: chown d7/da/d3f/d5c/f8d 24 1 2024-04-12T13:42:04.175 INFO:tasks.workunit.client.1.smithi110.stdout:7/450: write d1/d3/d4/d55/f65 [561300,31159] 0 2024-04-12T13:42:04.176 INFO:tasks.workunit.client.0.smithi060.stdout:6/512: rename d1/d7/da/dc/dac/fb9 to d1/d7/da/dc/d24/d8b/fbc 0 2024-04-12T13:42:04.178 INFO:tasks.workunit.client.1.smithi110.stdout:6/459: mknod d7/d10/d1c/d4d/c92 0 2024-04-12T13:42:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:03 smithi060 ceph-mon[29097]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 158 MiB/s wr, 253 op/s 2024-04-12T13:42:04.181 INFO:tasks.workunit.client.0.smithi060.stdout:2/424: dwrite d6/d13/d31/d33/f61 [0,4194304] 0 2024-04-12T13:42:04.181 INFO:tasks.workunit.client.0.smithi060.stdout:4/401: truncate d6/d2f/d51/f71 1694131 0 2024-04-12T13:42:04.182 INFO:tasks.workunit.client.1.smithi110.stdout:1/407: symlink de/d15/d32/d5e/l91 0 2024-04-12T13:42:04.184 INFO:tasks.workunit.client.1.smithi110.stdout:0/382: symlink d1/l7d 0 2024-04-12T13:42:04.184 INFO:tasks.workunit.client.0.smithi060.stdout:2/425: chown d6/f25 535271 1 2024-04-12T13:42:04.184 INFO:tasks.workunit.client.1.smithi110.stdout:0/383: chown d1 10064 1 2024-04-12T13:42:04.186 INFO:tasks.workunit.client.1.smithi110.stdout:2/466: mknod d6/dc/dd/c88 0 2024-04-12T13:42:04.189 INFO:tasks.workunit.client.1.smithi110.stdout:4/573: rename d0/d19/d1c/f25 to d0/d19/d26/fbe 0 2024-04-12T13:42:04.190 INFO:tasks.workunit.client.0.smithi060.stdout:7/353: rename d0/d7/d43/l4b to d0/d7/d43/d4d/l7d 0 2024-04-12T13:42:04.191 INFO:tasks.workunit.client.0.smithi060.stdout:7/354: chown d0/fe 34918 1 2024-04-12T13:42:04.192 INFO:tasks.workunit.client.0.smithi060.stdout:6/513: mkdir d1/d7/da/dbd 0 2024-04-12T13:42:04.193 INFO:tasks.workunit.client.1.smithi110.stdout:9/524: mkdir df/d13/d26/d37/d49/da3/dab 0 2024-04-12T13:42:04.194 INFO:tasks.workunit.client.0.smithi060.stdout:4/402: symlink d6/d7/db/l90 0 2024-04-12T13:42:04.195 INFO:tasks.workunit.client.1.smithi110.stdout:9/525: chown df/d13/d2c/d9e/la9 45952 1 2024-04-12T13:42:04.196 INFO:tasks.workunit.client.1.smithi110.stdout:6/460: readlink d7/d10/d1c/d2b/d3a/l50 0 2024-04-12T13:42:04.198 INFO:tasks.workunit.client.1.smithi110.stdout:1/408: creat de/d15/d32/d5e/d79/f92 x:0 0 0 2024-04-12T13:42:04.200 INFO:tasks.workunit.client.1.smithi110.stdout:1/409: write de/d14/f53 [600077,117521] 0 2024-04-12T13:42:04.201 INFO:tasks.workunit.client.0.smithi060.stdout:1/510: link d1e/d23/d2e/d30/d51/c7d d1e/d94/cb1 0 2024-04-12T13:42:04.204 INFO:tasks.workunit.client.0.smithi060.stdout:1/511: rename d1e to d1e/d23/d2e/d30/d51/d85/db2 22 2024-04-12T13:42:04.205 INFO:tasks.workunit.client.1.smithi110.stdout:5/393: rename da/d55 to da/d35/d71/d8f 0 2024-04-12T13:42:04.205 INFO:tasks.workunit.client.0.smithi060.stdout:1/512: readlink d1e/d29/d6d/la8 0 2024-04-12T13:42:04.206 INFO:tasks.workunit.client.1.smithi110.stdout:5/394: readlink l6 0 2024-04-12T13:42:04.207 INFO:tasks.workunit.client.0.smithi060.stdout:7/355: creat d0/d3d/d74/f7e x:0 0 0 2024-04-12T13:42:04.208 INFO:tasks.workunit.client.1.smithi110.stdout:5/395: truncate da/d2e/d45/d25/d5d/f86 422519 0 2024-04-12T13:42:04.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/514: truncate d1/d7/da/dc/d24/d2d/f55 808120 0 2024-04-12T13:42:04.212 INFO:tasks.workunit.client.0.smithi060.stdout:4/403: dwrite d6/d7/db/d85/f67 [0,4194304] 0 2024-04-12T13:42:04.214 INFO:tasks.workunit.client.0.smithi060.stdout:6/515: write d1/d7/da/dc/d24/f91 [747719,48008] 0 2024-04-12T13:42:04.217 INFO:tasks.workunit.client.0.smithi060.stdout:3/456: creat d7/d17/d27/d36/f99 x:0 0 0 2024-04-12T13:42:04.219 INFO:tasks.workunit.client.1.smithi110.stdout:0/384: rename d1/d8/d36/d51/d7c to d1/d8/d36/d63/d4a/d7e 0 2024-04-12T13:42:04.221 INFO:tasks.workunit.client.0.smithi060.stdout:1/513: symlink d1e/d29/d6d/lb3 0 2024-04-12T13:42:04.223 INFO:tasks.workunit.client.1.smithi110.stdout:9/526: symlink df/d13/d2c/lac 0 2024-04-12T13:42:04.225 INFO:tasks.workunit.client.1.smithi110.stdout:8/442: sync 2024-04-12T13:42:04.225 INFO:tasks.workunit.client.1.smithi110.stdout:5/396: creat da/d2e/d45/f90 x:0 0 0 2024-04-12T13:42:04.227 INFO:tasks.workunit.client.1.smithi110.stdout:5/397: chown da/db/f31 503639 1 2024-04-12T13:42:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:03 smithi110 ceph-mon[36055]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 158 MiB/s wr, 253 op/s 2024-04-12T13:42:04.228 INFO:tasks.workunit.client.1.smithi110.stdout:8/443: chown d1/d3/d3c/d5a/d6f/d7e/l80 13009 1 2024-04-12T13:42:04.229 INFO:tasks.workunit.client.1.smithi110.stdout:1/410: unlink de/c74 0 2024-04-12T13:42:04.230 INFO:tasks.workunit.client.1.smithi110.stdout:5/398: stat da/d2e/d45/d29/d32/l57 0 2024-04-12T13:42:04.230 INFO:tasks.workunit.client.1.smithi110.stdout:1/411: readlink de/l84 0 2024-04-12T13:42:04.234 INFO:tasks.workunit.client.1.smithi110.stdout:0/385: symlink d1/d48/l7f 0 2024-04-12T13:42:04.235 INFO:tasks.workunit.client.0.smithi060.stdout:3/457: creat d7/da/d3f/d5c/f9a x:0 0 0 2024-04-12T13:42:04.238 INFO:tasks.workunit.client.0.smithi060.stdout:7/356: unlink d0/c3 0 2024-04-12T13:42:04.239 INFO:tasks.workunit.client.1.smithi110.stdout:2/467: getdents d6/dc/d1b/d57/d62 0 2024-04-12T13:42:04.243 INFO:tasks.workunit.client.0.smithi060.stdout:1/514: rmdir d1e/d23/d2e/d86 39 2024-04-12T13:42:04.246 INFO:tasks.workunit.client.0.smithi060.stdout:2/426: getdents d6/d13/d31 0 2024-04-12T13:42:04.249 INFO:tasks.workunit.client.1.smithi110.stdout:5/399: creat da/d4f/f91 x:0 0 0 2024-04-12T13:42:04.250 INFO:tasks.workunit.client.0.smithi060.stdout:6/516: dwrite d1/d7/da/dc/f3c [0,4194304] 0 2024-04-12T13:42:04.250 INFO:tasks.workunit.client.1.smithi110.stdout:5/400: dread - da/d2e/d45/f90 zero size 2024-04-12T13:42:04.253 INFO:tasks.workunit.client.1.smithi110.stdout:1/412: symlink de/d14/l93 0 2024-04-12T13:42:04.254 INFO:tasks.workunit.client.1.smithi110.stdout:1/413: chown de/d15/l2b 76809213 1 2024-04-12T13:42:04.254 INFO:tasks.workunit.client.0.smithi060.stdout:3/458: mkdir d7/d17/d19/d33/d63/d9b 0 2024-04-12T13:42:04.256 INFO:tasks.workunit.client.0.smithi060.stdout:7/357: dread d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:04.257 INFO:tasks.workunit.client.1.smithi110.stdout:9/527: creat df/d13/d26/d37/d49/da3/dab/fad x:0 0 0 2024-04-12T13:42:04.262 INFO:tasks.workunit.client.1.smithi110.stdout:5/401: fsync da/db/d15/f1a 0 2024-04-12T13:42:04.263 INFO:tasks.workunit.client.1.smithi110.stdout:1/414: symlink de/d14/d34/d55/d6b/l94 0 2024-04-12T13:42:04.264 INFO:tasks.workunit.client.0.smithi060.stdout:3/459: unlink d7/da/f2c 0 2024-04-12T13:42:04.265 INFO:tasks.workunit.client.1.smithi110.stdout:1/415: readlink de/d14/d83/l85 0 2024-04-12T13:42:04.265 INFO:tasks.workunit.client.1.smithi110.stdout:5/402: rename da/db/d61 to da/db/d61/d79/d82/d92 22 2024-04-12T13:42:04.265 INFO:tasks.workunit.client.1.smithi110.stdout:6/461: dwrite d7/f1a [0,4194304] 0 2024-04-12T13:42:04.266 INFO:tasks.workunit.client.1.smithi110.stdout:9/528: rmdir df/d38/d6e/d7f 39 2024-04-12T13:42:04.269 INFO:tasks.workunit.client.0.smithi060.stdout:1/515: symlink d1e/d94/lb4 0 2024-04-12T13:42:04.271 INFO:tasks.workunit.client.0.smithi060.stdout:7/358: dread d0/d7/f39 [0,4194304] 0 2024-04-12T13:42:04.271 INFO:tasks.workunit.client.0.smithi060.stdout:2/427: mkdir d6/d10/d81 0 2024-04-12T13:42:04.273 INFO:tasks.workunit.client.1.smithi110.stdout:5/403: mknod da/d2e/d45/c93 0 2024-04-12T13:42:04.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/404: write d6/f70 [2836421,95407] 0 2024-04-12T13:42:04.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/405: readlink d6/d21/l4c 0 2024-04-12T13:42:04.275 INFO:tasks.workunit.client.1.smithi110.stdout:2/468: dwrite f4 [4194304,4194304] 0 2024-04-12T13:42:04.279 INFO:tasks.workunit.client.1.smithi110.stdout:9/529: dread - df/d13/d26/d37/f90 zero size 2024-04-12T13:42:04.280 INFO:tasks.workunit.client.0.smithi060.stdout:4/406: chown d6/d7/dd/d1a/f60 46158 1 2024-04-12T13:42:04.281 INFO:tasks.workunit.client.0.smithi060.stdout:4/407: readlink d6/l44 0 2024-04-12T13:42:04.282 INFO:tasks.workunit.client.1.smithi110.stdout:8/444: dwrite d1/d3/d35/d3a/d41/f53 [0,4194304] 0 2024-04-12T13:42:04.283 INFO:tasks.workunit.client.1.smithi110.stdout:2/469: truncate d6/dc/dd/d49/d64/f2c 4445288 0 2024-04-12T13:42:04.285 INFO:tasks.workunit.client.0.smithi060.stdout:6/517: write d1/d7/da/dc/d24/d30/f71 [1533444,91016] 0 2024-04-12T13:42:04.289 INFO:tasks.workunit.client.0.smithi060.stdout:3/460: rename d7/d17/d27/d36/l6f to d7/d17/l9c 0 2024-04-12T13:42:04.289 INFO:tasks.workunit.client.1.smithi110.stdout:3/449: sync 2024-04-12T13:42:04.292 INFO:tasks.workunit.client.0.smithi060.stdout:7/359: dwrite d0/d7/d43/d4d/f57 [0,4194304] 0 2024-04-12T13:42:04.294 INFO:tasks.workunit.client.1.smithi110.stdout:5/404: dwrite da/d2e/d45/d25/f5a [0,4194304] 0 2024-04-12T13:42:04.295 INFO:tasks.workunit.client.1.smithi110.stdout:9/530: rmdir df/d13/d2c/d2d/d39/d3a/d4e/d83 39 2024-04-12T13:42:04.297 INFO:tasks.workunit.client.1.smithi110.stdout:9/531: chown df/d38/f88 30477877 1 2024-04-12T13:42:04.298 INFO:tasks.workunit.client.0.smithi060.stdout:7/360: chown d0/d7/d43/d63/d6f/c76 0 1 2024-04-12T13:42:04.298 INFO:tasks.workunit.client.1.smithi110.stdout:5/405: write da/d2e/d45/d25/f43 [780249,127887] 0 2024-04-12T13:42:04.300 INFO:tasks.workunit.client.1.smithi110.stdout:9/532: write df/d8a/f8e [1977270,29965] 0 2024-04-12T13:42:04.301 INFO:tasks.workunit.client.1.smithi110.stdout:5/406: read da/db/d61/d7a/f87 [1734683,114789] 0 2024-04-12T13:42:04.303 INFO:tasks.workunit.client.1.smithi110.stdout:8/445: creat d1/d3/d35/d3a/d84/f92 x:0 0 0 2024-04-12T13:42:04.303 INFO:tasks.workunit.client.1.smithi110.stdout:2/470: readlink d6/dc/d1b/l58 0 2024-04-12T13:42:04.303 INFO:tasks.workunit.client.0.smithi060.stdout:6/518: symlink d1/d7/da/d20/d99/lbe 0 2024-04-12T13:42:04.303 INFO:tasks.workunit.client.1.smithi110.stdout:3/450: mkdir d5/dc/d31/d3b/d32/d3e/d98 0 2024-04-12T13:42:04.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/519: stat d1/d7/da/dc/d24/d30/d52/d78 0 2024-04-12T13:42:04.309 INFO:tasks.workunit.client.0.smithi060.stdout:1/516: dwrite d1e/d23/d2e/d5e/d68/fa0 [0,4194304] 0 2024-04-12T13:42:04.310 INFO:tasks.workunit.client.0.smithi060.stdout:7/361: getdents d0 0 2024-04-12T13:42:04.313 INFO:tasks.workunit.client.1.smithi110.stdout:5/407: read da/d2e/d45/d29/d32/f36 [4056289,99370] 0 2024-04-12T13:42:04.315 INFO:tasks.workunit.client.1.smithi110.stdout:6/462: dwrite d7/d10/d1c/d2b/f7a [0,4194304] 0 2024-04-12T13:42:04.321 INFO:tasks.workunit.client.0.smithi060.stdout:6/520: creat d1/d7/da/fbf x:0 0 0 2024-04-12T13:42:04.324 INFO:tasks.workunit.client.1.smithi110.stdout:5/408: symlink da/db/d61/l94 0 2024-04-12T13:42:04.325 INFO:tasks.workunit.client.0.smithi060.stdout:4/408: dwrite d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:42:04.328 INFO:tasks.workunit.client.1.smithi110.stdout:3/451: getdents d5/dc/d31/d3b 0 2024-04-12T13:42:04.329 INFO:tasks.workunit.client.1.smithi110.stdout:2/471: dwrite d6/dc/dd/d49/d64/d5d/f5f [0,4194304] 0 2024-04-12T13:42:04.333 INFO:tasks.workunit.client.0.smithi060.stdout:1/517: creat d1e/d29/d65/fb5 x:0 0 0 2024-04-12T13:42:04.333 INFO:tasks.workunit.client.0.smithi060.stdout:7/362: unlink d0/d7/f11 0 2024-04-12T13:42:04.333 INFO:tasks.workunit.client.1.smithi110.stdout:2/472: write d6/dc/dd/d49/d64/d25/f40 [3845758,100607] 0 2024-04-12T13:42:04.335 INFO:tasks.workunit.client.1.smithi110.stdout:9/533: write fc [2694799,35817] 0 2024-04-12T13:42:04.337 INFO:tasks.workunit.client.0.smithi060.stdout:6/521: mkdir d1/d7/da/dc/d24/d34/d51/d97/dc0 0 2024-04-12T13:42:04.337 INFO:tasks.workunit.client.1.smithi110.stdout:9/534: dread - df/d13/d26/d37/fa4 zero size 2024-04-12T13:42:04.341 INFO:tasks.workunit.client.1.smithi110.stdout:5/409: creat da/db/d61/d79/d88/f95 x:0 0 0 2024-04-12T13:42:04.342 INFO:tasks.workunit.client.0.smithi060.stdout:8/396: sync 2024-04-12T13:42:04.342 INFO:tasks.workunit.client.0.smithi060.stdout:9/360: sync 2024-04-12T13:42:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:8/397: fdatasync d9/f71 0 2024-04-12T13:42:04.344 INFO:tasks.workunit.client.0.smithi060.stdout:7/363: chown d0/d7/l2b 85639 1 2024-04-12T13:42:04.348 INFO:tasks.workunit.client.0.smithi060.stdout:3/461: dread d7/d17/d19/f85 [0,4194304] 0 2024-04-12T13:42:04.350 INFO:tasks.workunit.client.0.smithi060.stdout:9/361: creat d4/d9/d19/f75 x:0 0 0 2024-04-12T13:42:04.351 INFO:tasks.workunit.client.1.smithi110.stdout:6/463: truncate d7/d25/d30/d44/d3d/f49 2626156 0 2024-04-12T13:42:04.356 INFO:tasks.workunit.client.1.smithi110.stdout:9/535: write df/d13/d26/f32 [2787972,87652] 0 2024-04-12T13:42:04.358 INFO:tasks.workunit.client.0.smithi060.stdout:1/518: rename d1e/d29/ca1 to d1e/d23/d2e/d30/d51/cb6 0 2024-04-12T13:42:04.362 INFO:tasks.workunit.client.1.smithi110.stdout:6/464: mkdir d7/d25/d2c/d4c/d77/d93 0 2024-04-12T13:42:04.363 INFO:tasks.workunit.client.1.smithi110.stdout:9/536: fdatasync df/d13/d2c/d2d/d39/d3a/f62 0 2024-04-12T13:42:04.365 INFO:tasks.workunit.client.0.smithi060.stdout:7/364: creat d0/d7/d43/d63/d6f/f7f x:0 0 0 2024-04-12T13:42:04.367 INFO:tasks.workunit.client.0.smithi060.stdout:7/365: write d0/f64 [491608,93897] 0 2024-04-12T13:42:04.367 INFO:tasks.workunit.client.1.smithi110.stdout:3/452: creat d5/f99 x:0 0 0 2024-04-12T13:42:04.368 INFO:tasks.workunit.client.1.smithi110.stdout:3/453: fdatasync d5/dc/f27 0 2024-04-12T13:42:04.370 INFO:tasks.workunit.client.0.smithi060.stdout:6/522: rename d1/d7/da/dc/d3a to d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1 0 2024-04-12T13:42:04.370 INFO:tasks.workunit.client.1.smithi110.stdout:3/454: fdatasync d5/dc/d20/d2d/d4f/f58 0 2024-04-12T13:42:04.371 INFO:tasks.workunit.client.0.smithi060.stdout:4/409: dread d6/d7/dd/d1a/d57/f83 [0,4194304] 0 2024-04-12T13:42:04.372 INFO:tasks.workunit.client.1.smithi110.stdout:2/473: dread d6/dc/dd/d49/f61 [0,4194304] 0 2024-04-12T13:42:04.373 INFO:tasks.workunit.client.1.smithi110.stdout:2/474: chown d6/f4b 4942125 1 2024-04-12T13:42:04.374 INFO:tasks.workunit.client.0.smithi060.stdout:3/462: dwrite d7/f47 [4194304,4194304] 0 2024-04-12T13:42:04.375 INFO:tasks.workunit.client.1.smithi110.stdout:2/475: dread - d6/dc/dd/d49/d64/d4a/d51/f78 zero size 2024-04-12T13:42:04.377 INFO:tasks.workunit.client.1.smithi110.stdout:9/537: truncate df/d13/d2c/d2d/d39/d3a/f8c 1862821 0 2024-04-12T13:42:04.378 INFO:tasks.workunit.client.0.smithi060.stdout:1/519: dread d1e/d29/d65/f7f [0,4194304] 0 2024-04-12T13:42:04.379 INFO:tasks.workunit.client.0.smithi060.stdout:8/398: write d9/fc [2402037,93247] 0 2024-04-12T13:42:04.387 INFO:tasks.workunit.client.0.smithi060.stdout:9/362: rename d4/d9/l4a to d4/d9/d19/l76 0 2024-04-12T13:42:04.388 INFO:tasks.workunit.client.1.smithi110.stdout:3/455: creat d5/dc/d31/d3b/d5b/f9a x:0 0 0 2024-04-12T13:42:04.390 INFO:tasks.workunit.client.1.smithi110.stdout:3/456: write d5/f28 [7982851,40363] 0 2024-04-12T13:42:04.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/363: read d4/d8/d32/f5b [3106765,36901] 0 2024-04-12T13:42:04.390 INFO:tasks.workunit.client.0.smithi060.stdout:6/523: mkdir d1/d7/da/dc/dc2 0 2024-04-12T13:42:04.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/399: dread d9/d1b/d2b/f55 [0,4194304] 0 2024-04-12T13:42:04.393 INFO:tasks.workunit.client.1.smithi110.stdout:6/465: write d7/d25/d30/d44/f61 [1047379,6228] 0 2024-04-12T13:42:04.398 INFO:tasks.workunit.client.0.smithi060.stdout:1/520: fsync d1e/f33 0 2024-04-12T13:42:04.404 INFO:tasks.workunit.client.1.smithi110.stdout:6/466: chown d7/d10/c3b 31975119 1 2024-04-12T13:42:04.404 INFO:tasks.workunit.client.1.smithi110.stdout:2/476: creat d6/dc/d6f/f89 x:0 0 0 2024-04-12T13:42:04.406 INFO:tasks.workunit.client.1.smithi110.stdout:6/467: write d7/d10/d1c/d2b/f71 [663203,95291] 0 2024-04-12T13:42:04.406 INFO:tasks.workunit.client.1.smithi110.stdout:7/451: sync 2024-04-12T13:42:04.406 INFO:tasks.workunit.client.1.smithi110.stdout:4/574: sync 2024-04-12T13:42:04.406 INFO:tasks.workunit.client.1.smithi110.stdout:0/386: sync 2024-04-12T13:42:04.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/463: mknod d7/d17/d19/c9d 0 2024-04-12T13:42:04.408 INFO:tasks.workunit.client.0.smithi060.stdout:6/524: dwrite d1/fb6 [0,4194304] 0 2024-04-12T13:42:04.409 INFO:tasks.workunit.client.1.smithi110.stdout:6/468: truncate d7/d10/d1c/f6d 2112 0 2024-04-12T13:42:04.410 INFO:tasks.workunit.client.0.smithi060.stdout:8/400: dwrite d9/d1b/d37/d4d/f6b [4194304,4194304] 0 2024-04-12T13:42:04.412 INFO:tasks.workunit.client.1.smithi110.stdout:3/457: truncate d5/dc/f19 2913602 0 2024-04-12T13:42:04.416 INFO:tasks.workunit.client.1.smithi110.stdout:0/387: creat d1/d5e/f80 x:0 0 0 2024-04-12T13:42:04.417 INFO:tasks.workunit.client.0.smithi060.stdout:3/464: write d7/d17/d27/d36/f46 [81373,85092] 0 2024-04-12T13:42:04.418 INFO:tasks.workunit.client.1.smithi110.stdout:3/458: write d5/dc/d31/d3b/d5b/f8d [229778,130987] 0 2024-04-12T13:42:04.420 INFO:tasks.workunit.client.1.smithi110.stdout:6/469: creat d7/d10/d1c/d2b/d48/d4b/f94 x:0 0 0 2024-04-12T13:42:04.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/366: link d0/l2e d0/d7/l80 0 2024-04-12T13:42:04.428 INFO:tasks.workunit.client.0.smithi060.stdout:9/364: rename d4/d9/d19/d21/f2f to d4/f77 0 2024-04-12T13:42:04.428 INFO:tasks.workunit.client.1.smithi110.stdout:7/452: rename d1/d3/d4/d55/f65 to d1/d3/d4/f9b 0 2024-04-12T13:42:04.429 INFO:tasks.workunit.client.1.smithi110.stdout:6/470: chown d7/d25/d2c/f57 0 1 2024-04-12T13:42:04.429 INFO:tasks.workunit.client.1.smithi110.stdout:2/477: dwrite d6/dc/d1b/f2a [4194304,4194304] 0 2024-04-12T13:42:04.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/401: rmdir d9/d1d 39 2024-04-12T13:42:04.431 INFO:tasks.workunit.client.0.smithi060.stdout:4/410: getdents d6/d2f/d51 0 2024-04-12T13:42:04.432 INFO:tasks.workunit.client.1.smithi110.stdout:7/453: fdatasync d1/d3/d4/d36/d76/f8a 0 2024-04-12T13:42:04.434 INFO:tasks.workunit.client.0.smithi060.stdout:4/411: fsync d6/d7/db/f72 0 2024-04-12T13:42:04.436 INFO:tasks.workunit.client.0.smithi060.stdout:3/465: creat d7/d17/d19/d33/d63/f9e x:0 0 0 2024-04-12T13:42:04.441 INFO:tasks.workunit.client.0.smithi060.stdout:3/466: write d7/d17/d19/d33/f6c [622820,130458] 0 2024-04-12T13:42:04.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/367: rmdir d0/d7/d43/d4d 39 2024-04-12T13:42:04.445 INFO:tasks.workunit.client.1.smithi110.stdout:3/459: rename d5/dc/d31/f45 to d5/dc/d31/d3b/d32/d3e/d5f/f9b 0 2024-04-12T13:42:04.448 INFO:tasks.workunit.client.0.smithi060.stdout:0/409: sync 2024-04-12T13:42:04.448 INFO:tasks.workunit.client.0.smithi060.stdout:5/466: sync 2024-04-12T13:42:04.448 INFO:tasks.workunit.client.0.smithi060.stdout:8/402: dread - d9/d1b/d2b/f5c zero size 2024-04-12T13:42:04.452 INFO:tasks.workunit.client.0.smithi060.stdout:3/467: creat d7/f9f x:0 0 0 2024-04-12T13:42:04.453 INFO:tasks.workunit.client.1.smithi110.stdout:0/388: dwrite d1/d8/d36/d51/d60/f70 [0,4194304] 0 2024-04-12T13:42:04.454 INFO:tasks.workunit.client.1.smithi110.stdout:4/575: dread d0/d19/f2e [0,4194304] 0 2024-04-12T13:42:04.454 INFO:tasks.workunit.client.1.smithi110.stdout:6/471: creat d7/d25/d2c/d4c/d77/d93/f95 x:0 0 0 2024-04-12T13:42:04.455 INFO:tasks.workunit.client.0.smithi060.stdout:1/521: dread d1e/d23/d2e/f39 [0,4194304] 0 2024-04-12T13:42:04.459 INFO:tasks.workunit.client.0.smithi060.stdout:4/412: dread d6/d7/dd/d1a/d19/f5e [0,4194304] 0 2024-04-12T13:42:04.459 INFO:tasks.workunit.client.1.smithi110.stdout:6/472: chown d7/d10/d1c/d4d/c92 9 1 2024-04-12T13:42:04.459 INFO:tasks.workunit.client.1.smithi110.stdout:2/478: dwrite d6/dc/dd/d49/d64/d4a/d51/f78 [0,4194304] 0 2024-04-12T13:42:04.459 INFO:tasks.workunit.client.0.smithi060.stdout:4/413: fsync d6/d7/db/f22 0 2024-04-12T13:42:04.461 INFO:tasks.workunit.client.0.smithi060.stdout:1/522: write d1e/d1f/f4b [5347351,103984] 0 2024-04-12T13:42:04.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/525: dwrite d1/f57 [0,4194304] 0 2024-04-12T13:42:04.472 INFO:tasks.workunit.client.0.smithi060.stdout:7/368: dwrite d0/d1b/f5b [0,4194304] 0 2024-04-12T13:42:04.477 INFO:tasks.workunit.client.0.smithi060.stdout:9/365: dread d4/f77 [0,4194304] 0 2024-04-12T13:42:04.479 INFO:tasks.workunit.client.1.smithi110.stdout:1/416: sync 2024-04-12T13:42:04.479 INFO:tasks.workunit.client.1.smithi110.stdout:8/446: sync 2024-04-12T13:42:04.480 INFO:tasks.workunit.client.1.smithi110.stdout:1/417: readlink de/d14/l93 0 2024-04-12T13:42:04.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/366: dwrite d4/d9/d19/d21/d73/d67/f49 [0,4194304] 0 2024-04-12T13:42:04.508 INFO:tasks.workunit.client.0.smithi060.stdout:2/428: sync 2024-04-12T13:42:04.508 INFO:tasks.workunit.client.0.smithi060.stdout:2/429: readlink d6/d56/l68 0 2024-04-12T13:42:04.511 INFO:tasks.workunit.client.0.smithi060.stdout:2/430: write d6/d10/d2b/d35/f52 [1565355,23024] 0 2024-04-12T13:42:04.512 INFO:tasks.workunit.client.0.smithi060.stdout:2/431: stat d6/d10/d4b/f7c 0 2024-04-12T13:42:04.515 INFO:tasks.workunit.client.1.smithi110.stdout:9/538: sync 2024-04-12T13:42:04.515 INFO:tasks.workunit.client.1.smithi110.stdout:5/410: sync 2024-04-12T13:42:04.519 INFO:tasks.workunit.client.1.smithi110.stdout:9/539: fdatasync df/d13/d26/d37/d49/f55 0 2024-04-12T13:42:04.566 INFO:tasks.workunit.client.0.smithi060.stdout:0/410: fsync d7/d9/f48 0 2024-04-12T13:42:04.572 INFO:tasks.workunit.client.1.smithi110.stdout:4/576: creat d0/de/d2c/d57/fbf x:0 0 0 2024-04-12T13:42:04.574 INFO:tasks.workunit.client.1.smithi110.stdout:4/577: dread - d0/d19/d26/d8a/f8d zero size 2024-04-12T13:42:04.577 INFO:tasks.workunit.client.1.smithi110.stdout:6/473: creat d7/d25/d2c/d4c/d77/f96 x:0 0 0 2024-04-12T13:42:04.580 INFO:tasks.workunit.client.1.smithi110.stdout:2/479: creat d6/dc/dd/d49/f8a x:0 0 0 2024-04-12T13:42:04.582 INFO:tasks.workunit.client.1.smithi110.stdout:2/480: chown d6/dc/dd/f54 712389 1 2024-04-12T13:42:04.586 INFO:tasks.workunit.client.1.smithi110.stdout:8/447: creat d1/d3/d3c/d5a/d6f/d7e/f93 x:0 0 0 2024-04-12T13:42:04.589 INFO:tasks.workunit.client.1.smithi110.stdout:8/448: dread d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:04.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/369: write d0/d7/f6 [2852088,119099] 0 2024-04-12T13:42:04.593 INFO:tasks.workunit.client.1.smithi110.stdout:8/449: truncate d1/d3/d3c/d5a/d6f/d7e/f8e 231689 0 2024-04-12T13:42:04.597 INFO:tasks.workunit.client.0.smithi060.stdout:9/367: creat d4/d8/d32/f78 x:0 0 0 2024-04-12T13:42:04.600 INFO:tasks.workunit.client.1.smithi110.stdout:4/578: mkdir d0/d75/d84/d89/dc0 0 2024-04-12T13:42:04.604 INFO:tasks.workunit.client.1.smithi110.stdout:1/418: symlink de/d1d/l95 0 2024-04-12T13:42:04.605 INFO:tasks.workunit.client.1.smithi110.stdout:1/419: fsync de/f58 0 2024-04-12T13:42:04.606 INFO:tasks.workunit.client.0.smithi060.stdout:0/411: rename d7/d9/d14/f5c to d7/d33/d88/f99 0 2024-04-12T13:42:04.607 INFO:tasks.workunit.client.1.smithi110.stdout:7/454: getdents d1/d31/d5d/d71 0 2024-04-12T13:42:04.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/467: link d6/dd/d1f/d32/f6f d6/dd/d1f/d25/d35/d50/d5f/f9b 0 2024-04-12T13:42:04.619 INFO:tasks.workunit.client.0.smithi060.stdout:1/523: symlink d1e/d23/d49/lb7 0 2024-04-12T13:42:04.620 INFO:tasks.workunit.client.0.smithi060.stdout:5/468: chown d6/dd/d1f/d25/d53/d87/f4f 123678523 1 2024-04-12T13:42:04.620 INFO:tasks.workunit.client.1.smithi110.stdout:4/579: rmdir d0/d19/d8f 39 2024-04-12T13:42:04.622 INFO:tasks.workunit.client.1.smithi110.stdout:2/481: mknod d6/c8b 0 2024-04-12T13:42:04.630 INFO:tasks.workunit.client.1.smithi110.stdout:8/450: truncate d1/d5/dd/f27 3424789 0 2024-04-12T13:42:04.632 INFO:tasks.workunit.client.1.smithi110.stdout:7/455: dread d1/d3/d4/f30 [0,4194304] 0 2024-04-12T13:42:04.632 INFO:tasks.workunit.client.0.smithi060.stdout:9/368: mkdir d4/d9/d19/d21/d79 0 2024-04-12T13:42:04.633 INFO:tasks.workunit.client.0.smithi060.stdout:9/369: readlink d4/l14 0 2024-04-12T13:42:04.635 INFO:tasks.workunit.client.0.smithi060.stdout:5/469: dread d6/d10/d12/f36 [0,4194304] 0 2024-04-12T13:42:04.639 INFO:tasks.workunit.client.1.smithi110.stdout:1/420: mkdir de/d15/d32/d61/d96 0 2024-04-12T13:42:04.640 INFO:tasks.workunit.client.0.smithi060.stdout:0/412: write d7/d9/f2b [4437368,92863] 0 2024-04-12T13:42:04.640 INFO:tasks.workunit.client.1.smithi110.stdout:4/580: mknod d0/d19/d1c/d50/cc1 0 2024-04-12T13:42:04.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/468: creat d7/d17/d19/d33/d63/d6d/fa0 x:0 0 0 2024-04-12T13:42:04.642 INFO:tasks.workunit.client.1.smithi110.stdout:9/540: link df/d13/d3b/d40/d56/fa0 df/d13/d26/d37/fae 0 2024-04-12T13:42:04.643 INFO:tasks.workunit.client.1.smithi110.stdout:4/581: chown d0/de/d32/d5f/c9d 0 1 2024-04-12T13:42:04.645 INFO:tasks.workunit.client.1.smithi110.stdout:2/482: mkdir d6/dc/dd/d49/d64/d8c 0 2024-04-12T13:42:04.647 INFO:tasks.workunit.client.1.smithi110.stdout:7/456: dwrite d1/d31/f59 [0,4194304] 0 2024-04-12T13:42:04.660 INFO:tasks.workunit.client.1.smithi110.stdout:1/421: dwrite de/d14/f53 [0,4194304] 0 2024-04-12T13:42:04.662 INFO:tasks.workunit.client.1.smithi110.stdout:7/457: symlink d1/d3/d4/d55/d56/l9c 0 2024-04-12T13:42:04.665 INFO:tasks.workunit.client.1.smithi110.stdout:9/541: dwrite df/d13/d2c/d2d/d39/d3a/f78 [0,4194304] 0 2024-04-12T13:42:04.673 INFO:tasks.workunit.client.1.smithi110.stdout:1/422: chown de/l6c 951 1 2024-04-12T13:42:04.677 INFO:tasks.workunit.client.1.smithi110.stdout:9/542: creat df/d8a/faf x:0 0 0 2024-04-12T13:42:04.681 INFO:tasks.workunit.client.1.smithi110.stdout:7/458: creat d1/d1b/d94/f9d x:0 0 0 2024-04-12T13:42:04.681 INFO:tasks.workunit.client.1.smithi110.stdout:6/474: sync 2024-04-12T13:42:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:3/469: write d7/da/d3f/d5c/f54 [386130,15227] 0 2024-04-12T13:42:04.686 INFO:tasks.workunit.client.1.smithi110.stdout:2/483: getdents d6/dc/dd/d49/d64/d4a/d55 0 2024-04-12T13:42:04.694 INFO:tasks.workunit.client.1.smithi110.stdout:7/459: creat d1/d1b/d3d/f9e x:0 0 0 2024-04-12T13:42:04.698 INFO:tasks.workunit.client.0.smithi060.stdout:3/470: dread - d7/d17/d19/d33/f5b zero size 2024-04-12T13:42:04.700 INFO:tasks.workunit.client.0.smithi060.stdout:3/471: chown d7/d17/d19/d33/f5b 518652362 1 2024-04-12T13:42:04.701 INFO:tasks.workunit.client.1.smithi110.stdout:2/484: mkdir d6/dc/d13/d80/d8d 0 2024-04-12T13:42:04.702 INFO:tasks.workunit.client.0.smithi060.stdout:5/470: getdents d6/dd/d27 0 2024-04-12T13:42:04.704 INFO:tasks.workunit.client.1.smithi110.stdout:1/423: creat de/d1d/f97 x:0 0 0 2024-04-12T13:42:04.706 INFO:tasks.workunit.client.0.smithi060.stdout:2/432: creat d6/d13/d31/d33/f82 x:0 0 0 2024-04-12T13:42:04.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/472: dread d7/da/d3f/d5c/f54 [0,4194304] 0 2024-04-12T13:42:04.711 INFO:tasks.workunit.client.1.smithi110.stdout:7/460: mknod d1/d3/d4/d36/c9f 0 2024-04-12T13:42:04.715 INFO:tasks.workunit.client.0.smithi060.stdout:5/471: rename d6/dd/d1f/d25/d53/d87/c1d to d6/dd/d1f/d25/d53/d8d/c9c 0 2024-04-12T13:42:04.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/472: chown d6/d10/d12/d38/f40 22 1 2024-04-12T13:42:04.718 INFO:tasks.workunit.client.0.smithi060.stdout:1/524: creat d1e/d46/fb8 x:0 0 0 2024-04-12T13:42:04.719 INFO:tasks.workunit.client.0.smithi060.stdout:1/525: stat d1e/d23/d2e/f39 0 2024-04-12T13:42:04.720 INFO:tasks.workunit.client.0.smithi060.stdout:1/526: chown d1e/d23/l24 75 1 2024-04-12T13:42:04.725 INFO:tasks.workunit.client.1.smithi110.stdout:7/461: dwrite d1/d3/d4/f2e [0,4194304] 0 2024-04-12T13:42:04.734 INFO:tasks.workunit.client.1.smithi110.stdout:1/424: mknod de/c98 0 2024-04-12T13:42:04.734 INFO:tasks.workunit.client.1.smithi110.stdout:1/425: stat de/d15/f3f 0 2024-04-12T13:42:04.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/403: write d9/f11 [2520015,15239] 0 2024-04-12T13:42:04.735 INFO:tasks.workunit.client.0.smithi060.stdout:1/527: dread - d1e/d23/d49/d4e/f77 zero size 2024-04-12T13:42:04.737 INFO:tasks.workunit.client.1.smithi110.stdout:7/462: stat d1/d3/d4/d36/d76/l7f 0 2024-04-12T13:42:04.737 INFO:tasks.workunit.client.1.smithi110.stdout:1/426: symlink de/d14/d34/l99 0 2024-04-12T13:42:04.740 INFO:tasks.workunit.client.1.smithi110.stdout:7/463: write d1/d3/d4/d55/d82/f6a [93259,47286] 0 2024-04-12T13:42:04.741 INFO:tasks.workunit.client.0.smithi060.stdout:1/528: mknod d1e/d23/d2e/d30/d51/cb9 0 2024-04-12T13:42:04.743 INFO:tasks.workunit.client.1.smithi110.stdout:7/464: write d1/d3/d4/d36/f3a [1633852,29493] 0 2024-04-12T13:42:04.745 INFO:tasks.workunit.client.0.smithi060.stdout:1/529: rename d1e/d23/d2e/d5e to d1e/d23/d2e/d5e/d68/d9a/dba 22 2024-04-12T13:42:04.752 INFO:tasks.workunit.client.1.smithi110.stdout:1/427: dwrite de/f80 [0,4194304] 0 2024-04-12T13:42:04.757 INFO:tasks.workunit.client.0.smithi060.stdout:5/473: dread d6/dd/d1f/d32/d46/f92 [0,4194304] 0 2024-04-12T13:42:04.760 INFO:tasks.workunit.client.0.smithi060.stdout:1/530: getdents d1e/d23/d2e/d86 0 2024-04-12T13:42:04.766 INFO:tasks.workunit.client.0.smithi060.stdout:1/531: fdatasync d1e/d23/d49/d4e/f77 0 2024-04-12T13:42:04.767 INFO:tasks.workunit.client.0.smithi060.stdout:6/526: dwrite d1/d7/da/dc/d24/d2d/f3d [4194304,4194304] 0 2024-04-12T13:42:04.768 INFO:tasks.workunit.client.0.smithi060.stdout:6/527: stat d1/d7/l79 0 2024-04-12T13:42:04.771 INFO:tasks.workunit.client.1.smithi110.stdout:3/460: link d5/dc/d31/d3b/d5b/l70 d5/dc/d31/d3b/l9c 0 2024-04-12T13:42:04.773 INFO:tasks.workunit.client.1.smithi110.stdout:3/461: write d5/dc/f85 [143878,124647] 0 2024-04-12T13:42:04.773 INFO:tasks.workunit.client.1.smithi110.stdout:5/411: write da/db/f37 [284153,55183] 0 2024-04-12T13:42:04.776 INFO:tasks.workunit.client.0.smithi060.stdout:1/532: creat d1e/d23/d2e/d5e/d68/fbb x:0 0 0 2024-04-12T13:42:04.778 INFO:tasks.workunit.client.0.smithi060.stdout:4/414: creat d6/d7/dd/f91 x:0 0 0 2024-04-12T13:42:04.780 INFO:tasks.workunit.client.0.smithi060.stdout:6/528: unlink d1/d7/da/d20/c40 0 2024-04-12T13:42:04.780 INFO:tasks.workunit.client.0.smithi060.stdout:1/533: read d1e/d23/d2e/d30/d51/f8a [287827,92887] 0 2024-04-12T13:42:04.783 INFO:tasks.workunit.client.1.smithi110.stdout:5/412: mknod da/d2e/d45/d29/d58/c96 0 2024-04-12T13:42:04.783 INFO:tasks.workunit.client.0.smithi060.stdout:1/534: chown d1e/l20 377 1 2024-04-12T13:42:04.786 INFO:tasks.workunit.client.0.smithi060.stdout:4/415: creat d6/d7/dd/df/f92 x:0 0 0 2024-04-12T13:42:04.787 INFO:tasks.workunit.client.0.smithi060.stdout:6/529: fdatasync d1/d7/da/dc/d24/f46 0 2024-04-12T13:42:04.791 INFO:tasks.workunit.client.0.smithi060.stdout:4/416: creat d6/d7/dd/df/f93 x:0 0 0 2024-04-12T13:42:04.793 INFO:tasks.workunit.client.0.smithi060.stdout:6/530: mkdir d1/d7/da/dc/d24/d2d/db0/dc3 0 2024-04-12T13:42:04.795 INFO:tasks.workunit.client.0.smithi060.stdout:1/535: link d1e/d1f/f22 d1e/d46/d8d/fbc 0 2024-04-12T13:42:04.796 INFO:tasks.workunit.client.0.smithi060.stdout:4/417: read d6/d2f/d51/f71 [839085,103417] 0 2024-04-12T13:42:04.797 INFO:tasks.workunit.client.1.smithi110.stdout:5/413: dwrite da/d2e/d45/d29/f7e [0,4194304] 0 2024-04-12T13:42:04.799 INFO:tasks.workunit.client.1.smithi110.stdout:0/389: rename d1/d8/c16 to d1/d8/d36/d65/c81 0 2024-04-12T13:42:04.799 INFO:tasks.workunit.client.1.smithi110.stdout:5/414: read - da/db/f8d zero size 2024-04-12T13:42:04.801 INFO:tasks.workunit.client.0.smithi060.stdout:6/531: dread d1/d7/da/dc/d24/f91 [0,4194304] 0 2024-04-12T13:42:04.803 INFO:tasks.workunit.client.0.smithi060.stdout:1/536: write d1e/d46/f62 [8825800,6748] 0 2024-04-12T13:42:04.804 INFO:tasks.workunit.client.0.smithi060.stdout:4/418: mkdir d6/d7/dd/d1a/d57/d63/d68/d94 0 2024-04-12T13:42:04.806 INFO:tasks.workunit.client.0.smithi060.stdout:4/419: write d6/d7/dd/df/f93 [319358,87719] 0 2024-04-12T13:42:04.807 INFO:tasks.workunit.client.1.smithi110.stdout:8/451: rename d1/d3/d3c/f57 to d1/f94 0 2024-04-12T13:42:04.811 INFO:tasks.workunit.client.1.smithi110.stdout:5/415: mkdir da/db/d3b/d40/d97 0 2024-04-12T13:42:04.812 INFO:tasks.workunit.client.0.smithi060.stdout:6/532: read - d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f84 zero size 2024-04-12T13:42:04.812 INFO:tasks.workunit.client.1.smithi110.stdout:5/416: chown da/d4f/f91 390599 1 2024-04-12T13:42:04.813 INFO:tasks.workunit.client.0.smithi060.stdout:7/370: write d0/d1b/f1d [1758344,74594] 0 2024-04-12T13:42:04.815 INFO:tasks.workunit.client.0.smithi060.stdout:7/371: dread - d0/d1b/f27 zero size 2024-04-12T13:42:04.818 INFO:tasks.workunit.client.0.smithi060.stdout:6/533: write d1/d7/da/dc/d24/d34/d51/d59/f9b [786004,89492] 0 2024-04-12T13:42:04.828 INFO:tasks.workunit.client.0.smithi060.stdout:1/537: getdents d1e/d23/d2e/d5e 0 2024-04-12T13:42:04.836 INFO:tasks.workunit.client.0.smithi060.stdout:1/538: creat d1e/d23/d49/d4e/fbd x:0 0 0 2024-04-12T13:42:04.837 INFO:tasks.workunit.client.0.smithi060.stdout:7/372: dread d0/d1b/f37 [0,4194304] 0 2024-04-12T13:42:04.841 INFO:tasks.workunit.client.0.smithi060.stdout:6/534: dread d1/d7/da/dc/d24/d34/d51/d97/da9/fb7 [0,4194304] 0 2024-04-12T13:42:04.843 INFO:tasks.workunit.client.0.smithi060.stdout:1/539: rename d1e/f87 to d1e/d23/d2e/d8e/d98/fbe 0 2024-04-12T13:42:04.844 INFO:tasks.workunit.client.0.smithi060.stdout:0/413: creat d7/f9a x:0 0 0 2024-04-12T13:42:04.846 INFO:tasks.workunit.client.0.smithi060.stdout:0/414: chown d7/d9/d4c/f55 841858947 1 2024-04-12T13:42:04.848 INFO:tasks.workunit.client.0.smithi060.stdout:9/370: dwrite d4/d8/f2c [0,4194304] 0 2024-04-12T13:42:04.856 INFO:tasks.workunit.client.0.smithi060.stdout:1/540: dread d1e/f7c [0,4194304] 0 2024-04-12T13:42:04.858 INFO:tasks.workunit.client.0.smithi060.stdout:0/415: mknod d7/d33/d5b/c9b 0 2024-04-12T13:42:04.858 INFO:tasks.workunit.client.0.smithi060.stdout:1/541: chown d1e/d46/f6f 14 1 2024-04-12T13:42:04.861 INFO:tasks.workunit.client.1.smithi110.stdout:4/582: creat d0/de/d2c/fc2 x:0 0 0 2024-04-12T13:42:04.863 INFO:tasks.workunit.client.0.smithi060.stdout:9/371: fdatasync d4/d9/d19/f4e 0 2024-04-12T13:42:04.869 INFO:tasks.workunit.client.1.smithi110.stdout:9/543: dwrite df/f25 [0,4194304] 0 2024-04-12T13:42:04.871 INFO:tasks.workunit.client.0.smithi060.stdout:3/473: write d7/d17/d19/f85 [923725,104258] 0 2024-04-12T13:42:04.873 INFO:tasks.workunit.client.1.smithi110.stdout:8/452: getdents d1/d5/dd/d31 0 2024-04-12T13:42:04.875 INFO:tasks.workunit.client.1.smithi110.stdout:2/485: truncate d6/dc/dd/f28 3189899 0 2024-04-12T13:42:04.876 INFO:tasks.workunit.client.0.smithi060.stdout:1/542: mkdir d1e/d23/d49/dbf 0 2024-04-12T13:42:04.878 INFO:tasks.workunit.client.0.smithi060.stdout:9/372: dread d4/d9/fc [0,4194304] 0 2024-04-12T13:42:04.878 INFO:tasks.workunit.client.1.smithi110.stdout:8/453: rmdir d1/d5 39 2024-04-12T13:42:04.880 INFO:tasks.workunit.client.0.smithi060.stdout:9/373: write d4/d8/f4d [650434,56051] 0 2024-04-12T13:42:04.883 INFO:tasks.workunit.client.1.smithi110.stdout:2/486: creat d6/dc/d1b/f8e x:0 0 0 2024-04-12T13:42:04.884 INFO:tasks.workunit.client.1.smithi110.stdout:4/583: dwrite d0/de/d2c/d57/fbf [0,4194304] 0 2024-04-12T13:42:04.887 INFO:tasks.workunit.client.0.smithi060.stdout:7/373: rename d0/d7/c36 to d0/c81 0 2024-04-12T13:42:04.889 INFO:tasks.workunit.client.1.smithi110.stdout:2/487: mkdir d6/dc/d1b/d8f 0 2024-04-12T13:42:04.890 INFO:tasks.workunit.client.0.smithi060.stdout:1/543: dwrite d1e/d23/d49/f54 [0,4194304] 0 2024-04-12T13:42:04.894 INFO:tasks.workunit.client.0.smithi060.stdout:8/404: truncate d9/d1b/d2b/f32 443085 0 2024-04-12T13:42:04.896 INFO:tasks.workunit.client.1.smithi110.stdout:7/465: write d1/f2a [3501349,84555] 0 2024-04-12T13:42:04.897 INFO:tasks.workunit.client.0.smithi060.stdout:7/374: rmdir d0/d7/d43/d4d 39 2024-04-12T13:42:04.899 INFO:tasks.workunit.client.1.smithi110.stdout:6/475: rename d7/d10/d1c/d2b/d48/c68 to d7/c97 0 2024-04-12T13:42:04.901 INFO:tasks.workunit.client.0.smithi060.stdout:7/375: write d0/d3d/f56 [1840448,96724] 0 2024-04-12T13:42:04.901 INFO:tasks.workunit.client.1.smithi110.stdout:2/488: creat d6/dc/d13/f90 x:0 0 0 2024-04-12T13:42:04.901 INFO:tasks.workunit.client.1.smithi110.stdout:1/428: write fb [53971,108850] 0 2024-04-12T13:42:04.903 INFO:tasks.workunit.client.1.smithi110.stdout:1/429: readlink de/d1d/l1f 0 2024-04-12T13:42:04.908 INFO:tasks.workunit.client.1.smithi110.stdout:7/466: mkdir d1/d3/d84/da0 0 2024-04-12T13:42:04.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/405: creat d9/d1d/d5e/f87 x:0 0 0 2024-04-12T13:42:04.914 INFO:tasks.workunit.client.1.smithi110.stdout:6/476: symlink d7/d10/d1c/d4d/l98 0 2024-04-12T13:42:04.915 INFO:tasks.workunit.client.0.smithi060.stdout:5/474: dwrite d6/d89/f8f [0,4194304] 0 2024-04-12T13:42:04.918 INFO:tasks.workunit.client.0.smithi060.stdout:5/475: chown d6/dd/d1f/d25/d42/d6b/f80 0 1 2024-04-12T13:42:04.920 INFO:tasks.workunit.client.0.smithi060.stdout:7/376: fdatasync d0/d7/f33 0 2024-04-12T13:42:04.921 INFO:tasks.workunit.client.1.smithi110.stdout:1/430: readlink de/l43 0 2024-04-12T13:42:04.923 INFO:tasks.workunit.client.0.smithi060.stdout:8/406: mknod d9/d1b/c88 0 2024-04-12T13:42:04.924 INFO:tasks.workunit.client.1.smithi110.stdout:7/467: dwrite d1/d3/d4/d55/f62 [0,4194304] 0 2024-04-12T13:42:04.925 INFO:tasks.workunit.client.0.smithi060.stdout:1/544: dread d1e/d23/d49/d4e/f58 [0,4194304] 0 2024-04-12T13:42:04.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/407: dread - d9/d1b/d37/d4d/d63/f85 zero size 2024-04-12T13:42:04.929 INFO:tasks.workunit.client.1.smithi110.stdout:5/417: rename da/d2e/d45/d25/d5d/c64 to da/d2e/d45/d29/d58/c98 0 2024-04-12T13:42:04.931 INFO:tasks.workunit.client.0.smithi060.stdout:5/476: rmdir d6/dd 39 2024-04-12T13:42:04.933 INFO:tasks.workunit.client.0.smithi060.stdout:7/377: creat d0/d7/d43/d63/d6f/f82 x:0 0 0 2024-04-12T13:42:04.934 INFO:tasks.workunit.client.1.smithi110.stdout:2/489: dwrite d6/d18/f29 [4194304,4194304] 0 2024-04-12T13:42:04.935 INFO:tasks.workunit.client.1.smithi110.stdout:3/462: dread - d5/dc/d31/d3b/d32/d3e/d5f/f8b zero size 2024-04-12T13:42:04.944 INFO:tasks.workunit.client.0.smithi060.stdout:7/378: dread d0/d7/d43/f46 [0,4194304] 0 2024-04-12T13:42:04.951 INFO:tasks.workunit.client.1.smithi110.stdout:0/390: fsync d1/d8/d36/d51/d60/f18 0 2024-04-12T13:42:04.952 INFO:tasks.workunit.client.0.smithi060.stdout:5/477: creat d6/dd/d1f/d25/d53/d87/f9d x:0 0 0 2024-04-12T13:42:04.954 INFO:tasks.workunit.client.0.smithi060.stdout:5/478: stat d6/d10/f31 0 2024-04-12T13:42:04.954 INFO:tasks.workunit.client.1.smithi110.stdout:0/391: read d1/d8/d36/d51/d60/f70 [4080017,46680] 0 2024-04-12T13:42:04.959 INFO:tasks.workunit.client.0.smithi060.stdout:4/420: dwrite d6/d7/dd/d1a/d19/f52 [0,4194304] 0 2024-04-12T13:42:04.965 INFO:tasks.workunit.client.0.smithi060.stdout:1/545: creat d1e/d23/d49/fc0 x:0 0 0 2024-04-12T13:42:04.970 INFO:tasks.workunit.client.1.smithi110.stdout:0/392: creat d1/d8/d36/d63/f82 x:0 0 0 2024-04-12T13:42:04.970 INFO:tasks.workunit.client.0.smithi060.stdout:4/421: fdatasync d6/d7/dd/d1a/d57/f83 0 2024-04-12T13:42:04.972 INFO:tasks.workunit.client.1.smithi110.stdout:2/490: creat d6/dc/dd/d49/d64/d4a/d55/d82/d84/f91 x:0 0 0 2024-04-12T13:42:04.973 INFO:tasks.workunit.client.0.smithi060.stdout:7/379: dread d0/d1b/f72 [0,4194304] 0 2024-04-12T13:42:04.973 INFO:tasks.workunit.client.1.smithi110.stdout:0/393: truncate d1/d8/d36/d63/f82 89128 0 2024-04-12T13:42:04.975 INFO:tasks.workunit.client.0.smithi060.stdout:8/408: getdents d9/d1b/d3c/d60/d65 0 2024-04-12T13:42:04.977 INFO:tasks.workunit.client.0.smithi060.stdout:1/546: creat d1e/d23/d2e/d8e/d98/fc1 x:0 0 0 2024-04-12T13:42:04.979 INFO:tasks.workunit.client.0.smithi060.stdout:5/479: dwrite d6/dd/d1f/d25/d35/d50/d5f/f7f [0,4194304] 0 2024-04-12T13:42:04.979 INFO:tasks.workunit.client.0.smithi060.stdout:8/409: dread - d9/d1b/d37/d4d/f7e zero size 2024-04-12T13:42:04.980 INFO:tasks.workunit.client.1.smithi110.stdout:9/544: rename df/c22 to df/d13/cb0 0 2024-04-12T13:42:04.985 INFO:tasks.workunit.client.0.smithi060.stdout:7/380: write d0/d1b/f72 [843837,108987] 0 2024-04-12T13:42:04.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/422: mknod d6/d7/db/d62/c95 0 2024-04-12T13:42:04.991 INFO:tasks.workunit.client.1.smithi110.stdout:0/394: dwrite d1/d8/d36/d51/f68 [0,4194304] 0 2024-04-12T13:42:04.993 INFO:tasks.workunit.client.0.smithi060.stdout:6/535: dwrite d1/d7/da/dc/d24/d34/d51/d59/f4d [0,4194304] 0 2024-04-12T13:42:04.997 INFO:tasks.workunit.client.0.smithi060.stdout:1/547: creat d1e/d23/d49/d4e/fc2 x:0 0 0 2024-04-12T13:42:04.997 INFO:tasks.workunit.client.0.smithi060.stdout:3/474: truncate d7/f47 74443 0 2024-04-12T13:42:04.999 INFO:tasks.workunit.client.1.smithi110.stdout:9/545: read df/d13/d2c/d2d/d39/f79 [285934,130526] 0 2024-04-12T13:42:05.000 INFO:tasks.workunit.client.0.smithi060.stdout:8/410: rmdir d9/d1b/d3c/d6e 39 2024-04-12T13:42:05.002 INFO:tasks.workunit.client.0.smithi060.stdout:5/480: symlink d6/dd/d1f/l9e 0 2024-04-12T13:42:05.003 INFO:tasks.workunit.client.0.smithi060.stdout:0/416: dwrite d7/d9/f31 [0,4194304] 0 2024-04-12T13:42:05.007 INFO:tasks.workunit.client.1.smithi110.stdout:8/454: truncate d1/d3/d3c/d5a/f8a 3043178 0 2024-04-12T13:42:05.013 INFO:tasks.workunit.client.1.smithi110.stdout:0/395: unlink d1/d3c/d6b/c75 0 2024-04-12T13:42:05.014 INFO:tasks.workunit.client.1.smithi110.stdout:4/584: dwrite d0/d75/d84/f77 [0,4194304] 0 2024-04-12T13:42:05.016 INFO:tasks.workunit.client.1.smithi110.stdout:0/396: write d1/f7 [445443,121030] 0 2024-04-12T13:42:05.018 INFO:tasks.workunit.client.1.smithi110.stdout:2/491: creat d6/dc/dd/d49/d64/d4a/f92 x:0 0 0 2024-04-12T13:42:05.019 INFO:tasks.workunit.client.1.smithi110.stdout:4/585: write d0/d19/f85 [5698609,100848] 0 2024-04-12T13:42:05.026 INFO:tasks.workunit.client.1.smithi110.stdout:9/546: write df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/d89/fa5 [485813,78121] 0 2024-04-12T13:42:05.028 INFO:tasks.workunit.client.1.smithi110.stdout:7/468: rename d1/d31/d5d/d71 to d1/d3/d4/d36/da1 0 2024-04-12T13:42:05.031 INFO:tasks.workunit.client.1.smithi110.stdout:7/469: fdatasync d1/d3/d4/d36/d4b/f3b 0 2024-04-12T13:42:05.032 INFO:tasks.workunit.client.1.smithi110.stdout:5/418: stat da/d2e/d45/d29/d58/c98 0 2024-04-12T13:42:05.033 INFO:tasks.workunit.client.1.smithi110.stdout:7/470: write d1/d31/f81 [391729,30355] 0 2024-04-12T13:42:05.035 INFO:tasks.workunit.client.0.smithi060.stdout:3/475: creat d7/d17/d19/d96/fa1 x:0 0 0 2024-04-12T13:42:05.035 INFO:tasks.workunit.client.1.smithi110.stdout:5/419: write da/d2e/d45/d29/d66/f70 [1046718,1215] 0 2024-04-12T13:42:05.036 INFO:tasks.workunit.client.0.smithi060.stdout:0/417: unlink d7/d9/l13 0 2024-04-12T13:42:05.037 INFO:tasks.workunit.client.1.smithi110.stdout:5/420: readlink da/db/d52/l5f 0 2024-04-12T13:42:05.039 INFO:tasks.workunit.client.1.smithi110.stdout:5/421: dread - da/d4f/f7d zero size 2024-04-12T13:42:05.042 INFO:tasks.workunit.client.0.smithi060.stdout:0/418: write d7/d9/f48 [1664825,6239] 0 2024-04-12T13:42:05.043 INFO:tasks.workunit.client.0.smithi060.stdout:8/411: rename d9/f2c to d9/d1b/d37/d4d/d63/f89 0 2024-04-12T13:42:05.044 INFO:tasks.workunit.client.1.smithi110.stdout:0/397: symlink d1/d8/d36/d51/l83 0 2024-04-12T13:42:05.045 INFO:tasks.workunit.client.0.smithi060.stdout:7/381: symlink d0/d78/l83 0 2024-04-12T13:42:05.046 INFO:tasks.workunit.client.1.smithi110.stdout:4/586: fsync d0/d19/d1c/d50/f67 0 2024-04-12T13:42:05.049 INFO:tasks.workunit.client.1.smithi110.stdout:9/547: mkdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/db1 0 2024-04-12T13:42:05.050 INFO:tasks.workunit.client.1.smithi110.stdout:6/477: dwrite d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:42:05.051 INFO:tasks.workunit.client.1.smithi110.stdout:7/471: mkdir d1/d3/d4/d36/d76/da2 0 2024-04-12T13:42:05.052 INFO:tasks.workunit.client.0.smithi060.stdout:3/476: mkdir d7/d17/d27/d36/d53/da2 0 2024-04-12T13:42:05.053 INFO:tasks.workunit.client.1.smithi110.stdout:9/548: write df/d38/d6e/faa [813347,39658] 0 2024-04-12T13:42:05.054 INFO:tasks.workunit.client.0.smithi060.stdout:3/477: fsync d7/d17/d27/d36/f46 0 2024-04-12T13:42:05.054 INFO:tasks.workunit.client.1.smithi110.stdout:6/478: fdatasync d7/d10/d1c/d2b/d3a/f81 0 2024-04-12T13:42:05.055 INFO:tasks.workunit.client.1.smithi110.stdout:7/472: fdatasync d1/d3/d4/d36/da1/f80 0 2024-04-12T13:42:05.056 INFO:tasks.workunit.client.1.smithi110.stdout:5/422: mknod da/db/d61/d79/d82/c99 0 2024-04-12T13:42:05.059 INFO:tasks.workunit.client.1.smithi110.stdout:5/423: write da/db/d61/d79/d88/f95 [708807,16813] 0 2024-04-12T13:42:05.061 INFO:tasks.workunit.client.1.smithi110.stdout:8/455: dwrite d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:42:05.062 INFO:tasks.workunit.client.1.smithi110.stdout:2/492: read d6/dc/d13/f43 [862931,16987] 0 2024-04-12T13:42:05.064 INFO:tasks.workunit.client.1.smithi110.stdout:7/473: chown d1/d3/d4/d55/d56/c87 44 1 2024-04-12T13:42:05.065 INFO:tasks.workunit.client.1.smithi110.stdout:5/424: write da/d2e/d45/d29/d66/f70 [813690,95698] 0 2024-04-12T13:42:05.068 INFO:tasks.workunit.client.1.smithi110.stdout:0/398: creat d1/d8/d36/d65/f84 x:0 0 0 2024-04-12T13:42:05.068 INFO:tasks.workunit.client.1.smithi110.stdout:2/493: dread - d6/dc/dd/d49/f8a zero size 2024-04-12T13:42:05.068 INFO:tasks.workunit.client.1.smithi110.stdout:9/549: read df/d13/d2c/d2d/d39/d3a/f62 [21263,47783] 0 2024-04-12T13:42:05.068 INFO:tasks.workunit.client.1.smithi110.stdout:4/587: mknod d0/d78/cc3 0 2024-04-12T13:42:05.070 INFO:tasks.workunit.client.1.smithi110.stdout:2/494: chown d6/dc/dd/d49/c7a 2011 1 2024-04-12T13:42:05.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/423: write d6/d2f/d51/f71 [1414723,4702] 0 2024-04-12T13:42:05.074 INFO:tasks.workunit.client.0.smithi060.stdout:1/548: write d1e/f45 [1431358,8935] 0 2024-04-12T13:42:05.076 INFO:tasks.workunit.client.1.smithi110.stdout:1/431: sync 2024-04-12T13:42:05.083 INFO:tasks.workunit.client.0.smithi060.stdout:6/536: truncate d1/d2c/f70 982924 0 2024-04-12T13:42:05.087 INFO:tasks.workunit.client.1.smithi110.stdout:3/463: rename d5/dc/d31/d3b/d5b/f8d to d5/dc/d31/d3b/f9d 0 2024-04-12T13:42:05.090 INFO:tasks.workunit.client.0.smithi060.stdout:4/424: dwrite d6/d2f/d51/f71 [0,4194304] 0 2024-04-12T13:42:05.092 INFO:tasks.workunit.client.1.smithi110.stdout:8/456: symlink d1/d3/d3c/d5a/d6f/l95 0 2024-04-12T13:42:05.094 INFO:tasks.workunit.client.1.smithi110.stdout:8/457: write d1/d3/d3c/d5a/d6f/d7e/f8e [314767,17484] 0 2024-04-12T13:42:05.096 INFO:tasks.workunit.client.1.smithi110.stdout:8/458: fdatasync d1/d3/d3c/d5a/f6d 0 2024-04-12T13:42:05.097 INFO:tasks.workunit.client.1.smithi110.stdout:0/399: mknod d1/d3c/d6b/c85 0 2024-04-12T13:42:05.097 INFO:tasks.workunit.client.1.smithi110.stdout:7/474: dread d1/d3/d84/f8d [0,4194304] 0 2024-04-12T13:42:05.098 INFO:tasks.workunit.client.1.smithi110.stdout:8/459: fdatasync d1/d3/d3c/d5a/d6f/d7e/f8e 0 2024-04-12T13:42:05.099 INFO:tasks.workunit.client.1.smithi110.stdout:4/588: rmdir d0/d13 39 2024-04-12T13:42:05.103 INFO:tasks.workunit.client.1.smithi110.stdout:9/550: mkdir df/d13/d2c/d2d/d39/d3a/db2 0 2024-04-12T13:42:05.104 INFO:tasks.workunit.client.0.smithi060.stdout:7/382: creat d0/d78/f84 x:0 0 0 2024-04-12T13:42:05.106 INFO:tasks.workunit.client.1.smithi110.stdout:2/495: mknod d6/dc/dd/d49/d64/d4a/d3c/d6e/c93 0 2024-04-12T13:42:05.108 INFO:tasks.workunit.client.1.smithi110.stdout:1/432: creat de/d14/d34/d55/f9a x:0 0 0 2024-04-12T13:42:05.113 INFO:tasks.workunit.client.1.smithi110.stdout:0/400: dwrite d1/d8/d36/f44 [0,4194304] 0 2024-04-12T13:42:05.122 INFO:tasks.workunit.client.0.smithi060.stdout:5/481: creat d6/d10/d12/f9f x:0 0 0 2024-04-12T13:42:05.125 INFO:tasks.workunit.client.0.smithi060.stdout:5/482: chown d6/d10/f2b 244692458 1 2024-04-12T13:42:05.128 INFO:tasks.workunit.client.1.smithi110.stdout:7/475: mknod d1/d31/d5d/ca3 0 2024-04-12T13:42:05.129 INFO:tasks.workunit.client.1.smithi110.stdout:7/476: stat d1/d3/d4/f2d 0 2024-04-12T13:42:05.130 INFO:tasks.workunit.client.0.smithi060.stdout:3/478: dwrite d7/d17/f42 [0,4194304] 0 2024-04-12T13:42:05.131 INFO:tasks.workunit.client.1.smithi110.stdout:8/460: creat d1/d3/d35/d3a/d3e/d64/d85/f96 x:0 0 0 2024-04-12T13:42:05.132 INFO:tasks.workunit.client.1.smithi110.stdout:8/461: stat d1/l29 0 2024-04-12T13:42:05.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/412: mkdir d9/d1b/d2b/d82/d8a 0 2024-04-12T13:42:05.134 INFO:tasks.workunit.client.1.smithi110.stdout:8/462: fdatasync d1/d3/d3c/d5a/d6f/d7e/f47 0 2024-04-12T13:42:05.134 INFO:tasks.workunit.client.0.smithi060.stdout:3/479: rename d7/da/d3f/d5c/d25 to d7/da/d3f/d5c/d25/d4d/da3 22 2024-04-12T13:42:05.136 INFO:tasks.workunit.client.0.smithi060.stdout:8/413: write d9/d1b/d37/d4d/d63/f85 [326675,73010] 0 2024-04-12T13:42:05.136 INFO:tasks.workunit.client.0.smithi060.stdout:7/383: unlink d0/f4c 0 2024-04-12T13:42:05.137 INFO:tasks.workunit.client.1.smithi110.stdout:8/463: rename d1/d3/d35/d3a/d41 to d1/d3/d35/d3a/d41/d77/d97 22 2024-04-12T13:42:05.139 INFO:tasks.workunit.client.0.smithi060.stdout:4/425: symlink d6/d7/dd/d1a/d57/d63/d68/d94/l96 0 2024-04-12T13:42:05.140 INFO:tasks.workunit.client.0.smithi060.stdout:3/480: truncate d7/da/d3f/d5c/d25/f5f 648498 0 2024-04-12T13:42:05.141 INFO:tasks.workunit.client.1.smithi110.stdout:2/496: rmdir d6/dc/d6f 39 2024-04-12T13:42:05.142 INFO:tasks.workunit.client.0.smithi060.stdout:1/549: dread d1e/d1f/f4a [0,4194304] 0 2024-04-12T13:42:05.144 INFO:tasks.workunit.client.1.smithi110.stdout:2/497: chown d6/dc/dd/d49/d64/c2d 88 1 2024-04-12T13:42:05.145 INFO:tasks.workunit.client.1.smithi110.stdout:1/433: symlink de/d15/d32/d5e/l9b 0 2024-04-12T13:42:05.147 INFO:tasks.workunit.client.1.smithi110.stdout:3/464: fsync d5/dc/d31/d3b/d32/d3e/d5f/f9b 0 2024-04-12T13:42:05.148 INFO:tasks.workunit.client.1.smithi110.stdout:3/465: write d5/f1f [2756171,82659] 0 2024-04-12T13:42:05.149 INFO:tasks.workunit.client.1.smithi110.stdout:0/401: symlink d1/d8/d36/d63/d4a/l86 0 2024-04-12T13:42:05.152 INFO:tasks.workunit.client.0.smithi060.stdout:2/433: sync 2024-04-12T13:42:05.152 INFO:tasks.workunit.client.0.smithi060.stdout:9/374: sync 2024-04-12T13:42:05.152 INFO:tasks.workunit.client.1.smithi110.stdout:7/477: symlink d1/d3/d4/d55/d56/la4 0 2024-04-12T13:42:05.153 INFO:tasks.workunit.client.0.smithi060.stdout:9/375: chown d4/d9/d19/d21 350365869 1 2024-04-12T13:42:05.153 INFO:tasks.workunit.client.0.smithi060.stdout:8/414: mkdir d9/d1b/d37/d4d/d63/d66/d8b 0 2024-04-12T13:42:05.154 INFO:tasks.workunit.client.1.smithi110.stdout:7/478: read d1/d1b/d74/f79 [1619535,100389] 0 2024-04-12T13:42:05.156 INFO:tasks.workunit.client.0.smithi060.stdout:8/415: write d9/f11 [2463543,73651] 0 2024-04-12T13:42:05.159 INFO:tasks.workunit.client.0.smithi060.stdout:8/416: chown d9/d1b/c88 668 1 2024-04-12T13:42:05.162 INFO:tasks.workunit.client.0.smithi060.stdout:3/481: mknod d7/d17/d27/ca4 0 2024-04-12T13:42:05.163 INFO:tasks.workunit.client.0.smithi060.stdout:6/537: write d1/d7/da/dc/d24/f37 [1021690,121597] 0 2024-04-12T13:42:05.164 INFO:tasks.workunit.client.0.smithi060.stdout:1/550: dwrite d1e/d23/f89 [0,4194304] 0 2024-04-12T13:42:05.166 INFO:tasks.workunit.client.0.smithi060.stdout:1/551: readlink l12 0 2024-04-12T13:42:05.166 INFO:tasks.workunit.client.1.smithi110.stdout:2/498: unlink d6/dc/dd/f16 0 2024-04-12T13:42:05.167 INFO:tasks.workunit.client.0.smithi060.stdout:1/552: fsync d1e/f28 0 2024-04-12T13:42:05.169 INFO:tasks.workunit.client.1.smithi110.stdout:2/499: write d6/dc/d1b/d57/f63 [91349,87909] 0 2024-04-12T13:42:05.170 INFO:tasks.workunit.client.0.smithi060.stdout:7/384: mkdir d0/d7/d43/d85 0 2024-04-12T13:42:05.172 INFO:tasks.workunit.client.0.smithi060.stdout:7/385: chown d0/c29 16152 1 2024-04-12T13:42:05.172 INFO:tasks.workunit.client.1.smithi110.stdout:2/500: write d6/dc/f3f [589093,62396] 0 2024-04-12T13:42:05.176 INFO:tasks.workunit.client.0.smithi060.stdout:7/386: write d0/d1b/f5f [4983706,51793] 0 2024-04-12T13:42:05.178 INFO:tasks.workunit.client.0.smithi060.stdout:7/387: chown d0/c42 24 1 2024-04-12T13:42:05.180 INFO:tasks.workunit.client.0.smithi060.stdout:9/376: mkdir d4/d33/d65/d7a 0 2024-04-12T13:42:05.183 INFO:tasks.workunit.client.0.smithi060.stdout:3/482: dwrite d7/d17/d27/d36/d53/f94 [0,4194304] 0 2024-04-12T13:42:05.183 INFO:tasks.workunit.client.0.smithi060.stdout:0/419: getdents d7/d9 0 2024-04-12T13:42:05.185 INFO:tasks.workunit.client.1.smithi110.stdout:8/464: mknod d1/d5/d1f/d8f/c98 0 2024-04-12T13:42:05.185 INFO:tasks.workunit.client.0.smithi060.stdout:0/420: readlink d7/d41/l47 0 2024-04-12T13:42:05.188 INFO:tasks.workunit.client.1.smithi110.stdout:8/465: write d1/d3/d35/d3a/d41/f53 [2835607,84501] 0 2024-04-12T13:42:05.189 INFO:tasks.workunit.client.0.smithi060.stdout:3/483: truncate d7/da/d3f/d5c/d25/d4d/f6e 520431 0 2024-04-12T13:42:05.189 INFO:tasks.workunit.client.1.smithi110.stdout:6/479: dwrite d7/d25/d30/d44/d3d/f49 [0,4194304] 0 2024-04-12T13:42:05.189 INFO:tasks.workunit.client.0.smithi060.stdout:6/538: rmdir d1/d7 39 2024-04-12T13:42:05.191 INFO:tasks.workunit.client.1.smithi110.stdout:2/501: creat d6/dc/dd/d49/d64/d4a/d55/d82/d84/f94 x:0 0 0 2024-04-12T13:42:05.193 INFO:tasks.workunit.client.0.smithi060.stdout:5/483: creat d6/fa0 x:0 0 0 2024-04-12T13:42:05.194 INFO:tasks.workunit.client.0.smithi060.stdout:9/377: dread d4/f77 [0,4194304] 0 2024-04-12T13:42:05.195 INFO:tasks.workunit.client.1.smithi110.stdout:2/502: write d6/dc/d1b/f2a [3278618,11337] 0 2024-04-12T13:42:05.196 INFO:tasks.workunit.client.0.smithi060.stdout:1/553: mknod d1e/d23/d2e/d8e/cc3 0 2024-04-12T13:42:05.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/426: dwrite d6/d21/f5d [0,4194304] 0 2024-04-12T13:42:05.199 INFO:tasks.workunit.client.1.smithi110.stdout:2/503: stat d6/dc/dd/d49/d64/d4a/d51/f78 0 2024-04-12T13:42:05.199 INFO:tasks.workunit.client.1.smithi110.stdout:9/551: dwrite df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f7e [0,4194304] 0 2024-04-12T13:42:05.201 INFO:tasks.workunit.client.1.smithi110.stdout:6/480: mkdir d7/d10/d41/d99 0 2024-04-12T13:42:05.202 INFO:tasks.workunit.client.1.smithi110.stdout:8/466: dread d1/d3/d3c/d5a/f82 [0,4194304] 0 2024-04-12T13:42:05.203 INFO:tasks.workunit.client.0.smithi060.stdout:2/434: truncate d6/d13/d5b/f66 58301 0 2024-04-12T13:42:05.203 INFO:tasks.workunit.client.1.smithi110.stdout:9/552: truncate df/d8a/f8e 4627011 0 2024-04-12T13:42:05.204 INFO:tasks.workunit.client.0.smithi060.stdout:7/388: mknod d0/d78/c86 0 2024-04-12T13:42:05.205 INFO:tasks.workunit.client.1.smithi110.stdout:8/467: write d1/d3/fe [71118,95274] 0 2024-04-12T13:42:05.206 INFO:tasks.workunit.client.0.smithi060.stdout:4/427: dread d6/d7/f3b [0,4194304] 0 2024-04-12T13:42:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:7/389: chown d0/d3d/f40 2209832 1 2024-04-12T13:42:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:8/417: mkdir d9/d1b/d3c/d8c 0 2024-04-12T13:42:05.207 INFO:tasks.workunit.client.1.smithi110.stdout:6/481: truncate d7/d10/d1c/d2b/d3a/d82/f7b 722189 0 2024-04-12T13:42:05.208 INFO:tasks.workunit.client.1.smithi110.stdout:3/466: getdents d5/dc/d20/d2d/d4f 0 2024-04-12T13:42:05.209 INFO:tasks.workunit.client.0.smithi060.stdout:8/418: fsync d9/da/f24 0 2024-04-12T13:42:05.212 INFO:tasks.workunit.client.0.smithi060.stdout:3/484: creat d7/d17/d27/fa5 x:0 0 0 2024-04-12T13:42:05.214 INFO:tasks.workunit.client.0.smithi060.stdout:8/419: chown d9/f71 26855 1 2024-04-12T13:42:05.214 INFO:tasks.workunit.client.0.smithi060.stdout:4/428: truncate d6/d7/dd/d4d/d69/f8a 304407 0 2024-04-12T13:42:05.216 INFO:tasks.workunit.client.1.smithi110.stdout:9/553: mkdir df/d38/db3 0 2024-04-12T13:42:05.216 INFO:tasks.workunit.client.0.smithi060.stdout:9/378: chown d4/c13 9739 1 2024-04-12T13:42:05.217 INFO:tasks.workunit.client.0.smithi060.stdout:1/554: dread d1e/d23/d49/f54 [4194304,4194304] 0 2024-04-12T13:42:05.220 INFO:tasks.workunit.client.0.smithi060.stdout:8/420: truncate d9/d1d/f4c 5626073 0 2024-04-12T13:42:05.220 INFO:tasks.workunit.client.1.smithi110.stdout:8/468: fdatasync d1/d3/d3c/d5a/f82 0 2024-04-12T13:42:05.221 INFO:tasks.workunit.client.1.smithi110.stdout:8/469: stat d1/d3/d35/d3a/c5b 0 2024-04-12T13:42:05.223 INFO:tasks.workunit.client.0.smithi060.stdout:2/435: symlink d6/d10/d16/l83 0 2024-04-12T13:42:05.223 INFO:tasks.workunit.client.0.smithi060.stdout:5/484: dwrite f1 [0,4194304] 0 2024-04-12T13:42:05.224 INFO:tasks.workunit.client.0.smithi060.stdout:0/421: symlink d7/l9c 0 2024-04-12T13:42:05.227 INFO:tasks.workunit.client.1.smithi110.stdout:2/504: creat d6/dc/dd/d49/d64/d8c/f95 x:0 0 0 2024-04-12T13:42:05.230 INFO:tasks.workunit.client.1.smithi110.stdout:9/554: mkdir df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/db4 0 2024-04-12T13:42:05.234 INFO:tasks.workunit.client.1.smithi110.stdout:6/482: fdatasync d7/d10/d1c/d2b/d48/d54/f86 0 2024-04-12T13:42:05.238 INFO:tasks.workunit.client.1.smithi110.stdout:2/505: write d6/dc/f14 [3638113,52664] 0 2024-04-12T13:42:05.246 INFO:tasks.workunit.client.1.smithi110.stdout:3/467: dread d5/dc/f24 [0,4194304] 0 2024-04-12T13:42:05.248 INFO:tasks.workunit.client.1.smithi110.stdout:3/468: truncate d5/d86/f93 573938 0 2024-04-12T13:42:05.249 INFO:tasks.workunit.client.1.smithi110.stdout:3/469: chown d5/dc/f24 11 1 2024-04-12T13:42:05.260 INFO:tasks.workunit.client.0.smithi060.stdout:2/436: unlink d6/d10/c11 0 2024-04-12T13:42:05.263 INFO:tasks.workunit.client.0.smithi060.stdout:4/429: dread d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:42:05.264 INFO:tasks.workunit.client.1.smithi110.stdout:1/434: dwrite de/d15/d32/d61/d6a/d8b/f8e [4194304,4194304] 0 2024-04-12T13:42:05.265 INFO:tasks.workunit.client.1.smithi110.stdout:5/425: sync 2024-04-12T13:42:05.268 INFO:tasks.workunit.client.1.smithi110.stdout:3/470: rename d5/dc/d20/d2d/d4e/d89/f97 to d5/dc/d31/d3b/d32/d3e/d98/f9e 0 2024-04-12T13:42:05.269 INFO:tasks.workunit.client.0.smithi060.stdout:8/421: mkdir d9/d1b/d3c/d8d 0 2024-04-12T13:42:05.270 INFO:tasks.workunit.client.0.smithi060.stdout:8/422: stat d9/d1b/d37/f6a 0 2024-04-12T13:42:05.272 INFO:tasks.workunit.client.1.smithi110.stdout:3/471: write d5/dc/d20/d2d/d4f/f7b [667583,120036] 0 2024-04-12T13:42:05.275 INFO:tasks.workunit.client.0.smithi060.stdout:7/390: creat d0/d7/f87 x:0 0 0 2024-04-12T13:42:05.277 INFO:tasks.workunit.client.1.smithi110.stdout:2/506: creat d6/dc/d6f/f96 x:0 0 0 2024-04-12T13:42:05.279 INFO:tasks.workunit.client.1.smithi110.stdout:0/402: dwrite d1/d27/d31/f64 [0,4194304] 0 2024-04-12T13:42:05.279 INFO:tasks.workunit.client.0.smithi060.stdout:0/422: symlink d7/d9/d14/d35/d44/d7d/l9d 0 2024-04-12T13:42:05.283 INFO:tasks.workunit.client.1.smithi110.stdout:1/435: mkdir de/d14/d34/d87/d9c 0 2024-04-12T13:42:05.284 INFO:tasks.workunit.client.1.smithi110.stdout:1/436: dread - de/d14/f78 zero size 2024-04-12T13:42:05.286 INFO:tasks.workunit.client.0.smithi060.stdout:1/555: rmdir d1e/d23/d49/dbf 0 2024-04-12T13:42:05.289 INFO:tasks.workunit.client.1.smithi110.stdout:1/437: write de/d14/d34/d55/f63 [4075853,109232] 0 2024-04-12T13:42:05.289 INFO:tasks.workunit.client.0.smithi060.stdout:4/430: stat d6/d21/d29/c65 0 2024-04-12T13:42:05.290 INFO:tasks.workunit.client.1.smithi110.stdout:6/483: link d7/d25/d30/l51 d7/d10/d41/l9a 0 2024-04-12T13:42:05.291 INFO:tasks.workunit.client.1.smithi110.stdout:4/589: sync 2024-04-12T13:42:05.292 INFO:tasks.workunit.client.1.smithi110.stdout:1/438: write de/d14/d34/d55/d6b/f6f [1134164,120107] 0 2024-04-12T13:42:05.293 INFO:tasks.workunit.client.1.smithi110.stdout:6/484: dread - d7/d10/d1c/d2b/d48/d4b/f94 zero size 2024-04-12T13:42:05.294 INFO:tasks.workunit.client.1.smithi110.stdout:4/590: write d0/d19/d1c/d50/d6f/fae [457579,114186] 0 2024-04-12T13:42:05.294 INFO:tasks.workunit.client.0.smithi060.stdout:4/431: write d6/d7/dd/df/f23 [3061297,8185] 0 2024-04-12T13:42:05.294 INFO:tasks.workunit.client.0.smithi060.stdout:7/391: dwrite d0/d7/d43/d63/f67 [0,4194304] 0 2024-04-12T13:42:05.295 INFO:tasks.workunit.client.1.smithi110.stdout:1/439: stat de/d14/d34/d55/d6b/f82 0 2024-04-12T13:42:05.295 INFO:tasks.workunit.client.1.smithi110.stdout:6/485: fsync d7/d10/d1c/d2b/f7a 0 2024-04-12T13:42:05.297 INFO:tasks.workunit.client.0.smithi060.stdout:9/379: link d4/d33/d65/c6e d4/d33/d65/d7a/c7b 0 2024-04-12T13:42:05.297 INFO:tasks.workunit.client.1.smithi110.stdout:1/440: chown de/d14/d34/d55 5752 1 2024-04-12T13:42:05.299 INFO:tasks.workunit.client.1.smithi110.stdout:3/472: creat d5/dc/d20/d2d/d4f/f9f x:0 0 0 2024-04-12T13:42:05.300 INFO:tasks.workunit.client.1.smithi110.stdout:3/473: chown d5/dc/d20/d2d/d4f/f58 0 1 2024-04-12T13:42:05.300 INFO:tasks.workunit.client.0.smithi060.stdout:8/423: dread d9/d1b/d2b/f32 [0,4194304] 0 2024-04-12T13:42:05.309 INFO:tasks.workunit.client.1.smithi110.stdout:0/403: truncate d1/d8/f34 368381 0 2024-04-12T13:42:05.313 INFO:tasks.workunit.client.1.smithi110.stdout:8/470: write d1/d3/d3c/d5a/d6f/d83/f8c [166568,99601] 0 2024-04-12T13:42:05.315 INFO:tasks.workunit.client.0.smithi060.stdout:4/432: stat d6/d21/c16 0 2024-04-12T13:42:05.318 INFO:tasks.workunit.client.1.smithi110.stdout:9/555: write df/f24 [2645321,24079] 0 2024-04-12T13:42:05.318 INFO:tasks.workunit.client.1.smithi110.stdout:8/471: truncate d1/d3/d3c/d5a/d6f/d7e/f63 1020427 0 2024-04-12T13:42:05.318 INFO:tasks.workunit.client.0.smithi060.stdout:6/539: dwrite d1/d7/da/d20/f36 [0,4194304] 0 2024-04-12T13:42:05.321 INFO:tasks.workunit.client.1.smithi110.stdout:4/591: unlink d0/de/d2c/cbd 0 2024-04-12T13:42:05.322 INFO:tasks.workunit.client.0.smithi060.stdout:6/540: chown d1/d7/da/dc/d24/d30/d52/d78/d80/d93 249398 1 2024-04-12T13:42:05.322 INFO:tasks.workunit.client.1.smithi110.stdout:1/441: symlink de/d14/d83/l9d 0 2024-04-12T13:42:05.322 INFO:tasks.workunit.client.1.smithi110.stdout:4/592: fdatasync d0/d19/f62 0 2024-04-12T13:42:05.324 INFO:tasks.workunit.client.1.smithi110.stdout:0/404: dwrite d1/d8/d36/d65/f84 [0,4194304] 0 2024-04-12T13:42:05.325 INFO:tasks.workunit.client.0.smithi060.stdout:8/424: creat d9/d1b/d2b/d82/f8e x:0 0 0 2024-04-12T13:42:05.325 INFO:tasks.workunit.client.1.smithi110.stdout:0/405: chown d1/d8/d36/f44 1511 1 2024-04-12T13:42:05.326 INFO:tasks.workunit.client.0.smithi060.stdout:8/425: readlink d9/l34 0 2024-04-12T13:42:05.326 INFO:tasks.workunit.client.1.smithi110.stdout:3/474: mkdir d5/dc/da0 0 2024-04-12T13:42:05.328 INFO:tasks.workunit.client.0.smithi060.stdout:8/426: chown d9/f11 60 1 2024-04-12T13:42:05.328 INFO:tasks.workunit.client.1.smithi110.stdout:2/507: mknod d6/dc/dd/d49/d64/c97 0 2024-04-12T13:42:05.331 INFO:tasks.workunit.client.1.smithi110.stdout:2/508: readlink d6/dc/d1b/l74 0 2024-04-12T13:42:05.334 INFO:tasks.workunit.client.1.smithi110.stdout:9/556: dread - df/d13/f87 zero size 2024-04-12T13:42:05.336 INFO:tasks.workunit.client.1.smithi110.stdout:9/557: read - df/d13/d26/d37/fa4 zero size 2024-04-12T13:42:05.336 INFO:tasks.workunit.client.1.smithi110.stdout:1/442: dread de/d15/d32/d61/d6a/d8b/f8e [4194304,4194304] 0 2024-04-12T13:42:05.339 INFO:tasks.workunit.client.0.smithi060.stdout:6/541: dread - d1/d7/da/dc/d24/d34/d51/d59/f87 zero size 2024-04-12T13:42:05.340 INFO:tasks.workunit.client.1.smithi110.stdout:7/479: sync 2024-04-12T13:42:05.341 INFO:tasks.workunit.client.1.smithi110.stdout:4/593: creat d0/d75/d84/fc4 x:0 0 0 2024-04-12T13:42:05.342 INFO:tasks.workunit.client.0.smithi060.stdout:1/556: creat d1e/d29/fc4 x:0 0 0 2024-04-12T13:42:05.346 INFO:tasks.workunit.client.1.smithi110.stdout:3/475: symlink d5/dc/la1 0 2024-04-12T13:42:05.346 INFO:tasks.workunit.client.0.smithi060.stdout:2/437: truncate d6/d56/f51 113413 0 2024-04-12T13:42:05.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/423: getdents d7/d9/d14/d4a 0 2024-04-12T13:42:05.349 INFO:tasks.workunit.client.1.smithi110.stdout:5/426: truncate da/d2e/d45/d29/d32/f81 704673 0 2024-04-12T13:42:05.350 INFO:tasks.workunit.client.0.smithi060.stdout:2/438: write d6/d10/d2b/d35/f4c [2048297,119662] 0 2024-04-12T13:42:05.352 INFO:tasks.workunit.client.0.smithi060.stdout:2/439: read d6/f8 [895324,95127] 0 2024-04-12T13:42:05.353 INFO:tasks.workunit.client.1.smithi110.stdout:6/486: creat d7/d25/d30/f9b x:0 0 0 2024-04-12T13:42:05.354 INFO:tasks.workunit.client.1.smithi110.stdout:7/480: dread d1/d3/d4/f2e [0,4194304] 0 2024-04-12T13:42:05.355 INFO:tasks.workunit.client.1.smithi110.stdout:9/558: dwrite df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f7e [0,4194304] 0 2024-04-12T13:42:05.356 INFO:tasks.workunit.client.0.smithi060.stdout:9/380: rename d4/d9/d19/d21/d79 to d4/d8/d7c 0 2024-04-12T13:42:05.358 INFO:tasks.workunit.client.1.smithi110.stdout:8/472: dread d1/d7/f3f [0,4194304] 0 2024-04-12T13:42:05.358 INFO:tasks.workunit.client.0.smithi060.stdout:1/557: dwrite d1e/d29/d65/f7a [0,4194304] 0 2024-04-12T13:42:05.360 INFO:tasks.workunit.client.1.smithi110.stdout:8/473: fsync d1/d3/d3c/d5a/d6f/d7e/f47 0 2024-04-12T13:42:05.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/542: creat d1/d7/da/fc4 x:0 0 0 2024-04-12T13:42:05.363 INFO:tasks.workunit.client.0.smithi060.stdout:6/543: stat d1/d7/da/dc/dc2 0 2024-04-12T13:42:05.367 INFO:tasks.workunit.client.0.smithi060.stdout:8/427: rmdir d9/d1b/d3c/d6e 39 2024-04-12T13:42:05.369 INFO:tasks.workunit.client.0.smithi060.stdout:0/424: mknod d7/d41/c9e 0 2024-04-12T13:42:05.375 INFO:tasks.workunit.client.1.smithi110.stdout:0/406: link d1/d48/f5b d1/d8/d36/d51/d60/f87 0 2024-04-12T13:42:05.377 INFO:tasks.workunit.client.0.smithi060.stdout:4/433: truncate d6/d7/dd/df/f23 3891329 0 2024-04-12T13:42:05.379 INFO:tasks.workunit.client.1.smithi110.stdout:5/427: creat da/db/d61/f9a x:0 0 0 2024-04-12T13:42:05.380 INFO:tasks.workunit.client.1.smithi110.stdout:2/509: fsync d6/dc/dd/d49/d64/d4a/d55/f6b 0 2024-04-12T13:42:05.381 INFO:tasks.workunit.client.1.smithi110.stdout:5/428: write da/db/f4a [2131249,89273] 0 2024-04-12T13:42:05.382 INFO:tasks.workunit.client.0.smithi060.stdout:9/381: write d4/d8/d32/f5b [2757460,65377] 0 2024-04-12T13:42:05.382 INFO:tasks.workunit.client.1.smithi110.stdout:2/510: dread - d6/dc/d13/f90 zero size 2024-04-12T13:42:05.384 INFO:tasks.workunit.client.1.smithi110.stdout:5/429: truncate da/d4f/f91 147065 0 2024-04-12T13:42:05.386 INFO:tasks.workunit.client.0.smithi060.stdout:6/544: creat d1/d7/da/dc/d24/d34/d51/d59/d94/fc5 x:0 0 0 2024-04-12T13:42:05.388 INFO:tasks.workunit.client.1.smithi110.stdout:7/481: rename d1/d3/d4/d36/d4b to d1/d1b/d3d/d68/d97/da5 0 2024-04-12T13:42:05.389 INFO:tasks.workunit.client.0.smithi060.stdout:6/545: write d1/d7/da/dc/d24/d30/d52/d5e/fbb [695905,100313] 0 2024-04-12T13:42:05.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/425: creat d7/d33/d5b/f9f x:0 0 0 2024-04-12T13:42:05.393 INFO:tasks.workunit.client.0.smithi060.stdout:2/440: creat d6/d10/d6b/f84 x:0 0 0 2024-04-12T13:42:05.396 INFO:tasks.workunit.client.1.smithi110.stdout:4/594: mkdir d0/d19/d8f/dc5 0 2024-04-12T13:42:05.398 INFO:tasks.workunit.client.0.smithi060.stdout:9/382: write d4/f77 [4445294,9128] 0 2024-04-12T13:42:05.398 INFO:tasks.workunit.client.1.smithi110.stdout:4/595: write d0/de/d32/d61/f9b [826276,103577] 0 2024-04-12T13:42:05.399 INFO:tasks.workunit.client.0.smithi060.stdout:1/558: truncate d1e/d29/f44 53991 0 2024-04-12T13:42:05.400 INFO:tasks.workunit.client.1.smithi110.stdout:8/474: dread d1/d3/d3c/d5a/f8a [0,4194304] 0 2024-04-12T13:42:05.401 INFO:tasks.workunit.client.0.smithi060.stdout:9/383: write d4/d9/d19/d21/f66 [801480,47374] 0 2024-04-12T13:42:05.401 INFO:tasks.workunit.client.1.smithi110.stdout:4/596: write d0/de/f7f [7542215,68879] 0 2024-04-12T13:42:05.402 INFO:tasks.workunit.client.1.smithi110.stdout:0/407: stat d1/d8/c59 0 2024-04-12T13:42:05.402 INFO:tasks.workunit.client.0.smithi060.stdout:1/559: chown d1e/d23/d2e/l97 35536 1 2024-04-12T13:42:05.402 INFO:tasks.workunit.client.0.smithi060.stdout:9/384: readlink d4/l48 0 2024-04-12T13:42:05.403 INFO:tasks.workunit.client.0.smithi060.stdout:8/428: creat d9/d1b/d3c/d60/d79/f8f x:0 0 0 2024-04-12T13:42:05.403 INFO:tasks.workunit.client.1.smithi110.stdout:0/408: write d1/f2f [4802570,121401] 0 2024-04-12T13:42:05.407 INFO:tasks.workunit.client.1.smithi110.stdout:0/409: truncate d1/d8/d36/d63/d4a/f73 398462 0 2024-04-12T13:42:05.408 INFO:tasks.workunit.client.1.smithi110.stdout:0/410: write d1/d8/d36/d63/f82 [505810,100259] 0 2024-04-12T13:42:05.411 INFO:tasks.workunit.client.1.smithi110.stdout:2/511: mknod d6/dc/d6f/c98 0 2024-04-12T13:42:05.417 INFO:tasks.workunit.client.1.smithi110.stdout:9/559: rename df/f25 to df/d13/d26/d37/d49/da3/fb5 0 2024-04-12T13:42:05.421 INFO:tasks.workunit.client.1.smithi110.stdout:0/411: dread d1/d8/d36/d65/f84 [0,4194304] 0 2024-04-12T13:42:05.423 INFO:tasks.workunit.client.1.smithi110.stdout:1/443: creat de/d15/d32/d61/f9e x:0 0 0 2024-04-12T13:42:05.425 INFO:tasks.workunit.client.0.smithi060.stdout:8/429: mkdir d9/d1d/d5e/d90 0 2024-04-12T13:42:05.426 INFO:tasks.workunit.client.0.smithi060.stdout:2/441: dread d6/d13/d17/f3c [0,4194304] 0 2024-04-12T13:42:05.427 INFO:tasks.workunit.client.1.smithi110.stdout:3/476: creat d5/fa2 x:0 0 0 2024-04-12T13:42:05.427 INFO:tasks.workunit.client.0.smithi060.stdout:6/546: symlink d1/d7/lc6 0 2024-04-12T13:42:05.428 INFO:tasks.workunit.client.0.smithi060.stdout:2/442: stat d6/d13/d31/d33/l45 0 2024-04-12T13:42:05.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/430: chown d9/d1b/d37/d48/c52 1115 1 2024-04-12T13:42:05.431 INFO:tasks.workunit.client.0.smithi060.stdout:2/443: write d6/f15 [2527617,130692] 0 2024-04-12T13:42:05.431 INFO:tasks.workunit.client.0.smithi060.stdout:9/385: dread d4/d8/fb [4194304,4194304] 0 2024-04-12T13:42:05.432 INFO:tasks.workunit.client.1.smithi110.stdout:9/560: dwrite df/d38/d6e/faa [0,4194304] 0 2024-04-12T13:42:05.433 INFO:tasks.workunit.client.0.smithi060.stdout:0/426: mkdir d7/d9/de/d7c/da0 0 2024-04-12T13:42:05.434 INFO:tasks.workunit.client.0.smithi060.stdout:2/444: write d6/d13/d5b/f78 [570525,7232] 0 2024-04-12T13:42:05.434 INFO:tasks.workunit.client.0.smithi060.stdout:9/386: write d4/d8/d32/f5b [681967,44296] 0 2024-04-12T13:42:05.434 INFO:tasks.workunit.client.1.smithi110.stdout:9/561: write df/d13/d26/d37/fa4 [980821,112308] 0 2024-04-12T13:42:05.437 INFO:tasks.workunit.client.0.smithi060.stdout:2/445: dread - d6/d13/d31/d33/f6a zero size 2024-04-12T13:42:05.439 INFO:tasks.workunit.client.1.smithi110.stdout:8/475: creat d1/d3/d35/d3a/d3e/f99 x:0 0 0 2024-04-12T13:42:05.444 INFO:tasks.workunit.client.0.smithi060.stdout:2/446: read d6/d56/d43/f72 [93336,59327] 0 2024-04-12T13:42:05.444 INFO:tasks.workunit.client.0.smithi060.stdout:4/434: getdents d6/d7/db/d85 0 2024-04-12T13:42:05.445 INFO:tasks.workunit.client.0.smithi060.stdout:1/560: dwrite d1e/d23/d49/d4e/f77 [0,4194304] 0 2024-04-12T13:42:05.445 INFO:tasks.workunit.client.1.smithi110.stdout:6/487: link d7/d25/d30/d44/d3d/c79 d7/d10/d1c/c9c 0 2024-04-12T13:42:05.445 INFO:tasks.workunit.client.0.smithi060.stdout:8/431: dread - d9/d1d/d2f/f4b zero size 2024-04-12T13:42:05.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/561: stat d1e/d1f/fad 0 2024-04-12T13:42:05.448 INFO:tasks.workunit.client.0.smithi060.stdout:6/547: mkdir d1/d7/da/dc/d24/d30/d52/d78/dc7 0 2024-04-12T13:42:05.449 INFO:tasks.workunit.client.1.smithi110.stdout:4/597: dwrite d0/d13/f2a [4194304,4194304] 0 2024-04-12T13:42:05.449 INFO:tasks.workunit.client.0.smithi060.stdout:2/447: chown d6/d13/d31/d33/d3d/f59 227153547 1 2024-04-12T13:42:05.450 INFO:tasks.workunit.client.1.smithi110.stdout:5/430: link da/d2e/d45/d29/f78 da/db/d61/f9b 0 2024-04-12T13:42:05.452 INFO:tasks.workunit.client.1.smithi110.stdout:5/431: chown da/d2e/d45/f1f 0 1 2024-04-12T13:42:05.464 INFO:tasks.workunit.client.0.smithi060.stdout:0/427: unlink d7/f11 0 2024-04-12T13:42:05.469 INFO:tasks.workunit.client.0.smithi060.stdout:2/448: dwrite f3 [0,4194304] 0 2024-04-12T13:42:05.469 INFO:tasks.workunit.client.0.smithi060.stdout:8/432: dwrite d9/d1d/f6f [0,4194304] 0 2024-04-12T13:42:05.471 INFO:tasks.workunit.client.0.smithi060.stdout:2/449: fsync d6/d56/f75 0 2024-04-12T13:42:05.473 INFO:tasks.workunit.client.1.smithi110.stdout:2/512: write d6/dc/dd/d49/d64/d4a/d55/f60 [778805,7050] 0 2024-04-12T13:42:05.475 INFO:tasks.workunit.client.1.smithi110.stdout:9/562: read - df/d13/d26/d37/f90 zero size 2024-04-12T13:42:05.477 INFO:tasks.workunit.client.1.smithi110.stdout:8/476: chown d1/d3/d35/d3a/d3e/l73 6572 1 2024-04-12T13:42:05.482 INFO:tasks.workunit.client.0.smithi060.stdout:1/562: mknod d1e/d23/d2e/d5e/cc5 0 2024-04-12T13:42:05.483 INFO:tasks.workunit.client.1.smithi110.stdout:4/598: creat d0/de/fc6 x:0 0 0 2024-04-12T13:42:05.485 INFO:tasks.workunit.client.1.smithi110.stdout:5/432: rmdir da/d2e/d45/d25 39 2024-04-12T13:42:05.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/428: truncate d7/d9/d14/d35/d44/d7d/f2a 5581251 0 2024-04-12T13:42:05.488 INFO:tasks.workunit.client.0.smithi060.stdout:8/433: mknod d9/d1b/d37/d4d/d63/c91 0 2024-04-12T13:42:05.489 INFO:tasks.workunit.client.1.smithi110.stdout:1/444: symlink de/d15/d32/d61/d96/l9f 0 2024-04-12T13:42:05.494 INFO:tasks.workunit.client.0.smithi060.stdout:0/429: write d7/d9/d14/f85 [656114,39885] 0 2024-04-12T13:42:05.495 INFO:tasks.workunit.client.0.smithi060.stdout:4/435: creat d6/d7/dd/d1a/d19/d7a/f97 x:0 0 0 2024-04-12T13:42:05.497 INFO:tasks.workunit.client.1.smithi110.stdout:8/477: symlink d1/d3/d3c/l9a 0 2024-04-12T13:42:05.499 INFO:tasks.workunit.client.0.smithi060.stdout:9/387: rename d4/d9/d19/d21/d73/d67/c69 to d4/d9/c7d 0 2024-04-12T13:42:05.500 INFO:tasks.workunit.client.0.smithi060.stdout:9/388: stat d4/d9/l54 0 2024-04-12T13:42:05.501 INFO:tasks.workunit.client.1.smithi110.stdout:8/478: dread d1/d3/d35/d3a/d41/f51 [0,4194304] 0 2024-04-12T13:42:05.501 INFO:tasks.workunit.client.1.smithi110.stdout:5/433: dwrite f9 [0,4194304] 0 2024-04-12T13:42:05.503 INFO:tasks.workunit.client.1.smithi110.stdout:4/599: truncate d0/de/f24 1450893 0 2024-04-12T13:42:05.509 INFO:tasks.workunit.client.0.smithi060.stdout:0/430: creat d7/d9/d14/d4a/fa1 x:0 0 0 2024-04-12T13:42:05.511 INFO:tasks.workunit.client.1.smithi110.stdout:7/482: rename d1/d3/d84 to d1/d3/d4/da6 0 2024-04-12T13:42:05.516 INFO:tasks.workunit.client.1.smithi110.stdout:5/434: dwrite da/db/f8d [0,4194304] 0 2024-04-12T13:42:05.518 INFO:tasks.workunit.client.0.smithi060.stdout:4/436: dwrite d6/d7/dd/df/f37 [0,4194304] 0 2024-04-12T13:42:05.518 INFO:tasks.workunit.client.0.smithi060.stdout:3/485: sync 2024-04-12T13:42:05.518 INFO:tasks.workunit.client.0.smithi060.stdout:7/392: sync 2024-04-12T13:42:05.518 INFO:tasks.workunit.client.0.smithi060.stdout:5/485: sync 2024-04-12T13:42:05.519 INFO:tasks.workunit.client.1.smithi110.stdout:5/435: chown da/db/d61/d7a/f87 52439 1 2024-04-12T13:42:05.521 INFO:tasks.workunit.client.0.smithi060.stdout:2/450: link d6/d56/l7e d6/d56/d43/l85 0 2024-04-12T13:42:05.526 INFO:tasks.workunit.client.0.smithi060.stdout:9/389: creat d4/d9/d19/d21/d73/d67/f7e x:0 0 0 2024-04-12T13:42:05.531 INFO:tasks.workunit.client.0.smithi060.stdout:8/434: write d9/d1d/d5e/f61 [698391,93314] 0 2024-04-12T13:42:05.534 INFO:tasks.workunit.client.0.smithi060.stdout:7/393: dread d0/d7/f6 [0,4194304] 0 2024-04-12T13:42:05.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/394: stat d0/d7/d43/d63/d6f/c76 0 2024-04-12T13:42:05.540 INFO:tasks.workunit.client.1.smithi110.stdout:0/412: rename d1/d8/d36/c66 to d1/d48/c88 0 2024-04-12T13:42:05.540 INFO:tasks.workunit.client.1.smithi110.stdout:4/600: write d0/de/d2c/f4d [2145523,50749] 0 2024-04-12T13:42:05.543 INFO:tasks.workunit.client.0.smithi060.stdout:0/431: truncate d7/d9/d14/d35/d3c/f42 4345136 0 2024-04-12T13:42:05.545 INFO:tasks.workunit.client.1.smithi110.stdout:2/513: dwrite d6/dc/dd/d49/f7d [0,4194304] 0 2024-04-12T13:42:05.546 INFO:tasks.workunit.client.1.smithi110.stdout:7/483: read d1/d3/d4/f1c [3634310,55887] 0 2024-04-12T13:42:05.547 INFO:tasks.workunit.client.0.smithi060.stdout:6/548: rename d1/l10 to d1/d7/da/dc/d7a/lc8 0 2024-04-12T13:42:05.553 INFO:tasks.workunit.client.0.smithi060.stdout:1/563: dwrite d1e/d23/d2e/d5e/d68/fa0 [0,4194304] 0 2024-04-12T13:42:05.556 INFO:tasks.workunit.client.0.smithi060.stdout:8/435: dwrite d9/d1b/d37/d4d/f7e [0,4194304] 0 2024-04-12T13:42:05.557 INFO:tasks.workunit.client.1.smithi110.stdout:6/488: getdents d7/d25/d2c/d4c/d77/d93 0 2024-04-12T13:42:05.561 INFO:tasks.workunit.client.0.smithi060.stdout:2/451: fsync d6/f8 0 2024-04-12T13:42:05.561 INFO:tasks.workunit.client.0.smithi060.stdout:5/486: mknod d6/dd/d1f/d25/d35/ca1 0 2024-04-12T13:42:05.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/390: chown d4/d8/d32/c70 8150 1 2024-04-12T13:42:05.568 INFO:tasks.workunit.client.0.smithi060.stdout:5/487: truncate d6/dd/d1f/f98 729773 0 2024-04-12T13:42:05.568 INFO:tasks.workunit.client.0.smithi060.stdout:7/395: read - d0/d7/d43/d4d/f79 zero size 2024-04-12T13:42:05.568 INFO:tasks.workunit.client.1.smithi110.stdout:4/601: creat d0/d13/fc7 x:0 0 0 2024-04-12T13:42:05.569 INFO:tasks.workunit.client.1.smithi110.stdout:0/413: rmdir d1/d8/d36/d51 39 2024-04-12T13:42:05.573 INFO:tasks.workunit.client.0.smithi060.stdout:6/549: mknod d1/d7/da/dc/d24/d30/d52/d5e/d7b/cc9 0 2024-04-12T13:42:05.575 INFO:tasks.workunit.client.1.smithi110.stdout:7/484: mkdir d1/d1b/d3d/d68/d97/da5/da7 0 2024-04-12T13:42:05.577 INFO:tasks.workunit.client.1.smithi110.stdout:5/436: symlink da/d35/d71/d89/l9c 0 2024-04-12T13:42:05.577 INFO:tasks.workunit.client.0.smithi060.stdout:6/550: readlink d1/d7/da/dc/d24/d2d/l83 0 2024-04-12T13:42:05.579 INFO:tasks.workunit.client.1.smithi110.stdout:5/437: fsync da/db/f8d 0 2024-04-12T13:42:05.579 INFO:tasks.workunit.client.1.smithi110.stdout:7/485: write d1/d3/d4/d36/da1/f80 [3845226,82771] 0 2024-04-12T13:42:05.580 INFO:tasks.workunit.client.0.smithi060.stdout:0/432: dread d7/d9/f1c [0,4194304] 0 2024-04-12T13:42:05.580 INFO:tasks.workunit.client.0.smithi060.stdout:1/564: creat d1e/d23/d2e/d8e/d98/fc6 x:0 0 0 2024-04-12T13:42:05.582 INFO:tasks.workunit.client.0.smithi060.stdout:1/565: stat d1e 0 2024-04-12T13:42:05.583 INFO:tasks.workunit.client.1.smithi110.stdout:8/479: creat d1/f9b x:0 0 0 2024-04-12T13:42:05.585 INFO:tasks.workunit.client.0.smithi060.stdout:9/391: mknod d4/d8/d7c/c7f 0 2024-04-12T13:42:05.588 INFO:tasks.workunit.client.0.smithi060.stdout:2/452: truncate d6/d10/f57 1465333 0 2024-04-12T13:42:05.588 INFO:tasks.workunit.client.1.smithi110.stdout:4/602: dwrite d0/d19/d1c/fad [0,4194304] 0 2024-04-12T13:42:05.595 INFO:tasks.workunit.client.0.smithi060.stdout:4/437: dread d6/d7/dd/df/f23 [0,4194304] 0 2024-04-12T13:42:05.597 INFO:tasks.workunit.client.1.smithi110.stdout:6/489: mknod d7/d10/d7e/d85/c9d 0 2024-04-12T13:42:05.598 INFO:tasks.workunit.client.1.smithi110.stdout:3/477: rename d5/dc/d20/c52 to d5/ca3 0 2024-04-12T13:42:05.599 INFO:tasks.workunit.client.0.smithi060.stdout:6/551: mkdir d1/d7/da/dc/dac/dca 0 2024-04-12T13:42:05.599 INFO:tasks.workunit.client.0.smithi060.stdout:4/438: truncate d6/d7/dd/df/f92 624820 0 2024-04-12T13:42:05.600 INFO:tasks.workunit.client.0.smithi060.stdout:6/552: dread - d1/d2c/fae zero size 2024-04-12T13:42:05.602 INFO:tasks.workunit.client.1.smithi110.stdout:2/514: dwrite d6/dc/dd/d49/d64/d4a/d3c/f26 [0,4194304] 0 2024-04-12T13:42:05.609 INFO:tasks.workunit.client.1.smithi110.stdout:7/486: dwrite d1/d1b/d74/f93 [0,4194304] 0 2024-04-12T13:42:05.610 INFO:tasks.workunit.client.1.smithi110.stdout:6/490: read d7/d10/d1c/d2b/d48/d54/f5d [3976910,124402] 0 2024-04-12T13:42:05.611 INFO:tasks.workunit.client.1.smithi110.stdout:1/445: rename de/d15/c69 to de/d15/d32/ca0 0 2024-04-12T13:42:05.613 INFO:tasks.workunit.client.0.smithi060.stdout:7/396: mkdir d0/d7/d88 0 2024-04-12T13:42:05.614 INFO:tasks.workunit.client.1.smithi110.stdout:7/487: chown d1/d3/d4 2 1 2024-04-12T13:42:05.615 INFO:tasks.workunit.client.1.smithi110.stdout:2/515: dread - d6/dc/dd/d49/d64/d4a/f92 zero size 2024-04-12T13:42:05.619 INFO:tasks.workunit.client.1.smithi110.stdout:3/478: mknod d5/dc/d20/ca4 0 2024-04-12T13:42:05.620 INFO:tasks.workunit.client.0.smithi060.stdout:8/436: creat d9/d1b/d3c/f92 x:0 0 0 2024-04-12T13:42:05.621 INFO:tasks.workunit.client.0.smithi060.stdout:4/439: symlink d6/d2f/d51/l98 0 2024-04-12T13:42:05.624 INFO:tasks.workunit.client.0.smithi060.stdout:6/553: mkdir d1/d7/da/dc/dcb 0 2024-04-12T13:42:05.625 INFO:tasks.workunit.client.1.smithi110.stdout:5/438: dwrite da/d35/f4e [0,4194304] 0 2024-04-12T13:42:05.627 INFO:tasks.workunit.client.0.smithi060.stdout:5/488: dwrite d6/d10/d12/f36 [4194304,4194304] 0 2024-04-12T13:42:05.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/440: write d6/d7/dd/d1a/d57/d63/d68/f6c [508675,69945] 0 2024-04-12T13:42:05.628 INFO:tasks.workunit.client.1.smithi110.stdout:9/563: rename df/d13/d2c/d2d/d94/fa1 to df/d38/d6e/d7f/fb6 0 2024-04-12T13:42:05.629 INFO:tasks.workunit.client.0.smithi060.stdout:6/554: chown d1/d7/da/dc/d24/d30/d52/d5e/l76 0 1 2024-04-12T13:42:05.631 INFO:tasks.workunit.client.0.smithi060.stdout:2/453: mkdir d6/d56/d86 0 2024-04-12T13:42:05.633 INFO:tasks.workunit.client.1.smithi110.stdout:4/603: dwrite d0/de/d2c/fc2 [0,4194304] 0 2024-04-12T13:42:05.635 INFO:tasks.workunit.client.0.smithi060.stdout:4/441: write d6/d7/dd/d1a/d19/f52 [4045245,51632] 0 2024-04-12T13:42:05.635 INFO:tasks.workunit.client.0.smithi060.stdout:2/454: dread - d6/d13/f34 zero size 2024-04-12T13:42:05.635 INFO:tasks.workunit.client.0.smithi060.stdout:5/489: read d6/dd/d1f/d25/d42/d52/f8c [979914,107605] 0 2024-04-12T13:42:05.636 INFO:tasks.workunit.client.0.smithi060.stdout:3/486: rename d7/f52 to d7/da/d3f/fa6 0 2024-04-12T13:42:05.636 INFO:tasks.workunit.client.0.smithi060.stdout:2/455: stat f3 0 2024-04-12T13:42:05.639 INFO:tasks.workunit.client.1.smithi110.stdout:7/488: mknod d1/d1b/d74/ca8 0 2024-04-12T13:42:05.640 INFO:tasks.workunit.client.0.smithi060.stdout:1/566: dwrite d1e/f2d [4194304,4194304] 0 2024-04-12T13:42:05.645 INFO:tasks.workunit.client.0.smithi060.stdout:0/433: dwrite d7/d9/d14/d35/d44/f77 [0,4194304] 0 2024-04-12T13:42:05.646 INFO:tasks.workunit.client.1.smithi110.stdout:9/564: chown df/d13/d26/d37/d49/l9d 1777191 1 2024-04-12T13:42:05.647 INFO:tasks.workunit.client.1.smithi110.stdout:2/516: mknod d6/dc/d1b/d8f/c99 0 2024-04-12T13:42:05.650 INFO:tasks.workunit.client.1.smithi110.stdout:3/479: fsync d5/dc/d31/d3b/d32/f37 0 2024-04-12T13:42:05.651 INFO:tasks.workunit.client.0.smithi060.stdout:0/434: dread - d7/d9/d14/d4a/f5f zero size 2024-04-12T13:42:05.654 INFO:tasks.workunit.client.1.smithi110.stdout:0/414: dwrite d1/d8/d36/d63/f46 [0,4194304] 0 2024-04-12T13:42:05.657 INFO:tasks.workunit.client.1.smithi110.stdout:4/604: write d0/de/d2c/d57/f94 [741030,80616] 0 2024-04-12T13:42:05.661 INFO:tasks.workunit.client.1.smithi110.stdout:6/491: dwrite d7/d10/f20 [0,4194304] 0 2024-04-12T13:42:05.663 INFO:tasks.workunit.client.0.smithi060.stdout:6/555: dwrite d1/d2c/fae [0,4194304] 0 2024-04-12T13:42:05.665 INFO:tasks.workunit.client.1.smithi110.stdout:5/439: dread da/db/f8d [0,4194304] 0 2024-04-12T13:42:05.665 INFO:tasks.workunit.client.1.smithi110.stdout:6/492: fdatasync d7/d10/d1c/f24 0 2024-04-12T13:42:05.666 INFO:tasks.workunit.client.1.smithi110.stdout:7/489: truncate d1/d1b/d74/f79 2087618 0 2024-04-12T13:42:05.666 INFO:tasks.workunit.client.1.smithi110.stdout:2/517: write d6/dc/dd/d49/d64/d8c/f95 [265889,48071] 0 2024-04-12T13:42:05.667 INFO:tasks.workunit.client.0.smithi060.stdout:2/456: mkdir d6/d13/d31/d87 0 2024-04-12T13:42:05.667 INFO:tasks.workunit.client.0.smithi060.stdout:8/437: link d9/d1d/d5e/f87 d9/d1d/d5e/f93 0 2024-04-12T13:42:05.668 INFO:tasks.workunit.client.0.smithi060.stdout:4/442: mknod d6/d7/dd/d1a/d57/d63/d68/d94/c99 0 2024-04-12T13:42:05.670 INFO:tasks.workunit.client.0.smithi060.stdout:9/392: getdents d4/d9/d19/d21/d73/d67 0 2024-04-12T13:42:05.674 INFO:tasks.workunit.client.0.smithi060.stdout:2/457: chown d6/d13/d31/d33/f39 951049890 1 2024-04-12T13:42:05.675 INFO:tasks.workunit.client.1.smithi110.stdout:2/518: truncate d6/dc/d13/f90 207457 0 2024-04-12T13:42:05.676 INFO:tasks.workunit.client.1.smithi110.stdout:4/605: mknod d0/d78/cc8 0 2024-04-12T13:42:05.676 INFO:tasks.workunit.client.0.smithi060.stdout:0/435: readlink d7/d9/d14/d35/d44/d8c/l97 0 2024-04-12T13:42:05.677 INFO:tasks.workunit.client.1.smithi110.stdout:2/519: dread - d6/dc/dd/d49/d64/d4a/f77 zero size 2024-04-12T13:42:05.680 INFO:tasks.workunit.client.0.smithi060.stdout:7/397: creat d0/d7/d43/f89 x:0 0 0 2024-04-12T13:42:05.686 INFO:tasks.workunit.client.1.smithi110.stdout:1/446: write de/d15/d32/d61/d6a/d8b/f8e [8573188,5988] 0 2024-04-12T13:42:05.689 INFO:tasks.workunit.client.1.smithi110.stdout:3/480: mknod d5/dc/d20/ca5 0 2024-04-12T13:42:05.689 INFO:tasks.workunit.client.1.smithi110.stdout:1/447: fsync de/d1d/f97 0 2024-04-12T13:42:05.691 INFO:tasks.workunit.client.1.smithi110.stdout:3/481: chown d5/dc/d20 2759 1 2024-04-12T13:42:05.691 INFO:tasks.workunit.client.1.smithi110.stdout:1/448: readlink de/d14/d34/l99 0 2024-04-12T13:42:05.692 INFO:tasks.workunit.client.0.smithi060.stdout:9/393: mknod d4/d9/d19/d21/d73/c80 0 2024-04-12T13:42:05.694 INFO:tasks.workunit.client.0.smithi060.stdout:9/394: chown d4/l48 249467 1 2024-04-12T13:42:05.698 INFO:tasks.workunit.client.0.smithi060.stdout:9/395: chown d4/d9/d19/d21/d73/d67/f2b 416538 1 2024-04-12T13:42:05.700 INFO:tasks.workunit.client.1.smithi110.stdout:8/480: sync 2024-04-12T13:42:05.704 INFO:tasks.workunit.client.0.smithi060.stdout:0/436: dread d7/d9/d14/f34 [0,4194304] 0 2024-04-12T13:42:05.705 INFO:tasks.workunit.client.1.smithi110.stdout:7/490: dread d1/f2b [0,4194304] 0 2024-04-12T13:42:05.706 INFO:tasks.workunit.client.0.smithi060.stdout:2/458: creat d6/d56/d55/f88 x:0 0 0 2024-04-12T13:42:05.712 INFO:tasks.workunit.client.1.smithi110.stdout:4/606: creat d0/d75/fc9 x:0 0 0 2024-04-12T13:42:05.712 INFO:tasks.workunit.client.0.smithi060.stdout:0/437: dread d7/d9/d14/f34 [0,4194304] 0 2024-04-12T13:42:05.713 INFO:tasks.workunit.client.1.smithi110.stdout:4/607: chown d0/d19/d26/l45 198 1 2024-04-12T13:42:05.715 INFO:tasks.workunit.client.1.smithi110.stdout:4/608: chown d0/d19/d26/f40 1 1 2024-04-12T13:42:05.715 INFO:tasks.workunit.client.1.smithi110.stdout:2/520: write d6/dc/dd/d49/d64/d4a/d51/f4f [400755,69820] 0 2024-04-12T13:42:05.716 INFO:tasks.workunit.client.0.smithi060.stdout:8/438: getdents d9/d1b/d3c/d8c 0 2024-04-12T13:42:05.716 INFO:tasks.workunit.client.0.smithi060.stdout:0/438: read - d7/d9/d14/d35/d44/d49/d67/f86 zero size 2024-04-12T13:42:05.717 INFO:tasks.workunit.client.1.smithi110.stdout:2/521: write d6/dc/f14 [1638971,40558] 0 2024-04-12T13:42:05.719 INFO:tasks.workunit.client.1.smithi110.stdout:5/440: dwrite da/db/d61/d7a/f87 [0,4194304] 0 2024-04-12T13:42:05.719 INFO:tasks.workunit.client.1.smithi110.stdout:9/565: link df/d38/f88 df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/d89/fb7 0 2024-04-12T13:42:05.721 INFO:tasks.workunit.client.1.smithi110.stdout:9/566: fdatasync df/d38/f95 0 2024-04-12T13:42:05.722 INFO:tasks.workunit.client.0.smithi060.stdout:5/490: rename d6/dd/d1f/d32/d46/d91 to d6/dd/d1f/d32/da2 0 2024-04-12T13:42:05.725 INFO:tasks.workunit.client.1.smithi110.stdout:9/567: read df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 [2758333,84885] 0 2024-04-12T13:42:05.726 INFO:tasks.workunit.client.0.smithi060.stdout:7/398: dread d0/f71 [0,4194304] 0 2024-04-12T13:42:05.726 INFO:tasks.workunit.client.1.smithi110.stdout:1/449: unlink de/d15/d32/d5e/l91 0 2024-04-12T13:42:05.728 INFO:tasks.workunit.client.1.smithi110.stdout:6/493: mkdir d7/d25/d30/d9e 0 2024-04-12T13:42:05.730 INFO:tasks.workunit.client.0.smithi060.stdout:9/396: chown d4/d8/d32/c58 2043476 1 2024-04-12T13:42:05.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/397: fsync d4/d9/d19/d21/d73/d67/f5e 0 2024-04-12T13:42:05.731 INFO:tasks.workunit.client.0.smithi060.stdout:3/487: mkdir d7/d17/d27/da7 0 2024-04-12T13:42:05.732 INFO:tasks.workunit.client.1.smithi110.stdout:0/415: rmdir d1/d8/d36/d63/d4a/d7e 0 2024-04-12T13:42:05.733 INFO:tasks.workunit.client.1.smithi110.stdout:4/609: rename d0/d75/d84/l70 to d0/de/d32/d5f/lca 0 2024-04-12T13:42:05.736 INFO:tasks.workunit.client.0.smithi060.stdout:4/443: truncate d6/d7/dd/fe 1973932 0 2024-04-12T13:42:05.738 INFO:tasks.workunit.client.0.smithi060.stdout:4/444: stat d6/d7/dd/d1a/d19/f1b 0 2024-04-12T13:42:05.742 INFO:tasks.workunit.client.0.smithi060.stdout:4/445: read d6/d7/dd/d1a/d57/f83 [3634238,91672] 0 2024-04-12T13:42:05.743 INFO:tasks.workunit.client.1.smithi110.stdout:6/494: dwrite d7/d10/d1c/d2b/f71 [0,4194304] 0 2024-04-12T13:42:05.745 INFO:tasks.workunit.client.0.smithi060.stdout:4/446: write d6/d7/dd/d1a/d19/d7a/f97 [155822,123650] 0 2024-04-12T13:42:05.748 INFO:tasks.workunit.client.0.smithi060.stdout:9/398: dwrite d4/d9/d19/f63 [0,4194304] 0 2024-04-12T13:42:05.754 INFO:tasks.workunit.client.0.smithi060.stdout:8/439: write d9/d1d/d5e/f93 [61718,91490] 0 2024-04-12T13:42:05.754 INFO:tasks.workunit.client.1.smithi110.stdout:7/491: symlink d1/d1b/d3d/d68/d97/da5/da7/la9 0 2024-04-12T13:42:05.758 INFO:tasks.workunit.client.0.smithi060.stdout:3/488: creat d7/d17/d19/d33/d63/fa8 x:0 0 0 2024-04-12T13:42:05.759 INFO:tasks.workunit.client.0.smithi060.stdout:0/439: unlink d7/d9/d4c/f75 0 2024-04-12T13:42:05.762 INFO:tasks.workunit.client.1.smithi110.stdout:4/610: fsync d0/f15 0 2024-04-12T13:42:05.763 INFO:tasks.workunit.client.0.smithi060.stdout:0/440: truncate d7/f87 193182 0 2024-04-12T13:42:05.764 INFO:tasks.workunit.client.0.smithi060.stdout:1/567: rename cd to d1e/d23/d2e/d86/cc7 0 2024-04-12T13:42:05.765 INFO:tasks.workunit.client.1.smithi110.stdout:3/482: write d5/dc/d31/d3b/f4a [2082001,29916] 0 2024-04-12T13:42:05.765 INFO:tasks.workunit.client.1.smithi110.stdout:7/492: dread d1/d3/d4/f2d [0,4194304] 0 2024-04-12T13:42:05.767 INFO:tasks.workunit.client.1.smithi110.stdout:7/493: chown d1/d1b/d74 1 1 2024-04-12T13:42:05.770 INFO:tasks.workunit.client.1.smithi110.stdout:7/494: dread - d1/d1b/d74/f8b zero size 2024-04-12T13:42:05.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/399: creat d4/d8/d7c/f81 x:0 0 0 2024-04-12T13:42:05.777 INFO:tasks.workunit.client.1.smithi110.stdout:9/568: dread df/d13/d3b/d40/d56/f6c [0,4194304] 0 2024-04-12T13:42:05.777 INFO:tasks.workunit.client.1.smithi110.stdout:0/416: dwrite d1/d8/d36/d51/d60/f41 [0,4194304] 0 2024-04-12T13:42:05.779 INFO:tasks.workunit.client.1.smithi110.stdout:0/417: write d1/d8/f34 [262759,50869] 0 2024-04-12T13:42:05.782 INFO:tasks.workunit.client.0.smithi060.stdout:8/440: write d9/d1b/f19 [5655246,44915] 0 2024-04-12T13:42:05.783 INFO:tasks.workunit.client.0.smithi060.stdout:3/489: rmdir d7/d17/d19/d33/d63 39 2024-04-12T13:42:05.785 INFO:tasks.workunit.client.1.smithi110.stdout:1/450: truncate de/d15/f3f 1571160 0 2024-04-12T13:42:05.785 INFO:tasks.workunit.client.0.smithi060.stdout:0/441: fsync d7/d33/d88/f99 0 2024-04-12T13:42:05.785 INFO:tasks.workunit.client.0.smithi060.stdout:4/447: write d6/d7/dd/d1a/d19/f5a [88082,33131] 0 2024-04-12T13:42:05.785 INFO:tasks.workunit.client.0.smithi060.stdout:8/441: write d9/d1b/d3c/f77 [909298,76549] 0 2024-04-12T13:42:05.786 INFO:tasks.workunit.client.1.smithi110.stdout:1/451: stat de/d1d/d86 0 2024-04-12T13:42:05.789 INFO:tasks.workunit.client.1.smithi110.stdout:4/611: rmdir d0/d75 39 2024-04-12T13:42:05.792 INFO:tasks.workunit.client.1.smithi110.stdout:2/522: mknod d6/dc/d13/d80/d8d/c9a 0 2024-04-12T13:42:05.793 INFO:tasks.workunit.client.1.smithi110.stdout:6/495: dwrite d7/d10/d1c/f28 [0,4194304] 0 2024-04-12T13:42:05.793 INFO:tasks.workunit.client.1.smithi110.stdout:4/612: chown d0/d19/d26/d65/fb3 363581 1 2024-04-12T13:42:05.794 INFO:tasks.workunit.client.0.smithi060.stdout:4/448: read d6/d7/db/f22 [2851287,33861] 0 2024-04-12T13:42:05.794 INFO:tasks.workunit.client.1.smithi110.stdout:3/483: mkdir d5/dc/d20/d2d/da6 0 2024-04-12T13:42:05.796 INFO:tasks.workunit.client.0.smithi060.stdout:5/491: rmdir d6/dd/d1f/d25/d8e 0 2024-04-12T13:42:05.797 INFO:tasks.workunit.client.0.smithi060.stdout:9/400: dwrite d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:05.797 INFO:tasks.workunit.client.0.smithi060.stdout:4/449: chown d6/c86 19 1 2024-04-12T13:42:05.798 INFO:tasks.workunit.client.1.smithi110.stdout:8/481: getdents d1/d3/d35/d3a/d3e/d64 0 2024-04-12T13:42:05.808 INFO:tasks.workunit.client.1.smithi110.stdout:7/495: rename d1/d3/d4/f35 to d1/d3/d4/d55/faa 0 2024-04-12T13:42:05.810 INFO:tasks.workunit.client.1.smithi110.stdout:7/496: chown d1/d3/d43/c75 3945588 1 2024-04-12T13:42:05.810 INFO:tasks.workunit.client.0.smithi060.stdout:2/459: getdents d6/d13/d17 0 2024-04-12T13:42:05.811 INFO:tasks.workunit.client.1.smithi110.stdout:7/497: read - d1/d1b/d74/f8b zero size 2024-04-12T13:42:05.813 INFO:tasks.workunit.client.1.smithi110.stdout:0/418: dread d1/d27/d31/f49 [0,4194304] 0 2024-04-12T13:42:05.814 INFO:tasks.workunit.client.1.smithi110.stdout:0/419: write d1/f2f [3745137,34206] 0 2024-04-12T13:42:05.818 INFO:tasks.workunit.client.0.smithi060.stdout:1/568: dwrite d1e/d23/f89 [4194304,4194304] 0 2024-04-12T13:42:05.822 INFO:tasks.workunit.client.0.smithi060.stdout:0/442: mknod d7/d41/ca2 0 2024-04-12T13:42:05.826 INFO:tasks.workunit.client.0.smithi060.stdout:9/401: mknod d4/d9/d19/c82 0 2024-04-12T13:42:05.828 INFO:tasks.workunit.client.1.smithi110.stdout:2/523: creat d6/dc/d13/d80/f9b x:0 0 0 2024-04-12T13:42:05.828 INFO:tasks.workunit.client.1.smithi110.stdout:0/420: dwrite d1/f22 [0,4194304] 0 2024-04-12T13:42:05.829 INFO:tasks.workunit.client.0.smithi060.stdout:7/399: getdents d0/d7/d43/d63/d6f 0 2024-04-12T13:42:05.830 INFO:tasks.workunit.client.1.smithi110.stdout:4/613: truncate d0/d75/d84/d89/fba 188834 0 2024-04-12T13:42:05.833 INFO:tasks.workunit.client.1.smithi110.stdout:8/482: mkdir d1/d3/d3c/d5a/d6f/d9c 0 2024-04-12T13:42:05.836 INFO:tasks.workunit.client.1.smithi110.stdout:9/569: dwrite df/d13/d2c/d2d/d39/d3a/f62 [0,4194304] 0 2024-04-12T13:42:05.838 INFO:tasks.workunit.client.0.smithi060.stdout:3/490: unlink d7/da/d3f/d5c/c16 0 2024-04-12T13:42:05.839 INFO:tasks.workunit.client.0.smithi060.stdout:1/569: truncate f14 356540 0 2024-04-12T13:42:05.839 INFO:tasks.workunit.client.0.smithi060.stdout:7/400: dread d0/f64 [0,4194304] 0 2024-04-12T13:42:05.843 INFO:tasks.workunit.client.0.smithi060.stdout:9/402: dread d4/d9/d19/f63 [0,4194304] 0 2024-04-12T13:42:05.843 INFO:tasks.workunit.client.0.smithi060.stdout:8/442: symlink d9/d1b/d3c/d8d/l94 0 2024-04-12T13:42:05.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/492: mkdir d6/d89/da3 0 2024-04-12T13:42:05.846 INFO:tasks.workunit.client.1.smithi110.stdout:2/524: dwrite d6/d18/f29 [4194304,4194304] 0 2024-04-12T13:42:05.851 INFO:tasks.workunit.client.0.smithi060.stdout:4/450: creat d6/d7/dd/d1a/d19/d42/d7c/f9a x:0 0 0 2024-04-12T13:42:05.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/451: chown d6 864084600 1 2024-04-12T13:42:05.855 INFO:tasks.workunit.client.0.smithi060.stdout:2/460: mknod d6/d56/d86/c89 0 2024-04-12T13:42:05.856 INFO:tasks.workunit.client.0.smithi060.stdout:2/461: chown d6/d10/c3b 86411957 1 2024-04-12T13:42:05.857 INFO:tasks.workunit.client.0.smithi060.stdout:3/491: chown d7/f47 693 1 2024-04-12T13:42:05.862 INFO:tasks.workunit.client.0.smithi060.stdout:7/401: rename d0/c29 to d0/c8a 0 2024-04-12T13:42:05.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/493: dread d6/dd/d1f/d25/d42/d52/f75 [0,4194304] 0 2024-04-12T13:42:05.868 INFO:tasks.workunit.client.1.smithi110.stdout:5/441: sync 2024-04-12T13:42:05.872 INFO:tasks.workunit.client.0.smithi060.stdout:1/570: creat d1e/d23/d2e/d8e/d98/fc8 x:0 0 0 2024-04-12T13:42:05.874 INFO:tasks.workunit.client.0.smithi060.stdout:8/443: dwrite d9/d1b/d37/d4d/d63/f85 [0,4194304] 0 2024-04-12T13:42:05.877 INFO:tasks.workunit.client.0.smithi060.stdout:4/452: creat d6/d7/dd/d4d/f9b x:0 0 0 2024-04-12T13:42:05.877 INFO:tasks.workunit.client.0.smithi060.stdout:1/571: truncate d1e/d46/fb8 34281 0 2024-04-12T13:42:05.878 INFO:tasks.workunit.client.1.smithi110.stdout:1/452: mkdir de/d7b/da1 0 2024-04-12T13:42:05.884 INFO:tasks.workunit.client.1.smithi110.stdout:7/498: write d1/d3/d4/f1c [3933077,6204] 0 2024-04-12T13:42:05.886 INFO:tasks.workunit.client.1.smithi110.stdout:0/421: mkdir d1/d27/d31/d89 0 2024-04-12T13:42:05.888 INFO:tasks.workunit.client.1.smithi110.stdout:4/614: mknod d0/d19/d1c/d50/d6f/db9/ccb 0 2024-04-12T13:42:05.889 INFO:tasks.workunit.client.1.smithi110.stdout:8/483: rename d1/d7/f32 to d1/d3/d3c/d5a/f9d 0 2024-04-12T13:42:05.890 INFO:tasks.workunit.client.1.smithi110.stdout:2/525: mkdir d6/dc/d1b/d8f/d9c 0 2024-04-12T13:42:05.892 INFO:tasks.workunit.client.1.smithi110.stdout:6/496: link d7/d25/d30/d44/d3d/f76 d7/d25/f9f 0 2024-04-12T13:42:05.896 INFO:tasks.workunit.client.1.smithi110.stdout:9/570: creat df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/db4/fb8 x:0 0 0 2024-04-12T13:42:05.897 INFO:tasks.workunit.client.1.smithi110.stdout:0/422: fsync d1/d8/d36/d51/d60/f70 0 2024-04-12T13:42:05.899 INFO:tasks.workunit.client.1.smithi110.stdout:4/615: write d0/de/d32/d61/f7a [32240,121179] 0 2024-04-12T13:42:05.902 INFO:tasks.workunit.client.1.smithi110.stdout:6/497: write d7/f1a [5422478,37157] 0 2024-04-12T13:42:05.902 INFO:tasks.workunit.client.1.smithi110.stdout:7/499: mknod d1/d1b/cab 0 2024-04-12T13:42:05.903 INFO:tasks.workunit.client.1.smithi110.stdout:6/498: stat d7/d10/d7e/d85 0 2024-04-12T13:42:05.908 INFO:tasks.workunit.client.1.smithi110.stdout:3/484: truncate d5/dc/f12 3369979 0 2024-04-12T13:42:05.909 INFO:tasks.workunit.client.0.smithi060.stdout:7/402: creat d0/d3d/f8b x:0 0 0 2024-04-12T13:42:05.909 INFO:tasks.workunit.client.1.smithi110.stdout:9/571: fdatasync df/f1e 0 2024-04-12T13:42:05.910 INFO:tasks.workunit.client.0.smithi060.stdout:0/443: rename d7/d33/d88/f99 to d7/fa3 0 2024-04-12T13:42:05.912 INFO:tasks.workunit.client.0.smithi060.stdout:7/403: dread - d0/d1b/f60 zero size 2024-04-12T13:42:05.913 INFO:tasks.workunit.client.1.smithi110.stdout:0/423: mkdir d1/d8/d8a 0 2024-04-12T13:42:05.913 INFO:tasks.workunit.client.0.smithi060.stdout:3/492: dwrite d7/da/d3f/f41 [0,4194304] 0 2024-04-12T13:42:05.921 INFO:tasks.workunit.client.0.smithi060.stdout:8/444: mknod d9/d1b/d84/c95 0 2024-04-12T13:42:05.925 INFO:tasks.workunit.client.1.smithi110.stdout:5/442: rename da/db/d61 to da/d2e/d45/d25/d9d 0 2024-04-12T13:42:05.925 INFO:tasks.workunit.client.1.smithi110.stdout:1/453: dwrite de/d1d/f28 [0,4194304] 0 2024-04-12T13:42:05.926 INFO:tasks.workunit.client.0.smithi060.stdout:8/445: write d9/d1b/d37/d48/f62 [884474,122057] 0 2024-04-12T13:42:05.926 INFO:tasks.workunit.client.1.smithi110.stdout:5/443: stat da/d2e/d45/d29/f2d 0 2024-04-12T13:42:05.927 INFO:tasks.workunit.client.1.smithi110.stdout:4/616: symlink d0/d19/d8f/dc5/lcc 0 2024-04-12T13:42:05.928 INFO:tasks.workunit.client.0.smithi060.stdout:4/453: creat d6/d7/dd/d1a/d19/d42/f9c x:0 0 0 2024-04-12T13:42:05.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:05 smithi060 ceph-mon[29097]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 51 MiB/s rd, 246 MiB/s wr, 421 op/s 2024-04-12T13:42:05.931 INFO:tasks.workunit.client.1.smithi110.stdout:5/444: chown da/d2e/d45/d29/d58/c98 1531 1 2024-04-12T13:42:05.933 INFO:tasks.workunit.client.1.smithi110.stdout:5/445: fsync da/d2e/d45/f90 0 2024-04-12T13:42:05.933 INFO:tasks.workunit.client.1.smithi110.stdout:3/485: mkdir d5/dc/d31/d74/d75/da7 0 2024-04-12T13:42:05.935 INFO:tasks.workunit.client.1.smithi110.stdout:3/486: readlink d5/dc/d20/d2d/l94 0 2024-04-12T13:42:05.938 INFO:tasks.workunit.client.1.smithi110.stdout:9/572: fdatasync df/d13/d2c/d2d/f64 0 2024-04-12T13:42:05.942 INFO:tasks.workunit.client.0.smithi060.stdout:7/404: mkdir d0/d1b/d8c 0 2024-04-12T13:42:05.942 INFO:tasks.workunit.client.1.smithi110.stdout:6/499: mknod d7/d25/ca0 0 2024-04-12T13:42:05.943 INFO:tasks.workunit.client.0.smithi060.stdout:1/572: dwrite d1e/d29/d65/f7f [0,4194304] 0 2024-04-12T13:42:05.953 INFO:tasks.workunit.client.1.smithi110.stdout:8/484: getdents d1/d3/d35/d3a/d84 0 2024-04-12T13:42:05.956 INFO:tasks.workunit.client.1.smithi110.stdout:1/454: creat de/d15/d32/d61/d96/fa2 x:0 0 0 2024-04-12T13:42:05.956 INFO:tasks.workunit.client.1.smithi110.stdout:7/500: truncate d1/d3/d4/d55/f62 502450 0 2024-04-12T13:42:05.957 INFO:tasks.workunit.client.1.smithi110.stdout:4/617: unlink d0/de/fc6 0 2024-04-12T13:42:05.958 INFO:tasks.workunit.client.0.smithi060.stdout:8/446: write d9/d1b/d37/d4d/f5a [585855,64716] 0 2024-04-12T13:42:05.958 INFO:tasks.workunit.client.0.smithi060.stdout:0/444: dwrite d7/f3e [4194304,4194304] 0 2024-04-12T13:42:05.962 INFO:tasks.workunit.client.1.smithi110.stdout:4/618: write d0/de/d2c/f2b [4378989,67416] 0 2024-04-12T13:42:05.962 INFO:tasks.workunit.client.0.smithi060.stdout:9/403: rename d4/d8/cf to d4/c83 0 2024-04-12T13:42:05.964 INFO:tasks.workunit.client.0.smithi060.stdout:7/405: write d0/d7/f55 [941327,113515] 0 2024-04-12T13:42:05.965 INFO:tasks.workunit.client.0.smithi060.stdout:9/404: write d4/d8/f3b [1050585,105699] 0 2024-04-12T13:42:05.965 INFO:tasks.workunit.client.1.smithi110.stdout:9/573: mknod df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/d72/cb9 0 2024-04-12T13:42:05.966 INFO:tasks.workunit.client.1.smithi110.stdout:0/424: dwrite d1/d27/d31/f49 [4194304,4194304] 0 2024-04-12T13:42:05.968 INFO:tasks.workunit.client.0.smithi060.stdout:3/493: creat d7/da/fa9 x:0 0 0 2024-04-12T13:42:05.971 INFO:tasks.workunit.client.1.smithi110.stdout:6/500: read d7/d25/d30/d44/f21 [3292842,122385] 0 2024-04-12T13:42:05.973 INFO:tasks.workunit.client.1.smithi110.stdout:6/501: write d7/d10/d1c/f6d [591632,40051] 0 2024-04-12T13:42:05.974 INFO:tasks.workunit.client.0.smithi060.stdout:0/445: fsync d7/d9/f48 0 2024-04-12T13:42:05.975 INFO:tasks.workunit.client.0.smithi060.stdout:8/447: unlink d9/d1d/d2f/f4f 0 2024-04-12T13:42:05.983 INFO:tasks.workunit.client.0.smithi060.stdout:2/462: rename d6/d10/c27 to d6/d10/d4b/c8a 0 2024-04-12T13:42:05.984 INFO:tasks.workunit.client.1.smithi110.stdout:0/425: dread d1/d27/d31/f64 [0,4194304] 0 2024-04-12T13:42:05.985 INFO:tasks.workunit.client.1.smithi110.stdout:2/526: sync 2024-04-12T13:42:05.987 INFO:tasks.workunit.client.0.smithi060.stdout:2/463: chown d6/d13/d5b/d6d 6 1 2024-04-12T13:42:05.988 INFO:tasks.workunit.client.1.smithi110.stdout:1/455: unlink de/d15/c19 0 2024-04-12T13:42:05.988 INFO:tasks.workunit.client.0.smithi060.stdout:9/405: dwrite d4/d33/d50/f6c [0,4194304] 0 2024-04-12T13:42:05.989 INFO:tasks.workunit.client.1.smithi110.stdout:2/527: chown d6/dc/dd/d49/d64/d4a/d55/f68 31332474 1 2024-04-12T13:42:05.990 INFO:tasks.workunit.client.0.smithi060.stdout:7/406: dwrite d0/d1b/f48 [0,4194304] 0 2024-04-12T13:42:05.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/407: chown d0/d3d/c6e 6 1 2024-04-12T13:42:05.993 INFO:tasks.workunit.client.1.smithi110.stdout:2/528: write d6/dc/dd/d49/d64/d4a/d51/f78 [8048,93417] 0 2024-04-12T13:42:05.993 INFO:tasks.workunit.client.1.smithi110.stdout:3/487: dwrite d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:42:05.995 INFO:tasks.workunit.client.0.smithi060.stdout:7/408: write d0/d3d/d74/f7e [141698,18261] 0 2024-04-12T13:42:05.996 INFO:tasks.workunit.client.1.smithi110.stdout:2/529: fsync d6/dc/f14 0 2024-04-12T13:42:05.996 INFO:tasks.workunit.client.0.smithi060.stdout:3/494: truncate d7/da/d3f/d5c/f54 1268688 0 2024-04-12T13:42:05.997 INFO:tasks.workunit.client.0.smithi060.stdout:3/495: readlink d7/d17/d19/d33/l34 0 2024-04-12T13:42:05.998 INFO:tasks.workunit.client.1.smithi110.stdout:3/488: chown d5/dc/d31/d3b/d32/d3e/f41 17 1 2024-04-12T13:42:06.000 INFO:tasks.workunit.client.0.smithi060.stdout:0/446: symlink d7/d9/d14/d35/d44/d49/d67/la4 0 2024-04-12T13:42:06.002 INFO:tasks.workunit.client.0.smithi060.stdout:0/447: write d7/f87 [471442,119811] 0 2024-04-12T13:42:06.008 INFO:tasks.workunit.client.1.smithi110.stdout:8/485: dwrite d1/d5/d1f/f66 [0,4194304] 0 2024-04-12T13:42:06.011 INFO:tasks.workunit.client.0.smithi060.stdout:4/454: rename d6/d7/db/d62 to d6/d7/dd/d1a/d19/d7a/d9d 0 2024-04-12T13:42:06.012 INFO:tasks.workunit.client.1.smithi110.stdout:7/501: write d1/d1b/d94/f95 [277253,76700] 0 2024-04-12T13:42:06.012 INFO:tasks.workunit.client.1.smithi110.stdout:5/446: truncate da/d35/d71/d8f/f7b 8401643 0 2024-04-12T13:42:06.014 INFO:tasks.workunit.client.1.smithi110.stdout:1/456: dwrite de/d14/d34/f75 [0,4194304] 0 2024-04-12T13:42:06.016 INFO:tasks.workunit.client.0.smithi060.stdout:4/455: dread d6/d7/dd/d4d/d69/f8a [0,4194304] 0 2024-04-12T13:42:06.017 INFO:tasks.workunit.client.0.smithi060.stdout:7/409: creat d0/d78/f8d x:0 0 0 2024-04-12T13:42:06.020 INFO:tasks.workunit.client.1.smithi110.stdout:1/457: write de/d14/f3a [1789821,44042] 0 2024-04-12T13:42:06.022 INFO:tasks.workunit.client.1.smithi110.stdout:9/574: fdatasync df/d13/d2c/d2d/d39/d3a/f77 0 2024-04-12T13:42:06.025 INFO:tasks.workunit.client.1.smithi110.stdout:0/426: truncate d1/f14 4724749 0 2024-04-12T13:42:06.026 INFO:tasks.workunit.client.0.smithi060.stdout:6/556: sync 2024-04-12T13:42:06.028 INFO:tasks.workunit.client.0.smithi060.stdout:7/410: creat d0/d7/d43/d4d/f8e x:0 0 0 2024-04-12T13:42:06.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/411: chown d0/d3d/d74/l75 64377 1 2024-04-12T13:42:06.035 INFO:tasks.workunit.client.1.smithi110.stdout:8/486: readlink d1/d3/d3c/l37 0 2024-04-12T13:42:06.037 INFO:tasks.workunit.client.0.smithi060.stdout:9/406: creat d4/d8/f84 x:0 0 0 2024-04-12T13:42:06.039 INFO:tasks.workunit.client.1.smithi110.stdout:4/619: mkdir d0/d19/d26/d65/d7e/daa/dcd 0 2024-04-12T13:42:06.039 INFO:tasks.workunit.client.1.smithi110.stdout:7/502: dwrite d1/d3/f11 [0,4194304] 0 2024-04-12T13:42:06.041 INFO:tasks.workunit.client.0.smithi060.stdout:0/448: dwrite d7/d41/f7f [0,4194304] 0 2024-04-12T13:42:06.048 INFO:tasks.workunit.client.1.smithi110.stdout:5/447: mkdir da/d2e/d45/d25/d9d/d79/d9e 0 2024-04-12T13:42:06.051 INFO:tasks.workunit.client.0.smithi060.stdout:1/573: rename d1e/d46/f67 to d1e/d23/d2e/fc9 0 2024-04-12T13:42:06.053 INFO:tasks.workunit.client.0.smithi060.stdout:8/448: dwrite d9/d1d/d2f/f4b [0,4194304] 0 2024-04-12T13:42:06.060 INFO:tasks.workunit.client.1.smithi110.stdout:6/502: write d7/d25/d30/d44/d3d/f5b [880632,37778] 0 2024-04-12T13:42:06.063 INFO:tasks.workunit.client.0.smithi060.stdout:2/464: dwrite d6/d56/d43/f50 [0,4194304] 0 2024-04-12T13:42:06.066 INFO:tasks.workunit.client.0.smithi060.stdout:9/407: creat d4/d33/d50/f85 x:0 0 0 2024-04-12T13:42:06.066 INFO:tasks.workunit.client.1.smithi110.stdout:9/575: symlink df/d13/d2c/d2d/d39/lba 0 2024-04-12T13:42:06.069 INFO:tasks.workunit.client.0.smithi060.stdout:3/496: getdents d7/da/d3f/d5c/d25/d4d 0 2024-04-12T13:42:06.070 INFO:tasks.workunit.client.1.smithi110.stdout:0/427: mknod d1/d27/c8b 0 2024-04-12T13:42:06.073 INFO:tasks.workunit.client.1.smithi110.stdout:2/530: mkdir d6/dc/d9d 0 2024-04-12T13:42:06.074 INFO:tasks.workunit.client.0.smithi060.stdout:3/497: readlink d7/d17/d19/d33/l34 0 2024-04-12T13:42:06.075 INFO:tasks.workunit.client.0.smithi060.stdout:4/456: link d6/d7/dd/l4f d6/d7/dd/df/l9e 0 2024-04-12T13:42:06.075 INFO:tasks.workunit.client.1.smithi110.stdout:3/489: mknod d5/dc/d31/d3b/d32/d3e/d87/ca8 0 2024-04-12T13:42:06.075 INFO:tasks.workunit.client.1.smithi110.stdout:2/531: write d6/dc/dd/d49/f6c [1172971,99117] 0 2024-04-12T13:42:06.080 INFO:tasks.workunit.client.1.smithi110.stdout:8/487: write d1/d3/d3c/f33 [627675,87035] 0 2024-04-12T13:42:06.084 INFO:tasks.workunit.client.1.smithi110.stdout:4/620: rmdir d0/d19/d1c 39 2024-04-12T13:42:06.086 INFO:tasks.workunit.client.1.smithi110.stdout:7/503: unlink d1/d3/d43/c75 0 2024-04-12T13:42:06.090 INFO:tasks.workunit.client.1.smithi110.stdout:5/448: write da/db/d15/f59 [3943231,101485] 0 2024-04-12T13:42:06.090 INFO:tasks.workunit.client.1.smithi110.stdout:1/458: write de/d14/d34/f5f [5021261,123937] 0 2024-04-12T13:42:06.090 INFO:tasks.workunit.client.0.smithi060.stdout:2/465: dwrite d6/d13/d31/d33/f82 [0,4194304] 0 2024-04-12T13:42:06.093 INFO:tasks.workunit.client.1.smithi110.stdout:3/490: dwrite d5/dc/d31/d3b/d32/d3e/d5f/f8b [0,4194304] 0 2024-04-12T13:42:06.094 INFO:tasks.workunit.client.1.smithi110.stdout:6/503: mknod d7/d25/d2c/ca1 0 2024-04-12T13:42:06.096 INFO:tasks.workunit.client.1.smithi110.stdout:9/576: symlink df/d13/d2c/d9e/lbb 0 2024-04-12T13:42:06.096 INFO:tasks.workunit.client.1.smithi110.stdout:3/491: write d5/dc/d20/f2a [3599023,17887] 0 2024-04-12T13:42:06.097 INFO:tasks.workunit.client.1.smithi110.stdout:1/459: write de/d15/d32/f44 [6108301,80983] 0 2024-04-12T13:42:06.099 INFO:tasks.workunit.client.1.smithi110.stdout:1/460: readlink de/d14/d83/l9d 0 2024-04-12T13:42:06.101 INFO:tasks.workunit.client.0.smithi060.stdout:3/498: dwrite d7/d17/f90 [0,4194304] 0 2024-04-12T13:42:06.104 INFO:tasks.workunit.client.0.smithi060.stdout:3/499: dread - d7/d17/d27/d36/f99 zero size 2024-04-12T13:42:06.106 INFO:tasks.workunit.client.1.smithi110.stdout:8/488: unlink d1/d3/d35/c58 0 2024-04-12T13:42:06.110 INFO:tasks.workunit.client.1.smithi110.stdout:7/504: dread d1/d1b/d3d/d68/d97/da5/f3b [0,4194304] 0 2024-04-12T13:42:06.118 INFO:tasks.workunit.client.0.smithi060.stdout:6/557: getdents d1/d7/da/dc/d24/d34/d51/d97/dc0 0 2024-04-12T13:42:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:1/574: rmdir d1e 39 2024-04-12T13:42:06.127 INFO:tasks.workunit.client.0.smithi060.stdout:7/412: symlink d0/d1b/d8c/l8f 0 2024-04-12T13:42:06.129 INFO:tasks.workunit.client.1.smithi110.stdout:7/505: creat d1/d1b/d94/fac x:0 0 0 2024-04-12T13:42:06.131 INFO:tasks.workunit.client.0.smithi060.stdout:4/457: truncate d6/d7/dd/d1a/d19/f1f 8834947 0 2024-04-12T13:42:06.133 INFO:tasks.workunit.client.1.smithi110.stdout:0/428: creat d1/f8c x:0 0 0 2024-04-12T13:42:06.135 INFO:tasks.workunit.client.1.smithi110.stdout:3/492: mknod d5/ca9 0 2024-04-12T13:42:06.135 INFO:tasks.workunit.client.1.smithi110.stdout:9/577: dwrite df/d13/d26/f28 [0,4194304] 0 2024-04-12T13:42:06.136 INFO:tasks.workunit.client.0.smithi060.stdout:2/466: rmdir d6/d56/d86 39 2024-04-12T13:42:06.140 INFO:tasks.workunit.client.1.smithi110.stdout:2/532: creat d6/dc/d13/f9e x:0 0 0 2024-04-12T13:42:06.141 INFO:tasks.workunit.client.1.smithi110.stdout:2/533: dread - d6/dc/d13/f9e zero size 2024-04-12T13:42:06.142 INFO:tasks.workunit.client.1.smithi110.stdout:4/621: rename d0/de/d32/d5f/l5e to d0/d19/lce 0 2024-04-12T13:42:06.143 INFO:tasks.workunit.client.0.smithi060.stdout:8/449: dwrite d9/d1b/d3c/d6e/f86 [0,4194304] 0 2024-04-12T13:42:06.143 INFO:tasks.workunit.client.1.smithi110.stdout:2/534: write d6/dc/d13/f9e [653191,119369] 0 2024-04-12T13:42:06.144 INFO:tasks.workunit.client.0.smithi060.stdout:6/558: rename d1/d7/da/dc/d24/d2d/fa7 to d1/d7d/fcc 0 2024-04-12T13:42:06.145 INFO:tasks.workunit.client.1.smithi110.stdout:2/535: fsync d6/dc/dd/d49/d64/d4a/d51/f2f 0 2024-04-12T13:42:06.149 INFO:tasks.workunit.client.0.smithi060.stdout:1/575: write d1e/d23/d2e/d30/f36 [1611796,86188] 0 2024-04-12T13:42:06.150 INFO:tasks.workunit.client.1.smithi110.stdout:9/578: read df/d13/d2c/f8f [2533793,76162] 0 2024-04-12T13:42:06.152 INFO:tasks.workunit.client.1.smithi110.stdout:7/506: write d1/d3/d4/d55/faa [2186608,109348] 0 2024-04-12T13:42:06.153 INFO:tasks.workunit.client.1.smithi110.stdout:0/429: write d1/d8/f34 [655317,16330] 0 2024-04-12T13:42:06.154 INFO:tasks.workunit.client.0.smithi060.stdout:7/413: unlink d0/d1b/f1d 0 2024-04-12T13:42:06.154 INFO:tasks.workunit.client.1.smithi110.stdout:7/507: chown d1/d1b 160189054 1 2024-04-12T13:42:06.156 INFO:tasks.workunit.client.1.smithi110.stdout:2/536: truncate d6/dc/dd/f81 101661 0 2024-04-12T13:42:06.157 INFO:tasks.workunit.client.0.smithi060.stdout:4/458: unlink d6/d7/dd/d1a/d19/d42/c43 0 2024-04-12T13:42:06.161 INFO:tasks.workunit.client.1.smithi110.stdout:6/504: rename d7/d10/d1c/d2b/d3a/d82/f7b to d7/d25/d2c/fa2 0 2024-04-12T13:42:06.162 INFO:tasks.workunit.client.1.smithi110.stdout:4/622: symlink d0/d75/d84/lcf 0 2024-04-12T13:42:06.167 INFO:tasks.workunit.client.0.smithi060.stdout:0/449: dwrite d7/d9/d4c/f50 [0,4194304] 0 2024-04-12T13:42:06.168 INFO:tasks.workunit.client.0.smithi060.stdout:3/500: symlink d7/da/d3f/laa 0 2024-04-12T13:42:06.169 INFO:tasks.workunit.client.1.smithi110.stdout:5/449: link da/d35/d71/d89/l9c da/db/l9f 0 2024-04-12T13:42:06.169 INFO:tasks.workunit.client.1.smithi110.stdout:8/489: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:42:06.174 INFO:tasks.workunit.client.0.smithi060.stdout:8/450: unlink d9/d1b/d37/f3a 0 2024-04-12T13:42:06.180 INFO:tasks.workunit.client.1.smithi110.stdout:7/508: mkdir d1/d3/d4/d55/d56/d72/dad 0 2024-04-12T13:42:06.180 INFO:tasks.workunit.client.1.smithi110.stdout:1/461: dwrite de/f4d [0,4194304] 0 2024-04-12T13:42:06.182 INFO:tasks.workunit.client.0.smithi060.stdout:1/576: unlink d1e/d23/d49/d4e/fbd 0 2024-04-12T13:42:06.182 INFO:tasks.workunit.client.0.smithi060.stdout:7/414: dwrite d0/d3d/d74/f7e [0,4194304] 0 2024-04-12T13:42:06.184 INFO:tasks.workunit.client.0.smithi060.stdout:2/467: dread d6/d10/f57 [0,4194304] 0 2024-04-12T13:42:06.188 INFO:tasks.workunit.client.1.smithi110.stdout:2/537: unlink d6/dc/dd/d49/d64/d4a/d3c/d6e/l79 0 2024-04-12T13:42:06.192 INFO:tasks.workunit.client.1.smithi110.stdout:9/579: rename df/d13/d2c/d2d/d39/d3a/d4e/d83/d5d/f67 to df/d13/d3b/d40/d56/fbc 0 2024-04-12T13:42:06.195 INFO:tasks.workunit.client.1.smithi110.stdout:3/493: dread d5/f28 [0,4194304] 0 2024-04-12T13:42:06.201 INFO:tasks.workunit.client.1.smithi110.stdout:8/490: dwrite d1/d3/d3c/d5a/d6f/d7e/f63 [0,4194304] 0 2024-04-12T13:42:06.202 INFO:tasks.workunit.client.0.smithi060.stdout:6/559: write d1/d7/da/dc/d24/d30/d52/f81 [756753,81409] 0 2024-04-12T13:42:06.204 INFO:tasks.workunit.client.0.smithi060.stdout:0/450: mkdir d7/d9/d14/d35/d44/d49/d67/da5 0 2024-04-12T13:42:06.205 INFO:tasks.workunit.client.0.smithi060.stdout:6/560: fdatasync d1/d7/da/dc/d24/d8b/f8f 0 2024-04-12T13:42:06.207 INFO:tasks.workunit.client.1.smithi110.stdout:7/509: dread d1/d3/f11 [0,4194304] 0 2024-04-12T13:42:06.207 INFO:tasks.workunit.client.0.smithi060.stdout:6/561: chown d1/d7/da/dc/d24/d8b/f8f 20032538 1 2024-04-12T13:42:06.208 INFO:tasks.workunit.client.0.smithi060.stdout:8/451: creat d9/d1b/d3c/d6e/f96 x:0 0 0 2024-04-12T13:42:06.209 INFO:tasks.workunit.client.0.smithi060.stdout:6/562: chown d1/d7/da/d20 3839600 1 2024-04-12T13:42:06.210 INFO:tasks.workunit.client.1.smithi110.stdout:2/538: creat d6/dc/dd/d49/d64/d5d/f9f x:0 0 0 2024-04-12T13:42:06.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/452: write d9/d1b/d37/d4d/f7e [2683740,21228] 0 2024-04-12T13:42:06.211 INFO:tasks.workunit.client.1.smithi110.stdout:4/623: dwrite d0/d78/f81 [0,4194304] 0 2024-04-12T13:42:06.214 INFO:tasks.workunit.client.1.smithi110.stdout:9/580: mknod df/d8a/cbd 0 2024-04-12T13:42:06.217 INFO:tasks.workunit.client.0.smithi060.stdout:1/577: write d1e/d23/d2e/d30/f96 [152409,15696] 0 2024-04-12T13:42:06.220 INFO:tasks.workunit.client.0.smithi060.stdout:7/415: mkdir d0/d7/d43/d63/d90 0 2024-04-12T13:42:06.222 INFO:tasks.workunit.client.1.smithi110.stdout:3/494: fsync d5/dc/d31/d3b/d5b/f96 0 2024-04-12T13:42:06.223 INFO:tasks.workunit.client.0.smithi060.stdout:2/468: symlink d6/d13/d31/d33/d3d/l8b 0 2024-04-12T13:42:06.224 INFO:tasks.workunit.client.1.smithi110.stdout:8/491: mkdir d1/d3/d35/d3a/d84/d9e 0 2024-04-12T13:42:06.225 INFO:tasks.workunit.client.0.smithi060.stdout:4/459: truncate d6/d7/db/f8e 561224 0 2024-04-12T13:42:06.227 INFO:tasks.workunit.client.1.smithi110.stdout:8/492: write d1/d3/d3c/d5a/d6f/d83/f8c [34391,121933] 0 2024-04-12T13:42:06.227 INFO:tasks.workunit.client.0.smithi060.stdout:3/501: mkdir d7/d17/d19/d33/d63/d6d/dab 0 2024-04-12T13:42:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:05 smithi110 ceph-mon[36055]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 51 MiB/s rd, 246 MiB/s wr, 421 op/s 2024-04-12T13:42:06.229 INFO:tasks.workunit.client.1.smithi110.stdout:8/493: truncate d1/f9b 137985 0 2024-04-12T13:42:06.229 INFO:tasks.workunit.client.1.smithi110.stdout:1/462: creat de/d1d/d86/fa3 x:0 0 0 2024-04-12T13:42:06.230 INFO:tasks.workunit.client.0.smithi060.stdout:0/451: fsync d7/d9/f1a 0 2024-04-12T13:42:06.231 INFO:tasks.workunit.client.1.smithi110.stdout:1/463: chown de/d15/d32/f39 151161 1 2024-04-12T13:42:06.233 INFO:tasks.workunit.client.0.smithi060.stdout:4/460: truncate d6/d7/dd/d1a/d19/f5a 529908 0 2024-04-12T13:42:06.233 INFO:tasks.workunit.client.1.smithi110.stdout:8/494: write d1/d3/d3c/d5a/d6f/d7e/f63 [593060,73941] 0 2024-04-12T13:42:06.236 INFO:tasks.workunit.client.1.smithi110.stdout:3/495: dread d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:42:06.238 INFO:tasks.workunit.client.0.smithi060.stdout:1/578: creat d1e/d23/d2e/d5e/d68/fca x:0 0 0 2024-04-12T13:42:06.241 INFO:tasks.workunit.client.0.smithi060.stdout:2/469: mknod d6/d56/d55/c8c 0 2024-04-12T13:42:06.250 INFO:tasks.workunit.client.0.smithi060.stdout:4/461: symlink d6/d7/dd/d1a/l9f 0 2024-04-12T13:42:06.251 INFO:tasks.workunit.client.0.smithi060.stdout:2/470: dread d6/d13/d31/f41 [4194304,4194304] 0 2024-04-12T13:42:06.254 INFO:tasks.workunit.client.1.smithi110.stdout:7/510: dwrite d1/d3/d4/d36/da1/f80 [0,4194304] 0 2024-04-12T13:42:06.255 INFO:tasks.workunit.client.1.smithi110.stdout:5/450: dwrite da/db/f37 [0,4194304] 0 2024-04-12T13:42:06.256 INFO:tasks.workunit.client.0.smithi060.stdout:1/579: symlink d1e/d23/d49/d4e/d9b/lcb 0 2024-04-12T13:42:06.256 INFO:tasks.workunit.client.1.smithi110.stdout:2/539: creat d6/dc/d13/d80/fa0 x:0 0 0 2024-04-12T13:42:06.258 INFO:tasks.workunit.client.1.smithi110.stdout:1/464: dwrite de/d1d/f97 [0,4194304] 0 2024-04-12T13:42:06.259 INFO:tasks.workunit.client.1.smithi110.stdout:4/624: write d0/d75/f79 [4004733,94628] 0 2024-04-12T13:42:06.263 INFO:tasks.workunit.client.1.smithi110.stdout:0/430: link d1/d27/d31/l3b d1/d8/d36/l8d 0 2024-04-12T13:42:06.264 INFO:tasks.workunit.client.1.smithi110.stdout:8/495: dwrite d1/d7/d20/f36 [0,4194304] 0 2024-04-12T13:42:06.276 INFO:tasks.workunit.client.1.smithi110.stdout:7/511: mknod d1/d1b/d74/cae 0 2024-04-12T13:42:06.277 INFO:tasks.workunit.client.0.smithi060.stdout:1/580: readlink l18 0 2024-04-12T13:42:06.278 INFO:tasks.workunit.client.0.smithi060.stdout:7/416: dwrite d0/d1b/f31 [0,4194304] 0 2024-04-12T13:42:06.281 INFO:tasks.workunit.client.0.smithi060.stdout:7/417: chown d0/d3d/f56 3375 1 2024-04-12T13:42:06.281 INFO:tasks.workunit.client.0.smithi060.stdout:3/502: rename d7/da/f82 to d7/da/d3f/fac 0 2024-04-12T13:42:06.281 INFO:tasks.workunit.client.0.smithi060.stdout:0/452: write d7/d9/d14/d35/f6b [3806835,130719] 0 2024-04-12T13:42:06.284 INFO:tasks.workunit.client.1.smithi110.stdout:6/505: sync 2024-04-12T13:42:06.285 INFO:tasks.workunit.client.1.smithi110.stdout:9/581: link df/d13/d26/d37/d49/c4a df/d13/d3b/cbe 0 2024-04-12T13:42:06.288 INFO:tasks.workunit.client.0.smithi060.stdout:4/462: symlink d6/la0 0 2024-04-12T13:42:06.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/563: write d1/d7/da/dc/d24/d2d/f55 [1851891,11442] 0 2024-04-12T13:42:06.290 INFO:tasks.workunit.client.1.smithi110.stdout:9/582: chown df/d13/d2c/d2d/d39/l47 30079189 1 2024-04-12T13:42:06.298 INFO:tasks.workunit.client.1.smithi110.stdout:1/465: dwrite de/f64 [0,4194304] 0 2024-04-12T13:42:06.298 INFO:tasks.workunit.client.1.smithi110.stdout:4/625: dwrite d0/de/d2c/d57/fbf [4194304,4194304] 0 2024-04-12T13:42:06.299 INFO:tasks.workunit.client.0.smithi060.stdout:3/503: mknod d7/d17/d27/cad 0 2024-04-12T13:42:06.302 INFO:tasks.workunit.client.1.smithi110.stdout:1/466: chown de/d15/d32/f44 2173460 1 2024-04-12T13:42:06.302 INFO:tasks.workunit.client.1.smithi110.stdout:3/496: truncate d5/dc/d20/d2d/f51 1084643 0 2024-04-12T13:42:06.303 INFO:tasks.workunit.client.1.smithi110.stdout:6/506: dread d7/d25/f9f [0,4194304] 0 2024-04-12T13:42:06.304 INFO:tasks.workunit.client.1.smithi110.stdout:8/496: rename d1/d5/d1f/d8f to d1/d3/d35/d43/d9f 0 2024-04-12T13:42:06.307 INFO:tasks.workunit.client.1.smithi110.stdout:2/540: dread d6/dc/dd/f54 [0,4194304] 0 2024-04-12T13:42:06.309 INFO:tasks.workunit.client.1.smithi110.stdout:5/451: mknod da/db/ca0 0 2024-04-12T13:42:06.310 INFO:tasks.workunit.client.1.smithi110.stdout:2/541: dread - d6/dc/dd/d49/d64/f5a zero size 2024-04-12T13:42:06.310 INFO:tasks.workunit.client.1.smithi110.stdout:5/452: write da/d2e/d45/d29/f2d [411253,4285] 0 2024-04-12T13:42:06.311 INFO:tasks.workunit.client.0.smithi060.stdout:0/453: write d7/d9/d14/d35/d44/d49/d74/f95 [4834362,63086] 0 2024-04-12T13:42:06.311 INFO:tasks.workunit.client.0.smithi060.stdout:1/581: mkdir d1e/dcc 0 2024-04-12T13:42:06.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/471: dwrite f4 [0,4194304] 0 2024-04-12T13:42:06.313 INFO:tasks.workunit.client.1.smithi110.stdout:5/453: write da/d4f/f91 [841379,17257] 0 2024-04-12T13:42:06.313 INFO:tasks.workunit.client.1.smithi110.stdout:2/542: chown d6/dc/dd/d49/d64/d4a/d55/d82/d84/f94 44203216 1 2024-04-12T13:42:06.317 INFO:tasks.workunit.client.0.smithi060.stdout:6/564: creat d1/d7/da/dc/d24/d34/d51/fcd x:0 0 0 2024-04-12T13:42:06.318 INFO:tasks.workunit.client.1.smithi110.stdout:9/583: truncate df/d13/d2c/d2d/f64 3239477 0 2024-04-12T13:42:06.319 INFO:tasks.workunit.client.1.smithi110.stdout:9/584: fdatasync df/d13/d26/f32 0 2024-04-12T13:42:06.321 INFO:tasks.workunit.client.1.smithi110.stdout:1/467: symlink de/d14/la4 0 2024-04-12T13:42:06.322 INFO:tasks.workunit.client.0.smithi060.stdout:2/472: write d6/d13/f67 [1857540,94339] 0 2024-04-12T13:42:06.324 INFO:tasks.workunit.client.1.smithi110.stdout:3/497: dread d5/dc/d31/d3b/d32/d3e/d5f/f8b [0,4194304] 0 2024-04-12T13:42:06.326 INFO:tasks.workunit.client.1.smithi110.stdout:1/468: stat de/d15/d32/d61/d6a/d72/c8d 0 2024-04-12T13:42:06.329 INFO:tasks.workunit.client.0.smithi060.stdout:1/582: rmdir d1e/d29/d6d 39 2024-04-12T13:42:06.339 INFO:tasks.workunit.client.0.smithi060.stdout:3/504: write d7/da/d3f/d5c/d25/f44 [1466840,37369] 0 2024-04-12T13:42:06.341 INFO:tasks.workunit.client.0.smithi060.stdout:3/505: readlink d7/d17/d19/l4a 0 2024-04-12T13:42:06.341 INFO:tasks.workunit.client.0.smithi060.stdout:6/565: creat d1/d7/da/dc/d24/d2d/db0/db2/fce x:0 0 0 2024-04-12T13:42:06.341 INFO:tasks.workunit.client.1.smithi110.stdout:7/512: truncate d1/d31/f96 9552679 0 2024-04-12T13:42:06.343 INFO:tasks.workunit.client.1.smithi110.stdout:5/454: write da/d2e/d45/d25/d9d/d79/d88/f8c [459524,117175] 0 2024-04-12T13:42:06.344 INFO:tasks.workunit.client.1.smithi110.stdout:7/513: fdatasync d1/d3/d4/f1c 0 2024-04-12T13:42:06.346 INFO:tasks.workunit.client.1.smithi110.stdout:4/626: creat d0/d75/d84/d89/dc0/fd0 x:0 0 0 2024-04-12T13:42:06.347 INFO:tasks.workunit.client.1.smithi110.stdout:4/627: stat d0/f5 0 2024-04-12T13:42:06.349 INFO:tasks.workunit.client.1.smithi110.stdout:0/431: dwrite d1/d8/d36/f44 [4194304,4194304] 0 2024-04-12T13:42:06.350 INFO:tasks.workunit.client.1.smithi110.stdout:9/585: creat df/d13/d2c/d2d/d39/d3a/d4e/d83/d63/db4/fbf x:0 0 0 2024-04-12T13:42:06.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/418: getdents d0/d7 0 2024-04-12T13:42:06.352 INFO:tasks.workunit.client.1.smithi110.stdout:0/432: fdatasync d1/d8/d36/d51/f62 0 2024-04-12T13:42:06.353 INFO:tasks.workunit.client.1.smithi110.stdout:9/586: chown df/d13/d26/d37/fa4 4 1 2024-04-12T13:42:06.353 INFO:tasks.workunit.client.1.smithi110.stdout:6/507: mkdir d7/d25/d30/d44/da3 0 2024-04-12T13:42:06.355 INFO:tasks.workunit.client.1.smithi110.stdout:6/508: dread - d7/d10/d1c/d4d/f8e zero size 2024-04-12T13:42:06.356 INFO:tasks.workunit.client.0.smithi060.stdout:6/566: creat d1/d7/da/dc/fcf x:0 0 0 2024-04-12T13:42:06.357 INFO:tasks.workunit.client.1.smithi110.stdout:1/469: fdatasync de/d14/d34/f40 0 2024-04-12T13:42:06.359 INFO:tasks.workunit.client.1.smithi110.stdout:0/433: read d1/d8/d36/d51/f68 [2456009,36454] 0 2024-04-12T13:42:06.359 INFO:tasks.workunit.client.0.smithi060.stdout:0/454: write d7/d9/d14/d35/d44/d7d/f2a [1926953,84336] 0 2024-04-12T13:42:06.360 INFO:tasks.workunit.client.1.smithi110.stdout:8/497: fdatasync d1/d3/d35/f6b 0 2024-04-12T13:42:06.362 INFO:tasks.workunit.client.0.smithi060.stdout:1/583: creat d1e/d23/d2e/d5e/d68/d9a/fcd x:0 0 0 2024-04-12T13:42:06.362 INFO:tasks.workunit.client.0.smithi060.stdout:3/506: dwrite d7/d17/d19/f23 [4194304,4194304] 0 2024-04-12T13:42:06.363 INFO:tasks.workunit.client.0.smithi060.stdout:0/455: fdatasync d7/d9/f48 0 2024-04-12T13:42:06.363 INFO:tasks.workunit.client.0.smithi060.stdout:6/567: write d1/d7/da/fbf [993858,37139] 0 2024-04-12T13:42:06.363 INFO:tasks.workunit.client.0.smithi060.stdout:9/408: sync 2024-04-12T13:42:06.363 INFO:tasks.workunit.client.0.smithi060.stdout:5/494: sync 2024-04-12T13:42:06.364 INFO:tasks.workunit.client.0.smithi060.stdout:4/463: getdents d6/d7/dd/d1a/d19 0 2024-04-12T13:42:06.365 INFO:tasks.workunit.client.1.smithi110.stdout:7/514: rmdir d1/d1b/d94 39 2024-04-12T13:42:06.367 INFO:tasks.workunit.client.1.smithi110.stdout:3/498: dread d5/dc/d31/d3b/d32/f37 [0,4194304] 0 2024-04-12T13:42:06.368 INFO:tasks.workunit.client.0.smithi060.stdout:1/584: chown d1e/d23/d2e/d30/f5c 4655 1 2024-04-12T13:42:06.371 INFO:tasks.workunit.client.1.smithi110.stdout:5/455: creat da/d2e/d45/d29/d58/fa1 x:0 0 0 2024-04-12T13:42:06.375 INFO:tasks.workunit.client.1.smithi110.stdout:1/470: dread de/d1d/f28 [0,4194304] 0 2024-04-12T13:42:06.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/507: dread - d7/da/d3f/d5c/f9a zero size 2024-04-12T13:42:06.376 INFO:tasks.workunit.client.0.smithi060.stdout:6/568: fdatasync d1/d7/da/dc/d24/d34/d51/d59/f4d 0 2024-04-12T13:42:06.378 INFO:tasks.workunit.client.1.smithi110.stdout:9/587: mknod df/d13/d2c/d2d/d39/d3a/cc0 0 2024-04-12T13:42:06.378 INFO:tasks.workunit.client.0.smithi060.stdout:9/409: mknod d4/d9/d19/d21/d73/c86 0 2024-04-12T13:42:06.379 INFO:tasks.workunit.client.1.smithi110.stdout:0/434: dread d1/f2f [0,4194304] 0 2024-04-12T13:42:06.383 INFO:tasks.workunit.client.1.smithi110.stdout:6/509: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:42:06.384 INFO:tasks.workunit.client.1.smithi110.stdout:9/588: stat df/d13/d2c/d2d/d39/d3a/d4e/d83 0 2024-04-12T13:42:06.385 INFO:tasks.workunit.client.0.smithi060.stdout:2/473: link d6/f9 d6/d56/d86/f8d 0 2024-04-12T13:42:06.388 INFO:tasks.workunit.client.0.smithi060.stdout:5/495: truncate d6/dd/d1f/d25/d53/d87/f3a 540605 0 2024-04-12T13:42:06.388 INFO:tasks.workunit.client.1.smithi110.stdout:0/435: write d1/d27/d31/f52 [206026,54835] 0 2024-04-12T13:42:06.394 INFO:tasks.workunit.client.1.smithi110.stdout:8/498: dwrite d1/d3/d35/d3a/d41/f51 [4194304,4194304] 0 2024-04-12T13:42:06.396 INFO:tasks.workunit.client.1.smithi110.stdout:3/499: dwrite d5/dc/f85 [0,4194304] 0 2024-04-12T13:42:06.397 INFO:tasks.workunit.client.0.smithi060.stdout:7/419: dwrite d0/f3a [4194304,4194304] 0 2024-04-12T13:42:06.400 INFO:tasks.workunit.client.1.smithi110.stdout:4/628: dwrite d0/d19/d1c/f60 [0,4194304] 0 2024-04-12T13:42:06.400 INFO:tasks.workunit.client.1.smithi110.stdout:3/500: chown d5/dc/d31/d3b 99 1 2024-04-12T13:42:06.403 INFO:tasks.workunit.client.0.smithi060.stdout:4/464: write d6/d21/f41 [1077919,43061] 0 2024-04-12T13:42:06.407 INFO:tasks.workunit.client.0.smithi060.stdout:7/420: truncate d0/d3d/f7c 855505 0 2024-04-12T13:42:06.408 INFO:tasks.workunit.client.0.smithi060.stdout:6/569: dread d1/d7/da/dc/d24/d30/d52/d5e/f68 [0,4194304] 0 2024-04-12T13:42:06.409 INFO:tasks.workunit.client.1.smithi110.stdout:7/515: mknod d1/d3/d4/d55/caf 0 2024-04-12T13:42:06.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/456: dwrite d7/d9/d14/d4a/f5f [0,4194304] 0 2024-04-12T13:42:06.410 INFO:tasks.workunit.client.1.smithi110.stdout:5/456: mkdir da/db/d3b/d40/da2 0 2024-04-12T13:42:06.412 INFO:tasks.workunit.client.1.smithi110.stdout:7/516: write d1/d3/d4/f1c [1621452,82728] 0 2024-04-12T13:42:06.412 INFO:tasks.workunit.client.0.smithi060.stdout:2/474: creat d6/d10/d6b/f8e x:0 0 0 2024-04-12T13:42:06.412 INFO:tasks.workunit.client.0.smithi060.stdout:0/457: chown d7/d9/d14/d35/d44/d7d 13329459 1 2024-04-12T13:42:06.415 INFO:tasks.workunit.client.0.smithi060.stdout:0/458: truncate d7/f26 2641073 0 2024-04-12T13:42:06.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/585: creat d1e/dcc/fce x:0 0 0 2024-04-12T13:42:06.420 INFO:tasks.workunit.client.1.smithi110.stdout:3/501: dread d5/dc/f85 [0,4194304] 0 2024-04-12T13:42:06.422 INFO:tasks.workunit.client.0.smithi060.stdout:8/453: sync 2024-04-12T13:42:06.423 INFO:tasks.workunit.client.1.smithi110.stdout:0/436: symlink d1/d8/d36/d63/l8e 0 2024-04-12T13:42:06.427 INFO:tasks.workunit.client.1.smithi110.stdout:8/499: creat d1/d5/dd/fa0 x:0 0 0 2024-04-12T13:42:06.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/421: creat d0/d1b/d8c/f91 x:0 0 0 2024-04-12T13:42:06.431 INFO:tasks.workunit.client.0.smithi060.stdout:6/570: creat d1/d7/da/d20/fd0 x:0 0 0 2024-04-12T13:42:06.431 INFO:tasks.workunit.client.0.smithi060.stdout:9/410: dwrite d4/d9/d19/d21/d73/d67/f2b [0,4194304] 0 2024-04-12T13:42:06.432 INFO:tasks.workunit.client.0.smithi060.stdout:5/496: write d6/d10/f2b [1648246,69392] 0 2024-04-12T13:42:06.434 INFO:tasks.workunit.client.1.smithi110.stdout:6/510: dwrite d7/f73 [0,4194304] 0 2024-04-12T13:42:06.441 INFO:tasks.workunit.client.1.smithi110.stdout:4/629: rmdir d0/d75/d84/d89 39 2024-04-12T13:42:06.447 INFO:tasks.workunit.client.1.smithi110.stdout:7/517: mknod d1/d3/d4/d55/cb0 0 2024-04-12T13:42:06.447 INFO:tasks.workunit.client.1.smithi110.stdout:6/511: dread d7/d10/d1c/f28 [0,4194304] 0 2024-04-12T13:42:06.447 INFO:tasks.workunit.client.0.smithi060.stdout:2/475: symlink d6/d10/d6b/l8f 0 2024-04-12T13:42:06.448 INFO:tasks.workunit.client.0.smithi060.stdout:7/422: dread d0/d1b/f5f [4194304,4194304] 0 2024-04-12T13:42:06.452 INFO:tasks.workunit.client.0.smithi060.stdout:2/476: fsync d6/d13/d31/f42 0 2024-04-12T13:42:06.453 INFO:tasks.workunit.client.0.smithi060.stdout:7/423: write d0/d7/d43/d63/f67 [4280609,97244] 0 2024-04-12T13:42:06.454 INFO:tasks.workunit.client.0.smithi060.stdout:2/477: stat d6/d13/d31/d33/f6a 0 2024-04-12T13:42:06.457 INFO:tasks.workunit.client.0.smithi060.stdout:9/411: dread d4/d33/d50/f6c [0,4194304] 0 2024-04-12T13:42:06.457 INFO:tasks.workunit.client.0.smithi060.stdout:3/508: link d7/d17/d19/c3b d7/d17/d19/d33/d63/cae 0 2024-04-12T13:42:06.462 INFO:tasks.workunit.client.1.smithi110.stdout:0/437: chown d1/d8/c59 135844 1 2024-04-12T13:42:06.466 INFO:tasks.workunit.client.1.smithi110.stdout:2/543: sync 2024-04-12T13:42:06.468 INFO:tasks.workunit.client.1.smithi110.stdout:2/544: read - d6/dc/dd/f47 zero size 2024-04-12T13:42:06.470 INFO:tasks.workunit.client.1.smithi110.stdout:2/545: chown d6/dc/dd/d49/d64/d4a/f92 1459201123 1 2024-04-12T13:42:06.472 INFO:tasks.workunit.client.1.smithi110.stdout:2/546: write d6/dc/dd/d49/d64/d4a/f92 [293002,23440] 0 2024-04-12T13:42:06.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/497: dread d6/d10/f68 [0,4194304] 0 2024-04-12T13:42:06.474 INFO:tasks.workunit.client.1.smithi110.stdout:8/500: write d1/d7/d20/f5f [938344,91260] 0 2024-04-12T13:42:06.475 INFO:tasks.workunit.client.1.smithi110.stdout:4/630: mknod d0/d19/d1c/d50/d6f/db9/cd1 0 2024-04-12T13:42:06.477 INFO:tasks.workunit.client.0.smithi060.stdout:7/424: dread - d0/d3d/f40 zero size 2024-04-12T13:42:06.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/459: write d7/d9/d14/d35/d3c/f42 [4519868,49572] 0 2024-04-12T13:42:06.478 INFO:tasks.workunit.client.1.smithi110.stdout:8/501: write d1/d3/d35/d3a/d41/f53 [4119114,108389] 0 2024-04-12T13:42:06.480 INFO:tasks.workunit.client.1.smithi110.stdout:8/502: write d1/f5c [20863,61388] 0 2024-04-12T13:42:06.482 INFO:tasks.workunit.client.0.smithi060.stdout:2/478: rename d6/d13/d31/d33/f82 to d6/d13/d5b/d6d/f90 0 2024-04-12T13:42:06.483 INFO:tasks.workunit.client.0.smithi060.stdout:4/465: link d6/d7/dd/d4d/d69/l6b d6/d7/dd/d1a/d56/la1 0 2024-04-12T13:42:06.483 INFO:tasks.workunit.client.1.smithi110.stdout:5/457: truncate da/d2e/d45/d25/d9d/f3e 236041 0 2024-04-12T13:42:06.484 INFO:tasks.workunit.client.1.smithi110.stdout:1/471: sync 2024-04-12T13:42:06.485 INFO:tasks.workunit.client.1.smithi110.stdout:5/458: chown da/f6b 741815 1 2024-04-12T13:42:06.485 INFO:tasks.workunit.client.0.smithi060.stdout:4/466: fdatasync d6/d7/db/f3c 0 2024-04-12T13:42:06.487 INFO:tasks.workunit.client.1.smithi110.stdout:5/459: truncate da/d2e/d45/d29/d58/f6d 890095 0 2024-04-12T13:42:06.494 INFO:tasks.workunit.client.1.smithi110.stdout:1/472: dread de/d14/d34/d55/d6b/f6f [0,4194304] 0 2024-04-12T13:42:06.494 INFO:tasks.workunit.client.1.smithi110.stdout:9/589: rename df/d13/d2c/d2d/d39/d3a/d4e to df/d13/d2c/d2d/dc1 0 2024-04-12T13:42:06.496 INFO:tasks.workunit.client.1.smithi110.stdout:1/473: chown de/d14/d34/d55/d6b 262043 1 2024-04-12T13:42:06.496 INFO:tasks.workunit.client.0.smithi060.stdout:7/425: dwrite d0/d7/d43/f89 [0,4194304] 0 2024-04-12T13:42:06.503 INFO:tasks.workunit.client.1.smithi110.stdout:6/512: mkdir d7/da4 0 2024-04-12T13:42:06.505 INFO:tasks.workunit.client.1.smithi110.stdout:6/513: write d7/d25/d2c/f3c [9060303,56471] 0 2024-04-12T13:42:06.506 INFO:tasks.workunit.client.1.smithi110.stdout:6/514: stat d7/f73 0 2024-04-12T13:42:06.508 INFO:tasks.workunit.client.1.smithi110.stdout:0/438: write d1/d8/d36/d51/d60/f41 [1050075,26998] 0 2024-04-12T13:42:06.509 INFO:tasks.workunit.client.1.smithi110.stdout:7/518: creat d1/d31/d7b/fb1 x:0 0 0 2024-04-12T13:42:06.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/571: write d1/d2c/f70 [1635127,80765] 0 2024-04-12T13:42:06.512 INFO:tasks.workunit.client.0.smithi060.stdout:0/460: mknod d7/d9/de/d7c/ca6 0 2024-04-12T13:42:06.514 INFO:tasks.workunit.client.1.smithi110.stdout:8/503: fdatasync d1/d3/d35/d3a/d3e/d64/d85/d8d/f91 0 2024-04-12T13:42:06.519 INFO:tasks.workunit.client.1.smithi110.stdout:5/460: symlink da/d5c/la3 0 2024-04-12T13:42:06.519 INFO:tasks.workunit.client.1.smithi110.stdout:3/502: link d5/dc/d31/d3b/d32/l81 d5/dc/d20/laa 0 2024-04-12T13:42:06.522 INFO:tasks.workunit.client.0.smithi060.stdout:7/426: mkdir d0/d7/d92 0 2024-04-12T13:42:06.523 INFO:tasks.workunit.client.1.smithi110.stdout:0/439: dwrite d1/f8c [0,4194304] 0 2024-04-12T13:42:06.525 INFO:tasks.workunit.client.0.smithi060.stdout:5/498: dwrite d6/dd/d1f/d25/d53/d87/f60 [0,4194304] 0 2024-04-12T13:42:06.525 INFO:tasks.workunit.client.0.smithi060.stdout:7/427: write d0/d1b/f72 [3474340,109474] 0 2024-04-12T13:42:06.526 INFO:tasks.workunit.client.1.smithi110.stdout:1/474: creat de/d15/d32/d5e/fa5 x:0 0 0 2024-04-12T13:42:06.527 INFO:tasks.workunit.client.0.smithi060.stdout:1/586: getdents d1e/d94 0 2024-04-12T13:42:06.529 INFO:tasks.workunit.client.0.smithi060.stdout:5/499: truncate d6/fa0 277065 0 2024-04-12T13:42:06.531 INFO:tasks.workunit.client.1.smithi110.stdout:2/547: creat d6/dc/d9d/fa1 x:0 0 0 2024-04-12T13:42:06.533 INFO:tasks.workunit.client.1.smithi110.stdout:6/515: mknod d7/d10/d1c/d2b/d48/d4b/ca5 0 2024-04-12T13:42:06.534 INFO:tasks.workunit.client.0.smithi060.stdout:2/479: mknod d6/d10/c91 0 2024-04-12T13:42:06.536 INFO:tasks.workunit.client.1.smithi110.stdout:7/519: mknod d1/d1b/d3d/d68/cb2 0 2024-04-12T13:42:06.536 INFO:tasks.workunit.client.0.smithi060.stdout:1/587: chown d1e/d23/d49/d4e/d9b/fac 2 1 2024-04-12T13:42:06.537 INFO:tasks.workunit.client.0.smithi060.stdout:2/480: write d6/d13/f34 [318475,15675] 0 2024-04-12T13:42:06.539 INFO:tasks.workunit.client.0.smithi060.stdout:4/467: rename d6/d7/dd/d1a/c1c to d6/d7/dd/d1a/d57/d63/d68/d76/ca2 0 2024-04-12T13:42:06.541 INFO:tasks.workunit.client.1.smithi110.stdout:4/631: link d0/d19/d1c/d50/d6f/db9/f73 d0/d78/fd2 0 2024-04-12T13:42:06.541 INFO:tasks.workunit.client.0.smithi060.stdout:2/481: chown d6/d56/d58 696 1 2024-04-12T13:42:06.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/412: creat d4/f87 x:0 0 0 2024-04-12T13:42:06.547 INFO:tasks.workunit.client.0.smithi060.stdout:3/509: creat d7/da/faf x:0 0 0 2024-04-12T13:42:06.549 INFO:tasks.workunit.client.0.smithi060.stdout:3/510: write d7/da/faf [265939,26945] 0 2024-04-12T13:42:06.550 INFO:tasks.workunit.client.1.smithi110.stdout:9/590: dwrite df/d13/d2c/d2d/d39/d3a/f77 [0,4194304] 0 2024-04-12T13:42:06.553 INFO:tasks.workunit.client.1.smithi110.stdout:3/503: chown d5/dc/d31/d3b/d5b/l70 5 1 2024-04-12T13:42:06.553 INFO:tasks.workunit.client.0.smithi060.stdout:5/500: dwrite d6/d89/f8f [4194304,4194304] 0 2024-04-12T13:42:06.555 INFO:tasks.workunit.client.0.smithi060.stdout:7/428: write d0/d7/f73 [864127,95864] 0 2024-04-12T13:42:06.557 INFO:tasks.workunit.client.1.smithi110.stdout:9/591: dread df/d13/d2c/d2d/d39/f44 [0,4194304] 0 2024-04-12T13:42:06.559 INFO:tasks.workunit.client.0.smithi060.stdout:7/429: write d0/d3d/f8b [70512,87274] 0 2024-04-12T13:42:06.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/461: mknod d7/d33/ca7 0 2024-04-12T13:42:06.563 INFO:tasks.workunit.client.0.smithi060.stdout:7/430: write d0/d3d/f58 [365748,76488] 0 2024-04-12T13:42:06.563 INFO:tasks.workunit.client.1.smithi110.stdout:0/440: write d1/d8/ff [1400901,54691] 0 2024-04-12T13:42:06.570 INFO:tasks.workunit.client.0.smithi060.stdout:4/468: mknod d6/d7/dd/df/ca3 0 2024-04-12T13:42:06.570 INFO:tasks.workunit.client.1.smithi110.stdout:1/475: fdatasync de/d14/f65 0 2024-04-12T13:42:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:6/572: dwrite d1/d7/da/dc/d24/d30/d52/f8a [0,4194304] 0 2024-04-12T13:42:06.572 INFO:tasks.workunit.client.1.smithi110.stdout:9/592: dwrite df/d13/f27 [0,4194304] 0 2024-04-12T13:42:06.574 INFO:tasks.workunit.client.1.smithi110.stdout:1/476: chown de/d15/c17 1 1 2024-04-12T13:42:06.574 INFO:tasks.workunit.client.0.smithi060.stdout:4/469: dread - d6/d2f/d51/f89 zero size 2024-04-12T13:42:06.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/413: mknod d4/d9/d19/c88 0 2024-04-12T13:42:06.578 INFO:tasks.workunit.client.1.smithi110.stdout:6/516: dread d7/d25/d2c/d4c/d77/f8a [0,4194304] 0 2024-04-12T13:42:06.580 INFO:tasks.workunit.client.0.smithi060.stdout:1/588: write d1e/d46/f62 [9841052,107945] 0 2024-04-12T13:42:06.580 INFO:tasks.workunit.client.1.smithi110.stdout:1/477: write de/d15/d32/d61/d96/fa2 [356622,125212] 0 2024-04-12T13:42:06.587 INFO:tasks.workunit.client.1.smithi110.stdout:5/461: dwrite da/d2e/d45/d25/d9d/f9b [0,4194304] 0 2024-04-12T13:42:06.590 INFO:tasks.workunit.client.0.smithi060.stdout:6/573: read d1/d7/da/dc/d24/d30/f71 [953196,4912] 0 2024-04-12T13:42:06.593 INFO:tasks.workunit.client.1.smithi110.stdout:5/462: write da/d2e/d45/d29/f7e [1280746,47734] 0 2024-04-12T13:42:06.593 INFO:tasks.workunit.client.0.smithi060.stdout:2/482: getdents d6/d10/d16/d36 0 2024-04-12T13:42:06.594 INFO:tasks.workunit.client.0.smithi060.stdout:0/462: dwrite d7/d9/d14/d35/d44/d49/d67/f86 [0,4194304] 0 2024-04-12T13:42:06.598 INFO:tasks.workunit.client.1.smithi110.stdout:0/441: creat d1/d48/f8f x:0 0 0 2024-04-12T13:42:06.600 INFO:tasks.workunit.client.1.smithi110.stdout:2/548: mkdir d6/d18/da2 0 2024-04-12T13:42:06.600 INFO:tasks.workunit.client.1.smithi110.stdout:9/593: unlink df/d13/d3b/d40/c80 0 2024-04-12T13:42:06.601 INFO:tasks.workunit.client.0.smithi060.stdout:3/511: mkdir d7/d17/d27/d36/db0 0 2024-04-12T13:42:06.602 INFO:tasks.workunit.client.1.smithi110.stdout:9/594: readlink df/l6f 0 2024-04-12T13:42:06.606 INFO:tasks.workunit.client.1.smithi110.stdout:7/520: dwrite d1/f2b [0,4194304] 0 2024-04-12T13:42:06.607 INFO:tasks.workunit.client.0.smithi060.stdout:4/470: dwrite d6/d7/dd/d1a/d19/d42/f9c [0,4194304] 0 2024-04-12T13:42:06.610 INFO:tasks.workunit.client.0.smithi060.stdout:1/589: dwrite d1e/d29/d65/f7f [0,4194304] 0 2024-04-12T13:42:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:9/414: symlink d4/d9/d19/d21/d73/l89 0 2024-04-12T13:42:06.621 INFO:tasks.workunit.client.1.smithi110.stdout:9/595: dwrite df/d13/d2c/d2d/d39/d3a/f62 [0,4194304] 0 2024-04-12T13:42:06.623 INFO:tasks.workunit.client.0.smithi060.stdout:8/454: sync 2024-04-12T13:42:06.624 INFO:tasks.workunit.client.1.smithi110.stdout:5/463: rmdir da/db/d52 39 2024-04-12T13:42:06.627 INFO:tasks.workunit.client.0.smithi060.stdout:7/431: creat d0/d7/d43/d63/d6f/f93 x:0 0 0 2024-04-12T13:42:06.633 INFO:tasks.workunit.client.1.smithi110.stdout:6/517: truncate d7/d25/d2c/f40 1748822 0 2024-04-12T13:42:06.637 INFO:tasks.workunit.client.0.smithi060.stdout:2/483: fdatasync d6/d10/d16/f1c 0 2024-04-12T13:42:06.640 INFO:tasks.workunit.client.0.smithi060.stdout:0/463: fsync d7/d9/f2b 0 2024-04-12T13:42:06.644 INFO:tasks.workunit.client.0.smithi060.stdout:0/464: stat d7/d9/d14/f25 0 2024-04-12T13:42:06.647 INFO:tasks.workunit.client.1.smithi110.stdout:2/549: symlink d6/dc/dd/d49/d64/d4a/d3c/d6e/la3 0 2024-04-12T13:42:06.649 INFO:tasks.workunit.client.0.smithi060.stdout:5/501: truncate d6/dd/d1f/d32/f6f 2564569 0 2024-04-12T13:42:06.650 INFO:tasks.workunit.client.1.smithi110.stdout:2/550: write d6/dc/dd/d49/d64/d4a/d51/f2f [4853853,99079] 0 2024-04-12T13:42:06.653 INFO:tasks.workunit.client.1.smithi110.stdout:2/551: write d6/dc/d1b/f8e [386749,100050] 0 2024-04-12T13:42:06.657 INFO:tasks.workunit.client.1.smithi110.stdout:3/504: creat d5/dc/d31/fab x:0 0 0 2024-04-12T13:42:06.657 INFO:tasks.workunit.client.0.smithi060.stdout:3/512: dread d7/da/f3e [0,4194304] 0 2024-04-12T13:42:06.659 INFO:tasks.workunit.client.0.smithi060.stdout:6/574: mknod d1/d7/da/dbd/cd1 0 2024-04-12T13:42:06.659 INFO:tasks.workunit.client.1.smithi110.stdout:9/596: creat df/d13/d26/d37/d49/fc2 x:0 0 0 2024-04-12T13:42:06.660 INFO:tasks.workunit.client.0.smithi060.stdout:2/484: dwrite d6/d56/d43/f65 [0,4194304] 0 2024-04-12T13:42:06.661 INFO:tasks.workunit.client.0.smithi060.stdout:7/432: symlink d0/d7/d43/d63/d6f/l94 0 2024-04-12T13:42:06.662 INFO:tasks.workunit.client.1.smithi110.stdout:8/504: sync 2024-04-12T13:42:06.663 INFO:tasks.workunit.client.1.smithi110.stdout:5/464: mknod da/d2e/d45/d29/d66/d7c/ca4 0 2024-04-12T13:42:06.664 INFO:tasks.workunit.client.0.smithi060.stdout:2/485: write d6/d13/d5b/d6d/f6e [41049,47549] 0 2024-04-12T13:42:06.671 INFO:tasks.workunit.client.0.smithi060.stdout:4/471: dread d6/d2f/d51/f71 [0,4194304] 0 2024-04-12T13:42:06.671 INFO:tasks.workunit.client.0.smithi060.stdout:6/575: read d1/d7/da/dc/f3c [3623723,86559] 0 2024-04-12T13:42:06.678 INFO:tasks.workunit.client.1.smithi110.stdout:8/505: dwrite d1/d3/d3c/d5a/d6f/d7e/f8e [0,4194304] 0 2024-04-12T13:42:06.690 INFO:tasks.workunit.client.0.smithi060.stdout:8/455: rename d9/d1b/d3c/d60/d79/f8f to d9/d1b/d37/d4d/f97 0 2024-04-12T13:42:06.691 INFO:tasks.workunit.client.0.smithi060.stdout:8/456: chown d9/d1b/d2b/f55 7681 1 2024-04-12T13:42:06.691 INFO:tasks.workunit.client.1.smithi110.stdout:6/518: mkdir d7/d25/d2c/d4c/da6 0 2024-04-12T13:42:06.694 INFO:tasks.workunit.client.1.smithi110.stdout:6/519: dread - d7/d10/d1c/d2b/d48/d54/f88 zero size 2024-04-12T13:42:06.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/415: mknod d4/c8a 0 2024-04-12T13:42:06.696 INFO:tasks.workunit.client.0.smithi060.stdout:9/416: chown d4/d9/d19 491 1 2024-04-12T13:42:06.697 INFO:tasks.workunit.client.0.smithi060.stdout:9/417: read d4/f6f [6176075,64266] 0 2024-04-12T13:42:06.697 INFO:tasks.workunit.client.1.smithi110.stdout:2/552: creat d6/dc/dd/d49/d64/d4a/d3c/d50/fa4 x:0 0 0 2024-04-12T13:42:06.698 INFO:tasks.workunit.client.0.smithi060.stdout:9/418: readlink l3 0 2024-04-12T13:42:06.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/433: creat d0/d78/f95 x:0 0 0 2024-04-12T13:42:06.702 INFO:tasks.workunit.client.1.smithi110.stdout:5/465: symlink da/d2e/d45/d29/d66/d7c/la5 0 2024-04-12T13:42:06.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/486: dread d6/d10/d2b/d35/f4c [0,4194304] 0 2024-04-12T13:42:06.708 INFO:tasks.workunit.client.0.smithi060.stdout:6/576: fsync d1/d7/da/dc/d24/d30/d52/d5e/f67 0 2024-04-12T13:42:06.710 INFO:tasks.workunit.client.1.smithi110.stdout:7/521: rmdir d1/d3/d4/da6/da0 0 2024-04-12T13:42:06.710 INFO:tasks.workunit.client.1.smithi110.stdout:6/520: dwrite d7/d25/d2c/d4c/f8b [0,4194304] 0 2024-04-12T13:42:06.711 INFO:tasks.workunit.client.1.smithi110.stdout:4/632: sync 2024-04-12T13:42:06.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/590: creat d1e/d23/d49/fcf x:0 0 0 2024-04-12T13:42:06.716 INFO:tasks.workunit.client.1.smithi110.stdout:9/597: link df/d13/d2c/d2d/dc1/d83/d63/db4/fb8 df/d8a/fc3 0 2024-04-12T13:42:06.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/502: creat d6/dd/d1f/d25/d42/d52/d7a/fa4 x:0 0 0 2024-04-12T13:42:06.721 INFO:tasks.workunit.client.1.smithi110.stdout:2/553: rename d6/dc/d13/f90 to d6/dc/d13/d80/d8d/fa5 0 2024-04-12T13:42:06.723 INFO:tasks.workunit.client.0.smithi060.stdout:8/457: rename d9/d1b/d37/d4d/c5b to d9/d1b/d3c/d8d/c98 0 2024-04-12T13:42:06.724 INFO:tasks.workunit.client.0.smithi060.stdout:6/577: dread d1/d7/da/dc/d24/d30/d52/f8a [0,4194304] 0 2024-04-12T13:42:06.725 INFO:tasks.workunit.client.1.smithi110.stdout:5/466: mkdir da/db/d3b/d40/da6 0 2024-04-12T13:42:06.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/458: truncate d9/d1b/d37/f6a 848862 0 2024-04-12T13:42:06.728 INFO:tasks.workunit.client.1.smithi110.stdout:8/506: link d1/f5c d1/d3/d3c/fa1 0 2024-04-12T13:42:06.728 INFO:tasks.workunit.client.1.smithi110.stdout:3/505: dwrite d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:06.732 INFO:tasks.workunit.client.1.smithi110.stdout:3/506: write d5/dc/d31/d3b/d32/d3e/f41 [1835909,45851] 0 2024-04-12T13:42:06.733 INFO:tasks.workunit.client.0.smithi060.stdout:2/487: unlink d6/d13/d17/c1e 0 2024-04-12T13:42:06.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/488: dread - d6/d56/d55/f88 zero size 2024-04-12T13:42:06.736 INFO:tasks.workunit.client.0.smithi060.stdout:4/472: creat d6/d21/d88/fa4 x:0 0 0 2024-04-12T13:42:06.736 INFO:tasks.workunit.client.0.smithi060.stdout:2/489: chown d6/d10/c3b 511052714 1 2024-04-12T13:42:06.737 INFO:tasks.workunit.client.1.smithi110.stdout:0/442: getdents d1/d56 0 2024-04-12T13:42:06.737 INFO:tasks.workunit.client.1.smithi110.stdout:6/521: creat d7/d10/d7e/d85/fa7 x:0 0 0 2024-04-12T13:42:06.737 INFO:tasks.workunit.client.1.smithi110.stdout:3/507: chown d5/dc/d31/d3b/l9c 92 1 2024-04-12T13:42:06.738 INFO:tasks.workunit.client.1.smithi110.stdout:0/443: chown d1/d3c/f5f 8696172 1 2024-04-12T13:42:06.740 INFO:tasks.workunit.client.1.smithi110.stdout:4/633: write d0/d19/f5c [531818,35891] 0 2024-04-12T13:42:06.741 INFO:tasks.workunit.client.1.smithi110.stdout:9/598: unlink df/d13/c18 0 2024-04-12T13:42:06.747 INFO:tasks.workunit.client.1.smithi110.stdout:4/634: chown d0/de/f7f 2751957 1 2024-04-12T13:42:06.750 INFO:tasks.workunit.client.1.smithi110.stdout:3/508: truncate d5/dc/d20/d2d/d4f/f7b 1214367 0 2024-04-12T13:42:06.751 INFO:tasks.workunit.client.0.smithi060.stdout:3/513: creat d7/d17/d27/d36/fb1 x:0 0 0 2024-04-12T13:42:06.751 INFO:tasks.workunit.client.1.smithi110.stdout:5/467: dwrite da/d2e/f30 [0,4194304] 0 2024-04-12T13:42:06.755 INFO:tasks.workunit.client.0.smithi060.stdout:6/578: creat d1/d7/da/dc/d24/d34/d51/fd2 x:0 0 0 2024-04-12T13:42:06.755 INFO:tasks.workunit.client.1.smithi110.stdout:8/507: dwrite d1/d3/d3c/d5a/d6f/d7e/f71 [0,4194304] 0 2024-04-12T13:42:06.759 INFO:tasks.workunit.client.1.smithi110.stdout:8/508: readlink d1/d7/d20/l7c 0 2024-04-12T13:42:06.760 INFO:tasks.workunit.client.0.smithi060.stdout:8/459: creat d9/d1d/d2f/f99 x:0 0 0 2024-04-12T13:42:06.768 INFO:tasks.workunit.client.1.smithi110.stdout:0/444: fdatasync d1/d8/d36/d51/f69 0 2024-04-12T13:42:06.768 INFO:tasks.workunit.client.0.smithi060.stdout:7/434: dwrite d0/f64 [0,4194304] 0 2024-04-12T13:42:06.768 INFO:tasks.workunit.client.1.smithi110.stdout:1/478: sync 2024-04-12T13:42:06.769 INFO:tasks.workunit.client.1.smithi110.stdout:0/445: fdatasync d1/d8/d36/d63/f82 0 2024-04-12T13:42:06.771 INFO:tasks.workunit.client.0.smithi060.stdout:4/473: creat d6/d2f/fa5 x:0 0 0 2024-04-12T13:42:06.772 INFO:tasks.workunit.client.1.smithi110.stdout:0/446: stat d1/d27/d6e/l77 0 2024-04-12T13:42:06.772 INFO:tasks.workunit.client.1.smithi110.stdout:2/554: symlink d6/d18/la6 0 2024-04-12T13:42:06.774 INFO:tasks.workunit.client.0.smithi060.stdout:2/490: mknod d6/d10/d4b/c92 0 2024-04-12T13:42:06.775 INFO:tasks.workunit.client.1.smithi110.stdout:9/599: creat df/d13/d2c/d2d/dc1/d83/d63/d72/fc4 x:0 0 0 2024-04-12T13:42:06.775 INFO:tasks.workunit.client.1.smithi110.stdout:4/635: mkdir d0/de/d32/d5f/dd3 0 2024-04-12T13:42:06.777 INFO:tasks.workunit.client.1.smithi110.stdout:2/555: read d6/dc/dd/f1f [6322185,36833] 0 2024-04-12T13:42:06.777 INFO:tasks.workunit.client.1.smithi110.stdout:3/509: mknod d5/dc/d20/cac 0 2024-04-12T13:42:06.780 INFO:tasks.workunit.client.1.smithi110.stdout:5/468: truncate da/db/d15/f1b 1301380 0 2024-04-12T13:42:06.780 INFO:tasks.workunit.client.0.smithi060.stdout:8/460: dread d9/d1d/d2f/f4b [0,4194304] 0 2024-04-12T13:42:06.782 INFO:tasks.workunit.client.0.smithi060.stdout:9/419: truncate d4/d8/d32/f5b 3642447 0 2024-04-12T13:42:06.782 INFO:tasks.workunit.client.1.smithi110.stdout:5/469: readlink da/db/l1c 0 2024-04-12T13:42:06.783 INFO:tasks.workunit.client.1.smithi110.stdout:8/509: dread d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:42:06.784 INFO:tasks.workunit.client.1.smithi110.stdout:7/522: rmdir d1/d3/d4/d36/d76/da2 0 2024-04-12T13:42:06.784 INFO:tasks.workunit.client.1.smithi110.stdout:6/522: dread d7/d25/d30/d44/f1d [4194304,4194304] 0 2024-04-12T13:42:06.787 INFO:tasks.workunit.client.1.smithi110.stdout:3/510: chown d5/dc/d31/d3b/d32/d3e/f44 1006098888 1 2024-04-12T13:42:06.787 INFO:tasks.workunit.client.1.smithi110.stdout:4/636: dread d0/d19/d1c/d50/d6f/fae [0,4194304] 0 2024-04-12T13:42:06.789 INFO:tasks.workunit.client.0.smithi060.stdout:7/435: symlink d0/d3d/d74/l96 0 2024-04-12T13:42:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:7/436: chown d0/d1b/f60 318 1 2024-04-12T13:42:06.792 INFO:tasks.workunit.client.1.smithi110.stdout:1/479: rename de/d15/d32/d61/d6a/d8b/f8e to de/d1d/d86/fa6 0 2024-04-12T13:42:06.793 INFO:tasks.workunit.client.1.smithi110.stdout:0/447: dread d1/f26 [0,4194304] 0 2024-04-12T13:42:06.796 INFO:tasks.workunit.client.0.smithi060.stdout:2/491: creat d6/d10/d2b/d60/f93 x:0 0 0 2024-04-12T13:42:06.797 INFO:tasks.workunit.client.1.smithi110.stdout:7/523: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:42:06.800 INFO:tasks.workunit.client.0.smithi060.stdout:8/461: rmdir d9/d1b/d3c/d8d 39 2024-04-12T13:42:06.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/420: dwrite d4/d8/d7c/f81 [0,4194304] 0 2024-04-12T13:42:06.803 INFO:tasks.workunit.client.1.smithi110.stdout:2/556: mkdir d6/dc/d6f/da7 0 2024-04-12T13:42:06.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/503: creat d6/d10/d12/fa5 x:0 0 0 2024-04-12T13:42:06.807 INFO:tasks.workunit.client.1.smithi110.stdout:3/511: dwrite d5/dc/d31/fab [0,4194304] 0 2024-04-12T13:42:06.810 INFO:tasks.workunit.client.0.smithi060.stdout:6/579: link d1/d7/f5d d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/fd3 0 2024-04-12T13:42:06.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/474: symlink d6/la6 0 2024-04-12T13:42:06.820 INFO:tasks.workunit.client.0.smithi060.stdout:7/437: rename d0/d7/d43/d4d/f8e to d0/d78/f97 0 2024-04-12T13:42:06.822 INFO:tasks.workunit.client.0.smithi060.stdout:1/591: getdents d1e/d23/d2e/d8e/d98 0 2024-04-12T13:42:06.823 INFO:tasks.workunit.client.0.smithi060.stdout:1/592: read - d1e/d29/fc4 zero size 2024-04-12T13:42:06.824 INFO:tasks.workunit.client.1.smithi110.stdout:6/523: rename d7/d10/d1c/d2b/d48/d54/l67 to d7/d10/d41/la8 0 2024-04-12T13:42:06.827 INFO:tasks.workunit.client.1.smithi110.stdout:0/448: unlink f0 0 2024-04-12T13:42:06.831 INFO:tasks.workunit.client.1.smithi110.stdout:1/480: creat de/d15/d32/d61/d6a/d72/fa7 x:0 0 0 2024-04-12T13:42:06.838 INFO:tasks.workunit.client.1.smithi110.stdout:7/524: creat d1/d31/d5d/fb3 x:0 0 0 2024-04-12T13:42:06.839 INFO:tasks.workunit.client.0.smithi060.stdout:2/492: write d6/d13/d17/f6f [250600,5236] 0 2024-04-12T13:42:06.843 INFO:tasks.workunit.client.1.smithi110.stdout:2/557: creat d6/dc/d1b/d8f/fa8 x:0 0 0 2024-04-12T13:42:06.843 INFO:tasks.workunit.client.1.smithi110.stdout:9/600: write df/d38/fa2 [1681961,121824] 0 2024-04-12T13:42:06.844 INFO:tasks.workunit.client.0.smithi060.stdout:6/580: write d1/d7/da/dc/d24/d34/d51/d97/f9d [974163,107409] 0 2024-04-12T13:42:06.845 INFO:tasks.workunit.client.1.smithi110.stdout:9/601: readlink df/d13/d3b/d40/l69 0 2024-04-12T13:42:06.847 INFO:tasks.workunit.client.1.smithi110.stdout:9/602: chown df/d13/d26/f45 0 1 2024-04-12T13:42:06.848 INFO:tasks.workunit.client.0.smithi060.stdout:9/421: mknod d4/c8b 0 2024-04-12T13:42:06.849 INFO:tasks.workunit.client.1.smithi110.stdout:1/481: dread de/d14/d34/f5f [0,4194304] 0 2024-04-12T13:42:06.850 INFO:tasks.workunit.client.0.smithi060.stdout:8/462: symlink d9/d1b/d3c/d8d/l9a 0 2024-04-12T13:42:06.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/422: read d4/d9/d19/f63 [2031049,90468] 0 2024-04-12T13:42:06.853 INFO:tasks.workunit.client.0.smithi060.stdout:6/581: dread d1/d7/da/fbf [0,4194304] 0 2024-04-12T13:42:06.854 INFO:tasks.workunit.client.0.smithi060.stdout:1/593: write d1e/d29/d37/f73 [5039081,112807] 0 2024-04-12T13:42:06.855 INFO:tasks.workunit.client.0.smithi060.stdout:3/514: getdents d7/d17/d27/d36/d53 0 2024-04-12T13:42:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:4/475: link d6/d7/f8c d6/d7/dd/d1a/d57/fa7 0 2024-04-12T13:42:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:3/515: truncate d7/d17/d19/d33/f77 2433150 0 2024-04-12T13:42:06.860 INFO:tasks.workunit.client.1.smithi110.stdout:1/482: dwrite de/d14/f3a [0,4194304] 0 2024-04-12T13:42:06.861 INFO:tasks.workunit.client.0.smithi060.stdout:4/476: readlink d6/d21/d29/l4a 0 2024-04-12T13:42:06.864 INFO:tasks.workunit.client.0.smithi060.stdout:5/504: write d6/dd/d1f/d32/f6f [3335293,105281] 0 2024-04-12T13:42:06.866 INFO:tasks.workunit.client.0.smithi060.stdout:7/438: mknod d0/d7/d43/d85/c98 0 2024-04-12T13:42:06.870 INFO:tasks.workunit.client.0.smithi060.stdout:9/423: mkdir d4/d9/d19/d8c 0 2024-04-12T13:42:06.875 INFO:tasks.workunit.client.0.smithi060.stdout:1/594: mknod d1e/d23/d2e/d5e/d68/d9a/cd0 0 2024-04-12T13:42:06.877 INFO:tasks.workunit.client.0.smithi060.stdout:1/595: chown d1e/d29/d37/f50 546507 1 2024-04-12T13:42:06.879 INFO:tasks.workunit.client.0.smithi060.stdout:3/516: symlink d7/d17/d27/d36/d53/lb2 0 2024-04-12T13:42:06.882 INFO:tasks.workunit.client.0.smithi060.stdout:4/477: mkdir d6/d7/dd/d1a/d19/d7a/da8 0 2024-04-12T13:42:06.885 INFO:tasks.workunit.client.0.smithi060.stdout:5/505: dread d6/dd/d1f/d32/f6f [0,4194304] 0 2024-04-12T13:42:06.885 INFO:tasks.workunit.client.0.smithi060.stdout:3/517: truncate d7/d17/d19/d33/d63/f9e 224878 0 2024-04-12T13:42:06.887 INFO:tasks.workunit.client.0.smithi060.stdout:6/582: dread d1/d7/da/dc/f6d [0,4194304] 0 2024-04-12T13:42:06.889 INFO:tasks.workunit.client.0.smithi060.stdout:3/518: chown d7/d17/d19/f74 869180241 1 2024-04-12T13:42:06.890 INFO:tasks.workunit.client.0.smithi060.stdout:7/439: unlink d0/d7/d43/d63/d6f/f93 0 2024-04-12T13:42:06.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/424: dwrite d4/d9/d19/d21/f31 [4194304,4194304] 0 2024-04-12T13:42:06.895 INFO:tasks.workunit.client.0.smithi060.stdout:2/493: link d6/d10/d2b/d35/f4c d6/d10/d2b/d35/f94 0 2024-04-12T13:42:06.896 INFO:tasks.workunit.client.1.smithi110.stdout:8/510: getdents d1/d5/dd/d31 0 2024-04-12T13:42:06.898 INFO:tasks.workunit.client.0.smithi060.stdout:1/596: dwrite d1e/d46/faa [0,4194304] 0 2024-04-12T13:42:06.900 INFO:tasks.workunit.client.1.smithi110.stdout:8/511: write d1/d3/d35/d3a/d41/d77/f78 [129785,18611] 0 2024-04-12T13:42:06.903 INFO:tasks.workunit.client.0.smithi060.stdout:1/597: chown d1e/d46/c4f 357261073 1 2024-04-12T13:42:06.906 INFO:tasks.workunit.client.1.smithi110.stdout:3/512: write d5/dc/d31/d3b/f6b [3340699,119865] 0 2024-04-12T13:42:06.907 INFO:tasks.workunit.client.0.smithi060.stdout:4/478: dwrite d6/d21/d29/f7f [0,4194304] 0 2024-04-12T13:42:06.907 INFO:tasks.workunit.client.0.smithi060.stdout:7/440: unlink d0/f59 0 2024-04-12T13:42:06.909 INFO:tasks.workunit.client.1.smithi110.stdout:4/637: sync 2024-04-12T13:42:06.910 INFO:tasks.workunit.client.1.smithi110.stdout:0/449: unlink d1/d3c/d6b/c71 0 2024-04-12T13:42:06.910 INFO:tasks.workunit.client.0.smithi060.stdout:6/583: symlink d1/d7/da/dc/d24/d30/d52/d5e/d7e/ld4 0 2024-04-12T13:42:06.914 INFO:tasks.workunit.client.1.smithi110.stdout:3/513: write d5/dc/d31/d3b/f4a [4854583,91917] 0 2024-04-12T13:42:06.914 INFO:tasks.workunit.client.1.smithi110.stdout:7/525: mkdir d1/d1b/d74/db4 0 2024-04-12T13:42:06.915 INFO:tasks.workunit.client.1.smithi110.stdout:0/450: write d1/f22 [3895810,55099] 0 2024-04-12T13:42:06.917 INFO:tasks.workunit.client.1.smithi110.stdout:3/514: chown d5/dc/d31/d3b/d32/f78 0 1 2024-04-12T13:42:06.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/519: symlink d7/d17/d19/d33/d63/d6d/d91/lb3 0 2024-04-12T13:42:06.920 INFO:tasks.workunit.client.1.smithi110.stdout:5/470: creat da/db/d15/fa7 x:0 0 0 2024-04-12T13:42:06.921 INFO:tasks.workunit.client.1.smithi110.stdout:5/471: stat da/d2e/d45/d29/f2d 0 2024-04-12T13:42:06.923 INFO:tasks.workunit.client.1.smithi110.stdout:5/472: fsync da/db/f8d 0 2024-04-12T13:42:06.924 INFO:tasks.workunit.client.0.smithi060.stdout:3/520: dread - d7/d17/d27/d36/f79 zero size 2024-04-12T13:42:06.924 INFO:tasks.workunit.client.0.smithi060.stdout:4/479: symlink d6/d7/dd/d1a/d57/d63/d68/d76/la9 0 2024-04-12T13:42:06.924 INFO:tasks.workunit.client.1.smithi110.stdout:6/524: dread d7/d25/d2c/f40 [0,4194304] 0 2024-04-12T13:42:06.928 INFO:tasks.workunit.client.1.smithi110.stdout:6/525: chown d7/d25/d30/d44/f7d 195 1 2024-04-12T13:42:06.930 INFO:tasks.workunit.client.0.smithi060.stdout:2/494: creat d6/d10/f95 x:0 0 0 2024-04-12T13:42:06.931 INFO:tasks.workunit.client.1.smithi110.stdout:0/451: fdatasync d1/f14 0 2024-04-12T13:42:06.932 INFO:tasks.workunit.client.1.smithi110.stdout:7/526: dread d1/d1b/d3d/f63 [0,4194304] 0 2024-04-12T13:42:06.933 INFO:tasks.workunit.client.1.smithi110.stdout:2/558: creat d6/dc/fa9 x:0 0 0 2024-04-12T13:42:06.934 INFO:tasks.workunit.client.0.smithi060.stdout:5/506: getdents d6/dd/d1f/d32 0 2024-04-12T13:42:06.934 INFO:tasks.workunit.client.0.smithi060.stdout:6/584: symlink d1/d7/da/dc/d24/d2d/db0/dc3/ld5 0 2024-04-12T13:42:06.939 INFO:tasks.workunit.client.1.smithi110.stdout:1/483: dread de/d14/f4f [0,4194304] 0 2024-04-12T13:42:06.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/521: rename d7/da/d3f/d5c/d25/d4d to d7/da/d3f/d5c/d25/d4d/db4 22 2024-04-12T13:42:06.940 INFO:tasks.workunit.client.0.smithi060.stdout:7/441: dwrite d0/d1b/f5b [0,4194304] 0 2024-04-12T13:42:06.940 INFO:tasks.workunit.client.0.smithi060.stdout:4/480: write d6/d7/dd/d4d/f9b [692972,34753] 0 2024-04-12T13:42:06.940 INFO:tasks.workunit.client.0.smithi060.stdout:1/598: dread f14 [0,4194304] 0 2024-04-12T13:42:06.941 INFO:tasks.workunit.client.0.smithi060.stdout:9/425: dread d4/fd [0,4194304] 0 2024-04-12T13:42:06.944 INFO:tasks.workunit.client.0.smithi060.stdout:2/495: creat d6/d13/d5b/f96 x:0 0 0 2024-04-12T13:42:06.944 INFO:tasks.workunit.client.0.smithi060.stdout:4/481: chown d6/d7/dd/d1a/d57/f83 25 1 2024-04-12T13:42:06.944 INFO:tasks.workunit.client.1.smithi110.stdout:0/452: mkdir d1/d3c/d6b/d90 0 2024-04-12T13:42:06.947 INFO:tasks.workunit.client.1.smithi110.stdout:6/526: mkdir d7/da9 0 2024-04-12T13:42:06.949 INFO:tasks.workunit.client.0.smithi060.stdout:9/426: read d4/d9/d19/f34 [2713242,102977] 0 2024-04-12T13:42:06.951 INFO:tasks.workunit.client.0.smithi060.stdout:9/427: fsync d4/f77 0 2024-04-12T13:42:06.952 INFO:tasks.workunit.client.1.smithi110.stdout:2/559: creat d6/dc/d1b/d8f/faa x:0 0 0 2024-04-12T13:42:06.956 INFO:tasks.workunit.client.1.smithi110.stdout:1/484: dread f6 [0,4194304] 0 2024-04-12T13:42:06.957 INFO:tasks.workunit.client.1.smithi110.stdout:1/485: chown fb 587959777 1 2024-04-12T13:42:06.959 INFO:tasks.workunit.client.1.smithi110.stdout:5/473: rename da/db/d3b/d40/l84 to da/db/la8 0 2024-04-12T13:42:06.961 INFO:tasks.workunit.client.1.smithi110.stdout:5/474: write da/d2e/f30 [4016629,120019] 0 2024-04-12T13:42:06.961 INFO:tasks.workunit.client.1.smithi110.stdout:0/453: creat d1/d27/d6e/f91 x:0 0 0 2024-04-12T13:42:06.966 INFO:tasks.workunit.client.0.smithi060.stdout:4/482: mknod d6/d7/db/d85/caa 0 2024-04-12T13:42:06.970 INFO:tasks.workunit.client.1.smithi110.stdout:1/486: creat de/d1d/d86/fa8 x:0 0 0 2024-04-12T13:42:06.972 INFO:tasks.workunit.client.1.smithi110.stdout:1/487: fdatasync de/d14/d34/d55/f63 0 2024-04-12T13:42:06.974 INFO:tasks.workunit.client.0.smithi060.stdout:3/522: symlink d7/d17/d27/d36/lb5 0 2024-04-12T13:42:06.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/523: write d7/da/d3f/d5c/d25/d4d/f95 [669891,193] 0 2024-04-12T13:42:06.978 INFO:tasks.workunit.client.1.smithi110.stdout:5/475: dwrite da/d5c/f8b [0,4194304] 0 2024-04-12T13:42:06.980 INFO:tasks.workunit.client.1.smithi110.stdout:2/560: mkdir d6/d18/da2/dab 0 2024-04-12T13:42:06.981 INFO:tasks.workunit.client.0.smithi060.stdout:7/442: symlink d0/d7/d92/l99 0 2024-04-12T13:42:06.983 INFO:tasks.workunit.client.1.smithi110.stdout:3/515: write d5/dc/d31/d3b/f4b [4377453,97112] 0 2024-04-12T13:42:06.983 INFO:tasks.workunit.client.0.smithi060.stdout:3/524: dread d7/da/d3f/d5c/d25/f5f [0,4194304] 0 2024-04-12T13:42:06.985 INFO:tasks.workunit.client.1.smithi110.stdout:9/603: sync 2024-04-12T13:42:06.986 INFO:tasks.workunit.client.1.smithi110.stdout:0/454: dread d1/f7 [0,4194304] 0 2024-04-12T13:42:06.987 INFO:tasks.workunit.client.1.smithi110.stdout:8/512: dwrite d1/d3/d3c/fa1 [0,4194304] 0 2024-04-12T13:42:06.988 INFO:tasks.workunit.client.0.smithi060.stdout:6/585: write d1/d7/da/dc/d24/d30/d52/d5e/f63 [516259,130664] 0 2024-04-12T13:42:06.989 INFO:tasks.workunit.client.0.smithi060.stdout:9/428: mknod d4/d8/c8d 0 2024-04-12T13:42:06.991 INFO:tasks.workunit.client.1.smithi110.stdout:3/516: chown d5/dc/d31/d3b/d32/d3e/l60 1 1 2024-04-12T13:42:06.991 INFO:tasks.workunit.client.1.smithi110.stdout:1/488: dread de/f4d [0,4194304] 0 2024-04-12T13:42:06.994 INFO:tasks.workunit.client.1.smithi110.stdout:7/527: getdents d1/d31/d5d 0 2024-04-12T13:42:06.996 INFO:tasks.workunit.client.0.smithi060.stdout:5/507: write d6/dd/d1f/d25/d53/d87/f3a [756744,119937] 0 2024-04-12T13:42:06.999 INFO:tasks.workunit.client.1.smithi110.stdout:6/527: write d7/d10/d1c/f29 [5060398,35425] 0 2024-04-12T13:42:07.000 INFO:tasks.workunit.client.0.smithi060.stdout:4/483: unlink d6/d2f/l31 0 2024-04-12T13:42:07.002 INFO:tasks.workunit.client.0.smithi060.stdout:4/484: readlink d6/d7/dd/d1a/d56/l6e 0 2024-04-12T13:42:07.007 INFO:tasks.workunit.client.1.smithi110.stdout:5/476: dwrite f5 [0,4194304] 0 2024-04-12T13:42:07.007 INFO:tasks.workunit.client.1.smithi110.stdout:1/489: chown de/f10 1426 1 2024-04-12T13:42:07.009 INFO:tasks.workunit.client.1.smithi110.stdout:0/455: dwrite d1/f8c [0,4194304] 0 2024-04-12T13:42:07.012 INFO:tasks.workunit.client.0.smithi060.stdout:0/465: sync 2024-04-12T13:42:07.015 INFO:tasks.workunit.client.0.smithi060.stdout:1/599: getdents d1e/d46/d8d 0 2024-04-12T13:42:07.017 INFO:tasks.workunit.client.0.smithi060.stdout:2/496: dwrite d6/d13/d5b/f66 [0,4194304] 0 2024-04-12T13:42:07.019 INFO:tasks.workunit.client.0.smithi060.stdout:1/600: chown d1e/d23/d2e/d5e/d68/ca9 12513 1 2024-04-12T13:42:07.020 INFO:tasks.workunit.client.0.smithi060.stdout:0/466: read d7/d9/d14/d35/d44/d7d/f32 [376152,59737] 0 2024-04-12T13:42:07.021 INFO:tasks.workunit.client.0.smithi060.stdout:2/497: chown d6/d56/d43/f5e 16022 1 2024-04-12T13:42:07.023 INFO:tasks.workunit.client.0.smithi060.stdout:2/498: chown f4 130932113 1 2024-04-12T13:42:07.024 INFO:tasks.workunit.client.0.smithi060.stdout:2/499: chown d6/f5a 2329 1 2024-04-12T13:42:07.033 INFO:tasks.workunit.client.0.smithi060.stdout:4/485: dwrite d6/d21/f41 [0,4194304] 0 2024-04-12T13:42:07.038 INFO:tasks.workunit.client.0.smithi060.stdout:3/525: rename d7/l1c to d7/d17/d19/d33/d63/d6d/d91/lb6 0 2024-04-12T13:42:07.041 INFO:tasks.workunit.client.0.smithi060.stdout:7/443: truncate d0/d7/f33 2446378 0 2024-04-12T13:42:07.045 INFO:tasks.workunit.client.0.smithi060.stdout:9/429: dwrite d4/d9/d19/f4e [0,4194304] 0 2024-04-12T13:42:07.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/586: truncate d1/f57 3264780 0 2024-04-12T13:42:07.058 INFO:tasks.workunit.client.1.smithi110.stdout:8/513: truncate d1/d3/d3c/d5a/f82 1345941 0 2024-04-12T13:42:07.058 INFO:tasks.workunit.client.1.smithi110.stdout:2/561: creat d6/d18/fac x:0 0 0 2024-04-12T13:42:07.058 INFO:tasks.workunit.client.0.smithi060.stdout:1/601: symlink d1e/d23/d2e/d30/d51/ld1 0 2024-04-12T13:42:07.058 INFO:tasks.workunit.client.0.smithi060.stdout:9/430: write d4/d8/f17 [387835,41532] 0 2024-04-12T13:42:07.060 INFO:tasks.workunit.client.1.smithi110.stdout:7/528: truncate d1/d3/f6d 237408 0 2024-04-12T13:42:07.060 INFO:tasks.workunit.client.1.smithi110.stdout:5/477: mkdir da/d2e/d45/d29/d32/da9 0 2024-04-12T13:42:07.060 INFO:tasks.workunit.client.0.smithi060.stdout:2/500: creat d6/d10/d2b/d35/f97 x:0 0 0 2024-04-12T13:42:07.062 INFO:tasks.workunit.client.1.smithi110.stdout:3/517: mkdir d5/dc/d31/d74/d75/da7/dad 0 2024-04-12T13:42:07.062 INFO:tasks.workunit.client.0.smithi060.stdout:7/444: readlink d0/d7/l20 0 2024-04-12T13:42:07.067 INFO:tasks.workunit.client.0.smithi060.stdout:9/431: write d4/d9/d19/d21/d73/d67/f5e [1181590,70609] 0 2024-04-12T13:42:07.067 INFO:tasks.workunit.client.0.smithi060.stdout:0/467: dwrite d7/d9/f1a [0,4194304] 0 2024-04-12T13:42:07.069 INFO:tasks.workunit.client.0.smithi060.stdout:0/468: dread - d7/d33/d5b/f64 zero size 2024-04-12T13:42:07.070 INFO:tasks.workunit.client.1.smithi110.stdout:9/604: dread df/d13/d26/f41 [0,4194304] 0 2024-04-12T13:42:07.070 INFO:tasks.workunit.client.1.smithi110.stdout:2/562: mknod d6/d53/cad 0 2024-04-12T13:42:07.074 INFO:tasks.workunit.client.1.smithi110.stdout:0/456: dwrite d1/d8/d36/d63/d4a/f73 [0,4194304] 0 2024-04-12T13:42:07.076 INFO:tasks.workunit.client.1.smithi110.stdout:1/490: dwrite de/d15/d32/d61/f73 [0,4194304] 0 2024-04-12T13:42:07.082 INFO:tasks.workunit.client.1.smithi110.stdout:0/457: write d1/f22 [8608094,97028] 0 2024-04-12T13:42:07.085 INFO:tasks.workunit.client.1.smithi110.stdout:9/605: dread df/d13/d2c/d2d/dc1/d83/f7d [0,4194304] 0 2024-04-12T13:42:07.089 INFO:tasks.workunit.client.1.smithi110.stdout:8/514: dread d1/d3/d3c/d5a/d6f/d7e/f63 [0,4194304] 0 2024-04-12T13:42:07.091 INFO:tasks.workunit.client.1.smithi110.stdout:8/515: chown d1/d7/d20/l26 0 1 2024-04-12T13:42:07.094 INFO:tasks.workunit.client.1.smithi110.stdout:2/563: rmdir d6/dc/dd/d49 39 2024-04-12T13:42:07.096 INFO:tasks.workunit.client.1.smithi110.stdout:3/518: dwrite d5/f28 [8388608,4194304] 0 2024-04-12T13:42:07.097 INFO:tasks.workunit.client.0.smithi060.stdout:2/501: dwrite d6/d13/d5b/f96 [0,4194304] 0 2024-04-12T13:42:07.097 INFO:tasks.workunit.client.0.smithi060.stdout:9/432: dwrite d4/d33/d50/f74 [0,4194304] 0 2024-04-12T13:42:07.097 INFO:tasks.workunit.client.0.smithi060.stdout:6/587: dwrite d1/d7/da/dc/d24/d34/d51/fd2 [0,4194304] 0 2024-04-12T13:42:07.098 INFO:tasks.workunit.client.1.smithi110.stdout:3/519: write d5/dc/f82 [540476,34912] 0 2024-04-12T13:42:07.100 INFO:tasks.workunit.client.0.smithi060.stdout:9/433: chown d4/d9/d19/d21 4603 1 2024-04-12T13:42:07.101 INFO:tasks.workunit.client.1.smithi110.stdout:1/491: mkdir de/d15/da9 0 2024-04-12T13:42:07.103 INFO:tasks.workunit.client.1.smithi110.stdout:3/520: write d5/dc/d31/d3b/d5b/f9a [665843,106729] 0 2024-04-12T13:42:07.113 INFO:tasks.workunit.client.1.smithi110.stdout:3/521: write d5/f1f [1739550,32791] 0 2024-04-12T13:42:07.117 INFO:tasks.workunit.client.1.smithi110.stdout:8/516: dwrite d1/d7/d20/f36 [0,4194304] 0 2024-04-12T13:42:07.120 INFO:tasks.workunit.client.1.smithi110.stdout:4/638: sync 2024-04-12T13:42:07.129 INFO:tasks.workunit.client.1.smithi110.stdout:7/529: dread d1/d3/d4/f1c [0,4194304] 0 2024-04-12T13:42:07.131 INFO:tasks.workunit.client.1.smithi110.stdout:1/492: dwrite de/d15/d32/d61/d6a/d72/fa7 [0,4194304] 0 2024-04-12T13:42:07.134 INFO:tasks.workunit.client.1.smithi110.stdout:5/478: link da/d2e/d45/d25/d9d/d7a/f87 da/d2e/d45/faa 0 2024-04-12T13:42:07.135 INFO:tasks.workunit.client.1.smithi110.stdout:1/493: fsync de/d15/d32/f71 0 2024-04-12T13:42:07.139 INFO:tasks.workunit.client.1.smithi110.stdout:9/606: mkdir df/d13/dc5 0 2024-04-12T13:42:07.142 INFO:tasks.workunit.client.1.smithi110.stdout:2/564: mknod d6/dc/dd/d49/d64/d4a/d3c/d50/cae 0 2024-04-12T13:42:07.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/486: creat d6/d7/dd/d1a/d56/d8d/fab x:0 0 0 2024-04-12T13:42:07.146 INFO:tasks.workunit.client.1.smithi110.stdout:4/639: mknod d0/d19/d26/d65/cd4 0 2024-04-12T13:42:07.146 INFO:tasks.workunit.client.0.smithi060.stdout:1/602: fdatasync d1e/d29/d37/f50 0 2024-04-12T13:42:07.149 INFO:tasks.workunit.client.1.smithi110.stdout:8/517: creat d1/d3/d35/d3a/d84/fa2 x:0 0 0 2024-04-12T13:42:07.152 INFO:tasks.workunit.client.1.smithi110.stdout:0/458: link d1/c2a d1/d5e/c92 0 2024-04-12T13:42:07.160 INFO:tasks.workunit.client.0.smithi060.stdout:0/469: mknod d7/d9/de/ca8 0 2024-04-12T13:42:07.161 INFO:tasks.workunit.client.1.smithi110.stdout:6/528: sync 2024-04-12T13:42:07.162 INFO:tasks.workunit.client.1.smithi110.stdout:6/529: dread - d7/d25/d2c/d4c/d77/f96 zero size 2024-04-12T13:42:07.167 INFO:tasks.workunit.client.0.smithi060.stdout:3/526: dwrite d7/d17/d27/d36/f46 [0,4194304] 0 2024-04-12T13:42:07.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/518: mkdir d1/d7/d20/da3 0 2024-04-12T13:42:07.170 INFO:tasks.workunit.client.1.smithi110.stdout:2/565: dread d6/dc/dd/f22 [0,4194304] 0 2024-04-12T13:42:07.172 INFO:tasks.workunit.client.0.smithi060.stdout:2/502: creat d6/d13/d31/d33/f98 x:0 0 0 2024-04-12T13:42:07.172 INFO:tasks.workunit.client.1.smithi110.stdout:0/459: creat d1/d5e/f93 x:0 0 0 2024-04-12T13:42:07.174 INFO:tasks.workunit.client.0.smithi060.stdout:9/434: symlink d4/d9/d19/l8e 0 2024-04-12T13:42:07.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/588: truncate d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b 366430 0 2024-04-12T13:42:07.176 INFO:tasks.workunit.client.1.smithi110.stdout:7/530: write d1/d3/d4/f27 [132917,129310] 0 2024-04-12T13:42:07.177 INFO:tasks.workunit.client.1.smithi110.stdout:5/479: creat da/d2e/d45/d25/d9d/d7a/fab x:0 0 0 2024-04-12T13:42:07.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/527: read d7/d17/d19/d33/f6c [578292,28727] 0 2024-04-12T13:42:07.180 INFO:tasks.workunit.client.0.smithi060.stdout:6/589: read d1/d7/da/dc/f7c [2366535,61317] 0 2024-04-12T13:42:07.180 INFO:tasks.workunit.client.1.smithi110.stdout:9/607: mkdir df/d13/d2c/d2d/dc1/d9f/dc6 0 2024-04-12T13:42:07.181 INFO:tasks.workunit.client.1.smithi110.stdout:6/530: fsync d7/d25/d30/d44/f21 0 2024-04-12T13:42:07.184 INFO:tasks.workunit.client.0.smithi060.stdout:1/603: rename d1e/d46/f82 to d1e/d23/d2e/d30/d51/d85/fd2 0 2024-04-12T13:42:07.186 INFO:tasks.workunit.client.1.smithi110.stdout:2/566: creat d6/dc/dd/d49/faf x:0 0 0 2024-04-12T13:42:07.186 INFO:tasks.workunit.client.0.smithi060.stdout:1/604: write d1e/f28 [5387655,109947] 0 2024-04-12T13:42:07.189 INFO:tasks.workunit.client.1.smithi110.stdout:0/460: unlink d1/d8/d36/d63/f46 0 2024-04-12T13:42:07.190 INFO:tasks.workunit.client.1.smithi110.stdout:8/519: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:42:07.190 INFO:tasks.workunit.client.0.smithi060.stdout:7/445: dwrite d0/d7/d43/f46 [0,4194304] 0 2024-04-12T13:42:07.191 INFO:tasks.workunit.client.1.smithi110.stdout:8/520: chown d1/d5 6 1 2024-04-12T13:42:07.191 INFO:tasks.workunit.client.0.smithi060.stdout:5/508: sync 2024-04-12T13:42:07.192 INFO:tasks.workunit.client.0.smithi060.stdout:8/463: sync 2024-04-12T13:42:07.192 INFO:tasks.workunit.client.1.smithi110.stdout:3/522: getdents d5 0 2024-04-12T13:42:07.193 INFO:tasks.workunit.client.0.smithi060.stdout:5/509: stat d6/dd/d1f/d25/d53/d8d 0 2024-04-12T13:42:07.195 INFO:tasks.workunit.client.1.smithi110.stdout:9/608: rmdir df/d38 39 2024-04-12T13:42:07.198 INFO:tasks.workunit.client.1.smithi110.stdout:3/523: dread d5/dc/f82 [0,4194304] 0 2024-04-12T13:42:07.199 INFO:tasks.workunit.client.1.smithi110.stdout:7/531: truncate d1/d3/f4c 898213 0 2024-04-12T13:42:07.204 INFO:tasks.workunit.client.1.smithi110.stdout:4/640: rename d0/d19/d1c/d50/cc1 to d0/d19/d1c/cd5 0 2024-04-12T13:42:07.207 INFO:tasks.workunit.client.1.smithi110.stdout:2/567: mkdir d6/dc/dd/d49/d64/d25/db0 0 2024-04-12T13:42:07.208 INFO:tasks.workunit.client.1.smithi110.stdout:0/461: mknod d1/d3c/d6b/c94 0 2024-04-12T13:42:07.209 INFO:tasks.workunit.client.1.smithi110.stdout:0/462: readlink d1/l7d 0 2024-04-12T13:42:07.210 INFO:tasks.workunit.client.0.smithi060.stdout:9/435: dread d4/d8/f2e [0,4194304] 0 2024-04-12T13:42:07.210 INFO:tasks.workunit.client.1.smithi110.stdout:0/463: dread - d1/d5e/f93 zero size 2024-04-12T13:42:07.212 INFO:tasks.workunit.client.0.smithi060.stdout:9/436: chown d4/d9/d19/d21/d73/d67/f5e 139804861 1 2024-04-12T13:42:07.213 INFO:tasks.workunit.client.1.smithi110.stdout:8/521: creat d1/d3/d35/d3a/d3e/d4f/fa4 x:0 0 0 2024-04-12T13:42:07.215 INFO:tasks.workunit.client.1.smithi110.stdout:5/480: mknod da/d2e/d45/d29/d66/d7c/d8a/cac 0 2024-04-12T13:42:07.217 INFO:tasks.workunit.client.0.smithi060.stdout:7/446: chown d0/d7/d43/d4d/c7a 19266 1 2024-04-12T13:42:07.218 INFO:tasks.workunit.client.1.smithi110.stdout:9/609: creat df/d13/d2c/d2d/dc1/d83/d63/fc7 x:0 0 0 2024-04-12T13:42:07.219 INFO:tasks.workunit.client.0.smithi060.stdout:7/447: write d0/d78/f95 [348959,108959] 0 2024-04-12T13:42:07.219 INFO:tasks.workunit.client.0.smithi060.stdout:8/464: mknod d9/d1b/d3c/d60/c9b 0 2024-04-12T13:42:07.220 INFO:tasks.workunit.client.1.smithi110.stdout:3/524: chown d5/dc/d31/d3b/c5e 6657 1 2024-04-12T13:42:07.220 INFO:tasks.workunit.client.0.smithi060.stdout:5/510: rmdir d6/dd/d1f/d25/d35 39 2024-04-12T13:42:07.221 INFO:tasks.workunit.client.1.smithi110.stdout:8/522: dread d1/d5/dd/f27 [0,4194304] 0 2024-04-12T13:42:07.223 INFO:tasks.workunit.client.1.smithi110.stdout:8/523: readlink d1/d3/d35/d3a/l54 0 2024-04-12T13:42:07.225 INFO:tasks.workunit.client.1.smithi110.stdout:3/525: dread d5/dc/f2e [0,4194304] 0 2024-04-12T13:42:07.226 INFO:tasks.workunit.client.0.smithi060.stdout:2/503: mkdir d6/d64/d99 0 2024-04-12T13:42:07.228 INFO:tasks.workunit.client.1.smithi110.stdout:4/641: creat d0/d19/d26/fd6 x:0 0 0 2024-04-12T13:42:07.232 INFO:tasks.workunit.client.0.smithi060.stdout:6/590: symlink d1/d7/da/dc/d24/d30/ld6 0 2024-04-12T13:42:07.234 INFO:tasks.workunit.client.0.smithi060.stdout:1/605: dread d1e/d23/d2e/d30/f52 [0,4194304] 0 2024-04-12T13:42:07.234 INFO:tasks.workunit.client.1.smithi110.stdout:5/481: creat da/d4f/fad x:0 0 0 2024-04-12T13:42:07.238 INFO:tasks.workunit.client.0.smithi060.stdout:1/606: chown d1e/d23/d2e/d8e/d98/fbe 3 1 2024-04-12T13:42:07.247 INFO:tasks.workunit.client.1.smithi110.stdout:8/524: rmdir d1/d3/d35/d3a/d3e/d4f 39 2024-04-12T13:42:07.247 INFO:tasks.workunit.client.0.smithi060.stdout:7/448: read - d0/d7/f87 zero size 2024-04-12T13:42:07.248 INFO:tasks.workunit.client.0.smithi060.stdout:8/465: creat d9/d1b/d3c/d6e/f9c x:0 0 0 2024-04-12T13:42:07.254 INFO:tasks.workunit.client.0.smithi060.stdout:5/511: mkdir d6/dd/d1f/d25/d53/d87/da6 0 2024-04-12T13:42:07.254 INFO:tasks.workunit.client.1.smithi110.stdout:5/482: dread da/db/f8d [0,4194304] 0 2024-04-12T13:42:07.255 INFO:tasks.workunit.client.0.smithi060.stdout:4/487: getdents d6/d7/dd/df 0 2024-04-12T13:42:07.256 INFO:tasks.workunit.client.0.smithi060.stdout:3/528: getdents d7/da/d3f/d5c/d25/d4d 0 2024-04-12T13:42:07.258 INFO:tasks.workunit.client.0.smithi060.stdout:6/591: dread - d1/d7/da/dc/f74 zero size 2024-04-12T13:42:07.260 INFO:tasks.workunit.client.0.smithi060.stdout:0/470: getdents d7/d9/de/d80 0 2024-04-12T13:42:07.261 INFO:tasks.workunit.client.0.smithi060.stdout:6/592: chown d1/d7/da/d20/c6f 116819961 1 2024-04-12T13:42:07.262 INFO:tasks.workunit.client.0.smithi060.stdout:0/471: write d7/f87 [223591,82464] 0 2024-04-12T13:42:07.263 INFO:tasks.workunit.client.1.smithi110.stdout:7/532: write d1/d1b/d74/f79 [1730514,65864] 0 2024-04-12T13:42:07.264 INFO:tasks.workunit.client.0.smithi060.stdout:0/472: fdatasync d7/f9a 0 2024-04-12T13:42:07.267 INFO:tasks.workunit.client.1.smithi110.stdout:4/642: rename d0/d75/d84/d89/dc0 to d0/d19/d26/d8a/dd7 0 2024-04-12T13:42:07.268 INFO:tasks.workunit.client.1.smithi110.stdout:3/526: write d5/dc/d31/d3b/d32/f56 [812625,114633] 0 2024-04-12T13:42:07.270 INFO:tasks.workunit.client.1.smithi110.stdout:5/483: dwrite da/d2e/d45/d25/d9d/d79/d88/f8c [0,4194304] 0 2024-04-12T13:42:07.271 INFO:tasks.workunit.client.1.smithi110.stdout:1/494: sync 2024-04-12T13:42:07.271 INFO:tasks.workunit.client.0.smithi060.stdout:5/512: fsync d6/dd/d1f/d32/d46/f92 0 2024-04-12T13:42:07.272 INFO:tasks.workunit.client.0.smithi060.stdout:7/449: dwrite d0/f64 [0,4194304] 0 2024-04-12T13:42:07.274 INFO:tasks.workunit.client.0.smithi060.stdout:9/437: dwrite d4/d8/f2e [0,4194304] 0 2024-04-12T13:42:07.274 INFO:tasks.workunit.client.1.smithi110.stdout:2/568: truncate d6/dc/dd/d49/d64/d4a/d51/f2f 418665 0 2024-04-12T13:42:07.274 INFO:tasks.workunit.client.1.smithi110.stdout:9/610: creat df/d38/db3/fc8 x:0 0 0 2024-04-12T13:42:07.275 INFO:tasks.workunit.client.1.smithi110.stdout:1/495: read de/d14/d34/d55/d6b/f7c [29039,35346] 0 2024-04-12T13:42:07.275 INFO:tasks.workunit.client.0.smithi060.stdout:4/488: symlink d6/d7/dd/d1a/d19/d42/lac 0 2024-04-12T13:42:07.275 INFO:tasks.workunit.client.0.smithi060.stdout:7/450: dread - d0/d78/f8d zero size 2024-04-12T13:42:07.275 INFO:tasks.workunit.client.0.smithi060.stdout:2/504: truncate d6/d13/d5b/d6d/f90 440166 0 2024-04-12T13:42:07.280 INFO:tasks.workunit.client.0.smithi060.stdout:5/513: write d6/f17 [2232782,43296] 0 2024-04-12T13:42:07.286 INFO:tasks.workunit.client.1.smithi110.stdout:3/527: dread d5/dc/d31/d3b/d32/d3e/d5f/f8b [0,4194304] 0 2024-04-12T13:42:07.286 INFO:tasks.workunit.client.1.smithi110.stdout:7/533: mkdir d1/d3/d4/d55/d82/db5 0 2024-04-12T13:42:07.287 INFO:tasks.workunit.client.0.smithi060.stdout:8/466: symlink d9/d1b/d3c/l9d 0 2024-04-12T13:42:07.288 INFO:tasks.workunit.client.0.smithi060.stdout:0/473: stat d7/d9/l2f 0 2024-04-12T13:42:07.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/593: dread - d1/d7/da/dc/d24/d30/d52/d5e/f98 zero size 2024-04-12T13:42:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:0/474: stat d7/d41/l47 0 2024-04-12T13:42:07.292 INFO:tasks.workunit.client.1.smithi110.stdout:5/484: chown da/db/d15/f1b 40 1 2024-04-12T13:42:07.293 INFO:tasks.workunit.client.1.smithi110.stdout:2/569: rmdir d6/dc/d13 39 2024-04-12T13:42:07.296 INFO:tasks.workunit.client.1.smithi110.stdout:8/525: truncate d1/f5c 4097509 0 2024-04-12T13:42:07.297 INFO:tasks.workunit.client.0.smithi060.stdout:8/467: truncate d9/d1b/d3c/d6e/f9c 424579 0 2024-04-12T13:42:07.298 INFO:tasks.workunit.client.1.smithi110.stdout:9/611: unlink df/d13/d3b/d40/d56/f6c 0 2024-04-12T13:42:07.301 INFO:tasks.workunit.client.1.smithi110.stdout:1/496: creat de/d14/d34/d55/d6b/faa x:0 0 0 2024-04-12T13:42:07.303 INFO:tasks.workunit.client.0.smithi060.stdout:2/505: dwrite d6/d13/d17/f6f [0,4194304] 0 2024-04-12T13:42:07.305 INFO:tasks.workunit.client.1.smithi110.stdout:6/531: sync 2024-04-12T13:42:07.305 INFO:tasks.workunit.client.0.smithi060.stdout:7/451: truncate d0/d7/f55 4924347 0 2024-04-12T13:42:07.308 INFO:tasks.workunit.client.1.smithi110.stdout:7/534: write d1/d3/d4/f9b [146090,106810] 0 2024-04-12T13:42:07.308 INFO:tasks.workunit.client.0.smithi060.stdout:9/438: rmdir d4/d9/d19/d21 39 2024-04-12T13:42:07.308 INFO:tasks.workunit.client.0.smithi060.stdout:7/452: read - d0/d7/d43/d63/d6f/f7f zero size 2024-04-12T13:42:07.311 INFO:tasks.workunit.client.1.smithi110.stdout:5/485: dread - da/d35/d71/d8f/f5b zero size 2024-04-12T13:42:07.312 INFO:tasks.workunit.client.0.smithi060.stdout:3/529: creat d7/d17/d27/d36/db0/fb7 x:0 0 0 2024-04-12T13:42:07.317 INFO:tasks.workunit.client.1.smithi110.stdout:8/526: creat d1/d3/d3c/d75/d79/fa5 x:0 0 0 2024-04-12T13:42:07.321 INFO:tasks.workunit.client.1.smithi110.stdout:3/528: dread d5/f28 [4194304,4194304] 0 2024-04-12T13:42:07.323 INFO:tasks.workunit.client.0.smithi060.stdout:6/594: truncate d1/d7/f43 28550 0 2024-04-12T13:42:07.324 INFO:tasks.workunit.client.1.smithi110.stdout:1/497: mkdir de/d15/dab 0 2024-04-12T13:42:07.325 INFO:tasks.workunit.client.1.smithi110.stdout:4/643: dread d0/f15 [4194304,4194304] 0 2024-04-12T13:42:07.328 INFO:tasks.workunit.client.0.smithi060.stdout:2/506: creat d6/d10/d2b/f9a x:0 0 0 2024-04-12T13:42:07.332 INFO:tasks.workunit.client.0.smithi060.stdout:4/489: dread d6/d7/dd/d1a/d57/fa7 [0,4194304] 0 2024-04-12T13:42:07.334 INFO:tasks.workunit.client.1.smithi110.stdout:9/612: dread df/d38/d6e/faa [0,4194304] 0 2024-04-12T13:42:07.335 INFO:tasks.workunit.client.1.smithi110.stdout:2/570: chown d6/dc/d13/f7b 850764 1 2024-04-12T13:42:07.335 INFO:tasks.workunit.client.1.smithi110.stdout:5/486: dwrite da/d2e/d45/d25/d9d/d79/d82/f85 [0,4194304] 0 2024-04-12T13:42:07.340 INFO:tasks.workunit.client.0.smithi060.stdout:7/453: symlink d0/d1b/d8c/l9a 0 2024-04-12T13:42:07.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/468: link d9/d1b/d2b/f45 d9/d1b/d3c/d6e/d7b/f9e 0 2024-04-12T13:42:07.345 INFO:tasks.workunit.client.1.smithi110.stdout:0/464: sync 2024-04-12T13:42:07.348 INFO:tasks.workunit.client.0.smithi060.stdout:5/514: dread d6/dd/d1f/d25/d53/f6e [0,4194304] 0 2024-04-12T13:42:07.351 INFO:tasks.workunit.client.1.smithi110.stdout:5/487: dwrite da/d4f/f91 [0,4194304] 0 2024-04-12T13:42:07.359 INFO:tasks.workunit.client.1.smithi110.stdout:1/498: dwrite de/d15/d32/d61/f67 [4194304,4194304] 0 2024-04-12T13:42:07.363 INFO:tasks.workunit.client.0.smithi060.stdout:9/439: creat d4/d9/d19/d21/d73/d67/f8f x:0 0 0 2024-04-12T13:42:07.364 INFO:tasks.workunit.client.0.smithi060.stdout:3/530: fdatasync d7/da/d3f/d5c/f54 0 2024-04-12T13:42:07.366 INFO:tasks.workunit.client.0.smithi060.stdout:8/469: dread - d9/d1b/f70 zero size 2024-04-12T13:42:07.367 INFO:tasks.workunit.client.1.smithi110.stdout:8/527: mknod d1/d7/ca6 0 2024-04-12T13:42:07.369 INFO:tasks.workunit.client.1.smithi110.stdout:0/465: rmdir d1/d27/d6e 39 2024-04-12T13:42:07.369 INFO:tasks.workunit.client.0.smithi060.stdout:5/515: fsync d6/dd/d1f/d25/d53/d87/f60 0 2024-04-12T13:42:07.373 INFO:tasks.workunit.client.0.smithi060.stdout:0/475: getdents d7/d9 0 2024-04-12T13:42:07.374 INFO:tasks.workunit.client.1.smithi110.stdout:5/488: mkdir da/d2e/d45/d25/d9d/d7a/dae 0 2024-04-12T13:42:07.375 INFO:tasks.workunit.client.1.smithi110.stdout:4/644: write d0/d19/d1c/d50/f67 [367648,82529] 0 2024-04-12T13:42:07.375 INFO:tasks.workunit.client.1.smithi110.stdout:5/489: chown da/db/d3b 991678113 1 2024-04-12T13:42:07.378 INFO:tasks.workunit.client.0.smithi060.stdout:4/490: write d6/f2e [628405,108845] 0 2024-04-12T13:42:07.378 INFO:tasks.workunit.client.1.smithi110.stdout:7/535: truncate d1/d3/d4/f30 1534372 0 2024-04-12T13:42:07.379 INFO:tasks.workunit.client.1.smithi110.stdout:7/536: stat d1/d1b 0 2024-04-12T13:42:07.383 INFO:tasks.workunit.client.0.smithi060.stdout:4/491: write d6/d7/dd/d1a/d56/d8d/fab [475554,99277] 0 2024-04-12T13:42:07.383 INFO:tasks.workunit.client.0.smithi060.stdout:7/454: unlink d0/d7/l13 0 2024-04-12T13:42:07.385 INFO:tasks.workunit.client.1.smithi110.stdout:1/499: mkdir de/d15/d32/d61/d6a/dac 0 2024-04-12T13:42:07.386 INFO:tasks.workunit.client.0.smithi060.stdout:7/455: write d0/f3a [2994135,104150] 0 2024-04-12T13:42:07.386 INFO:tasks.workunit.client.0.smithi060.stdout:4/492: chown d6/d7/dd/d1a/l39 407 1 2024-04-12T13:42:07.388 INFO:tasks.workunit.client.1.smithi110.stdout:7/537: dread d1/d31/f81 [0,4194304] 0 2024-04-12T13:42:07.388 INFO:tasks.workunit.client.0.smithi060.stdout:9/440: symlink d4/d9/d19/d21/d73/l90 0 2024-04-12T13:42:07.389 INFO:tasks.workunit.client.1.smithi110.stdout:2/571: mkdir d6/dc/db1 0 2024-04-12T13:42:07.391 INFO:tasks.workunit.client.0.smithi060.stdout:4/493: read d6/d7/f3b [168376,102490] 0 2024-04-12T13:42:07.393 INFO:tasks.workunit.client.0.smithi060.stdout:3/531: symlink d7/d17/d27/d36/db0/lb8 0 2024-04-12T13:42:07.393 INFO:tasks.workunit.client.1.smithi110.stdout:9/613: mkdir df/d13/d26/dc9 0 2024-04-12T13:42:07.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/441: write d4/d8/d32/f78 [155607,12244] 0 2024-04-12T13:42:07.400 INFO:tasks.workunit.client.0.smithi060.stdout:2/507: rename d6/d13/f34 to d6/f9b 0 2024-04-12T13:42:07.400 INFO:tasks.workunit.client.0.smithi060.stdout:1/607: sync 2024-04-12T13:42:07.401 INFO:tasks.workunit.client.1.smithi110.stdout:5/490: mknod da/d35/caf 0 2024-04-12T13:42:07.402 INFO:tasks.workunit.client.1.smithi110.stdout:5/491: stat da/db/f37 0 2024-04-12T13:42:07.403 INFO:tasks.workunit.client.1.smithi110.stdout:1/500: dwrite de/d15/d32/d5e/fa5 [0,4194304] 0 2024-04-12T13:42:07.405 INFO:tasks.workunit.client.0.smithi060.stdout:2/508: write d6/d13/d17/f30 [4763741,16976] 0 2024-04-12T13:42:07.405 INFO:tasks.workunit.client.1.smithi110.stdout:1/501: write de/f80 [3957532,100971] 0 2024-04-12T13:42:07.407 INFO:tasks.workunit.client.0.smithi060.stdout:2/509: readlink d6/d10/d16/l83 0 2024-04-12T13:42:07.408 INFO:tasks.workunit.client.1.smithi110.stdout:1/502: write de/d15/d32/d61/f73 [3733571,110806] 0 2024-04-12T13:42:07.409 INFO:tasks.workunit.client.0.smithi060.stdout:8/470: dread d9/d1b/d3c/d6e/d7b/f9e [0,4194304] 0 2024-04-12T13:42:07.409 INFO:tasks.workunit.client.1.smithi110.stdout:4/645: rename d0/de/d2c/d57/fbf to d0/de/d2c/d57/fd8 0 2024-04-12T13:42:07.413 INFO:tasks.workunit.client.0.smithi060.stdout:6/595: getdents d1/d7/da/dc/d24/d30/d52/d5e 0 2024-04-12T13:42:07.415 INFO:tasks.workunit.client.0.smithi060.stdout:5/516: dread f1 [0,4194304] 0 2024-04-12T13:42:07.423 INFO:tasks.workunit.client.0.smithi060.stdout:1/608: dwrite d1e/d23/d2e/d8e/d98/fa6 [0,4194304] 0 2024-04-12T13:42:07.423 INFO:tasks.workunit.client.1.smithi110.stdout:9/614: dread df/d38/d6e/d7f/f8b [4194304,4194304] 0 2024-04-12T13:42:07.425 INFO:tasks.workunit.client.1.smithi110.stdout:9/615: chown df/d13/d2c/d2d/d94 588287588 1 2024-04-12T13:42:07.425 INFO:tasks.workunit.client.1.smithi110.stdout:6/532: rename d7/d10/d1c/d2b/c83 to d7/d25/d30/d44/caa 0 2024-04-12T13:42:07.429 INFO:tasks.workunit.client.0.smithi060.stdout:7/456: mkdir d0/d3d/d74/d9b 0 2024-04-12T13:42:07.435 INFO:tasks.workunit.client.1.smithi110.stdout:2/572: symlink d6/dc/dd/d49/d64/d4a/d55/d82/lb2 0 2024-04-12T13:42:07.438 INFO:tasks.workunit.client.1.smithi110.stdout:2/573: chown d6/dc/dd/d49/d64/d4a/d3c/d50/fa4 179021 1 2024-04-12T13:42:07.442 INFO:tasks.workunit.client.0.smithi060.stdout:4/494: mkdir d6/d7/dd/d1a/d19/dad 0 2024-04-12T13:42:07.445 INFO:tasks.workunit.client.1.smithi110.stdout:8/528: getdents d1/d5/dd/d31 0 2024-04-12T13:42:07.448 INFO:tasks.workunit.client.1.smithi110.stdout:3/529: getdents d5/dc/d20/d2d/d4e/d89 0 2024-04-12T13:42:07.451 INFO:tasks.workunit.client.1.smithi110.stdout:3/530: write d5/dc/d31/d3b/d32/d3e/f41 [1136293,14539] 0 2024-04-12T13:42:07.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/476: link d7/d33/d5b/f9f d7/d9/d14/d35/d3c/fa9 0 2024-04-12T13:42:07.453 INFO:tasks.workunit.client.1.smithi110.stdout:2/574: dwrite d6/dc/dd/d49/d64/d4a/f92 [0,4194304] 0 2024-04-12T13:42:07.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/510: unlink d6/d56/d43/f50 0 2024-04-12T13:42:07.457 INFO:tasks.workunit.client.1.smithi110.stdout:5/492: dread da/db/d15/f24 [0,4194304] 0 2024-04-12T13:42:07.457 INFO:tasks.workunit.client.1.smithi110.stdout:2/575: write d6/dc/dd/d49/d64/d4a/d3c/f26 [2523862,31578] 0 2024-04-12T13:42:07.462 INFO:tasks.workunit.client.1.smithi110.stdout:4/646: chown d0/d19/l37 0 1 2024-04-12T13:42:07.469 INFO:tasks.workunit.client.1.smithi110.stdout:0/466: rename d1/f7 to d1/d5e/f95 0 2024-04-12T13:42:07.470 INFO:tasks.workunit.client.0.smithi060.stdout:1/609: mknod d1e/d29/d65/cd3 0 2024-04-12T13:42:07.472 INFO:tasks.workunit.client.1.smithi110.stdout:6/533: rmdir d7/d10/d1c/d2b/d48/d54 39 2024-04-12T13:42:07.472 INFO:tasks.workunit.client.0.smithi060.stdout:9/442: dwrite d4/d33/d50/f61 [0,4194304] 0 2024-04-12T13:42:07.474 INFO:tasks.workunit.client.1.smithi110.stdout:5/493: dwrite da/d2e/d45/d25/d9d/d79/d88/f8c [0,4194304] 0 2024-04-12T13:42:07.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/457: symlink d0/d7/d92/l9c 0 2024-04-12T13:42:07.476 INFO:tasks.workunit.client.1.smithi110.stdout:7/538: fsync d1/d3/f6d 0 2024-04-12T13:42:07.476 INFO:tasks.workunit.client.0.smithi060.stdout:9/443: fdatasync d4/d8/d32/f78 0 2024-04-12T13:42:07.479 INFO:tasks.workunit.client.0.smithi060.stdout:4/495: mknod d6/d7/db/d85/cae 0 2024-04-12T13:42:07.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/444: write d4/d8/f40 [293356,110404] 0 2024-04-12T13:42:07.483 INFO:tasks.workunit.client.0.smithi060.stdout:4/496: write d6/d21/f53 [166554,123562] 0 2024-04-12T13:42:07.483 INFO:tasks.workunit.client.0.smithi060.stdout:6/596: dwrite d1/d7/da/dc/f29 [0,4194304] 0 2024-04-12T13:42:07.484 INFO:tasks.workunit.client.1.smithi110.stdout:8/529: symlink d1/d3/d35/d3a/d84/la7 0 2024-04-12T13:42:07.488 INFO:tasks.workunit.client.0.smithi060.stdout:2/511: symlink d6/d56/d55/l9c 0 2024-04-12T13:42:07.489 INFO:tasks.workunit.client.0.smithi060.stdout:8/471: mknod d9/c9f 0 2024-04-12T13:42:07.489 INFO:tasks.workunit.client.0.smithi060.stdout:9/445: chown d4/c8a 123566680 1 2024-04-12T13:42:07.489 INFO:tasks.workunit.client.0.smithi060.stdout:8/472: dread - d9/d1b/d37/d4d/f97 zero size 2024-04-12T13:42:07.489 INFO:tasks.workunit.client.0.smithi060.stdout:5/517: unlink d6/dd/d1f/d25/d35/d50/l57 0 2024-04-12T13:42:07.494 INFO:tasks.workunit.client.1.smithi110.stdout:6/534: dwrite d7/d25/d30/d44/f7d [0,4194304] 0 2024-04-12T13:42:07.496 INFO:tasks.workunit.client.0.smithi060.stdout:1/610: mkdir d1e/d94/dd4 0 2024-04-12T13:42:07.497 INFO:tasks.workunit.client.0.smithi060.stdout:3/532: creat d7/d17/d27/d36/fb9 x:0 0 0 2024-04-12T13:42:07.498 INFO:tasks.workunit.client.1.smithi110.stdout:2/576: creat d6/dc/dd/d49/d64/d4a/d55/d82/d84/fb3 x:0 0 0 2024-04-12T13:42:07.499 INFO:tasks.workunit.client.0.smithi060.stdout:1/611: chown d1e/d23/d2e/d8e/cc3 108026 1 2024-04-12T13:42:07.500 INFO:tasks.workunit.client.1.smithi110.stdout:9/616: mkdir df/d13/dca 0 2024-04-12T13:42:07.504 INFO:tasks.workunit.client.1.smithi110.stdout:7/539: dwrite d1/d1b/d3d/d68/f8e [0,4194304] 0 2024-04-12T13:42:07.504 INFO:tasks.workunit.client.1.smithi110.stdout:1/503: rename de/d15/d32/d5e/fa5 to de/d15/d32/d61/d6a/d8b/fad 0 2024-04-12T13:42:07.504 INFO:tasks.workunit.client.1.smithi110.stdout:0/467: dread - d1/d8/d36/d63/f5d zero size 2024-04-12T13:42:07.504 INFO:tasks.workunit.client.1.smithi110.stdout:5/494: mkdir da/d2e/d45/d25/d9d/d79/d88/db0 0 2024-04-12T13:42:07.506 INFO:tasks.workunit.client.1.smithi110.stdout:3/531: symlink d5/dc/d31/d74/d75/da7/dad/lae 0 2024-04-12T13:42:07.511 INFO:tasks.workunit.client.1.smithi110.stdout:3/532: chown d5/dc/f13 226855 1 2024-04-12T13:42:07.511 INFO:tasks.workunit.client.1.smithi110.stdout:8/530: symlink d1/d5/dd/la8 0 2024-04-12T13:42:07.522 INFO:tasks.workunit.client.1.smithi110.stdout:1/504: symlink de/d14/d34/d87/lae 0 2024-04-12T13:42:07.523 INFO:tasks.workunit.client.1.smithi110.stdout:5/495: creat da/d35/d71/d89/fb1 x:0 0 0 2024-04-12T13:42:07.526 INFO:tasks.workunit.client.1.smithi110.stdout:0/468: dwrite d1/d5e/f93 [0,4194304] 0 2024-04-12T13:42:07.527 INFO:tasks.workunit.client.1.smithi110.stdout:1/505: truncate de/d14/d34/d55/f5c 2067269 0 2024-04-12T13:42:07.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/458: write d0/d78/f97 [726513,59246] 0 2024-04-12T13:42:07.529 INFO:tasks.workunit.client.0.smithi060.stdout:4/497: mknod d6/d7/dd/d1a/d57/d63/d68/caf 0 2024-04-12T13:42:07.530 INFO:tasks.workunit.client.1.smithi110.stdout:6/535: truncate d7/d10/d1c/f24 3497104 0 2024-04-12T13:42:07.531 INFO:tasks.workunit.client.0.smithi060.stdout:9/446: rename d4/f87 to d4/d33/d65/f91 0 2024-04-12T13:42:07.532 INFO:tasks.workunit.client.1.smithi110.stdout:7/540: mkdir d1/d1b/d94/db6 0 2024-04-12T13:42:07.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/597: creat d1/d7/da/dc/dac/fd7 x:0 0 0 2024-04-12T13:42:07.533 INFO:tasks.workunit.client.0.smithi060.stdout:7/459: dread - d0/d7/d43/d63/d6f/f82 zero size 2024-04-12T13:42:07.535 INFO:tasks.workunit.client.1.smithi110.stdout:9/617: mkdir df/d38/d6e/dcb 0 2024-04-12T13:42:07.536 INFO:tasks.workunit.client.1.smithi110.stdout:3/533: dwrite d5/dc/d31/d3b/d32/f78 [0,4194304] 0 2024-04-12T13:42:07.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/460: stat d0/c65 0 2024-04-12T13:42:07.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/477: creat d7/d9/d14/faa x:0 0 0 2024-04-12T13:42:07.544 INFO:tasks.workunit.client.0.smithi060.stdout:0/478: chown d7/d9/lb 392 1 2024-04-12T13:42:07.545 INFO:tasks.workunit.client.1.smithi110.stdout:9/618: read df/d13/d2c/f8f [1052629,94379] 0 2024-04-12T13:42:07.546 INFO:tasks.workunit.client.1.smithi110.stdout:4/647: dwrite d0/d19/f23 [4194304,4194304] 0 2024-04-12T13:42:07.546 INFO:tasks.workunit.client.0.smithi060.stdout:8/473: dwrite d9/d1b/d37/d48/f62 [0,4194304] 0 2024-04-12T13:42:07.546 INFO:tasks.workunit.client.0.smithi060.stdout:4/498: unlink d6/d21/d29/l35 0 2024-04-12T13:42:07.548 INFO:tasks.workunit.client.1.smithi110.stdout:5/496: dread da/d2e/d45/d25/d9d/d79/d82/f85 [0,4194304] 0 2024-04-12T13:42:07.550 INFO:tasks.workunit.client.1.smithi110.stdout:5/497: chown da/db/d15/fa7 1 1 2024-04-12T13:42:07.552 INFO:tasks.workunit.client.1.smithi110.stdout:5/498: fdatasync da/d2e/d45/d25/d9d/f9b 0 2024-04-12T13:42:07.557 INFO:tasks.workunit.client.1.smithi110.stdout:1/506: rmdir de/d14/d34/d55/d6b 39 2024-04-12T13:42:07.568 INFO:tasks.workunit.client.0.smithi060.stdout:9/447: dwrite d4/d9/d19/d21/f66 [0,4194304] 0 2024-04-12T13:42:07.568 INFO:tasks.workunit.client.1.smithi110.stdout:3/534: mknod d5/dc/d20/d2d/d4e/caf 0 2024-04-12T13:42:07.569 INFO:tasks.workunit.client.1.smithi110.stdout:3/535: chown d5/dc/da0 171127308 1 2024-04-12T13:42:07.570 INFO:tasks.workunit.client.0.smithi060.stdout:8/474: rename d9/da to d9/d1b/d84/da0 0 2024-04-12T13:42:07.571 INFO:tasks.workunit.client.1.smithi110.stdout:3/536: truncate d5/d86/f93 651353 0 2024-04-12T13:42:07.576 INFO:tasks.workunit.client.0.smithi060.stdout:6/598: mkdir d1/d7/da/dc/d24/d30/dd8 0 2024-04-12T13:42:07.580 INFO:tasks.workunit.client.1.smithi110.stdout:0/469: creat d1/d27/d6e/f96 x:0 0 0 2024-04-12T13:42:07.581 INFO:tasks.workunit.client.1.smithi110.stdout:0/470: dread - d1/d48/f8f zero size 2024-04-12T13:42:07.582 INFO:tasks.workunit.client.1.smithi110.stdout:4/648: mkdir d0/de/da0/dd9 0 2024-04-12T13:42:07.583 INFO:tasks.workunit.client.1.smithi110.stdout:4/649: dread - d0/d19/d26/d8a/dd7/fd0 zero size 2024-04-12T13:42:07.585 INFO:tasks.workunit.client.1.smithi110.stdout:4/650: chown d0/d19/d1c/d50/d6f/l88 26171 1 2024-04-12T13:42:07.586 INFO:tasks.workunit.client.0.smithi060.stdout:3/533: link d7/d17/d19/d33/l34 d7/lba 0 2024-04-12T13:42:07.587 INFO:tasks.workunit.client.0.smithi060.stdout:7/461: dwrite d0/d1b/f37 [0,4194304] 0 2024-04-12T13:42:07.590 INFO:tasks.workunit.client.1.smithi110.stdout:5/499: rename da/db/f31 to da/d2e/d45/d29/d66/fb2 0 2024-04-12T13:42:07.592 INFO:tasks.workunit.client.0.smithi060.stdout:1/612: dread d1e/f2b [0,4194304] 0 2024-04-12T13:42:07.594 INFO:tasks.workunit.client.0.smithi060.stdout:4/499: rename d6/d7/dd/d4d/d69/l6b to d6/d7/dd/d1a/d19/d42/d7c/lb0 0 2024-04-12T13:42:07.595 INFO:tasks.workunit.client.0.smithi060.stdout:5/518: dread d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:42:07.598 INFO:tasks.workunit.client.0.smithi060.stdout:0/479: truncate d7/d9/d14/d4a/f4f 2526363 0 2024-04-12T13:42:07.598 INFO:tasks.workunit.client.1.smithi110.stdout:5/500: dread da/d35/f75 [0,4194304] 0 2024-04-12T13:42:07.600 INFO:tasks.workunit.client.1.smithi110.stdout:5/501: write da/db/f8d [4194445,28819] 0 2024-04-12T13:42:07.600 INFO:tasks.workunit.client.0.smithi060.stdout:0/480: write d7/f87 [691444,43695] 0 2024-04-12T13:42:07.600 INFO:tasks.workunit.client.0.smithi060.stdout:9/448: mkdir d4/d9/d19/d8c/d92 0 2024-04-12T13:42:07.601 INFO:tasks.workunit.client.1.smithi110.stdout:5/502: readlink da/d2e/d45/d25/d9d/l76 0 2024-04-12T13:42:07.602 INFO:tasks.workunit.client.1.smithi110.stdout:7/541: link d1/d1b/d74/f8b d1/d1b/d94/db6/fb7 0 2024-04-12T13:42:07.603 INFO:tasks.workunit.client.0.smithi060.stdout:0/481: chown d7/d9/d14/d35/d3c/c59 3069030 1 2024-04-12T13:42:07.604 INFO:tasks.workunit.client.1.smithi110.stdout:5/503: write da/d2e/d45/f1e [5083610,73476] 0 2024-04-12T13:42:07.606 INFO:tasks.workunit.client.1.smithi110.stdout:3/537: write d5/dc/d31/d3b/d32/d3e/d5f/f8b [2524066,67061] 0 2024-04-12T13:42:07.607 INFO:tasks.workunit.client.0.smithi060.stdout:1/613: dread - d1e/d23/d2e/d86/f9c zero size 2024-04-12T13:42:07.609 INFO:tasks.workunit.client.0.smithi060.stdout:4/500: creat d6/d7/db/fb1 x:0 0 0 2024-04-12T13:42:07.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/501: dread - d6/d7/db/fb1 zero size 2024-04-12T13:42:07.611 INFO:tasks.workunit.client.1.smithi110.stdout:4/651: unlink d0/de/d32/d61/fa2 0 2024-04-12T13:42:07.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/519: rename d6/d10/d12/d38/l73 to d6/d89/la7 0 2024-04-12T13:42:07.615 INFO:tasks.workunit.client.0.smithi060.stdout:6/599: dwrite d1/d7/da/dc/d24/d8b/fbc [0,4194304] 0 2024-04-12T13:42:07.618 INFO:tasks.workunit.client.1.smithi110.stdout:6/536: link d7/d10/d1c/d2b/f7a d7/d10/d41/fab 0 2024-04-12T13:42:07.625 INFO:tasks.workunit.client.1.smithi110.stdout:9/619: creat df/d13/d26/d37/fcc x:0 0 0 2024-04-12T13:42:07.625 INFO:tasks.workunit.client.1.smithi110.stdout:3/538: creat d5/dc/d20/d2d/fb0 x:0 0 0 2024-04-12T13:42:07.626 INFO:tasks.workunit.client.1.smithi110.stdout:4/652: dwrite d0/de/d2c/d57/f94 [0,4194304] 0 2024-04-12T13:42:07.627 INFO:tasks.workunit.client.1.smithi110.stdout:9/620: stat df/d13/d2c/d2d/d39/f91 0 2024-04-12T13:42:07.629 INFO:tasks.workunit.client.0.smithi060.stdout:0/482: mkdir d7/d9/d14/dab 0 2024-04-12T13:42:07.631 INFO:tasks.workunit.client.0.smithi060.stdout:3/534: creat d7/d17/d19/d33/fbb x:0 0 0 2024-04-12T13:42:07.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/614: dread d1e/d46/d8d/fbc [0,4194304] 0 2024-04-12T13:42:07.631 INFO:tasks.workunit.client.0.smithi060.stdout:7/462: creat d0/d7/f9d x:0 0 0 2024-04-12T13:42:07.635 INFO:tasks.workunit.client.1.smithi110.stdout:1/507: rename de/d1d/c4a to de/d14/d34/d87/caf 0 2024-04-12T13:42:07.635 INFO:tasks.workunit.client.1.smithi110.stdout:6/537: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:42:07.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/463: write d0/d3d/d74/f7e [517816,8614] 0 2024-04-12T13:42:07.636 INFO:tasks.workunit.client.0.smithi060.stdout:3/535: write d7/d17/d27/d36/f46 [2333698,103161] 0 2024-04-12T13:42:07.639 INFO:tasks.workunit.client.0.smithi060.stdout:5/520: truncate d6/dd/d1f/d25/d53/f6e 8143006 0 2024-04-12T13:42:07.639 INFO:tasks.workunit.client.1.smithi110.stdout:2/577: sync 2024-04-12T13:42:07.639 INFO:tasks.workunit.client.1.smithi110.stdout:8/531: sync 2024-04-12T13:42:07.640 INFO:tasks.workunit.client.0.smithi060.stdout:3/536: chown d7/d17/d19/d33/f77 1866 1 2024-04-12T13:42:07.642 INFO:tasks.workunit.client.1.smithi110.stdout:2/578: chown d6/dc/dd/d49/f8a 529 1 2024-04-12T13:42:07.644 INFO:tasks.workunit.client.0.smithi060.stdout:9/449: dread d4/d8/f41 [0,4194304] 0 2024-04-12T13:42:07.644 INFO:tasks.workunit.client.0.smithi060.stdout:3/537: truncate d7/da/d3f/d5c/f8d 724227 0 2024-04-12T13:42:07.649 INFO:tasks.workunit.client.1.smithi110.stdout:7/542: symlink d1/d1b/lb8 0 2024-04-12T13:42:07.653 INFO:tasks.workunit.client.1.smithi110.stdout:3/539: mkdir d5/dc/d20/d2d/db1 0 2024-04-12T13:42:07.653 INFO:tasks.workunit.client.1.smithi110.stdout:1/508: dread de/d14/f3a [0,4194304] 0 2024-04-12T13:42:07.657 INFO:tasks.workunit.client.1.smithi110.stdout:9/621: chown df/d13/d2c/d2d/f64 523280 1 2024-04-12T13:42:07.658 INFO:tasks.workunit.client.0.smithi060.stdout:0/483: creat d7/d9/d14/d35/d44/d7d/fac x:0 0 0 2024-04-12T13:42:07.660 INFO:tasks.workunit.client.0.smithi060.stdout:6/600: truncate d1/d7/f5d 1052768 0 2024-04-12T13:42:07.660 INFO:tasks.workunit.client.1.smithi110.stdout:8/532: dwrite d1/d3/d3c/f33 [0,4194304] 0 2024-04-12T13:42:07.664 INFO:tasks.workunit.client.1.smithi110.stdout:5/504: rename da/d2e/d45/c20 to da/d35/cb3 0 2024-04-12T13:42:07.664 INFO:tasks.workunit.client.0.smithi060.stdout:4/502: stat d6/d7/dd/d1a/d19/d42/d7c/lb0 0 2024-04-12T13:42:07.666 INFO:tasks.workunit.client.0.smithi060.stdout:4/503: chown d6/d7/dd/d1a/d19/d7a/d9d 674650 1 2024-04-12T13:42:07.668 INFO:tasks.workunit.client.0.smithi060.stdout:7/464: mknod d0/d7/d43/d85/c9e 0 2024-04-12T13:42:07.670 INFO:tasks.workunit.client.0.smithi060.stdout:7/465: readlink d0/l3f 0 2024-04-12T13:42:07.670 INFO:tasks.workunit.client.1.smithi110.stdout:6/538: chown d7/d10/d1c/d2b/d48/d54/f5d 965110 1 2024-04-12T13:42:07.672 INFO:tasks.workunit.client.0.smithi060.stdout:5/521: mkdir d6/d10/d12/d4c/da8 0 2024-04-12T13:42:07.681 INFO:tasks.workunit.client.0.smithi060.stdout:1/615: symlink d1e/ld5 0 2024-04-12T13:42:07.682 INFO:tasks.workunit.client.1.smithi110.stdout:1/509: fdatasync de/f10 0 2024-04-12T13:42:07.683 INFO:tasks.workunit.client.0.smithi060.stdout:0/484: symlink d7/d41/lad 0 2024-04-12T13:42:07.684 INFO:tasks.workunit.client.0.smithi060.stdout:1/616: dread - d1e/d23/d2e/d8e/d98/fc1 zero size 2024-04-12T13:42:07.684 INFO:tasks.workunit.client.1.smithi110.stdout:0/471: link d1/d27/d31/l3b d1/d48/l97 0 2024-04-12T13:42:07.685 INFO:tasks.workunit.client.0.smithi060.stdout:5/522: dread d6/dd/d1f/d25/d35/d50/d5f/f9b [0,4194304] 0 2024-04-12T13:42:07.686 INFO:tasks.workunit.client.0.smithi060.stdout:0/485: dread - d7/d9/d14/d4a/fa1 zero size 2024-04-12T13:42:07.688 INFO:tasks.workunit.client.0.smithi060.stdout:4/504: unlink d6/d7/dd/d1a/d19/f5e 0 2024-04-12T13:42:07.692 INFO:tasks.workunit.client.0.smithi060.stdout:7/466: rmdir d0/d7/d43/d63 39 2024-04-12T13:42:07.695 INFO:tasks.workunit.client.1.smithi110.stdout:9/622: rmdir df/d13/d26/d37 39 2024-04-12T13:42:07.701 INFO:tasks.workunit.client.1.smithi110.stdout:8/533: symlink d1/d7/d20/la9 0 2024-04-12T13:42:07.702 INFO:tasks.workunit.client.1.smithi110.stdout:8/534: fsync d1/d3/d35/d3a/d3e/f49 0 2024-04-12T13:42:07.703 INFO:tasks.workunit.client.1.smithi110.stdout:5/505: symlink da/d2e/d45/d25/d9d/d79/lb4 0 2024-04-12T13:42:07.704 INFO:tasks.workunit.client.1.smithi110.stdout:5/506: fsync da/db/f8d 0 2024-04-12T13:42:07.705 INFO:tasks.workunit.client.0.smithi060.stdout:4/505: dwrite d6/d21/d88/fa4 [0,4194304] 0 2024-04-12T13:42:07.706 INFO:tasks.workunit.client.0.smithi060.stdout:0/486: dwrite d7/d9/d4c/f50 [0,4194304] 0 2024-04-12T13:42:07.707 INFO:tasks.workunit.client.1.smithi110.stdout:6/539: symlink d7/d25/d2c/d4c/d77/d93/lac 0 2024-04-12T13:42:07.712 INFO:tasks.workunit.client.0.smithi060.stdout:0/487: write d7/d9/de/f91 [3518513,40148] 0 2024-04-12T13:42:07.714 INFO:tasks.workunit.client.1.smithi110.stdout:4/653: truncate d0/d13/f2a 8290843 0 2024-04-12T13:42:07.715 INFO:tasks.workunit.client.0.smithi060.stdout:7/467: dwrite d0/d1b/f53 [0,4194304] 0 2024-04-12T13:42:07.716 INFO:tasks.workunit.client.0.smithi060.stdout:3/538: dwrite d7/d17/d19/f74 [0,4194304] 0 2024-04-12T13:42:07.719 INFO:tasks.workunit.client.0.smithi060.stdout:9/450: truncate d4/f6f 4577484 0 2024-04-12T13:42:07.724 INFO:tasks.workunit.client.1.smithi110.stdout:7/543: link d1/d3/d4/f27 d1/d1b/d94/fb9 0 2024-04-12T13:42:07.732 INFO:tasks.workunit.client.1.smithi110.stdout:0/472: mknod d1/d5e/c98 0 2024-04-12T13:42:07.735 INFO:tasks.workunit.client.1.smithi110.stdout:0/473: write d1/d3c/f5f [497488,50126] 0 2024-04-12T13:42:07.742 INFO:tasks.workunit.client.0.smithi060.stdout:5/523: dwrite d6/dd/d27/f44 [0,4194304] 0 2024-04-12T13:42:07.744 INFO:tasks.workunit.client.0.smithi060.stdout:4/506: creat d6/d7/dd/d1a/d57/d63/fb2 x:0 0 0 2024-04-12T13:42:07.744 INFO:tasks.workunit.client.0.smithi060.stdout:5/524: chown d6/dd/f8a 48024827 1 2024-04-12T13:42:07.749 INFO:tasks.workunit.client.1.smithi110.stdout:5/507: rename da/d35/d71 to da/d2e/d45/d25/d9d/d7a/db5 0 2024-04-12T13:42:07.755 INFO:tasks.workunit.client.1.smithi110.stdout:2/579: rmdir d6/d18/da2/dab 0 2024-04-12T13:42:07.757 INFO:tasks.workunit.client.1.smithi110.stdout:4/654: rmdir d0/de/d32 39 2024-04-12T13:42:07.758 INFO:tasks.workunit.client.1.smithi110.stdout:7/544: symlink d1/d31/d7b/lba 0 2024-04-12T13:42:07.759 INFO:tasks.workunit.client.0.smithi060.stdout:9/451: write d4/d33/d50/f6c [4251531,63319] 0 2024-04-12T13:42:07.759 INFO:tasks.workunit.client.0.smithi060.stdout:1/617: truncate d1e/d23/f89 1155102 0 2024-04-12T13:42:07.761 INFO:tasks.workunit.client.0.smithi060.stdout:3/539: rmdir d7/da/d3f 39 2024-04-12T13:42:07.764 INFO:tasks.workunit.client.1.smithi110.stdout:1/510: getdents de/d14/d34/d87/d9c 0 2024-04-12T13:42:07.765 INFO:tasks.workunit.client.0.smithi060.stdout:6/601: getdents d1/d7/da/dc/d24/d2d/db0/dc3 0 2024-04-12T13:42:07.766 INFO:tasks.workunit.client.1.smithi110.stdout:1/511: read de/d15/d32/d61/d6a/d72/fa7 [1710137,67506] 0 2024-04-12T13:42:07.767 INFO:tasks.workunit.client.1.smithi110.stdout:1/512: write de/d15/d32/f39 [1057275,54176] 0 2024-04-12T13:42:07.768 INFO:tasks.workunit.client.1.smithi110.stdout:9/623: symlink df/d13/d2c/d2d/dc1/d9f/dc6/lcd 0 2024-04-12T13:42:07.769 INFO:tasks.workunit.client.0.smithi060.stdout:2/512: sync 2024-04-12T13:42:07.769 INFO:tasks.workunit.client.0.smithi060.stdout:8/475: sync 2024-04-12T13:42:07.770 INFO:tasks.workunit.client.0.smithi060.stdout:5/525: fdatasync d6/dd/d1f/d32/d46/f82 0 2024-04-12T13:42:07.771 INFO:tasks.workunit.client.1.smithi110.stdout:9/624: chown df/d13/d2c/d2d/dc1/d83/d63/db4/fbf 4205 1 2024-04-12T13:42:07.776 INFO:tasks.workunit.client.1.smithi110.stdout:5/508: chown da/db/d52/l5f 26 1 2024-04-12T13:42:07.777 INFO:tasks.workunit.client.0.smithi060.stdout:2/513: chown d6/d10/d2b/d60/l69 280 1 2024-04-12T13:42:07.783 INFO:tasks.workunit.client.0.smithi060.stdout:0/488: dwrite d7/fd [0,4194304] 0 2024-04-12T13:42:07.784 INFO:tasks.workunit.client.0.smithi060.stdout:9/452: dwrite d4/d33/d50/f6c [0,4194304] 0 2024-04-12T13:42:07.786 INFO:tasks.workunit.client.1.smithi110.stdout:8/535: dwrite d1/d3/d35/d3a/d3e/d4f/f5e [0,4194304] 0 2024-04-12T13:42:07.786 INFO:tasks.workunit.client.1.smithi110.stdout:7/545: unlink d1/d3/d43/f53 0 2024-04-12T13:42:07.789 INFO:tasks.workunit.client.0.smithi060.stdout:6/602: rmdir d1/d7/da/dc/d24/d8b 39 2024-04-12T13:42:07.790 INFO:tasks.workunit.client.1.smithi110.stdout:7/546: write d1/d3/d4/d36/da1/f92 [392271,25033] 0 2024-04-12T13:42:07.792 INFO:tasks.workunit.client.0.smithi060.stdout:1/618: dwrite d1e/d23/d2e/f39 [0,4194304] 0 2024-04-12T13:42:07.792 INFO:tasks.workunit.client.0.smithi060.stdout:5/526: unlink d6/d10/f2c 0 2024-04-12T13:42:07.793 INFO:tasks.workunit.client.0.smithi060.stdout:6/603: chown d1/d7/da/dc/d24/d34/d51/fcd 6867835 1 2024-04-12T13:42:07.796 INFO:tasks.workunit.client.1.smithi110.stdout:3/540: getdents d5/dc/d31/d3b/d32/d3e 0 2024-04-12T13:42:07.796 INFO:tasks.workunit.client.1.smithi110.stdout:7/547: readlink d1/d3/d4/d55/d56/l9c 0 2024-04-12T13:42:07.799 INFO:tasks.workunit.client.0.smithi060.stdout:6/604: dread - d1/d7/da/dc/f74 zero size 2024-04-12T13:42:07.800 INFO:tasks.workunit.client.1.smithi110.stdout:0/474: mknod d1/d3c/d6b/d90/c99 0 2024-04-12T13:42:07.800 INFO:tasks.workunit.client.0.smithi060.stdout:2/514: rename d6/d10/d2b/l40 to d6/d10/d4b/l9d 0 2024-04-12T13:42:07.801 INFO:tasks.workunit.client.1.smithi110.stdout:5/509: fdatasync da/d35/f75 0 2024-04-12T13:42:07.803 INFO:tasks.workunit.client.0.smithi060.stdout:3/540: mkdir d7/d17/d27/d36/d53/da2/dbc 0 2024-04-12T13:42:07.804 INFO:tasks.workunit.client.1.smithi110.stdout:6/540: dwrite d7/d10/d1c/d2b/d48/f70 [0,4194304] 0 2024-04-12T13:42:07.806 INFO:tasks.workunit.client.0.smithi060.stdout:2/515: chown d6/d13/d17/c20 4787076 1 2024-04-12T13:42:07.806 INFO:tasks.workunit.client.1.smithi110.stdout:4/655: mknod d0/de/cda 0 2024-04-12T13:42:07.807 INFO:tasks.workunit.client.0.smithi060.stdout:9/453: symlink d4/d8/d7c/l93 0 2024-04-12T13:42:07.812 INFO:tasks.workunit.client.0.smithi060.stdout:7/468: getdents d0 0 2024-04-12T13:42:07.813 INFO:tasks.workunit.client.1.smithi110.stdout:8/536: mknod d1/d3/d3c/d75/d79/caa 0 2024-04-12T13:42:07.815 INFO:tasks.workunit.client.1.smithi110.stdout:1/513: getdents de/d14/d34/d87/d9c 0 2024-04-12T13:42:07.820 INFO:tasks.workunit.client.1.smithi110.stdout:7/548: fdatasync d1/d3/f20 0 2024-04-12T13:42:07.822 INFO:tasks.workunit.client.0.smithi060.stdout:4/507: getdents d6/d7/dd/d1a/d57/d63 0 2024-04-12T13:42:07.822 INFO:tasks.workunit.client.1.smithi110.stdout:1/514: write de/d14/d34/d55/f5c [2528954,7180] 0 2024-04-12T13:42:07.823 INFO:tasks.workunit.client.0.smithi060.stdout:6/605: mknod d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/cd9 0 2024-04-12T13:42:07.830 INFO:tasks.workunit.client.1.smithi110.stdout:9/625: dwrite df/d38/f88 [0,4194304] 0 2024-04-12T13:42:07.831 INFO:tasks.workunit.client.0.smithi060.stdout:9/454: rmdir d4/d8/d7c 39 2024-04-12T13:42:07.831 INFO:tasks.workunit.client.1.smithi110.stdout:6/541: dread d7/d25/d30/d44/f2d [0,4194304] 0 2024-04-12T13:42:07.835 INFO:tasks.workunit.client.0.smithi060.stdout:1/619: mknod d1e/d29/d6d/cd6 0 2024-04-12T13:42:07.835 INFO:tasks.workunit.client.0.smithi060.stdout:1/620: stat lc 0 2024-04-12T13:42:07.841 INFO:tasks.workunit.client.0.smithi060.stdout:0/489: truncate d7/d9/d14/d35/d44/f77 3692305 0 2024-04-12T13:42:07.842 INFO:tasks.workunit.client.0.smithi060.stdout:8/476: rmdir d9/d1b/d3c/d8c 0 2024-04-12T13:42:07.842 INFO:tasks.workunit.client.0.smithi060.stdout:2/516: write d6/d13/d31/d33/d3d/f28 [230096,49757] 0 2024-04-12T13:42:07.844 INFO:tasks.workunit.client.0.smithi060.stdout:0/490: stat d7/f87 0 2024-04-12T13:42:07.845 INFO:tasks.workunit.client.0.smithi060.stdout:4/508: symlink d6/d7/dd/d1a/d19/d7a/lb3 0 2024-04-12T13:42:07.845 INFO:tasks.workunit.client.0.smithi060.stdout:6/606: rmdir d1/d7/da/dc/d24/d34 39 2024-04-12T13:42:07.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/509: chown d6/d21/d29 27 1 2024-04-12T13:42:07.847 INFO:tasks.workunit.client.0.smithi060.stdout:3/541: symlink d7/d17/d27/d36/d53/da2/dbc/lbd 0 2024-04-12T13:42:07.851 INFO:tasks.workunit.client.0.smithi060.stdout:7/469: creat d0/d7/d43/d63/f9f x:0 0 0 2024-04-12T13:42:07.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/527: creat d6/d10/d12/fa9 x:0 0 0 2024-04-12T13:42:07.857 INFO:tasks.workunit.client.0.smithi060.stdout:8/477: mkdir d9/d1b/d84/da1 0 2024-04-12T13:42:07.860 INFO:tasks.workunit.client.0.smithi060.stdout:8/478: chown d9/d1b/d37/d4d/l7a 0 1 2024-04-12T13:42:07.860 INFO:tasks.workunit.client.1.smithi110.stdout:8/537: mkdir d1/d3/d3c/d5a/dab 0 2024-04-12T13:42:07.864 INFO:tasks.workunit.client.1.smithi110.stdout:7/549: fsync d1/d3/d4/f27 0 2024-04-12T13:42:07.865 INFO:tasks.workunit.client.0.smithi060.stdout:1/621: getdents d1e/d23/d2e/d8e/d98/dae 0 2024-04-12T13:42:07.865 INFO:tasks.workunit.client.1.smithi110.stdout:2/580: getdents d6/dc/dd/d49/d64/d4a/d51 0 2024-04-12T13:42:07.867 INFO:tasks.workunit.client.0.smithi060.stdout:6/607: dwrite d1/d7/da/fc4 [0,4194304] 0 2024-04-12T13:42:07.867 INFO:tasks.workunit.client.1.smithi110.stdout:7/550: write d1/d1b/d94/fac [434499,101409] 0 2024-04-12T13:42:07.868 INFO:tasks.workunit.client.0.smithi060.stdout:8/479: truncate d9/d1b/d84/da0/f24 8801249 0 2024-04-12T13:42:07.869 INFO:tasks.workunit.client.1.smithi110.stdout:1/515: fdatasync de/d15/f76 0 2024-04-12T13:42:07.877 INFO:tasks.workunit.client.1.smithi110.stdout:4/656: fsync d0/d13/f2a 0 2024-04-12T13:42:07.880 INFO:tasks.workunit.client.1.smithi110.stdout:5/510: mkdir da/db/d3b/d40/d97/db6 0 2024-04-12T13:42:07.882 INFO:tasks.workunit.client.0.smithi060.stdout:2/517: dread d6/d10/d16/f1c [0,4194304] 0 2024-04-12T13:42:07.882 INFO:tasks.workunit.client.0.smithi060.stdout:3/542: unlink d7/da/d3f/fa6 0 2024-04-12T13:42:07.883 INFO:tasks.workunit.client.1.smithi110.stdout:9/626: fdatasync df/d13/d26/f28 0 2024-04-12T13:42:07.885 INFO:tasks.workunit.client.1.smithi110.stdout:9/627: chown df/d38/fa2 59 1 2024-04-12T13:42:07.885 INFO:tasks.workunit.client.0.smithi060.stdout:1/622: mknod d1e/d23/d2e/d30/cd7 0 2024-04-12T13:42:07.894 INFO:tasks.workunit.client.1.smithi110.stdout:2/581: rmdir d6/dc/d1b/d8f 39 2024-04-12T13:42:07.898 INFO:tasks.workunit.client.0.smithi060.stdout:2/518: rmdir d6/d13/d5b/d6d 39 2024-04-12T13:42:07.899 INFO:tasks.workunit.client.0.smithi060.stdout:3/543: dwrite d7/d17/d19/d33/d63/fa8 [0,4194304] 0 2024-04-12T13:42:07.899 INFO:tasks.workunit.client.1.smithi110.stdout:0/475: link d1/f14 d1/d3c/d6b/d90/f9a 0 2024-04-12T13:42:07.901 INFO:tasks.workunit.client.0.smithi060.stdout:9/455: truncate d4/d9/d19/f63 1566057 0 2024-04-12T13:42:07.902 INFO:tasks.workunit.client.0.smithi060.stdout:1/623: creat d1e/d29/d37/fd8 x:0 0 0 2024-04-12T13:42:07.906 INFO:tasks.workunit.client.1.smithi110.stdout:4/657: dread - d0/d19/d1c/d50/f69 zero size 2024-04-12T13:42:07.908 INFO:tasks.workunit.client.1.smithi110.stdout:4/658: fsync d0/d19/d26/fd6 0 2024-04-12T13:42:07.910 INFO:tasks.workunit.client.1.smithi110.stdout:4/659: chown d0/d75/f79 12143 1 2024-04-12T13:42:07.910 INFO:tasks.workunit.client.1.smithi110.stdout:5/511: rmdir da/d2e/d45/d25/d9d/d79 39 2024-04-12T13:42:07.911 INFO:tasks.workunit.client.1.smithi110.stdout:4/660: readlink d0/d19/d26/l45 0 2024-04-12T13:42:07.911 INFO:tasks.workunit.client.0.smithi060.stdout:4/510: dwrite d6/d7/dd/d1a/f50 [4194304,4194304] 0 2024-04-12T13:42:07.912 INFO:tasks.workunit.client.0.smithi060.stdout:6/608: dwrite d1/d7d/fcc [0,4194304] 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:5/528: rename d6/d10/d12/fa9 to d6/dd/faa 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:0/491: getdents d7/d9/d14/d4a 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:7/470: write d0/d7/f33 [2315560,98616] 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:0/492: truncate d7/f87 1650261 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:7/471: truncate d0/d7/f87 879112 0 2024-04-12T13:42:07.922 INFO:tasks.workunit.client.0.smithi060.stdout:2/519: rmdir d6/d13/d5b 39 2024-04-12T13:42:07.924 INFO:tasks.workunit.client.0.smithi060.stdout:2/520: chown d6/d13/d31 5054481 1 2024-04-12T13:42:07.924 INFO:tasks.workunit.client.1.smithi110.stdout:9/628: mknod df/d13/d2c/d2d/dc1/d83/d63/d72/cce 0 2024-04-12T13:42:07.926 INFO:tasks.workunit.client.0.smithi060.stdout:2/521: chown d6/f14 415265770 1 2024-04-12T13:42:07.938 INFO:tasks.workunit.client.1.smithi110.stdout:3/541: sync 2024-04-12T13:42:07.946 INFO:tasks.workunit.client.1.smithi110.stdout:2/582: mkdir d6/dc/d1b/d57/d62/db4 0 2024-04-12T13:42:07.948 INFO:tasks.workunit.client.1.smithi110.stdout:2/583: chown d6/d18/la6 0 1 2024-04-12T13:42:07.949 INFO:tasks.workunit.client.1.smithi110.stdout:1/516: symlink de/d15/da9/lb0 0 2024-04-12T13:42:07.950 INFO:tasks.workunit.client.0.smithi060.stdout:8/480: link d9/d1b/c3d d9/d1d/ca2 0 2024-04-12T13:42:07.951 INFO:tasks.workunit.client.1.smithi110.stdout:2/584: chown d6/dc/dd/d49/c65 2111 1 2024-04-12T13:42:07.952 INFO:tasks.workunit.client.1.smithi110.stdout:1/517: rename de/d15/d32/d61/d6a to de/d15/d32/d61/d6a/db1 22 2024-04-12T13:42:07.953 INFO:tasks.workunit.client.1.smithi110.stdout:5/512: symlink da/d2e/d45/d25/d9d/d7a/db5/lb7 0 2024-04-12T13:42:07.955 INFO:tasks.workunit.client.1.smithi110.stdout:6/542: rmdir d7/d10/d41/d99 0 2024-04-12T13:42:07.956 INFO:tasks.workunit.client.1.smithi110.stdout:0/476: write d1/d8/d36/d51/f69 [1846166,40799] 0 2024-04-12T13:42:07.956 INFO:tasks.workunit.client.1.smithi110.stdout:3/542: dread d5/f28 [0,4194304] 0 2024-04-12T13:42:07.958 INFO:tasks.workunit.client.0.smithi060.stdout:9/456: dwrite d4/d8/f2c [0,4194304] 0 2024-04-12T13:42:07.959 INFO:tasks.workunit.client.1.smithi110.stdout:8/538: creat d1/d3/d35/d3a/fac x:0 0 0 2024-04-12T13:42:07.959 INFO:tasks.workunit.client.1.smithi110.stdout:7/551: sync 2024-04-12T13:42:07.962 INFO:tasks.workunit.client.0.smithi060.stdout:7/472: mkdir d0/d78/da0 0 2024-04-12T13:42:07.962 INFO:tasks.workunit.client.0.smithi060.stdout:0/493: truncate d7/d9/de/f43 776132 0 2024-04-12T13:42:07.962 INFO:tasks.workunit.client.1.smithi110.stdout:4/661: symlink d0/de/d32/d61/ldb 0 2024-04-12T13:42:07.964 INFO:tasks.workunit.client.0.smithi060.stdout:0/494: truncate d7/d9/d14/d35/f94 797935 0 2024-04-12T13:42:07.973 INFO:tasks.workunit.client.0.smithi060.stdout:8/481: mknod d9/d1b/d3c/d60/ca3 0 2024-04-12T13:42:07.975 INFO:tasks.workunit.client.1.smithi110.stdout:5/513: dwrite da/d2e/d45/d25/d9d/d7a/db5/d89/fb1 [0,4194304] 0 2024-04-12T13:42:07.981 INFO:tasks.workunit.client.1.smithi110.stdout:8/539: dwrite d1/d3/d35/d3a/d41/d77/f78 [0,4194304] 0 2024-04-12T13:42:07.983 INFO:tasks.workunit.client.0.smithi060.stdout:4/511: truncate d6/d7/dd/d1a/d57/fa7 210574 0 2024-04-12T13:42:07.983 INFO:tasks.workunit.client.1.smithi110.stdout:2/585: creat d6/dc/db1/fb5 x:0 0 0 2024-04-12T13:42:07.984 INFO:tasks.workunit.client.1.smithi110.stdout:8/540: stat d1/d5/l8b 0 2024-04-12T13:42:07.987 INFO:tasks.workunit.client.1.smithi110.stdout:3/543: dread d5/dc/d20/d2d/d4f/f58 [0,4194304] 0 2024-04-12T13:42:07.988 INFO:tasks.workunit.client.0.smithi060.stdout:7/473: unlink d0/d7/d43/d85/c98 0 2024-04-12T13:42:07.989 INFO:tasks.workunit.client.1.smithi110.stdout:1/518: truncate de/f58 1178757 0 2024-04-12T13:42:07.990 INFO:tasks.workunit.client.0.smithi060.stdout:3/544: dwrite d7/f10 [0,4194304] 0 2024-04-12T13:42:07.991 INFO:tasks.workunit.client.1.smithi110.stdout:7/552: dread d1/d3/f4c [0,4194304] 0 2024-04-12T13:42:07.992 INFO:tasks.workunit.client.0.smithi060.stdout:0/495: dread d7/d9/de/f91 [0,4194304] 0 2024-04-12T13:42:07.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/522: creat d6/d64/d99/f9e x:0 0 0 2024-04-12T13:42:07.993 INFO:tasks.workunit.client.1.smithi110.stdout:6/543: creat d7/d25/d30/d6b/fad x:0 0 0 2024-04-12T13:42:07.993 INFO:tasks.workunit.client.1.smithi110.stdout:7/553: stat d1/d31/d5d/l8f 0 2024-04-12T13:42:07.995 INFO:tasks.workunit.client.1.smithi110.stdout:6/544: chown d7/d25/ca0 1 1 2024-04-12T13:42:07.996 INFO:tasks.workunit.client.1.smithi110.stdout:7/554: read - d1/d1b/d74/f8b zero size 2024-04-12T13:42:07.996 INFO:tasks.workunit.client.0.smithi060.stdout:0/496: dread - d7/d9/f1e zero size 2024-04-12T13:42:07.997 INFO:tasks.workunit.client.0.smithi060.stdout:8/482: dwrite d9/d1b/d37/d48/f62 [0,4194304] 0 2024-04-12T13:42:08.000 INFO:tasks.workunit.client.1.smithi110.stdout:9/629: fsync df/d13/d3b/d40/d56/fbc 0 2024-04-12T13:42:08.000 INFO:tasks.workunit.client.1.smithi110.stdout:6/545: fdatasync d7/d10/d1c/d2b/d3a/f81 0 2024-04-12T13:42:08.001 INFO:tasks.workunit.client.1.smithi110.stdout:5/514: dread da/db/f8d [0,4194304] 0 2024-04-12T13:42:08.003 INFO:tasks.workunit.client.1.smithi110.stdout:9/630: stat df/d13/d2c/d66 0 2024-04-12T13:42:08.003 INFO:tasks.workunit.client.1.smithi110.stdout:5/515: stat da/db/l10 0 2024-04-12T13:42:08.006 INFO:tasks.workunit.client.0.smithi060.stdout:1/624: rename d1e/d23/d2e/d8e/d98 to d1e/d23/dd9 0 2024-04-12T13:42:08.007 INFO:tasks.workunit.client.1.smithi110.stdout:9/631: write df/d13/d2c/d2d/dc1/f5b [6541460,38073] 0 2024-04-12T13:42:08.009 INFO:tasks.workunit.client.1.smithi110.stdout:0/477: creat d1/d27/d31/d67/f9b x:0 0 0 2024-04-12T13:42:08.015 INFO:tasks.workunit.client.1.smithi110.stdout:8/541: creat d1/d3/d3c/d75/d79/fad x:0 0 0 2024-04-12T13:42:08.018 INFO:tasks.workunit.client.1.smithi110.stdout:3/544: fdatasync d5/f43 0 2024-04-12T13:42:08.021 INFO:tasks.workunit.client.1.smithi110.stdout:1/519: creat de/d15/d32/fb2 x:0 0 0 2024-04-12T13:42:08.024 INFO:tasks.workunit.client.1.smithi110.stdout:2/586: write d6/dc/d1b/f2a [6987729,14794] 0 2024-04-12T13:42:08.026 INFO:tasks.workunit.client.0.smithi060.stdout:0/497: mknod d7/d9/cae 0 2024-04-12T13:42:08.030 INFO:tasks.workunit.client.0.smithi060.stdout:1/625: fsync f14 0 2024-04-12T13:42:08.033 INFO:tasks.workunit.client.0.smithi060.stdout:5/529: getdents d6/d10 0 2024-04-12T13:42:08.033 INFO:tasks.workunit.client.0.smithi060.stdout:1/626: dread - d1e/d29/d37/fd8 zero size 2024-04-12T13:42:08.033 INFO:tasks.workunit.client.0.smithi060.stdout:9/457: dwrite d4/d9/d19/f63 [0,4194304] 0 2024-04-12T13:42:08.033 INFO:tasks.workunit.client.0.smithi060.stdout:5/530: chown d6/dd 439 1 2024-04-12T13:42:08.035 INFO:tasks.workunit.client.0.smithi060.stdout:9/458: dread - d4/d9/d19/f75 zero size 2024-04-12T13:42:08.038 INFO:tasks.workunit.client.0.smithi060.stdout:8/483: write d9/d1b/d3c/d60/d65/f67 [319943,34755] 0 2024-04-12T13:42:08.041 INFO:tasks.workunit.client.0.smithi060.stdout:7/474: fsync d0/d7/f6 0 2024-04-12T13:42:08.041 INFO:tasks.workunit.client.0.smithi060.stdout:8/484: write d9/d1b/d37/f6a [1141587,40372] 0 2024-04-12T13:42:08.043 INFO:tasks.workunit.client.1.smithi110.stdout:0/478: creat d1/d8/d36/d51/f9c x:0 0 0 2024-04-12T13:42:08.044 INFO:tasks.workunit.client.1.smithi110.stdout:0/479: write d1/d3c/f5f [1963729,76447] 0 2024-04-12T13:42:08.046 INFO:tasks.workunit.client.0.smithi060.stdout:3/545: mkdir d7/d17/d27/da7/dbe 0 2024-04-12T13:42:08.047 INFO:tasks.workunit.client.0.smithi060.stdout:2/523: rmdir d6/d13/d5b 39 2024-04-12T13:42:08.048 INFO:tasks.workunit.client.1.smithi110.stdout:1/520: mknod de/d15/cb3 0 2024-04-12T13:42:08.049 INFO:tasks.workunit.client.0.smithi060.stdout:2/524: chown d6/d13/d17/f6f 11244 1 2024-04-12T13:42:08.049 INFO:tasks.workunit.client.1.smithi110.stdout:1/521: fdatasync de/d15/d32/d61/f73 0 2024-04-12T13:42:08.051 INFO:tasks.workunit.client.0.smithi060.stdout:5/531: dread - d6/dd/f45 zero size 2024-04-12T13:42:08.052 INFO:tasks.workunit.client.1.smithi110.stdout:2/587: mknod d6/dc/dd/d49/d64/d5d/cb6 0 2024-04-12T13:42:08.053 INFO:tasks.workunit.client.1.smithi110.stdout:2/588: readlink d6/dc/d1b/l74 0 2024-04-12T13:42:08.057 INFO:tasks.workunit.client.0.smithi060.stdout:4/512: link d6/d21/c3d d6/d7/dd/d1a/d19/d42/d7c/cb4 0 2024-04-12T13:42:08.062 INFO:tasks.workunit.client.1.smithi110.stdout:9/632: dwrite df/d13/d2c/d2d/d39/f91 [0,4194304] 0 2024-04-12T13:42:08.065 INFO:tasks.workunit.client.0.smithi060.stdout:3/546: mknod d7/da/d3f/d5c/d25/d4d/cbf 0 2024-04-12T13:42:08.067 INFO:tasks.workunit.client.1.smithi110.stdout:8/542: truncate d1/d3/d3c/d5a/d6f/d7e/f71 1672921 0 2024-04-12T13:42:08.068 INFO:tasks.workunit.client.1.smithi110.stdout:3/545: creat d5/dc/d20/d2d/d4e/d89/d8c/fb2 x:0 0 0 2024-04-12T13:42:08.070 INFO:tasks.workunit.client.1.smithi110.stdout:7/555: dwrite d1/d1b/d3d/d68/d97/da5/f25 [0,4194304] 0 2024-04-12T13:42:08.071 INFO:tasks.workunit.client.1.smithi110.stdout:8/543: readlink d1/d3/d3c/d5a/d6f/l95 0 2024-04-12T13:42:08.072 INFO:tasks.workunit.client.1.smithi110.stdout:4/662: link d0/de/d2c/d57/la5 d0/d19/ldc 0 2024-04-12T13:42:08.075 INFO:tasks.workunit.client.0.smithi060.stdout:8/485: dwrite d9/d1b/d3c/d6e/d7b/f9e [0,4194304] 0 2024-04-12T13:42:08.075 INFO:tasks.workunit.client.1.smithi110.stdout:2/589: creat d6/dc/d9d/fb7 x:0 0 0 2024-04-12T13:42:08.075 INFO:tasks.workunit.client.1.smithi110.stdout:1/522: chown de/d14/d34/d55/d6b/f6f 3870 1 2024-04-12T13:42:08.078 INFO:tasks.workunit.client.1.smithi110.stdout:6/546: link d7/d25/d30/f9b d7/d10/d1c/d2b/d48/fae 0 2024-04-12T13:42:08.087 INFO:tasks.workunit.client.1.smithi110.stdout:0/480: dwrite d1/d27/d31/f50 [0,4194304] 0 2024-04-12T13:42:08.093 INFO:tasks.workunit.client.1.smithi110.stdout:3/546: fdatasync d5/dc/d31/d3b/d32/d3e/d98/f9e 0 2024-04-12T13:42:08.094 INFO:tasks.workunit.client.0.smithi060.stdout:8/486: dwrite d9/d1b/d37/d4d/d63/f85 [0,4194304] 0 2024-04-12T13:42:08.098 INFO:tasks.workunit.client.1.smithi110.stdout:4/663: symlink d0/d75/d84/d89/ldd 0 2024-04-12T13:42:08.101 INFO:tasks.workunit.client.1.smithi110.stdout:7/556: creat d1/d1b/d74/fbb x:0 0 0 2024-04-12T13:42:08.103 INFO:tasks.workunit.client.1.smithi110.stdout:7/557: read d1/d3/f4c [620486,66287] 0 2024-04-12T13:42:08.104 INFO:tasks.workunit.client.1.smithi110.stdout:4/664: write d0/d75/d84/d89/fba [684155,36123] 0 2024-04-12T13:42:08.106 INFO:tasks.workunit.client.1.smithi110.stdout:7/558: fdatasync d1/d1b/d3d/d68/f8e 0 2024-04-12T13:42:08.106 INFO:tasks.workunit.client.1.smithi110.stdout:1/523: mkdir de/d14/d34/db4 0 2024-04-12T13:42:08.110 INFO:tasks.workunit.client.1.smithi110.stdout:2/590: write d6/dc/dd/d49/d64/d25/f6d [4047381,21240] 0 2024-04-12T13:42:08.111 INFO:tasks.workunit.client.1.smithi110.stdout:2/591: stat d6/dc/dd/d49/f8a 0 2024-04-12T13:42:08.112 INFO:tasks.workunit.client.1.smithi110.stdout:5/516: rename da/d2e/d45/d25/d9d/d79/d82/f85 to da/db/d15/fb8 0 2024-04-12T13:42:08.114 INFO:tasks.workunit.client.1.smithi110.stdout:5/517: chown da/d35/f4e 4 1 2024-04-12T13:42:08.117 INFO:tasks.workunit.client.1.smithi110.stdout:9/633: mkdir df/d13/d26/d37/d49/dcf 0 2024-04-12T13:42:08.124 INFO:tasks.workunit.client.1.smithi110.stdout:8/544: dwrite d1/d7/f3f [0,4194304] 0 2024-04-12T13:42:08.128 INFO:tasks.workunit.client.1.smithi110.stdout:2/592: dwrite d6/dc/d1b/d57/f63 [0,4194304] 0 2024-04-12T13:42:08.128 INFO:tasks.workunit.client.1.smithi110.stdout:8/545: write d1/d3/d35/d3a/d41/f53 [4940122,73078] 0 2024-04-12T13:42:08.130 INFO:tasks.workunit.client.0.smithi060.stdout:9/459: symlink d4/d8/d7c/l94 0 2024-04-12T13:42:08.132 INFO:tasks.workunit.client.1.smithi110.stdout:8/546: dread - d1/d5/dd/fa0 zero size 2024-04-12T13:42:08.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/460: fdatasync d4/d9/d19/f4e 0 2024-04-12T13:42:08.135 INFO:tasks.workunit.client.0.smithi060.stdout:4/513: creat d6/d7/dd/d1a/d57/d63/fb5 x:0 0 0 2024-04-12T13:42:08.135 INFO:tasks.workunit.client.1.smithi110.stdout:4/665: fdatasync d0/d78/fd2 0 2024-04-12T13:42:08.136 INFO:tasks.workunit.client.1.smithi110.stdout:7/559: rmdir d1/d3 39 2024-04-12T13:42:08.137 INFO:tasks.workunit.client.0.smithi060.stdout:7/475: mkdir d0/d3d/d74/d9b/da1 0 2024-04-12T13:42:08.137 INFO:tasks.workunit.client.1.smithi110.stdout:1/524: creat de/d15/d32/d61/d6a/d8b/fb5 x:0 0 0 2024-04-12T13:42:08.138 INFO:tasks.workunit.client.0.smithi060.stdout:7/476: readlink d0/d7/d43/d63/l66 0 2024-04-12T13:42:08.139 INFO:tasks.workunit.client.1.smithi110.stdout:4/666: read d0/d19/d1c/f60 [2214867,30210] 0 2024-04-12T13:42:08.141 INFO:tasks.workunit.client.1.smithi110.stdout:6/547: mknod d7/d25/d2c/d4c/da6/caf 0 2024-04-12T13:42:08.141 INFO:tasks.workunit.client.1.smithi110.stdout:9/634: dwrite df/d13/d2c/d2d/dc1/d83/f7d [0,4194304] 0 2024-04-12T13:42:08.142 INFO:tasks.workunit.client.0.smithi060.stdout:3/547: readlink d7/d17/l9c 0 2024-04-12T13:42:08.157 INFO:tasks.workunit.client.0.smithi060.stdout:7/477: dwrite d0/d78/f8d [0,4194304] 0 2024-04-12T13:42:08.159 INFO:tasks.workunit.client.0.smithi060.stdout:9/461: symlink d4/d9/d19/d21/l95 0 2024-04-12T13:42:08.161 INFO:tasks.workunit.client.1.smithi110.stdout:2/593: symlink d6/d18/da2/lb8 0 2024-04-12T13:42:08.161 INFO:tasks.workunit.client.1.smithi110.stdout:6/548: dwrite d7/d25/d30/d44/d3d/f5b [0,4194304] 0 2024-04-12T13:42:08.165 INFO:tasks.workunit.client.1.smithi110.stdout:0/481: write d1/d8/f2e [3371382,68235] 0 2024-04-12T13:42:08.165 INFO:tasks.workunit.client.1.smithi110.stdout:8/547: creat d1/d3/d3c/d5a/d6f/d83/fae x:0 0 0 2024-04-12T13:42:08.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/525: write d6/d56/f51 [840928,16174] 0 2024-04-12T13:42:08.169 INFO:tasks.workunit.client.0.smithi060.stdout:3/548: fdatasync d7/da/d3f/f78 0 2024-04-12T13:42:08.169 INFO:tasks.workunit.client.0.smithi060.stdout:0/498: creat d7/d9/de/d7c/da0/faf x:0 0 0 2024-04-12T13:42:08.170 INFO:tasks.workunit.client.0.smithi060.stdout:1/627: getdents d1e/dcc 0 2024-04-12T13:42:08.170 INFO:tasks.workunit.client.1.smithi110.stdout:2/594: readlink d6/dc/dd/d49/d64/d4a/d3c/d6e/la3 0 2024-04-12T13:42:08.170 INFO:tasks.workunit.client.1.smithi110.stdout:0/482: truncate d1/d27/d31/d67/f9b 279625 0 2024-04-12T13:42:08.172 INFO:tasks.workunit.client.0.smithi060.stdout:8/487: write d9/d1b/d2b/f5c [1025860,13784] 0 2024-04-12T13:42:08.173 INFO:tasks.workunit.client.1.smithi110.stdout:3/547: write d5/dc/d31/d3b/f59 [4003646,68913] 0 2024-04-12T13:42:08.178 INFO:tasks.workunit.client.1.smithi110.stdout:1/525: dread de/d14/d34/f40 [0,4194304] 0 2024-04-12T13:42:08.179 INFO:tasks.workunit.client.0.smithi060.stdout:9/462: mknod d4/d8/d32/c96 0 2024-04-12T13:42:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:07 smithi060 ceph-mon[29097]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 177 MiB/s wr, 324 op/s 2024-04-12T13:42:08.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/478: chown d0/d7/f5e 75724 1 2024-04-12T13:42:08.182 INFO:tasks.workunit.client.1.smithi110.stdout:4/667: dread d0/d19/f74 [0,4194304] 0 2024-04-12T13:42:08.183 INFO:tasks.workunit.client.0.smithi060.stdout:7/479: chown d0/d7/d43/d4d 2056265 1 2024-04-12T13:42:08.188 INFO:tasks.workunit.client.0.smithi060.stdout:3/549: rmdir d7/d17/d19/d96 39 2024-04-12T13:42:08.188 INFO:tasks.workunit.client.0.smithi060.stdout:0/499: fsync d7/d9/d14/d35/d44/d7d/fac 0 2024-04-12T13:42:08.188 INFO:tasks.workunit.client.0.smithi060.stdout:2/526: mknod d6/d10/d2b/d35/c9f 0 2024-04-12T13:42:08.189 INFO:tasks.workunit.client.0.smithi060.stdout:0/500: readlink d7/lc 0 2024-04-12T13:42:08.190 INFO:tasks.workunit.client.1.smithi110.stdout:6/549: dwrite d7/d25/d2c/d4c/d77/d93/f95 [0,4194304] 0 2024-04-12T13:42:08.192 INFO:tasks.workunit.client.0.smithi060.stdout:8/488: rename d9/d1b/d3c/d60/d79 to d9/d1b/d3c/d60/da4 0 2024-04-12T13:42:08.195 INFO:tasks.workunit.client.0.smithi060.stdout:1/628: dwrite d1e/d23/dd9/fc6 [0,4194304] 0 2024-04-12T13:42:08.196 INFO:tasks.workunit.client.1.smithi110.stdout:2/595: mkdir d6/dc/dd/d49/d64/d5d/db9 0 2024-04-12T13:42:08.198 INFO:tasks.workunit.client.1.smithi110.stdout:7/560: truncate d1/d3/f4c 1542568 0 2024-04-12T13:42:08.202 INFO:tasks.workunit.client.1.smithi110.stdout:1/526: stat de/f5b 0 2024-04-12T13:42:08.205 INFO:tasks.workunit.client.1.smithi110.stdout:1/527: write de/d14/f53 [95764,30892] 0 2024-04-12T13:42:08.206 INFO:tasks.workunit.client.1.smithi110.stdout:5/518: rmdir da/d2e/d45/d29/d32/da9 0 2024-04-12T13:42:08.208 INFO:tasks.workunit.client.1.smithi110.stdout:1/528: write de/d15/d32/d61/d96/fa2 [850814,33003] 0 2024-04-12T13:42:08.209 INFO:tasks.workunit.client.0.smithi060.stdout:2/527: rename d6/d13/d17 to d6/d56/d58/da0 0 2024-04-12T13:42:08.210 INFO:tasks.workunit.client.1.smithi110.stdout:4/668: creat d0/de/da0/fde x:0 0 0 2024-04-12T13:42:08.210 INFO:tasks.workunit.client.0.smithi060.stdout:7/480: dwrite d0/d3d/d74/f7e [0,4194304] 0 2024-04-12T13:42:08.211 INFO:tasks.workunit.client.1.smithi110.stdout:0/483: dread d1/d27/d31/f49 [0,4194304] 0 2024-04-12T13:42:08.211 INFO:tasks.workunit.client.0.smithi060.stdout:3/550: mkdir d7/d17/d19/d33/d63/d9b/dc0 0 2024-04-12T13:42:08.212 INFO:tasks.workunit.client.1.smithi110.stdout:4/669: chown d0/d75/d91/fb7 33 1 2024-04-12T13:42:08.215 INFO:tasks.workunit.client.1.smithi110.stdout:2/596: unlink d6/dc/dd/d49/c67 0 2024-04-12T13:42:08.216 INFO:tasks.workunit.client.0.smithi060.stdout:9/463: rename d4/d9/f3f to d4/d9/f97 0 2024-04-12T13:42:08.218 INFO:tasks.workunit.client.1.smithi110.stdout:9/635: rmdir df/d13/d2c/d2d/dc1/d83/d5d/db1 0 2024-04-12T13:42:08.219 INFO:tasks.workunit.client.0.smithi060.stdout:4/514: dwrite d6/d7/dd/d1a/d19/f52 [0,4194304] 0 2024-04-12T13:42:08.219 INFO:tasks.workunit.client.0.smithi060.stdout:3/551: dread d7/da/faf [0,4194304] 0 2024-04-12T13:42:08.220 INFO:tasks.workunit.client.0.smithi060.stdout:1/629: rename f2 to d1e/d23/d2e/d30/fda 0 2024-04-12T13:42:08.223 INFO:tasks.workunit.client.0.smithi060.stdout:3/552: chown d7/f10 220 1 2024-04-12T13:42:08.224 INFO:tasks.workunit.client.1.smithi110.stdout:8/548: dread d1/d3/d3c/d5a/d6f/d7e/f47 [0,4194304] 0 2024-04-12T13:42:08.224 INFO:tasks.workunit.client.1.smithi110.stdout:1/529: dwrite de/d14/d34/d55/f63 [4194304,4194304] 0 2024-04-12T13:42:08.225 INFO:tasks.workunit.client.1.smithi110.stdout:0/484: symlink d1/d56/l9d 0 2024-04-12T13:42:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:07 smithi110 ceph-mon[36055]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 177 MiB/s wr, 324 op/s 2024-04-12T13:42:08.228 INFO:tasks.workunit.client.1.smithi110.stdout:0/485: readlink d1/d8/d36/d63/d4a/l79 0 2024-04-12T13:42:08.233 INFO:tasks.workunit.client.0.smithi060.stdout:3/553: write d7/f9f [59215,77868] 0 2024-04-12T13:42:08.238 INFO:tasks.workunit.client.0.smithi060.stdout:1/630: mkdir d1e/d23/d2e/d86/ddb 0 2024-04-12T13:42:08.241 INFO:tasks.workunit.client.1.smithi110.stdout:7/561: symlink d1/d1b/d94/db6/lbc 0 2024-04-12T13:42:08.243 INFO:tasks.workunit.client.1.smithi110.stdout:9/636: dread - df/d13/d2c/f53 zero size 2024-04-12T13:42:08.247 INFO:tasks.workunit.client.1.smithi110.stdout:3/548: rename d5/l10 to d5/dc/d31/d3b/lb3 0 2024-04-12T13:42:08.247 INFO:tasks.workunit.client.1.smithi110.stdout:9/637: stat df/d13/d2c/d2d/d39/c5a 0 2024-04-12T13:42:08.249 INFO:tasks.workunit.client.1.smithi110.stdout:0/486: dwrite d1/f6a [4194304,4194304] 0 2024-04-12T13:42:08.251 INFO:tasks.workunit.client.0.smithi060.stdout:7/481: rename d0/d7/f39 to d0/d1b/fa2 0 2024-04-12T13:42:08.253 INFO:tasks.workunit.client.1.smithi110.stdout:5/519: symlink da/db/d3b/d40/d97/db6/lb9 0 2024-04-12T13:42:08.259 INFO:tasks.workunit.client.0.smithi060.stdout:4/515: dwrite d6/d7/dd/d1a/d19/d42/d7c/f9a [0,4194304] 0 2024-04-12T13:42:08.259 INFO:tasks.workunit.client.0.smithi060.stdout:2/528: dwrite d6/d56/d55/f88 [0,4194304] 0 2024-04-12T13:42:08.260 INFO:tasks.workunit.client.0.smithi060.stdout:9/464: dwrite d4/d9/d19/d21/d73/d67/f2b [0,4194304] 0 2024-04-12T13:42:08.263 INFO:tasks.workunit.client.1.smithi110.stdout:1/530: dread de/d14/d34/d55/f5c [0,4194304] 0 2024-04-12T13:42:08.265 INFO:tasks.workunit.client.1.smithi110.stdout:4/670: mkdir d0/de/da0/dd9/ddf 0 2024-04-12T13:42:08.268 INFO:tasks.workunit.client.1.smithi110.stdout:7/562: mknod d1/d1b/d3d/d68/d97/da5/cbd 0 2024-04-12T13:42:08.268 INFO:tasks.workunit.client.1.smithi110.stdout:2/597: dwrite d6/dc/d1b/d8f/faa [0,4194304] 0 2024-04-12T13:42:08.268 INFO:tasks.workunit.client.0.smithi060.stdout:0/501: write d7/d9/d14/f34 [2056899,20565] 0 2024-04-12T13:42:08.271 INFO:tasks.workunit.client.0.smithi060.stdout:9/465: chown d4/d33/d50/f61 122654 1 2024-04-12T13:42:08.271 INFO:tasks.workunit.client.0.smithi060.stdout:8/489: write f2 [1259101,65737] 0 2024-04-12T13:42:08.272 INFO:tasks.workunit.client.1.smithi110.stdout:1/531: truncate de/f4d 4922956 0 2024-04-12T13:42:08.272 INFO:tasks.workunit.client.0.smithi060.stdout:7/482: truncate d0/f47 432280 0 2024-04-12T13:42:08.272 INFO:tasks.workunit.client.1.smithi110.stdout:4/671: write d0/de/d32/f7d [1105179,60532] 0 2024-04-12T13:42:08.277 INFO:tasks.workunit.client.1.smithi110.stdout:4/672: fdatasync d0/d19/d26/d65/fb3 0 2024-04-12T13:42:08.277 INFO:tasks.workunit.client.1.smithi110.stdout:0/487: dwrite d1/d27/d31/f52 [0,4194304] 0 2024-04-12T13:42:08.286 INFO:tasks.workunit.client.0.smithi060.stdout:3/554: dread d7/d17/d19/d33/f77 [0,4194304] 0 2024-04-12T13:42:08.288 INFO:tasks.workunit.client.0.smithi060.stdout:2/529: mknod d6/d10/d16/ca1 0 2024-04-12T13:42:08.295 INFO:tasks.workunit.client.0.smithi060.stdout:8/490: dwrite d9/d1d/d5e/f61 [0,4194304] 0 2024-04-12T13:42:08.296 INFO:tasks.workunit.client.1.smithi110.stdout:9/638: creat df/d13/d3b/fd0 x:0 0 0 2024-04-12T13:42:08.296 INFO:tasks.workunit.client.1.smithi110.stdout:5/520: dread da/d35/f4e [0,4194304] 0 2024-04-12T13:42:08.299 INFO:tasks.workunit.client.1.smithi110.stdout:9/639: fsync df/d13/d26/d37/d49/f55 0 2024-04-12T13:42:08.300 INFO:tasks.workunit.client.1.smithi110.stdout:5/521: truncate da/d2e/d45/d29/d58/f6d 1666268 0 2024-04-12T13:42:08.301 INFO:tasks.workunit.client.0.smithi060.stdout:0/502: symlink d7/d9/d14/d35/d44/d7d/lb0 0 2024-04-12T13:42:08.306 INFO:tasks.workunit.client.1.smithi110.stdout:5/522: truncate da/d2e/d45/d29/d66/f70 2072993 0 2024-04-12T13:42:08.307 INFO:tasks.workunit.client.1.smithi110.stdout:6/550: truncate d7/d25/d30/d44/d3d/f5b 397955 0 2024-04-12T13:42:08.310 INFO:tasks.workunit.client.1.smithi110.stdout:6/551: chown d7/d25/d30/d44/f61 14767754 1 2024-04-12T13:42:08.312 INFO:tasks.workunit.client.0.smithi060.stdout:6/609: sync 2024-04-12T13:42:08.312 INFO:tasks.workunit.client.0.smithi060.stdout:5/532: sync 2024-04-12T13:42:08.318 INFO:tasks.workunit.client.0.smithi060.stdout:6/610: write d1/d7/da/dc/d24/f96 [12255,6082] 0 2024-04-12T13:42:08.320 INFO:tasks.workunit.client.1.smithi110.stdout:1/532: creat de/d14/d83/fb6 x:0 0 0 2024-04-12T13:42:08.324 INFO:tasks.workunit.client.1.smithi110.stdout:4/673: unlink d0/d19/d1c/d50/l7b 0 2024-04-12T13:42:08.324 INFO:tasks.workunit.client.0.smithi060.stdout:2/530: creat d6/d10/d2b/d60/fa2 x:0 0 0 2024-04-12T13:42:08.325 INFO:tasks.workunit.client.0.smithi060.stdout:3/555: dread d7/d17/d19/f48 [0,4194304] 0 2024-04-12T13:42:08.325 INFO:tasks.workunit.client.0.smithi060.stdout:0/503: dwrite d7/d9/d14/f34 [0,4194304] 0 2024-04-12T13:42:08.329 INFO:tasks.workunit.client.1.smithi110.stdout:0/488: truncate d1/d27/d31/f64 827999 0 2024-04-12T13:42:08.330 INFO:tasks.workunit.client.0.smithi060.stdout:1/631: link d1e/d29/d65/fa7 d1e/d29/d37/fdc 0 2024-04-12T13:42:08.330 INFO:tasks.workunit.client.1.smithi110.stdout:7/563: dwrite d1/d3/d4/f1c [4194304,4194304] 0 2024-04-12T13:42:08.333 INFO:tasks.workunit.client.0.smithi060.stdout:1/632: dread - d1e/d23/d49/fcf zero size 2024-04-12T13:42:08.334 INFO:tasks.workunit.client.1.smithi110.stdout:7/564: write d1/d3/d43/f85 [3916518,127552] 0 2024-04-12T13:42:08.334 INFO:tasks.workunit.client.0.smithi060.stdout:1/633: readlink d1e/d23/d49/lb7 0 2024-04-12T13:42:08.335 INFO:tasks.workunit.client.0.smithi060.stdout:7/483: symlink d0/d7/la3 0 2024-04-12T13:42:08.335 INFO:tasks.workunit.client.1.smithi110.stdout:9/640: rename df/d13/d26/d37/d49/f55 to df/d13/d2c/d2d/d39/d3a/fd1 0 2024-04-12T13:42:08.336 INFO:tasks.workunit.client.0.smithi060.stdout:1/634: stat d1e/d23/d2e/d5e/d68/d9a/cd0 0 2024-04-12T13:42:08.338 INFO:tasks.workunit.client.1.smithi110.stdout:7/565: fdatasync d1/d1b/d3d/d68/d97/da5/f3b 0 2024-04-12T13:42:08.342 INFO:tasks.workunit.client.1.smithi110.stdout:6/552: symlink d7/d10/d1c/d2b/d48/d54/lb0 0 2024-04-12T13:42:08.345 INFO:tasks.workunit.client.1.smithi110.stdout:3/549: readlink d5/dc/d31/d3b/d5b/l71 0 2024-04-12T13:42:08.346 INFO:tasks.workunit.client.0.smithi060.stdout:3/556: dwrite d7/da/d3f/d5c/f8d [0,4194304] 0 2024-04-12T13:42:08.350 INFO:tasks.workunit.client.1.smithi110.stdout:8/549: sync 2024-04-12T13:42:08.351 INFO:tasks.workunit.client.0.smithi060.stdout:2/531: rename d6/d10/d16/l83 to d6/d56/d43/la3 0 2024-04-12T13:42:08.352 INFO:tasks.workunit.client.1.smithi110.stdout:2/598: dread d6/dc/f14 [0,4194304] 0 2024-04-12T13:42:08.352 INFO:tasks.workunit.client.1.smithi110.stdout:8/550: chown d1/d5/l8b 100689901 1 2024-04-12T13:42:08.354 INFO:tasks.workunit.client.0.smithi060.stdout:2/532: fdatasync d6/d10/d2b/d60/f93 0 2024-04-12T13:42:08.355 INFO:tasks.workunit.client.0.smithi060.stdout:9/466: creat d4/d8/f98 x:0 0 0 2024-04-12T13:42:08.364 INFO:tasks.workunit.client.0.smithi060.stdout:7/484: mkdir d0/d1b/da4 0 2024-04-12T13:42:08.365 INFO:tasks.workunit.client.0.smithi060.stdout:4/516: link d6/d7/db/f8e d6/d2f/d7d/fb6 0 2024-04-12T13:42:08.369 INFO:tasks.workunit.client.0.smithi060.stdout:7/485: truncate d0/d7/d43/d63/f9f 537013 0 2024-04-12T13:42:08.370 INFO:tasks.workunit.client.0.smithi060.stdout:3/557: dwrite d7/d17/d27/f8e [0,4194304] 0 2024-04-12T13:42:08.376 INFO:tasks.workunit.client.1.smithi110.stdout:3/550: truncate d5/dc/f53 5096958 0 2024-04-12T13:42:08.378 INFO:tasks.workunit.client.1.smithi110.stdout:0/489: creat d1/d8/d8a/f9e x:0 0 0 2024-04-12T13:42:08.378 INFO:tasks.workunit.client.1.smithi110.stdout:3/551: chown d5/dc/d31/d3b/d32/d3e/f41 3722 1 2024-04-12T13:42:08.380 INFO:tasks.workunit.client.0.smithi060.stdout:6/611: creat d1/d7/da/d20/da8/fda x:0 0 0 2024-04-12T13:42:08.380 INFO:tasks.workunit.client.0.smithi060.stdout:8/491: dwrite d9/f1f [4194304,4194304] 0 2024-04-12T13:42:08.381 INFO:tasks.workunit.client.0.smithi060.stdout:0/504: symlink d7/d9/d4c/lb1 0 2024-04-12T13:42:08.382 INFO:tasks.workunit.client.1.smithi110.stdout:8/551: mkdir d1/d3/d35/d3a/d3e/d4f/daf 0 2024-04-12T13:42:08.383 INFO:tasks.workunit.client.0.smithi060.stdout:6/612: readlink d1/d7/da/dc/d24/d30/d52/d5e/l76 0 2024-04-12T13:42:08.384 INFO:tasks.workunit.client.0.smithi060.stdout:2/533: unlink d6/f5a 0 2024-04-12T13:42:08.386 INFO:tasks.workunit.client.0.smithi060.stdout:0/505: write d7/d9/d14/d35/d44/d7d/fac [570282,106819] 0 2024-04-12T13:42:08.387 INFO:tasks.workunit.client.0.smithi060.stdout:9/467: creat d4/d8/d32/f99 x:0 0 0 2024-04-12T13:42:08.388 INFO:tasks.workunit.client.1.smithi110.stdout:9/641: mkdir df/d13/d26/d37/d49/dcf/dd2 0 2024-04-12T13:42:08.389 INFO:tasks.workunit.client.0.smithi060.stdout:0/506: dread - d7/d33/d5b/f9f zero size 2024-04-12T13:42:08.391 INFO:tasks.workunit.client.0.smithi060.stdout:1/635: truncate d1e/d29/d65/fa7 66626 0 2024-04-12T13:42:08.394 INFO:tasks.workunit.client.1.smithi110.stdout:4/674: dwrite d0/d75/f9a [0,4194304] 0 2024-04-12T13:42:08.396 INFO:tasks.workunit.client.1.smithi110.stdout:9/642: write df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [53980,24425] 0 2024-04-12T13:42:08.396 INFO:tasks.workunit.client.0.smithi060.stdout:5/533: truncate d6/d10/d12/d38/f40 1990659 0 2024-04-12T13:42:08.398 INFO:tasks.workunit.client.1.smithi110.stdout:1/533: creat de/d1d/fb7 x:0 0 0 2024-04-12T13:42:08.399 INFO:tasks.workunit.client.1.smithi110.stdout:1/534: fdatasync de/d14/d34/f40 0 2024-04-12T13:42:08.402 INFO:tasks.workunit.client.1.smithi110.stdout:0/490: creat d1/d5e/f9f x:0 0 0 2024-04-12T13:42:08.403 INFO:tasks.workunit.client.1.smithi110.stdout:1/535: write de/d15/d32/fb2 [30712,68009] 0 2024-04-12T13:42:08.403 INFO:tasks.workunit.client.0.smithi060.stdout:7/486: unlink d0/d7/d43/f89 0 2024-04-12T13:42:08.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/552: mkdir d5/dc/d20/d2d/d4e/d89/db4 0 2024-04-12T13:42:08.404 INFO:tasks.workunit.client.0.smithi060.stdout:3/558: fdatasync d7/d17/d27/d36/d53/f71 0 2024-04-12T13:42:08.405 INFO:tasks.workunit.client.1.smithi110.stdout:8/552: creat d1/d3/d35/d3a/d41/fb0 x:0 0 0 2024-04-12T13:42:08.406 INFO:tasks.workunit.client.0.smithi060.stdout:2/534: creat d6/d56/d55/fa4 x:0 0 0 2024-04-12T13:42:08.407 INFO:tasks.workunit.client.1.smithi110.stdout:2/599: dread d6/f12 [4194304,4194304] 0 2024-04-12T13:42:08.409 INFO:tasks.workunit.client.0.smithi060.stdout:6/613: chown d1/d7/da/dc/d24/d34/d51/d59/f87 235 1 2024-04-12T13:42:08.409 INFO:tasks.workunit.client.0.smithi060.stdout:9/468: symlink d4/d9/d19/d21/d73/l9a 0 2024-04-12T13:42:08.410 INFO:tasks.workunit.client.1.smithi110.stdout:5/523: getdents da/d2e/d45/d29/d66/d7c 0 2024-04-12T13:42:08.410 INFO:tasks.workunit.client.1.smithi110.stdout:7/566: creat d1/d1b/fbe x:0 0 0 2024-04-12T13:42:08.410 INFO:tasks.workunit.client.1.smithi110.stdout:0/491: truncate d1/d8/d36/d51/f62 84769 0 2024-04-12T13:42:08.411 INFO:tasks.workunit.client.1.smithi110.stdout:5/524: readlink da/db/l1c 0 2024-04-12T13:42:08.411 INFO:tasks.workunit.client.0.smithi060.stdout:9/469: stat d4/d9/d19/d21/f31 0 2024-04-12T13:42:08.412 INFO:tasks.workunit.client.0.smithi060.stdout:6/614: dread - d1/d7/da/dc/d24/d2d/db0/db2/fce zero size 2024-04-12T13:42:08.414 INFO:tasks.workunit.client.0.smithi060.stdout:4/517: mkdir d6/db7 0 2024-04-12T13:42:08.417 INFO:tasks.workunit.client.0.smithi060.stdout:4/518: write d6/d7/dd/d1a/d19/d42/d7c/f9a [2003590,15652] 0 2024-04-12T13:42:08.420 INFO:tasks.workunit.client.0.smithi060.stdout:8/492: dread d9/d1b/d37/d4d/f7e [0,4194304] 0 2024-04-12T13:42:08.421 INFO:tasks.workunit.client.0.smithi060.stdout:6/615: truncate d1/d7/da/dc/d24/d34/d51/d59/f9b 939688 0 2024-04-12T13:42:08.423 INFO:tasks.workunit.client.1.smithi110.stdout:3/553: dread - d5/fa2 zero size 2024-04-12T13:42:08.424 INFO:tasks.workunit.client.0.smithi060.stdout:6/616: write d1/d7/da/dc/f29 [5112230,51247] 0 2024-04-12T13:42:08.424 INFO:tasks.workunit.client.1.smithi110.stdout:0/492: dwrite d1/d27/d31/d67/f9b [0,4194304] 0 2024-04-12T13:42:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:3/559: creat d7/d17/d27/d36/db0/fc1 x:0 0 0 2024-04-12T13:42:08.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/560: fsync d7/d17/d27/d36/f99 0 2024-04-12T13:42:08.433 INFO:tasks.workunit.client.0.smithi060.stdout:0/507: fsync d7/d9/f82 0 2024-04-12T13:42:08.434 INFO:tasks.workunit.client.0.smithi060.stdout:3/561: stat d7/d17/d27/d36/f46 0 2024-04-12T13:42:08.435 INFO:tasks.workunit.client.0.smithi060.stdout:0/508: stat d7/d41/f7f 0 2024-04-12T13:42:08.435 INFO:tasks.workunit.client.0.smithi060.stdout:1/636: symlink d1e/d29/ldd 0 2024-04-12T13:42:08.437 INFO:tasks.workunit.client.0.smithi060.stdout:9/470: mknod d4/d33/d65/c9b 0 2024-04-12T13:42:08.440 INFO:tasks.workunit.client.0.smithi060.stdout:9/471: dread - d4/d33/d50/f85 zero size 2024-04-12T13:42:08.440 INFO:tasks.workunit.client.1.smithi110.stdout:9/643: mkdir df/d13/d2c/d2d/dd3 0 2024-04-12T13:42:08.443 INFO:tasks.workunit.client.1.smithi110.stdout:6/553: getdents d7/d25/d30 0 2024-04-12T13:42:08.443 INFO:tasks.workunit.client.0.smithi060.stdout:9/472: truncate d4/d8/d32/f99 354991 0 2024-04-12T13:42:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:4/519: truncate d6/d7/f3b 1323196 0 2024-04-12T13:42:08.445 INFO:tasks.workunit.client.0.smithi060.stdout:9/473: chown d4/d8/d7c 2031 1 2024-04-12T13:42:08.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/617: dwrite d1/d7/da/dc/d24/d2d/db0/db2/fce [0,4194304] 0 2024-04-12T13:42:08.447 INFO:tasks.workunit.client.1.smithi110.stdout:1/536: mknod de/d15/d32/d61/cb8 0 2024-04-12T13:42:08.450 INFO:tasks.workunit.client.0.smithi060.stdout:8/493: rename d9/d1b/d2b/f45 to d9/d1b/d3c/d6e/fa5 0 2024-04-12T13:42:08.453 INFO:tasks.workunit.client.0.smithi060.stdout:7/487: mkdir d0/d1b/da4/da5 0 2024-04-12T13:42:08.454 INFO:tasks.workunit.client.0.smithi060.stdout:7/488: write d0/d1b/f72 [2686761,117564] 0 2024-04-12T13:42:08.457 INFO:tasks.workunit.client.0.smithi060.stdout:3/562: stat d7/d17/d19/d96/c97 0 2024-04-12T13:42:08.459 INFO:tasks.workunit.client.0.smithi060.stdout:0/509: dread - d7/d9/f92 zero size 2024-04-12T13:42:08.461 INFO:tasks.workunit.client.1.smithi110.stdout:2/600: dwrite d6/dc/f33 [0,4194304] 0 2024-04-12T13:42:08.463 INFO:tasks.workunit.client.1.smithi110.stdout:2/601: dread - d6/dc/d1b/d8f/fa8 zero size 2024-04-12T13:42:08.463 INFO:tasks.workunit.client.0.smithi060.stdout:5/534: link d6/dd/d1f/d32/d46/l4d d6/d89/da3/lab 0 2024-04-12T13:42:08.465 INFO:tasks.workunit.client.0.smithi060.stdout:5/535: chown d6/fa0 0 1 2024-04-12T13:42:08.466 INFO:tasks.workunit.client.0.smithi060.stdout:9/474: rmdir d4/d9/d19/d21/d73 39 2024-04-12T13:42:08.466 INFO:tasks.workunit.client.1.smithi110.stdout:6/554: mknod d7/d25/d2c/d4c/d77/cb1 0 2024-04-12T13:42:08.468 INFO:tasks.workunit.client.0.smithi060.stdout:9/475: dread - d4/d33/d50/f85 zero size 2024-04-12T13:42:08.469 INFO:tasks.workunit.client.1.smithi110.stdout:1/537: write f6 [4529230,130430] 0 2024-04-12T13:42:08.471 INFO:tasks.workunit.client.0.smithi060.stdout:8/494: mknod d9/d1b/d3c/d8d/ca6 0 2024-04-12T13:42:08.472 INFO:tasks.workunit.client.1.smithi110.stdout:0/493: symlink d1/d27/d31/d89/la0 0 2024-04-12T13:42:08.473 INFO:tasks.workunit.client.0.smithi060.stdout:8/495: read d9/d1b/d3c/f77 [845525,4052] 0 2024-04-12T13:42:08.473 INFO:tasks.workunit.client.1.smithi110.stdout:8/553: rmdir d1/d3/d35/d3a/d3e/d4f/daf 0 2024-04-12T13:42:08.475 INFO:tasks.workunit.client.1.smithi110.stdout:4/675: rmdir d0/d75 39 2024-04-12T13:42:08.475 INFO:tasks.workunit.client.1.smithi110.stdout:8/554: write d1/d3/d35/d3a/d84/f92 [883225,86453] 0 2024-04-12T13:42:08.477 INFO:tasks.workunit.client.1.smithi110.stdout:8/555: dread - d1/d3/d3c/d5a/f6d zero size 2024-04-12T13:42:08.478 INFO:tasks.workunit.client.1.smithi110.stdout:7/567: rename d1/d1b/d94 to d1/d3/d4/dbf 0 2024-04-12T13:42:08.478 INFO:tasks.workunit.client.1.smithi110.stdout:6/555: rename d7/d10/d1c/d2b to d7/d10/d1c/d2b/d3a/db2 22 2024-04-12T13:42:08.480 INFO:tasks.workunit.client.1.smithi110.stdout:7/568: readlink d1/d1b/d3d/d68/d97/da5/l46 0 2024-04-12T13:42:08.480 INFO:tasks.workunit.client.1.smithi110.stdout:5/525: creat da/db/d15/fba x:0 0 0 2024-04-12T13:42:08.481 INFO:tasks.workunit.client.0.smithi060.stdout:6/618: write d1/d7/da/dc/f74 [903817,55258] 0 2024-04-12T13:42:08.481 INFO:tasks.workunit.client.0.smithi060.stdout:2/535: dread d6/d13/d5b/d6d/f90 [0,4194304] 0 2024-04-12T13:42:08.483 INFO:tasks.workunit.client.0.smithi060.stdout:6/619: chown d1/d7d 956 1 2024-04-12T13:42:08.483 INFO:tasks.workunit.client.0.smithi060.stdout:7/489: rename d0/l68 to d0/d1b/d8c/la6 0 2024-04-12T13:42:08.483 INFO:tasks.workunit.client.0.smithi060.stdout:2/536: read - d6/d56/d58/da0/f5c zero size 2024-04-12T13:42:08.484 INFO:tasks.workunit.client.1.smithi110.stdout:3/554: write d5/dc/d20/d2d/f51 [1880417,91135] 0 2024-04-12T13:42:08.487 INFO:tasks.workunit.client.1.smithi110.stdout:1/538: rmdir de/d15/da9 39 2024-04-12T13:42:08.489 INFO:tasks.workunit.client.1.smithi110.stdout:0/494: fsync d1/d5e/f95 0 2024-04-12T13:42:08.492 INFO:tasks.workunit.client.1.smithi110.stdout:8/556: rmdir d1/d3/d35/d3a/d84 39 2024-04-12T13:42:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:9/476: symlink d4/d33/l9c 0 2024-04-12T13:42:08.495 INFO:tasks.workunit.client.1.smithi110.stdout:6/556: creat d7/d25/d30/d44/d3d/fb3 x:0 0 0 2024-04-12T13:42:08.498 INFO:tasks.workunit.client.1.smithi110.stdout:7/569: creat d1/d3/d4/d55/fc0 x:0 0 0 2024-04-12T13:42:08.499 INFO:tasks.workunit.client.0.smithi060.stdout:4/520: truncate d6/d7/dd/d1a/d57/f83 3755890 0 2024-04-12T13:42:08.503 INFO:tasks.workunit.client.0.smithi060.stdout:3/563: dwrite d7/d17/d19/d33/f50 [0,4194304] 0 2024-04-12T13:42:08.504 INFO:tasks.workunit.client.1.smithi110.stdout:3/555: chown d5/f40 2 1 2024-04-12T13:42:08.507 INFO:tasks.workunit.client.0.smithi060.stdout:3/564: chown d7/da/d3f/d5c/d25/f7b 14083 1 2024-04-12T13:42:08.511 INFO:tasks.workunit.client.1.smithi110.stdout:1/539: creat de/d15/d32/d61/d6a/d72/fb9 x:0 0 0 2024-04-12T13:42:08.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/490: write d0/d7/f5e [960450,121228] 0 2024-04-12T13:42:08.514 INFO:tasks.workunit.client.1.smithi110.stdout:1/540: write de/d15/d32/f71 [1761471,108288] 0 2024-04-12T13:42:08.516 INFO:tasks.workunit.client.1.smithi110.stdout:4/676: rename d0/d19/d26/d65 to d0/d19/d26/d8a/de0 0 2024-04-12T13:42:08.516 INFO:tasks.workunit.client.0.smithi060.stdout:9/477: dwrite d4/d8/f2c [0,4194304] 0 2024-04-12T13:42:08.517 INFO:tasks.workunit.client.0.smithi060.stdout:0/510: symlink d7/d9/d14/lb2 0 2024-04-12T13:42:08.517 INFO:tasks.workunit.client.0.smithi060.stdout:0/511: readlink d7/l9c 0 2024-04-12T13:42:08.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/637: link d1e/d29/d6d/c95 d1e/d23/d2e/d30/d51/cde 0 2024-04-12T13:42:08.520 INFO:tasks.workunit.client.1.smithi110.stdout:3/556: dread d5/dc/d31/d3b/d32/f78 [0,4194304] 0 2024-04-12T13:42:08.520 INFO:tasks.workunit.client.1.smithi110.stdout:6/557: readlink d7/lb 0 2024-04-12T13:42:08.521 INFO:tasks.workunit.client.1.smithi110.stdout:5/526: unlink da/d35/cb3 0 2024-04-12T13:42:08.526 INFO:tasks.workunit.client.1.smithi110.stdout:9/644: getdents df/d13/d3b/d40 0 2024-04-12T13:42:08.531 INFO:tasks.workunit.client.1.smithi110.stdout:2/602: link d6/dc/dd/d49/d64/d4a/d3c/d6e/l75 d6/dc/dd/d49/d64/d5d/db9/lba 0 2024-04-12T13:42:08.536 INFO:tasks.workunit.client.0.smithi060.stdout:8/496: mknod d9/d1b/d2b/d82/d8a/ca7 0 2024-04-12T13:42:08.537 INFO:tasks.workunit.client.1.smithi110.stdout:1/541: mkdir de/d14/d83/dba 0 2024-04-12T13:42:08.538 INFO:tasks.workunit.client.1.smithi110.stdout:8/557: link d1/d3/d35/d3a/d41/fb0 d1/d3/d35/d3a/d41/d77/fb1 0 2024-04-12T13:42:08.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/536: dwrite d6/dd/d1f/d25/d35/f72 [0,4194304] 0 2024-04-12T13:42:08.542 INFO:tasks.workunit.client.1.smithi110.stdout:8/558: readlink d1/d3/d35/d43/l6e 0 2024-04-12T13:42:08.548 INFO:tasks.workunit.client.1.smithi110.stdout:6/558: rmdir d7/d25/d2c 39 2024-04-12T13:42:08.551 INFO:tasks.workunit.client.0.smithi060.stdout:3/565: write d7/d17/d19/f1f [4064162,121299] 0 2024-04-12T13:42:08.551 INFO:tasks.workunit.client.1.smithi110.stdout:6/559: write d7/d10/d1c/d2b/d48/f5e [122920,6924] 0 2024-04-12T13:42:08.553 INFO:tasks.workunit.client.1.smithi110.stdout:9/645: stat df/d13/cb0 0 2024-04-12T13:42:08.554 INFO:tasks.workunit.client.1.smithi110.stdout:6/560: readlink d7/d10/d1c/d2b/d48/d4b/l66 0 2024-04-12T13:42:08.554 INFO:tasks.workunit.client.0.smithi060.stdout:3/566: chown d7/d17/d27/d36/fb1 208537274 1 2024-04-12T13:42:08.559 INFO:tasks.workunit.client.0.smithi060.stdout:6/620: truncate d1/d2c/f70 201825 0 2024-04-12T13:42:08.559 INFO:tasks.workunit.client.0.smithi060.stdout:3/567: write d7/d17/d19/f74 [561056,38762] 0 2024-04-12T13:42:08.562 INFO:tasks.workunit.client.1.smithi110.stdout:8/559: dread d1/d3/d3c/d5a/f8a [0,4194304] 0 2024-04-12T13:42:08.563 INFO:tasks.workunit.client.0.smithi060.stdout:2/537: dwrite d6/d56/d86/f8d [0,4194304] 0 2024-04-12T13:42:08.563 INFO:tasks.workunit.client.1.smithi110.stdout:4/677: unlink d0/de/cda 0 2024-04-12T13:42:08.565 INFO:tasks.workunit.client.1.smithi110.stdout:3/557: creat d5/d86/fb5 x:0 0 0 2024-04-12T13:42:08.565 INFO:tasks.workunit.client.1.smithi110.stdout:7/570: link d1/d3/d4/d36/d76/l89 d1/d3/d4/dbf/lc1 0 2024-04-12T13:42:08.569 INFO:tasks.workunit.client.1.smithi110.stdout:1/542: dread de/d15/f31 [0,4194304] 0 2024-04-12T13:42:08.569 INFO:tasks.workunit.client.0.smithi060.stdout:5/537: creat d6/dd/d1f/d25/d42/d6b/fac x:0 0 0 2024-04-12T13:42:08.570 INFO:tasks.workunit.client.0.smithi060.stdout:5/538: fdatasync d6/f99 0 2024-04-12T13:42:08.571 INFO:tasks.workunit.client.0.smithi060.stdout:2/538: truncate d6/d13/d31/d33/f6a 465750 0 2024-04-12T13:42:08.572 INFO:tasks.workunit.client.0.smithi060.stdout:8/497: dread d9/d1b/d3c/f77 [0,4194304] 0 2024-04-12T13:42:08.574 INFO:tasks.workunit.client.0.smithi060.stdout:2/539: stat d6/f77 0 2024-04-12T13:42:08.574 INFO:tasks.workunit.client.1.smithi110.stdout:6/561: dwrite d7/d10/d1c/d2b/f38 [0,4194304] 0 2024-04-12T13:42:08.575 INFO:tasks.workunit.client.1.smithi110.stdout:1/543: read de/d1d/d86/fa6 [6851973,29911] 0 2024-04-12T13:42:08.577 INFO:tasks.workunit.client.1.smithi110.stdout:9/646: dwrite df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [0,4194304] 0 2024-04-12T13:42:08.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/540: write d6/d13/d31/f42 [4173123,109164] 0 2024-04-12T13:42:08.581 INFO:tasks.workunit.client.1.smithi110.stdout:2/603: creat d6/dc/dd/d49/d64/d5d/db9/fbb x:0 0 0 2024-04-12T13:42:08.583 INFO:tasks.workunit.client.1.smithi110.stdout:0/495: link d1/d5e/c92 d1/d27/d31/d89/ca1 0 2024-04-12T13:42:08.586 INFO:tasks.workunit.client.1.smithi110.stdout:4/678: rmdir d0 39 2024-04-12T13:42:08.588 INFO:tasks.workunit.client.0.smithi060.stdout:4/521: creat d6/fb8 x:0 0 0 2024-04-12T13:42:08.590 INFO:tasks.workunit.client.1.smithi110.stdout:5/527: creat da/db/fbb x:0 0 0 2024-04-12T13:42:08.592 INFO:tasks.workunit.client.0.smithi060.stdout:4/522: write d6/d7/dd/df/f37 [4160260,107432] 0 2024-04-12T13:42:08.592 INFO:tasks.workunit.client.1.smithi110.stdout:5/528: chown da/d2e/d45/d25/d9d/l76 4435786 1 2024-04-12T13:42:08.594 INFO:tasks.workunit.client.1.smithi110.stdout:5/529: chown da/db/d3b/c65 0 1 2024-04-12T13:42:08.595 INFO:tasks.workunit.client.1.smithi110.stdout:1/544: chown de/l13 97918 1 2024-04-12T13:42:08.596 INFO:tasks.workunit.client.1.smithi110.stdout:5/530: fdatasync da/db/f4a 0 2024-04-12T13:42:08.597 INFO:tasks.workunit.client.0.smithi060.stdout:2/541: creat d6/d13/d31/d33/fa5 x:0 0 0 2024-04-12T13:42:08.598 INFO:tasks.workunit.client.1.smithi110.stdout:9/647: creat df/d13/d2c/d2d/d94/fd4 x:0 0 0 2024-04-12T13:42:08.599 INFO:tasks.workunit.client.0.smithi060.stdout:2/542: fsync d6/d10/d2b/d35/f97 0 2024-04-12T13:42:08.600 INFO:tasks.workunit.client.1.smithi110.stdout:2/604: symlink d6/dc/dd/d49/d64/d4a/d55/d82/d84/lbc 0 2024-04-12T13:42:08.603 INFO:tasks.workunit.client.0.smithi060.stdout:7/491: write d0/d7/f24 [2493774,1881] 0 2024-04-12T13:42:08.604 INFO:tasks.workunit.client.1.smithi110.stdout:9/648: read df/d13/d2c/d2d/dc1/d83/f68 [3097038,68893] 0 2024-04-12T13:42:08.605 INFO:tasks.workunit.client.0.smithi060.stdout:8/498: dread d9/d1b/f47 [0,4194304] 0 2024-04-12T13:42:08.606 INFO:tasks.workunit.client.1.smithi110.stdout:9/649: readlink df/d13/d2c/d2d/l3c 0 2024-04-12T13:42:08.606 INFO:tasks.workunit.client.0.smithi060.stdout:1/638: rename d1e/d1f/fad to d1e/d29/fdf 0 2024-04-12T13:42:08.610 INFO:tasks.workunit.client.0.smithi060.stdout:3/568: link d7/d17/d27/d36/f46 d7/d17/d27/d36/d53/fc2 0 2024-04-12T13:42:08.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/560: dread d1/d3/d35/d3a/d41/f51 [4194304,4194304] 0 2024-04-12T13:42:08.613 INFO:tasks.workunit.client.1.smithi110.stdout:7/571: symlink d1/d3/d4/lc2 0 2024-04-12T13:42:08.613 INFO:tasks.workunit.client.1.smithi110.stdout:8/561: chown d1/d3/d35/d3a/d3e 1873789 1 2024-04-12T13:42:08.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/539: dread d6/dd/d1f/d25/d53/f77 [0,4194304] 0 2024-04-12T13:42:08.617 INFO:tasks.workunit.client.1.smithi110.stdout:6/562: link d7/d25/d30/d44/d3d/f49 d7/d10/d1c/d2b/d3a/d82/fb4 0 2024-04-12T13:42:08.620 INFO:tasks.workunit.client.0.smithi060.stdout:0/512: getdents d7/d9/de/d63 0 2024-04-12T13:42:08.621 INFO:tasks.workunit.client.1.smithi110.stdout:1/545: write de/d15/d32/d61/d6a/d8b/fad [796292,72578] 0 2024-04-12T13:42:08.623 INFO:tasks.workunit.client.1.smithi110.stdout:5/531: fsync da/d2e/d45/d25/d9d/d7a/db5/d8f/f5b 0 2024-04-12T13:42:08.625 INFO:tasks.workunit.client.1.smithi110.stdout:5/532: chown da/d2e/d45/d25/d9d/d79/d88/f95 7872535 1 2024-04-12T13:42:08.631 INFO:tasks.workunit.client.1.smithi110.stdout:4/679: rename d0/de/d32/d5f/cb5 to d0/d19/d26/d8a/ce1 0 2024-04-12T13:42:08.632 INFO:tasks.workunit.client.0.smithi060.stdout:3/569: dwrite d7/da/d3f/d5c/d25/d4d/f6e [0,4194304] 0 2024-04-12T13:42:08.633 INFO:tasks.workunit.client.0.smithi060.stdout:2/543: rename d6/d56/d58/da0/c20 to d6/d10/d4b/ca6 0 2024-04-12T13:42:08.633 INFO:tasks.workunit.client.1.smithi110.stdout:3/558: write d5/dc/d20/d2d/f42 [2622785,15240] 0 2024-04-12T13:42:08.633 INFO:tasks.workunit.client.0.smithi060.stdout:3/570: readlink d7/d17/d19/l4a 0 2024-04-12T13:42:08.635 INFO:tasks.workunit.client.0.smithi060.stdout:6/621: link d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/l9a d1/d7/da/dc/d24/d2d/ldb 0 2024-04-12T13:42:08.639 INFO:tasks.workunit.client.0.smithi060.stdout:1/639: symlink d1e/d23/d49/d4e/le0 0 2024-04-12T13:42:08.640 INFO:tasks.workunit.client.1.smithi110.stdout:8/562: symlink d1/d3/d3c/d5a/d6f/d7e/lb2 0 2024-04-12T13:42:08.642 INFO:tasks.workunit.client.1.smithi110.stdout:7/572: truncate d1/d3/d4/d36/f3a 1326500 0 2024-04-12T13:42:08.642 INFO:tasks.workunit.client.0.smithi060.stdout:4/523: write d6/d21/f27 [3491971,23341] 0 2024-04-12T13:42:08.643 INFO:tasks.workunit.client.1.smithi110.stdout:7/573: fsync d1/d3/d43/f85 0 2024-04-12T13:42:08.646 INFO:tasks.workunit.client.1.smithi110.stdout:2/605: write d6/dc/f36 [3188198,7367] 0 2024-04-12T13:42:08.647 INFO:tasks.workunit.client.1.smithi110.stdout:6/563: write d7/d25/d2c/d4c/f8b [4511648,16412] 0 2024-04-12T13:42:08.647 INFO:tasks.workunit.client.0.smithi060.stdout:0/513: mknod d7/d33/d5b/cb3 0 2024-04-12T13:42:08.650 INFO:tasks.workunit.client.0.smithi060.stdout:4/524: fsync d6/d7/dd/d1a/d57/d63/d68/f6c 0 2024-04-12T13:42:08.651 INFO:tasks.workunit.client.1.smithi110.stdout:5/533: fsync da/d2e/d45/d29/d32/f54 0 2024-04-12T13:42:08.651 INFO:tasks.workunit.client.0.smithi060.stdout:8/499: creat d9/d1b/d84/da1/fa8 x:0 0 0 2024-04-12T13:42:08.652 INFO:tasks.workunit.client.0.smithi060.stdout:4/525: chown d6/d7/dd/d1a/d19/f1b 1264 1 2024-04-12T13:42:08.653 INFO:tasks.workunit.client.1.smithi110.stdout:0/496: link d1/d8/d36/d63/d4a/f78 d1/d8/d36/fa2 0 2024-04-12T13:42:08.655 INFO:tasks.workunit.client.1.smithi110.stdout:4/680: unlink d0/d19/d26/f59 0 2024-04-12T13:42:08.660 INFO:tasks.workunit.client.0.smithi060.stdout:1/640: unlink d1e/d23/d2e/d30/cd7 0 2024-04-12T13:42:08.662 INFO:tasks.workunit.client.1.smithi110.stdout:3/559: write d5/f1f [2945731,20086] 0 2024-04-12T13:42:08.663 INFO:tasks.workunit.client.0.smithi060.stdout:7/492: mknod d0/d7/d88/ca7 0 2024-04-12T13:42:08.664 INFO:tasks.workunit.client.1.smithi110.stdout:2/606: dread d6/dc/f36 [0,4194304] 0 2024-04-12T13:42:08.666 INFO:tasks.workunit.client.1.smithi110.stdout:8/563: rmdir d1/d3/d3c/d5a 39 2024-04-12T13:42:08.673 INFO:tasks.workunit.client.0.smithi060.stdout:2/544: dread d6/d13/d31/d33/f39 [0,4194304] 0 2024-04-12T13:42:08.675 INFO:tasks.workunit.client.0.smithi060.stdout:3/571: link d7/d17/d27/d36/db0/fb7 d7/d17/d19/d96/fc3 0 2024-04-12T13:42:08.678 INFO:tasks.workunit.client.0.smithi060.stdout:5/540: dwrite d6/dd/d1f/d32/d46/f92 [0,4194304] 0 2024-04-12T13:42:08.679 INFO:tasks.workunit.client.0.smithi060.stdout:8/500: creat d9/d1b/d37/d4d/d63/fa9 x:0 0 0 2024-04-12T13:42:08.679 INFO:tasks.workunit.client.1.smithi110.stdout:2/607: dwrite d6/dc/d1b/f2a [4194304,4194304] 0 2024-04-12T13:42:08.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/526: creat d6/d7/dd/d1a/d19/d42/d7c/fb9 x:0 0 0 2024-04-12T13:42:08.685 INFO:tasks.workunit.client.0.smithi060.stdout:1/641: rmdir d1e/d23/d2e/d86 39 2024-04-12T13:42:08.686 INFO:tasks.workunit.client.0.smithi060.stdout:6/622: dread d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f49 [0,4194304] 0 2024-04-12T13:42:08.687 INFO:tasks.workunit.client.0.smithi060.stdout:7/493: rename d0/d7/la3 to d0/d78/la8 0 2024-04-12T13:42:08.689 INFO:tasks.workunit.client.1.smithi110.stdout:6/564: creat d7/d10/d7e/fb5 x:0 0 0 2024-04-12T13:42:08.692 INFO:tasks.workunit.client.1.smithi110.stdout:5/534: rmdir da/d2e 39 2024-04-12T13:42:08.694 INFO:tasks.workunit.client.0.smithi060.stdout:0/514: fsync d7/d9/d14/d35/d44/f77 0 2024-04-12T13:42:08.696 INFO:tasks.workunit.client.1.smithi110.stdout:0/497: mknod d1/d27/d31/ca3 0 2024-04-12T13:42:08.696 INFO:tasks.workunit.client.0.smithi060.stdout:5/541: truncate d6/d10/f31 283523 0 2024-04-12T13:42:08.697 INFO:tasks.workunit.client.1.smithi110.stdout:0/498: write d1/f22 [3688257,35826] 0 2024-04-12T13:42:08.699 INFO:tasks.workunit.client.1.smithi110.stdout:9/650: creat df/d13/d3b/d40/d56/fd5 x:0 0 0 2024-04-12T13:42:08.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/623: creat d1/d7/da/dc/d24/d30/d52/fdc x:0 0 0 2024-04-12T13:42:08.704 INFO:tasks.workunit.client.1.smithi110.stdout:3/560: dread - d5/dc/d20/d2d/d4e/f66 zero size 2024-04-12T13:42:08.706 INFO:tasks.workunit.client.1.smithi110.stdout:7/574: dwrite d1/d3/d4/d55/d82/f66 [0,4194304] 0 2024-04-12T13:42:08.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/572: dread d7/d17/f28 [0,4194304] 0 2024-04-12T13:42:08.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/642: getdents d1e/d46/d8d 0 2024-04-12T13:42:08.711 INFO:tasks.workunit.client.1.smithi110.stdout:0/499: dread d1/d27/d31/f50 [0,4194304] 0 2024-04-12T13:42:08.714 INFO:tasks.workunit.client.0.smithi060.stdout:7/494: mkdir d0/d7/da9 0 2024-04-12T13:42:08.716 INFO:tasks.workunit.client.0.smithi060.stdout:2/545: dwrite d6/f9b [0,4194304] 0 2024-04-12T13:42:08.716 INFO:tasks.workunit.client.1.smithi110.stdout:1/546: rmdir de/d14/d83/dba 0 2024-04-12T13:42:08.717 INFO:tasks.workunit.client.1.smithi110.stdout:3/561: dread d5/dc/d31/d3b/d32/f78 [0,4194304] 0 2024-04-12T13:42:08.717 INFO:tasks.workunit.client.0.smithi060.stdout:4/527: write d6/d7/dd/d1a/d19/f1f [3294403,50048] 0 2024-04-12T13:42:08.718 INFO:tasks.workunit.client.1.smithi110.stdout:3/562: chown d5/fa2 0 1 2024-04-12T13:42:08.721 INFO:tasks.workunit.client.0.smithi060.stdout:4/528: stat d6/d7/dd/d1a/d19/d42/lac 0 2024-04-12T13:42:08.724 INFO:tasks.workunit.client.1.smithi110.stdout:6/565: creat d7/d10/fb6 x:0 0 0 2024-04-12T13:42:08.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/573: dread d7/d17/d19/d33/f50 [0,4194304] 0 2024-04-12T13:42:08.727 INFO:tasks.workunit.client.0.smithi060.stdout:8/501: truncate d9/d1b/d37/d4d/f7e 2156911 0 2024-04-12T13:42:08.728 INFO:tasks.workunit.client.0.smithi060.stdout:1/643: mkdir d1e/d23/d2e/d5e/d68/d9a/de1 0 2024-04-12T13:42:08.728 INFO:tasks.workunit.client.0.smithi060.stdout:3/574: chown d7/d17/d19/c66 129497 1 2024-04-12T13:42:08.731 INFO:tasks.workunit.client.1.smithi110.stdout:5/535: chown da/d2e/d45/d25/c3f 116749614 1 2024-04-12T13:42:08.731 INFO:tasks.workunit.client.0.smithi060.stdout:7/495: readlink d0/d78/la8 0 2024-04-12T13:42:08.732 INFO:tasks.workunit.client.1.smithi110.stdout:1/547: dwrite de/d14/f78 [0,4194304] 0 2024-04-12T13:42:08.735 INFO:tasks.workunit.client.1.smithi110.stdout:9/651: rename df/d13/d26/d37/d49 to df/d13/d2c/d9e/dd6 0 2024-04-12T13:42:08.739 INFO:tasks.workunit.client.0.smithi060.stdout:8/502: creat d9/d1b/d84/da0/faa x:0 0 0 2024-04-12T13:42:08.740 INFO:tasks.workunit.client.1.smithi110.stdout:3/563: mkdir d5/dc/d20/d2d/d4e/d89/d8c/db6 0 2024-04-12T13:42:08.740 INFO:tasks.workunit.client.1.smithi110.stdout:7/575: read d1/d3/d4/d55/f62 [113090,20809] 0 2024-04-12T13:42:08.744 INFO:tasks.workunit.client.0.smithi060.stdout:3/575: dread d7/da/d3f/d5c/d25/f44 [0,4194304] 0 2024-04-12T13:42:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:1/644: dread d1e/d23/d2e/d30/f5f [0,4194304] 0 2024-04-12T13:42:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/576: write d7/d17/d27/d36/d53/f6a [3482360,77873] 0 2024-04-12T13:42:08.749 INFO:tasks.workunit.client.1.smithi110.stdout:6/566: chown d7/l9 6547 1 2024-04-12T13:42:08.751 INFO:tasks.workunit.client.0.smithi060.stdout:4/529: creat d6/d7/dd/d1a/d19/d7a/da8/fba x:0 0 0 2024-04-12T13:42:08.751 INFO:tasks.workunit.client.0.smithi060.stdout:1/645: chown d1e/d23/c2a 196536 1 2024-04-12T13:42:08.752 INFO:tasks.workunit.client.0.smithi060.stdout:7/496: dread d0/d1b/fa2 [0,4194304] 0 2024-04-12T13:42:08.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/530: write d6/d7/db/fb1 [397864,108505] 0 2024-04-12T13:42:08.755 INFO:tasks.workunit.client.1.smithi110.stdout:0/500: dwrite d1/d27/d31/f49 [8388608,4194304] 0 2024-04-12T13:42:08.756 INFO:tasks.workunit.client.0.smithi060.stdout:4/531: write d6/d21/f2a [638341,118064] 0 2024-04-12T13:42:08.758 INFO:tasks.workunit.client.0.smithi060.stdout:8/503: symlink d9/d1b/d3c/d60/lab 0 2024-04-12T13:42:08.764 INFO:tasks.workunit.client.1.smithi110.stdout:9/652: creat df/d13/d2c/d9e/dd6/dcf/fd7 x:0 0 0 2024-04-12T13:42:08.767 INFO:tasks.workunit.client.1.smithi110.stdout:4/681: dwrite d0/f5 [0,4194304] 0 2024-04-12T13:42:08.769 INFO:tasks.workunit.client.0.smithi060.stdout:1/646: creat d1e/d23/d49/d4e/d9b/fe2 x:0 0 0 2024-04-12T13:42:08.770 INFO:tasks.workunit.client.1.smithi110.stdout:3/564: mknod d5/dc/d20/d2d/d4f/cb7 0 2024-04-12T13:42:08.774 INFO:tasks.workunit.client.0.smithi060.stdout:1/647: chown d1e/d23/f25 23762 1 2024-04-12T13:42:08.774 INFO:tasks.workunit.client.0.smithi060.stdout:5/542: dwrite d6/d10/d12/d4c/f85 [0,4194304] 0 2024-04-12T13:42:08.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/497: rename d0/c8a to d0/d3d/d74/d9b/da1/caa 0 2024-04-12T13:42:08.780 INFO:tasks.workunit.client.1.smithi110.stdout:6/567: creat d7/d25/d2c/d4c/da6/fb7 x:0 0 0 2024-04-12T13:42:08.781 INFO:tasks.workunit.client.0.smithi060.stdout:8/504: dwrite d9/d1b/d84/da0/faa [0,4194304] 0 2024-04-12T13:42:08.782 INFO:tasks.workunit.client.1.smithi110.stdout:1/548: write de/d14/d34/f5f [1803615,89942] 0 2024-04-12T13:42:08.786 INFO:tasks.workunit.client.0.smithi060.stdout:6/624: dwrite d1/f57 [0,4194304] 0 2024-04-12T13:42:08.788 INFO:tasks.workunit.client.1.smithi110.stdout:2/608: getdents d6/dc/d1b/d57 0 2024-04-12T13:42:08.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/577: write d7/da/d3f/d5c/d25/f5f [667848,79916] 0 2024-04-12T13:42:08.791 INFO:tasks.workunit.client.1.smithi110.stdout:2/609: truncate d6/dc/dd/f81 919325 0 2024-04-12T13:42:08.791 INFO:tasks.workunit.client.1.smithi110.stdout:8/564: sync 2024-04-12T13:42:08.791 INFO:tasks.workunit.client.0.smithi060.stdout:6/625: write d1/d7/da/fc4 [3410757,81435] 0 2024-04-12T13:42:08.793 INFO:tasks.workunit.client.1.smithi110.stdout:0/501: rename d1/d8/d36/d63/d4a/l86 to d1/d8/d36/d63/d4a/la4 0 2024-04-12T13:42:08.793 INFO:tasks.workunit.client.0.smithi060.stdout:3/578: chown d7/d17/d19/d96/c97 61915 1 2024-04-12T13:42:08.794 INFO:tasks.workunit.client.1.smithi110.stdout:9/653: rename df/d13/d3b/d40/c46 to df/d13/d26/dc9/cd8 0 2024-04-12T13:42:08.796 INFO:tasks.workunit.client.1.smithi110.stdout:0/502: fdatasync d1/d8/d36/d63/d4a/f4f 0 2024-04-12T13:42:08.796 INFO:tasks.workunit.client.0.smithi060.stdout:6/626: chown d1/d7/da/dc/d24/d2d/l83 940316147 1 2024-04-12T13:42:08.796 INFO:tasks.workunit.client.1.smithi110.stdout:4/682: creat d0/d19/d1c/d50/fe2 x:0 0 0 2024-04-12T13:42:08.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/543: readlink d6/d89/la7 0 2024-04-12T13:42:08.798 INFO:tasks.workunit.client.1.smithi110.stdout:3/565: symlink d5/dc/d31/d74/d75/lb8 0 2024-04-12T13:42:08.802 INFO:tasks.workunit.client.0.smithi060.stdout:4/532: mkdir d6/db7/dbb 0 2024-04-12T13:42:08.804 INFO:tasks.workunit.client.0.smithi060.stdout:7/498: creat d0/d7/d43/d63/fab x:0 0 0 2024-04-12T13:42:08.807 INFO:tasks.workunit.client.1.smithi110.stdout:7/576: truncate d1/d3/d43/f85 1972610 0 2024-04-12T13:42:08.809 INFO:tasks.workunit.client.0.smithi060.stdout:1/648: symlink d1e/d23/d2e/d5e/d68/d9a/le3 0 2024-04-12T13:42:08.810 INFO:tasks.workunit.client.0.smithi060.stdout:7/499: write d0/d7/f5e [1319400,116505] 0 2024-04-12T13:42:08.813 INFO:tasks.workunit.client.1.smithi110.stdout:5/536: dwrite da/db/f1d [0,4194304] 0 2024-04-12T13:42:08.816 INFO:tasks.workunit.client.1.smithi110.stdout:5/537: read da/d2e/d45/f1e [1338205,6832] 0 2024-04-12T13:42:08.816 INFO:tasks.workunit.client.0.smithi060.stdout:5/544: mknod d6/dd/d1f/d25/d35/d50/d5f/cad 0 2024-04-12T13:42:08.821 INFO:tasks.workunit.client.0.smithi060.stdout:3/579: dwrite d7/d17/d27/d36/fb9 [0,4194304] 0 2024-04-12T13:42:08.823 INFO:tasks.workunit.client.1.smithi110.stdout:8/565: mknod d1/d5/d1f/cb3 0 2024-04-12T13:42:08.824 INFO:tasks.workunit.client.0.smithi060.stdout:4/533: mknod d6/d7/dd/d1a/d57/d63/d68/d94/cbc 0 2024-04-12T13:42:08.827 INFO:tasks.workunit.client.1.smithi110.stdout:9/654: creat df/d13/d2c/d2d/dc1/d83/d63/fd9 x:0 0 0 2024-04-12T13:42:08.829 INFO:tasks.workunit.client.1.smithi110.stdout:8/566: write d1/d3/d35/d3a/d41/f53 [2455572,52303] 0 2024-04-12T13:42:08.830 INFO:tasks.workunit.client.0.smithi060.stdout:8/505: rename d9/d1b/d37/l7d to d9/d1b/d3c/d6e/d7b/lac 0 2024-04-12T13:42:08.831 INFO:tasks.workunit.client.1.smithi110.stdout:9/655: stat df/d13/d2c/d2d/dc1/c6d 0 2024-04-12T13:42:08.835 INFO:tasks.workunit.client.1.smithi110.stdout:1/549: dwrite de/d14/d34/d55/f5c [0,4194304] 0 2024-04-12T13:42:08.835 INFO:tasks.workunit.client.0.smithi060.stdout:5/545: dread d6/dd/d1f/d25/d42/d52/f8c [0,4194304] 0 2024-04-12T13:42:08.843 INFO:tasks.workunit.client.0.smithi060.stdout:3/580: chown d7/da/l92 135986 1 2024-04-12T13:42:08.846 INFO:tasks.workunit.client.1.smithi110.stdout:8/567: dwrite d1/d3/d35/d3a/d3e/d4f/f5e [0,4194304] 0 2024-04-12T13:42:08.846 INFO:tasks.workunit.client.0.smithi060.stdout:3/581: readlink d7/da/d3f/d5c/l14 0 2024-04-12T13:42:08.850 INFO:tasks.workunit.client.1.smithi110.stdout:6/568: creat d7/d25/d30/d44/da3/fb8 x:0 0 0 2024-04-12T13:42:08.850 INFO:tasks.workunit.client.0.smithi060.stdout:5/546: mknod d6/dd/d1f/d25/d42/d52/cae 0 2024-04-12T13:42:08.851 INFO:tasks.workunit.client.0.smithi060.stdout:5/547: read - d6/dd/f45 zero size 2024-04-12T13:42:08.851 INFO:tasks.workunit.client.0.smithi060.stdout:8/506: mknod d9/d1b/d37/d4d/d63/d66/d8b/cad 0 2024-04-12T13:42:08.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/534: fdatasync d6/d7/dd/fe 0 2024-04-12T13:42:08.852 INFO:tasks.workunit.client.0.smithi060.stdout:8/507: fdatasync f2 0 2024-04-12T13:42:08.853 INFO:tasks.workunit.client.0.smithi060.stdout:3/582: mkdir d7/d17/d27/d36/db0/dc4 0 2024-04-12T13:42:08.854 INFO:tasks.workunit.client.1.smithi110.stdout:1/550: dwrite de/d15/d32/fb2 [0,4194304] 0 2024-04-12T13:42:08.857 INFO:tasks.workunit.client.0.smithi060.stdout:3/583: stat d7/d17/d27/d36/d53/fc2 0 2024-04-12T13:42:08.858 INFO:tasks.workunit.client.0.smithi060.stdout:4/535: dread d6/d7/dd/df/f92 [0,4194304] 0 2024-04-12T13:42:08.863 INFO:tasks.workunit.client.0.smithi060.stdout:7/500: truncate d0/d1b/f72 1430951 0 2024-04-12T13:42:08.869 INFO:tasks.workunit.client.0.smithi060.stdout:3/584: read d7/f47 [32844,82253] 0 2024-04-12T13:42:08.871 INFO:tasks.workunit.client.0.smithi060.stdout:4/536: mkdir d6/d7/dd/d1a/d57/d63/d68/d76/dbd 0 2024-04-12T13:42:08.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/585: truncate d7/d17/d27/fa5 391740 0 2024-04-12T13:42:08.876 INFO:tasks.workunit.client.0.smithi060.stdout:3/586: write d7/d17/f90 [2764365,70859] 0 2024-04-12T13:42:08.877 INFO:tasks.workunit.client.0.smithi060.stdout:8/508: dwrite d9/d1b/d37/d4d/d63/f89 [0,4194304] 0 2024-04-12T13:42:08.879 INFO:tasks.workunit.client.0.smithi060.stdout:4/537: mkdir d6/d2f/dbe 0 2024-04-12T13:42:08.887 INFO:tasks.workunit.client.0.smithi060.stdout:7/501: getdents d0/d1b/d8c 0 2024-04-12T13:42:08.890 INFO:tasks.workunit.client.0.smithi060.stdout:8/509: mknod d9/d1b/d2b/cae 0 2024-04-12T13:42:08.892 INFO:tasks.workunit.client.0.smithi060.stdout:5/548: dwrite d6/d10/d12/d38/f86 [0,4194304] 0 2024-04-12T13:42:08.895 INFO:tasks.workunit.client.0.smithi060.stdout:5/549: fdatasync d6/dd/d1f/d32/f6f 0 2024-04-12T13:42:08.897 INFO:tasks.workunit.client.0.smithi060.stdout:4/538: read d6/d7/dd/df/f92 [324193,51553] 0 2024-04-12T13:42:08.902 INFO:tasks.workunit.client.0.smithi060.stdout:7/502: rename d0/d1b/d8c/la6 to d0/lac 0 2024-04-12T13:42:08.905 INFO:tasks.workunit.client.0.smithi060.stdout:8/510: mknod d9/d1b/d2b/caf 0 2024-04-12T13:42:08.905 INFO:tasks.workunit.client.0.smithi060.stdout:7/503: chown d0/c81 4 1 2024-04-12T13:42:08.907 INFO:tasks.workunit.client.1.smithi110.stdout:5/538: rmdir da/d2e/d45/d29/d66/d7c/d8a 39 2024-04-12T13:42:08.908 INFO:tasks.workunit.client.1.smithi110.stdout:5/539: readlink da/db/l1c 0 2024-04-12T13:42:08.911 INFO:tasks.workunit.client.0.smithi060.stdout:5/550: creat d6/d89/da3/faf x:0 0 0 2024-04-12T13:42:08.912 INFO:tasks.workunit.client.0.smithi060.stdout:3/587: write d7/da/d3f/d5c/d25/f26 [53477,93708] 0 2024-04-12T13:42:08.914 INFO:tasks.workunit.client.0.smithi060.stdout:8/511: symlink d9/d1b/d37/d48/lb0 0 2024-04-12T13:42:08.916 INFO:tasks.workunit.client.0.smithi060.stdout:3/588: read d7/d17/d19/f48 [72347,62601] 0 2024-04-12T13:42:08.916 INFO:tasks.workunit.client.0.smithi060.stdout:8/512: fsync d9/d1b/d37/d4d/d63/f85 0 2024-04-12T13:42:08.918 INFO:tasks.workunit.client.0.smithi060.stdout:8/513: write d9/f71 [19362,78597] 0 2024-04-12T13:42:08.922 INFO:tasks.workunit.client.0.smithi060.stdout:4/539: fsync d6/d2f/d51/f89 0 2024-04-12T13:42:08.924 INFO:tasks.workunit.client.0.smithi060.stdout:4/540: write d6/d7/dd/d1a/d19/f52 [2098384,25273] 0 2024-04-12T13:42:08.926 INFO:tasks.workunit.client.0.smithi060.stdout:5/551: rename d6/d10/f68 to d6/dd/d1f/d25/d42/d52/d7a/fb0 0 2024-04-12T13:42:08.928 INFO:tasks.workunit.client.0.smithi060.stdout:4/541: write d6/d7/dd/d1a/d19/d42/d7c/f9a [826223,4322] 0 2024-04-12T13:42:08.931 INFO:tasks.workunit.client.0.smithi060.stdout:8/514: dread d9/d1d/d5e/f61 [0,4194304] 0 2024-04-12T13:42:08.931 INFO:tasks.workunit.client.0.smithi060.stdout:8/515: stat d9/d1d 0 2024-04-12T13:42:09.098 INFO:tasks.workunit.client.1.smithi110.stdout:4/683: write d0/d19/d26/fbe [581750,85253] 0 2024-04-12T13:42:09.105 INFO:tasks.workunit.client.1.smithi110.stdout:6/569: readlink d7/d25/d30/d44/l17 0 2024-04-12T13:42:09.109 INFO:tasks.workunit.client.1.smithi110.stdout:0/503: truncate d1/d8/ff 3950150 0 2024-04-12T13:42:09.110 INFO:tasks.workunit.client.1.smithi110.stdout:1/551: rmdir de/d14/d34/d87 39 2024-04-12T13:42:09.113 INFO:tasks.workunit.client.1.smithi110.stdout:6/570: truncate d7/d10/d7e/fb5 910861 0 2024-04-12T13:42:09.125 INFO:tasks.workunit.client.0.smithi060.stdout:8/516: mkdir d9/d1b/d3c/d6e/d7b/db1 0 2024-04-12T13:42:09.135 INFO:tasks.workunit.client.0.smithi060.stdout:4/542: write d6/d7/dd/df/f20 [110472,26396] 0 2024-04-12T13:42:09.135 INFO:tasks.workunit.client.0.smithi060.stdout:3/589: dwrite d7/d17/d19/d33/f6c [0,4194304] 0 2024-04-12T13:42:09.138 INFO:tasks.workunit.client.1.smithi110.stdout:2/610: link d6/dc/dd/d49/d64/l42 d6/dc/dd/d49/d64/d5d/lbd 0 2024-04-12T13:42:09.145 INFO:tasks.workunit.client.1.smithi110.stdout:8/568: symlink d1/d3/d35/d3a/lb4 0 2024-04-12T13:42:09.153 INFO:tasks.workunit.client.1.smithi110.stdout:0/504: mknod d1/d8/d36/d63/d4a/ca5 0 2024-04-12T13:42:09.160 INFO:tasks.workunit.client.1.smithi110.stdout:9/656: creat df/d13/fda x:0 0 0 2024-04-12T13:42:09.160 INFO:tasks.workunit.client.1.smithi110.stdout:3/566: getdents d5/dc/d31/d3b/d32/d3e/d98 0 2024-04-12T13:42:09.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/517: dread d9/d1d/d5e/f61 [0,4194304] 0 2024-04-12T13:42:09.162 INFO:tasks.workunit.client.1.smithi110.stdout:1/552: dread de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:09.166 INFO:tasks.workunit.client.1.smithi110.stdout:1/553: chown de/d14/d34/d55/f5c 2 1 2024-04-12T13:42:09.168 INFO:tasks.workunit.client.1.smithi110.stdout:7/577: getdents d1 0 2024-04-12T13:42:09.169 INFO:tasks.workunit.client.1.smithi110.stdout:2/611: creat d6/dc/dd/d49/d64/d5d/db9/fbe x:0 0 0 2024-04-12T13:42:09.169 INFO:tasks.workunit.client.0.smithi060.stdout:4/543: dread d6/d21/f27 [0,4194304] 0 2024-04-12T13:42:09.170 INFO:tasks.workunit.client.1.smithi110.stdout:4/684: creat d0/d75/fe3 x:0 0 0 2024-04-12T13:42:09.171 INFO:tasks.workunit.client.0.smithi060.stdout:4/544: fdatasync d6/d21/f41 0 2024-04-12T13:42:09.173 INFO:tasks.workunit.client.1.smithi110.stdout:1/554: chown de/d1d/fb7 2529 1 2024-04-12T13:42:09.175 INFO:tasks.workunit.client.1.smithi110.stdout:5/540: creat da/d2e/d45/d29/fbc x:0 0 0 2024-04-12T13:42:09.176 INFO:tasks.workunit.client.1.smithi110.stdout:0/505: mkdir d1/d3c/da6 0 2024-04-12T13:42:09.179 INFO:tasks.workunit.client.1.smithi110.stdout:9/657: mkdir df/d13/d2c/d2d/dc1/d83/d63/db4/ddb 0 2024-04-12T13:42:09.179 INFO:tasks.workunit.client.1.smithi110.stdout:6/571: dread d7/d10/d1c/d2b/d48/d54/f5d [0,4194304] 0 2024-04-12T13:42:09.181 INFO:tasks.workunit.client.1.smithi110.stdout:8/569: symlink d1/d3/d35/d3a/lb5 0 2024-04-12T13:42:09.182 INFO:tasks.workunit.client.1.smithi110.stdout:2/612: truncate d6/dc/dd/d49/d64/d4a/d55/d82/d84/fb3 80957 0 2024-04-12T13:42:09.186 INFO:tasks.workunit.client.1.smithi110.stdout:1/555: rmdir de/d15/d32/d5e/d79 39 2024-04-12T13:42:09.186 INFO:tasks.workunit.client.1.smithi110.stdout:9/658: read df/d13/d2c/d2d/d39/d3a/fd1 [4025993,105548] 0 2024-04-12T13:42:09.187 INFO:tasks.workunit.client.1.smithi110.stdout:3/567: dwrite d5/dc/d31/d3b/f4b [0,4194304] 0 2024-04-12T13:42:09.187 INFO:tasks.workunit.client.1.smithi110.stdout:0/506: mknod d1/d8/d36/d65/ca7 0 2024-04-12T13:42:09.188 INFO:tasks.workunit.client.0.smithi060.stdout:9/478: sync 2024-04-12T13:42:09.188 INFO:tasks.workunit.client.1.smithi110.stdout:8/570: fdatasync d1/d3/d3c/d75/d79/fad 0 2024-04-12T13:42:09.189 INFO:tasks.workunit.client.1.smithi110.stdout:5/541: creat da/d2e/d45/d25/d5d/fbd x:0 0 0 2024-04-12T13:42:09.191 INFO:tasks.workunit.client.0.smithi060.stdout:9/479: fsync d4/d9/d19/d21/f66 0 2024-04-12T13:42:09.192 INFO:tasks.workunit.client.1.smithi110.stdout:1/556: write de/d1d/d86/fa8 [242747,14530] 0 2024-04-12T13:42:09.193 INFO:tasks.workunit.client.1.smithi110.stdout:6/572: mkdir d7/d25/d2c/d4c/d77/db9 0 2024-04-12T13:42:09.196 INFO:tasks.workunit.client.0.smithi060.stdout:7/504: link d0/d1b/fa2 d0/fad 0 2024-04-12T13:42:09.197 INFO:tasks.workunit.client.1.smithi110.stdout:0/507: dread d1/f26 [0,4194304] 0 2024-04-12T13:42:09.206 INFO:tasks.workunit.client.1.smithi110.stdout:8/571: write d1/d3/d35/d3a/d84/f92 [465666,13529] 0 2024-04-12T13:42:09.208 INFO:tasks.workunit.client.1.smithi110.stdout:8/572: chown d1 28750409 1 2024-04-12T13:42:09.209 INFO:tasks.workunit.client.0.smithi060.stdout:3/590: readlink d7/l29 0 2024-04-12T13:42:09.213 INFO:tasks.workunit.client.1.smithi110.stdout:0/508: creat d1/d8/d8a/fa8 x:0 0 0 2024-04-12T13:42:09.213 INFO:tasks.workunit.client.0.smithi060.stdout:8/518: mknod d9/d1b/d3c/d60/cb2 0 2024-04-12T13:42:09.215 INFO:tasks.workunit.client.0.smithi060.stdout:7/505: dwrite d0/d7/f33 [0,4194304] 0 2024-04-12T13:42:09.218 INFO:tasks.workunit.client.1.smithi110.stdout:5/542: dwrite da/d2e/d45/d25/d9d/f9a [0,4194304] 0 2024-04-12T13:42:09.220 INFO:tasks.workunit.client.1.smithi110.stdout:8/573: stat d1/d3/d35/d3a/d41 0 2024-04-12T13:42:09.221 INFO:tasks.workunit.client.1.smithi110.stdout:2/613: dwrite d6/dc/dd/d49/f61 [0,4194304] 0 2024-04-12T13:42:09.222 INFO:tasks.workunit.client.0.smithi060.stdout:9/480: symlink d4/d8/d32/l9d 0 2024-04-12T13:42:09.225 INFO:tasks.workunit.client.1.smithi110.stdout:4/685: dread d0/de/d32/d5f/f7c [0,4194304] 0 2024-04-12T13:42:09.228 INFO:tasks.workunit.client.0.smithi060.stdout:5/552: mknod d6/d10/d12/d4c/cb1 0 2024-04-12T13:42:09.233 INFO:tasks.workunit.client.1.smithi110.stdout:3/568: getdents d5/dc/d31 0 2024-04-12T13:42:09.236 INFO:tasks.workunit.client.0.smithi060.stdout:5/553: truncate d6/dd/d1f/d25/d53/d87/f3a 1189174 0 2024-04-12T13:42:09.237 INFO:tasks.workunit.client.0.smithi060.stdout:7/506: dwrite d0/d1b/f5b [4194304,4194304] 0 2024-04-12T13:42:09.237 INFO:tasks.workunit.client.1.smithi110.stdout:6/573: dwrite d7/d10/d1c/d2b/d48/d54/f5d [0,4194304] 0 2024-04-12T13:42:09.240 INFO:tasks.workunit.client.0.smithi060.stdout:8/519: unlink d9/d1b/c88 0 2024-04-12T13:42:09.240 INFO:tasks.workunit.client.0.smithi060.stdout:0/515: sync 2024-04-12T13:42:09.250 INFO:tasks.workunit.client.1.smithi110.stdout:3/569: dwrite d5/dc/d20/d2d/d4f/f7b [0,4194304] 0 2024-04-12T13:42:09.250 INFO:tasks.workunit.client.1.smithi110.stdout:8/574: creat d1/d3/d35/d3a/d84/fb6 x:0 0 0 2024-04-12T13:42:09.254 INFO:tasks.workunit.client.1.smithi110.stdout:8/575: readlink d1/d5/d1f/l65 0 2024-04-12T13:42:09.254 INFO:tasks.workunit.client.0.smithi060.stdout:4/545: fdatasync d6/d2f/d7d/fb6 0 2024-04-12T13:42:09.259 INFO:tasks.workunit.client.1.smithi110.stdout:5/543: getdents da/db/d3b/d40/da6 0 2024-04-12T13:42:09.260 INFO:tasks.workunit.client.0.smithi060.stdout:4/546: chown d6/d2f/d7d/c87 0 1 2024-04-12T13:42:09.262 INFO:tasks.workunit.client.1.smithi110.stdout:6/574: mkdir d7/d25/d2c/d4c/da6/dba 0 2024-04-12T13:42:09.264 INFO:tasks.workunit.client.0.smithi060.stdout:4/547: write d6/d21/f53 [4999747,119824] 0 2024-04-12T13:42:09.267 INFO:tasks.workunit.client.1.smithi110.stdout:6/575: dread - d7/d25/d30/d6b/fad zero size 2024-04-12T13:42:09.267 INFO:tasks.workunit.client.0.smithi060.stdout:8/520: rename d9/d1b/d3c/d60 to d9/d1b/d37/d4d/d63/d66/db3 0 2024-04-12T13:42:09.268 INFO:tasks.workunit.client.1.smithi110.stdout:9/659: dwrite df/d13/d2c/d9e/dd6/f73 [0,4194304] 0 2024-04-12T13:42:09.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/507: dwrite d0/d1b/f31 [4194304,4194304] 0 2024-04-12T13:42:09.270 INFO:tasks.workunit.client.1.smithi110.stdout:8/576: truncate d1/d3/d35/d3a/d41/fb0 204685 0 2024-04-12T13:42:09.271 INFO:tasks.workunit.client.1.smithi110.stdout:1/557: dwrite de/d15/f76 [0,4194304] 0 2024-04-12T13:42:09.273 INFO:tasks.workunit.client.1.smithi110.stdout:1/558: stat de/d14/f78 0 2024-04-12T13:42:09.276 INFO:tasks.workunit.client.1.smithi110.stdout:0/509: write d1/d8/d36/d63/f5d [288435,67908] 0 2024-04-12T13:42:09.278 INFO:tasks.workunit.client.1.smithi110.stdout:2/614: creat d6/dc/fbf x:0 0 0 2024-04-12T13:42:09.279 INFO:tasks.workunit.client.1.smithi110.stdout:5/544: chown da/c46 182 1 2024-04-12T13:42:09.279 INFO:tasks.workunit.client.0.smithi060.stdout:3/591: write d7/da/f84 [5396953,46661] 0 2024-04-12T13:42:09.280 INFO:tasks.workunit.client.1.smithi110.stdout:1/559: truncate de/d14/d34/d55/f5c 5184597 0 2024-04-12T13:42:09.282 INFO:tasks.workunit.client.1.smithi110.stdout:3/570: dread d5/dc/d31/d3b/f4a [4194304,4194304] 0 2024-04-12T13:42:09.287 INFO:tasks.workunit.client.1.smithi110.stdout:2/615: write d6/dc/d13/f9e [1243419,11789] 0 2024-04-12T13:42:09.287 INFO:tasks.workunit.client.1.smithi110.stdout:4/686: creat d0/d19/d1c/fe4 x:0 0 0 2024-04-12T13:42:09.288 INFO:tasks.workunit.client.1.smithi110.stdout:3/571: chown d5/dc/d20/d2d/d4e/d89/db4 11062477 1 2024-04-12T13:42:09.290 INFO:tasks.workunit.client.1.smithi110.stdout:1/560: truncate de/d14/d34/d55/f63 9386818 0 2024-04-12T13:42:09.292 INFO:tasks.workunit.client.1.smithi110.stdout:2/616: readlink d6/dc/dd/d49/d64/l42 0 2024-04-12T13:42:09.293 INFO:tasks.workunit.client.1.smithi110.stdout:7/578: sync 2024-04-12T13:42:09.293 INFO:tasks.workunit.client.0.smithi060.stdout:2/546: sync 2024-04-12T13:42:09.294 INFO:tasks.workunit.client.0.smithi060.stdout:1/649: sync 2024-04-12T13:42:09.294 INFO:tasks.workunit.client.0.smithi060.stdout:6/627: sync 2024-04-12T13:42:09.294 INFO:tasks.workunit.client.0.smithi060.stdout:8/521: creat d9/d1b/d2b/fb4 x:0 0 0 2024-04-12T13:42:09.298 INFO:tasks.workunit.client.0.smithi060.stdout:4/548: creat d6/d7/dd/d1a/d57/d63/d68/d94/fbf x:0 0 0 2024-04-12T13:42:09.301 INFO:tasks.workunit.client.0.smithi060.stdout:0/516: link d7/d41/f7f d7/d33/fb4 0 2024-04-12T13:42:09.301 INFO:tasks.workunit.client.1.smithi110.stdout:9/660: dread df/d13/d26/d37/fa4 [0,4194304] 0 2024-04-12T13:42:09.302 INFO:tasks.workunit.client.0.smithi060.stdout:7/508: mknod d0/d7/d43/d4d/cae 0 2024-04-12T13:42:09.308 INFO:tasks.workunit.client.1.smithi110.stdout:3/572: mknod d5/d86/cb9 0 2024-04-12T13:42:09.310 INFO:tasks.workunit.client.1.smithi110.stdout:6/576: creat d7/da4/fbb x:0 0 0 2024-04-12T13:42:09.312 INFO:tasks.workunit.client.1.smithi110.stdout:8/577: dwrite d1/d3/d35/d3a/d3e/d64/d85/f96 [0,4194304] 0 2024-04-12T13:42:09.314 INFO:tasks.workunit.client.1.smithi110.stdout:5/545: mkdir da/d2e/d45/d25/d9d/d79/dbe 0 2024-04-12T13:42:09.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/546: readlink da/db/l10 0 2024-04-12T13:42:09.323 INFO:tasks.workunit.client.1.smithi110.stdout:1/561: rename de/l6c to de/d14/d83/lbb 0 2024-04-12T13:42:09.325 INFO:tasks.workunit.client.0.smithi060.stdout:4/549: dwrite d6/d21/d29/f7f [0,4194304] 0 2024-04-12T13:42:09.326 INFO:tasks.workunit.client.1.smithi110.stdout:6/577: dwrite d7/d10/d1c/d2b/f91 [0,4194304] 0 2024-04-12T13:42:09.327 INFO:tasks.workunit.client.0.smithi060.stdout:3/592: dread d7/d17/d27/d36/d53/f6a [0,4194304] 0 2024-04-12T13:42:09.329 INFO:tasks.workunit.client.1.smithi110.stdout:2/617: symlink d6/dc/dd/d49/d64/d5d/lc0 0 2024-04-12T13:42:09.332 INFO:tasks.workunit.client.1.smithi110.stdout:2/618: read - d6/dc/dd/f47 zero size 2024-04-12T13:42:09.333 INFO:tasks.workunit.client.0.smithi060.stdout:8/522: rename d9/d1b/d37/c44 to d9/d1b/d3c/d6e/d7b/cb5 0 2024-04-12T13:42:09.335 INFO:tasks.workunit.client.1.smithi110.stdout:2/619: truncate d6/dc/d13/f9e 1429418 0 2024-04-12T13:42:09.336 INFO:tasks.workunit.client.1.smithi110.stdout:0/510: symlink d1/d27/la9 0 2024-04-12T13:42:09.336 INFO:tasks.workunit.client.1.smithi110.stdout:2/620: chown d6/dc/d1b/d57/d62 7888698 1 2024-04-12T13:42:09.340 INFO:tasks.workunit.client.0.smithi060.stdout:7/509: creat d0/d1b/d8c/faf x:0 0 0 2024-04-12T13:42:09.344 INFO:tasks.workunit.client.0.smithi060.stdout:5/554: write d6/d10/d12/d38/f40 [1129623,125115] 0 2024-04-12T13:42:09.348 INFO:tasks.workunit.client.1.smithi110.stdout:3/573: rmdir d5/dc/d31/d3b/d32 39 2024-04-12T13:42:09.348 INFO:tasks.workunit.client.0.smithi060.stdout:6/628: dwrite d1/d7/da/dc/d24/f91 [0,4194304] 0 2024-04-12T13:42:09.352 INFO:tasks.workunit.client.0.smithi060.stdout:5/555: write d6/dd/d1f/d25/d35/d50/d5f/f7f [1575954,121613] 0 2024-04-12T13:42:09.352 INFO:tasks.workunit.client.0.smithi060.stdout:2/547: creat d6/d10/d16/d36/fa7 x:0 0 0 2024-04-12T13:42:09.353 INFO:tasks.workunit.client.1.smithi110.stdout:8/578: mknod d1/d45/cb7 0 2024-04-12T13:42:09.353 INFO:tasks.workunit.client.1.smithi110.stdout:2/621: dwrite d6/dc/d1b/d8f/fa8 [0,4194304] 0 2024-04-12T13:42:09.355 INFO:tasks.workunit.client.0.smithi060.stdout:9/481: dwrite d4/d9/f2a [0,4194304] 0 2024-04-12T13:42:09.362 INFO:tasks.workunit.client.1.smithi110.stdout:5/547: creat da/d2e/d45/d29/d58/fbf x:0 0 0 2024-04-12T13:42:09.364 INFO:tasks.workunit.client.0.smithi060.stdout:4/550: creat d6/d7/dd/df/fc0 x:0 0 0 2024-04-12T13:42:09.365 INFO:tasks.workunit.client.1.smithi110.stdout:5/548: chown da/d2e/d45/d25/d9d/d7a/db5/lb7 1 1 2024-04-12T13:42:09.365 INFO:tasks.workunit.client.0.smithi060.stdout:8/523: mknod d9/d1b/d3c/d6e/d7b/cb6 0 2024-04-12T13:42:09.367 INFO:tasks.workunit.client.1.smithi110.stdout:7/579: rename d1/d3/l21 to d1/d1b/d70/lc3 0 2024-04-12T13:42:09.369 INFO:tasks.workunit.client.1.smithi110.stdout:7/580: readlink d1/d3/d4/d36/d76/l90 0 2024-04-12T13:42:09.369 INFO:tasks.workunit.client.1.smithi110.stdout:1/562: symlink de/d15/d32/d61/d96/lbc 0 2024-04-12T13:42:09.376 INFO:tasks.workunit.client.1.smithi110.stdout:0/511: mknod d1/d27/d6e/caa 0 2024-04-12T13:42:09.377 INFO:tasks.workunit.client.1.smithi110.stdout:0/512: stat d1/d8/d36/d51/d60/f70 0 2024-04-12T13:42:09.382 INFO:tasks.workunit.client.0.smithi060.stdout:3/593: dwrite d7/da/d3f/fac [4194304,4194304] 0 2024-04-12T13:42:09.385 INFO:tasks.workunit.client.0.smithi060.stdout:5/556: dwrite d6/d10/d12/d38/f40 [0,4194304] 0 2024-04-12T13:42:09.385 INFO:tasks.workunit.client.0.smithi060.stdout:6/629: creat d1/d7/da/dc/fdd x:0 0 0 2024-04-12T13:42:09.387 INFO:tasks.workunit.client.0.smithi060.stdout:1/650: dwrite fb [0,4194304] 0 2024-04-12T13:42:09.388 INFO:tasks.workunit.client.1.smithi110.stdout:8/579: dread d1/d3/d35/f6b [0,4194304] 0 2024-04-12T13:42:09.388 INFO:tasks.workunit.client.1.smithi110.stdout:5/549: mknod da/d2e/d45/d25/d9d/d79/d88/cc0 0 2024-04-12T13:42:09.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/482: chown d4/d9/d19/d21/d73/d67/f2b 495708414 1 2024-04-12T13:42:09.395 INFO:tasks.workunit.client.1.smithi110.stdout:7/581: rmdir d1/d3/d4/d36/d76 39 2024-04-12T13:42:09.402 INFO:tasks.workunit.client.0.smithi060.stdout:6/630: write d1/d7/da/dc/f29 [4106353,103274] 0 2024-04-12T13:42:09.406 INFO:tasks.workunit.client.1.smithi110.stdout:1/563: rename de/d15/l33 to de/d15/d32/d61/d6a/d72/lbd 0 2024-04-12T13:42:09.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/517: link d7/d41/l47 d7/d33/d5b/lb5 0 2024-04-12T13:42:09.413 INFO:tasks.workunit.client.1.smithi110.stdout:6/578: fdatasync d7/d10/d41/fab 0 2024-04-12T13:42:09.417 INFO:tasks.workunit.client.0.smithi060.stdout:8/524: dread d9/d1d/f6f [0,4194304] 0 2024-04-12T13:42:09.418 INFO:tasks.workunit.client.1.smithi110.stdout:4/687: truncate d0/d75/f9a 2360814 0 2024-04-12T13:42:09.421 INFO:tasks.workunit.client.1.smithi110.stdout:9/661: link df/d13/d2c/d2d/dc1/f74 df/d13/d3b/d40/d56/fdc 0 2024-04-12T13:42:09.429 INFO:tasks.workunit.client.1.smithi110.stdout:5/550: symlink da/d35/lc1 0 2024-04-12T13:42:09.432 INFO:tasks.workunit.client.1.smithi110.stdout:8/580: mknod d1/d3/d35/d3a/d41/d77/cb8 0 2024-04-12T13:42:09.436 INFO:tasks.workunit.client.0.smithi060.stdout:5/557: symlink d6/dd/d27/lb2 0 2024-04-12T13:42:09.440 INFO:tasks.workunit.client.1.smithi110.stdout:1/564: creat de/d15/d32/d61/d6a/d72/fbe x:0 0 0 2024-04-12T13:42:09.440 INFO:tasks.workunit.client.1.smithi110.stdout:3/574: sync 2024-04-12T13:42:09.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/631: rmdir d1/d7/da/dc/d24/d34 39 2024-04-12T13:42:09.450 INFO:tasks.workunit.client.1.smithi110.stdout:2/622: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:42:09.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/518: read d7/d9/d14/d35/d44/d49/d67/f76 [19143,29919] 0 2024-04-12T13:42:09.451 INFO:tasks.workunit.client.0.smithi060.stdout:4/551: dwrite d6/d7/dd/d1a/d19/f33 [0,4194304] 0 2024-04-12T13:42:09.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/548: creat d6/d56/fa8 x:0 0 0 2024-04-12T13:42:09.456 INFO:tasks.workunit.client.0.smithi060.stdout:3/594: write d7/d17/d27/d36/d53/f71 [938219,106934] 0 2024-04-12T13:42:09.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/549: chown d6/d10/d16/d36 298 1 2024-04-12T13:42:09.458 INFO:tasks.workunit.client.0.smithi060.stdout:2/550: dread - d6/d10/d2b/f9a zero size 2024-04-12T13:42:09.464 INFO:tasks.workunit.client.1.smithi110.stdout:9/662: dwrite df/d13/d26/f41 [0,4194304] 0 2024-04-12T13:42:09.478 INFO:tasks.workunit.client.1.smithi110.stdout:1/565: dwrite de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:09.487 INFO:tasks.workunit.client.1.smithi110.stdout:2/623: dread d6/f12 [0,4194304] 0 2024-04-12T13:42:09.495 INFO:tasks.workunit.client.1.smithi110.stdout:1/566: dread de/d14/f78 [0,4194304] 0 2024-04-12T13:42:09.502 INFO:tasks.workunit.client.0.smithi060.stdout:5/558: unlink d6/dd/d1f/d32/d46/f92 0 2024-04-12T13:42:09.505 INFO:tasks.workunit.client.0.smithi060.stdout:5/559: write d6/dd/d1f/f98 [223339,95462] 0 2024-04-12T13:42:09.509 INFO:tasks.workunit.client.0.smithi060.stdout:5/560: write d6/d10/d12/d38/f40 [2238802,62952] 0 2024-04-12T13:42:09.566 INFO:tasks.workunit.client.0.smithi060.stdout:7/510: getdents d0/d7/d43/d4d 0 2024-04-12T13:42:09.566 INFO:tasks.workunit.client.0.smithi060.stdout:7/511: write d0/d7/f55 [3327300,43695] 0 2024-04-12T13:42:09.569 INFO:tasks.workunit.client.1.smithi110.stdout:7/582: dwrite d1/f6b [0,4194304] 0 2024-04-12T13:42:09.571 INFO:tasks.workunit.client.1.smithi110.stdout:4/688: mknod d0/d19/d1c/ce5 0 2024-04-12T13:42:09.579 INFO:tasks.workunit.client.1.smithi110.stdout:0/513: creat d1/d8/fab x:0 0 0 2024-04-12T13:42:09.583 INFO:tasks.workunit.client.1.smithi110.stdout:5/551: fsync da/f11 0 2024-04-12T13:42:09.601 INFO:tasks.workunit.client.0.smithi060.stdout:3/595: unlink d7/d17/d27/f58 0 2024-04-12T13:42:09.603 INFO:tasks.workunit.client.0.smithi060.stdout:3/596: chown d7/d17/f90 1776 1 2024-04-12T13:42:09.614 INFO:tasks.workunit.client.0.smithi060.stdout:0/519: dread d7/d9/d14/d35/d44/d7d/f3b [0,4194304] 0 2024-04-12T13:42:09.616 INFO:tasks.workunit.client.1.smithi110.stdout:4/689: creat d0/de/d2c/d57/fe6 x:0 0 0 2024-04-12T13:42:09.617 INFO:tasks.workunit.client.1.smithi110.stdout:4/690: chown d0/d19/d26/d8a 46990 1 2024-04-12T13:42:09.618 INFO:tasks.workunit.client.0.smithi060.stdout:7/512: creat d0/fb0 x:0 0 0 2024-04-12T13:42:09.618 INFO:tasks.workunit.client.1.smithi110.stdout:0/514: readlink d1/d48/l97 0 2024-04-12T13:42:09.625 INFO:tasks.workunit.client.0.smithi060.stdout:6/632: getdents d1/d7/da/dc/dcb 0 2024-04-12T13:42:09.628 INFO:tasks.workunit.client.1.smithi110.stdout:9/663: fdatasync df/d13/d26/d37/fae 0 2024-04-12T13:42:09.630 INFO:tasks.workunit.client.1.smithi110.stdout:9/664: chown df/d13/d2c/d2d/l3c 230 1 2024-04-12T13:42:09.633 INFO:tasks.workunit.client.1.smithi110.stdout:2/624: mkdir d6/dc/dd/d49/d64/d4a/dc1 0 2024-04-12T13:42:09.635 INFO:tasks.workunit.client.0.smithi060.stdout:5/561: mknod d6/dd/d1f/d25/d53/d87/da6/cb3 0 2024-04-12T13:42:09.637 INFO:tasks.workunit.client.1.smithi110.stdout:7/583: dread d1/d3/d4/f9 [4194304,4194304] 0 2024-04-12T13:42:09.637 INFO:tasks.workunit.client.0.smithi060.stdout:0/520: mknod d7/d9/d14/d35/d44/d7d/cb6 0 2024-04-12T13:42:09.638 INFO:tasks.workunit.client.1.smithi110.stdout:7/584: write d1/f2b [2478503,41499] 0 2024-04-12T13:42:09.640 INFO:tasks.workunit.client.0.smithi060.stdout:7/513: mkdir d0/d7/d88/db1 0 2024-04-12T13:42:09.642 INFO:tasks.workunit.client.0.smithi060.stdout:9/483: link d4/d9/d19/d21/d73/l90 d4/d8/l9e 0 2024-04-12T13:42:09.642 INFO:tasks.workunit.client.0.smithi060.stdout:7/514: write d0/d3d/d74/f7e [4390542,91512] 0 2024-04-12T13:42:09.647 INFO:tasks.workunit.client.0.smithi060.stdout:4/552: creat d6/d7/dd/fc1 x:0 0 0 2024-04-12T13:42:09.648 INFO:tasks.workunit.client.1.smithi110.stdout:9/665: write df/d38/d6e/d7f/fb6 [499524,59957] 0 2024-04-12T13:42:09.659 INFO:tasks.workunit.client.0.smithi060.stdout:9/484: unlink d4/d8/f2c 0 2024-04-12T13:42:09.660 INFO:tasks.workunit.client.1.smithi110.stdout:7/585: creat d1/d3/d4/da6/fc4 x:0 0 0 2024-04-12T13:42:09.664 INFO:tasks.workunit.client.0.smithi060.stdout:7/515: mknod d0/d7/d92/cb2 0 2024-04-12T13:42:09.665 INFO:tasks.workunit.client.0.smithi060.stdout:7/516: chown d0/d7/d43/d4d/l6a 3000573 1 2024-04-12T13:42:09.668 INFO:tasks.workunit.client.0.smithi060.stdout:7/517: write d0/d3d/f8b [753374,47971] 0 2024-04-12T13:42:09.669 INFO:tasks.workunit.client.0.smithi060.stdout:7/518: chown d0/d1b/l44 46597 1 2024-04-12T13:42:09.670 INFO:tasks.workunit.client.1.smithi110.stdout:2/625: link d6/dc/dd/d49/faf d6/dc/dd/d49/d64/d8c/fc2 0 2024-04-12T13:42:09.670 INFO:tasks.workunit.client.1.smithi110.stdout:2/626: chown d6/dc/d9d 7 1 2024-04-12T13:42:09.671 INFO:tasks.workunit.client.0.smithi060.stdout:7/519: chown d0/d7/f33 95 1 2024-04-12T13:42:09.673 INFO:tasks.workunit.client.1.smithi110.stdout:7/586: unlink d1/d3/f20 0 2024-04-12T13:42:09.673 INFO:tasks.workunit.client.0.smithi060.stdout:7/520: read d0/d7/f5e [655909,63251] 0 2024-04-12T13:42:09.675 INFO:tasks.workunit.client.0.smithi060.stdout:0/521: creat d7/d9/d14/d35/fb7 x:0 0 0 2024-04-12T13:42:09.675 INFO:tasks.workunit.client.0.smithi060.stdout:7/521: fsync d0/d7/d43/d63/d6f/f82 0 2024-04-12T13:42:09.676 INFO:tasks.workunit.client.0.smithi060.stdout:0/522: stat d7/d9/d14/f25 0 2024-04-12T13:42:09.676 INFO:tasks.workunit.client.0.smithi060.stdout:7/522: stat d0/d78/c86 0 2024-04-12T13:42:09.679 INFO:tasks.workunit.client.1.smithi110.stdout:9/666: link df/d13/d2c/d9e/dd6/da3/fb5 df/d13/d2c/d2d/d39/d4f/fdd 0 2024-04-12T13:42:09.681 INFO:tasks.workunit.client.1.smithi110.stdout:2/627: mkdir d6/dc/d13/d80/d8d/dc3 0 2024-04-12T13:42:09.681 INFO:tasks.workunit.client.1.smithi110.stdout:9/667: chown df/d13/d26/d37/fcc 0 1 2024-04-12T13:42:09.682 INFO:tasks.workunit.client.0.smithi060.stdout:9/485: creat d4/d33/d65/d7a/f9f x:0 0 0 2024-04-12T13:42:09.683 INFO:tasks.workunit.client.0.smithi060.stdout:0/523: read d7/f3e [1808231,69130] 0 2024-04-12T13:42:09.688 INFO:tasks.workunit.client.1.smithi110.stdout:9/668: mkdir df/d13/d3b/d40/dde 0 2024-04-12T13:42:09.706 INFO:tasks.workunit.client.1.smithi110.stdout:7/587: creat d1/d1b/d3d/fc5 x:0 0 0 2024-04-12T13:42:09.711 INFO:tasks.workunit.client.1.smithi110.stdout:7/588: mkdir d1/d1b/dc6 0 2024-04-12T13:42:09.711 INFO:tasks.workunit.client.1.smithi110.stdout:6/579: write d7/f39 [6344754,58460] 0 2024-04-12T13:42:09.712 INFO:tasks.workunit.client.0.smithi060.stdout:7/523: dread d0/f21 [0,4194304] 0 2024-04-12T13:42:09.712 INFO:tasks.workunit.client.1.smithi110.stdout:7/589: readlink d1/d1b/d74/l7d 0 2024-04-12T13:42:09.713 INFO:tasks.workunit.client.0.smithi060.stdout:7/524: chown d0/d1b/c34 4 1 2024-04-12T13:42:09.714 INFO:tasks.workunit.client.1.smithi110.stdout:7/590: readlink d1/l61 0 2024-04-12T13:42:09.715 INFO:tasks.workunit.client.0.smithi060.stdout:0/524: dread d7/d9/f1a [0,4194304] 0 2024-04-12T13:42:09.716 INFO:tasks.workunit.client.0.smithi060.stdout:1/651: rename d1e/d29/d65/fa5 to d1e/d23/fe4 0 2024-04-12T13:42:09.716 INFO:tasks.workunit.client.1.smithi110.stdout:6/580: truncate d7/d10/d1c/d2b/d48/fae 864845 0 2024-04-12T13:42:09.718 INFO:tasks.workunit.client.0.smithi060.stdout:7/525: chown d0/d7/c50 79244316 1 2024-04-12T13:42:09.719 INFO:tasks.workunit.client.1.smithi110.stdout:6/581: dread d7/d10/d1c/d2b/d48/f5e [0,4194304] 0 2024-04-12T13:42:09.719 INFO:tasks.workunit.client.1.smithi110.stdout:7/591: mknod d1/d1b/d3d/d68/d97/da5/da7/cc7 0 2024-04-12T13:42:09.723 INFO:tasks.workunit.client.0.smithi060.stdout:5/562: rename d6/dd/d1f/d25/d42/d6b/f80 to d6/dd/d1f/d32/d46/fb4 0 2024-04-12T13:42:09.730 INFO:tasks.workunit.client.0.smithi060.stdout:7/526: write d0/d7/f5e [39082,7791] 0 2024-04-12T13:42:09.734 INFO:tasks.workunit.client.0.smithi060.stdout:0/525: mknod d7/d9/d4c/d8e/cb8 0 2024-04-12T13:42:09.735 INFO:tasks.workunit.client.1.smithi110.stdout:6/582: dwrite d7/d10/d1c/d4d/f8e [0,4194304] 0 2024-04-12T13:42:09.736 INFO:tasks.workunit.client.1.smithi110.stdout:7/592: dwrite d1/d1b/fbe [0,4194304] 0 2024-04-12T13:42:09.736 INFO:tasks.workunit.client.1.smithi110.stdout:8/581: write d1/f5c [4221434,96569] 0 2024-04-12T13:42:09.738 INFO:tasks.workunit.client.1.smithi110.stdout:7/593: stat d1/d31/d7b/lba 0 2024-04-12T13:42:09.741 INFO:tasks.workunit.client.0.smithi060.stdout:0/526: rmdir d7/d41 39 2024-04-12T13:42:09.746 INFO:tasks.workunit.client.1.smithi110.stdout:7/594: truncate d1/d31/f7a 387249 0 2024-04-12T13:42:09.747 INFO:tasks.workunit.client.0.smithi060.stdout:1/652: dread d1e/d1f/f4b [4194304,4194304] 0 2024-04-12T13:42:09.747 INFO:tasks.workunit.client.0.smithi060.stdout:9/486: creat d4/d9/fa0 x:0 0 0 2024-04-12T13:42:09.747 INFO:tasks.workunit.client.0.smithi060.stdout:8/525: truncate d9/d1b/d3c/d6e/fa5 2196210 0 2024-04-12T13:42:09.748 INFO:tasks.workunit.client.0.smithi060.stdout:8/526: readlink d9/d1b/d84/da0/l1c 0 2024-04-12T13:42:09.750 INFO:tasks.workunit.client.1.smithi110.stdout:8/582: dread d1/d3/d3c/d5a/d6f/d83/f8c [0,4194304] 0 2024-04-12T13:42:09.759 INFO:tasks.workunit.client.0.smithi060.stdout:8/527: mknod d9/d1b/d37/d4d/d63/d66/db3/d65/cb7 0 2024-04-12T13:42:09.764 INFO:tasks.workunit.client.1.smithi110.stdout:8/583: link d1/d3/c1b d1/d3/cb9 0 2024-04-12T13:42:09.766 INFO:tasks.workunit.client.1.smithi110.stdout:7/595: getdents d1/d3/d4/d55/d56 0 2024-04-12T13:42:09.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/653: link d1e/d23/d49/f83 d1e/dcc/fe5 0 2024-04-12T13:42:09.767 INFO:tasks.workunit.client.1.smithi110.stdout:3/575: truncate d5/dc/d20/d2d/f42 1222069 0 2024-04-12T13:42:09.769 INFO:tasks.workunit.client.1.smithi110.stdout:8/584: chown d1/d3/d35/l68 2036 1 2024-04-12T13:42:09.770 INFO:tasks.workunit.client.0.smithi060.stdout:5/563: mknod d6/dd/d1f/d25/cb5 0 2024-04-12T13:42:09.770 INFO:tasks.workunit.client.1.smithi110.stdout:3/576: chown d5/dc/d31/c3d 115200 1 2024-04-12T13:42:09.774 INFO:tasks.workunit.client.1.smithi110.stdout:7/596: creat d1/d3/d4/dbf/db6/fc8 x:0 0 0 2024-04-12T13:42:09.775 INFO:tasks.workunit.client.1.smithi110.stdout:7/597: chown d1/d3/d43/l4f 2137 1 2024-04-12T13:42:09.777 INFO:tasks.workunit.client.1.smithi110.stdout:7/598: write d1/d1b/fbe [3000324,69601] 0 2024-04-12T13:42:09.779 INFO:tasks.workunit.client.1.smithi110.stdout:8/585: rmdir d1/d3/d35/d3a/d41/d77 39 2024-04-12T13:42:09.779 INFO:tasks.workunit.client.0.smithi060.stdout:1/654: dread d1e/d23/d2e/d30/f36 [0,4194304] 0 2024-04-12T13:42:09.779 INFO:tasks.workunit.client.0.smithi060.stdout:9/487: dread d4/d8/d32/f5b [0,4194304] 0 2024-04-12T13:42:09.780 INFO:tasks.workunit.client.1.smithi110.stdout:8/586: fdatasync d1/d5/dd/fa0 0 2024-04-12T13:42:09.782 INFO:tasks.workunit.client.0.smithi060.stdout:5/564: mknod d6/dd/d1f/d32/d3d/cb6 0 2024-04-12T13:42:09.784 INFO:tasks.workunit.client.1.smithi110.stdout:5/552: write da/d2e/d45/faa [5230029,18267] 0 2024-04-12T13:42:09.784 INFO:tasks.workunit.client.1.smithi110.stdout:7/599: dread d1/d3/d4/da6/f8d [0,4194304] 0 2024-04-12T13:42:09.785 INFO:tasks.workunit.client.1.smithi110.stdout:8/587: write d1/d3/d35/d3a/d84/fa2 [977241,84385] 0 2024-04-12T13:42:09.789 INFO:tasks.workunit.client.1.smithi110.stdout:8/588: dread d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:09.790 INFO:tasks.workunit.client.0.smithi060.stdout:1/655: symlink d1e/d23/d2e/d5e/d68/d9a/de1/le6 0 2024-04-12T13:42:09.793 INFO:tasks.workunit.client.0.smithi060.stdout:9/488: creat d4/fa1 x:0 0 0 2024-04-12T13:42:09.795 INFO:tasks.workunit.client.1.smithi110.stdout:0/515: link d1/f14 d1/d8/d36/fac 0 2024-04-12T13:42:09.797 INFO:tasks.workunit.client.0.smithi060.stdout:9/489: chown d4/d9/d19/f4e 108 1 2024-04-12T13:42:09.799 INFO:tasks.workunit.client.1.smithi110.stdout:3/577: creat d5/fba x:0 0 0 2024-04-12T13:42:09.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/490: fsync d4/d9/f2a 0 2024-04-12T13:42:09.800 INFO:tasks.workunit.client.0.smithi060.stdout:3/597: dwrite d7/d17/d27/d36/db0/fb7 [0,4194304] 0 2024-04-12T13:42:09.800 INFO:tasks.workunit.client.1.smithi110.stdout:4/691: dwrite d0/d19/f85 [0,4194304] 0 2024-04-12T13:42:09.801 INFO:tasks.workunit.client.0.smithi060.stdout:1/656: dread d1e/d23/d2e/d30/f5c [0,4194304] 0 2024-04-12T13:42:09.803 INFO:tasks.workunit.client.0.smithi060.stdout:5/565: dwrite d6/dd/d1f/d25/d53/d87/f9d [0,4194304] 0 2024-04-12T13:42:09.804 INFO:tasks.workunit.client.1.smithi110.stdout:0/516: mknod d1/d8/d36/d63/d4a/cad 0 2024-04-12T13:42:09.806 INFO:tasks.workunit.client.1.smithi110.stdout:8/589: dwrite d1/d3/d35/d3a/d3e/d4f/f5e [4194304,4194304] 0 2024-04-12T13:42:09.814 INFO:tasks.workunit.client.1.smithi110.stdout:1/567: rename de/f4d to de/d1d/fbf 0 2024-04-12T13:42:09.816 INFO:tasks.workunit.client.1.smithi110.stdout:9/669: sync 2024-04-12T13:42:09.817 INFO:tasks.workunit.client.0.smithi060.stdout:3/598: creat d7/d17/d19/d96/fc5 x:0 0 0 2024-04-12T13:42:09.819 INFO:tasks.workunit.client.0.smithi060.stdout:1/657: unlink d1e/d46/faa 0 2024-04-12T13:42:09.820 INFO:tasks.workunit.client.0.smithi060.stdout:3/599: dread - d7/da/fa9 zero size 2024-04-12T13:42:09.822 INFO:tasks.workunit.client.1.smithi110.stdout:8/590: unlink d1/d3/d3c/l37 0 2024-04-12T13:42:09.827 INFO:tasks.workunit.client.1.smithi110.stdout:4/692: mknod d0/d13/ce7 0 2024-04-12T13:42:09.830 INFO:tasks.workunit.client.0.smithi060.stdout:5/566: rename d6/dd/d1f/d25/d42/d52/l94 to d6/dd/d1f/d32/d46/lb7 0 2024-04-12T13:42:09.831 INFO:tasks.workunit.client.0.smithi060.stdout:7/527: rmdir d0/d7 39 2024-04-12T13:42:09.836 INFO:tasks.workunit.client.0.smithi060.stdout:6/633: dwrite d1/d7/da/dc/f3b [0,4194304] 0 2024-04-12T13:42:09.837 INFO:tasks.workunit.client.1.smithi110.stdout:7/600: rename d1/d1b/d3d/d68/d97/da5/cbd to d1/d3/d4/d55/d56/d72/cc9 0 2024-04-12T13:42:09.841 INFO:tasks.workunit.client.0.smithi060.stdout:1/658: mkdir d1e/d29/d65/de7 0 2024-04-12T13:42:09.842 INFO:tasks.workunit.client.0.smithi060.stdout:1/659: chown d1e/d23/d49 420532 1 2024-04-12T13:42:09.843 INFO:tasks.workunit.client.1.smithi110.stdout:0/517: symlink d1/d8/d36/lae 0 2024-04-12T13:42:09.847 INFO:tasks.workunit.client.0.smithi060.stdout:3/600: mknod d7/d17/d27/d36/d53/da2/cc6 0 2024-04-12T13:42:09.851 INFO:tasks.workunit.client.1.smithi110.stdout:9/670: creat df/d38/fdf x:0 0 0 2024-04-12T13:42:09.856 INFO:tasks.workunit.client.1.smithi110.stdout:8/591: mkdir d1/d5/dd/d31/dba 0 2024-04-12T13:42:09.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/567: truncate d6/dd/d1f/d25/d42/d6b/f76 1956653 0 2024-04-12T13:42:09.859 INFO:tasks.workunit.client.0.smithi060.stdout:5/568: chown d6/dd/d1f/c78 13995449 1 2024-04-12T13:42:09.862 INFO:tasks.workunit.client.0.smithi060.stdout:1/660: symlink d1e/d29/d65/le8 0 2024-04-12T13:42:09.863 INFO:tasks.workunit.client.0.smithi060.stdout:3/601: creat d7/d17/d27/fc7 x:0 0 0 2024-04-12T13:42:09.867 INFO:tasks.workunit.client.1.smithi110.stdout:2/628: write d6/dc/dd/f22 [102973,64147] 0 2024-04-12T13:42:09.867 INFO:tasks.workunit.client.0.smithi060.stdout:6/634: rename d1/c4 to d1/d7d/cde 0 2024-04-12T13:42:09.871 INFO:tasks.workunit.client.0.smithi060.stdout:6/635: read d1/d7/da/dc/d24/d30/d52/d5e/fbb [650078,22648] 0 2024-04-12T13:42:09.873 INFO:tasks.workunit.client.0.smithi060.stdout:7/528: symlink d0/d7/d43/d63/d90/lb3 0 2024-04-12T13:42:09.878 INFO:tasks.workunit.client.0.smithi060.stdout:3/602: unlink d7/d17/d27/d36/d53/da2/dbc/lbd 0 2024-04-12T13:42:09.886 INFO:tasks.workunit.client.0.smithi060.stdout:3/603: rename d7/d17/d27/d36/d53/fc2 to d7/d17/d27/d36/d53/fc8 0 2024-04-12T13:42:09.889 INFO:tasks.workunit.client.0.smithi060.stdout:7/529: dwrite d0/d1b/d8c/f91 [0,4194304] 0 2024-04-12T13:42:09.895 INFO:tasks.workunit.client.0.smithi060.stdout:3/604: rmdir d7/d17 39 2024-04-12T13:42:09.895 INFO:tasks.workunit.client.0.smithi060.stdout:6/636: link d1/c58 d1/d7/da/dc/d24/d30/d52/d5e/d7b/cdf 0 2024-04-12T13:42:09.898 INFO:tasks.workunit.client.0.smithi060.stdout:2/551: symlink d6/la9 0 2024-04-12T13:42:09.899 INFO:tasks.workunit.client.0.smithi060.stdout:7/530: chown d0/d1b/f72 11614 1 2024-04-12T13:42:09.916 INFO:tasks.workunit.client.0.smithi060.stdout:2/552: mkdir d6/d10/daa 0 2024-04-12T13:42:09.917 INFO:tasks.workunit.client.0.smithi060.stdout:6/637: truncate d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/fd3 1800623 0 2024-04-12T13:42:09.920 INFO:tasks.workunit.client.0.smithi060.stdout:7/531: creat d0/d78/da0/fb4 x:0 0 0 2024-04-12T13:42:09.922 INFO:tasks.workunit.client.1.smithi110.stdout:6/583: dwrite d7/f19 [0,4194304] 0 2024-04-12T13:42:09.927 INFO:tasks.workunit.client.0.smithi060.stdout:6/638: mknod d1/d7d/ce0 0 2024-04-12T13:42:09.936 INFO:tasks.workunit.client.0.smithi060.stdout:3/605: rename d7/da to d7/d17/d19/dc9 0 2024-04-12T13:42:09.939 INFO:tasks.workunit.client.0.smithi060.stdout:6/639: write d1/d7/da/d20/f36 [370929,49259] 0 2024-04-12T13:42:09.942 INFO:tasks.workunit.client.1.smithi110.stdout:6/584: dwrite d7/d10/d1c/f29 [4194304,4194304] 0 2024-04-12T13:42:09.943 INFO:tasks.workunit.client.0.smithi060.stdout:6/640: dread - d1/d7/da/dc/d24/f46 zero size 2024-04-12T13:42:09.946 INFO:tasks.workunit.client.1.smithi110.stdout:5/553: write da/db/d15/f59 [1713783,36208] 0 2024-04-12T13:42:09.947 INFO:tasks.workunit.client.0.smithi060.stdout:3/606: creat d7/d17/d27/d36/d53/da2/fca x:0 0 0 2024-04-12T13:42:09.950 INFO:tasks.workunit.client.0.smithi060.stdout:7/532: getdents d0/d3d/d74 0 2024-04-12T13:42:09.954 INFO:tasks.workunit.client.0.smithi060.stdout:6/641: rmdir d1/d7/da/dc/d24/d30/d52/d5e/d7e 39 2024-04-12T13:42:09.954 INFO:tasks.workunit.client.0.smithi060.stdout:7/533: read d0/d3d/d74/f7e [2731328,72562] 0 2024-04-12T13:42:09.957 INFO:tasks.workunit.client.0.smithi060.stdout:6/642: fsync d1/d7/da/dc/d24/f91 0 2024-04-12T13:42:09.963 INFO:tasks.workunit.client.1.smithi110.stdout:4/693: mknod d0/d19/d26/d8a/de0/d7e/ce8 0 2024-04-12T13:42:09.965 INFO:tasks.workunit.client.0.smithi060.stdout:7/534: unlink d0/d7/f55 0 2024-04-12T13:42:09.967 INFO:tasks.workunit.client.1.smithi110.stdout:7/601: mknod d1/d3/d43/cca 0 2024-04-12T13:42:09.968 INFO:tasks.workunit.client.0.smithi060.stdout:6/643: unlink d1/d7/da/dc/f6d 0 2024-04-12T13:42:09.970 INFO:tasks.workunit.client.1.smithi110.stdout:0/518: rmdir d1/d48 39 2024-04-12T13:42:09.971 INFO:tasks.workunit.client.0.smithi060.stdout:6/644: write d1/d7/da/fc4 [2662041,64252] 0 2024-04-12T13:42:09.971 INFO:tasks.workunit.client.1.smithi110.stdout:3/578: dwrite d5/f40 [0,4194304] 0 2024-04-12T13:42:09.972 INFO:tasks.workunit.client.1.smithi110.stdout:1/568: mkdir de/d15/d32/d61/d6a/dac/dc0 0 2024-04-12T13:42:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:7/535: rmdir d0/d7/d43/d63/d90 39 2024-04-12T13:42:09.980 INFO:tasks.workunit.client.1.smithi110.stdout:8/592: fdatasync d1/d5/dd/d31/f3d 0 2024-04-12T13:42:09.980 INFO:tasks.workunit.client.0.smithi060.stdout:7/536: stat d0/d7/f73 0 2024-04-12T13:42:09.983 INFO:tasks.workunit.client.1.smithi110.stdout:2/629: mknod d6/d53/cc4 0 2024-04-12T13:42:09.986 INFO:tasks.workunit.client.1.smithi110.stdout:2/630: chown d6/dc/dd/d49/d64/d25/c2e 0 1 2024-04-12T13:42:09.986 INFO:tasks.workunit.client.0.smithi060.stdout:6/645: rmdir d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1 39 2024-04-12T13:42:09.994 INFO:tasks.workunit.client.0.smithi060.stdout:7/537: read d0/d7/f10 [2672057,58679] 0 2024-04-12T13:42:09.996 INFO:tasks.workunit.client.0.smithi060.stdout:7/538: fdatasync d0/fb0 0 2024-04-12T13:42:09.996 INFO:tasks.workunit.client.0.smithi060.stdout:1/661: dwrite d1e/d1f/f22 [0,4194304] 0 2024-04-12T13:42:09.997 INFO:tasks.workunit.client.1.smithi110.stdout:6/585: rmdir d7/d25/d30/d44/da3 39 2024-04-12T13:42:10.002 INFO:tasks.workunit.client.1.smithi110.stdout:4/694: readlink d0/d19/d1c/l28 0 2024-04-12T13:42:10.004 INFO:tasks.workunit.client.1.smithi110.stdout:4/695: readlink d0/d19/d26/d8a/de0/l9e 0 2024-04-12T13:42:10.014 INFO:tasks.workunit.client.1.smithi110.stdout:0/519: creat d1/d8/d36/d51/d60/faf x:0 0 0 2024-04-12T13:42:10.015 INFO:tasks.workunit.client.0.smithi060.stdout:1/662: getdents d1e/d23/d2e/d5e 0 2024-04-12T13:42:10.016 INFO:tasks.workunit.client.0.smithi060.stdout:1/663: readlink d1e/d23/l3f 0 2024-04-12T13:42:10.016 INFO:tasks.workunit.client.0.smithi060.stdout:7/539: link d0/d3d/c4e d0/d7/d88/db1/cb5 0 2024-04-12T13:42:10.020 INFO:tasks.workunit.client.0.smithi060.stdout:1/664: creat d1e/d94/fe9 x:0 0 0 2024-04-12T13:42:10.022 INFO:tasks.workunit.client.0.smithi060.stdout:7/540: mkdir d0/d1b/d8c/db6 0 2024-04-12T13:42:10.023 INFO:tasks.workunit.client.0.smithi060.stdout:0/527: sync 2024-04-12T13:42:10.024 INFO:tasks.workunit.client.0.smithi060.stdout:4/553: sync 2024-04-12T13:42:10.024 INFO:tasks.workunit.client.1.smithi110.stdout:7/602: symlink d1/d1b/lcb 0 2024-04-12T13:42:10.026 INFO:tasks.workunit.client.1.smithi110.stdout:4/696: dwrite d0/d19/d26/d8a/dd7/fd0 [0,4194304] 0 2024-04-12T13:42:10.029 INFO:tasks.workunit.client.0.smithi060.stdout:1/665: mknod d1e/d94/cea 0 2024-04-12T13:42:10.030 INFO:tasks.workunit.client.1.smithi110.stdout:6/586: dread d7/d10/d1c/d2b/d3a/d82/fb4 [0,4194304] 0 2024-04-12T13:42:10.031 INFO:tasks.workunit.client.1.smithi110.stdout:3/579: fsync d5/f28 0 2024-04-12T13:42:10.035 INFO:tasks.workunit.client.0.smithi060.stdout:4/554: mkdir d6/db7/dc2 0 2024-04-12T13:42:10.037 INFO:tasks.workunit.client.1.smithi110.stdout:9/671: creat df/d13/d2c/d2d/dc1/d83/fe0 x:0 0 0 2024-04-12T13:42:10.037 INFO:tasks.workunit.client.0.smithi060.stdout:7/541: dwrite d0/d1b/f31 [4194304,4194304] 0 2024-04-12T13:42:10.041 INFO:tasks.workunit.client.0.smithi060.stdout:0/528: unlink d7/d9/d14/d35/d44/d7d/l22 0 2024-04-12T13:42:10.042 INFO:tasks.workunit.client.1.smithi110.stdout:2/631: dread d6/dc/dd/d49/d64/d4a/f5b [0,4194304] 0 2024-04-12T13:42:10.049 INFO:tasks.workunit.client.1.smithi110.stdout:4/697: mkdir d0/de/d32/d61/de9 0 2024-04-12T13:42:10.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/555: fsync d6/d7/dd/fe 0 2024-04-12T13:42:10.051 INFO:tasks.workunit.client.0.smithi060.stdout:7/542: mkdir d0/d7/d92/db7 0 2024-04-12T13:42:10.052 INFO:tasks.workunit.client.0.smithi060.stdout:3/607: write d7/d17/d19/d33/f77 [3258346,112781] 0 2024-04-12T13:42:10.053 INFO:tasks.workunit.client.0.smithi060.stdout:4/556: chown d6/d7/db 3549 1 2024-04-12T13:42:10.054 INFO:tasks.workunit.client.1.smithi110.stdout:5/554: sync 2024-04-12T13:42:10.054 INFO:tasks.workunit.client.1.smithi110.stdout:4/698: readlink d0/de/d2c/d57/lb6 0 2024-04-12T13:42:10.056 INFO:tasks.workunit.client.1.smithi110.stdout:5/555: fdatasync da/d2e/d45/d29/f50 0 2024-04-12T13:42:10.057 INFO:tasks.workunit.client.1.smithi110.stdout:4/699: write d0/de/d2c/fc2 [4594409,39242] 0 2024-04-12T13:42:10.058 INFO:tasks.workunit.client.1.smithi110.stdout:1/569: creat de/d15/fc1 x:0 0 0 2024-04-12T13:42:10.061 INFO:tasks.workunit.client.0.smithi060.stdout:7/543: creat d0/d78/da0/fb8 x:0 0 0 2024-04-12T13:42:10.063 INFO:tasks.workunit.client.0.smithi060.stdout:7/544: chown d0/d7/d88/db1 5792 1 2024-04-12T13:42:10.063 INFO:tasks.workunit.client.1.smithi110.stdout:2/632: dwrite d6/dc/d6f/f96 [0,4194304] 0 2024-04-12T13:42:10.063 INFO:tasks.workunit.client.0.smithi060.stdout:3/608: readlink d7/lba 0 2024-04-12T13:42:10.066 INFO:tasks.workunit.client.0.smithi060.stdout:3/609: write d7/d17/d27/d36/db0/fc1 [942580,26486] 0 2024-04-12T13:42:10.066 INFO:tasks.workunit.client.1.smithi110.stdout:0/520: mknod d1/d48/cb0 0 2024-04-12T13:42:10.071 INFO:tasks.workunit.client.1.smithi110.stdout:6/587: symlink d7/lbc 0 2024-04-12T13:42:10.081 INFO:tasks.workunit.client.1.smithi110.stdout:1/570: symlink de/d14/d34/d55/d6b/lc2 0 2024-04-12T13:42:10.082 INFO:tasks.workunit.client.0.smithi060.stdout:6/646: dwrite d1/d7/da/dc/d24/d30/d52/f60 [0,4194304] 0 2024-04-12T13:42:10.084 INFO:tasks.workunit.client.1.smithi110.stdout:0/521: dwrite d1/d8/d36/d51/f62 [0,4194304] 0 2024-04-12T13:42:10.089 INFO:tasks.workunit.client.1.smithi110.stdout:0/522: write d1/d8/d36/d63/d4a/f73 [2283797,4961] 0 2024-04-12T13:42:10.089 INFO:tasks.workunit.client.1.smithi110.stdout:9/672: dwrite df/d13/d2c/d2d/d39/d3a/fd1 [0,4194304] 0 2024-04-12T13:42:10.089 INFO:tasks.workunit.client.1.smithi110.stdout:5/556: rename da/db/d15/fba to da/d2e/d45/d25/d9d/d7a/dae/fc2 0 2024-04-12T13:42:10.089 INFO:tasks.workunit.client.1.smithi110.stdout:6/588: dwrite d7/d10/d1c/d2b/d3a/f81 [0,4194304] 0 2024-04-12T13:42:10.096 INFO:tasks.workunit.client.1.smithi110.stdout:2/633: chown d6/dc/d13/f43 2525096 1 2024-04-12T13:42:10.096 INFO:tasks.workunit.client.1.smithi110.stdout:7/603: getdents d1/d3/d4/d55/d56 0 2024-04-12T13:42:10.097 INFO:tasks.workunit.client.1.smithi110.stdout:4/700: unlink d0/ff 0 2024-04-12T13:42:10.099 INFO:tasks.workunit.client.0.smithi060.stdout:1/666: dwrite d1e/d23/d2e/d30/f5c [0,4194304] 0 2024-04-12T13:42:10.113 INFO:tasks.workunit.client.1.smithi110.stdout:9/673: rename df/d13/d2c/lac to df/d13/d3b/le1 0 2024-04-12T13:42:10.113 INFO:tasks.workunit.client.1.smithi110.stdout:8/593: dwrite d1/d3/d3c/d5a/f82 [0,4194304] 0 2024-04-12T13:42:10.118 INFO:tasks.workunit.client.1.smithi110.stdout:5/557: mkdir da/d2e/d45/d25/d9d/d7a/dc3 0 2024-04-12T13:42:10.118 INFO:tasks.workunit.client.1.smithi110.stdout:6/589: symlink d7/d25/d2c/d4c/d77/lbd 0 2024-04-12T13:42:10.120 INFO:tasks.workunit.client.1.smithi110.stdout:8/594: chown d1/d3/d35/d43/l6e 50359575 1 2024-04-12T13:42:10.123 INFO:tasks.workunit.client.1.smithi110.stdout:8/595: readlink d1/d3/d3c/d75/d79/l88 0 2024-04-12T13:42:10.129 INFO:tasks.workunit.client.1.smithi110.stdout:3/580: rename d5/dc/d31/d3b/d32/d3e/d87 to d5/dc/d31/d74/d75/dbb 0 2024-04-12T13:42:10.131 INFO:tasks.workunit.client.1.smithi110.stdout:2/634: dwrite d6/dc/d13/d80/f9b [0,4194304] 0 2024-04-12T13:42:10.135 INFO:tasks.workunit.client.0.smithi060.stdout:0/529: link d7/d9/d14/d35/d44/l52 d7/d9/d14/d35/d44/d49/d74/lb9 0 2024-04-12T13:42:10.135 INFO:tasks.workunit.client.1.smithi110.stdout:3/581: chown d5/dc/l26 3869 1 2024-04-12T13:42:10.137 INFO:tasks.workunit.client.1.smithi110.stdout:1/571: creat de/d14/d34/fc3 x:0 0 0 2024-04-12T13:42:10.139 INFO:tasks.workunit.client.1.smithi110.stdout:9/674: dwrite df/d38/fdf [0,4194304] 0 2024-04-12T13:42:10.139 INFO:tasks.workunit.client.1.smithi110.stdout:1/572: write de/d14/d34/d55/f9a [715844,74355] 0 2024-04-12T13:42:10.142 INFO:tasks.workunit.client.1.smithi110.stdout:5/558: mknod da/d2e/d45/d25/d9d/d79/cc4 0 2024-04-12T13:42:10.143 INFO:tasks.workunit.client.1.smithi110.stdout:5/559: readlink da/d5c/la3 0 2024-04-12T13:42:10.147 INFO:tasks.workunit.client.0.smithi060.stdout:7/545: creat d0/d7/d43/d63/d90/fb9 x:0 0 0 2024-04-12T13:42:10.150 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:09 smithi060 ceph-mon[29097]: pgmap v29: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 272 MiB/s wr, 518 op/s 2024-04-12T13:42:10.151 INFO:tasks.workunit.client.0.smithi060.stdout:6/647: rmdir d1/d7/da/dc/d24 39 2024-04-12T13:42:10.153 INFO:tasks.workunit.client.1.smithi110.stdout:7/604: rename d1/d3/d4/f2e to d1/d3/d4/d36/da1/fcc 0 2024-04-12T13:42:10.157 INFO:tasks.workunit.client.0.smithi060.stdout:1/667: unlink d1e/d1f/c72 0 2024-04-12T13:42:10.159 INFO:tasks.workunit.client.1.smithi110.stdout:2/635: fdatasync d6/f12 0 2024-04-12T13:42:10.161 INFO:tasks.workunit.client.1.smithi110.stdout:5/560: dwrite da/d2e/d45/d29/d58/f6d [0,4194304] 0 2024-04-12T13:42:10.162 INFO:tasks.workunit.client.0.smithi060.stdout:1/668: read - d1e/d94/fe9 zero size 2024-04-12T13:42:10.163 INFO:tasks.workunit.client.1.smithi110.stdout:0/523: getdents d1/d56 0 2024-04-12T13:42:10.168 INFO:tasks.workunit.client.1.smithi110.stdout:1/573: rmdir de/d15 39 2024-04-12T13:42:10.170 INFO:tasks.workunit.client.0.smithi060.stdout:6/648: dwrite d1/d7/da/fc4 [0,4194304] 0 2024-04-12T13:42:10.174 INFO:tasks.workunit.client.0.smithi060.stdout:0/530: symlink d7/d9/d14/lba 0 2024-04-12T13:42:10.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/610: creat d7/d17/d19/d33/fcb x:0 0 0 2024-04-12T13:42:10.181 INFO:tasks.workunit.client.0.smithi060.stdout:1/669: mkdir d1e/d23/d2e/d30/d51/d85/deb 0 2024-04-12T13:42:10.184 INFO:tasks.workunit.client.1.smithi110.stdout:4/701: write d0/d13/f2d [2459572,69985] 0 2024-04-12T13:42:10.185 INFO:tasks.workunit.client.1.smithi110.stdout:9/675: symlink df/d13/d2c/d2d/dc1/d83/d63/le2 0 2024-04-12T13:42:10.187 INFO:tasks.workunit.client.0.smithi060.stdout:6/649: chown d1/d7/da/dc/d24/d30/d52/d78 14223 1 2024-04-12T13:42:10.189 INFO:tasks.workunit.client.0.smithi060.stdout:3/611: fsync d7/d17/f1a 0 2024-04-12T13:42:10.190 INFO:tasks.workunit.client.1.smithi110.stdout:9/676: dread - df/d13/d2c/d2d/dc1/d83/d63/fc7 zero size 2024-04-12T13:42:10.192 INFO:tasks.workunit.client.1.smithi110.stdout:2/636: creat d6/dc/dd/d49/d64/d4a/d55/d82/d84/fc5 x:0 0 0 2024-04-12T13:42:10.193 INFO:tasks.workunit.client.0.smithi060.stdout:1/670: rename d1e/d29/d37/c61 to d1e/d29/d65/cec 0 2024-04-12T13:42:10.197 INFO:tasks.workunit.client.0.smithi060.stdout:4/557: dwrite d6/d7/dd/d1a/d56/f5c [0,4194304] 0 2024-04-12T13:42:10.198 INFO:tasks.workunit.client.1.smithi110.stdout:5/561: dread da/d2e/f30 [0,4194304] 0 2024-04-12T13:42:10.198 INFO:tasks.workunit.client.1.smithi110.stdout:0/524: creat d1/d56/fb1 x:0 0 0 2024-04-12T13:42:10.200 INFO:tasks.workunit.client.0.smithi060.stdout:3/612: symlink d7/d17/d19/d33/d63/d9b/lcc 0 2024-04-12T13:42:10.201 INFO:tasks.workunit.client.1.smithi110.stdout:6/590: link d7/d25/d30/d44/d3d/c63 d7/d25/d2c/d4c/da6/cbe 0 2024-04-12T13:42:10.203 INFO:tasks.workunit.client.1.smithi110.stdout:3/582: dread d5/dc/d31/d74/f62 [0,4194304] 0 2024-04-12T13:42:10.206 INFO:tasks.workunit.client.0.smithi060.stdout:1/671: creat d1e/d1f/fed x:0 0 0 2024-04-12T13:42:10.206 INFO:tasks.workunit.client.1.smithi110.stdout:8/596: sync 2024-04-12T13:42:10.207 INFO:tasks.workunit.client.1.smithi110.stdout:8/597: chown d1/f94 171 1 2024-04-12T13:42:10.208 INFO:tasks.workunit.client.0.smithi060.stdout:0/531: link d7/d9/d4c/c73 d7/d9/d14/d4a/cbb 0 2024-04-12T13:42:10.211 INFO:tasks.workunit.client.0.smithi060.stdout:4/558: dwrite d6/d21/f5d [0,4194304] 0 2024-04-12T13:42:10.220 INFO:tasks.workunit.client.1.smithi110.stdout:9/677: dwrite df/d13/d2c/d2d/f93 [0,4194304] 0 2024-04-12T13:42:10.222 INFO:tasks.workunit.client.1.smithi110.stdout:9/678: stat df/d13/d2c/d2d/d39/c5a 0 2024-04-12T13:42:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:09 smithi110 ceph-mon[36055]: pgmap v29: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 272 MiB/s wr, 518 op/s 2024-04-12T13:42:10.233 INFO:tasks.workunit.client.1.smithi110.stdout:7/605: sync 2024-04-12T13:42:10.236 INFO:tasks.workunit.client.0.smithi060.stdout:1/672: creat d1e/d23/d49/d4e/fee x:0 0 0 2024-04-12T13:42:10.237 INFO:tasks.workunit.client.0.smithi060.stdout:8/528: sync 2024-04-12T13:42:10.238 INFO:tasks.workunit.client.0.smithi060.stdout:1/673: chown d1e/d1f/f4b 30 1 2024-04-12T13:42:10.241 INFO:tasks.workunit.client.0.smithi060.stdout:1/674: chown d1e/d46/f6f 54130251 1 2024-04-12T13:42:10.242 INFO:tasks.workunit.client.1.smithi110.stdout:0/525: rename d1/d8/d36/d63 to d1/d48/db2 0 2024-04-12T13:42:10.247 INFO:tasks.workunit.client.1.smithi110.stdout:6/591: mkdir d7/d10/d1c/d2b/d3a/dbf 0 2024-04-12T13:42:10.255 INFO:tasks.workunit.client.0.smithi060.stdout:0/532: rename d7/d9/de/d7c/da0 to d7/d41/dbc 0 2024-04-12T13:42:10.256 INFO:tasks.workunit.client.0.smithi060.stdout:8/529: dwrite d9/d1d/d5e/f93 [0,4194304] 0 2024-04-12T13:42:10.260 INFO:tasks.workunit.client.0.smithi060.stdout:3/613: dwrite d7/d17/d19/dc9/d3f/d5c/d25/d4d/f75 [0,4194304] 0 2024-04-12T13:42:10.262 INFO:tasks.workunit.client.1.smithi110.stdout:2/637: mkdir d6/dc/dd/dc6 0 2024-04-12T13:42:10.265 INFO:tasks.workunit.client.0.smithi060.stdout:3/614: chown d7/d17/d19/d33/d63/d6d/d91 175091 1 2024-04-12T13:42:10.265 INFO:tasks.workunit.client.1.smithi110.stdout:2/638: truncate d6/dc/dd/f81 1055425 0 2024-04-12T13:42:10.267 INFO:tasks.workunit.client.0.smithi060.stdout:8/530: truncate d9/d1b/d2b/d82/f8e 520493 0 2024-04-12T13:42:10.269 INFO:tasks.workunit.client.0.smithi060.stdout:0/533: creat d7/d9/d14/d35/d44/d8c/fbd x:0 0 0 2024-04-12T13:42:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:4/559: creat d6/d21/fc3 x:0 0 0 2024-04-12T13:42:10.274 INFO:tasks.workunit.client.0.smithi060.stdout:3/615: write d7/d17/d19/dc9/d3f/d5c/d25/f5f [26107,128134] 0 2024-04-12T13:42:10.277 INFO:tasks.workunit.client.1.smithi110.stdout:7/606: read d1/d3/d4/f2d [744100,6154] 0 2024-04-12T13:42:10.279 INFO:tasks.workunit.client.1.smithi110.stdout:7/607: stat d1/d3/d4/dbf/f95 0 2024-04-12T13:42:10.280 INFO:tasks.workunit.client.0.smithi060.stdout:8/531: creat d9/d1b/d2b/d82/d8a/fb8 x:0 0 0 2024-04-12T13:42:10.280 INFO:tasks.workunit.client.1.smithi110.stdout:0/526: creat d1/d5e/fb3 x:0 0 0 2024-04-12T13:42:10.282 INFO:tasks.workunit.client.0.smithi060.stdout:0/534: rmdir d7/d9/d14/d35/d44/d49/d74 39 2024-04-12T13:42:10.285 INFO:tasks.workunit.client.0.smithi060.stdout:4/560: fsync d6/d7/dd/df/f93 0 2024-04-12T13:42:10.285 INFO:tasks.workunit.client.0.smithi060.stdout:1/675: dwrite d1e/d29/d65/fb5 [0,4194304] 0 2024-04-12T13:42:10.286 INFO:tasks.workunit.client.1.smithi110.stdout:6/592: mknod d7/d25/d2c/d4c/d77/cc0 0 2024-04-12T13:42:10.288 INFO:tasks.workunit.client.0.smithi060.stdout:1/676: truncate d1e/d94/fe9 1009088 0 2024-04-12T13:42:10.290 INFO:tasks.workunit.client.1.smithi110.stdout:3/583: mknod d5/dc/d31/d3b/cbc 0 2024-04-12T13:42:10.293 INFO:tasks.workunit.client.0.smithi060.stdout:8/532: creat d9/d1b/d84/fb9 x:0 0 0 2024-04-12T13:42:10.296 INFO:tasks.workunit.client.1.smithi110.stdout:8/598: link d1/d3/d35/d3a/fac d1/d5/d1f/fbb 0 2024-04-12T13:42:10.296 INFO:tasks.workunit.client.0.smithi060.stdout:8/533: write d9/d1b/d3c/d6e/f9c [523790,33728] 0 2024-04-12T13:42:10.297 INFO:tasks.workunit.client.1.smithi110.stdout:2/639: creat d6/dc/dd/d49/d64/d4a/d51/fc7 x:0 0 0 2024-04-12T13:42:10.301 INFO:tasks.workunit.client.1.smithi110.stdout:9/679: symlink df/d13/d26/le3 0 2024-04-12T13:42:10.302 INFO:tasks.workunit.client.1.smithi110.stdout:1/574: creat de/d15/fc4 x:0 0 0 2024-04-12T13:42:10.303 INFO:tasks.workunit.client.1.smithi110.stdout:7/608: mknod d1/d3/d4/d55/d56/ccd 0 2024-04-12T13:42:10.304 INFO:tasks.workunit.client.1.smithi110.stdout:7/609: dread - d1/d3/d4/d55/fc0 zero size 2024-04-12T13:42:10.305 INFO:tasks.workunit.client.1.smithi110.stdout:4/702: write d0/de/d2c/d57/f94 [4309852,88732] 0 2024-04-12T13:42:10.307 INFO:tasks.workunit.client.1.smithi110.stdout:6/593: mknod d7/d25/d30/d44/d3d/cc1 0 2024-04-12T13:42:10.313 INFO:tasks.workunit.client.1.smithi110.stdout:9/680: symlink df/d13/d2c/d9e/le4 0 2024-04-12T13:42:10.314 INFO:tasks.workunit.client.1.smithi110.stdout:1/575: rename de/d15/d32/d61/d96/fa2 to de/d15/dab/fc5 0 2024-04-12T13:42:10.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/562: getdents da/d2e/d45/d25/d9d/d7a/dae 0 2024-04-12T13:42:10.317 INFO:tasks.workunit.client.1.smithi110.stdout:4/703: stat d0/de/d32/d61/ca8 0 2024-04-12T13:42:10.320 INFO:tasks.workunit.client.1.smithi110.stdout:2/640: write d6/dc/dd/d49/d64/d4a/d55/f68 [1698827,23839] 0 2024-04-12T13:42:10.323 INFO:tasks.workunit.client.1.smithi110.stdout:8/599: truncate d1/d5/dd/d31/f3d 2732744 0 2024-04-12T13:42:10.323 INFO:tasks.workunit.client.1.smithi110.stdout:9/681: creat df/d13/d2c/d9e/dd6/da3/fe5 x:0 0 0 2024-04-12T13:42:10.324 INFO:tasks.workunit.client.1.smithi110.stdout:1/576: dread de/d14/d34/d55/f9a [0,4194304] 0 2024-04-12T13:42:10.325 INFO:tasks.workunit.client.1.smithi110.stdout:3/584: getdents d5/dc/d20/d2d/d4e 0 2024-04-12T13:42:10.327 INFO:tasks.workunit.client.1.smithi110.stdout:2/641: dread - d6/dc/dd/d49/d64/f5a zero size 2024-04-12T13:42:10.328 INFO:tasks.workunit.client.1.smithi110.stdout:2/642: chown d6/d18 695960207 1 2024-04-12T13:42:10.328 INFO:tasks.workunit.client.1.smithi110.stdout:6/594: write d7/d25/d30/d44/d3d/f69 [571994,3798] 0 2024-04-12T13:42:10.329 INFO:tasks.workunit.client.1.smithi110.stdout:1/577: mknod de/d15/dab/cc6 0 2024-04-12T13:42:10.330 INFO:tasks.workunit.client.1.smithi110.stdout:8/600: mknod d1/d5/cbc 0 2024-04-12T13:42:10.332 INFO:tasks.workunit.client.1.smithi110.stdout:5/563: dread da/d2e/f30 [0,4194304] 0 2024-04-12T13:42:10.335 INFO:tasks.workunit.client.1.smithi110.stdout:2/643: write d6/dc/fbf [121158,56254] 0 2024-04-12T13:42:10.336 INFO:tasks.workunit.client.1.smithi110.stdout:3/585: truncate d5/dc/d31/d3b/d32/d3e/f41 2469371 0 2024-04-12T13:42:10.336 INFO:tasks.workunit.client.1.smithi110.stdout:8/601: write d1/d3/f24 [1111946,93041] 0 2024-04-12T13:42:10.337 INFO:tasks.workunit.client.1.smithi110.stdout:6/595: creat d7/d10/d7e/d85/fc2 x:0 0 0 2024-04-12T13:42:10.340 INFO:tasks.workunit.client.1.smithi110.stdout:1/578: mkdir de/d14/d34/d55/d6b/dc7 0 2024-04-12T13:42:10.340 INFO:tasks.workunit.client.1.smithi110.stdout:8/602: chown d1/l1a 2834570 1 2024-04-12T13:42:10.340 INFO:tasks.workunit.client.1.smithi110.stdout:5/564: readlink da/db/l9f 0 2024-04-12T13:42:10.342 INFO:tasks.workunit.client.1.smithi110.stdout:2/644: creat d6/d53/fc8 x:0 0 0 2024-04-12T13:42:10.346 INFO:tasks.workunit.client.1.smithi110.stdout:4/704: dwrite d0/d19/d1c/fe4 [0,4194304] 0 2024-04-12T13:42:10.350 INFO:tasks.workunit.client.1.smithi110.stdout:7/610: dwrite d1/d3/d4/d36/da1/fcc [0,4194304] 0 2024-04-12T13:42:10.352 INFO:tasks.workunit.client.1.smithi110.stdout:6/596: rename d7/d10/d1c/d2b/d3a/d82 to d7/d25/d30/d9e/dc3 0 2024-04-12T13:42:10.355 INFO:tasks.workunit.client.1.smithi110.stdout:7/611: mknod d1/d1b/d3d/d68/cce 0 2024-04-12T13:42:10.356 INFO:tasks.workunit.client.1.smithi110.stdout:8/603: rename d1/d7/d20/l76 to d1/d3/d35/d3a/d3e/d4f/lbd 0 2024-04-12T13:42:10.358 INFO:tasks.workunit.client.1.smithi110.stdout:2/645: truncate d6/dc/dd/d49/d64/d5d/f9f 756234 0 2024-04-12T13:42:10.364 INFO:tasks.workunit.client.0.smithi060.stdout:1/677: write d1e/d23/f25 [4144570,84864] 0 2024-04-12T13:42:10.365 INFO:tasks.workunit.client.0.smithi060.stdout:3/616: getdents d7/d17 0 2024-04-12T13:42:10.368 INFO:tasks.workunit.client.0.smithi060.stdout:1/678: write d1e/f45 [1639345,66994] 0 2024-04-12T13:42:10.371 INFO:tasks.workunit.client.0.smithi060.stdout:3/617: mknod d7/d17/d27/da7/ccd 0 2024-04-12T13:42:10.375 INFO:tasks.workunit.client.0.smithi060.stdout:8/534: dwrite d9/d1b/d37/d4d/d63/f85 [0,4194304] 0 2024-04-12T13:42:10.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/618: rmdir d7/d17/d27/d36/d53 39 2024-04-12T13:42:10.378 INFO:tasks.workunit.client.0.smithi060.stdout:4/561: dwrite d6/d7/db/d85/f4e [0,4194304] 0 2024-04-12T13:42:10.381 INFO:tasks.workunit.client.0.smithi060.stdout:1/679: creat d1e/d23/d49/d4e/fef x:0 0 0 2024-04-12T13:42:10.383 INFO:tasks.workunit.client.0.smithi060.stdout:8/535: creat d9/d1d/d5e/fba x:0 0 0 2024-04-12T13:42:10.386 INFO:tasks.workunit.client.0.smithi060.stdout:8/536: readlink d9/d1b/d3c/l9d 0 2024-04-12T13:42:10.389 INFO:tasks.workunit.client.0.smithi060.stdout:8/537: symlink d9/d1b/d2b/d82/d8a/lbb 0 2024-04-12T13:42:10.390 INFO:tasks.workunit.client.0.smithi060.stdout:3/619: dread d7/d17/d27/d36/d53/f71 [0,4194304] 0 2024-04-12T13:42:10.391 INFO:tasks.workunit.client.0.smithi060.stdout:8/538: dread - d9/d1b/d84/da1/fa8 zero size 2024-04-12T13:42:10.392 INFO:tasks.workunit.client.0.smithi060.stdout:8/539: chown d9/d1d/d5e 27 1 2024-04-12T13:42:10.394 INFO:tasks.workunit.client.0.smithi060.stdout:3/620: mkdir d7/d17/d27/da7/dbe/dce 0 2024-04-12T13:42:10.396 INFO:tasks.workunit.client.0.smithi060.stdout:8/540: creat d9/d1b/d37/d48/fbc x:0 0 0 2024-04-12T13:42:10.398 INFO:tasks.workunit.client.0.smithi060.stdout:3/621: mknod d7/ccf 0 2024-04-12T13:42:10.400 INFO:tasks.workunit.client.0.smithi060.stdout:1/680: dwrite d1e/f28 [4194304,4194304] 0 2024-04-12T13:42:10.401 INFO:tasks.workunit.client.0.smithi060.stdout:4/562: truncate d6/d7/dd/d1a/d56/d8d/fab 221539 0 2024-04-12T13:42:10.404 INFO:tasks.workunit.client.0.smithi060.stdout:3/622: write d7/d17/d19/dc9/d3f/d5c/d25/d4d/f75 [4810380,6766] 0 2024-04-12T13:42:10.406 INFO:tasks.workunit.client.0.smithi060.stdout:4/563: symlink d6/d2f/lc4 0 2024-04-12T13:42:10.407 INFO:tasks.workunit.client.1.smithi110.stdout:0/527: sync 2024-04-12T13:42:10.408 INFO:tasks.workunit.client.1.smithi110.stdout:7/612: symlink d1/d3/d4/d55/d82/db5/lcf 0 2024-04-12T13:42:10.410 INFO:tasks.workunit.client.0.smithi060.stdout:3/623: creat d7/d17/d19/d33/d63/d9b/fd0 x:0 0 0 2024-04-12T13:42:10.412 INFO:tasks.workunit.client.0.smithi060.stdout:8/541: dread d9/d1b/d37/f39 [0,4194304] 0 2024-04-12T13:42:10.415 INFO:tasks.workunit.client.0.smithi060.stdout:3/624: fsync d7/d17/d19/f85 0 2024-04-12T13:42:10.418 INFO:tasks.workunit.client.1.smithi110.stdout:7/613: dread - d1/d3/d4/d55/fc0 zero size 2024-04-12T13:42:10.419 INFO:tasks.workunit.client.1.smithi110.stdout:1/579: dwrite de/d15/d32/d61/f9e [0,4194304] 0 2024-04-12T13:42:10.420 INFO:tasks.workunit.client.0.smithi060.stdout:3/625: truncate d7/f9f 217628 0 2024-04-12T13:42:10.420 INFO:tasks.workunit.client.0.smithi060.stdout:5/569: sync 2024-04-12T13:42:10.420 INFO:tasks.workunit.client.0.smithi060.stdout:9/491: sync 2024-04-12T13:42:10.420 INFO:tasks.workunit.client.1.smithi110.stdout:0/528: symlink d1/d27/d31/d67/lb4 0 2024-04-12T13:42:10.420 INFO:tasks.workunit.client.0.smithi060.stdout:8/542: mkdir d9/d1b/d3c/d6e/dbd 0 2024-04-12T13:42:10.423 INFO:tasks.workunit.client.1.smithi110.stdout:3/586: dwrite d5/f99 [0,4194304] 0 2024-04-12T13:42:10.423 INFO:tasks.workunit.client.0.smithi060.stdout:3/626: readlink d7/d17/d19/l7a 0 2024-04-12T13:42:10.423 INFO:tasks.workunit.client.0.smithi060.stdout:4/564: rename d6/d7/dd/d1a/d19/f52 to d6/d21/fc5 0 2024-04-12T13:42:10.426 INFO:tasks.workunit.client.0.smithi060.stdout:5/570: write d6/dd/d27/f44 [4293261,95463] 0 2024-04-12T13:42:10.427 INFO:tasks.workunit.client.1.smithi110.stdout:4/705: dwrite d0/fc [0,4194304] 0 2024-04-12T13:42:10.427 INFO:tasks.workunit.client.0.smithi060.stdout:1/681: dwrite d1e/f33 [0,4194304] 0 2024-04-12T13:42:10.428 INFO:tasks.workunit.client.1.smithi110.stdout:7/614: rmdir d1/d3/d4/d36 39 2024-04-12T13:42:10.431 INFO:tasks.workunit.client.1.smithi110.stdout:7/615: fsync d1/d1b/d74/fbb 0 2024-04-12T13:42:10.431 INFO:tasks.workunit.client.0.smithi060.stdout:9/492: creat d4/d9/d19/d21/d73/d67/fa2 x:0 0 0 2024-04-12T13:42:10.433 INFO:tasks.workunit.client.1.smithi110.stdout:2/646: creat d6/dc/dd/d49/d64/fc9 x:0 0 0 2024-04-12T13:42:10.434 INFO:tasks.workunit.client.0.smithi060.stdout:8/543: creat d9/d1b/d2b/fbe x:0 0 0 2024-04-12T13:42:10.436 INFO:tasks.workunit.client.1.smithi110.stdout:3/587: read d5/dc/d31/d74/f80 [4087047,98848] 0 2024-04-12T13:42:10.438 INFO:tasks.workunit.client.1.smithi110.stdout:1/580: creat de/d7b/fc8 x:0 0 0 2024-04-12T13:42:10.439 INFO:tasks.workunit.client.0.smithi060.stdout:4/565: fsync d6/d7/dd/df/f23 0 2024-04-12T13:42:10.440 INFO:tasks.workunit.client.0.smithi060.stdout:5/571: fsync d6/dd/faa 0 2024-04-12T13:42:10.442 INFO:tasks.workunit.client.1.smithi110.stdout:8/604: dwrite d1/d3/d35/d3a/d84/fb6 [0,4194304] 0 2024-04-12T13:42:10.442 INFO:tasks.workunit.client.1.smithi110.stdout:3/588: chown d5/dc/d31/d3b/f6b 60 1 2024-04-12T13:42:10.443 INFO:tasks.workunit.client.0.smithi060.stdout:4/566: stat d6/d7/dd/d1a/d19/d42/f9c 0 2024-04-12T13:42:10.446 INFO:tasks.workunit.client.1.smithi110.stdout:1/581: truncate de/d15/fc4 129557 0 2024-04-12T13:42:10.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/627: rename d7/d17/d19/dc9/d3f/fac to d7/d17/d19/d33/d63/d9b/dc0/fd1 0 2024-04-12T13:42:10.450 INFO:tasks.workunit.client.0.smithi060.stdout:3/628: dread - d7/d17/d19/d33/fcb zero size 2024-04-12T13:42:10.450 INFO:tasks.workunit.client.0.smithi060.stdout:1/682: mkdir d1e/d23/d2e/d5e/df0 0 2024-04-12T13:42:10.451 INFO:tasks.workunit.client.1.smithi110.stdout:4/706: rmdir d0/d13 39 2024-04-12T13:42:10.452 INFO:tasks.workunit.client.0.smithi060.stdout:3/629: chown d7/d17/d19/f85 1414 1 2024-04-12T13:42:10.457 INFO:tasks.workunit.client.1.smithi110.stdout:5/565: dread da/d2e/d45/d25/d9d/d7a/db5/d8f/f7b [4194304,4194304] 0 2024-04-12T13:42:10.459 INFO:tasks.workunit.client.0.smithi060.stdout:8/544: dread d9/d1d/f33 [4194304,4194304] 0 2024-04-12T13:42:10.459 INFO:tasks.workunit.client.1.smithi110.stdout:9/682: sync 2024-04-12T13:42:10.460 INFO:tasks.workunit.client.1.smithi110.stdout:0/529: dread d1/f2c [0,4194304] 0 2024-04-12T13:42:10.460 INFO:tasks.workunit.client.1.smithi110.stdout:7/616: creat d1/d3/d4/d55/d82/fd0 x:0 0 0 2024-04-12T13:42:10.464 INFO:tasks.workunit.client.1.smithi110.stdout:3/589: fsync d5/f1f 0 2024-04-12T13:42:10.466 INFO:tasks.workunit.client.1.smithi110.stdout:8/605: mkdir d1/d3/dbe 0 2024-04-12T13:42:10.470 INFO:tasks.workunit.client.0.smithi060.stdout:1/683: rename d1e/d29/fc4 to d1e/d23/d49/d4e/ff1 0 2024-04-12T13:42:10.471 INFO:tasks.workunit.client.1.smithi110.stdout:4/707: dread - d0/de/d2c/d57/fa4 zero size 2024-04-12T13:42:10.471 INFO:tasks.workunit.client.0.smithi060.stdout:8/545: dread d9/d1b/d37/d4d/f5a [0,4194304] 0 2024-04-12T13:42:10.474 INFO:tasks.workunit.client.1.smithi110.stdout:4/708: write d0/d19/d1c/fad [900340,108239] 0 2024-04-12T13:42:10.475 INFO:tasks.workunit.client.1.smithi110.stdout:5/566: unlink da/d5c/c67 0 2024-04-12T13:42:10.480 INFO:tasks.workunit.client.0.smithi060.stdout:3/630: dread d7/d17/d19/dc9/f84 [0,4194304] 0 2024-04-12T13:42:10.481 INFO:tasks.workunit.client.0.smithi060.stdout:5/572: mkdir d6/d10/db8 0 2024-04-12T13:42:10.482 INFO:tasks.workunit.client.1.smithi110.stdout:3/590: dwrite d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:10.483 INFO:tasks.workunit.client.1.smithi110.stdout:0/530: creat d1/d48/db2/fb5 x:0 0 0 2024-04-12T13:42:10.485 INFO:tasks.workunit.client.1.smithi110.stdout:3/591: chown d5/dc/d31/d3b/f9d 21339284 1 2024-04-12T13:42:10.485 INFO:tasks.workunit.client.0.smithi060.stdout:1/684: dread d1e/f45 [0,4194304] 0 2024-04-12T13:42:10.485 INFO:tasks.workunit.client.0.smithi060.stdout:4/567: dread d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:42:10.488 INFO:tasks.workunit.client.1.smithi110.stdout:3/592: truncate d5/dc/d31/d3b/d5b/f9a 1510141 0 2024-04-12T13:42:10.489 INFO:tasks.workunit.client.0.smithi060.stdout:4/568: read d6/d7/dd/d1a/d19/d42/d7c/f9a [1327164,40692] 0 2024-04-12T13:42:10.491 INFO:tasks.workunit.client.0.smithi060.stdout:4/569: dread - d6/d7/dd/fc1 zero size 2024-04-12T13:42:10.493 INFO:tasks.workunit.client.1.smithi110.stdout:8/606: creat d1/d3/d35/d43/d9f/fbf x:0 0 0 2024-04-12T13:42:10.494 INFO:tasks.workunit.client.0.smithi060.stdout:5/573: mknod d6/dd/d27/cb9 0 2024-04-12T13:42:10.495 INFO:tasks.workunit.client.1.smithi110.stdout:2/647: creat d6/dc/dd/d49/d64/fca x:0 0 0 2024-04-12T13:42:10.498 INFO:tasks.workunit.client.0.smithi060.stdout:9/493: dwrite d4/d9/d19/d21/f27 [4194304,4194304] 0 2024-04-12T13:42:10.499 INFO:tasks.workunit.client.1.smithi110.stdout:5/567: fdatasync f9 0 2024-04-12T13:42:10.503 INFO:tasks.workunit.client.1.smithi110.stdout:4/709: creat d0/d19/d26/d8a/de0/d7e/fea x:0 0 0 2024-04-12T13:42:10.504 INFO:tasks.workunit.client.1.smithi110.stdout:7/617: unlink d1/d31/l6f 0 2024-04-12T13:42:10.505 INFO:tasks.workunit.client.1.smithi110.stdout:4/710: write d0/d19/f5c [1307655,114452] 0 2024-04-12T13:42:10.506 INFO:tasks.workunit.client.1.smithi110.stdout:7/618: fsync d1/f28 0 2024-04-12T13:42:10.506 INFO:tasks.workunit.client.1.smithi110.stdout:8/607: dread d1/d3/d35/d3a/d84/fb6 [0,4194304] 0 2024-04-12T13:42:10.507 INFO:tasks.workunit.client.0.smithi060.stdout:4/570: fsync d6/d7/db/f4b 0 2024-04-12T13:42:10.508 INFO:tasks.workunit.client.1.smithi110.stdout:6/597: sync 2024-04-12T13:42:10.513 INFO:tasks.workunit.client.1.smithi110.stdout:8/608: read d1/d3/d35/d3a/d3e/d64/d85/f96 [2965783,48523] 0 2024-04-12T13:42:10.513 INFO:tasks.workunit.client.1.smithi110.stdout:1/582: write de/d15/d32/d5e/d79/f7a [5124336,40647] 0 2024-04-12T13:42:10.517 INFO:tasks.workunit.client.1.smithi110.stdout:2/648: fdatasync d6/dc/dd/d49/d64/d5d/f71 0 2024-04-12T13:42:10.517 INFO:tasks.workunit.client.0.smithi060.stdout:2/553: sync 2024-04-12T13:42:10.518 INFO:tasks.workunit.client.0.smithi060.stdout:7/546: sync 2024-04-12T13:42:10.519 INFO:tasks.workunit.client.1.smithi110.stdout:2/649: readlink d6/dc/dd/d49/d64/l5c 0 2024-04-12T13:42:10.520 INFO:tasks.workunit.client.0.smithi060.stdout:2/554: read - d6/d10/d2b/d60/f93 zero size 2024-04-12T13:42:10.524 INFO:tasks.workunit.client.0.smithi060.stdout:3/631: dwrite d7/d17/d27/d36/d53/f8c [0,4194304] 0 2024-04-12T13:42:10.526 INFO:tasks.workunit.client.0.smithi060.stdout:1/685: write d1e/d23/fe4 [1048361,69164] 0 2024-04-12T13:42:10.529 INFO:tasks.workunit.client.0.smithi060.stdout:9/494: mknod d4/ca3 0 2024-04-12T13:42:10.530 INFO:tasks.workunit.client.1.smithi110.stdout:9/683: link df/d13/d2c/d2d/dc1/d83/d5d/f7e df/d8a/fe6 0 2024-04-12T13:42:10.531 INFO:tasks.workunit.client.1.smithi110.stdout:7/619: dread d1/d3/d4/d55/d82/f66 [0,4194304] 0 2024-04-12T13:42:10.531 INFO:tasks.workunit.client.0.smithi060.stdout:1/686: dread d1e/d23/d2e/d30/f5f [0,4194304] 0 2024-04-12T13:42:10.532 INFO:tasks.workunit.client.0.smithi060.stdout:7/547: creat d0/d1b/da4/fba x:0 0 0 2024-04-12T13:42:10.534 INFO:tasks.workunit.client.0.smithi060.stdout:8/546: getdents d9/d1b/d37/d4d 0 2024-04-12T13:42:10.535 INFO:tasks.workunit.client.0.smithi060.stdout:4/571: write d6/d7/dd/d1a/f60 [2306596,60654] 0 2024-04-12T13:42:10.540 INFO:tasks.workunit.client.1.smithi110.stdout:8/609: creat d1/d5/dd/fc0 x:0 0 0 2024-04-12T13:42:10.542 INFO:tasks.workunit.client.1.smithi110.stdout:5/568: dwrite da/db/d15/f1b [0,4194304] 0 2024-04-12T13:42:10.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/574: creat d6/dd/d1f/d25/fba x:0 0 0 2024-04-12T13:42:10.544 INFO:tasks.workunit.client.1.smithi110.stdout:8/610: write d1/d3/d35/d3a/d3e/d4f/f5e [8642232,62853] 0 2024-04-12T13:42:10.547 INFO:tasks.workunit.client.1.smithi110.stdout:2/650: unlink d6/dc/dd/d49/d64/f5a 0 2024-04-12T13:42:10.548 INFO:tasks.workunit.client.0.smithi060.stdout:3/632: write d7/d17/d27/d36/f3c [250638,20419] 0 2024-04-12T13:42:10.550 INFO:tasks.workunit.client.1.smithi110.stdout:8/611: dread d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:10.550 INFO:tasks.workunit.client.0.smithi060.stdout:1/687: symlink d1e/d23/d2e/d30/lf2 0 2024-04-12T13:42:10.552 INFO:tasks.workunit.client.1.smithi110.stdout:0/531: creat d1/d8/d36/fb6 x:0 0 0 2024-04-12T13:42:10.552 INFO:tasks.workunit.client.1.smithi110.stdout:0/532: read - d1/d8/d36/d51/d60/faf zero size 2024-04-12T13:42:10.553 INFO:tasks.workunit.client.0.smithi060.stdout:8/547: creat d9/d1b/d37/d4d/d63/d66/d8b/fbf x:0 0 0 2024-04-12T13:42:10.555 INFO:tasks.workunit.client.1.smithi110.stdout:3/593: dwrite d5/dc/f19 [0,4194304] 0 2024-04-12T13:42:10.558 INFO:tasks.workunit.client.0.smithi060.stdout:4/572: dwrite d6/d21/fc3 [0,4194304] 0 2024-04-12T13:42:10.561 INFO:tasks.workunit.client.1.smithi110.stdout:9/684: symlink df/d13/d2c/d2d/dc1/d83/d63/le7 0 2024-04-12T13:42:10.568 INFO:tasks.workunit.client.0.smithi060.stdout:1/688: creat d1e/d29/d65/ff3 x:0 0 0 2024-04-12T13:42:10.572 INFO:tasks.workunit.client.0.smithi060.stdout:3/633: mknod d7/d17/d19/d33/d63/d9b/dc0/cd2 0 2024-04-12T13:42:10.575 INFO:tasks.workunit.client.0.smithi060.stdout:7/548: write d0/f47 [352552,129111] 0 2024-04-12T13:42:10.575 INFO:tasks.workunit.client.0.smithi060.stdout:6/650: sync 2024-04-12T13:42:10.576 INFO:tasks.workunit.client.0.smithi060.stdout:0/535: sync 2024-04-12T13:42:10.576 INFO:tasks.workunit.client.0.smithi060.stdout:8/548: creat d9/d1b/fc0 x:0 0 0 2024-04-12T13:42:10.581 INFO:tasks.workunit.client.1.smithi110.stdout:2/651: readlink d6/d53/l7e 0 2024-04-12T13:42:10.586 INFO:tasks.workunit.client.0.smithi060.stdout:2/555: getdents d6/d10/d2b/d60 0 2024-04-12T13:42:10.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/495: link d4/d33/d50/c72 d4/d33/ca4 0 2024-04-12T13:42:10.589 INFO:tasks.workunit.client.0.smithi060.stdout:9/496: dread - d4/d8/f84 zero size 2024-04-12T13:42:10.590 INFO:tasks.workunit.client.1.smithi110.stdout:4/711: truncate d0/d13/f2d 18883 0 2024-04-12T13:42:10.591 INFO:tasks.workunit.client.1.smithi110.stdout:7/620: symlink d1/d1b/ld1 0 2024-04-12T13:42:10.593 INFO:tasks.workunit.client.0.smithi060.stdout:1/689: write f14 [110652,88101] 0 2024-04-12T13:42:10.594 INFO:tasks.workunit.client.1.smithi110.stdout:3/594: mkdir d5/dc/d31/d3b/d32/d3e/d5f/dbd 0 2024-04-12T13:42:10.597 INFO:tasks.workunit.client.1.smithi110.stdout:9/685: chown df/d13/d26/d37/d6a/f76 16690392 1 2024-04-12T13:42:10.601 INFO:tasks.workunit.client.0.smithi060.stdout:3/634: creat d7/d17/d19/d33/d63/d6d/fd3 x:0 0 0 2024-04-12T13:42:10.602 INFO:tasks.workunit.client.1.smithi110.stdout:1/583: rename de/d15/d32/d61/f67 to de/d14/d34/fc9 0 2024-04-12T13:42:10.604 INFO:tasks.workunit.client.1.smithi110.stdout:2/652: mkdir d6/dc/d1b/d57/d62/dcb 0 2024-04-12T13:42:10.607 INFO:tasks.workunit.client.0.smithi060.stdout:7/549: dwrite d0/d7/d43/f46 [0,4194304] 0 2024-04-12T13:42:10.607 INFO:tasks.workunit.client.0.smithi060.stdout:4/573: dwrite d6/f8f [0,4194304] 0 2024-04-12T13:42:10.607 INFO:tasks.workunit.client.0.smithi060.stdout:0/536: write d7/d9/d4c/f55 [1044380,112959] 0 2024-04-12T13:42:10.609 INFO:tasks.workunit.client.1.smithi110.stdout:6/598: getdents d7/d10/d1c/d2b/d48 0 2024-04-12T13:42:10.613 INFO:tasks.workunit.client.1.smithi110.stdout:7/621: mkdir d1/d1b/d70/dd2 0 2024-04-12T13:42:10.613 INFO:tasks.workunit.client.0.smithi060.stdout:5/575: link d6/d89/f8f d6/dd/d1f/d25/d42/fbb 0 2024-04-12T13:42:10.613 INFO:tasks.workunit.client.0.smithi060.stdout:7/550: readlink d0/d1b/l54 0 2024-04-12T13:42:10.615 INFO:tasks.workunit.client.1.smithi110.stdout:7/622: dread - d1/d3/d4/d55/d56/f8c zero size 2024-04-12T13:42:10.615 INFO:tasks.workunit.client.0.smithi060.stdout:0/537: chown d7/d33 9856 1 2024-04-12T13:42:10.616 INFO:tasks.workunit.client.1.smithi110.stdout:3/595: mknod d5/dc/d31/d74/d75/da7/dad/cbe 0 2024-04-12T13:42:10.619 INFO:tasks.workunit.client.1.smithi110.stdout:9/686: creat df/d13/d26/d37/d6a/fe8 x:0 0 0 2024-04-12T13:42:10.619 INFO:tasks.workunit.client.0.smithi060.stdout:8/549: symlink d9/d1b/d37/d4d/d63/d66/db3/d65/lc1 0 2024-04-12T13:42:10.621 INFO:tasks.workunit.client.0.smithi060.stdout:2/556: creat d6/d13/d31/fab x:0 0 0 2024-04-12T13:42:10.621 INFO:tasks.workunit.client.0.smithi060.stdout:6/651: rmdir d1/d7/da/dc/d24/d34/d51/d59/d94 39 2024-04-12T13:42:10.622 INFO:tasks.workunit.client.0.smithi060.stdout:9/497: dwrite d4/d9/d19/d21/f27 [4194304,4194304] 0 2024-04-12T13:42:10.625 INFO:tasks.workunit.client.1.smithi110.stdout:8/612: rename d1/d3/d3c/d5a/d6f/d7e/f47 to d1/d7/d20/fc1 0 2024-04-12T13:42:10.626 INFO:tasks.workunit.client.1.smithi110.stdout:5/569: sync 2024-04-12T13:42:10.627 INFO:tasks.workunit.client.0.smithi060.stdout:1/690: read - d1e/d23/dd9/faf zero size 2024-04-12T13:42:10.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/635: chown d7/d17/d19/d33/d63/c7f 34382873 1 2024-04-12T13:42:10.630 INFO:tasks.workunit.client.0.smithi060.stdout:4/574: symlink d6/d2f/lc6 0 2024-04-12T13:42:10.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/551: unlink d0/d7/d43/d63/c77 0 2024-04-12T13:42:10.638 INFO:tasks.workunit.client.0.smithi060.stdout:0/538: symlink d7/d33/d88/lbe 0 2024-04-12T13:42:10.641 INFO:tasks.workunit.client.0.smithi060.stdout:2/557: unlink d6/f14 0 2024-04-12T13:42:10.642 INFO:tasks.workunit.client.1.smithi110.stdout:7/623: mknod d1/d31/d7b/cd3 0 2024-04-12T13:42:10.643 INFO:tasks.workunit.client.0.smithi060.stdout:8/550: unlink d9/d1b/l22 0 2024-04-12T13:42:10.644 INFO:tasks.workunit.client.0.smithi060.stdout:2/558: truncate d6/d10/f95 56374 0 2024-04-12T13:42:10.646 INFO:tasks.workunit.client.0.smithi060.stdout:6/652: truncate d1/d7/da/d20/f26 6290228 0 2024-04-12T13:42:10.647 INFO:tasks.workunit.client.1.smithi110.stdout:1/584: dwrite f6 [0,4194304] 0 2024-04-12T13:42:10.647 INFO:tasks.workunit.client.0.smithi060.stdout:3/636: dread d7/d17/d27/d36/fb9 [0,4194304] 0 2024-04-12T13:42:10.648 INFO:tasks.workunit.client.1.smithi110.stdout:9/687: symlink df/d13/d2c/d9e/dd6/dcf/le9 0 2024-04-12T13:42:10.648 INFO:tasks.workunit.client.1.smithi110.stdout:6/599: write d7/d25/d30/d44/f61 [956263,16912] 0 2024-04-12T13:42:10.650 INFO:tasks.workunit.client.1.smithi110.stdout:4/712: truncate d0/d19/d1c/fe4 1305219 0 2024-04-12T13:42:10.652 INFO:tasks.workunit.client.1.smithi110.stdout:9/688: chown df/d13/d2c/d2d/d39/d3a/f78 975 1 2024-04-12T13:42:10.653 INFO:tasks.workunit.client.1.smithi110.stdout:2/653: dwrite d6/dc/dd/d49/d64/f2c [4194304,4194304] 0 2024-04-12T13:42:10.654 INFO:tasks.workunit.client.1.smithi110.stdout:0/533: rename d1/d8/d36/d51/d60/l29 to d1/d48/db2/lb7 0 2024-04-12T13:42:10.655 INFO:tasks.workunit.client.1.smithi110.stdout:5/570: symlink da/d5c/lc5 0 2024-04-12T13:42:10.656 INFO:tasks.workunit.client.0.smithi060.stdout:0/539: mknod d7/d9/d4c/d8e/cbf 0 2024-04-12T13:42:10.659 INFO:tasks.workunit.client.0.smithi060.stdout:2/559: symlink d6/d10/d2b/d35/lac 0 2024-04-12T13:42:10.660 INFO:tasks.workunit.client.1.smithi110.stdout:2/654: chown d6/dc/d1b/f4e 189661 1 2024-04-12T13:42:10.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/560: fsync d6/d56/d55/fa4 0 2024-04-12T13:42:10.661 INFO:tasks.workunit.client.0.smithi060.stdout:0/540: chown d7/d9/d14/d35/d44/d7d/l84 5098680 1 2024-04-12T13:42:10.663 INFO:tasks.workunit.client.1.smithi110.stdout:8/613: read d1/d3/d35/d3a/d3e/f49 [443908,94967] 0 2024-04-12T13:42:10.664 INFO:tasks.workunit.client.1.smithi110.stdout:0/534: chown d1/d8/d36/d51/d60/l40 21 1 2024-04-12T13:42:10.665 INFO:tasks.workunit.client.1.smithi110.stdout:3/596: symlink d5/dc/d20/d2d/d4e/d89/d8c/db6/lbf 0 2024-04-12T13:42:10.665 INFO:tasks.workunit.client.1.smithi110.stdout:8/614: chown d1 1428 1 2024-04-12T13:42:10.667 INFO:tasks.workunit.client.0.smithi060.stdout:6/653: rmdir d1/d7/da/dc/d24/d34/d51/d59 39 2024-04-12T13:42:10.667 INFO:tasks.workunit.client.0.smithi060.stdout:3/637: rmdir d7/d17/d19/d96 39 2024-04-12T13:42:10.668 INFO:tasks.workunit.client.1.smithi110.stdout:8/615: chown d1/d5/dd/d31 3 1 2024-04-12T13:42:10.670 INFO:tasks.workunit.client.0.smithi060.stdout:0/541: chown d7/d9/d14/d35/d44/d7d/fac 1837309 1 2024-04-12T13:42:10.674 INFO:tasks.workunit.client.1.smithi110.stdout:6/600: creat d7/da4/fc4 x:0 0 0 2024-04-12T13:42:10.674 INFO:tasks.workunit.client.0.smithi060.stdout:9/498: write d4/d9/f3e [5064146,40079] 0 2024-04-12T13:42:10.675 INFO:tasks.workunit.client.0.smithi060.stdout:6/654: readlink d1/d7/da/dc/d24/d30/d52/d5e/la1 0 2024-04-12T13:42:10.678 INFO:tasks.workunit.client.1.smithi110.stdout:1/585: dwrite de/d15/d32/f71 [0,4194304] 0 2024-04-12T13:42:10.678 INFO:tasks.workunit.client.0.smithi060.stdout:4/575: write d6/d21/d29/f73 [698774,76629] 0 2024-04-12T13:42:10.679 INFO:tasks.workunit.client.1.smithi110.stdout:5/571: mknod da/db/d3b/cc6 0 2024-04-12T13:42:10.681 INFO:tasks.workunit.client.1.smithi110.stdout:0/535: rmdir d1/d3c/d6b/d90 39 2024-04-12T13:42:10.689 INFO:tasks.workunit.client.0.smithi060.stdout:2/561: dwrite d6/d13/d31/d33/fa5 [0,4194304] 0 2024-04-12T13:42:10.690 INFO:tasks.workunit.client.1.smithi110.stdout:2/655: rename d6/dc/dd/d49/d64/d4a/d55 to d6/dc/d13/d80/d8d/dcc 0 2024-04-12T13:42:10.690 INFO:tasks.workunit.client.0.smithi060.stdout:2/562: fdatasync d6/d56/f51 0 2024-04-12T13:42:10.691 INFO:tasks.workunit.client.0.smithi060.stdout:8/551: symlink d9/d1d/d5e/d90/lc2 0 2024-04-12T13:42:10.692 INFO:tasks.workunit.client.1.smithi110.stdout:7/624: dwrite d1/d3/d4/f2d [0,4194304] 0 2024-04-12T13:42:10.695 INFO:tasks.workunit.client.1.smithi110.stdout:3/597: mkdir d5/dc/d20/d2d/d4e/d89/dc0 0 2024-04-12T13:42:10.699 INFO:tasks.workunit.client.0.smithi060.stdout:7/552: truncate d0/d7/f24 90130 0 2024-04-12T13:42:10.700 INFO:tasks.workunit.client.1.smithi110.stdout:3/598: write d5/dc/d31/d3b/d32/d3e/d5f/f9b [36629,126239] 0 2024-04-12T13:42:10.703 INFO:tasks.workunit.client.1.smithi110.stdout:9/689: dread df/d13/d2c/d2d/d39/d3a/f78 [0,4194304] 0 2024-04-12T13:42:10.703 INFO:tasks.workunit.client.1.smithi110.stdout:4/713: write d0/d78/fd2 [418387,69290] 0 2024-04-12T13:42:10.707 INFO:tasks.workunit.client.0.smithi060.stdout:9/499: readlink d4/d8/l9e 0 2024-04-12T13:42:10.707 INFO:tasks.workunit.client.1.smithi110.stdout:6/601: mkdir d7/d25/d30/d9e/dc3/dc5 0 2024-04-12T13:42:10.709 INFO:tasks.workunit.client.1.smithi110.stdout:1/586: fsync de/d15/f31 0 2024-04-12T13:42:10.710 INFO:tasks.workunit.client.0.smithi060.stdout:6/655: chown d1/d7/c61 47 1 2024-04-12T13:42:10.714 INFO:tasks.workunit.client.0.smithi060.stdout:4/576: mkdir d6/d7/dd/d1a/d57/dc7 0 2024-04-12T13:42:10.715 INFO:tasks.workunit.client.0.smithi060.stdout:3/638: write d7/d17/d19/d33/d63/d6d/f98 [731820,48529] 0 2024-04-12T13:42:10.717 INFO:tasks.workunit.client.1.smithi110.stdout:0/536: creat d1/d48/db2/fb8 x:0 0 0 2024-04-12T13:42:10.721 INFO:tasks.workunit.client.1.smithi110.stdout:8/616: write d1/d3/d3c/d5a/d6f/d83/f8c [13778,81514] 0 2024-04-12T13:42:10.723 INFO:tasks.workunit.client.1.smithi110.stdout:2/656: rename d6/dc/f36 to d6/dc/d1b/d57/d62/db4/fcd 0 2024-04-12T13:42:10.725 INFO:tasks.workunit.client.1.smithi110.stdout:1/587: dread de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:10.725 INFO:tasks.workunit.client.1.smithi110.stdout:5/572: write da/d2e/d45/d25/f44 [2094352,110182] 0 2024-04-12T13:42:10.726 INFO:tasks.workunit.client.1.smithi110.stdout:7/625: truncate d1/d3/d4/dbf/db6/fb7 768048 0 2024-04-12T13:42:10.727 INFO:tasks.workunit.client.1.smithi110.stdout:7/626: chown d1/d3/d4/d55 366266461 1 2024-04-12T13:42:10.730 INFO:tasks.workunit.client.0.smithi060.stdout:7/553: rmdir d0/d7/d43/d85 39 2024-04-12T13:42:10.731 INFO:tasks.workunit.client.0.smithi060.stdout:1/691: dwrite d1e/d23/d2e/d5e/fa4 [0,4194304] 0 2024-04-12T13:42:10.733 INFO:tasks.workunit.client.1.smithi110.stdout:9/690: mknod df/d13/d2c/d2d/dc1/d83/d5d/d89/cea 0 2024-04-12T13:42:10.734 INFO:tasks.workunit.client.0.smithi060.stdout:6/656: mkdir d1/d7/da/dc/d7a/de1 0 2024-04-12T13:42:10.736 INFO:tasks.workunit.client.0.smithi060.stdout:1/692: fsync d1e/d23/dd9/fc8 0 2024-04-12T13:42:10.738 INFO:tasks.workunit.client.0.smithi060.stdout:6/657: chown d1/d7/da/dc/d24/d30/d52/f60 726744 1 2024-04-12T13:42:10.739 INFO:tasks.workunit.client.0.smithi060.stdout:9/500: rename d4/d8/d32/c3c to d4/d8/d7c/ca5 0 2024-04-12T13:42:10.739 INFO:tasks.workunit.client.1.smithi110.stdout:5/573: dwrite da/db/fbb [0,4194304] 0 2024-04-12T13:42:10.741 INFO:tasks.workunit.client.0.smithi060.stdout:4/577: rmdir d6/d7/dd/d4d/d69 39 2024-04-12T13:42:10.748 INFO:tasks.workunit.client.1.smithi110.stdout:0/537: mknod d1/d8/d36/d51/cb9 0 2024-04-12T13:42:10.750 INFO:tasks.workunit.client.1.smithi110.stdout:6/602: write d7/d10/d41/fab [1535099,126995] 0 2024-04-12T13:42:10.753 INFO:tasks.workunit.client.0.smithi060.stdout:2/563: dwrite d6/d56/d43/f72 [0,4194304] 0 2024-04-12T13:42:10.753 INFO:tasks.workunit.client.1.smithi110.stdout:8/617: mkdir d1/d3/d35/d3a/d3e/d64/d85/dc2 0 2024-04-12T13:42:10.755 INFO:tasks.workunit.client.0.smithi060.stdout:1/693: truncate d1e/f2b 804746 0 2024-04-12T13:42:10.757 INFO:tasks.workunit.client.0.smithi060.stdout:9/501: mkdir d4/d9/d19/d8c/da6 0 2024-04-12T13:42:10.759 INFO:tasks.workunit.client.0.smithi060.stdout:1/694: dread - d1e/d23/d49/d4e/ff1 zero size 2024-04-12T13:42:10.761 INFO:tasks.workunit.client.0.smithi060.stdout:3/639: creat d7/d17/d19/d96/fd4 x:0 0 0 2024-04-12T13:42:10.761 INFO:tasks.workunit.client.1.smithi110.stdout:3/599: mknod d5/dc/d20/d2d/d4e/d89/dc0/cc1 0 2024-04-12T13:42:10.763 INFO:tasks.workunit.client.1.smithi110.stdout:3/600: chown d5/dc/d31/d3b/d32/f3f 15084 1 2024-04-12T13:42:10.763 INFO:tasks.workunit.client.0.smithi060.stdout:9/502: read d4/d8/d7c/f81 [1890680,115059] 0 2024-04-12T13:42:10.773 INFO:tasks.workunit.client.0.smithi060.stdout:2/564: dread d6/d13/d31/d33/d3d/f63 [0,4194304] 0 2024-04-12T13:42:10.774 INFO:tasks.workunit.client.0.smithi060.stdout:4/578: write d6/d21/f2d [2819140,11095] 0 2024-04-12T13:42:10.777 INFO:tasks.workunit.client.0.smithi060.stdout:1/695: creat d1e/dcc/ff4 x:0 0 0 2024-04-12T13:42:10.777 INFO:tasks.workunit.client.1.smithi110.stdout:0/538: creat d1/d5e/fba x:0 0 0 2024-04-12T13:42:10.778 INFO:tasks.workunit.client.0.smithi060.stdout:8/552: write d9/d1d/f33 [4695409,5377] 0 2024-04-12T13:42:10.779 INFO:tasks.workunit.client.1.smithi110.stdout:2/657: dwrite d6/dc/dd/d49/d64/d4a/f72 [0,4194304] 0 2024-04-12T13:42:10.781 INFO:tasks.workunit.client.0.smithi060.stdout:3/640: rmdir d7/d17/d27/d36/d53 39 2024-04-12T13:42:10.782 INFO:tasks.workunit.client.0.smithi060.stdout:7/554: truncate d0/f3a 7838035 0 2024-04-12T13:42:10.783 INFO:tasks.workunit.client.1.smithi110.stdout:1/588: symlink de/d15/d32/d5e/lca 0 2024-04-12T13:42:10.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/503: rename d4/d8/f84 to d4/d8/d7c/fa7 0 2024-04-12T13:42:10.791 INFO:tasks.workunit.client.1.smithi110.stdout:5/574: dwrite da/d2e/d45/d29/d32/f36 [0,4194304] 0 2024-04-12T13:42:10.791 INFO:tasks.workunit.client.0.smithi060.stdout:2/565: symlink d6/d64/d99/lad 0 2024-04-12T13:42:10.792 INFO:tasks.workunit.client.1.smithi110.stdout:4/714: link d0/de/d32/c4a d0/d75/ceb 0 2024-04-12T13:42:10.794 INFO:tasks.workunit.client.0.smithi060.stdout:4/579: dwrite d6/d7/dd/d4d/f9b [0,4194304] 0 2024-04-12T13:42:10.795 INFO:tasks.workunit.client.0.smithi060.stdout:1/696: creat d1e/d23/dd9/ff5 x:0 0 0 2024-04-12T13:42:10.797 INFO:tasks.workunit.client.1.smithi110.stdout:6/603: mkdir d7/d25/dc6 0 2024-04-12T13:42:10.799 INFO:tasks.workunit.client.1.smithi110.stdout:6/604: write d7/d10/d1c/d2b/f7a [2265171,129116] 0 2024-04-12T13:42:10.799 INFO:tasks.workunit.client.1.smithi110.stdout:0/539: creat d1/d48/db2/d4a/fbb x:0 0 0 2024-04-12T13:42:10.803 INFO:tasks.workunit.client.1.smithi110.stdout:2/658: mknod d6/dc/d6f/cce 0 2024-04-12T13:42:10.813 INFO:tasks.workunit.client.1.smithi110.stdout:9/691: rename df/d13/d2c/d2d/d39/d3a/cc0 to df/ceb 0 2024-04-12T13:42:10.815 INFO:tasks.workunit.client.0.smithi060.stdout:1/697: dwrite d1e/d46/f62 [0,4194304] 0 2024-04-12T13:42:10.816 INFO:tasks.workunit.client.1.smithi110.stdout:3/601: mknod d5/dc/d31/d3b/d32/d3e/d5f/dbd/cc2 0 2024-04-12T13:42:10.817 INFO:tasks.workunit.client.1.smithi110.stdout:4/715: dread - d0/d75/d84/f90 zero size 2024-04-12T13:42:10.834 INFO:tasks.workunit.client.1.smithi110.stdout:4/716: dwrite d0/de/f7f [4194304,4194304] 0 2024-04-12T13:42:10.837 INFO:tasks.workunit.client.1.smithi110.stdout:5/575: creat da/d2e/d45/d25/d9d/d7a/db5/d8f/fc7 x:0 0 0 2024-04-12T13:42:10.840 INFO:tasks.workunit.client.0.smithi060.stdout:4/580: mkdir d6/d7/db/dc8 0 2024-04-12T13:42:10.842 INFO:tasks.workunit.client.1.smithi110.stdout:0/540: creat d1/d56/fbc x:0 0 0 2024-04-12T13:42:10.842 INFO:tasks.workunit.client.1.smithi110.stdout:7/627: write d1/d3/d4/d36/f5c [8612542,95941] 0 2024-04-12T13:42:10.843 INFO:tasks.workunit.client.0.smithi060.stdout:3/641: getdents d7/d17/d27/da7/dbe/dce 0 2024-04-12T13:42:10.846 INFO:tasks.workunit.client.1.smithi110.stdout:7/628: chown d1/d1b/d3d/d68/d97/da5/da7 80 1 2024-04-12T13:42:10.846 INFO:tasks.workunit.client.1.smithi110.stdout:0/541: chown d1/d27/d31/d89/ca1 1402920 1 2024-04-12T13:42:10.846 INFO:tasks.workunit.client.0.smithi060.stdout:6/658: getdents d1/d7/da/dc/d24/d34/d51 0 2024-04-12T13:42:10.849 INFO:tasks.workunit.client.1.smithi110.stdout:8/618: rename d1/d7/d20/fc1 to d1/d7/d20/da3/fc3 0 2024-04-12T13:42:10.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/698: creat d1e/d23/d49/d4e/ff6 x:0 0 0 2024-04-12T13:42:10.852 INFO:tasks.workunit.client.0.smithi060.stdout:9/504: mkdir d4/da8 0 2024-04-12T13:42:10.853 INFO:tasks.workunit.client.0.smithi060.stdout:9/505: dread - d4/d8/d7c/fa7 zero size 2024-04-12T13:42:10.858 INFO:tasks.workunit.client.1.smithi110.stdout:6/605: write d7/d25/d30/d44/f21 [144670,114579] 0 2024-04-12T13:42:10.859 INFO:tasks.workunit.client.1.smithi110.stdout:2/659: write d6/dc/dd/d49/d64/d4a/f7c [480068,52582] 0 2024-04-12T13:42:10.859 INFO:tasks.workunit.client.0.smithi060.stdout:8/553: creat d9/d1b/d84/da0/d80/fc3 x:0 0 0 2024-04-12T13:42:10.861 INFO:tasks.workunit.client.0.smithi060.stdout:7/555: truncate d0/d7/f10 3302589 0 2024-04-12T13:42:10.861 INFO:tasks.workunit.client.1.smithi110.stdout:2/660: fsync d6/dc/fa9 0 2024-04-12T13:42:10.863 INFO:tasks.workunit.client.0.smithi060.stdout:7/556: truncate d0/d3d/f7c 1714735 0 2024-04-12T13:42:10.864 INFO:tasks.workunit.client.0.smithi060.stdout:6/659: rmdir d1/d7/da/dc/d24/d34/d51 39 2024-04-12T13:42:10.864 INFO:tasks.workunit.client.1.smithi110.stdout:3/602: dwrite d5/d86/fb5 [0,4194304] 0 2024-04-12T13:42:10.867 INFO:tasks.workunit.client.0.smithi060.stdout:6/660: write d1/d7/da/dc/f3b [1210669,18250] 0 2024-04-12T13:42:10.869 INFO:tasks.workunit.client.0.smithi060.stdout:2/566: rename d6/d13 to d6/dae 0 2024-04-12T13:42:10.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/567: readlink d6/dae/d31/l71 0 2024-04-12T13:42:10.874 INFO:tasks.workunit.client.0.smithi060.stdout:4/581: dwrite d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:42:10.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/642: creat d7/d17/d19/d33/d63/d6d/dab/fd5 x:0 0 0 2024-04-12T13:42:10.877 INFO:tasks.workunit.client.0.smithi060.stdout:4/582: chown d6/d7/db/c14 918 1 2024-04-12T13:42:10.877 INFO:tasks.workunit.client.1.smithi110.stdout:3/603: dread d5/f40 [0,4194304] 0 2024-04-12T13:42:10.881 INFO:tasks.workunit.client.0.smithi060.stdout:7/557: fsync d0/d3d/d74/f7e 0 2024-04-12T13:42:10.884 INFO:tasks.workunit.client.0.smithi060.stdout:7/558: fsync d0/d1b/da4/fba 0 2024-04-12T13:42:10.884 INFO:tasks.workunit.client.0.smithi060.stdout:4/583: write d6/d7/dd/d1a/d19/f1f [447375,68947] 0 2024-04-12T13:42:10.886 INFO:tasks.workunit.client.0.smithi060.stdout:1/699: mkdir d1e/d23/d2e/d5e/df0/df7 0 2024-04-12T13:42:10.895 INFO:tasks.workunit.client.0.smithi060.stdout:2/568: symlink d6/d56/d58/laf 0 2024-04-12T13:42:10.903 INFO:tasks.workunit.client.1.smithi110.stdout:1/589: sync 2024-04-12T13:42:10.903 INFO:tasks.workunit.client.0.smithi060.stdout:4/584: creat d6/d7/dd/d1a/d19/d42/fc9 x:0 0 0 2024-04-12T13:42:10.903 INFO:tasks.workunit.client.1.smithi110.stdout:1/590: stat de/d14/c2e 0 2024-04-12T13:42:10.905 INFO:tasks.workunit.client.0.smithi060.stdout:9/506: write d4/d9/f97 [970070,127042] 0 2024-04-12T13:42:10.911 INFO:tasks.workunit.client.0.smithi060.stdout:6/661: dwrite d1/d7/da/dc/d24/d30/d52/d78/d80/fb5 [0,4194304] 0 2024-04-12T13:42:10.913 INFO:tasks.workunit.client.0.smithi060.stdout:7/559: mkdir d0/dbb 0 2024-04-12T13:42:10.919 INFO:tasks.workunit.client.0.smithi060.stdout:9/507: creat d4/d9/d19/d21/d73/d67/fa9 x:0 0 0 2024-04-12T13:42:10.920 INFO:tasks.workunit.client.0.smithi060.stdout:8/554: link d9/d1b/d3c/d6e/d7b/f9e d9/d1b/d84/da1/fc4 0 2024-04-12T13:42:10.920 INFO:tasks.workunit.client.0.smithi060.stdout:4/585: dwrite d6/d7/db/d85/f4e [0,4194304] 0 2024-04-12T13:42:10.923 INFO:tasks.workunit.client.0.smithi060.stdout:4/586: write d6/d7/dd/d1a/d19/d7a/da8/fba [338800,64020] 0 2024-04-12T13:42:10.925 INFO:tasks.workunit.client.0.smithi060.stdout:1/700: rename d1e/f33 to d1e/d23/d2e/d5e/ff8 0 2024-04-12T13:42:10.928 INFO:tasks.workunit.client.0.smithi060.stdout:7/560: creat d0/d3d/d74/d9b/fbc x:0 0 0 2024-04-12T13:42:10.930 INFO:tasks.workunit.client.0.smithi060.stdout:7/561: stat d0/d1b/f27 0 2024-04-12T13:42:10.931 INFO:tasks.workunit.client.0.smithi060.stdout:8/555: mknod d9/d1b/d3c/d8d/cc5 0 2024-04-12T13:42:10.933 INFO:tasks.workunit.client.0.smithi060.stdout:8/556: stat d9/d1d/f33 0 2024-04-12T13:42:10.935 INFO:tasks.workunit.client.1.smithi110.stdout:4/717: rename d0/d19/f23 to d0/d78/fec 0 2024-04-12T13:42:10.936 INFO:tasks.workunit.client.0.smithi060.stdout:1/701: dread d1e/d23/d2e/d30/f36 [0,4194304] 0 2024-04-12T13:42:10.937 INFO:tasks.workunit.client.0.smithi060.stdout:9/508: creat d4/d33/d50/faa x:0 0 0 2024-04-12T13:42:10.938 INFO:tasks.workunit.client.0.smithi060.stdout:9/509: fsync d4/d8/f3b 0 2024-04-12T13:42:10.939 INFO:tasks.workunit.client.0.smithi060.stdout:1/702: chown d1e/d29/ldd 0 1 2024-04-12T13:42:10.941 INFO:tasks.workunit.client.0.smithi060.stdout:1/703: write d1e/d23/dd9/ff5 [656683,40356] 0 2024-04-12T13:42:10.944 INFO:tasks.workunit.client.0.smithi060.stdout:2/569: rename d6/d10/d2b/d35 to d6/d10/daa/db0 0 2024-04-12T13:42:10.945 INFO:tasks.workunit.client.1.smithi110.stdout:6/606: unlink d7/d10/l15 0 2024-04-12T13:42:10.946 INFO:tasks.workunit.client.0.smithi060.stdout:2/570: chown d6/dae/d5b/f66 2 1 2024-04-12T13:42:10.949 INFO:tasks.workunit.client.0.smithi060.stdout:8/557: creat d9/d1b/d37/d4d/d63/fc6 x:0 0 0 2024-04-12T13:42:10.950 INFO:tasks.workunit.client.1.smithi110.stdout:2/661: rmdir d6/dc/dd/d49/d64/d4a 39 2024-04-12T13:42:10.954 INFO:tasks.workunit.client.0.smithi060.stdout:9/510: dwrite d4/d33/d50/f6c [0,4194304] 0 2024-04-12T13:42:10.959 INFO:tasks.workunit.client.1.smithi110.stdout:5/576: write da/f11 [216312,51823] 0 2024-04-12T13:42:10.963 INFO:tasks.workunit.client.0.smithi060.stdout:6/662: rename d1/f6b to d1/d7/da/dc/d24/d30/dd8/fe2 0 2024-04-12T13:42:10.967 INFO:tasks.workunit.client.1.smithi110.stdout:7/629: dread - d1/d3/d4/d36/d76/f8a zero size 2024-04-12T13:42:10.970 INFO:tasks.workunit.client.1.smithi110.stdout:4/718: mknod d0/d78/ced 0 2024-04-12T13:42:10.972 INFO:tasks.workunit.client.0.smithi060.stdout:8/558: fdatasync d9/d1b/d3c/f56 0 2024-04-12T13:42:10.974 INFO:tasks.workunit.client.1.smithi110.stdout:8/619: unlink d1/d3/d35/d3a/d41/d77/c89 0 2024-04-12T13:42:10.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/511: symlink d4/d8/d32/lab 0 2024-04-12T13:42:10.978 INFO:tasks.workunit.client.1.smithi110.stdout:9/692: link df/d13/d2c/d9e/dd6/da3/fb5 df/d13/d26/d37/d6a/fec 0 2024-04-12T13:42:10.978 INFO:tasks.workunit.client.1.smithi110.stdout:9/693: readlink df/d13/l2a 0 2024-04-12T13:42:10.980 INFO:tasks.workunit.client.1.smithi110.stdout:9/694: dread - df/d13/f87 zero size 2024-04-12T13:42:10.985 INFO:tasks.workunit.client.0.smithi060.stdout:7/562: truncate d0/d1b/f5b 6988493 0 2024-04-12T13:42:10.987 INFO:tasks.workunit.client.0.smithi060.stdout:6/663: fdatasync d1/d7/da/dc/d24/d34/d51/d59/f4d 0 2024-04-12T13:42:10.990 INFO:tasks.workunit.client.1.smithi110.stdout:1/591: symlink de/d14/d34/db4/lcb 0 2024-04-12T13:42:10.990 INFO:tasks.workunit.client.0.smithi060.stdout:1/704: dwrite d1e/d29/d37/f50 [0,4194304] 0 2024-04-12T13:42:10.994 INFO:tasks.workunit.client.1.smithi110.stdout:0/542: creat d1/d3c/d6b/fbd x:0 0 0 2024-04-12T13:42:10.994 INFO:tasks.workunit.client.1.smithi110.stdout:5/577: mknod da/d2e/d45/d29/d66/cc8 0 2024-04-12T13:42:10.996 INFO:tasks.workunit.client.1.smithi110.stdout:7/630: creat d1/d3/d4/d55/d82/fd4 x:0 0 0 2024-04-12T13:42:10.997 INFO:tasks.workunit.client.0.smithi060.stdout:4/587: rename d6/d7/dd/d1a/d57/f83 to d6/d7/db/dc8/fca 0 2024-04-12T13:42:10.997 INFO:tasks.workunit.client.0.smithi060.stdout:2/571: dwrite d6/d10/d16/f18 [4194304,4194304] 0 2024-04-12T13:42:11.005 INFO:tasks.workunit.client.1.smithi110.stdout:7/631: write d1/d3/d4/d55/f77 [9076466,82833] 0 2024-04-12T13:42:11.005 INFO:tasks.workunit.client.0.smithi060.stdout:1/705: truncate d1e/d46/f75 1490789 0 2024-04-12T13:42:11.007 INFO:tasks.workunit.client.0.smithi060.stdout:9/512: creat d4/d9/d19/d8c/da6/fac x:0 0 0 2024-04-12T13:42:11.012 INFO:tasks.workunit.client.1.smithi110.stdout:3/604: link d5/dc/d20/d2d/l94 d5/dc/d31/d3b/d32/d3e/d5f/dbd/lc3 0 2024-04-12T13:42:11.017 INFO:tasks.workunit.client.1.smithi110.stdout:5/578: dwrite da/d2e/d45/d25/d9d/d7a/fab [0,4194304] 0 2024-04-12T13:42:11.017 INFO:tasks.workunit.client.1.smithi110.stdout:0/543: symlink d1/d3c/lbe 0 2024-04-12T13:42:11.030 INFO:tasks.workunit.client.0.smithi060.stdout:7/563: dread d0/d78/f8d [0,4194304] 0 2024-04-12T13:42:11.030 INFO:tasks.workunit.client.0.smithi060.stdout:8/559: write d9/d1b/d84/da1/fc4 [591449,113078] 0 2024-04-12T13:42:11.031 INFO:tasks.workunit.client.0.smithi060.stdout:9/513: rmdir d4/d9/d19/d21/d73 39 2024-04-12T13:42:11.032 INFO:tasks.workunit.client.0.smithi060.stdout:2/572: dread d6/dae/f67 [0,4194304] 0 2024-04-12T13:42:11.034 INFO:tasks.workunit.client.0.smithi060.stdout:1/706: dwrite d1e/d23/d49/f54 [0,4194304] 0 2024-04-12T13:42:11.035 INFO:tasks.workunit.client.0.smithi060.stdout:2/573: chown d6/f8 884 1 2024-04-12T13:42:11.037 INFO:tasks.workunit.client.1.smithi110.stdout:7/632: rename d1/d3/d4/d55/l5a to d1/d1b/d70/ld5 0 2024-04-12T13:42:11.037 INFO:tasks.workunit.client.1.smithi110.stdout:2/662: truncate d6/dc/d1b/f2a 5961716 0 2024-04-12T13:42:11.037 INFO:tasks.workunit.client.0.smithi060.stdout:4/588: creat d6/db7/dbb/fcb x:0 0 0 2024-04-12T13:42:11.039 INFO:tasks.workunit.client.0.smithi060.stdout:5/576: sync 2024-04-12T13:42:11.046 INFO:tasks.workunit.client.1.smithi110.stdout:1/592: unlink de/d15/d32/ca0 0 2024-04-12T13:42:11.048 INFO:tasks.workunit.client.0.smithi060.stdout:9/514: stat d4/c46 0 2024-04-12T13:42:11.048 INFO:tasks.workunit.client.1.smithi110.stdout:5/579: fsync da/f6b 0 2024-04-12T13:42:11.051 INFO:tasks.workunit.client.1.smithi110.stdout:0/544: creat d1/d8/d36/d51/fbf x:0 0 0 2024-04-12T13:42:11.053 INFO:tasks.workunit.client.0.smithi060.stdout:8/560: symlink d9/d1b/d2b/d82/d8a/lc7 0 2024-04-12T13:42:11.053 INFO:tasks.workunit.client.1.smithi110.stdout:0/545: truncate d1/d48/f5b 354569 0 2024-04-12T13:42:11.054 INFO:tasks.workunit.client.0.smithi060.stdout:7/564: dwrite d0/d3d/f7c [0,4194304] 0 2024-04-12T13:42:11.056 INFO:tasks.workunit.client.1.smithi110.stdout:6/607: getdents d7/d10 0 2024-04-12T13:42:11.059 INFO:tasks.workunit.client.1.smithi110.stdout:6/608: write d7/d10/d1c/d2b/d48/d54/f88 [95083,59463] 0 2024-04-12T13:42:11.060 INFO:tasks.workunit.client.1.smithi110.stdout:4/719: creat d0/d75/d84/fee x:0 0 0 2024-04-12T13:42:11.061 INFO:tasks.workunit.client.1.smithi110.stdout:6/609: chown d7/d25/d2c/fa2 192669 1 2024-04-12T13:42:11.062 INFO:tasks.workunit.client.1.smithi110.stdout:3/605: dread d5/dc/f12 [0,4194304] 0 2024-04-12T13:42:11.066 INFO:tasks.workunit.client.0.smithi060.stdout:1/707: dwrite d1e/dcc/ff4 [0,4194304] 0 2024-04-12T13:42:11.068 INFO:tasks.workunit.client.1.smithi110.stdout:9/695: creat df/d13/d2c/fed x:0 0 0 2024-04-12T13:42:11.068 INFO:tasks.workunit.client.0.smithi060.stdout:2/574: dwrite d6/d56/f75 [0,4194304] 0 2024-04-12T13:42:11.069 INFO:tasks.workunit.client.1.smithi110.stdout:2/663: rmdir d6/dc/dd/d49/d64 39 2024-04-12T13:42:11.073 INFO:tasks.workunit.client.0.smithi060.stdout:5/577: dwrite d6/dd/d1f/d25/fba [0,4194304] 0 2024-04-12T13:42:11.079 INFO:tasks.workunit.client.1.smithi110.stdout:0/546: mknod d1/d56/cc0 0 2024-04-12T13:42:11.082 INFO:tasks.workunit.client.1.smithi110.stdout:4/720: mknod d0/d19/d26/d8a/de0/cef 0 2024-04-12T13:42:11.083 INFO:tasks.workunit.client.0.smithi060.stdout:9/515: mkdir d4/d8/dad 0 2024-04-12T13:42:11.084 INFO:tasks.workunit.client.1.smithi110.stdout:6/610: dwrite d7/d25/d2c/d4c/f8b [0,4194304] 0 2024-04-12T13:42:11.088 INFO:tasks.workunit.client.1.smithi110.stdout:8/620: sync 2024-04-12T13:42:11.088 INFO:tasks.workunit.client.1.smithi110.stdout:6/611: truncate d7/d10/d41/fab 2826687 0 2024-04-12T13:42:11.091 INFO:tasks.workunit.client.0.smithi060.stdout:1/708: dwrite d1e/d23/dd9/fc6 [4194304,4194304] 0 2024-04-12T13:42:11.095 INFO:tasks.workunit.client.1.smithi110.stdout:7/633: mknod d1/d1b/d74/db4/cd6 0 2024-04-12T13:42:11.105 INFO:tasks.workunit.client.1.smithi110.stdout:1/593: creat de/d15/d32/d61/d6a/dac/dc0/fcc x:0 0 0 2024-04-12T13:42:11.109 INFO:tasks.workunit.client.1.smithi110.stdout:7/634: dwrite d1/d3/f11 [0,4194304] 0 2024-04-12T13:42:11.111 INFO:tasks.workunit.client.1.smithi110.stdout:7/635: stat d1/d3/d4/l1d 0 2024-04-12T13:42:11.115 INFO:tasks.workunit.client.1.smithi110.stdout:7/636: stat d1/d3/d4/f2d 0 2024-04-12T13:42:11.115 INFO:tasks.workunit.client.1.smithi110.stdout:6/612: symlink d7/d10/d1c/lc7 0 2024-04-12T13:42:11.118 INFO:tasks.workunit.client.1.smithi110.stdout:3/606: creat d5/dc/da0/fc4 x:0 0 0 2024-04-12T13:42:11.121 INFO:tasks.workunit.client.1.smithi110.stdout:5/580: creat da/db/fc9 x:0 0 0 2024-04-12T13:42:11.124 INFO:tasks.workunit.client.1.smithi110.stdout:7/637: rmdir d1 39 2024-04-12T13:42:11.125 INFO:tasks.workunit.client.1.smithi110.stdout:9/696: dwrite df/d13/d26/d37/fae [4194304,4194304] 0 2024-04-12T13:42:11.132 INFO:tasks.workunit.client.1.smithi110.stdout:2/664: mknod d6/dc/dd/d49/d64/ccf 0 2024-04-12T13:42:11.132 INFO:tasks.workunit.client.1.smithi110.stdout:1/594: dwrite de/d7b/fc8 [0,4194304] 0 2024-04-12T13:42:11.134 INFO:tasks.workunit.client.1.smithi110.stdout:4/721: write d0/de/f4c [818034,66376] 0 2024-04-12T13:42:11.138 INFO:tasks.workunit.client.1.smithi110.stdout:7/638: stat d1/d1b/d3d/c98 0 2024-04-12T13:42:11.142 INFO:tasks.workunit.client.1.smithi110.stdout:0/547: dread d1/d8/f21 [4194304,4194304] 0 2024-04-12T13:42:11.147 INFO:tasks.workunit.client.1.smithi110.stdout:9/697: mknod df/d13/d2c/d2d/dc1/d83/d63/d72/cee 0 2024-04-12T13:42:11.149 INFO:tasks.workunit.client.1.smithi110.stdout:9/698: chown df/d13/d2c/d2d/dc1/d83/d63/le2 38 1 2024-04-12T13:42:11.149 INFO:tasks.workunit.client.1.smithi110.stdout:3/607: truncate d5/dc/d20/d2d/d4f/f9f 192990 0 2024-04-12T13:42:11.149 INFO:tasks.workunit.client.1.smithi110.stdout:9/699: readlink df/d13/l5f 0 2024-04-12T13:42:11.156 INFO:tasks.workunit.client.1.smithi110.stdout:4/722: mknod d0/d19/d8f/cf0 0 2024-04-12T13:42:11.156 INFO:tasks.workunit.client.0.smithi060.stdout:2/575: symlink d6/d10/d2b/d60/lb1 0 2024-04-12T13:42:11.157 INFO:tasks.workunit.client.0.smithi060.stdout:4/589: link d6/d2f/lc6 d6/db7/lcc 0 2024-04-12T13:42:11.157 INFO:tasks.workunit.client.1.smithi110.stdout:8/621: dwrite d1/d5/dd/d31/f3d [0,4194304] 0 2024-04-12T13:42:11.157 INFO:tasks.workunit.client.1.smithi110.stdout:4/723: chown d0/de/c35 155 1 2024-04-12T13:42:11.160 INFO:tasks.workunit.client.0.smithi060.stdout:4/590: write d6/d7/dd/d1a/d56/f5c [2059027,29560] 0 2024-04-12T13:42:11.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/561: rename d9/d1b/d3c/d8d/c98 to d9/d1b/d3c/d8d/cc8 0 2024-04-12T13:42:11.161 INFO:tasks.workunit.client.0.smithi060.stdout:4/591: stat d6 0 2024-04-12T13:42:11.161 INFO:tasks.workunit.client.1.smithi110.stdout:6/613: creat d7/d25/d30/d44/d3d/fc8 x:0 0 0 2024-04-12T13:42:11.162 INFO:tasks.workunit.client.1.smithi110.stdout:3/608: unlink d5/dc/d31/d74/f80 0 2024-04-12T13:42:11.162 INFO:tasks.workunit.client.0.smithi060.stdout:9/516: read - d4/d9/d19/f6a zero size 2024-04-12T13:42:11.162 INFO:tasks.workunit.client.1.smithi110.stdout:1/595: dread de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:11.163 INFO:tasks.workunit.client.0.smithi060.stdout:9/517: stat d4/d8/f4d 0 2024-04-12T13:42:11.164 INFO:tasks.workunit.client.1.smithi110.stdout:9/700: fdatasync df/d13/d3b/d40/d56/fbc 0 2024-04-12T13:42:11.167 INFO:tasks.workunit.client.0.smithi060.stdout:2/576: unlink d6/d10/f57 0 2024-04-12T13:42:11.169 INFO:tasks.workunit.client.0.smithi060.stdout:7/565: creat d0/d7/fbd x:0 0 0 2024-04-12T13:42:11.170 INFO:tasks.workunit.client.1.smithi110.stdout:9/701: truncate df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 4459117 0 2024-04-12T13:42:11.170 INFO:tasks.workunit.client.0.smithi060.stdout:5/578: mknod d6/dd/d1f/d25/d42/cbc 0 2024-04-12T13:42:11.175 INFO:tasks.workunit.client.1.smithi110.stdout:8/622: creat d1/d3/d35/d3a/d3e/d64/d85/d8d/fc4 x:0 0 0 2024-04-12T13:42:11.179 INFO:tasks.workunit.client.0.smithi060.stdout:4/592: rmdir d6/d7/dd/d1a/d56 39 2024-04-12T13:42:11.179 INFO:tasks.workunit.client.0.smithi060.stdout:2/577: dwrite d6/d56/f2d [0,4194304] 0 2024-04-12T13:42:11.183 INFO:tasks.workunit.client.0.smithi060.stdout:4/593: read d6/d7/dd/df/f37 [930049,89457] 0 2024-04-12T13:42:11.186 INFO:tasks.workunit.client.1.smithi110.stdout:2/665: mkdir d6/dc/dd/d49/d64/d4a/dc1/dd0 0 2024-04-12T13:42:11.189 INFO:tasks.workunit.client.1.smithi110.stdout:2/666: stat d6/dc/d13/d80/d8d/dcc/d82 0 2024-04-12T13:42:11.189 INFO:tasks.workunit.client.1.smithi110.stdout:1/596: fdatasync de/d14/d34/d55/d6b/f82 0 2024-04-12T13:42:11.192 INFO:tasks.workunit.client.0.smithi060.stdout:5/579: fdatasync f2 0 2024-04-12T13:42:11.193 INFO:tasks.workunit.client.1.smithi110.stdout:5/581: getdents da/d2e/d45/d25/d5d 0 2024-04-12T13:42:11.196 INFO:tasks.workunit.client.1.smithi110.stdout:5/582: write da/d2e/d45/d25/d9d/d7a/fab [3955209,60407] 0 2024-04-12T13:42:11.197 INFO:tasks.workunit.client.1.smithi110.stdout:8/623: dwrite d1/d3/d3c/d75/d79/fad [0,4194304] 0 2024-04-12T13:42:11.197 INFO:tasks.workunit.client.0.smithi060.stdout:8/562: mkdir d9/dc9 0 2024-04-12T13:42:11.201 INFO:tasks.workunit.client.0.smithi060.stdout:2/578: symlink d6/d10/d4b/lb2 0 2024-04-12T13:42:11.202 INFO:tasks.workunit.client.0.smithi060.stdout:1/709: truncate d1e/f28 5508733 0 2024-04-12T13:42:11.204 INFO:tasks.workunit.client.0.smithi060.stdout:1/710: dread - d1e/d23/d49/d4e/ff1 zero size 2024-04-12T13:42:11.208 INFO:tasks.workunit.client.0.smithi060.stdout:9/518: creat d4/d9/d19/d21/d73/fae x:0 0 0 2024-04-12T13:42:11.208 INFO:tasks.workunit.client.1.smithi110.stdout:3/609: truncate d5/f43 443300 0 2024-04-12T13:42:11.209 INFO:tasks.workunit.client.0.smithi060.stdout:5/580: mknod d6/dd/d27/d7d/cbd 0 2024-04-12T13:42:11.210 INFO:tasks.workunit.client.0.smithi060.stdout:9/519: chown d4/d33/d65/f91 319 1 2024-04-12T13:42:11.211 INFO:tasks.workunit.client.1.smithi110.stdout:4/724: dwrite d0/d19/d1c/f58 [0,4194304] 0 2024-04-12T13:42:11.211 INFO:tasks.workunit.client.1.smithi110.stdout:6/614: fdatasync d7/d25/d30/d44/d3d/f47 0 2024-04-12T13:42:11.213 INFO:tasks.workunit.client.1.smithi110.stdout:9/702: write df/d38/d6e/d7f/f8b [1224067,11026] 0 2024-04-12T13:42:11.215 INFO:tasks.workunit.client.1.smithi110.stdout:4/725: fdatasync d0/d19/d26/fd6 0 2024-04-12T13:42:11.215 INFO:tasks.workunit.client.0.smithi060.stdout:2/579: symlink d6/d64/d99/lb3 0 2024-04-12T13:42:11.216 INFO:tasks.workunit.client.1.smithi110.stdout:2/667: unlink d6/dc/dd/d49/d64/d25/l27 0 2024-04-12T13:42:11.218 INFO:tasks.workunit.client.0.smithi060.stdout:7/566: dwrite d0/d1b/f27 [0,4194304] 0 2024-04-12T13:42:11.218 INFO:tasks.workunit.client.0.smithi060.stdout:2/580: chown d6/dae/d31/d33/f61 13276 1 2024-04-12T13:42:11.223 INFO:tasks.workunit.client.1.smithi110.stdout:9/703: truncate df/d13/d2c/d2d/dc1/d83/d63/db4/fbf 442490 0 2024-04-12T13:42:11.225 INFO:tasks.workunit.client.1.smithi110.stdout:5/583: dread da/d2e/d45/d29/d66/f70 [0,4194304] 0 2024-04-12T13:42:11.227 INFO:tasks.workunit.client.1.smithi110.stdout:9/704: read - df/d13/d2c/d2d/dc1/d83/d63/d72/fc4 zero size 2024-04-12T13:42:11.230 INFO:tasks.workunit.client.1.smithi110.stdout:9/705: chown df/d13/d2c/d2d/dc1/d83/d5d/d89/cea 3440644 1 2024-04-12T13:42:11.231 INFO:tasks.workunit.client.1.smithi110.stdout:8/624: dread d1/d3/d3c/d5a/f9d [4194304,4194304] 0 2024-04-12T13:42:11.235 INFO:tasks.workunit.client.0.smithi060.stdout:3/643: sync 2024-04-12T13:42:11.235 INFO:tasks.workunit.client.0.smithi060.stdout:0/542: sync 2024-04-12T13:42:11.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/625: dwrite d1/d5/dd/fc0 [0,4194304] 0 2024-04-12T13:42:11.260 INFO:tasks.workunit.client.0.smithi060.stdout:7/567: write d0/d1b/d8c/faf [909030,73092] 0 2024-04-12T13:42:11.260 INFO:tasks.workunit.client.0.smithi060.stdout:3/644: chown d7/d17/d19/c66 129 1 2024-04-12T13:42:11.263 INFO:tasks.workunit.client.0.smithi060.stdout:4/594: write d6/d7/dd/df/f23 [101659,83424] 0 2024-04-12T13:42:11.263 INFO:tasks.workunit.client.1.smithi110.stdout:7/639: getdents d1/d1b/d74 0 2024-04-12T13:42:11.266 INFO:tasks.workunit.client.0.smithi060.stdout:9/520: dwrite d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:11.273 INFO:tasks.workunit.client.1.smithi110.stdout:0/548: getdents d1/d8/d36 0 2024-04-12T13:42:11.276 INFO:tasks.workunit.client.0.smithi060.stdout:0/543: fsync d7/d9/d14/f24 0 2024-04-12T13:42:11.277 INFO:tasks.workunit.client.1.smithi110.stdout:5/584: dread da/db/f37 [0,4194304] 0 2024-04-12T13:42:11.280 INFO:tasks.workunit.client.1.smithi110.stdout:5/585: write da/f11 [1079877,117223] 0 2024-04-12T13:42:11.288 INFO:tasks.workunit.client.0.smithi060.stdout:7/568: read d0/d1b/f5f [4240357,126045] 0 2024-04-12T13:42:11.291 INFO:tasks.workunit.client.0.smithi060.stdout:3/645: creat d7/d17/d27/d36/db0/fd6 x:0 0 0 2024-04-12T13:42:11.291 INFO:tasks.workunit.client.0.smithi060.stdout:7/569: chown d0/d7/da9 2495 1 2024-04-12T13:42:11.293 INFO:tasks.workunit.client.1.smithi110.stdout:6/615: fdatasync d7/d25/d30/d44/da3/fb8 0 2024-04-12T13:42:11.294 INFO:tasks.workunit.client.0.smithi060.stdout:9/521: dwrite d4/d33/d50/f74 [0,4194304] 0 2024-04-12T13:42:11.295 INFO:tasks.workunit.client.1.smithi110.stdout:0/549: dread d1/d8/d36/d51/d60/f18 [0,4194304] 0 2024-04-12T13:42:11.295 INFO:tasks.workunit.client.0.smithi060.stdout:2/581: write d6/f25 [1217032,46097] 0 2024-04-12T13:42:11.295 INFO:tasks.workunit.client.1.smithi110.stdout:4/726: truncate d0/d78/fb4 203032 0 2024-04-12T13:42:11.297 INFO:tasks.workunit.client.0.smithi060.stdout:3/646: fdatasync d7/d17/d19/d33/d63/f9e 0 2024-04-12T13:42:11.298 INFO:tasks.workunit.client.0.smithi060.stdout:9/522: chown d4/d9/l22 40298007 1 2024-04-12T13:42:11.300 INFO:tasks.workunit.client.1.smithi110.stdout:2/668: unlink d6/dc/d13/d80/d8d/dcc/d82/d84/lbc 0 2024-04-12T13:42:11.301 INFO:tasks.workunit.client.0.smithi060.stdout:9/523: chown d4/d8/d32/f78 498 1 2024-04-12T13:42:11.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/647: read - d7/d17/d27/d36/db0/fd6 zero size 2024-04-12T13:42:11.306 INFO:tasks.workunit.client.1.smithi110.stdout:9/706: creat df/d13/d2c/d2d/d94/fef x:0 0 0 2024-04-12T13:42:11.307 INFO:tasks.workunit.client.0.smithi060.stdout:8/563: getdents d9/d1d/d5e/d90 0 2024-04-12T13:42:11.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/648: read d7/d17/d19/d33/d63/d6d/f98 [291777,27561] 0 2024-04-12T13:42:11.309 INFO:tasks.workunit.client.1.smithi110.stdout:1/597: truncate de/d7b/fc8 2709219 0 2024-04-12T13:42:11.312 INFO:tasks.workunit.client.0.smithi060.stdout:3/649: readlink d7/d17/d27/l88 0 2024-04-12T13:42:11.313 INFO:tasks.workunit.client.1.smithi110.stdout:7/640: mknod d1/d3/d4/d55/cd7 0 2024-04-12T13:42:11.315 INFO:tasks.workunit.client.0.smithi060.stdout:5/581: dwrite d6/dd/d1f/d25/d42/d52/d7a/fb0 [0,4194304] 0 2024-04-12T13:42:11.315 INFO:tasks.workunit.client.0.smithi060.stdout:0/544: dread d7/d9/f82 [0,4194304] 0 2024-04-12T13:42:11.318 INFO:tasks.workunit.client.1.smithi110.stdout:8/626: write d1/d3/d35/d3a/d3e/f99 [130698,124659] 0 2024-04-12T13:42:11.319 INFO:tasks.workunit.client.1.smithi110.stdout:9/707: dwrite fd [0,4194304] 0 2024-04-12T13:42:11.319 INFO:tasks.workunit.client.1.smithi110.stdout:5/586: symlink da/db/d3b/lca 0 2024-04-12T13:42:11.321 INFO:tasks.workunit.client.1.smithi110.stdout:9/708: stat df/d13/d26 0 2024-04-12T13:42:11.326 INFO:tasks.workunit.client.1.smithi110.stdout:6/616: rename d7/d10/d1c/d2b/f7a to d7/d25/d30/d9e/dc3/fc9 0 2024-04-12T13:42:11.327 INFO:tasks.workunit.client.1.smithi110.stdout:1/598: dwrite de/d15/d32/d61/f73 [0,4194304] 0 2024-04-12T13:42:11.327 INFO:tasks.workunit.client.1.smithi110.stdout:2/669: fdatasync d6/dc/dd/d49/d64/d5d/f71 0 2024-04-12T13:42:11.328 INFO:tasks.workunit.client.1.smithi110.stdout:6/617: write d7/f19 [1168983,11633] 0 2024-04-12T13:42:11.331 INFO:tasks.workunit.client.1.smithi110.stdout:8/627: symlink d1/d3/d3c/d5a/d6f/d7e/lc5 0 2024-04-12T13:42:11.333 INFO:tasks.workunit.client.1.smithi110.stdout:2/670: fsync d6/dc/d6f/f96 0 2024-04-12T13:42:11.334 INFO:tasks.workunit.client.1.smithi110.stdout:2/671: chown d6/d18/da2 97152192 1 2024-04-12T13:42:11.340 INFO:tasks.workunit.client.1.smithi110.stdout:9/709: symlink df/d13/d2c/d2d/d94/lf0 0 2024-04-12T13:42:11.340 INFO:tasks.workunit.client.1.smithi110.stdout:0/550: link d1/d8/d36/d65/f84 d1/d48/fc1 0 2024-04-12T13:42:11.340 INFO:tasks.workunit.client.1.smithi110.stdout:1/599: mknod de/d15/dab/ccd 0 2024-04-12T13:42:11.340 INFO:tasks.workunit.client.1.smithi110.stdout:5/587: mknod da/d2e/d45/d29/d66/d7c/ccb 0 2024-04-12T13:42:11.343 INFO:tasks.workunit.client.1.smithi110.stdout:6/618: creat d7/d25/dc6/fca x:0 0 0 2024-04-12T13:42:11.344 INFO:tasks.workunit.client.1.smithi110.stdout:8/628: write d1/d3/d3c/d75/d79/fad [4496349,68351] 0 2024-04-12T13:42:11.347 INFO:tasks.workunit.client.1.smithi110.stdout:1/600: symlink de/d15/d32/d61/d6a/lce 0 2024-04-12T13:42:11.347 INFO:tasks.workunit.client.1.smithi110.stdout:3/610: getdents d5/dc/d31/d3b/d5b 0 2024-04-12T13:42:11.347 INFO:tasks.workunit.client.1.smithi110.stdout:0/551: mknod d1/d48/cc2 0 2024-04-12T13:42:11.348 INFO:tasks.workunit.client.1.smithi110.stdout:5/588: symlink da/db/lcc 0 2024-04-12T13:42:11.353 INFO:tasks.workunit.client.1.smithi110.stdout:5/589: read da/d2e/d45/faa [1534933,9132] 0 2024-04-12T13:42:11.354 INFO:tasks.workunit.client.1.smithi110.stdout:6/619: creat d7/d25/d30/d44/d3d/fcb x:0 0 0 2024-04-12T13:42:11.354 INFO:tasks.workunit.client.1.smithi110.stdout:3/611: rmdir d5/dc/d31/d74 39 2024-04-12T13:42:11.355 INFO:tasks.workunit.client.1.smithi110.stdout:1/601: truncate f5 1876168 0 2024-04-12T13:42:11.360 INFO:tasks.workunit.client.1.smithi110.stdout:8/629: getdents d1/d7 0 2024-04-12T13:42:11.361 INFO:tasks.workunit.client.1.smithi110.stdout:4/727: dread d0/de/d32/f8c [0,4194304] 0 2024-04-12T13:42:11.362 INFO:tasks.workunit.client.1.smithi110.stdout:9/710: dwrite df/d13/d2c/d9e/dd6/fa7 [0,4194304] 0 2024-04-12T13:42:11.367 INFO:tasks.workunit.client.1.smithi110.stdout:5/590: rename da/d2e/f56 to da/db/d3b/d40/da2/fcd 0 2024-04-12T13:42:11.368 INFO:tasks.workunit.client.1.smithi110.stdout:8/630: mkdir d1/d7/d20/da3/dc6 0 2024-04-12T13:42:11.368 INFO:tasks.workunit.client.1.smithi110.stdout:7/641: write d1/d3/d43/f7c [109610,118820] 0 2024-04-12T13:42:11.374 INFO:tasks.workunit.client.1.smithi110.stdout:9/711: rmdir df/d13/d2c/d2d/dc1/d9f 39 2024-04-12T13:42:11.377 INFO:tasks.workunit.client.1.smithi110.stdout:1/602: creat de/d14/d34/d55/fcf x:0 0 0 2024-04-12T13:42:11.378 INFO:tasks.workunit.client.1.smithi110.stdout:4/728: dwrite d0/f5 [0,4194304] 0 2024-04-12T13:42:11.378 INFO:tasks.workunit.client.1.smithi110.stdout:5/591: write da/d35/f4e [12875020,34382] 0 2024-04-12T13:42:11.379 INFO:tasks.workunit.client.0.smithi060.stdout:2/582: mknod d6/d10/d2b/cb4 0 2024-04-12T13:42:11.379 INFO:tasks.workunit.client.0.smithi060.stdout:7/570: dwrite d0/f47 [0,4194304] 0 2024-04-12T13:42:11.382 INFO:tasks.workunit.client.0.smithi060.stdout:4/595: creat d6/d7/dd/d1a/fcd x:0 0 0 2024-04-12T13:42:11.384 INFO:tasks.workunit.client.0.smithi060.stdout:3/650: mknod d7/d17/d19/d33/d63/d9b/cd7 0 2024-04-12T13:42:11.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/524: mkdir d4/d9/d19/daf 0 2024-04-12T13:42:11.392 INFO:tasks.workunit.client.1.smithi110.stdout:9/712: truncate df/d13/d2c/d2d/d39/d4f/fdd 1599846 0 2024-04-12T13:42:11.397 INFO:tasks.workunit.client.0.smithi060.stdout:7/571: dread - d0/d7/f49 zero size 2024-04-12T13:42:11.397 INFO:tasks.workunit.client.1.smithi110.stdout:1/603: rename de/d15/d32/d5e/d79 to de/d14/dd0 0 2024-04-12T13:42:11.398 INFO:tasks.workunit.client.0.smithi060.stdout:9/525: chown d4/d9/d19/d21/d73/l89 204 1 2024-04-12T13:42:11.400 INFO:tasks.workunit.client.1.smithi110.stdout:3/612: write d5/dc/d20/d2d/d4f/f95 [14125,71792] 0 2024-04-12T13:42:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/583: dread d6/d56/f2d [0,4194304] 0 2024-04-12T13:42:11.403 INFO:tasks.workunit.client.0.smithi060.stdout:2/584: write d6/d56/d43/f72 [4334168,654] 0 2024-04-12T13:42:11.404 INFO:tasks.workunit.client.0.smithi060.stdout:4/596: rmdir d6/d7/dd 39 2024-04-12T13:42:11.406 INFO:tasks.workunit.client.0.smithi060.stdout:2/585: dread d6/dae/d31/d33/d3d/f63 [0,4194304] 0 2024-04-12T13:42:11.407 INFO:tasks.workunit.client.0.smithi060.stdout:3/651: write d7/d17/d27/d36/fb9 [4506500,54181] 0 2024-04-12T13:42:11.408 INFO:tasks.workunit.client.1.smithi110.stdout:0/552: dwrite d1/d27/d31/f64 [0,4194304] 0 2024-04-12T13:42:11.409 INFO:tasks.workunit.client.0.smithi060.stdout:3/652: chown d7/d17/d27/da7 1721439 1 2024-04-12T13:42:11.411 INFO:tasks.workunit.client.0.smithi060.stdout:3/653: chown d7/d17/d27/da7 13568260 1 2024-04-12T13:42:11.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/545: read d7/d9/d14/d35/d44/d7d/f32 [510925,62553] 0 2024-04-12T13:42:11.411 INFO:tasks.workunit.client.1.smithi110.stdout:0/553: dread - d1/d8/d8a/fa8 zero size 2024-04-12T13:42:11.411 INFO:tasks.workunit.client.1.smithi110.stdout:8/631: write d1/d3/d35/d3a/d3e/d4f/f87 [921117,67537] 0 2024-04-12T13:42:11.411 INFO:tasks.workunit.client.1.smithi110.stdout:6/620: truncate d7/d25/d30/d44/f1d 3920887 0 2024-04-12T13:42:11.417 INFO:tasks.workunit.client.1.smithi110.stdout:4/729: symlink d0/de/d32/d5f/dd3/lf1 0 2024-04-12T13:42:11.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/572: rmdir d0/d1b 39 2024-04-12T13:42:11.426 INFO:tasks.workunit.client.1.smithi110.stdout:7/642: link d1/d3/d4/d55/l6c d1/d3/d4/d55/d56/d72/dad/ld8 0 2024-04-12T13:42:11.427 INFO:tasks.workunit.client.1.smithi110.stdout:7/643: readlink d1/d3/l8 0 2024-04-12T13:42:11.428 INFO:tasks.workunit.client.1.smithi110.stdout:9/713: mknod df/d13/d3b/d40/dde/cf1 0 2024-04-12T13:42:11.428 INFO:tasks.workunit.client.1.smithi110.stdout:5/592: dwrite da/d2e/d45/d29/d32/f54 [0,4194304] 0 2024-04-12T13:42:11.429 INFO:tasks.workunit.client.1.smithi110.stdout:9/714: readlink df/d13/l5f 0 2024-04-12T13:42:11.430 INFO:tasks.workunit.client.1.smithi110.stdout:8/632: chown d1/d5/c2c 7 1 2024-04-12T13:42:11.431 INFO:tasks.workunit.client.0.smithi060.stdout:2/586: truncate d6/d10/d6b/f84 552613 0 2024-04-12T13:42:11.432 INFO:tasks.workunit.client.1.smithi110.stdout:6/621: readlink d7/d10/d1c/d7f/l8c 0 2024-04-12T13:42:11.432 INFO:tasks.workunit.client.0.smithi060.stdout:0/546: truncate d7/d9/d14/f6f 882053 0 2024-04-12T13:42:11.433 INFO:tasks.workunit.client.1.smithi110.stdout:0/554: creat d1/d48/db2/d4a/fc3 x:0 0 0 2024-04-12T13:42:11.434 INFO:tasks.workunit.client.0.smithi060.stdout:0/547: chown d7/lc 1 1 2024-04-12T13:42:11.434 INFO:tasks.workunit.client.1.smithi110.stdout:8/633: write d1/d5/dd/d31/f3d [4146618,128059] 0 2024-04-12T13:42:11.438 INFO:tasks.workunit.client.0.smithi060.stdout:6/664: sync 2024-04-12T13:42:11.438 INFO:tasks.workunit.client.0.smithi060.stdout:5/582: rename d6/dd/d1f/l9e to d6/dd/d1f/d25/d42/lbe 0 2024-04-12T13:42:11.439 INFO:tasks.workunit.client.0.smithi060.stdout:4/597: write d6/d7/db/d85/f4e [4463559,44482] 0 2024-04-12T13:42:11.443 INFO:tasks.workunit.client.0.smithi060.stdout:9/526: creat d4/d9/fb0 x:0 0 0 2024-04-12T13:42:11.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/573: mkdir d0/d7/d43/d63/dbe 0 2024-04-12T13:42:11.446 INFO:tasks.workunit.client.1.smithi110.stdout:5/593: creat da/d2e/d45/d25/d9d/d7a/db5/fce x:0 0 0 2024-04-12T13:42:11.447 INFO:tasks.workunit.client.1.smithi110.stdout:6/622: readlink d7/l26 0 2024-04-12T13:42:11.449 INFO:tasks.workunit.client.1.smithi110.stdout:5/594: write da/d2e/d45/d25/d9d/d7a/db5/fce [208463,109722] 0 2024-04-12T13:42:11.450 INFO:tasks.workunit.client.0.smithi060.stdout:4/598: creat d6/d2f/fce x:0 0 0 2024-04-12T13:42:11.450 INFO:tasks.workunit.client.1.smithi110.stdout:6/623: chown d7/d25/d2c/d4c/d77/d93/lac 26309730 1 2024-04-12T13:42:11.452 INFO:tasks.workunit.client.0.smithi060.stdout:5/583: rmdir d6/dd/d1f/d25/d42/d52 39 2024-04-12T13:42:11.452 INFO:tasks.workunit.client.1.smithi110.stdout:5/595: stat da/d2e/d45/d29/d66/cc8 0 2024-04-12T13:42:11.454 INFO:tasks.workunit.client.0.smithi060.stdout:2/587: write d6/f8 [4352374,62971] 0 2024-04-12T13:42:11.454 INFO:tasks.workunit.client.1.smithi110.stdout:3/613: dwrite d5/dc/d31/d3b/d32/d3e/d5f/f9b [0,4194304] 0 2024-04-12T13:42:11.454 INFO:tasks.workunit.client.1.smithi110.stdout:7/644: truncate d1/d3/d4/d55/d56/d72/f88 599719 0 2024-04-12T13:42:11.454 INFO:tasks.workunit.client.0.smithi060.stdout:9/527: fsync d4/d8/f4d 0 2024-04-12T13:42:11.458 INFO:tasks.workunit.client.1.smithi110.stdout:1/604: link de/d14/la4 de/d15/d32/ld1 0 2024-04-12T13:42:11.458 INFO:tasks.workunit.client.1.smithi110.stdout:8/634: mknod d1/d7/d20/cc7 0 2024-04-12T13:42:11.460 INFO:tasks.workunit.client.1.smithi110.stdout:8/635: stat d1/d3/d3c/d5a/d6f/d7e/f63 0 2024-04-12T13:42:11.461 INFO:tasks.workunit.client.1.smithi110.stdout:4/730: truncate d0/de/d2c/f4d 2452725 0 2024-04-12T13:42:11.462 INFO:tasks.workunit.client.1.smithi110.stdout:8/636: chown d1/d3/f24 3 1 2024-04-12T13:42:11.462 INFO:tasks.workunit.client.1.smithi110.stdout:8/637: dread - d1/d3/d3c/d5a/f6d zero size 2024-04-12T13:42:11.465 INFO:tasks.workunit.client.1.smithi110.stdout:8/638: write d1/d3/d3c/d75/d79/fad [3966873,29479] 0 2024-04-12T13:42:11.467 INFO:tasks.workunit.client.1.smithi110.stdout:9/715: rename df/d13/d3b/le1 to df/d13/d2c/d9e/dd6/dcf/dd2/lf2 0 2024-04-12T13:42:11.471 INFO:tasks.workunit.client.1.smithi110.stdout:8/639: truncate d1/d3/d35/d43/d9f/fbf 505329 0 2024-04-12T13:42:11.471 INFO:tasks.workunit.client.1.smithi110.stdout:3/614: dwrite d5/dc/f19 [0,4194304] 0 2024-04-12T13:42:11.471 INFO:tasks.workunit.client.0.smithi060.stdout:5/584: creat d6/dd/d1f/d32/da2/fbf x:0 0 0 2024-04-12T13:42:11.474 INFO:tasks.workunit.client.1.smithi110.stdout:5/596: symlink da/d2e/d45/d29/d66/lcf 0 2024-04-12T13:42:11.474 INFO:tasks.workunit.client.1.smithi110.stdout:7/645: creat d1/d3/d4/d55/d56/fd9 x:0 0 0 2024-04-12T13:42:11.475 INFO:tasks.workunit.client.0.smithi060.stdout:4/599: write d6/d7/dd/df/f18 [1325073,119301] 0 2024-04-12T13:42:11.475 INFO:tasks.workunit.client.1.smithi110.stdout:2/672: sync 2024-04-12T13:42:11.476 INFO:tasks.workunit.client.0.smithi060.stdout:4/600: readlink d6/d7/dd/l34 0 2024-04-12T13:42:11.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/574: dwrite d0/d1b/d8c/f91 [4194304,4194304] 0 2024-04-12T13:42:11.477 INFO:tasks.workunit.client.0.smithi060.stdout:2/588: rmdir d6/d56/d55 39 2024-04-12T13:42:11.480 INFO:tasks.workunit.client.0.smithi060.stdout:2/589: write d6/dae/d31/d33/d3d/f59 [4256714,17165] 0 2024-04-12T13:42:11.483 INFO:tasks.workunit.client.0.smithi060.stdout:2/590: stat d6/d56/d58/da0/f30 0 2024-04-12T13:42:11.484 INFO:tasks.workunit.client.1.smithi110.stdout:4/731: chown d0/de/da0/lac 6 1 2024-04-12T13:42:11.489 INFO:tasks.workunit.client.1.smithi110.stdout:8/640: rename d1/d3/d3c/c50 to d1/d3/cc8 0 2024-04-12T13:42:11.489 INFO:tasks.workunit.client.1.smithi110.stdout:6/624: dwrite d7/d10/d1c/d2b/f71 [0,4194304] 0 2024-04-12T13:42:11.491 INFO:tasks.workunit.client.1.smithi110.stdout:3/615: mkdir d5/dc/d20/d2d/d4e/d89/d8c/dc5 0 2024-04-12T13:42:11.493 INFO:tasks.workunit.client.1.smithi110.stdout:4/732: dread d0/d19/d26/fbe [0,4194304] 0 2024-04-12T13:42:11.494 INFO:tasks.workunit.client.0.smithi060.stdout:6/665: truncate d1/d7/da/dc/d24/d34/d51/fd2 1945561 0 2024-04-12T13:42:11.495 INFO:tasks.workunit.client.1.smithi110.stdout:4/733: chown d0/d19/f6d 4704681 1 2024-04-12T13:42:11.497 INFO:tasks.workunit.client.0.smithi060.stdout:6/666: chown d1/d7/da/dc/d24/c89 352335 1 2024-04-12T13:42:11.497 INFO:tasks.workunit.client.1.smithi110.stdout:7/646: unlink d1/d3/d4/l7 0 2024-04-12T13:42:11.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/575: creat d0/d7/d43/d63/d90/fbf x:0 0 0 2024-04-12T13:42:11.502 INFO:tasks.workunit.client.0.smithi060.stdout:9/528: mkdir d4/d9/d19/db1 0 2024-04-12T13:42:11.505 INFO:tasks.workunit.client.0.smithi060.stdout:2/591: mknod d6/d56/d86/cb5 0 2024-04-12T13:42:11.505 INFO:tasks.workunit.client.0.smithi060.stdout:0/548: getdents d7/d9/d14/d4a 0 2024-04-12T13:42:11.506 INFO:tasks.workunit.client.1.smithi110.stdout:5/597: creat da/d2e/d45/d25/d9d/d79/fd0 x:0 0 0 2024-04-12T13:42:11.506 INFO:tasks.workunit.client.1.smithi110.stdout:0/555: link d1/d48/db2/d4a/l79 d1/d27/d6e/lc4 0 2024-04-12T13:42:11.508 INFO:tasks.workunit.client.1.smithi110.stdout:5/598: truncate da/d5c/f8b 5160688 0 2024-04-12T13:42:11.508 INFO:tasks.workunit.client.1.smithi110.stdout:4/734: dwrite d0/d13/f2a [0,4194304] 0 2024-04-12T13:42:11.509 INFO:tasks.workunit.client.0.smithi060.stdout:0/549: fsync d7/d9/d14/d35/f6b 0 2024-04-12T13:42:11.510 INFO:tasks.workunit.client.1.smithi110.stdout:1/605: creat de/d14/d34/d55/d6b/dc7/fd2 x:0 0 0 2024-04-12T13:42:11.512 INFO:tasks.workunit.client.1.smithi110.stdout:5/599: write da/d2e/d45/d25/d9d/d7a/db5/d8f/fc7 [51042,63920] 0 2024-04-12T13:42:11.512 INFO:tasks.workunit.client.1.smithi110.stdout:1/606: chown de/d14/d34/d55/d6b/f77 1920025 1 2024-04-12T13:42:11.512 INFO:tasks.workunit.client.0.smithi060.stdout:7/576: dread d0/d1b/f72 [0,4194304] 0 2024-04-12T13:42:11.515 INFO:tasks.workunit.client.0.smithi060.stdout:5/585: rename d6/dd/d1f/d32/l55 to d6/d10/lc0 0 2024-04-12T13:42:11.517 INFO:tasks.workunit.client.0.smithi060.stdout:7/577: write d0/d78/f97 [907829,75476] 0 2024-04-12T13:42:11.518 INFO:tasks.workunit.client.1.smithi110.stdout:8/641: rmdir d1/d3/d3c/d75 39 2024-04-12T13:42:11.518 INFO:tasks.workunit.client.0.smithi060.stdout:6/667: dwrite d1/d7/da/dc/d24/f96 [0,4194304] 0 2024-04-12T13:42:11.520 INFO:tasks.workunit.client.0.smithi060.stdout:2/592: unlink d6/d56/f51 0 2024-04-12T13:42:11.521 INFO:tasks.workunit.client.1.smithi110.stdout:8/642: read d1/d7/d20/f36 [1370213,15183] 0 2024-04-12T13:42:11.524 INFO:tasks.workunit.client.0.smithi060.stdout:2/593: stat d6/d56/d58/da0/f6f 0 2024-04-12T13:42:11.524 INFO:tasks.workunit.client.0.smithi060.stdout:9/529: mknod d4/d9/d19/cb2 0 2024-04-12T13:42:11.529 INFO:tasks.workunit.client.1.smithi110.stdout:7/647: symlink d1/d3/d4/da6/lda 0 2024-04-12T13:42:11.529 INFO:tasks.workunit.client.0.smithi060.stdout:2/594: write d6/dae/d5b/d6d/f6e [30736,79875] 0 2024-04-12T13:42:11.535 INFO:tasks.workunit.client.1.smithi110.stdout:2/673: creat d6/dc/dd/dc6/fd1 x:0 0 0 2024-04-12T13:42:11.537 INFO:tasks.workunit.client.1.smithi110.stdout:7/648: dread d1/d3/d4/f9 [8388608,4194304] 0 2024-04-12T13:42:11.538 INFO:tasks.workunit.client.1.smithi110.stdout:0/556: symlink d1/d8/d36/d51/d60/lc5 0 2024-04-12T13:42:11.538 INFO:tasks.workunit.client.1.smithi110.stdout:3/616: dwrite d5/fa2 [0,4194304] 0 2024-04-12T13:42:11.541 INFO:tasks.workunit.client.1.smithi110.stdout:0/557: truncate d1/d8/d8a/fa8 122454 0 2024-04-12T13:42:11.541 INFO:tasks.workunit.client.0.smithi060.stdout:5/586: creat d6/dd/d1f/d25/d35/d50/d5f/fc1 x:0 0 0 2024-04-12T13:42:11.545 INFO:tasks.workunit.client.1.smithi110.stdout:1/607: mknod de/d14/d34/d55/d6b/dc7/cd3 0 2024-04-12T13:42:11.547 INFO:tasks.workunit.client.0.smithi060.stdout:2/595: fdatasync d6/d10/d16/f2e 0 2024-04-12T13:42:11.547 INFO:tasks.workunit.client.1.smithi110.stdout:6/625: getdents d7/da9 0 2024-04-12T13:42:11.549 INFO:tasks.workunit.client.1.smithi110.stdout:6/626: chown d7/d25/c3f 3 1 2024-04-12T13:42:11.549 INFO:tasks.workunit.client.1.smithi110.stdout:8/643: creat d1/d3/d35/d3a/d41/d77/fc9 x:0 0 0 2024-04-12T13:42:11.550 INFO:tasks.workunit.client.1.smithi110.stdout:9/716: link df/d13/d2c/d9e/la9 df/d13/d2c/d2d/dc1/d83/d63/db4/lf3 0 2024-04-12T13:42:11.552 INFO:tasks.workunit.client.0.smithi060.stdout:5/587: chown d6/d10/d12/f9f 6037311 1 2024-04-12T13:42:11.555 INFO:tasks.workunit.client.1.smithi110.stdout:4/735: unlink d0/d19/d26/d8a/ce1 0 2024-04-12T13:42:11.556 INFO:tasks.workunit.client.1.smithi110.stdout:7/649: rename d1/d1b/d74/l99 to d1/d3/d4/dbf/ldb 0 2024-04-12T13:42:11.558 INFO:tasks.workunit.client.0.smithi060.stdout:0/550: creat d7/d9/d14/d35/d44/d49/fc0 x:0 0 0 2024-04-12T13:42:11.558 INFO:tasks.workunit.client.1.smithi110.stdout:7/650: write d1/f18 [545336,63301] 0 2024-04-12T13:42:11.560 INFO:tasks.workunit.client.1.smithi110.stdout:0/558: mkdir d1/d8/d36/dc6 0 2024-04-12T13:42:11.562 INFO:tasks.workunit.client.1.smithi110.stdout:5/600: rmdir da/d2e/d45/d29/d66/d7c/d8a 39 2024-04-12T13:42:11.568 INFO:tasks.workunit.client.0.smithi060.stdout:4/601: rename d6/d7/dd/d1a/d19/c3e to d6/d7/dd/ccf 0 2024-04-12T13:42:11.568 INFO:tasks.workunit.client.1.smithi110.stdout:4/736: dwrite d0/d19/d1c/d50/fe2 [0,4194304] 0 2024-04-12T13:42:11.570 INFO:tasks.workunit.client.1.smithi110.stdout:8/644: mknod d1/d7/d20/da3/cca 0 2024-04-12T13:42:11.571 INFO:tasks.workunit.client.1.smithi110.stdout:6/627: mkdir d7/d10/d1c/d2b/d48/d4b/dcc 0 2024-04-12T13:42:11.572 INFO:tasks.workunit.client.0.smithi060.stdout:7/578: write d0/d7/f10 [1778484,10216] 0 2024-04-12T13:42:11.573 INFO:tasks.workunit.client.1.smithi110.stdout:6/628: chown d7/d25/c3f 4080 1 2024-04-12T13:42:11.574 INFO:tasks.workunit.client.1.smithi110.stdout:3/617: unlink d5/dc/d31/c3d 0 2024-04-12T13:42:11.575 INFO:tasks.workunit.client.0.smithi060.stdout:0/551: truncate d7/d9/f21 3169843 0 2024-04-12T13:42:11.578 INFO:tasks.workunit.client.0.smithi060.stdout:6/668: truncate d1/d7/da/dc/d24/d30/d52/f60 1737174 0 2024-04-12T13:42:11.582 INFO:tasks.workunit.client.0.smithi060.stdout:7/579: dread - d0/d1b/f60 zero size 2024-04-12T13:42:11.584 INFO:tasks.workunit.client.1.smithi110.stdout:8/645: dread d1/d3/d3c/d5a/f9d [4194304,4194304] 0 2024-04-12T13:42:11.587 INFO:tasks.workunit.client.0.smithi060.stdout:2/596: write d6/d56/d43/f5e [577123,36479] 0 2024-04-12T13:42:11.588 INFO:tasks.workunit.client.0.smithi060.stdout:5/588: rename d6/dd/d27/l51 to d6/dd/lc2 0 2024-04-12T13:42:11.589 INFO:tasks.workunit.client.1.smithi110.stdout:5/601: mknod da/d2e/d45/d25/d9d/d7a/db5/d89/cd1 0 2024-04-12T13:42:11.591 INFO:tasks.workunit.client.1.smithi110.stdout:5/602: dread - da/d2e/d45/d29/fbc zero size 2024-04-12T13:42:11.593 INFO:tasks.workunit.client.0.smithi060.stdout:5/589: write d6/dd/d1f/d25/d35/d50/d5f/fc1 [222542,102807] 0 2024-04-12T13:42:11.593 INFO:tasks.workunit.client.0.smithi060.stdout:7/580: symlink d0/d3d/d74/lc0 0 2024-04-12T13:42:11.595 INFO:tasks.workunit.client.1.smithi110.stdout:9/717: mkdir df/d13/df4 0 2024-04-12T13:42:11.596 INFO:tasks.workunit.client.0.smithi060.stdout:4/602: dread d6/d21/f41 [0,4194304] 0 2024-04-12T13:42:11.600 INFO:tasks.workunit.client.0.smithi060.stdout:4/603: write d6/d2f/fce [459607,28274] 0 2024-04-12T13:42:11.601 INFO:tasks.workunit.client.1.smithi110.stdout:6/629: symlink d7/da4/lcd 0 2024-04-12T13:42:11.603 INFO:tasks.workunit.client.1.smithi110.stdout:6/630: dread - d7/d25/d30/d44/da3/fb8 zero size 2024-04-12T13:42:11.605 INFO:tasks.workunit.client.0.smithi060.stdout:0/552: write d7/d9/de/f91 [1060575,97508] 0 2024-04-12T13:42:11.606 INFO:tasks.workunit.client.1.smithi110.stdout:5/603: dread da/d2e/f30 [0,4194304] 0 2024-04-12T13:42:11.609 INFO:tasks.workunit.client.1.smithi110.stdout:0/559: readlink d1/d8/d36/d51/d60/l23 0 2024-04-12T13:42:11.610 INFO:tasks.workunit.client.1.smithi110.stdout:8/646: creat d1/d7/d20/fcb x:0 0 0 2024-04-12T13:42:11.610 INFO:tasks.workunit.client.0.smithi060.stdout:2/597: dread d6/dae/d5b/f96 [0,4194304] 0 2024-04-12T13:42:11.611 INFO:tasks.workunit.client.0.smithi060.stdout:6/669: write d1/d7/da/dc/d24/d34/d51/d59/f87 [585131,37125] 0 2024-04-12T13:42:11.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/647: write d1/f5c [3338408,111514] 0 2024-04-12T13:42:11.613 INFO:tasks.workunit.client.1.smithi110.stdout:1/608: creat de/d15/fd4 x:0 0 0 2024-04-12T13:42:11.614 INFO:tasks.workunit.client.0.smithi060.stdout:2/598: read d6/d56/d43/f65 [909355,1971] 0 2024-04-12T13:42:11.614 INFO:tasks.workunit.client.1.smithi110.stdout:7/651: dwrite d1/d3/f6d [0,4194304] 0 2024-04-12T13:42:11.615 INFO:tasks.workunit.client.1.smithi110.stdout:8/648: read d1/f9b [113546,63985] 0 2024-04-12T13:42:11.616 INFO:tasks.workunit.client.1.smithi110.stdout:1/609: chown de/d14/dd0/f92 8551 1 2024-04-12T13:42:11.617 INFO:tasks.workunit.client.1.smithi110.stdout:9/718: fdatasync df/d13/d26/f45 0 2024-04-12T13:42:11.622 INFO:tasks.workunit.client.0.smithi060.stdout:5/590: creat d6/dd/d1f/d25/d42/d52/d7a/fc3 x:0 0 0 2024-04-12T13:42:11.623 INFO:tasks.workunit.client.0.smithi060.stdout:5/591: chown d6/dd/d1f/d25/d35/d50/d5f 25 1 2024-04-12T13:42:11.626 INFO:tasks.workunit.client.1.smithi110.stdout:5/604: unlink da/d2e/d45/d29/d58/c83 0 2024-04-12T13:42:11.629 INFO:tasks.workunit.client.1.smithi110.stdout:3/618: dwrite d5/dc/f24 [0,4194304] 0 2024-04-12T13:42:11.636 INFO:tasks.workunit.client.1.smithi110.stdout:8/649: unlink d1/d3/d35/d3a/d41/f69 0 2024-04-12T13:42:11.637 INFO:tasks.workunit.client.0.smithi060.stdout:0/553: dread d7/d9/d14/d35/d44/d49/d74/f95 [0,4194304] 0 2024-04-12T13:42:11.639 INFO:tasks.workunit.client.0.smithi060.stdout:7/581: getdents d0/d3d/d74 0 2024-04-12T13:42:11.639 INFO:tasks.workunit.client.1.smithi110.stdout:6/631: write d7/d25/d2c/f57 [31926,120093] 0 2024-04-12T13:42:11.641 INFO:tasks.workunit.client.1.smithi110.stdout:6/632: dread - d7/d25/d30/d44/d3d/fc8 zero size 2024-04-12T13:42:11.642 INFO:tasks.workunit.client.0.smithi060.stdout:7/582: read d0/f21 [1971927,117411] 0 2024-04-12T13:42:11.642 INFO:tasks.workunit.client.1.smithi110.stdout:6/633: chown d7/d10/d1c/d4d 172962366 1 2024-04-12T13:42:11.645 INFO:tasks.workunit.client.1.smithi110.stdout:1/610: truncate de/d14/d34/d55/d6b/f6f 1737795 0 2024-04-12T13:42:11.645 INFO:tasks.workunit.client.1.smithi110.stdout:2/674: sync 2024-04-12T13:42:11.648 INFO:tasks.workunit.client.1.smithi110.stdout:2/675: write d6/dc/d9d/fa1 [973852,35842] 0 2024-04-12T13:42:11.648 INFO:tasks.workunit.client.0.smithi060.stdout:6/670: dread d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b [0,4194304] 0 2024-04-12T13:42:11.653 INFO:tasks.workunit.client.0.smithi060.stdout:5/592: dread - d6/dd/d1f/d32/da2/fbf zero size 2024-04-12T13:42:11.655 INFO:tasks.workunit.client.1.smithi110.stdout:7/652: mknod d1/d31/cdc 0 2024-04-12T13:42:11.655 INFO:tasks.workunit.client.1.smithi110.stdout:0/560: write d1/d8/d36/d65/f6c [907276,48155] 0 2024-04-12T13:42:11.657 INFO:tasks.workunit.client.1.smithi110.stdout:3/619: mkdir d5/dc/d31/d3b/d32/d3e/d5f/dc6 0 2024-04-12T13:42:11.658 INFO:tasks.workunit.client.0.smithi060.stdout:4/604: link d6/d7/l84 d6/d7/dd/d1a/d57/d63/d68/d76/ld0 0 2024-04-12T13:42:11.659 INFO:tasks.workunit.client.1.smithi110.stdout:8/650: symlink d1/d3/d3c/d5a/d6f/d7e/lcc 0 2024-04-12T13:42:11.659 INFO:tasks.workunit.client.0.smithi060.stdout:7/583: write d0/d3d/d74/f7e [1661205,14318] 0 2024-04-12T13:42:11.659 INFO:tasks.workunit.client.1.smithi110.stdout:4/737: link d0/d19/d1c/fe4 d0/d75/d91/ff2 0 2024-04-12T13:42:11.661 INFO:tasks.workunit.client.1.smithi110.stdout:9/719: dwrite df/d13/d2c/d2d/dc1/d83/d63/db4/fb8 [0,4194304] 0 2024-04-12T13:42:11.664 INFO:tasks.workunit.client.0.smithi060.stdout:6/671: rmdir d1/d7/da/dc/d24/d2d/db0/db2 39 2024-04-12T13:42:11.664 INFO:tasks.workunit.client.0.smithi060.stdout:0/554: mknod d7/d9/de/d80/d8b/cc1 0 2024-04-12T13:42:11.665 INFO:tasks.workunit.client.0.smithi060.stdout:5/593: mknod d6/dd/d27/cc4 0 2024-04-12T13:42:11.666 INFO:tasks.workunit.client.0.smithi060.stdout:5/594: readlink d6/d10/d12/l7b 0 2024-04-12T13:42:11.667 INFO:tasks.workunit.client.0.smithi060.stdout:2/599: getdents d6/dae/d31/d33 0 2024-04-12T13:42:11.668 INFO:tasks.workunit.client.0.smithi060.stdout:6/672: write d1/d7/da/dc/d24/d30/d52/d78/d80/fb5 [3363438,66988] 0 2024-04-12T13:42:11.670 INFO:tasks.workunit.client.0.smithi060.stdout:4/605: rename d6/d7/db/d85/caa to d6/d7/db/dc8/cd1 0 2024-04-12T13:42:11.672 INFO:tasks.workunit.client.1.smithi110.stdout:5/605: fdatasync da/d2e/d45/d25/d9d/f3e 0 2024-04-12T13:42:11.676 INFO:tasks.workunit.client.1.smithi110.stdout:5/606: fsync da/d2e/d45/d29/f78 0 2024-04-12T13:42:11.676 INFO:tasks.workunit.client.1.smithi110.stdout:2/676: dwrite d6/dc/dd/dc6/fd1 [0,4194304] 0 2024-04-12T13:42:11.680 INFO:tasks.workunit.client.1.smithi110.stdout:3/620: creat d5/dc/d20/d2d/d4e/d89/d8c/db6/fc7 x:0 0 0 2024-04-12T13:42:11.682 INFO:tasks.workunit.client.1.smithi110.stdout:4/738: rmdir d0/d75/d84/d89 39 2024-04-12T13:42:11.685 INFO:tasks.workunit.client.1.smithi110.stdout:5/607: rename da/db/d15/fa7 to da/d2e/d45/d25/d9d/d79/d88/db0/fd2 0 2024-04-12T13:42:11.685 INFO:tasks.workunit.client.1.smithi110.stdout:9/720: symlink df/d13/df4/lf5 0 2024-04-12T13:42:11.688 INFO:tasks.workunit.client.1.smithi110.stdout:2/677: creat d6/dc/dd/d49/d64/d4a/dc1/dd0/fd2 x:0 0 0 2024-04-12T13:42:11.689 INFO:tasks.workunit.client.1.smithi110.stdout:1/611: truncate de/d14/d34/f7f 560621 0 2024-04-12T13:42:11.690 INFO:tasks.workunit.client.0.smithi060.stdout:1/711: sync 2024-04-12T13:42:11.692 INFO:tasks.workunit.client.1.smithi110.stdout:4/739: rmdir d0/d19/d1c/d50/d6f 39 2024-04-12T13:42:11.692 INFO:tasks.workunit.client.1.smithi110.stdout:6/634: write d7/d25/d30/d44/f2d [87749,5275] 0 2024-04-12T13:42:11.695 INFO:tasks.workunit.client.1.smithi110.stdout:1/612: readlink de/d15/d32/d61/d96/l9f 0 2024-04-12T13:42:11.695 INFO:tasks.workunit.client.1.smithi110.stdout:9/721: rename df/d13/d3b/c42 to df/d13/dc5/cf6 0 2024-04-12T13:42:11.699 INFO:tasks.workunit.client.1.smithi110.stdout:6/635: symlink d7/d10/d1c/d2b/d48/lce 0 2024-04-12T13:42:11.699 INFO:tasks.workunit.client.1.smithi110.stdout:1/613: chown de/d14/d83/l9d 457989 1 2024-04-12T13:42:11.700 INFO:tasks.workunit.client.1.smithi110.stdout:4/740: chown d0/de/d2c/d57/l6b 17 1 2024-04-12T13:42:11.705 INFO:tasks.workunit.client.0.smithi060.stdout:0/555: unlink d7/fd 0 2024-04-12T13:42:11.705 INFO:tasks.workunit.client.1.smithi110.stdout:5/608: truncate da/d4f/f91 3356551 0 2024-04-12T13:42:11.706 INFO:tasks.workunit.client.1.smithi110.stdout:0/561: dwrite d1/f2c [0,4194304] 0 2024-04-12T13:42:11.707 INFO:tasks.workunit.client.0.smithi060.stdout:2/600: truncate d6/d64/d99/f9e 800047 0 2024-04-12T13:42:11.708 INFO:tasks.workunit.client.0.smithi060.stdout:5/595: rename d6/dd/d27/f44 to d6/dd/d1f/d25/d42/d52/fc5 0 2024-04-12T13:42:11.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/712: chown d1e/d29/d6d/c93 33396800 1 2024-04-12T13:42:11.711 INFO:tasks.workunit.client.0.smithi060.stdout:1/713: chown d1e/d23/c2a 0 1 2024-04-12T13:42:11.711 INFO:tasks.workunit.client.1.smithi110.stdout:0/562: fsync d1/d27/d31/f64 0 2024-04-12T13:42:11.713 INFO:tasks.workunit.client.0.smithi060.stdout:4/606: dread d6/d21/d29/f73 [0,4194304] 0 2024-04-12T13:42:11.716 INFO:tasks.workunit.client.0.smithi060.stdout:4/607: dread - d6/d7/dd/d1a/d57/d63/fb5 zero size 2024-04-12T13:42:11.716 INFO:tasks.workunit.client.0.smithi060.stdout:2/601: dread - d6/dae/d31/d33/d3d/f7f zero size 2024-04-12T13:42:11.716 INFO:tasks.workunit.client.1.smithi110.stdout:5/609: stat da/d2e/d45/d25/d5d/c73 0 2024-04-12T13:42:11.717 INFO:tasks.workunit.client.0.smithi060.stdout:0/556: read d7/d9/f31 [901482,103772] 0 2024-04-12T13:42:11.719 INFO:tasks.workunit.client.1.smithi110.stdout:2/678: dwrite d6/dc/f33 [0,4194304] 0 2024-04-12T13:42:11.719 INFO:tasks.workunit.client.1.smithi110.stdout:8/651: dwrite d1/d3/d35/d3a/fac [0,4194304] 0 2024-04-12T13:42:11.720 INFO:tasks.workunit.client.1.smithi110.stdout:1/614: dread - de/d14/d34/d55/d6b/f82 zero size 2024-04-12T13:42:11.721 INFO:tasks.workunit.client.0.smithi060.stdout:6/673: rename d1/d7/da/dc/d24/f46 to d1/d7/da/dc/d24/d34/d51/d97/fe3 0 2024-04-12T13:42:11.725 INFO:tasks.workunit.client.1.smithi110.stdout:3/621: dwrite d5/dc/f82 [0,4194304] 0 2024-04-12T13:42:11.727 INFO:tasks.workunit.client.0.smithi060.stdout:2/602: fsync d6/f24 0 2024-04-12T13:42:11.727 INFO:tasks.workunit.client.1.smithi110.stdout:0/563: mknod d1/d27/d6e/cc7 0 2024-04-12T13:42:11.728 INFO:tasks.workunit.client.1.smithi110.stdout:8/652: write d1/d3/d35/d3a/d84/f92 [1253012,99544] 0 2024-04-12T13:42:11.729 INFO:tasks.workunit.client.1.smithi110.stdout:5/610: rmdir da/d2e/d45/d25 39 2024-04-12T13:42:11.729 INFO:tasks.workunit.client.0.smithi060.stdout:0/557: unlink d7/d9/d14/f24 0 2024-04-12T13:42:11.733 INFO:tasks.workunit.client.0.smithi060.stdout:6/674: creat d1/d7/da/dc/d24/d30/d52/d78/d80/fe4 x:0 0 0 2024-04-12T13:42:11.734 INFO:tasks.workunit.client.0.smithi060.stdout:0/558: rmdir d7/d33 39 2024-04-12T13:42:11.739 INFO:tasks.workunit.client.1.smithi110.stdout:8/653: dread d1/d3/d35/d3a/d41/d77/fb1 [0,4194304] 0 2024-04-12T13:42:11.741 INFO:tasks.workunit.client.0.smithi060.stdout:4/608: dwrite d6/d7/dd/d1a/d19/d42/d7c/fb9 [0,4194304] 0 2024-04-12T13:42:11.744 INFO:tasks.workunit.client.0.smithi060.stdout:5/596: getdents d6/dd/d1f/d25/d42/d52/d7a 0 2024-04-12T13:42:11.744 INFO:tasks.workunit.client.1.smithi110.stdout:3/622: creat d5/dc/d31/d3b/d32/d3e/d98/fc8 x:0 0 0 2024-04-12T13:42:11.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/714: rename d1e/d23/d2e/d8e/cc3 to d1e/d23/d2e/d5e/cf9 0 2024-04-12T13:42:11.755 INFO:tasks.workunit.client.0.smithi060.stdout:0/559: dwrite d7/d9/d14/d35/d44/d7d/f2a [0,4194304] 0 2024-04-12T13:42:11.759 INFO:tasks.workunit.client.1.smithi110.stdout:2/679: link d6/dc/dd/d49/d64/d4a/d3c/d50/fa4 d6/dc/fd3 0 2024-04-12T13:42:11.761 INFO:tasks.workunit.client.0.smithi060.stdout:1/715: link d1e/d23/d2e/f39 d1e/d23/d2e/d5e/df0/ffa 0 2024-04-12T13:42:11.762 INFO:tasks.workunit.client.1.smithi110.stdout:7/653: sync 2024-04-12T13:42:11.764 INFO:tasks.workunit.client.0.smithi060.stdout:0/560: symlink d7/d9/d14/d35/d44/d49/d67/da5/lc2 0 2024-04-12T13:42:11.766 INFO:tasks.workunit.client.1.smithi110.stdout:6/636: dread d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:42:11.767 INFO:tasks.workunit.client.1.smithi110.stdout:7/654: dread - d1/d31/d7b/fb1 zero size 2024-04-12T13:42:11.769 INFO:tasks.workunit.client.0.smithi060.stdout:5/597: read f2 [2443161,125353] 0 2024-04-12T13:42:11.772 INFO:tasks.workunit.client.0.smithi060.stdout:1/716: rename d1e/d23/d2e/d5e/d68/fca to d1e/d23/d2e/d30/d51/d85/ffb 0 2024-04-12T13:42:11.775 INFO:tasks.workunit.client.1.smithi110.stdout:8/654: write d1/d3/d35/d3a/fac [4977520,86699] 0 2024-04-12T13:42:11.775 INFO:tasks.workunit.client.1.smithi110.stdout:2/680: chown d6/dc/d9d/fb7 90027593 1 2024-04-12T13:42:11.777 INFO:tasks.workunit.client.0.smithi060.stdout:5/598: mkdir d6/dd/d1f/dc6 0 2024-04-12T13:42:11.778 INFO:tasks.workunit.client.1.smithi110.stdout:1/615: write de/d15/d32/d61/d6a/d72/f7d [625349,38250] 0 2024-04-12T13:42:11.782 INFO:tasks.workunit.client.0.smithi060.stdout:1/717: unlink d1e/d29/d65/f7f 0 2024-04-12T13:42:11.782 INFO:tasks.workunit.client.1.smithi110.stdout:9/722: dwrite df/d13/d2c/d2d/d39/d4f/fdd [0,4194304] 0 2024-04-12T13:42:11.783 INFO:tasks.workunit.client.1.smithi110.stdout:3/623: dwrite d5/fba [0,4194304] 0 2024-04-12T13:42:11.785 INFO:tasks.workunit.client.1.smithi110.stdout:4/741: dwrite d0/d75/d84/fc4 [0,4194304] 0 2024-04-12T13:42:11.788 INFO:tasks.workunit.client.0.smithi060.stdout:0/561: dwrite d7/d9/d14/d35/d3c/f42 [0,4194304] 0 2024-04-12T13:42:11.791 INFO:tasks.workunit.client.1.smithi110.stdout:7/655: mkdir d1/d3/d4/d55/d56/ddd 0 2024-04-12T13:42:11.791 INFO:tasks.workunit.client.1.smithi110.stdout:5/611: dread f5 [0,4194304] 0 2024-04-12T13:42:11.794 INFO:tasks.workunit.client.0.smithi060.stdout:4/609: dwrite d6/d7/dd/df/f93 [0,4194304] 0 2024-04-12T13:42:11.796 INFO:tasks.workunit.client.1.smithi110.stdout:7/656: write d1/d1b/fbe [780721,126590] 0 2024-04-12T13:42:11.797 INFO:tasks.workunit.client.1.smithi110.stdout:1/616: chown de/d14/f65 64563 1 2024-04-12T13:42:11.797 INFO:tasks.workunit.client.1.smithi110.stdout:8/655: symlink d1/d5/d1f/lcd 0 2024-04-12T13:42:11.798 INFO:tasks.workunit.client.0.smithi060.stdout:4/610: chown d6/db7/dbb 5 1 2024-04-12T13:42:11.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/718: creat d1e/d23/d2e/d5e/d68/d9a/de1/ffc x:0 0 0 2024-04-12T13:42:11.805 INFO:tasks.workunit.client.1.smithi110.stdout:0/564: dwrite d1/d3c/d6b/d90/f9a [0,4194304] 0 2024-04-12T13:42:11.810 INFO:tasks.workunit.client.1.smithi110.stdout:8/656: write d1/d5/dd/fa0 [204444,89354] 0 2024-04-12T13:42:11.811 INFO:tasks.workunit.client.1.smithi110.stdout:2/681: creat d6/dc/d13/d80/d8d/dcc/d82/d84/fd4 x:0 0 0 2024-04-12T13:42:11.811 INFO:tasks.workunit.client.1.smithi110.stdout:3/624: symlink d5/dc/d20/d2d/d4e/d89/lc9 0 2024-04-12T13:42:11.820 INFO:tasks.workunit.client.0.smithi060.stdout:5/599: getdents d6 0 2024-04-12T13:42:11.823 INFO:tasks.workunit.client.0.smithi060.stdout:4/611: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:42:11.823 INFO:tasks.workunit.client.0.smithi060.stdout:1/719: rename l1a to d1e/d23/d2e/d86/ddb/lfd 0 2024-04-12T13:42:11.825 INFO:tasks.workunit.client.1.smithi110.stdout:4/742: unlink d0/l39 0 2024-04-12T13:42:11.826 INFO:tasks.workunit.client.0.smithi060.stdout:5/600: mknod d6/cc7 0 2024-04-12T13:42:11.827 INFO:tasks.workunit.client.0.smithi060.stdout:4/612: read d6/d2f/fce [267124,92806] 0 2024-04-12T13:42:11.829 INFO:tasks.workunit.client.1.smithi110.stdout:0/565: mkdir d1/d8/d8a/dc8 0 2024-04-12T13:42:11.829 INFO:tasks.workunit.client.1.smithi110.stdout:1/617: dwrite de/d15/fc4 [0,4194304] 0 2024-04-12T13:42:11.829 INFO:tasks.workunit.client.0.smithi060.stdout:4/613: stat d6/d7/dd/d1a/d19/d42/fc9 0 2024-04-12T13:42:11.839 INFO:tasks.workunit.client.0.smithi060.stdout:1/720: dwrite fb [0,4194304] 0 2024-04-12T13:42:11.841 INFO:tasks.workunit.client.1.smithi110.stdout:8/657: rename d1/d7/d20/la9 to d1/d3/d35/d3a/d84/d9e/lce 0 2024-04-12T13:42:11.843 INFO:tasks.workunit.client.0.smithi060.stdout:1/721: rmdir d1e/d23/dd9 39 2024-04-12T13:42:11.850 INFO:tasks.workunit.client.1.smithi110.stdout:1/618: chown de/d15/fc4 16769178 1 2024-04-12T13:42:11.851 INFO:tasks.workunit.client.1.smithi110.stdout:6/637: dwrite d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:42:11.852 INFO:tasks.workunit.client.1.smithi110.stdout:9/723: dwrite df/d13/d2c/d2d/d39/f91 [0,4194304] 0 2024-04-12T13:42:11.857 INFO:tasks.workunit.client.1.smithi110.stdout:1/619: chown de/d14/d83/l85 284 1 2024-04-12T13:42:11.860 INFO:tasks.workunit.client.1.smithi110.stdout:1/620: write de/d15/d32/f71 [1424344,41438] 0 2024-04-12T13:42:11.866 INFO:tasks.workunit.client.0.smithi060.stdout:0/562: truncate d7/d9/d14/d35/d44/d49/d74/f95 2619822 0 2024-04-12T13:42:11.873 INFO:tasks.workunit.client.1.smithi110.stdout:7/657: truncate d1/d3/d4/d36/da1/f92 395395 0 2024-04-12T13:42:11.877 INFO:tasks.workunit.client.0.smithi060.stdout:5/601: mkdir d6/dd/d1f/d25/d42/d52/dc8 0 2024-04-12T13:42:11.878 INFO:tasks.workunit.client.1.smithi110.stdout:4/743: write d0/de/d32/d5f/f7c [3473365,45350] 0 2024-04-12T13:42:11.883 INFO:tasks.workunit.client.0.smithi060.stdout:1/722: dread d1e/d23/d49/d4e/f77 [0,4194304] 0 2024-04-12T13:42:11.884 INFO:tasks.workunit.client.0.smithi060.stdout:5/602: dread - d6/dd/d1f/d25/f90 zero size 2024-04-12T13:42:11.884 INFO:tasks.workunit.client.1.smithi110.stdout:0/566: rmdir d1 39 2024-04-12T13:42:11.885 INFO:tasks.workunit.client.0.smithi060.stdout:0/563: link d7/d9/d14/f25 d7/d9/d14/d35/d44/d8c/d8d/fc3 0 2024-04-12T13:42:11.886 INFO:tasks.workunit.client.0.smithi060.stdout:8/564: sync 2024-04-12T13:42:11.887 INFO:tasks.workunit.client.0.smithi060.stdout:3/654: sync 2024-04-12T13:42:11.888 INFO:tasks.workunit.client.1.smithi110.stdout:2/682: fsync d6/dc/d1b/d57/d62/db4/fcd 0 2024-04-12T13:42:11.889 INFO:tasks.workunit.client.0.smithi060.stdout:3/655: stat d7/d17/d19/dc9/d3f/d5c/d25/f7b 0 2024-04-12T13:42:11.892 INFO:tasks.workunit.client.1.smithi110.stdout:5/612: rename da/d4f to da/d2e/d45/d25/d9d/d79/d88/dd3 0 2024-04-12T13:42:11.899 INFO:tasks.workunit.client.0.smithi060.stdout:1/723: dwrite d1e/d94/fe9 [0,4194304] 0 2024-04-12T13:42:11.900 INFO:tasks.workunit.client.1.smithi110.stdout:3/625: truncate d5/dc/d20/d2d/f42 2228772 0 2024-04-12T13:42:11.903 INFO:tasks.workunit.client.0.smithi060.stdout:8/565: creat d9/d1b/d3c/d6e/d7b/fca x:0 0 0 2024-04-12T13:42:11.904 INFO:tasks.workunit.client.1.smithi110.stdout:6/638: rename d7/d25/d30/d9e to d7/d25/d30/dcf 0 2024-04-12T13:42:11.904 INFO:tasks.workunit.client.1.smithi110.stdout:2/683: dread d6/f8 [0,4194304] 0 2024-04-12T13:42:11.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/566: chown d9/d1d/d5e/f61 45 1 2024-04-12T13:42:11.908 INFO:tasks.workunit.client.0.smithi060.stdout:3/656: mknod d7/d17/d27/d36/d53/da2/cd8 0 2024-04-12T13:42:11.910 INFO:tasks.workunit.client.1.smithi110.stdout:1/621: symlink de/d15/d32/d61/d96/ld5 0 2024-04-12T13:42:11.911 INFO:tasks.workunit.client.0.smithi060.stdout:0/564: dwrite d7/fa3 [0,4194304] 0 2024-04-12T13:42:11.913 INFO:tasks.workunit.client.1.smithi110.stdout:1/622: write de/d15/d32/d61/d6a/d8b/fad [3704088,120449] 0 2024-04-12T13:42:11.915 INFO:tasks.workunit.client.1.smithi110.stdout:1/623: read - de/d15/fc1 zero size 2024-04-12T13:42:11.922 INFO:tasks.workunit.client.0.smithi060.stdout:8/567: unlink d9/d1b/d37/d4d/d63/d66/l83 0 2024-04-12T13:42:11.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/568: write d9/d1b/d37/d4d/d63/fa9 [79131,74929] 0 2024-04-12T13:42:11.926 INFO:tasks.workunit.client.1.smithi110.stdout:4/744: rename d0/d19/d26/d8a to d0/de/da0/dd9/df3 0 2024-04-12T13:42:11.929 INFO:tasks.workunit.client.0.smithi060.stdout:0/565: dwrite d7/d9/d14/d4a/fa1 [0,4194304] 0 2024-04-12T13:42:11.929 INFO:tasks.workunit.client.1.smithi110.stdout:5/613: creat da/db/d3b/d40/d97/fd4 x:0 0 0 2024-04-12T13:42:11.930 INFO:tasks.workunit.client.1.smithi110.stdout:4/745: write d0/de/d32/f7d [166810,57409] 0 2024-04-12T13:42:11.932 INFO:tasks.workunit.client.1.smithi110.stdout:8/658: symlink d1/d3/d3c/lcf 0 2024-04-12T13:42:11.933 INFO:tasks.workunit.client.1.smithi110.stdout:5/614: write da/db/d15/f1b [917159,44042] 0 2024-04-12T13:42:11.933 INFO:tasks.workunit.client.0.smithi060.stdout:3/657: mkdir d7/d17/d27/d36/db0/dd9 0 2024-04-12T13:42:11.938 INFO:tasks.workunit.client.1.smithi110.stdout:3/626: mkdir d5/d86/dca 0 2024-04-12T13:42:11.942 INFO:tasks.workunit.client.1.smithi110.stdout:2/684: rmdir d6/dc/dd/d49/d64/d4a/d3c/d6e 39 2024-04-12T13:42:11.943 INFO:tasks.workunit.client.1.smithi110.stdout:2/685: readlink d6/d18/da2/lb8 0 2024-04-12T13:42:11.947 INFO:tasks.workunit.client.1.smithi110.stdout:9/724: write df/f2e [5115193,75135] 0 2024-04-12T13:42:11.948 INFO:tasks.workunit.client.1.smithi110.stdout:0/567: creat d1/d48/fc9 x:0 0 0 2024-04-12T13:42:11.949 INFO:tasks.workunit.client.1.smithi110.stdout:9/725: chown df/d8a/f8e 7 1 2024-04-12T13:42:11.950 INFO:tasks.workunit.client.0.smithi060.stdout:3/658: dread d7/d17/d19/dc9/d3f/d5c/d25/f44 [0,4194304] 0 2024-04-12T13:42:11.950 INFO:tasks.workunit.client.0.smithi060.stdout:0/566: dwrite d7/d9/d14/d35/f6b [0,4194304] 0 2024-04-12T13:42:11.953 INFO:tasks.workunit.client.0.smithi060.stdout:3/659: stat d7/d17/d27/d36/d53/f8c 0 2024-04-12T13:42:11.959 INFO:tasks.workunit.client.1.smithi110.stdout:8/659: symlink d1/d3/d35/d3a/d84/d9e/ld0 0 2024-04-12T13:42:11.959 INFO:tasks.workunit.client.1.smithi110.stdout:5/615: dread da/db/f8d [0,4194304] 0 2024-04-12T13:42:11.962 INFO:tasks.workunit.client.0.smithi060.stdout:5/603: truncate d6/d10/f2b 403345 0 2024-04-12T13:42:11.963 INFO:tasks.workunit.client.1.smithi110.stdout:3/627: readlink d5/l7 0 2024-04-12T13:42:11.966 INFO:tasks.workunit.client.1.smithi110.stdout:2/686: mkdir d6/dc/dd/d49/d64/d4a/d3c/d50/dd5 0 2024-04-12T13:42:11.966 INFO:tasks.workunit.client.1.smithi110.stdout:9/726: dwrite df/d38/fdf [0,4194304] 0 2024-04-12T13:42:11.968 INFO:tasks.workunit.client.0.smithi060.stdout:8/569: rmdir d9/d1b/d37 39 2024-04-12T13:42:11.969 INFO:tasks.workunit.client.1.smithi110.stdout:9/727: write df/d13/d2c/d2d/dc1/d83/d63/db4/fbf [189037,13281] 0 2024-04-12T13:42:11.973 INFO:tasks.workunit.client.0.smithi060.stdout:1/724: truncate d1e/d1f/f22 4190703 0 2024-04-12T13:42:11.975 INFO:tasks.workunit.client.1.smithi110.stdout:7/658: write d1/d3/d4/d36/da1/f92 [658434,90341] 0 2024-04-12T13:42:11.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/660: link d7/d17/f42 d7/d17/d27/d36/d53/fda 0 2024-04-12T13:42:11.980 INFO:tasks.workunit.client.1.smithi110.stdout:7/659: read d1/d3/d4/da6/f8d [776236,29030] 0 2024-04-12T13:42:11.980 INFO:tasks.workunit.client.0.smithi060.stdout:3/661: fsync d7/d17/d19/d33/d63/d6d/fd3 0 2024-04-12T13:42:11.981 INFO:tasks.workunit.client.0.smithi060.stdout:5/604: dread d6/dd/d1f/d25/d53/d87/f4f [0,4194304] 0 2024-04-12T13:42:11.982 INFO:tasks.workunit.client.1.smithi110.stdout:7/660: read - d1/d31/d7b/fb1 zero size 2024-04-12T13:42:11.982 INFO:tasks.workunit.client.0.smithi060.stdout:1/725: mkdir d1e/d23/d2e/d30/d51/d85/dfe 0 2024-04-12T13:42:11.984 INFO:tasks.workunit.client.1.smithi110.stdout:7/661: write d1/d31/d5d/fb3 [618252,8162] 0 2024-04-12T13:42:11.984 INFO:tasks.workunit.client.0.smithi060.stdout:8/570: rename d9/c9f to d9/d1b/d3c/d6e/d7b/db1/ccb 0 2024-04-12T13:42:11.985 INFO:tasks.workunit.client.1.smithi110.stdout:1/624: write de/d1d/f97 [3350916,4294] 0 2024-04-12T13:42:11.986 INFO:tasks.workunit.client.1.smithi110.stdout:8/660: dread d1/d3/d35/d3a/d41/f53 [0,4194304] 0 2024-04-12T13:42:11.986 INFO:tasks.workunit.client.1.smithi110.stdout:1/625: fsync de/d14/d34/d55/f63 0 2024-04-12T13:42:11.988 INFO:tasks.workunit.client.0.smithi060.stdout:3/662: creat d7/d17/d19/dc9/d3f/d5c/fdb x:0 0 0 2024-04-12T13:42:11.989 INFO:tasks.workunit.client.1.smithi110.stdout:7/662: truncate d1/d3/d4/dbf/db6/fc8 438108 0 2024-04-12T13:42:11.989 INFO:tasks.workunit.client.1.smithi110.stdout:4/746: write d0/de/d32/f5d [818870,5730] 0 2024-04-12T13:42:11.991 INFO:tasks.workunit.client.0.smithi060.stdout:0/567: write d7/d9/f1c [2196567,111005] 0 2024-04-12T13:42:11.994 INFO:tasks.workunit.client.0.smithi060.stdout:1/726: write d1e/d23/d2e/d30/d51/d85/ffb [863578,114586] 0 2024-04-12T13:42:12.001 INFO:tasks.workunit.client.0.smithi060.stdout:8/571: write d9/d1b/d37/f6a [2037753,55132] 0 2024-04-12T13:42:12.002 INFO:tasks.workunit.client.1.smithi110.stdout:0/568: unlink d1/d8/ff 0 2024-04-12T13:42:12.003 INFO:tasks.workunit.client.0.smithi060.stdout:8/572: fsync d9/d1b/d84/da0/f24 0 2024-04-12T13:42:12.004 INFO:tasks.workunit.client.1.smithi110.stdout:0/569: chown d1/d27/d6e/l77 43 1 2024-04-12T13:42:12.004 INFO:tasks.workunit.client.1.smithi110.stdout:9/728: rename df/d13/c20 to df/d13/d2c/d2d/d94/cf7 0 2024-04-12T13:42:12.005 INFO:tasks.workunit.client.1.smithi110.stdout:1/626: dwrite de/d1d/fb7 [0,4194304] 0 2024-04-12T13:42:12.005 INFO:tasks.workunit.client.0.smithi060.stdout:8/573: chown d9/d1b/c3d 19 1 2024-04-12T13:42:12.005 INFO:tasks.workunit.client.0.smithi060.stdout:1/727: creat d1e/d23/d2e/d30/fff x:0 0 0 2024-04-12T13:42:12.006 INFO:tasks.workunit.client.0.smithi060.stdout:8/574: stat d9/d1d/d5e/f61 0 2024-04-12T13:42:12.008 INFO:tasks.workunit.client.0.smithi060.stdout:5/605: rename d6/dd/cf to d6/dd/d27/d7d/cc9 0 2024-04-12T13:42:12.011 INFO:tasks.workunit.client.1.smithi110.stdout:5/616: creat da/d2e/d45/d25/d9d/d79/d9e/fd5 x:0 0 0 2024-04-12T13:42:12.011 INFO:tasks.workunit.client.0.smithi060.stdout:5/606: write d6/dd/d1f/d25/d53/d87/f3a [1373081,61194] 0 2024-04-12T13:42:12.012 INFO:tasks.workunit.client.1.smithi110.stdout:6/639: write d7/d10/d1c/d2b/d48/f5e [787291,86507] 0 2024-04-12T13:42:12.020 INFO:tasks.workunit.client.1.smithi110.stdout:3/628: dwrite d5/dc/f12 [0,4194304] 0 2024-04-12T13:42:12.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/607: mkdir d6/dd/d1f/d25/d53/d87/d7e/dca 0 2024-04-12T13:42:12.023 INFO:tasks.workunit.client.0.smithi060.stdout:5/608: chown d6/dd/d1f/d25/d42/d52/d7a 0 1 2024-04-12T13:42:12.023 INFO:tasks.workunit.client.1.smithi110.stdout:2/687: dwrite d6/f12 [0,4194304] 0 2024-04-12T13:42:12.024 INFO:tasks.workunit.client.0.smithi060.stdout:0/568: truncate d7/d9/f2b 600150 0 2024-04-12T13:42:12.025 INFO:tasks.workunit.client.1.smithi110.stdout:3/629: dread d5/d86/f93 [0,4194304] 0 2024-04-12T13:42:12.030 INFO:tasks.workunit.client.1.smithi110.stdout:7/663: rename d1/d3/d4/d36/d76/l90 to d1/d1b/d74/db4/lde 0 2024-04-12T13:42:12.030 INFO:tasks.workunit.client.1.smithi110.stdout:0/570: mknod d1/d3c/cca 0 2024-04-12T13:42:12.030 INFO:tasks.workunit.client.1.smithi110.stdout:7/664: chown d1/d3/d4/d55 75965 1 2024-04-12T13:42:12.031 INFO:tasks.workunit.client.1.smithi110.stdout:9/729: creat df/d13/d2c/d2d/d94/ff8 x:0 0 0 2024-04-12T13:42:12.032 INFO:tasks.workunit.client.1.smithi110.stdout:8/661: mkdir d1/d3/dbe/dd1 0 2024-04-12T13:42:12.034 INFO:tasks.workunit.client.1.smithi110.stdout:2/688: symlink d6/dc/d1b/d8f/ld6 0 2024-04-12T13:42:12.035 INFO:tasks.workunit.client.1.smithi110.stdout:7/665: stat d1/d1b/d3d/d68/f8e 0 2024-04-12T13:42:12.036 INFO:tasks.workunit.client.0.smithi060.stdout:0/569: rmdir d7/d9/d14/d35/d44 39 2024-04-12T13:42:12.036 INFO:tasks.workunit.client.1.smithi110.stdout:6/640: write d7/d25/d30/d44/f21 [883787,67171] 0 2024-04-12T13:42:12.036 INFO:tasks.workunit.client.1.smithi110.stdout:3/630: creat d5/d86/fcb x:0 0 0 2024-04-12T13:42:12.037 INFO:tasks.workunit.client.1.smithi110.stdout:9/730: chown df/d13/d3b/d40/d56/fdc 114433827 1 2024-04-12T13:42:12.038 INFO:tasks.workunit.client.1.smithi110.stdout:1/627: rename de/d14/d34/d55/f9a to de/d14/d34/d55/d6b/dc7/fd6 0 2024-04-12T13:42:12.039 INFO:tasks.workunit.client.0.smithi060.stdout:3/663: rename d7/d17/d19/dc9/d3f/d5c/d25/d4d/cbf to d7/d17/d19/dc9/cdc 0 2024-04-12T13:42:12.041 INFO:tasks.workunit.client.0.smithi060.stdout:8/575: link d9/d1d/l72 d9/d1b/d37/d4d/lcc 0 2024-04-12T13:42:12.042 INFO:tasks.workunit.client.1.smithi110.stdout:8/662: dread d1/d3/d35/d3a/d41/fb0 [0,4194304] 0 2024-04-12T13:42:12.042 INFO:tasks.workunit.client.1.smithi110.stdout:7/666: chown d1/d3/d4/d55/d56/d72/dad 4082 1 2024-04-12T13:42:12.044 INFO:tasks.workunit.client.0.smithi060.stdout:0/570: rmdir d7/d9/d14/d35/d3c 39 2024-04-12T13:42:12.046 INFO:tasks.workunit.client.0.smithi060.stdout:0/571: write d7/d9/d14/faa [31080,62102] 0 2024-04-12T13:42:12.048 INFO:tasks.workunit.client.0.smithi060.stdout:3/664: mknod d7/d17/d19/d33/d63/d6d/cdd 0 2024-04-12T13:42:12.050 INFO:tasks.workunit.client.0.smithi060.stdout:8/576: symlink d9/d1d/d2f/lcd 0 2024-04-12T13:42:12.051 INFO:tasks.workunit.client.1.smithi110.stdout:6/641: fsync d7/d10/f62 0 2024-04-12T13:42:12.052 INFO:tasks.workunit.client.1.smithi110.stdout:0/571: dread d1/d8/d36/d51/d60/f2b [0,4194304] 0 2024-04-12T13:42:12.052 INFO:tasks.workunit.client.1.smithi110.stdout:6/642: fdatasync d7/f19 0 2024-04-12T13:42:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:0/572: stat d7/d9/d14/d35/d44/d7d/f2a 0 2024-04-12T13:42:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:7/584: sync 2024-04-12T13:42:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:9/530: sync 2024-04-12T13:42:12.055 INFO:tasks.workunit.client.0.smithi060.stdout:9/531: write d4/d9/d19/d21/f66 [2194337,84706] 0 2024-04-12T13:42:12.058 INFO:tasks.workunit.client.1.smithi110.stdout:3/631: dwrite d5/dc/d20/d2d/d4f/f7b [0,4194304] 0 2024-04-12T13:42:12.060 INFO:tasks.workunit.client.1.smithi110.stdout:5/617: dread da/d2e/d45/d25/f5a [0,4194304] 0 2024-04-12T13:42:12.061 INFO:tasks.workunit.client.0.smithi060.stdout:0/573: symlink d7/d41/dbc/lc4 0 2024-04-12T13:42:12.063 INFO:tasks.workunit.client.1.smithi110.stdout:3/632: dread - d5/d86/fcb zero size 2024-04-12T13:42:12.064 INFO:tasks.workunit.client.0.smithi060.stdout:1/728: write d1e/d23/d2e/d30/d51/f81 [6276493,46372] 0 2024-04-12T13:42:12.066 INFO:tasks.workunit.client.1.smithi110.stdout:1/628: symlink de/ld7 0 2024-04-12T13:42:12.067 INFO:tasks.workunit.client.1.smithi110.stdout:4/747: write d0/d19/d1c/d50/d6f/db9/f8e [615707,53589] 0 2024-04-12T13:42:12.073 INFO:tasks.workunit.client.1.smithi110.stdout:0/572: mkdir d1/d27/d31/d67/dcb 0 2024-04-12T13:42:12.074 INFO:tasks.workunit.client.1.smithi110.stdout:4/748: dread d0/de/f4c [0,4194304] 0 2024-04-12T13:42:12.077 INFO:tasks.workunit.client.1.smithi110.stdout:9/731: symlink df/d38/d6e/lf9 0 2024-04-12T13:42:12.081 INFO:tasks.workunit.client.0.smithi060.stdout:3/665: dwrite d7/d17/d19/dc9/f3e [0,4194304] 0 2024-04-12T13:42:12.082 INFO:tasks.workunit.client.1.smithi110.stdout:8/663: creat d1/d3/d3c/d5a/dab/fd2 x:0 0 0 2024-04-12T13:42:12.083 INFO:tasks.workunit.client.0.smithi060.stdout:5/609: dwrite d6/dd/f45 [0,4194304] 0 2024-04-12T13:42:12.086 INFO:tasks.workunit.client.0.smithi060.stdout:3/666: write d7/d17/d19/dc9/d3f/d5c/fdb [617100,87580] 0 2024-04-12T13:42:12.087 INFO:tasks.workunit.client.1.smithi110.stdout:2/689: dwrite d6/dc/dd/d49/d64/d5d/f71 [0,4194304] 0 2024-04-12T13:42:12.088 INFO:tasks.workunit.client.0.smithi060.stdout:7/585: truncate d0/d1b/f27 1336339 0 2024-04-12T13:42:12.091 INFO:tasks.workunit.client.0.smithi060.stdout:8/577: dwrite f1 [0,4194304] 0 2024-04-12T13:42:12.092 INFO:tasks.workunit.client.1.smithi110.stdout:2/690: read d6/dc/d6f/f96 [3731625,114707] 0 2024-04-12T13:42:12.093 INFO:tasks.workunit.client.0.smithi060.stdout:3/667: write d7/d17/d19/d33/d63/d6d/dab/fd5 [736149,22055] 0 2024-04-12T13:42:12.094 INFO:tasks.workunit.client.1.smithi110.stdout:3/633: creat d5/dc/d31/d3b/d32/fcc x:0 0 0 2024-04-12T13:42:12.095 INFO:tasks.workunit.client.0.smithi060.stdout:3/668: stat d7/d17/d19/d33/f6c 0 2024-04-12T13:42:12.095 INFO:tasks.workunit.client.1.smithi110.stdout:2/691: write d6/dc/db1/fb5 [752632,58439] 0 2024-04-12T13:42:12.097 INFO:tasks.workunit.client.0.smithi060.stdout:1/729: write d1e/d23/d2e/d5e/df0/ffa [2495781,4070] 0 2024-04-12T13:42:12.098 INFO:tasks.workunit.client.1.smithi110.stdout:1/629: mkdir de/d15/dab/dd8 0 2024-04-12T13:42:12.100 INFO:tasks.workunit.client.1.smithi110.stdout:2/692: write d6/dc/dd/d49/d64/d5d/db9/fbe [950462,103490] 0 2024-04-12T13:42:12.103 INFO:tasks.workunit.client.1.smithi110.stdout:2/693: read - d6/dc/fd3 zero size 2024-04-12T13:42:12.107 INFO:tasks.workunit.client.1.smithi110.stdout:4/749: readlink d0/de/d2c/l82 0 2024-04-12T13:42:12.114 INFO:tasks.workunit.client.1.smithi110.stdout:3/634: write d5/dc/f85 [4603381,16032] 0 2024-04-12T13:42:12.119 INFO:tasks.workunit.client.1.smithi110.stdout:7/667: getdents d1/d3 0 2024-04-12T13:42:12.119 INFO:tasks.workunit.client.1.smithi110.stdout:1/630: mkdir de/d15/dab/dd8/dd9 0 2024-04-12T13:42:12.120 INFO:tasks.workunit.client.1.smithi110.stdout:5/618: dwrite da/d2e/d45/f1f [0,4194304] 0 2024-04-12T13:42:12.126 INFO:tasks.workunit.client.1.smithi110.stdout:4/750: unlink d0/de/da0/dd9/df3/de0/d7e/lb1 0 2024-04-12T13:42:12.128 INFO:tasks.workunit.client.1.smithi110.stdout:9/732: link df/d13/d2c/d2d/d94/ff8 df/d13/d2c/d2d/dc1/ffa 0 2024-04-12T13:42:12.131 INFO:tasks.workunit.client.1.smithi110.stdout:5/619: mkdir da/d35/dd6 0 2024-04-12T13:42:12.132 INFO:tasks.workunit.client.1.smithi110.stdout:7/668: unlink d1/d3/d4/d55/d56/ccd 0 2024-04-12T13:42:12.134 INFO:tasks.workunit.client.1.smithi110.stdout:1/631: rename de/d15/d32/d61/d6a/d72 to de/d15/dab/dd8/dd9/dda 0 2024-04-12T13:42:12.136 INFO:tasks.workunit.client.1.smithi110.stdout:2/694: rename d6/d18/l31 to d6/d18/ld7 0 2024-04-12T13:42:12.137 INFO:tasks.workunit.client.1.smithi110.stdout:7/669: chown d1/d1b/d3d/f63 209 1 2024-04-12T13:42:12.143 INFO:tasks.workunit.client.1.smithi110.stdout:1/632: symlink de/d15/d32/d61/d96/ldb 0 2024-04-12T13:42:12.147 INFO:tasks.workunit.client.1.smithi110.stdout:6/643: dwrite d7/d10/d1c/d2b/d48/d4b/f94 [0,4194304] 0 2024-04-12T13:42:12.148 INFO:tasks.workunit.client.1.smithi110.stdout:7/670: write d1/d3/d4/dbf/db6/fc8 [455613,27052] 0 2024-04-12T13:42:12.148 INFO:tasks.workunit.client.1.smithi110.stdout:1/633: dread - de/d15/dab/dd8/dd9/dda/fbe zero size 2024-04-12T13:42:12.153 INFO:tasks.workunit.client.1.smithi110.stdout:0/573: dwrite d1/d48/f5b [0,4194304] 0 2024-04-12T13:42:12.159 INFO:tasks.workunit.client.1.smithi110.stdout:5/620: creat da/d2e/d45/d25/d9d/fd7 x:0 0 0 2024-04-12T13:42:12.165 INFO:tasks.workunit.client.1.smithi110.stdout:6/644: mkdir d7/d10/d7e/d85/dd0 0 2024-04-12T13:42:12.168 INFO:tasks.workunit.client.0.smithi060.stdout:3/669: dread d7/f8 [8388608,4194304] 0 2024-04-12T13:42:12.168 INFO:tasks.workunit.client.0.smithi060.stdout:7/586: creat d0/d7/d88/db1/fc1 x:0 0 0 2024-04-12T13:42:12.173 INFO:tasks.workunit.client.1.smithi110.stdout:5/621: unlink da/db/c38 0 2024-04-12T13:42:12.174 INFO:tasks.workunit.client.1.smithi110.stdout:2/695: getdents d6/dc/d13/d80/d8d/dcc 0 2024-04-12T13:42:12.177 INFO:tasks.workunit.client.1.smithi110.stdout:1/634: mkdir de/d14/d34/d55/ddc 0 2024-04-12T13:42:12.178 INFO:tasks.workunit.client.1.smithi110.stdout:6/645: truncate d7/d25/d30/d44/d3d/f49 4146511 0 2024-04-12T13:42:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:11 smithi060 ceph-mon[29097]: pgmap v30: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 183 MiB/s wr, 362 op/s 2024-04-12T13:42:12.181 INFO:tasks.workunit.client.1.smithi110.stdout:0/574: getdents d1/d8/d8a/dc8 0 2024-04-12T13:42:12.183 INFO:tasks.workunit.client.1.smithi110.stdout:5/622: creat da/d2e/d45/d25/d9d/d79/d88/dd3/fd8 x:0 0 0 2024-04-12T13:42:12.184 INFO:tasks.workunit.client.1.smithi110.stdout:4/751: truncate d0/de/d32/f5d 171644 0 2024-04-12T13:42:12.184 INFO:tasks.workunit.client.1.smithi110.stdout:9/733: dwrite df/d13/f87 [0,4194304] 0 2024-04-12T13:42:12.185 INFO:tasks.workunit.client.1.smithi110.stdout:1/635: creat de/d14/d34/d55/d6b/dc7/fdd x:0 0 0 2024-04-12T13:42:12.186 INFO:tasks.workunit.client.1.smithi110.stdout:6/646: symlink d7/d25/d30/dcf/ld1 0 2024-04-12T13:42:12.186 INFO:tasks.workunit.client.1.smithi110.stdout:4/752: readlink d0/d78/l80 0 2024-04-12T13:42:12.187 INFO:tasks.workunit.client.1.smithi110.stdout:1/636: chown de/d1d/d86/fa6 721529 1 2024-04-12T13:42:12.187 INFO:tasks.workunit.client.0.smithi060.stdout:8/578: write d9/d1b/d2b/f40 [3215226,26999] 0 2024-04-12T13:42:12.188 INFO:tasks.workunit.client.0.smithi060.stdout:1/730: write d1e/d29/d37/f4c [2495271,30180] 0 2024-04-12T13:42:12.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/675: sync 2024-04-12T13:42:12.188 INFO:tasks.workunit.client.0.smithi060.stdout:2/603: sync 2024-04-12T13:42:12.188 INFO:tasks.workunit.client.0.smithi060.stdout:4/614: sync 2024-04-12T13:42:12.189 INFO:tasks.workunit.client.1.smithi110.stdout:2/696: getdents d6/dc/dd/d49/d64/d25/db0 0 2024-04-12T13:42:12.191 INFO:tasks.workunit.client.0.smithi060.stdout:7/587: write d0/d1b/f72 [924907,50413] 0 2024-04-12T13:42:12.193 INFO:tasks.workunit.client.0.smithi060.stdout:6/676: chown d1/d7d/ce0 1471149 1 2024-04-12T13:42:12.193 INFO:tasks.workunit.client.0.smithi060.stdout:4/615: stat d6/d7/db/f22 0 2024-04-12T13:42:12.197 INFO:tasks.workunit.client.1.smithi110.stdout:9/734: rmdir df/d8a 39 2024-04-12T13:42:12.198 INFO:tasks.workunit.client.1.smithi110.stdout:1/637: creat de/d7b/fde x:0 0 0 2024-04-12T13:42:12.200 INFO:tasks.workunit.client.1.smithi110.stdout:1/638: write de/d7b/fde [219306,16165] 0 2024-04-12T13:42:12.202 INFO:tasks.workunit.client.1.smithi110.stdout:5/623: dwrite da/db/f4a [0,4194304] 0 2024-04-12T13:42:12.203 INFO:tasks.workunit.client.0.smithi060.stdout:4/616: chown d6/d7/dd/df/c24 1930649 1 2024-04-12T13:42:12.204 INFO:tasks.workunit.client.0.smithi060.stdout:5/610: dwrite d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:42:12.209 INFO:tasks.workunit.client.0.smithi060.stdout:3/670: dwrite d7/f47 [0,4194304] 0 2024-04-12T13:42:12.209 INFO:tasks.workunit.client.1.smithi110.stdout:7/671: write d1/d3/d4/dbf/db6/fb7 [1457044,71188] 0 2024-04-12T13:42:12.214 INFO:tasks.workunit.client.0.smithi060.stdout:2/604: dread d6/f1b [0,4194304] 0 2024-04-12T13:42:12.218 INFO:tasks.workunit.client.1.smithi110.stdout:0/575: link d1/d27/d6e/l77 d1/d3c/lcc 0 2024-04-12T13:42:12.219 INFO:tasks.workunit.client.0.smithi060.stdout:8/579: rename d9/d1b/d84/da1 to d9/d1b/d2b/d82/d8a/dce 0 2024-04-12T13:42:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:11 smithi110 ceph-mon[36055]: pgmap v30: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 183 MiB/s wr, 362 op/s 2024-04-12T13:42:12.229 INFO:tasks.workunit.client.1.smithi110.stdout:2/697: truncate d6/dc/f14 3295259 0 2024-04-12T13:42:12.230 INFO:tasks.workunit.client.1.smithi110.stdout:9/735: fdatasync df/d13/d26/f32 0 2024-04-12T13:42:12.236 INFO:tasks.workunit.client.0.smithi060.stdout:3/671: creat d7/d17/d27/d36/d53/da2/dbc/fde x:0 0 0 2024-04-12T13:42:12.238 INFO:tasks.workunit.client.1.smithi110.stdout:5/624: rename da/db/d15/f59 to da/db/d3b/d40/d97/db6/fd9 0 2024-04-12T13:42:12.239 INFO:tasks.workunit.client.0.smithi060.stdout:1/731: dread d1e/d1f/f4a [0,4194304] 0 2024-04-12T13:42:12.239 INFO:tasks.workunit.client.0.smithi060.stdout:3/672: fdatasync d7/d17/d27/d36/d53/da2/fca 0 2024-04-12T13:42:12.240 INFO:tasks.workunit.client.0.smithi060.stdout:2/605: mknod d6/d56/d58/da0/cb6 0 2024-04-12T13:42:12.241 INFO:tasks.workunit.client.0.smithi060.stdout:1/732: chown d1e/d23/d49/lb7 51204 1 2024-04-12T13:42:12.242 INFO:tasks.workunit.client.1.smithi110.stdout:4/753: creat d0/ff4 x:0 0 0 2024-04-12T13:42:12.244 INFO:tasks.workunit.client.0.smithi060.stdout:8/580: unlink d9/d1b/d37/d4d/d63/d66/db3/d65/lc1 0 2024-04-12T13:42:12.246 INFO:tasks.workunit.client.1.smithi110.stdout:6/647: creat d7/fd2 x:0 0 0 2024-04-12T13:42:12.248 INFO:tasks.workunit.client.0.smithi060.stdout:4/617: mkdir d6/d7/dd/dd2 0 2024-04-12T13:42:12.248 INFO:tasks.workunit.client.1.smithi110.stdout:6/648: write d7/d10/d1c/d2b/f71 [2718424,10084] 0 2024-04-12T13:42:12.249 INFO:tasks.workunit.client.0.smithi060.stdout:8/581: chown d9/d1b/d37/d4d/d63/d66/db3/d65/l7c 1 1 2024-04-12T13:42:12.251 INFO:tasks.workunit.client.1.smithi110.stdout:7/672: unlink d1/d3/l8 0 2024-04-12T13:42:12.252 INFO:tasks.workunit.client.0.smithi060.stdout:4/618: chown d6/d7/dd/d1a/d19/d42/fc9 56169 1 2024-04-12T13:42:12.252 INFO:tasks.workunit.client.0.smithi060.stdout:6/677: dwrite d1/d7/da/dc/d24/d30/d52/f81 [0,4194304] 0 2024-04-12T13:42:12.252 INFO:tasks.workunit.client.0.smithi060.stdout:5/611: symlink d6/d89/lcb 0 2024-04-12T13:42:12.254 INFO:tasks.workunit.client.1.smithi110.stdout:0/576: rmdir d1/d27/d6e 39 2024-04-12T13:42:12.256 INFO:tasks.workunit.client.0.smithi060.stdout:4/619: fdatasync d6/d7/dd/d1a/d19/d7a/da8/fba 0 2024-04-12T13:42:12.257 INFO:tasks.workunit.client.0.smithi060.stdout:3/673: truncate d7/d17/d19/dc9/d3f/d5c/f54 1519262 0 2024-04-12T13:42:12.259 INFO:tasks.workunit.client.0.smithi060.stdout:4/620: readlink d6/d7/dd/d1a/l39 0 2024-04-12T13:42:12.266 INFO:tasks.workunit.client.0.smithi060.stdout:5/612: creat d6/dd/d1f/d25/d53/d87/da6/fcc x:0 0 0 2024-04-12T13:42:12.268 INFO:tasks.workunit.client.1.smithi110.stdout:1/639: link de/d1d/d86/fa8 de/d15/d32/d61/d6a/dac/fdf 0 2024-04-12T13:42:12.271 INFO:tasks.workunit.client.0.smithi060.stdout:5/613: truncate d6/dd/d1f/d25/d53/d87/da6/fcc 1009240 0 2024-04-12T13:42:12.272 INFO:tasks.workunit.client.0.smithi060.stdout:5/614: stat d6/d10/d12/fa5 0 2024-04-12T13:42:12.276 INFO:tasks.workunit.client.0.smithi060.stdout:6/678: read d1/d7/da/dc/d24/d34/d51/d97/da9/fb7 [2774032,117976] 0 2024-04-12T13:42:12.278 INFO:tasks.workunit.client.0.smithi060.stdout:6/679: chown d1/d7/da/dc/fcf 0 1 2024-04-12T13:42:12.283 INFO:tasks.workunit.client.1.smithi110.stdout:6/649: readlink d7/d10/l23 0 2024-04-12T13:42:12.287 INFO:tasks.workunit.client.0.smithi060.stdout:3/674: getdents d7/d17/d27/d36/db0/dd9 0 2024-04-12T13:42:12.289 INFO:tasks.workunit.client.0.smithi060.stdout:2/606: dwrite d6/d56/d43/f65 [0,4194304] 0 2024-04-12T13:42:12.289 INFO:tasks.workunit.client.1.smithi110.stdout:9/736: dwrite df/d13/d2c/d9e/dd6/fa8 [0,4194304] 0 2024-04-12T13:42:12.292 INFO:tasks.workunit.client.0.smithi060.stdout:4/621: mkdir d6/dd3 0 2024-04-12T13:42:12.292 INFO:tasks.workunit.client.1.smithi110.stdout:2/698: mkdir d6/dc/d1b/d57/d62/dcb/dd8 0 2024-04-12T13:42:12.292 INFO:tasks.workunit.client.1.smithi110.stdout:9/737: write df/d13/d2c/d2d/dc1/d83/d63/fd9 [720117,61131] 0 2024-04-12T13:42:12.297 INFO:tasks.workunit.client.0.smithi060.stdout:2/607: read d6/f9 [3700938,103129] 0 2024-04-12T13:42:12.300 INFO:tasks.workunit.client.0.smithi060.stdout:1/733: write d1e/d23/d2e/d30/d51/d85/fd2 [856185,67260] 0 2024-04-12T13:42:12.307 INFO:tasks.workunit.client.1.smithi110.stdout:6/650: dwrite d7/d10/d1c/d2b/f38 [4194304,4194304] 0 2024-04-12T13:42:12.311 INFO:tasks.workunit.client.0.smithi060.stdout:2/608: creat d6/d10/d2b/fb7 x:0 0 0 2024-04-12T13:42:12.315 INFO:tasks.workunit.client.1.smithi110.stdout:0/577: creat d1/d3c/da6/fcd x:0 0 0 2024-04-12T13:42:12.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/625: truncate da/d2e/d45/d29/d66/fb2 4438982 0 2024-04-12T13:42:12.315 INFO:tasks.workunit.client.1.smithi110.stdout:1/640: write de/d14/d34/f75 [3262952,130810] 0 2024-04-12T13:42:12.316 INFO:tasks.workunit.client.0.smithi060.stdout:9/532: sync 2024-04-12T13:42:12.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/574: sync 2024-04-12T13:42:12.318 INFO:tasks.workunit.client.1.smithi110.stdout:7/673: mknod d1/d3/d4/d36/da1/cdf 0 2024-04-12T13:42:12.320 INFO:tasks.workunit.client.1.smithi110.stdout:5/626: write da/d2e/d45/d29/f50 [4467704,57723] 0 2024-04-12T13:42:12.321 INFO:tasks.workunit.client.1.smithi110.stdout:7/674: read d1/d1b/d3d/f63 [400397,115217] 0 2024-04-12T13:42:12.323 INFO:tasks.workunit.client.1.smithi110.stdout:5/627: dread - da/db/d3b/d40/d97/fd4 zero size 2024-04-12T13:42:12.323 INFO:tasks.workunit.client.1.smithi110.stdout:9/738: link df/d38/f88 df/d13/d2c/d2d/dd3/ffb 0 2024-04-12T13:42:12.323 INFO:tasks.workunit.client.0.smithi060.stdout:9/533: stat d4/d9/d19/d21/d73/fae 0 2024-04-12T13:42:12.327 INFO:tasks.workunit.client.1.smithi110.stdout:0/578: mkdir d1/d8/d8a/dce 0 2024-04-12T13:42:12.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/675: dwrite d7/d17/d27/d36/d53/f71 [0,4194304] 0 2024-04-12T13:42:12.330 INFO:tasks.workunit.client.1.smithi110.stdout:2/699: link d6/dc/dd/d49/d64/ccf d6/dc/db1/cd9 0 2024-04-12T13:42:12.331 INFO:tasks.workunit.client.0.smithi060.stdout:0/575: write d7/d9/f1a [2984348,11775] 0 2024-04-12T13:42:12.336 INFO:tasks.workunit.client.0.smithi060.stdout:6/680: dwrite d1/d7/da/dc/d24/d30/d52/d5e/f68 [0,4194304] 0 2024-04-12T13:42:12.338 INFO:tasks.workunit.client.1.smithi110.stdout:1/641: dwrite de/d15/dab/dd8/dd9/dda/fbe [0,4194304] 0 2024-04-12T13:42:12.341 INFO:tasks.workunit.client.0.smithi060.stdout:5/615: dwrite d6/d10/f2a [0,4194304] 0 2024-04-12T13:42:12.342 INFO:tasks.workunit.client.0.smithi060.stdout:2/609: truncate d6/dae/d31/d33/d3d/f63 571901 0 2024-04-12T13:42:12.343 INFO:tasks.workunit.client.1.smithi110.stdout:1/642: write de/d7b/fde [648807,98143] 0 2024-04-12T13:42:12.343 INFO:tasks.workunit.client.1.smithi110.stdout:3/635: sync 2024-04-12T13:42:12.343 INFO:tasks.workunit.client.1.smithi110.stdout:8/664: sync 2024-04-12T13:42:12.345 INFO:tasks.workunit.client.1.smithi110.stdout:3/636: chown d5/dc/d20 31 1 2024-04-12T13:42:12.347 INFO:tasks.workunit.client.1.smithi110.stdout:5/628: unlink da/d2e/d45/d29/d58/c96 0 2024-04-12T13:42:12.348 INFO:tasks.workunit.client.1.smithi110.stdout:1/643: dread - de/d14/d34/fc3 zero size 2024-04-12T13:42:12.348 INFO:tasks.workunit.client.0.smithi060.stdout:1/734: dread d1e/d29/d65/f7a [0,4194304] 0 2024-04-12T13:42:12.351 INFO:tasks.workunit.client.1.smithi110.stdout:2/700: rmdir d6/dc/dd/d49 39 2024-04-12T13:42:12.354 INFO:tasks.workunit.client.1.smithi110.stdout:1/644: read - de/d15/dab/dd8/dd9/dda/fb9 zero size 2024-04-12T13:42:12.360 INFO:tasks.workunit.client.1.smithi110.stdout:7/675: dread d1/d31/f96 [4194304,4194304] 0 2024-04-12T13:42:12.360 INFO:tasks.workunit.client.1.smithi110.stdout:2/701: chown d6/dc/d13/d80/d8d/dcc/f68 1801 1 2024-04-12T13:42:12.363 INFO:tasks.workunit.client.1.smithi110.stdout:9/739: write df/d13/d26/f45 [1664172,52962] 0 2024-04-12T13:42:12.366 INFO:tasks.workunit.client.0.smithi060.stdout:3/676: dwrite d7/d17/d27/fa5 [0,4194304] 0 2024-04-12T13:42:12.366 INFO:tasks.workunit.client.0.smithi060.stdout:4/622: dwrite d6/d7/f8c [0,4194304] 0 2024-04-12T13:42:12.372 INFO:tasks.workunit.client.1.smithi110.stdout:8/665: creat d1/d3/d35/d3a/d41/d77/fd3 x:0 0 0 2024-04-12T13:42:12.372 INFO:tasks.workunit.client.0.smithi060.stdout:5/616: fdatasync d6/d10/f2a 0 2024-04-12T13:42:12.373 INFO:tasks.workunit.client.1.smithi110.stdout:3/637: truncate d5/dc/d31/d3b/d32/f37 1863372 0 2024-04-12T13:42:12.376 INFO:tasks.workunit.client.0.smithi060.stdout:1/735: creat d1e/d29/d37/f100 x:0 0 0 2024-04-12T13:42:12.377 INFO:tasks.workunit.client.1.smithi110.stdout:5/629: write da/db/d3b/d40/f47 [179188,24095] 0 2024-04-12T13:42:12.382 INFO:tasks.workunit.client.1.smithi110.stdout:0/579: truncate d1/d3c/d6b/d90/f9a 3399239 0 2024-04-12T13:42:12.384 INFO:tasks.workunit.client.1.smithi110.stdout:9/740: dwrite df/d13/d26/d37/fae [4194304,4194304] 0 2024-04-12T13:42:12.391 INFO:tasks.workunit.client.1.smithi110.stdout:8/666: creat d1/d3/d35/d3a/d3e/d64/d85/fd4 x:0 0 0 2024-04-12T13:42:12.393 INFO:tasks.workunit.client.1.smithi110.stdout:3/638: dwrite d5/dc/d31/d3b/d32/f56 [0,4194304] 0 2024-04-12T13:42:12.393 INFO:tasks.workunit.client.1.smithi110.stdout:5/630: truncate da/f6b 1995886 0 2024-04-12T13:42:12.396 INFO:tasks.workunit.client.0.smithi060.stdout:2/610: link d6/d10/d2b/cb4 d6/d64/cb8 0 2024-04-12T13:42:12.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/617: dwrite d6/dd/d1f/d25/d53/d87/da6/fcc [0,4194304] 0 2024-04-12T13:42:12.399 INFO:tasks.workunit.client.1.smithi110.stdout:1/645: mknod de/d14/d34/d87/d9c/ce0 0 2024-04-12T13:42:12.400 INFO:tasks.workunit.client.1.smithi110.stdout:5/631: chown da/d2e/d45/d25/d9d/d79/fd0 321 1 2024-04-12T13:42:12.400 INFO:tasks.workunit.client.1.smithi110.stdout:3/639: write d5/dc/d31/d3b/d32/f56 [2432898,72754] 0 2024-04-12T13:42:12.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/611: chown d6/d56/d58/da0/f3c 11 1 2024-04-12T13:42:12.401 INFO:tasks.workunit.client.0.smithi060.stdout:4/623: dread d6/d21/f2d [0,4194304] 0 2024-04-12T13:42:12.402 INFO:tasks.workunit.client.1.smithi110.stdout:3/640: dread - d5/dc/d31/d3b/d32/d3e/d98/f9e zero size 2024-04-12T13:42:12.402 INFO:tasks.workunit.client.1.smithi110.stdout:1/646: write de/d15/dab/dd8/dd9/dda/fbe [2880688,128762] 0 2024-04-12T13:42:12.403 INFO:tasks.workunit.client.1.smithi110.stdout:1/647: chown de/d7b 0 1 2024-04-12T13:42:12.404 INFO:tasks.workunit.client.0.smithi060.stdout:9/534: getdents d4/d8/d7c 0 2024-04-12T13:42:12.405 INFO:tasks.workunit.client.1.smithi110.stdout:4/754: sync 2024-04-12T13:42:12.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/576: write d7/d9/f21 [337062,82155] 0 2024-04-12T13:42:12.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/577: dread - d7/d9/f92 zero size 2024-04-12T13:42:12.415 INFO:tasks.workunit.client.0.smithi060.stdout:3/677: mknod d7/d17/d19/d33/cdf 0 2024-04-12T13:42:12.421 INFO:tasks.workunit.client.0.smithi060.stdout:1/736: symlink d1e/d23/d49/l101 0 2024-04-12T13:42:12.421 INFO:tasks.workunit.client.1.smithi110.stdout:5/632: truncate da/db/f14 4718003 0 2024-04-12T13:42:12.423 INFO:tasks.workunit.client.0.smithi060.stdout:4/624: fsync d6/d7/dd/f91 0 2024-04-12T13:42:12.423 INFO:tasks.workunit.client.0.smithi060.stdout:5/618: dread d6/d10/f2a [0,4194304] 0 2024-04-12T13:42:12.424 INFO:tasks.workunit.client.1.smithi110.stdout:5/633: chown da/d2e/d45/d25/d5d/c73 57813235 1 2024-04-12T13:42:12.425 INFO:tasks.workunit.client.0.smithi060.stdout:1/737: chown d1e/d1f/f6e 429482 1 2024-04-12T13:42:12.427 INFO:tasks.workunit.client.0.smithi060.stdout:4/625: dread - d6/d2f/d51/f89 zero size 2024-04-12T13:42:12.427 INFO:tasks.workunit.client.1.smithi110.stdout:3/641: mknod d5/dc/ccd 0 2024-04-12T13:42:12.430 INFO:tasks.workunit.client.0.smithi060.stdout:6/681: dwrite d1/d7/f5d [0,4194304] 0 2024-04-12T13:42:12.430 INFO:tasks.workunit.client.0.smithi060.stdout:4/626: write d6/d21/f5d [797006,16550] 0 2024-04-12T13:42:12.432 INFO:tasks.workunit.client.0.smithi060.stdout:1/738: chown d1e/d23/d2e/d30/d51/cb9 1276183 1 2024-04-12T13:42:12.434 INFO:tasks.workunit.client.0.smithi060.stdout:0/578: rmdir d7/d9/d14 39 2024-04-12T13:42:12.436 INFO:tasks.workunit.client.1.smithi110.stdout:1/648: mkdir de/d15/d32/d61/d6a/dac/dc0/de1 0 2024-04-12T13:42:12.438 INFO:tasks.workunit.client.1.smithi110.stdout:4/755: mknod d0/de/da0/dd9/cf5 0 2024-04-12T13:42:12.439 INFO:tasks.workunit.client.1.smithi110.stdout:3/642: write d5/dc/d31/d3b/d32/d3e/d5f/f8b [3148481,102942] 0 2024-04-12T13:42:12.440 INFO:tasks.workunit.client.1.smithi110.stdout:7/676: dwrite d1/d3/d4/d55/d56/d72/f88 [0,4194304] 0 2024-04-12T13:42:12.441 INFO:tasks.workunit.client.1.smithi110.stdout:2/702: getdents d6/dc/dd/d49/d64/d4a/d51 0 2024-04-12T13:42:12.443 INFO:tasks.workunit.client.1.smithi110.stdout:8/667: dwrite d1/d3/d35/d3a/d41/f53 [0,4194304] 0 2024-04-12T13:42:12.443 INFO:tasks.workunit.client.1.smithi110.stdout:1/649: fdatasync de/d14/dd0/f7a 0 2024-04-12T13:42:12.447 INFO:tasks.workunit.client.0.smithi060.stdout:0/579: unlink d7/f87 0 2024-04-12T13:42:12.448 INFO:tasks.workunit.client.0.smithi060.stdout:1/739: rmdir d1e/d29/d6d 39 2024-04-12T13:42:12.449 INFO:tasks.workunit.client.1.smithi110.stdout:7/677: write d1/d3/d4/f9b [669367,110729] 0 2024-04-12T13:42:12.450 INFO:tasks.workunit.client.1.smithi110.stdout:8/668: dread - d1/d7/d20/fcb zero size 2024-04-12T13:42:12.450 INFO:tasks.workunit.client.1.smithi110.stdout:0/580: getdents d1/d8/d8a 0 2024-04-12T13:42:12.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/580: write d7/d41/dbc/faf [459197,44679] 0 2024-04-12T13:42:12.454 INFO:tasks.workunit.client.0.smithi060.stdout:3/678: link d7/d17/d19/d96/fc5 d7/d17/d19/d33/d63/d9b/dc0/fe0 0 2024-04-12T13:42:12.457 INFO:tasks.workunit.client.0.smithi060.stdout:3/679: dread - d7/d17/d19/d96/fd4 zero size 2024-04-12T13:42:12.457 INFO:tasks.workunit.client.1.smithi110.stdout:0/581: write d1/f2c [2189284,78633] 0 2024-04-12T13:42:12.460 INFO:tasks.workunit.client.1.smithi110.stdout:9/741: dread df/d13/d2c/d2d/dc1/d83/f68 [0,4194304] 0 2024-04-12T13:42:12.460 INFO:tasks.workunit.client.1.smithi110.stdout:7/678: chown d1/d3/d4/d36/da1/cdf 187 1 2024-04-12T13:42:12.460 INFO:tasks.workunit.client.0.smithi060.stdout:7/588: sync 2024-04-12T13:42:12.460 INFO:tasks.workunit.client.0.smithi060.stdout:8/582: sync 2024-04-12T13:42:12.461 INFO:tasks.workunit.client.1.smithi110.stdout:5/634: dwrite da/d2e/d45/d29/d58/fbf [0,4194304] 0 2024-04-12T13:42:12.461 INFO:tasks.workunit.client.0.smithi060.stdout:3/680: write d7/d17/f90 [4852152,124606] 0 2024-04-12T13:42:12.462 INFO:tasks.workunit.client.1.smithi110.stdout:7/679: dread - d1/d3/d4/da6/fc4 zero size 2024-04-12T13:42:12.465 INFO:tasks.workunit.client.0.smithi060.stdout:8/583: dread - d9/d1b/d37/d4d/d63/d66/d8b/fbf zero size 2024-04-12T13:42:12.465 INFO:tasks.workunit.client.1.smithi110.stdout:7/680: read - d1/d3/d4/d55/d82/fd4 zero size 2024-04-12T13:42:12.468 INFO:tasks.workunit.client.0.smithi060.stdout:8/584: chown d9/d1b/d3c/d8d 593232 1 2024-04-12T13:42:12.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/627: dread d6/d7/db/f4b [0,4194304] 0 2024-04-12T13:42:12.470 INFO:tasks.workunit.client.1.smithi110.stdout:6/651: sync 2024-04-12T13:42:12.474 INFO:tasks.workunit.client.0.smithi060.stdout:9/535: rmdir d4/da8 0 2024-04-12T13:42:12.474 INFO:tasks.workunit.client.0.smithi060.stdout:4/628: chown d6/d7/dd/d1a/d57/d63/fb5 67861 1 2024-04-12T13:42:12.476 INFO:tasks.workunit.client.0.smithi060.stdout:2/612: dread d6/dae/d31/d33/d3d/f59 [0,4194304] 0 2024-04-12T13:42:12.483 INFO:tasks.workunit.client.0.smithi060.stdout:1/740: symlink d1e/d46/d8d/l102 0 2024-04-12T13:42:12.484 INFO:tasks.workunit.client.1.smithi110.stdout:5/635: dread da/d2e/d45/d29/f78 [0,4194304] 0 2024-04-12T13:42:12.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/581: unlink d7/d9/f31 0 2024-04-12T13:42:12.489 INFO:tasks.workunit.client.1.smithi110.stdout:6/652: dwrite d7/d25/d2c/d4c/d77/d93/f95 [4194304,4194304] 0 2024-04-12T13:42:12.490 INFO:tasks.workunit.client.0.smithi060.stdout:6/682: write d1/d7/da/dc/d24/d30/d52/d5e/f98 [244417,10407] 0 2024-04-12T13:42:12.490 INFO:tasks.workunit.client.1.smithi110.stdout:6/653: readlink d7/lbc 0 2024-04-12T13:42:12.491 INFO:tasks.workunit.client.0.smithi060.stdout:5/619: write d6/fa0 [1277688,59997] 0 2024-04-12T13:42:12.494 INFO:tasks.workunit.client.1.smithi110.stdout:6/654: truncate d7/d25/d30/d44/da3/fb8 385803 0 2024-04-12T13:42:12.499 INFO:tasks.workunit.client.0.smithi060.stdout:4/629: dread d6/d21/f5d [0,4194304] 0 2024-04-12T13:42:12.501 INFO:tasks.workunit.client.1.smithi110.stdout:2/703: write d6/dc/dd/d49/f8a [363259,119134] 0 2024-04-12T13:42:12.502 INFO:tasks.workunit.client.0.smithi060.stdout:4/630: fsync d6/d7/db/d85/f4e 0 2024-04-12T13:42:12.502 INFO:tasks.workunit.client.0.smithi060.stdout:9/536: rmdir d4/d9/d19/d8c 39 2024-04-12T13:42:12.502 INFO:tasks.workunit.client.1.smithi110.stdout:7/681: dread - d1/d1b/d3d/f9e zero size 2024-04-12T13:42:12.504 INFO:tasks.workunit.client.0.smithi060.stdout:9/537: fsync d4/d8/fa 0 2024-04-12T13:42:12.506 INFO:tasks.workunit.client.0.smithi060.stdout:4/631: chown d6/d7/dd/d1a/d57/d63/d68/d94/cbc 33240287 1 2024-04-12T13:42:12.508 INFO:tasks.workunit.client.0.smithi060.stdout:9/538: write d4/d9/f2a [103415,104222] 0 2024-04-12T13:42:12.509 INFO:tasks.workunit.client.1.smithi110.stdout:1/650: rename de/f58 to de/d14/d83/fe2 0 2024-04-12T13:42:12.510 INFO:tasks.workunit.client.0.smithi060.stdout:7/589: write d0/d1b/f48 [3332378,124401] 0 2024-04-12T13:42:12.514 INFO:tasks.workunit.client.1.smithi110.stdout:8/669: dwrite d1/d3/d3c/d75/d79/fa5 [0,4194304] 0 2024-04-12T13:42:12.515 INFO:tasks.workunit.client.0.smithi060.stdout:5/620: creat d6/d10/d12/d4c/fcd x:0 0 0 2024-04-12T13:42:12.516 INFO:tasks.workunit.client.0.smithi060.stdout:1/741: write d1e/dcc/fce [301038,34734] 0 2024-04-12T13:42:12.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/742: chown d1e/d46/d8d/c9f 49516136 1 2024-04-12T13:42:12.520 INFO:tasks.workunit.client.0.smithi060.stdout:6/683: write d1/d7/da/dc/d24/d30/d52/d5e/fbb [415452,74118] 0 2024-04-12T13:42:12.523 INFO:tasks.workunit.client.1.smithi110.stdout:3/643: truncate d5/dc/d20/d2d/d4f/f7b 1257691 0 2024-04-12T13:42:12.526 INFO:tasks.workunit.client.1.smithi110.stdout:2/704: creat d6/dc/d6f/fda x:0 0 0 2024-04-12T13:42:12.529 INFO:tasks.workunit.client.1.smithi110.stdout:4/756: link d0/de/d32/f7d d0/d75/d84/d89/ff6 0 2024-04-12T13:42:12.533 INFO:tasks.workunit.client.1.smithi110.stdout:0/582: truncate d1/d48/db2/d4a/f73 759501 0 2024-04-12T13:42:12.535 INFO:tasks.workunit.client.1.smithi110.stdout:6/655: rename d7/d10/d1c/d4d to d7/d25/d2c/d4c/d77/dd3 0 2024-04-12T13:42:12.536 INFO:tasks.workunit.client.0.smithi060.stdout:9/539: creat d4/d33/d65/d7a/fb3 x:0 0 0 2024-04-12T13:42:12.536 INFO:tasks.workunit.client.0.smithi060.stdout:1/743: dwrite d1e/d29/d37/f100 [0,4194304] 0 2024-04-12T13:42:12.538 INFO:tasks.workunit.client.1.smithi110.stdout:9/742: dread fc [0,4194304] 0 2024-04-12T13:42:12.538 INFO:tasks.workunit.client.1.smithi110.stdout:8/670: mkdir d1/d3/d35/d43/d9f/dd5 0 2024-04-12T13:42:12.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/744: write d1e/d23/d49/d4e/fee [922779,36925] 0 2024-04-12T13:42:12.544 INFO:tasks.workunit.client.0.smithi060.stdout:7/590: creat d0/d7/d92/fc2 x:0 0 0 2024-04-12T13:42:12.545 INFO:tasks.workunit.client.1.smithi110.stdout:2/705: fsync d6/dc/dd/d49/d64/d4a/d51/f4f 0 2024-04-12T13:42:12.547 INFO:tasks.workunit.client.1.smithi110.stdout:1/651: mknod de/ce3 0 2024-04-12T13:42:12.551 INFO:tasks.workunit.client.1.smithi110.stdout:7/682: rename d1/d1b/d3d/d68/d97/da5 to d1/d3/d4/d55/d56/d72/de0 0 2024-04-12T13:42:12.556 INFO:tasks.workunit.client.1.smithi110.stdout:6/656: creat d7/d25/d2c/d4c/d77/d93/fd4 x:0 0 0 2024-04-12T13:42:12.559 INFO:tasks.workunit.client.1.smithi110.stdout:8/671: fsync d1/d3/d3c/d5a/d6f/d7e/f8e 0 2024-04-12T13:42:12.560 INFO:tasks.workunit.client.1.smithi110.stdout:6/657: write d7/d25/d30/d44/da3/fb8 [393615,40951] 0 2024-04-12T13:42:12.561 INFO:tasks.workunit.client.0.smithi060.stdout:4/632: symlink d6/d7/dd/d1a/d57/dc7/ld4 0 2024-04-12T13:42:12.564 INFO:tasks.workunit.client.0.smithi060.stdout:9/540: symlink d4/d33/d50/lb4 0 2024-04-12T13:42:12.564 INFO:tasks.workunit.client.0.smithi060.stdout:6/684: write d1/d7/da/dc/d24/d2d/f5a [1838677,62499] 0 2024-04-12T13:42:12.566 INFO:tasks.workunit.client.0.smithi060.stdout:1/745: truncate d1e/d46/f48 586247 0 2024-04-12T13:42:12.567 INFO:tasks.workunit.client.1.smithi110.stdout:1/652: stat de/d14/d34/d87/caf 0 2024-04-12T13:42:12.570 INFO:tasks.workunit.client.1.smithi110.stdout:3/644: rename d5/dc/d31/d3b/d32/d3e/d5f/dc6 to d5/dc/d20/d2d/d4f/dce 0 2024-04-12T13:42:12.571 INFO:tasks.workunit.client.0.smithi060.stdout:5/621: creat d6/d10/db8/fce x:0 0 0 2024-04-12T13:42:12.572 INFO:tasks.workunit.client.1.smithi110.stdout:7/683: creat d1/d1b/d3d/d68/d97/fe1 x:0 0 0 2024-04-12T13:42:12.573 INFO:tasks.workunit.client.0.smithi060.stdout:8/585: getdents d9/d1b/d37/d4d/d63 0 2024-04-12T13:42:12.574 INFO:tasks.workunit.client.0.smithi060.stdout:2/613: getdents d6/d56/d43 0 2024-04-12T13:42:12.575 INFO:tasks.workunit.client.1.smithi110.stdout:5/636: link da/d2e/d45/d29/d66/d7c/d8a/cac da/d2e/d45/d25/d9d/d7a/dc3/cda 0 2024-04-12T13:42:12.576 INFO:tasks.workunit.client.0.smithi060.stdout:5/622: write d6/d10/d12/d38/f86 [5012142,20328] 0 2024-04-12T13:42:12.576 INFO:tasks.workunit.client.0.smithi060.stdout:8/586: read d9/d1d/f33 [3233685,48096] 0 2024-04-12T13:42:12.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/614: readlink d6/d10/d2b/d60/lb1 0 2024-04-12T13:42:12.578 INFO:tasks.workunit.client.0.smithi060.stdout:1/746: symlink d1e/d29/d37/l103 0 2024-04-12T13:42:12.579 INFO:tasks.workunit.client.1.smithi110.stdout:8/672: creat d1/d3/d35/d3a/d3e/d4f/fd6 x:0 0 0 2024-04-12T13:42:12.582 INFO:tasks.workunit.client.1.smithi110.stdout:8/673: read d1/d3/d35/d3a/d3e/d4f/f87 [490974,81898] 0 2024-04-12T13:42:12.583 INFO:tasks.workunit.client.0.smithi060.stdout:2/615: dread d6/d10/f95 [0,4194304] 0 2024-04-12T13:42:12.585 INFO:tasks.workunit.client.0.smithi060.stdout:9/541: dwrite d4/d9/d19/d21/d73/d67/fa9 [0,4194304] 0 2024-04-12T13:42:12.586 INFO:tasks.workunit.client.0.smithi060.stdout:5/623: read d6/dd/d1f/d25/d42/d52/f8c [692396,32778] 0 2024-04-12T13:42:12.598 INFO:tasks.workunit.client.0.smithi060.stdout:0/582: truncate d7/d9/d14/d35/d3c/f45 3767641 0 2024-04-12T13:42:12.604 INFO:tasks.workunit.client.0.smithi060.stdout:8/587: symlink d9/d1b/d84/lcf 0 2024-04-12T13:42:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:6/685: dwrite d1/d7/da/d20/f4e [0,4194304] 0 2024-04-12T13:42:12.608 INFO:tasks.workunit.client.0.smithi060.stdout:4/633: write d6/d7/dd/d4d/d69/f8a [427789,74598] 0 2024-04-12T13:42:12.610 INFO:tasks.workunit.client.1.smithi110.stdout:8/674: dread d1/d5/d1f/f66 [4194304,4194304] 0 2024-04-12T13:42:12.614 INFO:tasks.workunit.client.1.smithi110.stdout:2/706: link d6/dc/dd/d49/d64/d5d/lc0 d6/dc/d13/d80/d8d/dcc/ldb 0 2024-04-12T13:42:12.615 INFO:tasks.workunit.client.0.smithi060.stdout:1/747: dread d1e/d23/d2e/d5e/df0/ffa [0,4194304] 0 2024-04-12T13:42:12.617 INFO:tasks.workunit.client.1.smithi110.stdout:0/583: link d1/d8/d36/d51/d60/f70 d1/d27/d6e/fcf 0 2024-04-12T13:42:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/542: creat d4/d9/d19/d21/d73/fb5 x:0 0 0 2024-04-12T13:42:12.619 INFO:tasks.workunit.client.1.smithi110.stdout:5/637: rename da/d2e/d45/d25/d9d/d79/d88/dd3/f91 to da/d2e/d45/d25/d9d/d79/d88/dd3/fdb 0 2024-04-12T13:42:12.620 INFO:tasks.workunit.client.1.smithi110.stdout:0/584: chown d1/d48/db2/d4a/f72 15 1 2024-04-12T13:42:12.621 INFO:tasks.workunit.client.1.smithi110.stdout:5/638: chown da/d2e/d45/d29/f7e 435352 1 2024-04-12T13:42:12.624 INFO:tasks.workunit.client.1.smithi110.stdout:5/639: dread - da/d2e/d45/d25/d9d/fd7 zero size 2024-04-12T13:42:12.624 INFO:tasks.workunit.client.1.smithi110.stdout:1/653: dread de/d1d/f42 [0,4194304] 0 2024-04-12T13:42:12.627 INFO:tasks.workunit.client.1.smithi110.stdout:6/658: rename d7/d25/d30/d44/f2d to d7/fd5 0 2024-04-12T13:42:12.629 INFO:tasks.workunit.client.0.smithi060.stdout:0/583: creat d7/d9/d14/d35/d44/d7d/fc5 x:0 0 0 2024-04-12T13:42:12.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/584: fsync d7/d9/d14/d35/d44/d7d/f2a 0 2024-04-12T13:42:12.632 INFO:tasks.workunit.client.1.smithi110.stdout:7/684: link d1/d3/d4/d36/l39 d1/d1b/d70/le2 0 2024-04-12T13:42:12.635 INFO:tasks.workunit.client.1.smithi110.stdout:8/675: mkdir d1/d3/d35/d3a/d41/dd7 0 2024-04-12T13:42:12.637 INFO:tasks.workunit.client.1.smithi110.stdout:0/585: dwrite d1/d56/fbc [0,4194304] 0 2024-04-12T13:42:12.638 INFO:tasks.workunit.client.0.smithi060.stdout:2/616: dwrite d6/d10/d6b/f8e [0,4194304] 0 2024-04-12T13:42:12.639 INFO:tasks.workunit.client.1.smithi110.stdout:5/640: dread - da/d2e/d45/d25/d9d/d79/d88/dd3/f7d zero size 2024-04-12T13:42:12.639 INFO:tasks.workunit.client.1.smithi110.stdout:0/586: chown d1/d27/d6e/cc7 179 1 2024-04-12T13:42:12.640 INFO:tasks.workunit.client.0.smithi060.stdout:7/591: getdents d0/d7/d43/d63/d6f 0 2024-04-12T13:42:12.641 INFO:tasks.workunit.client.1.smithi110.stdout:5/641: write da/d2e/d45/d25/d9d/d79/d9e/fd5 [710729,104074] 0 2024-04-12T13:42:12.642 INFO:tasks.workunit.client.0.smithi060.stdout:8/588: dread d9/d1b/d84/da0/faa [0,4194304] 0 2024-04-12T13:42:12.642 INFO:tasks.workunit.client.1.smithi110.stdout:2/707: write d6/dc/f2b [4908719,82090] 0 2024-04-12T13:42:12.645 INFO:tasks.workunit.client.0.smithi060.stdout:6/686: fdatasync d1/d7/da/dc/d24/d30/d52/f8a 0 2024-04-12T13:42:12.647 INFO:tasks.workunit.client.1.smithi110.stdout:6/659: stat d7/d25/d30/d44/d3d/f5b 0 2024-04-12T13:42:12.650 INFO:tasks.workunit.client.1.smithi110.stdout:7/685: mknod d1/d3/d4/d36/d76/ce3 0 2024-04-12T13:42:12.653 INFO:tasks.workunit.client.0.smithi060.stdout:7/592: dread d0/d7/d43/d63/f9f [0,4194304] 0 2024-04-12T13:42:12.661 INFO:tasks.workunit.client.1.smithi110.stdout:8/676: creat d1/d5/dd/d31/dba/fd8 x:0 0 0 2024-04-12T13:42:12.663 INFO:tasks.workunit.client.1.smithi110.stdout:1/654: link de/f64 de/d14/d83/fe4 0 2024-04-12T13:42:12.663 INFO:tasks.workunit.client.0.smithi060.stdout:2/617: chown d6/l73 51909564 1 2024-04-12T13:42:12.665 INFO:tasks.workunit.client.0.smithi060.stdout:2/618: read d6/d10/d6b/f8e [2578872,29833] 0 2024-04-12T13:42:12.665 INFO:tasks.workunit.client.1.smithi110.stdout:5/642: mkdir da/d2e/d45/ddc 0 2024-04-12T13:42:12.666 INFO:tasks.workunit.client.0.smithi060.stdout:3/681: sync 2024-04-12T13:42:12.666 INFO:tasks.workunit.client.0.smithi060.stdout:2/619: stat d6/d56/d58/laf 0 2024-04-12T13:42:12.667 INFO:tasks.workunit.client.1.smithi110.stdout:2/708: dread d6/dc/dd/d49/d64/d4a/f92 [0,4194304] 0 2024-04-12T13:42:12.667 INFO:tasks.workunit.client.1.smithi110.stdout:6/660: dread d7/d25/d30/d44/f61 [0,4194304] 0 2024-04-12T13:42:12.668 INFO:tasks.workunit.client.1.smithi110.stdout:6/661: dread - d7/d10/d7e/d85/fc2 zero size 2024-04-12T13:42:12.668 INFO:tasks.workunit.client.1.smithi110.stdout:2/709: stat d6/dc/d13/d80/d8d/dcc/f6b 0 2024-04-12T13:42:12.669 INFO:tasks.workunit.client.0.smithi060.stdout:5/624: creat d6/dd/fcf x:0 0 0 2024-04-12T13:42:12.670 INFO:tasks.workunit.client.0.smithi060.stdout:5/625: stat d6/dd/d1f/d25/l4b 0 2024-04-12T13:42:12.672 INFO:tasks.workunit.client.0.smithi060.stdout:6/687: truncate d1/d7/da/dc/f19 465001 0 2024-04-12T13:42:12.673 INFO:tasks.workunit.client.1.smithi110.stdout:1/655: dread - de/d14/f7e zero size 2024-04-12T13:42:12.676 INFO:tasks.workunit.client.0.smithi060.stdout:4/634: rename d6/d7/db/d85/c8b to d6/d7/dd/d4d/cd5 0 2024-04-12T13:42:12.676 INFO:tasks.workunit.client.1.smithi110.stdout:1/656: write de/d15/d32/d61/f73 [1288037,114810] 0 2024-04-12T13:42:12.676 INFO:tasks.workunit.client.1.smithi110.stdout:5/643: creat da/d2e/d45/d25/d9d/d79/fdd x:0 0 0 2024-04-12T13:42:12.676 INFO:tasks.workunit.client.0.smithi060.stdout:1/748: rename d1e to d1e/d23/d2e/d30/d51/d85/dfe/d104 22 2024-04-12T13:42:12.677 INFO:tasks.workunit.client.1.smithi110.stdout:2/710: creat d6/dc/d1b/d57/d62/fdc x:0 0 0 2024-04-12T13:42:12.677 INFO:tasks.workunit.client.0.smithi060.stdout:4/635: read d6/d21/f2d [3367047,59659] 0 2024-04-12T13:42:12.678 INFO:tasks.workunit.client.1.smithi110.stdout:2/711: stat d6/dc/d1b/d57 0 2024-04-12T13:42:12.679 INFO:tasks.workunit.client.1.smithi110.stdout:5/644: read da/db/f1d [407050,76426] 0 2024-04-12T13:42:12.679 INFO:tasks.workunit.client.1.smithi110.stdout:2/712: dread - d6/dc/fa9 zero size 2024-04-12T13:42:12.681 INFO:tasks.workunit.client.1.smithi110.stdout:2/713: fsync d6/dc/dd/d49/d64/f2c 0 2024-04-12T13:42:12.682 INFO:tasks.workunit.client.1.smithi110.stdout:7/686: fdatasync d1/d3/d43/f85 0 2024-04-12T13:42:12.684 INFO:tasks.workunit.client.1.smithi110.stdout:7/687: chown d1/d3/d4/d55/d82/f6a 184431386 1 2024-04-12T13:42:12.684 INFO:tasks.workunit.client.1.smithi110.stdout:8/677: unlink d1/d3/d35/c7a 0 2024-04-12T13:42:12.689 INFO:tasks.workunit.client.0.smithi060.stdout:3/682: creat d7/d17/d27/d36/db0/fe1 x:0 0 0 2024-04-12T13:42:12.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/543: link d4/d8/l29 d4/d33/lb6 0 2024-04-12T13:42:12.693 INFO:tasks.workunit.client.1.smithi110.stdout:5/645: mknod da/d2e/d45/d25/d9d/d79/cde 0 2024-04-12T13:42:12.693 INFO:tasks.workunit.client.0.smithi060.stdout:0/585: dwrite d7/d9/f1e [0,4194304] 0 2024-04-12T13:42:12.695 INFO:tasks.workunit.client.0.smithi060.stdout:5/626: chown d6/dd/d1f/c28 8186 1 2024-04-12T13:42:12.696 INFO:tasks.workunit.client.0.smithi060.stdout:8/589: truncate d9/d1b/d2b/f5c 934114 0 2024-04-12T13:42:12.700 INFO:tasks.workunit.client.1.smithi110.stdout:8/678: dwrite d1/d3/d3c/f33 [0,4194304] 0 2024-04-12T13:42:12.704 INFO:tasks.workunit.client.1.smithi110.stdout:1/657: write de/d1d/d86/fa3 [953076,115093] 0 2024-04-12T13:42:12.705 INFO:tasks.workunit.client.0.smithi060.stdout:4/636: dread - d6/d2f/fa5 zero size 2024-04-12T13:42:12.708 INFO:tasks.workunit.client.0.smithi060.stdout:7/593: truncate d0/d1b/f37 2129260 0 2024-04-12T13:42:12.711 INFO:tasks.workunit.client.0.smithi060.stdout:2/620: mknod d6/d10/cb9 0 2024-04-12T13:42:12.714 INFO:tasks.workunit.client.0.smithi060.stdout:2/621: write d6/d10/d2b/d60/f93 [456330,52127] 0 2024-04-12T13:42:12.715 INFO:tasks.workunit.client.1.smithi110.stdout:8/679: creat d1/d3/fd9 x:0 0 0 2024-04-12T13:42:12.717 INFO:tasks.workunit.client.0.smithi060.stdout:3/683: symlink d7/d17/d19/d33/d63/d9b/le2 0 2024-04-12T13:42:12.720 INFO:tasks.workunit.client.0.smithi060.stdout:9/544: mknod d4/d33/d50/cb7 0 2024-04-12T13:42:12.725 INFO:tasks.workunit.client.1.smithi110.stdout:1/658: creat de/d14/d34/d55/d6b/fe5 x:0 0 0 2024-04-12T13:42:12.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/684: write d7/d17/d19/dc9/d3f/d5c/d25/d4d/f6e [2858988,58786] 0 2024-04-12T13:42:12.726 INFO:tasks.workunit.client.0.smithi060.stdout:5/627: symlink d6/dd/d1f/d25/d42/d6b/ld0 0 2024-04-12T13:42:12.728 INFO:tasks.workunit.client.1.smithi110.stdout:8/680: mknod d1/d3/d35/d3a/d84/cda 0 2024-04-12T13:42:12.729 INFO:tasks.workunit.client.1.smithi110.stdout:5/646: dwrite da/db/f37 [4194304,4194304] 0 2024-04-12T13:42:12.729 INFO:tasks.workunit.client.0.smithi060.stdout:8/590: creat d9/d1b/d2b/d82/d8a/fd0 x:0 0 0 2024-04-12T13:42:12.730 INFO:tasks.workunit.client.0.smithi060.stdout:1/749: dwrite d1e/f45 [0,4194304] 0 2024-04-12T13:42:12.732 INFO:tasks.workunit.client.1.smithi110.stdout:7/688: dread d1/d3/f11 [0,4194304] 0 2024-04-12T13:42:12.734 INFO:tasks.workunit.client.1.smithi110.stdout:1/659: creat de/d14/d34/d87/fe6 x:0 0 0 2024-04-12T13:42:12.736 INFO:tasks.workunit.client.0.smithi060.stdout:1/750: truncate d1e/d23/d2e/d30/fff 1038172 0 2024-04-12T13:42:12.739 INFO:tasks.workunit.client.0.smithi060.stdout:7/594: dread - d0/d7/f41 zero size 2024-04-12T13:42:12.739 INFO:tasks.workunit.client.1.smithi110.stdout:2/714: getdents d6/dc 0 2024-04-12T13:42:12.742 INFO:tasks.workunit.client.1.smithi110.stdout:7/689: truncate d1/d1b/d3d/f63 593900 0 2024-04-12T13:42:12.742 INFO:tasks.workunit.client.1.smithi110.stdout:8/681: mknod d1/d3/dbe/dd1/cdb 0 2024-04-12T13:42:12.745 INFO:tasks.workunit.client.0.smithi060.stdout:9/545: dwrite d4/d33/d50/f6c [0,4194304] 0 2024-04-12T13:42:12.746 INFO:tasks.workunit.client.1.smithi110.stdout:1/660: rename de/d14/f65 to de/fe7 0 2024-04-12T13:42:12.746 INFO:tasks.workunit.client.0.smithi060.stdout:3/685: rmdir d7/d17/d19 39 2024-04-12T13:42:12.747 INFO:tasks.workunit.client.1.smithi110.stdout:8/682: chown d1/d3/d35/d3a/c5b 43912090 1 2024-04-12T13:42:12.748 INFO:tasks.workunit.client.1.smithi110.stdout:4/757: sync 2024-04-12T13:42:12.749 INFO:tasks.workunit.client.0.smithi060.stdout:2/622: mknod d6/dae/d31/d87/cba 0 2024-04-12T13:42:12.750 INFO:tasks.workunit.client.0.smithi060.stdout:1/751: dread - d1e/d23/d49/d4e/fc2 zero size 2024-04-12T13:42:12.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/595: mknod d0/d3d/cc3 0 2024-04-12T13:42:12.751 INFO:tasks.workunit.client.1.smithi110.stdout:5/647: dwrite da/d2e/d45/d25/d9d/d79/d88/dd3/fd8 [0,4194304] 0 2024-04-12T13:42:12.751 INFO:tasks.workunit.client.1.smithi110.stdout:1/661: write de/d7b/fde [879175,41880] 0 2024-04-12T13:42:12.752 INFO:tasks.workunit.client.0.smithi060.stdout:2/623: chown d6/d10/c91 2915 1 2024-04-12T13:42:12.754 INFO:tasks.workunit.client.0.smithi060.stdout:7/596: read d0/d1b/f72 [623231,125487] 0 2024-04-12T13:42:12.757 INFO:tasks.workunit.client.1.smithi110.stdout:5/648: chown da/d2e/d45/d29/d66/d7c/la5 7885 1 2024-04-12T13:42:12.760 INFO:tasks.workunit.client.0.smithi060.stdout:6/688: getdents d1 0 2024-04-12T13:42:12.761 INFO:tasks.workunit.client.0.smithi060.stdout:8/591: dread d9/d1b/d2b/f32 [0,4194304] 0 2024-04-12T13:42:12.761 INFO:tasks.workunit.client.1.smithi110.stdout:5/649: fdatasync da/d2e/d45/d25/f44 0 2024-04-12T13:42:12.762 INFO:tasks.workunit.client.0.smithi060.stdout:9/546: mkdir d4/d8/db8 0 2024-04-12T13:42:12.765 INFO:tasks.workunit.client.1.smithi110.stdout:5/650: truncate da/d2e/d45/d25/d9d/d7a/db5/fce 1173520 0 2024-04-12T13:42:12.765 INFO:tasks.workunit.client.0.smithi060.stdout:4/637: dread d6/d7/f3b [0,4194304] 0 2024-04-12T13:42:12.765 INFO:tasks.workunit.client.0.smithi060.stdout:6/689: write d1/d7/f5d [2669136,54427] 0 2024-04-12T13:42:12.766 INFO:tasks.workunit.client.0.smithi060.stdout:1/752: truncate d1e/d23/d2e/d30/d51/d85/ffb 1166894 0 2024-04-12T13:42:12.774 INFO:tasks.workunit.client.0.smithi060.stdout:5/628: creat d6/dd/fd1 x:0 0 0 2024-04-12T13:42:12.776 INFO:tasks.workunit.client.0.smithi060.stdout:7/597: creat d0/d3d/fc4 x:0 0 0 2024-04-12T13:42:12.777 INFO:tasks.workunit.client.1.smithi110.stdout:7/690: link d1/d3/d4/d36/c9f d1/d3/d4/dbf/db6/ce4 0 2024-04-12T13:42:12.778 INFO:tasks.workunit.client.1.smithi110.stdout:2/715: write d6/dc/dd/f1f [3607197,46220] 0 2024-04-12T13:42:12.783 INFO:tasks.workunit.client.0.smithi060.stdout:8/592: stat d9/l13 0 2024-04-12T13:42:12.784 INFO:tasks.workunit.client.1.smithi110.stdout:5/651: creat da/db/d3b/d40/da2/fdf x:0 0 0 2024-04-12T13:42:12.785 INFO:tasks.workunit.client.0.smithi060.stdout:0/586: dwrite d7/d33/d5b/f90 [4194304,4194304] 0 2024-04-12T13:42:12.785 INFO:tasks.workunit.client.1.smithi110.stdout:8/683: link d1/d3/d3c/lcf d1/d3/d35/d3a/d3e/d4f/ldc 0 2024-04-12T13:42:12.786 INFO:tasks.workunit.client.0.smithi060.stdout:9/547: chown d4/d9/d19/d8c/d92 378 1 2024-04-12T13:42:12.786 INFO:tasks.workunit.client.1.smithi110.stdout:8/684: readlink d1/d3/d35/d3a/d84/d9e/ld0 0 2024-04-12T13:42:12.787 INFO:tasks.workunit.client.0.smithi060.stdout:0/587: stat d7/d9/d14/f34 0 2024-04-12T13:42:12.788 INFO:tasks.workunit.client.0.smithi060.stdout:9/548: chown d4/d9/d19/l8e 1232358 1 2024-04-12T13:42:12.789 INFO:tasks.workunit.client.0.smithi060.stdout:9/549: chown d4/d33/d50/l68 15831409 1 2024-04-12T13:42:12.791 INFO:tasks.workunit.client.1.smithi110.stdout:4/758: write d0/d78/faf [162560,124343] 0 2024-04-12T13:42:12.792 INFO:tasks.workunit.client.1.smithi110.stdout:7/691: mkdir d1/d3/d4/d55/d56/de5 0 2024-04-12T13:42:12.793 INFO:tasks.workunit.client.0.smithi060.stdout:9/550: write d4/d9/d19/f1a [5322282,13502] 0 2024-04-12T13:42:12.794 INFO:tasks.workunit.client.1.smithi110.stdout:7/692: chown d1/d3/d4/f9 4 1 2024-04-12T13:42:12.795 INFO:tasks.workunit.client.0.smithi060.stdout:7/598: dwrite d0/d7/f87 [0,4194304] 0 2024-04-12T13:42:12.798 INFO:tasks.workunit.client.0.smithi060.stdout:6/690: mknod d1/d7/da/d20/d99/ce5 0 2024-04-12T13:42:12.799 INFO:tasks.workunit.client.1.smithi110.stdout:1/662: link fb de/d14/d34/d55/d6b/fe8 0 2024-04-12T13:42:12.802 INFO:tasks.workunit.client.1.smithi110.stdout:5/652: creat da/db/d52/fe0 x:0 0 0 2024-04-12T13:42:12.807 INFO:tasks.workunit.client.1.smithi110.stdout:8/685: dwrite d1/d3/d35/d3a/d3e/d64/d85/d8d/fc4 [0,4194304] 0 2024-04-12T13:42:12.807 INFO:tasks.workunit.client.1.smithi110.stdout:7/693: chown d1/d3/f4c 470 1 2024-04-12T13:42:12.814 INFO:tasks.workunit.client.0.smithi060.stdout:8/593: mknod d9/d1d/d5e/d90/cd1 0 2024-04-12T13:42:12.815 INFO:tasks.workunit.client.1.smithi110.stdout:4/759: dwrite d0/d19/d1c/d50/fe2 [0,4194304] 0 2024-04-12T13:42:12.816 INFO:tasks.workunit.client.1.smithi110.stdout:1/663: creat de/d1d/d86/fe9 x:0 0 0 2024-04-12T13:42:12.817 INFO:tasks.workunit.client.0.smithi060.stdout:0/588: symlink d7/d9/de/d80/lc6 0 2024-04-12T13:42:12.821 INFO:tasks.workunit.client.1.smithi110.stdout:5/653: rmdir da/db 39 2024-04-12T13:42:12.824 INFO:tasks.workunit.client.1.smithi110.stdout:7/694: mknod d1/d31/d5d/ce6 0 2024-04-12T13:42:12.826 INFO:tasks.workunit.client.0.smithi060.stdout:1/753: mkdir d1e/d105 0 2024-04-12T13:42:12.827 INFO:tasks.workunit.client.1.smithi110.stdout:2/716: dwrite d6/dc/dd/d49/d64/f87 [0,4194304] 0 2024-04-12T13:42:12.828 INFO:tasks.workunit.client.1.smithi110.stdout:7/695: write d1/d3/d4/d55/f77 [4988984,111874] 0 2024-04-12T13:42:12.829 INFO:tasks.workunit.client.1.smithi110.stdout:4/760: dread - d0/d19/d1c/d50/d6f/fa7 zero size 2024-04-12T13:42:12.832 INFO:tasks.workunit.client.0.smithi060.stdout:3/686: dwrite d7/d17/d27/d36/f62 [0,4194304] 0 2024-04-12T13:42:12.836 INFO:tasks.workunit.client.0.smithi060.stdout:8/594: mknod d9/d1b/d84/cd2 0 2024-04-12T13:42:12.838 INFO:tasks.workunit.client.1.smithi110.stdout:1/664: dread de/d14/d34/d55/d6b/f77 [0,4194304] 0 2024-04-12T13:42:12.838 INFO:tasks.workunit.client.0.smithi060.stdout:0/589: truncate d7/d9/d14/d35/d44/d49/d67/f86 2270754 0 2024-04-12T13:42:12.846 INFO:tasks.workunit.client.1.smithi110.stdout:4/761: symlink d0/de/d2c/lf7 0 2024-04-12T13:42:12.847 INFO:tasks.workunit.client.0.smithi060.stdout:9/551: symlink d4/d9/d19/lb9 0 2024-04-12T13:42:12.847 INFO:tasks.workunit.client.1.smithi110.stdout:5/654: fdatasync da/db/d3b/d40/da2/fcd 0 2024-04-12T13:42:12.848 INFO:tasks.workunit.client.1.smithi110.stdout:7/696: creat d1/d3/fe7 x:0 0 0 2024-04-12T13:42:12.849 INFO:tasks.workunit.client.1.smithi110.stdout:4/762: chown d0/de/da0/dd9/df3/dd7 110101236 1 2024-04-12T13:42:12.850 INFO:tasks.workunit.client.0.smithi060.stdout:7/599: mkdir d0/d7/dc5 0 2024-04-12T13:42:12.853 INFO:tasks.workunit.client.0.smithi060.stdout:2/624: getdents d6/dae/d31/d87 0 2024-04-12T13:42:12.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/629: truncate d6/dd/d1f/d25/f34 163625 0 2024-04-12T13:42:12.855 INFO:tasks.workunit.client.0.smithi060.stdout:0/590: symlink d7/d33/d88/lc7 0 2024-04-12T13:42:12.859 INFO:tasks.workunit.client.1.smithi110.stdout:2/717: dwrite d6/dc/dd/f54 [4194304,4194304] 0 2024-04-12T13:42:12.859 INFO:tasks.workunit.client.0.smithi060.stdout:5/630: fsync d6/dd/d1f/d25/d35/d50/d5f/f7f 0 2024-04-12T13:42:12.860 INFO:tasks.workunit.client.0.smithi060.stdout:8/595: creat d9/d1b/d84/da0/d80/fd3 x:0 0 0 2024-04-12T13:42:12.862 INFO:tasks.workunit.client.0.smithi060.stdout:6/691: dwrite d1/d7/da/dc/d24/f96 [4194304,4194304] 0 2024-04-12T13:42:12.870 INFO:tasks.workunit.client.0.smithi060.stdout:2/625: symlink d6/d64/d99/lbb 0 2024-04-12T13:42:12.873 INFO:tasks.workunit.client.1.smithi110.stdout:9/743: sync 2024-04-12T13:42:12.874 INFO:tasks.workunit.client.0.smithi060.stdout:2/626: write d6/dae/d5b/d6d/f6e [535587,90403] 0 2024-04-12T13:42:12.877 INFO:tasks.workunit.client.0.smithi060.stdout:0/591: rmdir d7/d41 39 2024-04-12T13:42:12.882 INFO:tasks.workunit.client.0.smithi060.stdout:9/552: mknod d4/d9/d19/db1/cba 0 2024-04-12T13:42:12.884 INFO:tasks.workunit.client.0.smithi060.stdout:5/631: fdatasync d6/d10/d12/f9f 0 2024-04-12T13:42:12.887 INFO:tasks.workunit.client.0.smithi060.stdout:1/754: dwrite d1e/d23/d2e/d30/d51/f8a [0,4194304] 0 2024-04-12T13:42:12.889 INFO:tasks.workunit.client.0.smithi060.stdout:5/632: readlink d6/dd/d1f/d25/d42/d6b/ld0 0 2024-04-12T13:42:12.902 INFO:tasks.workunit.client.0.smithi060.stdout:2/627: dread d6/f24 [0,4194304] 0 2024-04-12T13:42:12.910 INFO:tasks.workunit.client.0.smithi060.stdout:9/553: dwrite d4/d9/f2a [4194304,4194304] 0 2024-04-12T13:42:12.910 INFO:tasks.workunit.client.0.smithi060.stdout:7/600: rmdir d0/d7/d43/d63/dbe 0 2024-04-12T13:42:12.910 INFO:tasks.workunit.client.0.smithi060.stdout:9/554: chown d4/d9/d19/d21/f31 30 1 2024-04-12T13:42:12.915 INFO:tasks.workunit.client.0.smithi060.stdout:6/692: unlink d1/d7/da/dc/d24/d34/d51/d59/d94/ca6 0 2024-04-12T13:42:12.921 INFO:tasks.workunit.client.1.smithi110.stdout:1/665: mkdir de/d15/d32/d61/d6a/dac/dc0/dea 0 2024-04-12T13:42:12.925 INFO:tasks.workunit.client.1.smithi110.stdout:5/655: rename da/d2e/d45/d29/d58/fa1 to da/d2e/d45/d25/d5d/fe1 0 2024-04-12T13:42:12.925 INFO:tasks.workunit.client.1.smithi110.stdout:1/666: dread de/d14/d34/d55/d6b/f77 [0,4194304] 0 2024-04-12T13:42:12.926 INFO:tasks.workunit.client.0.smithi060.stdout:8/596: dwrite d9/d1b/d2b/f5c [0,4194304] 0 2024-04-12T13:42:12.926 INFO:tasks.workunit.client.1.smithi110.stdout:1/667: chown de/d14/d34/d55/c5d 382 1 2024-04-12T13:42:12.928 INFO:tasks.workunit.client.0.smithi060.stdout:1/755: mkdir d1e/d106 0 2024-04-12T13:42:12.937 INFO:tasks.workunit.client.0.smithi060.stdout:0/592: write d7/d41/f7f [4021882,129979] 0 2024-04-12T13:42:12.938 INFO:tasks.workunit.client.0.smithi060.stdout:6/693: chown d1/d7/da/dc/d24/d34/d51/d59/d94/lad 35 1 2024-04-12T13:42:12.943 INFO:tasks.workunit.client.1.smithi110.stdout:0/587: sync 2024-04-12T13:42:12.944 INFO:tasks.workunit.client.1.smithi110.stdout:3/645: sync 2024-04-12T13:42:12.944 INFO:tasks.workunit.client.1.smithi110.stdout:7/697: write d1/d3/f11 [2387584,66012] 0 2024-04-12T13:42:12.944 INFO:tasks.workunit.client.1.smithi110.stdout:6/662: sync 2024-04-12T13:42:12.944 INFO:tasks.workunit.client.1.smithi110.stdout:8/686: sync 2024-04-12T13:42:12.945 INFO:tasks.workunit.client.0.smithi060.stdout:9/555: mkdir d4/d9/d19/d21/dbb 0 2024-04-12T13:42:12.945 INFO:tasks.workunit.client.1.smithi110.stdout:2/718: write d6/dc/d13/d80/d8d/dcc/d82/d84/f94 [278777,22227] 0 2024-04-12T13:42:12.948 INFO:tasks.workunit.client.0.smithi060.stdout:5/633: write d6/dd/d1f/d32/d46/f93 [581187,19926] 0 2024-04-12T13:42:12.948 INFO:tasks.workunit.client.0.smithi060.stdout:2/628: dwrite d6/f15 [0,4194304] 0 2024-04-12T13:42:12.950 INFO:tasks.workunit.client.1.smithi110.stdout:8/687: chown d1/d3/d35/d3a/d3e/d64/d85/d8d 0 1 2024-04-12T13:42:12.951 INFO:tasks.workunit.client.1.smithi110.stdout:4/763: truncate d0/d19/d1c/d50/d6f/db9/f8e 170957 0 2024-04-12T13:42:12.952 INFO:tasks.workunit.client.0.smithi060.stdout:1/756: mkdir d1e/d23/d2e/d86/ddb/d107 0 2024-04-12T13:42:12.955 INFO:tasks.workunit.client.0.smithi060.stdout:1/757: read - d1e/d29/d65/ff3 zero size 2024-04-12T13:42:12.956 INFO:tasks.workunit.client.1.smithi110.stdout:6/663: stat d7/ce 0 2024-04-12T13:42:12.957 INFO:tasks.workunit.client.0.smithi060.stdout:8/597: write d9/d1b/d37/d4d/f5a [739051,17314] 0 2024-04-12T13:42:12.957 INFO:tasks.workunit.client.1.smithi110.stdout:9/744: dwrite df/d13/d26/d37/f90 [0,4194304] 0 2024-04-12T13:42:12.958 INFO:tasks.workunit.client.1.smithi110.stdout:3/646: mkdir d5/dc/dcf 0 2024-04-12T13:42:12.960 INFO:tasks.workunit.client.0.smithi060.stdout:0/593: mkdir d7/d9/de/d80/dc8 0 2024-04-12T13:42:12.962 INFO:tasks.workunit.client.0.smithi060.stdout:6/694: mkdir d1/d7/da/dc/d24/d30/d52/d78/d80/de6 0 2024-04-12T13:42:12.963 INFO:tasks.workunit.client.0.smithi060.stdout:0/594: chown d7/c19 2 1 2024-04-12T13:42:12.964 INFO:tasks.workunit.client.0.smithi060.stdout:8/598: readlink d9/d1b/d37/d4d/d63/d66/db3/lab 0 2024-04-12T13:42:12.968 INFO:tasks.workunit.client.0.smithi060.stdout:9/556: dwrite d4/d8/f98 [0,4194304] 0 2024-04-12T13:42:12.968 INFO:tasks.workunit.client.1.smithi110.stdout:7/698: stat d1/d3/d4/d55/cb0 0 2024-04-12T13:42:12.969 INFO:tasks.workunit.client.0.smithi060.stdout:8/599: truncate d9/d1b/d37/d4d/f97 401465 0 2024-04-12T13:42:12.969 INFO:tasks.workunit.client.1.smithi110.stdout:5/656: rename da/d2e/d45/d25/d9d/d7a/db5/d8f/c80 to da/d2e/d45/d25/d9d/d79/dbe/ce2 0 2024-04-12T13:42:12.970 INFO:tasks.workunit.client.1.smithi110.stdout:2/719: creat d6/dc/d1b/d57/d62/dcb/fdd x:0 0 0 2024-04-12T13:42:12.971 INFO:tasks.workunit.client.1.smithi110.stdout:8/688: rmdir d1/d3/d35/d3a/d3e 39 2024-04-12T13:42:12.971 INFO:tasks.workunit.client.1.smithi110.stdout:4/764: mknod d0/d19/d8f/cf8 0 2024-04-12T13:42:12.972 INFO:tasks.workunit.client.0.smithi060.stdout:6/695: dread d1/d7/da/dc/d24/d30/d52/d5e/f72 [0,4194304] 0 2024-04-12T13:42:12.973 INFO:tasks.workunit.client.0.smithi060.stdout:7/601: link d0/d7/d43/d63/l66 d0/d7/d43/d63/d6f/lc6 0 2024-04-12T13:42:12.975 INFO:tasks.workunit.client.1.smithi110.stdout:3/647: truncate d5/dc/d31/d3b/d32/f65 716358 0 2024-04-12T13:42:12.976 INFO:tasks.workunit.client.0.smithi060.stdout:1/758: mknod d1e/d23/d2e/d30/d51/d85/c108 0 2024-04-12T13:42:12.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/557: stat d4/d9/d19/d21/d73/l90 0 2024-04-12T13:42:12.976 INFO:tasks.workunit.client.0.smithi060.stdout:6/696: chown d1/d7/da/dc/d24/d34 48949 1 2024-04-12T13:42:12.977 INFO:tasks.workunit.client.1.smithi110.stdout:2/720: dread - d6/dc/d6f/fda zero size 2024-04-12T13:42:12.978 INFO:tasks.workunit.client.0.smithi060.stdout:6/697: readlink d1/d7/da/dc/d24/d2d/db0/dc3/ld5 0 2024-04-12T13:42:12.982 INFO:tasks.workunit.client.0.smithi060.stdout:8/600: symlink d9/d1b/d84/ld4 0 2024-04-12T13:42:12.986 INFO:tasks.workunit.client.1.smithi110.stdout:6/664: mknod d7/da9/cd6 0 2024-04-12T13:42:12.986 INFO:tasks.workunit.client.0.smithi060.stdout:7/602: creat d0/d7/d92/fc7 x:0 0 0 2024-04-12T13:42:12.988 INFO:tasks.workunit.client.1.smithi110.stdout:1/668: dread de/d14/d83/fe4 [0,4194304] 0 2024-04-12T13:42:12.990 INFO:tasks.workunit.client.1.smithi110.stdout:5/657: dread - da/db/f4c zero size 2024-04-12T13:42:12.991 INFO:tasks.workunit.client.0.smithi060.stdout:2/629: write f4 [3517009,67448] 0 2024-04-12T13:42:12.997 INFO:tasks.workunit.client.1.smithi110.stdout:9/745: dread df/d13/d2c/d2d/dc1/d83/d5d/f7e [0,4194304] 0 2024-04-12T13:42:12.998 INFO:tasks.workunit.client.0.smithi060.stdout:8/601: truncate d9/d1d/d2f/f30 4882458 0 2024-04-12T13:42:12.999 INFO:tasks.workunit.client.1.smithi110.stdout:3/648: truncate d5/dc/d20/d2d/fb0 992369 0 2024-04-12T13:42:13.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/558: symlink d4/d9/d19/d21/dbb/lbc 0 2024-04-12T13:42:13.003 INFO:tasks.workunit.client.0.smithi060.stdout:5/634: dwrite d6/dd/d1f/d32/d46/f62 [4194304,4194304] 0 2024-04-12T13:42:13.004 INFO:tasks.workunit.client.1.smithi110.stdout:6/665: readlink d7/d25/d30/l51 0 2024-04-12T13:42:13.008 INFO:tasks.workunit.client.1.smithi110.stdout:8/689: write d1/d3/f24 [226215,76895] 0 2024-04-12T13:42:13.008 INFO:tasks.workunit.client.0.smithi060.stdout:8/602: dread d9/d1b/d37/d4d/f97 [0,4194304] 0 2024-04-12T13:42:13.008 INFO:tasks.workunit.client.0.smithi060.stdout:6/698: mknod d1/d7/da/dc/d24/d34/d51/d59/ce7 0 2024-04-12T13:42:13.010 INFO:tasks.workunit.client.0.smithi060.stdout:7/603: dread d0/d3d/f58 [0,4194304] 0 2024-04-12T13:42:13.011 INFO:tasks.workunit.client.0.smithi060.stdout:1/759: creat d1e/d29/f109 x:0 0 0 2024-04-12T13:42:13.012 INFO:tasks.workunit.client.1.smithi110.stdout:2/721: write d6/dc/dd/f47 [810080,71046] 0 2024-04-12T13:42:13.013 INFO:tasks.workunit.client.0.smithi060.stdout:7/604: fdatasync d0/d7/f33 0 2024-04-12T13:42:13.014 INFO:tasks.workunit.client.0.smithi060.stdout:1/760: write d1e/f28 [2049505,63632] 0 2024-04-12T13:42:13.020 INFO:tasks.workunit.client.0.smithi060.stdout:8/603: creat d9/d1d/d5e/fd5 x:0 0 0 2024-04-12T13:42:13.021 INFO:tasks.workunit.client.0.smithi060.stdout:2/630: dread d6/dae/d31/d33/f39 [0,4194304] 0 2024-04-12T13:42:13.022 INFO:tasks.workunit.client.1.smithi110.stdout:0/588: rename d1/d8/d36/d51/cb9 to d1/d27/cd0 0 2024-04-12T13:42:13.025 INFO:tasks.workunit.client.1.smithi110.stdout:0/589: dread - d1/d48/db2/d4a/fbb zero size 2024-04-12T13:42:13.027 INFO:tasks.workunit.client.1.smithi110.stdout:9/746: mknod df/d13/d2c/d2d/dc1/d83/d63/d72/cfc 0 2024-04-12T13:42:13.029 INFO:tasks.workunit.client.1.smithi110.stdout:5/658: write f5 [1239340,64808] 0 2024-04-12T13:42:13.030 INFO:tasks.workunit.client.1.smithi110.stdout:6/666: mkdir d7/d25/d30/d6b/dd7 0 2024-04-12T13:42:13.031 INFO:tasks.workunit.client.1.smithi110.stdout:1/669: dwrite de/d14/d34/d55/d6b/dc7/fd6 [0,4194304] 0 2024-04-12T13:42:13.032 INFO:tasks.workunit.client.1.smithi110.stdout:4/765: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:42:13.035 INFO:tasks.workunit.client.0.smithi060.stdout:5/635: getdents d6/d10/d12/d4c/da8 0 2024-04-12T13:42:13.036 INFO:tasks.workunit.client.1.smithi110.stdout:3/649: dread d5/dc/d20/d2d/d4e/f6d [0,4194304] 0 2024-04-12T13:42:13.039 INFO:tasks.workunit.client.0.smithi060.stdout:2/631: creat d6/d56/d86/fbc x:0 0 0 2024-04-12T13:42:13.044 INFO:tasks.workunit.client.1.smithi110.stdout:0/590: stat d1/d3c/d6b/d90/f9a 0 2024-04-12T13:42:13.045 INFO:tasks.workunit.client.1.smithi110.stdout:7/699: getdents d1/d3/d4/d36 0 2024-04-12T13:42:13.046 INFO:tasks.workunit.client.1.smithi110.stdout:9/747: dread - df/d13/d2c/d9e/dd6/fc2 zero size 2024-04-12T13:42:13.047 INFO:tasks.workunit.client.0.smithi060.stdout:6/699: dwrite d1/d7/da/dc/d24/d2d/f3d [4194304,4194304] 0 2024-04-12T13:42:13.047 INFO:tasks.workunit.client.0.smithi060.stdout:5/636: dread - d6/f99 zero size 2024-04-12T13:42:13.056 INFO:tasks.workunit.client.0.smithi060.stdout:1/761: dwrite d1e/d23/dd9/fc8 [0,4194304] 0 2024-04-12T13:42:13.062 INFO:tasks.workunit.client.1.smithi110.stdout:6/667: fdatasync d7/d25/d30/d44/f61 0 2024-04-12T13:42:13.062 INFO:tasks.workunit.client.1.smithi110.stdout:5/659: creat da/d2e/d45/d25/d9d/d79/d88/dd3/fe3 x:0 0 0 2024-04-12T13:42:13.065 INFO:tasks.workunit.client.1.smithi110.stdout:5/660: chown da/d35/f4e 2260 1 2024-04-12T13:42:13.065 INFO:tasks.workunit.client.0.smithi060.stdout:7/605: link d0/d78/la8 d0/d7/d43/d4d/lc8 0 2024-04-12T13:42:13.065 INFO:tasks.workunit.client.0.smithi060.stdout:9/559: getdents d4/d33/d50 0 2024-04-12T13:42:13.066 INFO:tasks.workunit.client.0.smithi060.stdout:2/632: write d6/d10/daa/db0/f52 [822111,117763] 0 2024-04-12T13:42:13.072 INFO:tasks.workunit.client.1.smithi110.stdout:2/722: mknod d6/dc/dd/d49/d64/d4a/d3c/d50/dd5/cde 0 2024-04-12T13:42:13.074 INFO:tasks.workunit.client.0.smithi060.stdout:7/606: chown d0/l2e 98587 1 2024-04-12T13:42:13.075 INFO:tasks.workunit.client.1.smithi110.stdout:9/748: mknod df/d13/d2c/d9e/dd6/dcf/cfd 0 2024-04-12T13:42:13.075 INFO:tasks.workunit.client.0.smithi060.stdout:8/604: getdents d9/d1d/d2f 0 2024-04-12T13:42:13.075 INFO:tasks.workunit.client.0.smithi060.stdout:7/607: chown d0/c51 25652 1 2024-04-12T13:42:13.076 INFO:tasks.workunit.client.1.smithi110.stdout:1/670: mkdir de/d1d/deb 0 2024-04-12T13:42:13.076 INFO:tasks.workunit.client.0.smithi060.stdout:5/637: symlink d6/dd/d1f/d25/ld2 0 2024-04-12T13:42:13.077 INFO:tasks.workunit.client.0.smithi060.stdout:7/608: readlink d0/d1b/l54 0 2024-04-12T13:42:13.079 INFO:tasks.workunit.client.0.smithi060.stdout:5/638: readlink d6/dd/d1f/d25/ld2 0 2024-04-12T13:42:13.080 INFO:tasks.workunit.client.0.smithi060.stdout:9/560: mkdir d4/d9/dbd 0 2024-04-12T13:42:13.081 INFO:tasks.workunit.client.1.smithi110.stdout:0/591: read d1/d27/d6e/fcf [2748805,101579] 0 2024-04-12T13:42:13.081 INFO:tasks.workunit.client.1.smithi110.stdout:3/650: rmdir d5/dc/d31/d74/d75/da7/dad 39 2024-04-12T13:42:13.082 INFO:tasks.workunit.client.1.smithi110.stdout:8/690: dwrite d1/d3/d35/d3a/d3e/d4f/f87 [0,4194304] 0 2024-04-12T13:42:13.082 INFO:tasks.workunit.client.1.smithi110.stdout:9/749: write df/d13/d2c/d2d/dc1/f5b [6725467,15328] 0 2024-04-12T13:42:13.083 INFO:tasks.workunit.client.1.smithi110.stdout:2/723: chown d6/dc/dd/d49/d64/d4a/d51/f2f 1 1 2024-04-12T13:42:13.085 INFO:tasks.workunit.client.0.smithi060.stdout:6/700: rename d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/c8c to d1/d7/ce8 0 2024-04-12T13:42:13.086 INFO:tasks.workunit.client.0.smithi060.stdout:8/605: creat d9/d1b/d37/d4d/d63/d66/fd6 x:0 0 0 2024-04-12T13:42:13.087 INFO:tasks.workunit.client.1.smithi110.stdout:0/592: dread - d1/d48/db2/d4a/f78 zero size 2024-04-12T13:42:13.088 INFO:tasks.workunit.client.0.smithi060.stdout:8/606: stat d9/d1b/d2b/f32 0 2024-04-12T13:42:13.091 INFO:tasks.workunit.client.1.smithi110.stdout:5/661: rename da/d2e/d45/d29/d66 to da/d2e/d45/d25/d9d/d7a/db5/d8f/de4 0 2024-04-12T13:42:13.093 INFO:tasks.workunit.client.1.smithi110.stdout:7/700: dwrite d1/d3/d4/d55/faa [0,4194304] 0 2024-04-12T13:42:13.093 INFO:tasks.workunit.client.1.smithi110.stdout:4/766: dwrite d0/d75/d84/d89/ff6 [0,4194304] 0 2024-04-12T13:42:13.098 INFO:tasks.workunit.client.1.smithi110.stdout:1/671: rmdir de/d15/d32/d61/d6a/d8b 39 2024-04-12T13:42:13.100 INFO:tasks.workunit.client.1.smithi110.stdout:8/691: mknod d1/d3/cdd 0 2024-04-12T13:42:13.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/701: dwrite d1/d7/da/dc/f3b [0,4194304] 0 2024-04-12T13:42:13.112 INFO:tasks.workunit.client.1.smithi110.stdout:9/750: mkdir df/d13/d26/d37/d6a/dfe 0 2024-04-12T13:42:13.113 INFO:tasks.workunit.client.0.smithi060.stdout:6/702: readlink d1/d7/da/dc/d24/d34/l95 0 2024-04-12T13:42:13.114 INFO:tasks.workunit.client.1.smithi110.stdout:5/662: dwrite da/d2e/d45/f1f [0,4194304] 0 2024-04-12T13:42:13.115 INFO:tasks.workunit.client.1.smithi110.stdout:6/668: truncate d7/d25/d30/d44/d3d/f49 2186479 0 2024-04-12T13:42:13.121 INFO:tasks.workunit.client.1.smithi110.stdout:0/593: creat d1/d5e/fd1 x:0 0 0 2024-04-12T13:42:13.124 INFO:tasks.workunit.client.1.smithi110.stdout:2/724: symlink d6/dc/d13/ldf 0 2024-04-12T13:42:13.127 INFO:tasks.workunit.client.1.smithi110.stdout:6/669: fsync d7/d10/f35 0 2024-04-12T13:42:13.128 INFO:tasks.workunit.client.1.smithi110.stdout:5/663: creat da/d2e/d45/d25/d9d/d7a/dae/fe5 x:0 0 0 2024-04-12T13:42:13.129 INFO:tasks.workunit.client.1.smithi110.stdout:6/670: chown l6 53977122 1 2024-04-12T13:42:13.136 INFO:tasks.workunit.client.1.smithi110.stdout:3/651: dwrite d5/d86/f93 [0,4194304] 0 2024-04-12T13:42:13.141 INFO:tasks.workunit.client.1.smithi110.stdout:2/725: fdatasync d6/dc/dd/d49/d64/d4a/d51/f2f 0 2024-04-12T13:42:13.143 INFO:tasks.workunit.client.1.smithi110.stdout:0/594: symlink d1/d27/ld2 0 2024-04-12T13:42:13.148 INFO:tasks.workunit.client.1.smithi110.stdout:7/701: rmdir d1/d3/d4/d55/d56/de5 0 2024-04-12T13:42:13.156 INFO:tasks.workunit.client.1.smithi110.stdout:3/652: write d5/f40 [2298681,83976] 0 2024-04-12T13:42:13.157 INFO:tasks.workunit.client.1.smithi110.stdout:9/751: dread df/d8a/f8e [0,4194304] 0 2024-04-12T13:42:13.161 INFO:tasks.workunit.client.0.smithi060.stdout:1/762: rename d1e/d23/d2e/l97 to d1e/d23/d2e/d30/d51/d85/deb/l10a 0 2024-04-12T13:42:13.167 INFO:tasks.workunit.client.1.smithi110.stdout:7/702: rmdir d1/d3/d4/da6 39 2024-04-12T13:42:13.170 INFO:tasks.workunit.client.1.smithi110.stdout:4/767: write d0/de/f24 [1238860,63373] 0 2024-04-12T13:42:13.172 INFO:tasks.workunit.client.1.smithi110.stdout:3/653: fsync d5/dc/d31/d3b/d32/d3e/f44 0 2024-04-12T13:42:13.173 INFO:tasks.workunit.client.1.smithi110.stdout:2/726: dread d6/dc/d1b/d8f/faa [0,4194304] 0 2024-04-12T13:42:13.175 INFO:tasks.workunit.client.1.smithi110.stdout:4/768: write d0/de/da0/fde [516812,20136] 0 2024-04-12T13:42:13.176 INFO:tasks.workunit.client.0.smithi060.stdout:2/633: rename d6/dae/d31/d33/d3d to d6/d10/d81/dbd 0 2024-04-12T13:42:13.177 INFO:tasks.workunit.client.1.smithi110.stdout:5/664: link da/db/d3b/cc6 da/d2e/d45/d25/d9d/d7a/ce6 0 2024-04-12T13:42:13.178 INFO:tasks.workunit.client.0.smithi060.stdout:2/634: stat d6/d56/d58/da0/f3c 0 2024-04-12T13:42:13.181 INFO:tasks.workunit.client.1.smithi110.stdout:7/703: creat d1/d3/d4/dbf/fe8 x:0 0 0 2024-04-12T13:42:13.185 INFO:tasks.workunit.client.0.smithi060.stdout:7/609: rename d0/d7/d88 to d0/d7/da9/dc9 0 2024-04-12T13:42:13.186 INFO:tasks.workunit.client.1.smithi110.stdout:0/595: dread d1/d8/d36/d51/d60/f41 [0,4194304] 0 2024-04-12T13:42:13.187 INFO:tasks.workunit.client.0.smithi060.stdout:1/763: mknod d1e/d23/d49/c10b 0 2024-04-12T13:42:13.191 INFO:tasks.workunit.client.1.smithi110.stdout:2/727: dwrite d6/dc/d13/d80/d8d/dcc/f68 [0,4194304] 0 2024-04-12T13:42:13.192 INFO:tasks.workunit.client.0.smithi060.stdout:9/561: write d4/d9/d19/d21/d73/d67/f39 [428193,114746] 0 2024-04-12T13:42:13.197 INFO:tasks.workunit.client.0.smithi060.stdout:5/639: rename d6/dd/d1f/d25/d35/d50 to d6/dd/d1f/dd3 0 2024-04-12T13:42:13.199 INFO:tasks.workunit.client.1.smithi110.stdout:7/704: symlink d1/d3/d4/d36/d76/le9 0 2024-04-12T13:42:13.200 INFO:tasks.workunit.client.0.smithi060.stdout:5/640: chown d6/dd/d1f/d25/ld2 497858 1 2024-04-12T13:42:13.201 INFO:tasks.workunit.client.1.smithi110.stdout:0/596: creat d1/d48/db2/d4a/fd3 x:0 0 0 2024-04-12T13:42:13.202 INFO:tasks.workunit.client.1.smithi110.stdout:0/597: fdatasync d1/d5e/fb3 0 2024-04-12T13:42:13.203 INFO:tasks.workunit.client.0.smithi060.stdout:8/607: dwrite d9/d1b/d3c/f92 [0,4194304] 0 2024-04-12T13:42:13.205 INFO:tasks.workunit.client.1.smithi110.stdout:7/705: creat d1/d3/d4/dbf/db6/fea x:0 0 0 2024-04-12T13:42:13.206 INFO:tasks.workunit.client.0.smithi060.stdout:8/608: read - d9/d1b/d3c/d6e/d7b/fca zero size 2024-04-12T13:42:13.206 INFO:tasks.workunit.client.1.smithi110.stdout:3/654: getdents d5/dc/d31/d74 0 2024-04-12T13:42:13.207 INFO:tasks.workunit.client.0.smithi060.stdout:7/610: rmdir d0/d1b/da4/da5 0 2024-04-12T13:42:13.209 INFO:tasks.workunit.client.1.smithi110.stdout:5/665: getdents da/db/d3b/d40/da2 0 2024-04-12T13:42:13.211 INFO:tasks.workunit.client.1.smithi110.stdout:0/598: rename d1/d48/fc9 to d1/d27/d31/d67/dcb/fd4 0 2024-04-12T13:42:13.213 INFO:tasks.workunit.client.0.smithi060.stdout:2/635: dread d6/d10/daa/db0/f94 [0,4194304] 0 2024-04-12T13:42:13.213 INFO:tasks.workunit.client.1.smithi110.stdout:9/752: write df/d38/db3/fc8 [213742,79561] 0 2024-04-12T13:42:13.214 INFO:tasks.workunit.client.1.smithi110.stdout:5/666: dread - da/d2e/d45/d25/d9d/d79/fd0 zero size 2024-04-12T13:42:13.217 INFO:tasks.workunit.client.1.smithi110.stdout:3/655: rmdir d5/dc/d31/d3b/d32/d3e/d5f 39 2024-04-12T13:42:13.217 INFO:tasks.workunit.client.1.smithi110.stdout:0/599: chown d1/d27/d31/f64 28 1 2024-04-12T13:42:13.218 INFO:tasks.workunit.client.1.smithi110.stdout:0/600: stat d1/d5e 0 2024-04-12T13:42:13.219 INFO:tasks.workunit.client.0.smithi060.stdout:5/641: getdents d6/d10/db8 0 2024-04-12T13:42:13.222 INFO:tasks.workunit.client.0.smithi060.stdout:6/703: dwrite d1/d7/da/dc/d24/f37 [0,4194304] 0 2024-04-12T13:42:13.222 INFO:tasks.workunit.client.1.smithi110.stdout:7/706: rename d1/d3/d4/d55/d56/c87 to d1/d1b/d74/ceb 0 2024-04-12T13:42:13.225 INFO:tasks.workunit.client.0.smithi060.stdout:2/636: chown d6/d56/d55/l9c 116492 1 2024-04-12T13:42:13.229 INFO:tasks.workunit.client.1.smithi110.stdout:0/601: creat d1/d27/d31/fd5 x:0 0 0 2024-04-12T13:42:13.231 INFO:tasks.workunit.client.1.smithi110.stdout:9/753: rename df/d13/d26/d37/f90 to df/d38/d6e/dcb/fff 0 2024-04-12T13:42:13.235 INFO:tasks.workunit.client.0.smithi060.stdout:7/611: getdents d0/d3d 0 2024-04-12T13:42:13.236 INFO:tasks.workunit.client.0.smithi060.stdout:9/562: truncate d4/d8/fb 2372756 0 2024-04-12T13:42:13.237 INFO:tasks.workunit.client.1.smithi110.stdout:0/602: fdatasync d1/d8/d36/d65/f6c 0 2024-04-12T13:42:13.240 INFO:tasks.workunit.client.0.smithi060.stdout:7/612: fsync d0/f64 0 2024-04-12T13:42:13.240 INFO:tasks.workunit.client.0.smithi060.stdout:5/642: dread d6/dd/d1f/d25/d42/d52/f75 [0,4194304] 0 2024-04-12T13:42:13.240 INFO:tasks.workunit.client.1.smithi110.stdout:7/707: rename d1/d1b/d74/ca8 to d1/d3/d4/da6/cec 0 2024-04-12T13:42:13.241 INFO:tasks.workunit.client.1.smithi110.stdout:4/769: dwrite d0/d19/f2e [0,4194304] 0 2024-04-12T13:42:13.242 INFO:tasks.workunit.client.0.smithi060.stdout:7/613: chown d0/d78/da0/fb8 184871364 1 2024-04-12T13:42:13.242 INFO:tasks.workunit.client.1.smithi110.stdout:1/672: sync 2024-04-12T13:42:13.243 INFO:tasks.workunit.client.0.smithi060.stdout:2/637: creat d6/dae/d5b/fbe x:0 0 0 2024-04-12T13:42:13.247 INFO:tasks.workunit.client.1.smithi110.stdout:5/667: dwrite da/db/f4a [0,4194304] 0 2024-04-12T13:42:13.247 INFO:tasks.workunit.client.1.smithi110.stdout:2/728: dread d6/dc/dd/d49/f7d [0,4194304] 0 2024-04-12T13:42:13.251 INFO:tasks.workunit.client.0.smithi060.stdout:8/609: truncate d9/d1d/f6f 482485 0 2024-04-12T13:42:13.252 INFO:tasks.workunit.client.1.smithi110.stdout:9/754: mknod df/d13/d2c/d9e/dd6/da3/dab/c100 0 2024-04-12T13:42:13.253 INFO:tasks.workunit.client.0.smithi060.stdout:6/704: write d1/d7/da/dc/d24/f37 [5127146,126525] 0 2024-04-12T13:42:13.255 INFO:tasks.workunit.client.1.smithi110.stdout:0/603: creat d1/d3c/fd6 x:0 0 0 2024-04-12T13:42:13.261 INFO:tasks.workunit.client.1.smithi110.stdout:7/708: mknod d1/d1b/d3d/d68/d97/ced 0 2024-04-12T13:42:13.262 INFO:tasks.workunit.client.1.smithi110.stdout:3/656: dread d5/f99 [0,4194304] 0 2024-04-12T13:42:13.264 INFO:tasks.workunit.client.1.smithi110.stdout:7/709: dread - d1/d3/d4/dbf/db6/fea zero size 2024-04-12T13:42:13.264 INFO:tasks.workunit.client.1.smithi110.stdout:2/729: dread d6/dc/dd/d49/d64/d4a/d51/f2f [0,4194304] 0 2024-04-12T13:42:13.266 INFO:tasks.workunit.client.0.smithi060.stdout:5/643: mknod d6/dd/d1f/d32/d3d/cd4 0 2024-04-12T13:42:13.266 INFO:tasks.workunit.client.1.smithi110.stdout:5/668: truncate da/d2e/d45/d25/d9d/d79/d88/dd3/f7d 697968 0 2024-04-12T13:42:13.267 INFO:tasks.workunit.client.1.smithi110.stdout:1/673: truncate de/fe7 747778 0 2024-04-12T13:42:13.267 INFO:tasks.workunit.client.0.smithi060.stdout:2/638: dwrite d6/d64/d99/f9e [0,4194304] 0 2024-04-12T13:42:13.272 INFO:tasks.workunit.client.0.smithi060.stdout:7/614: dwrite d0/d7/f5e [0,4194304] 0 2024-04-12T13:42:13.272 INFO:tasks.workunit.client.0.smithi060.stdout:8/610: symlink d9/d1b/d2b/d82/d8a/ld7 0 2024-04-12T13:42:13.274 INFO:tasks.workunit.client.0.smithi060.stdout:9/563: write d4/d9/d19/d21/d73/d67/f5e [6932946,29873] 0 2024-04-12T13:42:13.274 INFO:tasks.workunit.client.0.smithi060.stdout:8/611: readlink d9/d1b/d84/da0/lf 0 2024-04-12T13:42:13.276 INFO:tasks.workunit.client.1.smithi110.stdout:3/657: dread d5/d86/f93 [0,4194304] 0 2024-04-12T13:42:13.276 INFO:tasks.workunit.client.0.smithi060.stdout:7/615: stat d0/d1b/f72 0 2024-04-12T13:42:13.277 INFO:tasks.workunit.client.1.smithi110.stdout:9/755: mknod df/d13/d2c/d2d/dc1/d83/d63/d72/c101 0 2024-04-12T13:42:13.278 INFO:tasks.workunit.client.0.smithi060.stdout:4/638: sync 2024-04-12T13:42:13.284 INFO:tasks.workunit.client.1.smithi110.stdout:3/658: truncate d5/dc/d31/d3b/d32/d3e/d98/f9e 732416 0 2024-04-12T13:42:13.287 INFO:tasks.workunit.client.1.smithi110.stdout:6/671: sync 2024-04-12T13:42:13.287 INFO:tasks.workunit.client.1.smithi110.stdout:8/692: sync 2024-04-12T13:42:13.291 INFO:tasks.workunit.client.0.smithi060.stdout:2/639: symlink d6/d10/d16/lbf 0 2024-04-12T13:42:13.293 INFO:tasks.workunit.client.1.smithi110.stdout:6/672: truncate d7/d10/f62 3656413 0 2024-04-12T13:42:13.294 INFO:tasks.workunit.client.1.smithi110.stdout:7/710: stat d1/d3/f6d 0 2024-04-12T13:42:13.295 INFO:tasks.workunit.client.0.smithi060.stdout:5/644: truncate d6/dd/d1f/d25/d42/d52/f75 478923 0 2024-04-12T13:42:13.295 INFO:tasks.workunit.client.1.smithi110.stdout:4/770: dwrite d0/d19/d1c/fe4 [0,4194304] 0 2024-04-12T13:42:13.296 INFO:tasks.workunit.client.0.smithi060.stdout:4/639: dread d6/d7/dd/df/f20 [0,4194304] 0 2024-04-12T13:42:13.298 INFO:tasks.workunit.client.1.smithi110.stdout:4/771: chown d0/de/da0/dd9/df3/de0/fb3 0 1 2024-04-12T13:42:13.299 INFO:tasks.workunit.client.0.smithi060.stdout:5/645: chown d6/dd/d1f/d32/da2 809 1 2024-04-12T13:42:13.307 INFO:tasks.workunit.client.0.smithi060.stdout:7/616: dwrite d0/d7/da9/dc9/db1/fc1 [0,4194304] 0 2024-04-12T13:42:13.309 INFO:tasks.workunit.client.0.smithi060.stdout:7/617: chown d0/d7 757819656 1 2024-04-12T13:42:13.309 INFO:tasks.workunit.client.1.smithi110.stdout:6/673: dwrite d7/d25/dc6/fca [0,4194304] 0 2024-04-12T13:42:13.310 INFO:tasks.workunit.client.0.smithi060.stdout:6/705: creat d1/d7/da/dc/d24/d2d/db0/db2/fe9 x:0 0 0 2024-04-12T13:42:13.313 INFO:tasks.workunit.client.0.smithi060.stdout:8/612: dread f2 [0,4194304] 0 2024-04-12T13:42:13.313 INFO:tasks.workunit.client.1.smithi110.stdout:1/674: rename de/d14/l93 to de/d15/dab/dd8/dd9/dda/lec 0 2024-04-12T13:42:13.315 INFO:tasks.workunit.client.1.smithi110.stdout:1/675: fsync de/d15/fc4 0 2024-04-12T13:42:13.315 INFO:tasks.workunit.client.1.smithi110.stdout:6/674: write d7/da4/fbb [978219,23139] 0 2024-04-12T13:42:13.318 INFO:tasks.workunit.client.1.smithi110.stdout:9/756: creat df/d38/f102 x:0 0 0 2024-04-12T13:42:13.320 INFO:tasks.workunit.client.1.smithi110.stdout:1/676: write de/d14/d34/d55/d6b/dc7/fdd [416040,84313] 0 2024-04-12T13:42:13.324 INFO:tasks.workunit.client.1.smithi110.stdout:9/757: write df/d13/d26/d37/fae [2102432,57276] 0 2024-04-12T13:42:13.326 INFO:tasks.workunit.client.1.smithi110.stdout:1/677: readlink de/d15/d32/d61/d96/ld5 0 2024-04-12T13:42:13.330 INFO:tasks.workunit.client.1.smithi110.stdout:1/678: write de/d14/d83/fb6 [736597,104239] 0 2024-04-12T13:42:13.331 INFO:tasks.workunit.client.0.smithi060.stdout:9/564: dwrite d4/d33/d65/f91 [0,4194304] 0 2024-04-12T13:42:13.334 INFO:tasks.workunit.client.1.smithi110.stdout:8/693: mknod d1/d3/dbe/dd1/cde 0 2024-04-12T13:42:13.335 INFO:tasks.workunit.client.0.smithi060.stdout:6/706: creat d1/d7d/fea x:0 0 0 2024-04-12T13:42:13.337 INFO:tasks.workunit.client.1.smithi110.stdout:0/604: dwrite d1/d8/d36/d65/f84 [0,4194304] 0 2024-04-12T13:42:13.338 INFO:tasks.workunit.client.1.smithi110.stdout:4/772: creat d0/d19/d1c/d50/d6f/ff9 x:0 0 0 2024-04-12T13:42:13.339 INFO:tasks.workunit.client.0.smithi060.stdout:7/618: mknod d0/d1b/d8c/cca 0 2024-04-12T13:42:13.339 INFO:tasks.workunit.client.1.smithi110.stdout:5/669: dwrite da/d2e/d45/d25/d9d/d79/d88/db0/fd2 [0,4194304] 0 2024-04-12T13:42:13.344 INFO:tasks.workunit.client.0.smithi060.stdout:2/640: mknod d6/d10/cc0 0 2024-04-12T13:42:13.344 INFO:tasks.workunit.client.1.smithi110.stdout:0/605: dread - d1/d27/d31/fd5 zero size 2024-04-12T13:42:13.347 INFO:tasks.workunit.client.0.smithi060.stdout:2/641: fsync d6/d10/d2b/d60/fa2 0 2024-04-12T13:42:13.350 INFO:tasks.workunit.client.1.smithi110.stdout:7/711: rename d1/d3/d4/d36/da1/cdf to d1/d3/d4/d55/d56/d72/cee 0 2024-04-12T13:42:13.350 INFO:tasks.workunit.client.1.smithi110.stdout:0/606: stat d1/d27/d31/f64 0 2024-04-12T13:42:13.353 INFO:tasks.workunit.client.1.smithi110.stdout:0/607: chown d1/d8/f34 0 1 2024-04-12T13:42:13.353 INFO:tasks.workunit.client.1.smithi110.stdout:2/730: dwrite d6/f48 [0,4194304] 0 2024-04-12T13:42:13.354 INFO:tasks.workunit.client.0.smithi060.stdout:2/642: truncate d6/d56/d55/fa4 220614 0 2024-04-12T13:42:13.356 INFO:tasks.workunit.client.1.smithi110.stdout:6/675: creat d7/da9/fd8 x:0 0 0 2024-04-12T13:42:13.358 INFO:tasks.workunit.client.0.smithi060.stdout:9/565: symlink d4/d9/d19/d21/d73/lbe 0 2024-04-12T13:42:13.358 INFO:tasks.workunit.client.1.smithi110.stdout:0/608: truncate d1/d48/db2/d4a/f4f 979814 0 2024-04-12T13:42:13.362 INFO:tasks.workunit.client.1.smithi110.stdout:9/758: read df/d13/f1b [609631,104218] 0 2024-04-12T13:42:13.364 INFO:tasks.workunit.client.0.smithi060.stdout:6/707: truncate d1/d7/da/dc/d24/d34/d51/d59/d94/fc5 437329 0 2024-04-12T13:42:13.369 INFO:tasks.workunit.client.1.smithi110.stdout:3/659: write d5/dc/d31/d3b/d32/d3e/f44 [1412114,20622] 0 2024-04-12T13:42:13.372 INFO:tasks.workunit.client.1.smithi110.stdout:8/694: creat d1/d3/d3c/d5a/d6f/d7e/fdf x:0 0 0 2024-04-12T13:42:13.374 INFO:tasks.workunit.client.1.smithi110.stdout:4/773: mkdir d0/de/da0/dd9/df3/de0/dfa 0 2024-04-12T13:42:13.375 INFO:tasks.workunit.client.0.smithi060.stdout:2/643: dwrite d6/d10/d2b/d60/f93 [0,4194304] 0 2024-04-12T13:42:13.375 INFO:tasks.workunit.client.0.smithi060.stdout:7/619: symlink d0/lcb 0 2024-04-12T13:42:13.376 INFO:tasks.workunit.client.1.smithi110.stdout:5/670: dread da/db/d15/f1b [0,4194304] 0 2024-04-12T13:42:13.379 INFO:tasks.workunit.client.0.smithi060.stdout:2/644: chown d6/d10/d81/dbd 230791 1 2024-04-12T13:42:13.379 INFO:tasks.workunit.client.1.smithi110.stdout:5/671: write da/d2e/d45/d25/d9d/d7a/db5/d8f/fc7 [694203,64063] 0 2024-04-12T13:42:13.384 INFO:tasks.workunit.client.1.smithi110.stdout:8/695: dread d1/d5/dd/fa0 [0,4194304] 0 2024-04-12T13:42:13.385 INFO:tasks.workunit.client.1.smithi110.stdout:7/712: rename d1/d3/d4/f9b to d1/d1b/d70/fef 0 2024-04-12T13:42:13.386 INFO:tasks.workunit.client.1.smithi110.stdout:8/696: fsync d1/d3/d35/d3a/d41/d77/fd3 0 2024-04-12T13:42:13.387 INFO:tasks.workunit.client.0.smithi060.stdout:5/646: link d6/dd/d1f/d25/d53/d87/l65 d6/dd/d1f/d25/d35/ld5 0 2024-04-12T13:42:13.387 INFO:tasks.workunit.client.0.smithi060.stdout:8/613: write d9/d1b/f47 [1604961,64484] 0 2024-04-12T13:42:13.388 INFO:tasks.workunit.client.1.smithi110.stdout:6/676: readlink d7/l22 0 2024-04-12T13:42:13.388 INFO:tasks.workunit.client.0.smithi060.stdout:3/687: sync 2024-04-12T13:42:13.389 INFO:tasks.workunit.client.1.smithi110.stdout:8/697: write d1/d3/d3c/f33 [1029771,92236] 0 2024-04-12T13:42:13.392 INFO:tasks.workunit.client.1.smithi110.stdout:2/731: creat d6/d53/fe0 x:0 0 0 2024-04-12T13:42:13.393 INFO:tasks.workunit.client.1.smithi110.stdout:2/732: dread - d6/d53/fe0 zero size 2024-04-12T13:42:13.394 INFO:tasks.workunit.client.1.smithi110.stdout:9/759: creat df/d13/d2c/d2d/d94/f103 x:0 0 0 2024-04-12T13:42:13.395 INFO:tasks.workunit.client.1.smithi110.stdout:2/733: stat d6/dc/d1b/d8f/d9c 0 2024-04-12T13:42:13.401 INFO:tasks.workunit.client.0.smithi060.stdout:6/708: truncate d1/d7/da/dc/f19 841814 0 2024-04-12T13:42:13.404 INFO:tasks.workunit.client.0.smithi060.stdout:2/645: dwrite d6/d10/d2b/f9a [0,4194304] 0 2024-04-12T13:42:13.405 INFO:tasks.workunit.client.0.smithi060.stdout:8/614: symlink d9/d1b/d2b/ld8 0 2024-04-12T13:42:13.406 INFO:tasks.workunit.client.0.smithi060.stdout:4/640: dwrite d6/d7/db/dc8/fca [0,4194304] 0 2024-04-12T13:42:13.413 INFO:tasks.workunit.client.1.smithi110.stdout:5/672: truncate da/d2e/d45/d25/d9d/d79/d88/f95 281031 0 2024-04-12T13:42:13.418 INFO:tasks.workunit.client.0.smithi060.stdout:3/688: unlink d7/d17/d19/d96/fa1 0 2024-04-12T13:42:13.418 INFO:tasks.workunit.client.1.smithi110.stdout:7/713: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:42:13.418 INFO:tasks.workunit.client.1.smithi110.stdout:6/677: rmdir d7/d25 39 2024-04-12T13:42:13.422 INFO:tasks.workunit.client.0.smithi060.stdout:6/709: chown d1/d7d/cde 126961 1 2024-04-12T13:42:13.422 INFO:tasks.workunit.client.0.smithi060.stdout:3/689: write d7/d17/d19/f1f [2193349,92842] 0 2024-04-12T13:42:13.426 INFO:tasks.workunit.client.1.smithi110.stdout:9/760: rmdir df/d13/d2c/d2d/d94 39 2024-04-12T13:42:13.427 INFO:tasks.workunit.client.0.smithi060.stdout:9/566: dread d4/d9/d19/d21/f66 [0,4194304] 0 2024-04-12T13:42:13.428 INFO:tasks.workunit.client.0.smithi060.stdout:8/615: mkdir d9/d1b/d37/d4d/d63/d66/dd9 0 2024-04-12T13:42:13.431 INFO:tasks.workunit.client.0.smithi060.stdout:2/646: rename d6/d10/d16/lbf to d6/d56/d55/lc1 0 2024-04-12T13:42:13.434 INFO:tasks.workunit.client.0.smithi060.stdout:4/641: write d6/d2f/d51/f71 [2813896,8342] 0 2024-04-12T13:42:13.435 INFO:tasks.workunit.client.1.smithi110.stdout:6/678: dwrite d7/d10/d7e/fb5 [0,4194304] 0 2024-04-12T13:42:13.436 INFO:tasks.workunit.client.0.smithi060.stdout:7/620: link d0/d7/d43/d4d/l7d d0/d7/d92/lcc 0 2024-04-12T13:42:13.437 INFO:tasks.workunit.client.1.smithi110.stdout:5/673: symlink da/d2e/d45/d25/d9d/d7a/dae/le7 0 2024-04-12T13:42:13.441 INFO:tasks.workunit.client.1.smithi110.stdout:7/714: dread d1/d3/d4/dbf/f95 [0,4194304] 0 2024-04-12T13:42:13.445 INFO:tasks.workunit.client.1.smithi110.stdout:0/609: rename d1/d8/d36/c47 to d1/d27/d6e/cd7 0 2024-04-12T13:42:13.446 INFO:tasks.workunit.client.1.smithi110.stdout:9/761: dwrite df/d13/d2c/d2d/dc1/f5b [0,4194304] 0 2024-04-12T13:42:13.449 INFO:tasks.workunit.client.0.smithi060.stdout:1/764: sync 2024-04-12T13:42:13.449 INFO:tasks.workunit.client.0.smithi060.stdout:0/595: sync 2024-04-12T13:42:13.449 INFO:tasks.workunit.client.0.smithi060.stdout:5/647: link d6/dd/d1f/c63 d6/d10/db8/cd6 0 2024-04-12T13:42:13.450 INFO:tasks.workunit.client.1.smithi110.stdout:0/610: dread d1/f26 [0,4194304] 0 2024-04-12T13:42:13.453 INFO:tasks.workunit.client.1.smithi110.stdout:8/698: creat d1/d3/d35/d3a/d3e/d64/d85/dc2/fe0 x:0 0 0 2024-04-12T13:42:13.454 INFO:tasks.workunit.client.0.smithi060.stdout:6/710: symlink d1/d7/da/dc/d7a/leb 0 2024-04-12T13:42:13.456 INFO:tasks.workunit.client.1.smithi110.stdout:2/734: getdents d6/dc/dd/d49/d64/d4a/d51 0 2024-04-12T13:42:13.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/616: fdatasync d9/d1b/d37/d4d/f97 0 2024-04-12T13:42:13.456 INFO:tasks.workunit.client.0.smithi060.stdout:6/711: fsync d1/d7/da/dc/d24/d30/d52/f81 0 2024-04-12T13:42:13.458 INFO:tasks.workunit.client.0.smithi060.stdout:6/712: chown d1/d7/l1c 28833402 1 2024-04-12T13:42:13.458 INFO:tasks.workunit.client.0.smithi060.stdout:8/617: chown d9/d1b/d3c/f56 191036441 1 2024-04-12T13:42:13.458 INFO:tasks.workunit.client.1.smithi110.stdout:2/735: truncate d6/d53/fc8 729331 0 2024-04-12T13:42:13.459 INFO:tasks.workunit.client.0.smithi060.stdout:2/647: creat d6/d10/d81/dbd/fc2 x:0 0 0 2024-04-12T13:42:13.460 INFO:tasks.workunit.client.1.smithi110.stdout:1/679: getdents de/d14/d34 0 2024-04-12T13:42:13.463 INFO:tasks.workunit.client.0.smithi060.stdout:4/642: stat d6/d2f/c59 0 2024-04-12T13:42:13.464 INFO:tasks.workunit.client.1.smithi110.stdout:7/715: mknod d1/d3/d4/dbf/db6/cf0 0 2024-04-12T13:42:13.466 INFO:tasks.workunit.client.0.smithi060.stdout:7/621: chown d0/d7/l2b 7 1 2024-04-12T13:42:13.471 INFO:tasks.workunit.client.0.smithi060.stdout:5/648: creat d6/dd/d27/d7d/fd7 x:0 0 0 2024-04-12T13:42:13.472 INFO:tasks.workunit.client.1.smithi110.stdout:0/611: mkdir d1/d3c/dd8 0 2024-04-12T13:42:13.473 INFO:tasks.workunit.client.0.smithi060.stdout:9/567: mkdir d4/d9/d19/d21/dbf 0 2024-04-12T13:42:13.475 INFO:tasks.workunit.client.0.smithi060.stdout:4/643: dread d6/f70 [0,4194304] 0 2024-04-12T13:42:13.477 INFO:tasks.workunit.client.0.smithi060.stdout:5/649: write d6/dd/d1f/dd3/d5f/f9b [2307477,24305] 0 2024-04-12T13:42:13.479 INFO:tasks.workunit.client.0.smithi060.stdout:8/618: creat d9/d1b/d37/d4d/d63/d66/db3/fda x:0 0 0 2024-04-12T13:42:13.479 INFO:tasks.workunit.client.0.smithi060.stdout:6/713: dwrite d1/d7/da/dc/d24/d30/d52/d5e/fbb [0,4194304] 0 2024-04-12T13:42:13.482 INFO:tasks.workunit.client.0.smithi060.stdout:8/619: readlink d9/d1b/d37/d48/l73 0 2024-04-12T13:42:13.483 INFO:tasks.workunit.client.1.smithi110.stdout:1/680: dread de/d15/f31 [0,4194304] 0 2024-04-12T13:42:13.486 INFO:tasks.workunit.client.1.smithi110.stdout:3/660: rename d5/dc/f27 to d5/dc/d20/d2d/d4e/d89/d8c/db6/fd0 0 2024-04-12T13:42:13.487 INFO:tasks.workunit.client.0.smithi060.stdout:8/620: truncate d9/d1b/d37/d4d/f97 1213186 0 2024-04-12T13:42:13.489 INFO:tasks.workunit.client.0.smithi060.stdout:3/690: creat d7/d17/fe3 x:0 0 0 2024-04-12T13:42:13.490 INFO:tasks.workunit.client.0.smithi060.stdout:8/621: stat d9/d1b/d84/da0/lf 0 2024-04-12T13:42:13.494 INFO:tasks.workunit.client.1.smithi110.stdout:0/612: dread - d1/d48/db2/d4a/f72 zero size 2024-04-12T13:42:13.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/765: mknod d1e/d23/dd9/dae/c10c 0 2024-04-12T13:42:13.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/622: dread d0/d3d/f7c [0,4194304] 0 2024-04-12T13:42:13.499 INFO:tasks.workunit.client.1.smithi110.stdout:8/699: dread d1/d5/d1f/f56 [0,4194304] 0 2024-04-12T13:42:13.500 INFO:tasks.workunit.client.1.smithi110.stdout:1/681: unlink de/d14/d34/d55/c5d 0 2024-04-12T13:42:13.500 INFO:tasks.workunit.client.1.smithi110.stdout:8/700: chown d1/d5/d1f/l2d 4408055 1 2024-04-12T13:42:13.501 INFO:tasks.workunit.client.0.smithi060.stdout:7/623: chown d0/d1b 170988 1 2024-04-12T13:42:13.501 INFO:tasks.workunit.client.1.smithi110.stdout:3/661: dwrite d5/f40 [0,4194304] 0 2024-04-12T13:42:13.502 INFO:tasks.workunit.client.0.smithi060.stdout:7/624: stat d0/c81 0 2024-04-12T13:42:13.502 INFO:tasks.workunit.client.1.smithi110.stdout:8/701: chown d1/d5/cbc 491 1 2024-04-12T13:42:13.503 INFO:tasks.workunit.client.0.smithi060.stdout:0/596: link d7/fa3 d7/d9/de/d80/d8b/fc9 0 2024-04-12T13:42:13.507 INFO:tasks.workunit.client.0.smithi060.stdout:2/648: write d6/f1b [171886,81768] 0 2024-04-12T13:42:13.511 INFO:tasks.workunit.client.1.smithi110.stdout:6/679: truncate d7/d10/d1c/d2b/d48/d4b/f94 2183473 0 2024-04-12T13:42:13.512 INFO:tasks.workunit.client.0.smithi060.stdout:3/691: dwrite d7/d17/d19/dc9/fa9 [0,4194304] 0 2024-04-12T13:42:13.518 INFO:tasks.workunit.client.1.smithi110.stdout:9/762: link df/d38/fdf df/d13/d2c/d2d/dc1/d83/f104 0 2024-04-12T13:42:13.521 INFO:tasks.workunit.client.0.smithi060.stdout:4/644: creat d6/d21/d88/fd6 x:0 0 0 2024-04-12T13:42:13.524 INFO:tasks.workunit.client.0.smithi060.stdout:5/650: mknod d6/d89/cd8 0 2024-04-12T13:42:13.527 INFO:tasks.workunit.client.1.smithi110.stdout:8/702: mkdir d1/d3/d35/d3a/d3e/d64/d85/de1 0 2024-04-12T13:42:13.532 INFO:tasks.workunit.client.0.smithi060.stdout:7/625: chown d0/d3d/c4e 111 1 2024-04-12T13:42:13.533 INFO:tasks.workunit.client.1.smithi110.stdout:9/763: truncate df/f19 641770 0 2024-04-12T13:42:13.535 INFO:tasks.workunit.client.0.smithi060.stdout:9/568: dwrite d4/d8/f17 [0,4194304] 0 2024-04-12T13:42:13.535 INFO:tasks.workunit.client.1.smithi110.stdout:9/764: write df/d13/d2c/d2d/dc1/d83/fe0 [677534,1729] 0 2024-04-12T13:42:13.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/597: mkdir d7/d9/de/dca 0 2024-04-12T13:42:13.540 INFO:tasks.workunit.client.0.smithi060.stdout:8/622: write d9/d1b/d37/d4d/f7e [2619763,58863] 0 2024-04-12T13:42:13.543 INFO:tasks.workunit.client.1.smithi110.stdout:4/774: rename d0/de/d32/c3e to d0/de/d2c/cfb 0 2024-04-12T13:42:13.545 INFO:tasks.workunit.client.0.smithi060.stdout:2/649: unlink d6/dae/d31/f42 0 2024-04-12T13:42:13.546 INFO:tasks.workunit.client.0.smithi060.stdout:5/651: dread d6/dd/d27/f2d [0,4194304] 0 2024-04-12T13:42:13.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/650: write d6/d56/d55/f88 [3953055,60011] 0 2024-04-12T13:42:13.552 INFO:tasks.workunit.client.0.smithi060.stdout:4/645: creat d6/d7/dd/d1a/d57/dc7/fd7 x:0 0 0 2024-04-12T13:42:13.553 INFO:tasks.workunit.client.0.smithi060.stdout:6/714: creat d1/d7/da/dc/d24/d30/d52/d78/d80/d93/fec x:0 0 0 2024-04-12T13:42:13.554 INFO:tasks.workunit.client.1.smithi110.stdout:0/613: creat d1/fd9 x:0 0 0 2024-04-12T13:42:13.555 INFO:tasks.workunit.client.0.smithi060.stdout:7/626: mknod d0/d7/d43/d4d/ccd 0 2024-04-12T13:42:13.557 INFO:tasks.workunit.client.0.smithi060.stdout:0/598: mknod d7/d9/de/d63/ccb 0 2024-04-12T13:42:13.558 INFO:tasks.workunit.client.0.smithi060.stdout:7/627: read d0/d7/d43/f46 [223697,83476] 0 2024-04-12T13:42:13.559 INFO:tasks.workunit.client.0.smithi060.stdout:8/623: symlink d9/d1b/d37/ldb 0 2024-04-12T13:42:13.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/599: readlink d7/d9/d14/d4a/l5e 0 2024-04-12T13:42:13.560 INFO:tasks.workunit.client.1.smithi110.stdout:1/682: creat de/d15/fed x:0 0 0 2024-04-12T13:42:13.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/628: read d0/d3d/f58 [141941,13331] 0 2024-04-12T13:42:13.569 INFO:tasks.workunit.client.1.smithi110.stdout:9/765: creat df/d13/dca/f105 x:0 0 0 2024-04-12T13:42:13.570 INFO:tasks.workunit.client.0.smithi060.stdout:6/715: dwrite d1/d7d/fea [0,4194304] 0 2024-04-12T13:42:13.572 INFO:tasks.workunit.client.0.smithi060.stdout:2/651: creat d6/d10/daa/db0/fc3 x:0 0 0 2024-04-12T13:42:13.574 INFO:tasks.workunit.client.0.smithi060.stdout:4/646: readlink d6/d7/l26 0 2024-04-12T13:42:13.582 INFO:tasks.workunit.client.1.smithi110.stdout:5/674: sync 2024-04-12T13:42:13.582 INFO:tasks.workunit.client.1.smithi110.stdout:2/736: sync 2024-04-12T13:42:13.582 INFO:tasks.workunit.client.0.smithi060.stdout:9/569: dread d4/d8/f2e [0,4194304] 0 2024-04-12T13:42:13.584 INFO:tasks.workunit.client.0.smithi060.stdout:9/570: readlink d4/d8/d32/lab 0 2024-04-12T13:42:13.584 INFO:tasks.workunit.client.1.smithi110.stdout:0/614: getdents d1/d8/d8a/dc8 0 2024-04-12T13:42:13.587 INFO:tasks.workunit.client.0.smithi060.stdout:8/624: creat d9/d1b/d37/d4d/d63/d66/d8b/fdc x:0 0 0 2024-04-12T13:42:13.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/571: dread d4/d8/d32/f99 [0,4194304] 0 2024-04-12T13:42:13.589 INFO:tasks.workunit.client.1.smithi110.stdout:2/737: write d6/dc/d1b/d57/d62/fdc [167519,124605] 0 2024-04-12T13:42:13.590 INFO:tasks.workunit.client.0.smithi060.stdout:9/572: chown d4/d33/c59 482 1 2024-04-12T13:42:13.590 INFO:tasks.workunit.client.1.smithi110.stdout:7/716: rename d1/d3/d4/f27 to d1/d1b/ff1 0 2024-04-12T13:42:13.591 INFO:tasks.workunit.client.0.smithi060.stdout:5/652: truncate d6/d10/f2a 1589933 0 2024-04-12T13:42:13.593 INFO:tasks.workunit.client.1.smithi110.stdout:8/703: dwrite d1/d3/d3c/d5a/d6f/d7e/f71 [0,4194304] 0 2024-04-12T13:42:13.595 INFO:tasks.workunit.client.0.smithi060.stdout:2/652: unlink d6/d56/d55/fa4 0 2024-04-12T13:42:13.598 INFO:tasks.workunit.client.0.smithi060.stdout:2/653: truncate d6/d10/d2b/fb7 714010 0 2024-04-12T13:42:13.599 INFO:tasks.workunit.client.1.smithi110.stdout:6/680: dwrite d7/d25/d30/d44/f31 [0,4194304] 0 2024-04-12T13:42:13.599 INFO:tasks.workunit.client.0.smithi060.stdout:4/647: dread d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:42:13.600 INFO:tasks.workunit.client.1.smithi110.stdout:1/683: dread de/f22 [0,4194304] 0 2024-04-12T13:42:13.602 INFO:tasks.workunit.client.0.smithi060.stdout:7/629: fsync d0/d1b/f27 0 2024-04-12T13:42:13.603 INFO:tasks.workunit.client.0.smithi060.stdout:7/630: readlink d0/d7/l20 0 2024-04-12T13:42:13.604 INFO:tasks.workunit.client.1.smithi110.stdout:9/766: write df/d13/d2c/f8f [27170,12229] 0 2024-04-12T13:42:13.607 INFO:tasks.workunit.client.0.smithi060.stdout:0/600: truncate d7/d9/f68 4433 0 2024-04-12T13:42:13.608 INFO:tasks.workunit.client.0.smithi060.stdout:7/631: write d0/d7/f33 [823007,57821] 0 2024-04-12T13:42:13.611 INFO:tasks.workunit.client.1.smithi110.stdout:3/662: rename d5/d86/fcb to d5/dc/d20/d2d/d4f/fd1 0 2024-04-12T13:42:13.615 INFO:tasks.workunit.client.1.smithi110.stdout:7/717: mknod d1/d3/d4/d55/d56/cf2 0 2024-04-12T13:42:13.618 INFO:tasks.workunit.client.1.smithi110.stdout:2/738: creat d6/dc/d13/d80/d8d/dcc/d82/fe1 x:0 0 0 2024-04-12T13:42:13.618 INFO:tasks.workunit.client.0.smithi060.stdout:9/573: rmdir d4/d9/d19/d8c 39 2024-04-12T13:42:13.621 INFO:tasks.workunit.client.1.smithi110.stdout:8/704: creat d1/d3/d3c/d5a/fe2 x:0 0 0 2024-04-12T13:42:13.622 INFO:tasks.workunit.client.1.smithi110.stdout:4/775: dwrite d0/de/d32/f5d [0,4194304] 0 2024-04-12T13:42:13.622 INFO:tasks.workunit.client.0.smithi060.stdout:3/692: link d7/d17/f28 d7/d17/d19/d33/fe4 0 2024-04-12T13:42:13.623 INFO:tasks.workunit.client.0.smithi060.stdout:5/653: creat d6/dd/d1f/d25/d53/fd9 x:0 0 0 2024-04-12T13:42:13.623 INFO:tasks.workunit.client.1.smithi110.stdout:5/675: dwrite da/d35/f41 [0,4194304] 0 2024-04-12T13:42:13.624 INFO:tasks.workunit.client.1.smithi110.stdout:6/681: mknod d7/d25/d30/cd9 0 2024-04-12T13:42:13.626 INFO:tasks.workunit.client.0.smithi060.stdout:5/654: chown d6/dd/d1f/d25/d42/d52/dc8 2 1 2024-04-12T13:42:13.626 INFO:tasks.workunit.client.1.smithi110.stdout:6/682: chown d7/d10/d1c/f28 832 1 2024-04-12T13:42:13.628 INFO:tasks.workunit.client.0.smithi060.stdout:0/601: dread - d7/d41/f61 zero size 2024-04-12T13:42:13.628 INFO:tasks.workunit.client.1.smithi110.stdout:1/684: rmdir de/d15/d32/d5e 39 2024-04-12T13:42:13.637 INFO:tasks.workunit.client.1.smithi110.stdout:7/718: creat d1/d3/d4/d36/ff3 x:0 0 0 2024-04-12T13:42:13.641 INFO:tasks.workunit.client.1.smithi110.stdout:4/776: dwrite d0/de/d32/f5d [0,4194304] 0 2024-04-12T13:42:13.644 INFO:tasks.workunit.client.0.smithi060.stdout:9/574: creat d4/d33/d65/d7a/fc0 x:0 0 0 2024-04-12T13:42:13.646 INFO:tasks.workunit.client.0.smithi060.stdout:3/693: fsync d7/d17/f28 0 2024-04-12T13:42:13.647 INFO:tasks.workunit.client.0.smithi060.stdout:9/575: dread - d4/d33/d50/faa zero size 2024-04-12T13:42:13.649 INFO:tasks.workunit.client.1.smithi110.stdout:8/705: unlink d1/c4c 0 2024-04-12T13:42:13.650 INFO:tasks.workunit.client.0.smithi060.stdout:9/576: write d4/f2d [4765100,28355] 0 2024-04-12T13:42:13.652 INFO:tasks.workunit.client.0.smithi060.stdout:6/716: creat d1/d7/da/dc/d24/fed x:0 0 0 2024-04-12T13:42:13.652 INFO:tasks.workunit.client.1.smithi110.stdout:2/739: dread d6/dc/d13/f69 [0,4194304] 0 2024-04-12T13:42:13.652 INFO:tasks.workunit.client.1.smithi110.stdout:4/777: dread d0/d78/fd2 [0,4194304] 0 2024-04-12T13:42:13.654 INFO:tasks.workunit.client.0.smithi060.stdout:8/625: write d9/f11 [3229261,6713] 0 2024-04-12T13:42:13.654 INFO:tasks.workunit.client.1.smithi110.stdout:1/685: fdatasync de/d14/d34/d55/d6b/f82 0 2024-04-12T13:42:13.659 INFO:tasks.workunit.client.0.smithi060.stdout:6/717: chown d1/d7/da/dc/d24/d30/d52/d5e/f72 888621 1 2024-04-12T13:42:13.662 INFO:tasks.workunit.client.1.smithi110.stdout:7/719: unlink d1/d3/d4/d55/d56/d72/de0/f25 0 2024-04-12T13:42:13.662 INFO:tasks.workunit.client.0.smithi060.stdout:5/655: dread d6/d10/f2b [0,4194304] 0 2024-04-12T13:42:13.665 INFO:tasks.workunit.client.1.smithi110.stdout:3/663: dread d5/dc/f53 [0,4194304] 0 2024-04-12T13:42:13.668 INFO:tasks.workunit.client.0.smithi060.stdout:0/602: write d7/f3e [7340518,40384] 0 2024-04-12T13:42:13.671 INFO:tasks.workunit.client.0.smithi060.stdout:9/577: stat d4/d9/d19/c5d 0 2024-04-12T13:42:13.673 INFO:tasks.workunit.client.1.smithi110.stdout:3/664: write d5/dc/d20/d2d/d4e/d89/d8c/db6/fc7 [136588,123837] 0 2024-04-12T13:42:13.673 INFO:tasks.workunit.client.1.smithi110.stdout:4/778: creat d0/d75/ffc x:0 0 0 2024-04-12T13:42:13.676 INFO:tasks.workunit.client.1.smithi110.stdout:0/615: dread d1/d8/d36/d51/f68 [0,4194304] 0 2024-04-12T13:42:13.677 INFO:tasks.workunit.client.0.smithi060.stdout:3/694: rename d7/d17/d19/d33/d63/d9b/le2 to d7/d17/d19/d33/d63/d6d/dab/le5 0 2024-04-12T13:42:13.680 INFO:tasks.workunit.client.1.smithi110.stdout:9/767: rename df/d13/d2c/d2d/dc1/d83/d63/d72/cfc to df/d13/d26/d37/c106 0 2024-04-12T13:42:13.681 INFO:tasks.workunit.client.1.smithi110.stdout:8/706: write d1/d5/dd/fa0 [1257898,73221] 0 2024-04-12T13:42:13.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/656: dread d6/dd/d1f/d25/d53/d87/f60 [0,4194304] 0 2024-04-12T13:42:13.686 INFO:tasks.workunit.client.1.smithi110.stdout:7/720: symlink d1/d3/d4/d55/d56/d72/de0/lf4 0 2024-04-12T13:42:13.688 INFO:tasks.workunit.client.0.smithi060.stdout:7/632: creat d0/d7/d43/fce x:0 0 0 2024-04-12T13:42:13.693 INFO:tasks.workunit.client.0.smithi060.stdout:3/695: dwrite d7/d17/d19/d33/d63/d6d/dab/fd5 [0,4194304] 0 2024-04-12T13:42:13.695 INFO:tasks.workunit.client.0.smithi060.stdout:2/654: getdents d6/d56 0 2024-04-12T13:42:13.698 INFO:tasks.workunit.client.1.smithi110.stdout:0/616: truncate d1/d48/db2/f82 768175 0 2024-04-12T13:42:13.699 INFO:tasks.workunit.client.0.smithi060.stdout:2/655: dread - d6/d10/daa/db0/fc3 zero size 2024-04-12T13:42:13.699 INFO:tasks.workunit.client.0.smithi060.stdout:5/657: creat d6/d10/d12/d38/fda x:0 0 0 2024-04-12T13:42:13.700 INFO:tasks.workunit.client.1.smithi110.stdout:0/617: chown d1/d48/fc1 124 1 2024-04-12T13:42:13.700 INFO:tasks.workunit.client.0.smithi060.stdout:6/718: dwrite d1/d7/da/ff [0,4194304] 0 2024-04-12T13:42:13.706 INFO:tasks.workunit.client.0.smithi060.stdout:7/633: mkdir d0/d3d/dcf 0 2024-04-12T13:42:13.707 INFO:tasks.workunit.client.1.smithi110.stdout:1/686: creat de/d15/d32/d61/d6a/dac/dc0/dea/fee x:0 0 0 2024-04-12T13:42:13.709 INFO:tasks.workunit.client.0.smithi060.stdout:9/578: write d4/d9/fc [392365,59875] 0 2024-04-12T13:42:13.709 INFO:tasks.workunit.client.1.smithi110.stdout:3/665: dwrite d5/dc/d31/d3b/f9d [0,4194304] 0 2024-04-12T13:42:13.710 INFO:tasks.workunit.client.0.smithi060.stdout:7/634: chown d0/d7/da9/dc9/db1 10610 1 2024-04-12T13:42:13.711 INFO:tasks.workunit.client.1.smithi110.stdout:9/768: mkdir df/d13/d2c/d9e/d107 0 2024-04-12T13:42:13.712 INFO:tasks.workunit.client.0.smithi060.stdout:8/626: link d9/d1d/d2f/c76 d9/d1b/d3c/d6e/d7b/cdd 0 2024-04-12T13:42:13.713 INFO:tasks.workunit.client.1.smithi110.stdout:7/721: fdatasync d1/d1b/d70/fef 0 2024-04-12T13:42:13.714 INFO:tasks.workunit.client.1.smithi110.stdout:8/707: creat d1/d3/d35/d3a/d3e/d64/d85/fe3 x:0 0 0 2024-04-12T13:42:13.715 INFO:tasks.workunit.client.1.smithi110.stdout:2/740: creat d6/d18/fe2 x:0 0 0 2024-04-12T13:42:13.717 INFO:tasks.workunit.client.0.smithi060.stdout:8/627: write d9/d1b/d3c/f92 [4790934,55860] 0 2024-04-12T13:42:13.718 INFO:tasks.workunit.client.1.smithi110.stdout:4/779: mknod d0/de/d32/d5f/dd3/cfd 0 2024-04-12T13:42:13.720 INFO:tasks.workunit.client.0.smithi060.stdout:9/579: truncate d4/d9/d19/d21/d73/fae 101450 0 2024-04-12T13:42:13.720 INFO:tasks.workunit.client.0.smithi060.stdout:5/658: rename d6/d89/lcb to d6/dd/d1f/dd3/ldb 0 2024-04-12T13:42:13.720 INFO:tasks.workunit.client.1.smithi110.stdout:6/683: getdents d7/d10/d1c/d2b/d48 0 2024-04-12T13:42:13.723 INFO:tasks.workunit.client.0.smithi060.stdout:2/656: dwrite d6/d56/d43/f65 [0,4194304] 0 2024-04-12T13:42:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:6/719: creat d1/d7/da/dc/d24/d34/d51/d97/da9/fee x:0 0 0 2024-04-12T13:42:13.726 INFO:tasks.workunit.client.1.smithi110.stdout:0/618: dwrite d1/d5e/f9f [0,4194304] 0 2024-04-12T13:42:13.727 INFO:tasks.workunit.client.1.smithi110.stdout:1/687: creat de/d14/d34/db4/fef x:0 0 0 2024-04-12T13:42:13.727 INFO:tasks.workunit.client.0.smithi060.stdout:3/696: dwrite d7/d17/d19/dc9/d3f/d5c/d25/d4d/f75 [0,4194304] 0 2024-04-12T13:42:13.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/580: chown d4/d9/d19/d21/d73/d67/c53 61092487 1 2024-04-12T13:42:13.732 INFO:tasks.workunit.client.0.smithi060.stdout:0/603: getdents d7/d9/d14/d35/d44 0 2024-04-12T13:42:13.739 INFO:tasks.workunit.client.1.smithi110.stdout:5/676: rename da/d5c/l68 to da/d2e/d45/d25/d9d/le8 0 2024-04-12T13:42:13.739 INFO:tasks.workunit.client.1.smithi110.stdout:2/741: unlink d6/dc/dd/d49/d64/d5d/f5f 0 2024-04-12T13:42:13.741 INFO:tasks.workunit.client.0.smithi060.stdout:7/635: dread d0/d1b/f27 [0,4194304] 0 2024-04-12T13:42:13.742 INFO:tasks.workunit.client.1.smithi110.stdout:3/666: dread d5/dc/d31/d3b/d32/d3e/f41 [0,4194304] 0 2024-04-12T13:42:13.744 INFO:tasks.workunit.client.1.smithi110.stdout:2/742: fsync d6/dc/f33 0 2024-04-12T13:42:13.745 INFO:tasks.workunit.client.0.smithi060.stdout:0/604: chown d7/d9/d14/f6f 24 1 2024-04-12T13:42:13.748 INFO:tasks.workunit.client.0.smithi060.stdout:2/657: mkdir d6/d10/dc4 0 2024-04-12T13:42:13.749 INFO:tasks.workunit.client.1.smithi110.stdout:0/619: creat d1/d8/d36/d51/d60/fda x:0 0 0 2024-04-12T13:42:13.749 INFO:tasks.workunit.client.0.smithi060.stdout:3/697: truncate d7/d17/d19/dc9/d3f/d5c/d25/f7b 5169924 0 2024-04-12T13:42:13.751 INFO:tasks.workunit.client.0.smithi060.stdout:8/628: link d9/d1b/d37/f39 d9/d1d/d5e/fde 0 2024-04-12T13:42:13.752 INFO:tasks.workunit.client.1.smithi110.stdout:9/769: symlink df/d13/d2c/d9e/d107/l108 0 2024-04-12T13:42:13.755 INFO:tasks.workunit.client.1.smithi110.stdout:8/708: dread d1/d3/d35/d3a/d3e/d64/d85/d8d/fc4 [0,4194304] 0 2024-04-12T13:42:13.756 INFO:tasks.workunit.client.0.smithi060.stdout:6/720: creat d1/d7/da/dc/d24/d30/d52/d78/dc7/fef x:0 0 0 2024-04-12T13:42:13.760 INFO:tasks.workunit.client.1.smithi110.stdout:0/620: mknod d1/d27/d31/d89/cdb 0 2024-04-12T13:42:13.762 INFO:tasks.workunit.client.1.smithi110.stdout:9/770: rmdir df/d13/d3b/d40/d56 39 2024-04-12T13:42:13.763 INFO:tasks.workunit.client.1.smithi110.stdout:1/688: dwrite de/d15/dab/dd8/dd9/dda/f7d [0,4194304] 0 2024-04-12T13:42:13.765 INFO:tasks.workunit.client.1.smithi110.stdout:9/771: chown df/d13/d2c 732262 1 2024-04-12T13:42:13.766 INFO:tasks.workunit.client.1.smithi110.stdout:6/684: rmdir d7/d25/d30/dcf/dc3/dc5 0 2024-04-12T13:42:13.766 INFO:tasks.workunit.client.0.smithi060.stdout:2/658: dwrite d6/f8 [0,4194304] 0 2024-04-12T13:42:13.769 INFO:tasks.workunit.client.1.smithi110.stdout:5/677: mkdir da/db/d15/de9 0 2024-04-12T13:42:13.771 INFO:tasks.workunit.client.0.smithi060.stdout:8/629: mknod d9/d1b/d37/d4d/d63/cdf 0 2024-04-12T13:42:13.772 INFO:tasks.workunit.client.1.smithi110.stdout:3/667: dwrite d5/f1f [0,4194304] 0 2024-04-12T13:42:13.773 INFO:tasks.workunit.client.1.smithi110.stdout:7/722: rename d1/d1b/d3d/c98 to d1/d1b/cf5 0 2024-04-12T13:42:13.774 INFO:tasks.workunit.client.0.smithi060.stdout:8/630: stat d9/d1b/d37/d4d/d63/d66/db3/c9b 0 2024-04-12T13:42:13.777 INFO:tasks.workunit.client.1.smithi110.stdout:1/689: dread de/d1d/d86/fa3 [0,4194304] 0 2024-04-12T13:42:13.780 INFO:tasks.workunit.client.1.smithi110.stdout:6/685: rename d7/d25 to d7/d25/dc6/dda 22 2024-04-12T13:42:13.782 INFO:tasks.workunit.client.1.smithi110.stdout:6/686: write d7/d10/d1c/d2b/d3a/f81 [1317850,97704] 0 2024-04-12T13:42:13.783 INFO:tasks.workunit.client.1.smithi110.stdout:8/709: dwrite d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:13.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/659: dread f1 [0,4194304] 0 2024-04-12T13:42:13.786 INFO:tasks.workunit.client.0.smithi060.stdout:3/698: mkdir d7/d17/d27/da7/dbe/dce/de6 0 2024-04-12T13:42:13.791 INFO:tasks.workunit.client.1.smithi110.stdout:0/621: fdatasync d1/d8/d36/d51/d60/f74 0 2024-04-12T13:42:13.791 INFO:tasks.workunit.client.0.smithi060.stdout:6/721: dread - d1/d7/da/dc/dac/fd7 zero size 2024-04-12T13:42:13.798 INFO:tasks.workunit.client.1.smithi110.stdout:5/678: dwrite da/d2e/d45/d25/d9d/d79/d9e/fd5 [0,4194304] 0 2024-04-12T13:42:13.798 INFO:tasks.workunit.client.1.smithi110.stdout:7/723: dwrite d1/f28 [0,4194304] 0 2024-04-12T13:42:13.798 INFO:tasks.workunit.client.0.smithi060.stdout:7/636: link d0/d1b/d8c/cca d0/d3d/d74/d9b/da1/cd0 0 2024-04-12T13:42:13.802 INFO:tasks.workunit.client.0.smithi060.stdout:3/699: unlink d7/d17/d19/dc9/d3f/d5c/d25/l2b 0 2024-04-12T13:42:13.811 INFO:tasks.workunit.client.0.smithi060.stdout:9/581: write d4/d9/d19/f34 [2865348,66441] 0 2024-04-12T13:42:13.812 INFO:tasks.workunit.client.0.smithi060.stdout:2/659: fdatasync d6/d10/d81/dbd/f63 0 2024-04-12T13:42:13.817 INFO:tasks.workunit.client.0.smithi060.stdout:7/637: rename d0/d7/d43/d4d/f57 to d0/d3d/d74/d9b/da1/fd1 0 2024-04-12T13:42:13.817 INFO:tasks.workunit.client.1.smithi110.stdout:2/743: write d6/dc/dd/d49/d64/d4a/d3c/f26 [2087574,55230] 0 2024-04-12T13:42:13.820 INFO:tasks.workunit.client.1.smithi110.stdout:2/744: truncate d6/dc/dd/f81 2004887 0 2024-04-12T13:42:13.823 INFO:tasks.workunit.client.0.smithi060.stdout:5/660: link d6/dd/d1f/d25/d53/fd9 d6/d10/db8/fdc 0 2024-04-12T13:42:13.825 INFO:tasks.workunit.client.0.smithi060.stdout:0/605: write d7/d9/d14/d35/f36 [2911506,9051] 0 2024-04-12T13:42:13.830 INFO:tasks.workunit.client.0.smithi060.stdout:2/660: dread d6/d10/d2b/f9a [0,4194304] 0 2024-04-12T13:42:13.831 INFO:tasks.workunit.client.0.smithi060.stdout:6/722: dread d1/d7/da/dc/d24/d8b/f8f [0,4194304] 0 2024-04-12T13:42:13.835 INFO:tasks.workunit.client.0.smithi060.stdout:3/700: dread d7/d17/d19/d33/d63/d9b/dc0/fd1 [0,4194304] 0 2024-04-12T13:42:13.837 INFO:tasks.workunit.client.0.smithi060.stdout:8/631: dread d9/d1d/f64 [0,4194304] 0 2024-04-12T13:42:13.837 INFO:tasks.workunit.client.1.smithi110.stdout:9/772: symlink df/d13/d2c/d2d/d39/d3a/db2/l109 0 2024-04-12T13:42:13.839 INFO:tasks.workunit.client.1.smithi110.stdout:5/679: mkdir da/db/d3b/d40/da2/dea 0 2024-04-12T13:42:13.840 INFO:tasks.workunit.client.0.smithi060.stdout:8/632: write d9/d1b/d2b/f40 [1569139,72743] 0 2024-04-12T13:42:13.842 INFO:tasks.workunit.client.1.smithi110.stdout:7/724: rmdir d1/d3/d4/d55/d56/d72/de0/da7 39 2024-04-12T13:42:13.843 INFO:tasks.workunit.client.1.smithi110.stdout:1/690: write de/f5b [289460,67477] 0 2024-04-12T13:42:13.849 INFO:tasks.workunit.client.1.smithi110.stdout:8/710: symlink d1/d3/d35/le4 0 2024-04-12T13:42:13.849 INFO:tasks.workunit.client.1.smithi110.stdout:6/687: getdents d7/d25/d30/d6b/dd7 0 2024-04-12T13:42:13.849 INFO:tasks.workunit.client.0.smithi060.stdout:6/723: mkdir d1/d7/da/d20/da8/df0 0 2024-04-12T13:42:13.850 INFO:tasks.workunit.client.1.smithi110.stdout:2/745: symlink d6/dc/d13/d80/d8d/dcc/d82/d84/le3 0 2024-04-12T13:42:13.852 INFO:tasks.workunit.client.1.smithi110.stdout:0/622: creat d1/d8/d36/d65/fdc x:0 0 0 2024-04-12T13:42:13.853 INFO:tasks.workunit.client.0.smithi060.stdout:1/766: sync 2024-04-12T13:42:13.856 INFO:tasks.workunit.client.1.smithi110.stdout:5/680: rmdir da/d2e/d45/d25/d9d/d7a/db5/d89 39 2024-04-12T13:42:13.857 INFO:tasks.workunit.client.1.smithi110.stdout:4/780: sync 2024-04-12T13:42:13.858 INFO:tasks.workunit.client.0.smithi060.stdout:7/638: write d0/f71 [4324450,125992] 0 2024-04-12T13:42:13.859 INFO:tasks.workunit.client.0.smithi060.stdout:0/606: write d7/f9a [780305,3095] 0 2024-04-12T13:42:13.861 INFO:tasks.workunit.client.1.smithi110.stdout:7/725: dwrite d1/d3/d4/dbf/fac [0,4194304] 0 2024-04-12T13:42:13.864 INFO:tasks.workunit.client.0.smithi060.stdout:8/633: rename d9/d1b/d3c/f92 to d9/d1b/d2b/fe0 0 2024-04-12T13:42:13.864 INFO:tasks.workunit.client.0.smithi060.stdout:5/661: symlink d6/dd/ldd 0 2024-04-12T13:42:13.869 INFO:tasks.workunit.client.0.smithi060.stdout:6/724: dwrite d1/d7/da/ff [0,4194304] 0 2024-04-12T13:42:13.870 INFO:tasks.workunit.client.0.smithi060.stdout:8/634: chown d9/d1d/d5e/fd5 461773 1 2024-04-12T13:42:13.870 INFO:tasks.workunit.client.0.smithi060.stdout:5/662: chown d6/dd/d1f/d32/d3d/c58 17768928 1 2024-04-12T13:42:13.871 INFO:tasks.workunit.client.1.smithi110.stdout:4/781: dwrite d0/d19/f2e [4194304,4194304] 0 2024-04-12T13:42:13.872 INFO:tasks.workunit.client.1.smithi110.stdout:4/782: chown d0/d19/d8f/dc5 195888881 1 2024-04-12T13:42:13.874 INFO:tasks.workunit.client.0.smithi060.stdout:2/661: dwrite d6/dae/d31/d33/f49 [0,4194304] 0 2024-04-12T13:42:13.874 INFO:tasks.workunit.client.1.smithi110.stdout:4/783: read - d0/de/da0/dd9/df3/de0/d7e/fea zero size 2024-04-12T13:42:13.881 INFO:tasks.workunit.client.0.smithi060.stdout:1/767: mknod d1e/d1f/c10d 0 2024-04-12T13:42:13.881 INFO:tasks.workunit.client.0.smithi060.stdout:7/639: creat d0/d78/da0/fd2 x:0 0 0 2024-04-12T13:42:13.884 INFO:tasks.workunit.client.0.smithi060.stdout:0/607: unlink d7/d33/c57 0 2024-04-12T13:42:13.889 INFO:tasks.workunit.client.0.smithi060.stdout:5/663: creat d6/dd/d1f/d25/d42/d52/d7a/fde x:0 0 0 2024-04-12T13:42:13.890 INFO:tasks.workunit.client.0.smithi060.stdout:0/608: write d7/d9/d14/d35/d44/d7d/fac [1685677,14374] 0 2024-04-12T13:42:13.892 INFO:tasks.workunit.client.0.smithi060.stdout:8/635: rename d9/d1b/d37/d4d/d63/c91 to d9/d1b/d3c/d6e/dbd/ce1 0 2024-04-12T13:42:13.893 INFO:tasks.workunit.client.0.smithi060.stdout:3/701: dread d7/d17/f90 [0,4194304] 0 2024-04-12T13:42:13.895 INFO:tasks.workunit.client.1.smithi110.stdout:4/784: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:42:13.895 INFO:tasks.workunit.client.0.smithi060.stdout:4/648: sync 2024-04-12T13:42:13.896 INFO:tasks.workunit.client.0.smithi060.stdout:9/582: link d4/l3d d4/lc1 0 2024-04-12T13:42:13.896 INFO:tasks.workunit.client.0.smithi060.stdout:0/609: write d7/d41/dbc/faf [1093282,13086] 0 2024-04-12T13:42:13.907 INFO:tasks.workunit.client.1.smithi110.stdout:3/668: sync 2024-04-12T13:42:13.909 INFO:tasks.workunit.client.1.smithi110.stdout:3/669: chown d5/dc/d31/d3b/d32/d3e/d98/fc8 13877791 1 2024-04-12T13:42:13.918 INFO:tasks.workunit.client.0.smithi060.stdout:5/664: dread d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:42:13.919 INFO:tasks.workunit.client.0.smithi060.stdout:2/662: rename d6/d56/d58/da0/c1d to d6/dae/d31/d87/cc5 0 2024-04-12T13:42:13.921 INFO:tasks.workunit.client.0.smithi060.stdout:4/649: fdatasync d6/f70 0 2024-04-12T13:42:13.921 INFO:tasks.workunit.client.0.smithi060.stdout:7/640: write d0/d1b/f60 [474740,40757] 0 2024-04-12T13:42:13.924 INFO:tasks.workunit.client.0.smithi060.stdout:8/636: creat d9/d1d/d2f/fe2 x:0 0 0 2024-04-12T13:42:13.924 INFO:tasks.workunit.client.0.smithi060.stdout:4/650: chown d6/d7/dd/df/f37 121 1 2024-04-12T13:42:13.925 INFO:tasks.workunit.client.0.smithi060.stdout:9/583: creat d4/d8/d32/fc2 x:0 0 0 2024-04-12T13:42:13.926 INFO:tasks.workunit.client.0.smithi060.stdout:8/637: write f1 [1518157,49699] 0 2024-04-12T13:42:13.927 INFO:tasks.workunit.client.0.smithi060.stdout:0/610: mknod d7/d9/d14/d35/d44/d49/d74/ccc 0 2024-04-12T13:42:13.934 INFO:tasks.workunit.client.0.smithi060.stdout:5/665: symlink d6/dd/d1f/d25/d53/d8d/ldf 0 2024-04-12T13:42:13.936 INFO:tasks.workunit.client.0.smithi060.stdout:2/663: creat d6/d64/d99/fc6 x:0 0 0 2024-04-12T13:42:13.940 INFO:tasks.workunit.client.0.smithi060.stdout:9/584: dwrite d4/d8/fa [0,4194304] 0 2024-04-12T13:42:13.946 INFO:tasks.workunit.client.0.smithi060.stdout:8/638: mkdir d9/d1b/d2b/d82/d8a/dce/de3 0 2024-04-12T13:42:13.948 INFO:tasks.workunit.client.1.smithi110.stdout:6/688: mknod d7/d10/d7e/cdb 0 2024-04-12T13:42:13.948 INFO:tasks.workunit.client.0.smithi060.stdout:1/768: rmdir d1e/d106 0 2024-04-12T13:42:13.949 INFO:tasks.workunit.client.1.smithi110.stdout:6/689: readlink d7/d25/d2c/l78 0 2024-04-12T13:42:13.951 INFO:tasks.workunit.client.0.smithi060.stdout:6/725: getdents d1/d7/da/dc/d24/d30/d52/d78/d80 0 2024-04-12T13:42:13.951 INFO:tasks.workunit.client.1.smithi110.stdout:2/746: creat d6/dc/dd/dc6/fe4 x:0 0 0 2024-04-12T13:42:13.956 INFO:tasks.workunit.client.0.smithi060.stdout:5/666: rmdir d6/dd/d1f/d25 39 2024-04-12T13:42:13.959 INFO:tasks.workunit.client.0.smithi060.stdout:7/641: write d0/d7/f73 [1855498,52266] 0 2024-04-12T13:42:13.962 INFO:tasks.workunit.client.0.smithi060.stdout:7/642: write d0/d3d/d74/f7e [3377534,23834] 0 2024-04-12T13:42:13.962 INFO:tasks.workunit.client.1.smithi110.stdout:5/681: creat da/d2e/d45/d25/d9d/d7a/dae/feb x:0 0 0 2024-04-12T13:42:13.964 INFO:tasks.workunit.client.1.smithi110.stdout:7/726: chown d1/d3/f4c 27675 1 2024-04-12T13:42:13.964 INFO:tasks.workunit.client.0.smithi060.stdout:7/643: readlink d0/l2e 0 2024-04-12T13:42:13.964 INFO:tasks.workunit.client.0.smithi060.stdout:9/585: dread - d4/d9/d19/d21/d73/d67/f8f zero size 2024-04-12T13:42:13.967 INFO:tasks.workunit.client.0.smithi060.stdout:9/586: truncate d4/d9/fc 563051 0 2024-04-12T13:42:13.969 INFO:tasks.workunit.client.0.smithi060.stdout:8/639: creat d9/d1d/d5e/fe4 x:0 0 0 2024-04-12T13:42:13.969 INFO:tasks.workunit.client.1.smithi110.stdout:0/623: write d1/d8/d36/d51/d60/f2b [2400277,5068] 0 2024-04-12T13:42:13.971 INFO:tasks.workunit.client.0.smithi060.stdout:1/769: creat d1e/d23/d2e/d30/d51/d85/f10e x:0 0 0 2024-04-12T13:42:13.972 INFO:tasks.workunit.client.1.smithi110.stdout:0/624: dread - d1/d27/d31/fd5 zero size 2024-04-12T13:42:13.973 INFO:tasks.workunit.client.1.smithi110.stdout:8/711: dwrite d1/d3/fe [0,4194304] 0 2024-04-12T13:42:13.974 INFO:tasks.workunit.client.1.smithi110.stdout:2/747: creat d6/dc/db1/fe5 x:0 0 0 2024-04-12T13:42:13.977 INFO:tasks.workunit.client.0.smithi060.stdout:0/611: creat d7/d9/d14/d35/fcd x:0 0 0 2024-04-12T13:42:13.978 INFO:tasks.workunit.client.0.smithi060.stdout:0/612: fdatasync d7/f9a 0 2024-04-12T13:42:13.980 INFO:tasks.workunit.client.0.smithi060.stdout:9/587: unlink d4/d9/d19/d21/f66 0 2024-04-12T13:42:13.981 INFO:tasks.workunit.client.0.smithi060.stdout:6/726: write d1/fb6 [3014682,81922] 0 2024-04-12T13:42:13.982 INFO:tasks.workunit.client.1.smithi110.stdout:7/727: unlink d1/d1b/d74/cae 0 2024-04-12T13:42:13.983 INFO:tasks.workunit.client.1.smithi110.stdout:5/682: dread da/d2e/d45/d25/d9d/d79/d88/f95 [0,4194304] 0 2024-04-12T13:42:13.983 INFO:tasks.workunit.client.0.smithi060.stdout:8/640: mkdir d9/d1b/d3c/d6e/d7b/db1/de5 0 2024-04-12T13:42:13.984 INFO:tasks.workunit.client.1.smithi110.stdout:4/785: symlink d0/de/d2c/lfe 0 2024-04-12T13:42:13.987 INFO:tasks.workunit.client.1.smithi110.stdout:3/670: fsync d5/dc/d31/d3b/d32/f37 0 2024-04-12T13:42:13.988 INFO:tasks.workunit.client.1.smithi110.stdout:1/691: rmdir de/d1d/deb 0 2024-04-12T13:42:13.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/664: link d6/d10/d2b/c47 d6/d64/cc7 0 2024-04-12T13:42:13.997 INFO:tasks.workunit.client.1.smithi110.stdout:8/712: creat d1/d3/d35/d3a/d3e/d64/d85/fe5 x:0 0 0 2024-04-12T13:42:13.998 INFO:tasks.workunit.client.1.smithi110.stdout:8/713: stat d1/d3/fe 0 2024-04-12T13:42:13.999 INFO:tasks.workunit.client.0.smithi060.stdout:0/613: dwrite d7/d9/d14/d35/d3c/f42 [0,4194304] 0 2024-04-12T13:42:14.000 INFO:tasks.workunit.client.1.smithi110.stdout:8/714: chown d1/d5/dd/c55 436421 1 2024-04-12T13:42:14.000 INFO:tasks.workunit.client.1.smithi110.stdout:9/773: getdents df/d13/d2c/d9e/dd6/dcf/dd2 0 2024-04-12T13:42:14.003 INFO:tasks.workunit.client.1.smithi110.stdout:9/774: read df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [2387786,95863] 0 2024-04-12T13:42:14.004 INFO:tasks.workunit.client.0.smithi060.stdout:8/641: symlink d9/d1b/d37/d4d/d63/d66/db3/da4/le6 0 2024-04-12T13:42:14.009 INFO:tasks.workunit.client.0.smithi060.stdout:1/770: dread d1e/f31 [0,4194304] 0 2024-04-12T13:42:14.012 INFO:tasks.workunit.client.0.smithi060.stdout:2/665: creat d6/dae/d5b/d6d/fc8 x:0 0 0 2024-04-12T13:42:14.012 INFO:tasks.workunit.client.1.smithi110.stdout:2/748: write d6/dc/f3f [1660914,89995] 0 2024-04-12T13:42:14.014 INFO:tasks.workunit.client.0.smithi060.stdout:2/666: chown d6/dae/d31/d33/f6a 745084 1 2024-04-12T13:42:14.016 INFO:tasks.workunit.client.1.smithi110.stdout:5/683: chown da/d2e/d45/d25/d9d/d7a/db5/d89/cd1 234 1 2024-04-12T13:42:14.018 INFO:tasks.workunit.client.0.smithi060.stdout:0/614: dwrite d7/d9/d14/d35/d44/d7d/fac [0,4194304] 0 2024-04-12T13:42:14.018 INFO:tasks.workunit.client.0.smithi060.stdout:6/727: rename d1/d7/da/dc/d24/d30/d52/d78/d80/d93/fec to d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/ff1 0 2024-04-12T13:42:14.018 INFO:tasks.workunit.client.1.smithi110.stdout:5/684: write da/db/f8d [2684630,122670] 0 2024-04-12T13:42:14.019 INFO:tasks.workunit.client.0.smithi060.stdout:0/615: stat d7 0 2024-04-12T13:42:14.019 INFO:tasks.workunit.client.1.smithi110.stdout:0/625: dwrite d1/d3c/f5f [0,4194304] 0 2024-04-12T13:42:14.022 INFO:tasks.workunit.client.1.smithi110.stdout:4/786: write d0/d13/f52 [398459,62344] 0 2024-04-12T13:42:14.022 INFO:tasks.workunit.client.1.smithi110.stdout:0/626: chown d1/d27/d31/c4b 235 1 2024-04-12T13:42:14.022 INFO:tasks.workunit.client.1.smithi110.stdout:3/671: chown d5/dc/d31/d74/d75/da7/dad/cbe 29687 1 2024-04-12T13:42:14.023 INFO:tasks.workunit.client.1.smithi110.stdout:0/627: fsync d1/d5e/fb3 0 2024-04-12T13:42:14.026 INFO:tasks.workunit.client.0.smithi060.stdout:9/588: link d4/d8/fa d4/d33/d50/fc3 0 2024-04-12T13:42:14.029 INFO:tasks.workunit.client.1.smithi110.stdout:3/672: stat d5/dc/d31/d3b/d32/f78 0 2024-04-12T13:42:14.030 INFO:tasks.workunit.client.0.smithi060.stdout:8/642: fdatasync d9/d1d/d2f/f99 0 2024-04-12T13:42:14.031 INFO:tasks.workunit.client.0.smithi060.stdout:1/771: dread - d1e/d29/d37/fd8 zero size 2024-04-12T13:42:14.031 INFO:tasks.workunit.client.1.smithi110.stdout:3/673: fdatasync d5/dc/f12 0 2024-04-12T13:42:14.034 INFO:tasks.workunit.client.1.smithi110.stdout:8/715: symlink d1/d3/d35/d3a/d3e/d64/le6 0 2024-04-12T13:42:14.034 INFO:tasks.workunit.client.1.smithi110.stdout:3/674: chown d5/dc/d31/d3b/f9d 0 1 2024-04-12T13:42:14.038 INFO:tasks.workunit.client.1.smithi110.stdout:9/775: stat df/d13/d2c/d2d/d94/f103 0 2024-04-12T13:42:14.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/728: creat d1/d7/da/dc/d24/d30/d52/d78/d80/d93/ff2 x:0 0 0 2024-04-12T13:42:14.047 INFO:tasks.workunit.client.0.smithi060.stdout:9/589: fdatasync d4/d33/d50/f61 0 2024-04-12T13:42:14.051 INFO:tasks.workunit.client.1.smithi110.stdout:4/787: dread - d0/de/da0/dd9/df3/de0/fb3 zero size 2024-04-12T13:42:14.052 INFO:tasks.workunit.client.0.smithi060.stdout:5/667: link d6/dd/d1f/d25/d53/f6e d6/dd/d1f/d25/d53/d87/da6/fe0 0 2024-04-12T13:42:14.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/667: write d6/dae/d5b/f78 [817589,27863] 0 2024-04-12T13:42:14.056 INFO:tasks.workunit.client.0.smithi060.stdout:0/616: write d7/d33/d5b/f64 [814786,22619] 0 2024-04-12T13:42:14.057 INFO:tasks.workunit.client.0.smithi060.stdout:8/643: dread d9/d1b/d84/da0/f24 [0,4194304] 0 2024-04-12T13:42:14.057 INFO:tasks.workunit.client.0.smithi060.stdout:7/644: link d0/d78/la8 d0/d7/d43/d63/ld3 0 2024-04-12T13:42:14.059 INFO:tasks.workunit.client.0.smithi060.stdout:1/772: dread d1e/d23/dd9/fc6 [0,4194304] 0 2024-04-12T13:42:14.059 INFO:tasks.workunit.client.1.smithi110.stdout:8/716: unlink d1/d3/d3c/d5a/f82 0 2024-04-12T13:42:14.064 INFO:tasks.workunit.client.0.smithi060.stdout:1/773: chown d1e/d29/d37/c42 6408 1 2024-04-12T13:42:14.064 INFO:tasks.workunit.client.0.smithi060.stdout:8/644: fdatasync d9/d1b/d3c/d6e/fa5 0 2024-04-12T13:42:14.065 INFO:tasks.workunit.client.0.smithi060.stdout:7/645: write d0/d1b/d8c/faf [89367,97265] 0 2024-04-12T13:42:14.066 INFO:tasks.workunit.client.1.smithi110.stdout:7/728: dwrite d1/d3/d4/f30 [0,4194304] 0 2024-04-12T13:42:14.069 INFO:tasks.workunit.client.1.smithi110.stdout:4/788: read - d0/de/fbc zero size 2024-04-12T13:42:14.069 INFO:tasks.workunit.client.0.smithi060.stdout:8/645: write d9/d1b/d3c/d6e/f9c [456082,32639] 0 2024-04-12T13:42:14.070 INFO:tasks.workunit.client.0.smithi060.stdout:7/646: truncate d0/d78/da0/fb4 808715 0 2024-04-12T13:42:14.072 INFO:tasks.workunit.client.0.smithi060.stdout:7/647: readlink d0/d78/l83 0 2024-04-12T13:42:14.078 INFO:tasks.workunit.client.1.smithi110.stdout:3/675: write d5/dc/d20/d2d/d4e/f66 [962266,90244] 0 2024-04-12T13:42:14.078 INFO:tasks.workunit.client.1.smithi110.stdout:5/685: creat da/db/d15/fec x:0 0 0 2024-04-12T13:42:14.080 INFO:tasks.workunit.client.1.smithi110.stdout:1/692: getdents de/d14 0 2024-04-12T13:42:14.081 INFO:tasks.workunit.client.1.smithi110.stdout:8/717: dwrite d1/d3/d35/d3a/d41/f53 [0,4194304] 0 2024-04-12T13:42:14.081 INFO:tasks.workunit.client.1.smithi110.stdout:0/628: link d1/f14 d1/d3c/da6/fdd 0 2024-04-12T13:42:14.082 INFO:tasks.workunit.client.0.smithi060.stdout:1/774: symlink d1e/d23/d2e/d30/l10f 0 2024-04-12T13:42:14.083 INFO:tasks.workunit.client.0.smithi060.stdout:6/729: write d1/d7/da/fbf [884064,45156] 0 2024-04-12T13:42:14.083 INFO:tasks.workunit.client.0.smithi060.stdout:7/648: truncate d0/d7/d43/d63/d6f/f7f 935189 0 2024-04-12T13:42:14.085 INFO:tasks.workunit.client.1.smithi110.stdout:5/686: write da/d2e/d45/d25/d9d/d7a/dae/fe5 [61375,99921] 0 2024-04-12T13:42:14.089 INFO:tasks.workunit.client.1.smithi110.stdout:8/718: read - d1/d3/d35/d3a/d3e/d64/d85/fd4 zero size 2024-04-12T13:42:14.092 INFO:tasks.workunit.client.1.smithi110.stdout:6/690: sync 2024-04-12T13:42:14.093 INFO:tasks.workunit.client.1.smithi110.stdout:0/629: creat d1/d27/d31/d89/fde x:0 0 0 2024-04-12T13:42:14.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/649: chown d0/d7/d43/d63 1088779 1 2024-04-12T13:42:14.094 INFO:tasks.workunit.client.1.smithi110.stdout:1/693: truncate de/f22 1950173 0 2024-04-12T13:42:14.097 INFO:tasks.workunit.client.1.smithi110.stdout:4/789: creat d0/de/da0/dd9/df3/de0/d7e/daa/dcd/fff x:0 0 0 2024-04-12T13:42:14.098 INFO:tasks.workunit.client.1.smithi110.stdout:3/676: chown d5/dc/d31/d3b/d32/d3e/d5f 13777872 1 2024-04-12T13:42:14.098 INFO:tasks.workunit.client.1.smithi110.stdout:5/687: mknod da/d2e/d45/d25/d9d/d79/d88/ced 0 2024-04-12T13:42:14.099 INFO:tasks.workunit.client.1.smithi110.stdout:7/729: dread d1/f6b [0,4194304] 0 2024-04-12T13:42:14.103 INFO:tasks.workunit.client.1.smithi110.stdout:9/776: dwrite df/d8a/faf [0,4194304] 0 2024-04-12T13:42:14.107 INFO:tasks.workunit.client.0.smithi060.stdout:0/617: truncate d7/d33/fb4 2817470 0 2024-04-12T13:42:14.113 INFO:tasks.workunit.client.0.smithi060.stdout:8/646: dread d9/d1b/d2b/f40 [0,4194304] 0 2024-04-12T13:42:14.115 INFO:tasks.workunit.client.1.smithi110.stdout:4/790: creat d0/de/da0/dd9/df3/f100 x:0 0 0 2024-04-12T13:42:14.115 INFO:tasks.workunit.client.0.smithi060.stdout:8/647: fsync f1 0 2024-04-12T13:42:14.118 INFO:tasks.workunit.client.0.smithi060.stdout:8/648: readlink d9/d1d/d2f/lcd 0 2024-04-12T13:42:14.121 INFO:tasks.workunit.client.1.smithi110.stdout:3/677: symlink d5/dc/d31/d3b/d32/ld2 0 2024-04-12T13:42:14.123 INFO:tasks.workunit.client.1.smithi110.stdout:0/630: creat d1/fdf x:0 0 0 2024-04-12T13:42:14.125 INFO:tasks.workunit.client.1.smithi110.stdout:5/688: dread da/db/f8d [0,4194304] 0 2024-04-12T13:42:14.128 INFO:tasks.workunit.client.1.smithi110.stdout:9/777: creat df/d38/d6e/d7f/f10a x:0 0 0 2024-04-12T13:42:14.128 INFO:tasks.workunit.client.1.smithi110.stdout:9/778: readlink df/d13/d2c/l50 0 2024-04-12T13:42:14.130 INFO:tasks.workunit.client.1.smithi110.stdout:6/691: link d7/d10/d1c/d2b/d48/d54/f86 d7/d10/d1c/d2b/d3a/fdc 0 2024-04-12T13:42:14.132 INFO:tasks.workunit.client.1.smithi110.stdout:3/678: rmdir d5/dc/d20/d2d/d4e/d89/dc0 39 2024-04-12T13:42:14.133 INFO:tasks.workunit.client.1.smithi110.stdout:3/679: read d5/f1f [2440389,89036] 0 2024-04-12T13:42:14.148 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:13 smithi060 ceph-mon[29097]: pgmap v31: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 192 MiB/s wr, 375 op/s 2024-04-12T13:42:14.148 INFO:tasks.workunit.client.1.smithi110.stdout:5/689: symlink da/d5c/lee 0 2024-04-12T13:42:14.150 INFO:tasks.workunit.client.1.smithi110.stdout:5/690: stat da/d2e/d45/d25 0 2024-04-12T13:42:14.153 INFO:tasks.workunit.client.1.smithi110.stdout:7/730: creat d1/d3/d4/d36/d76/ff6 x:0 0 0 2024-04-12T13:42:14.157 INFO:tasks.workunit.client.1.smithi110.stdout:3/680: mkdir d5/dc/d31/d3b/d32/dd3 0 2024-04-12T13:42:14.159 INFO:tasks.workunit.client.1.smithi110.stdout:3/681: fsync d5/dc/d31/d3b/d5b/f9a 0 2024-04-12T13:42:14.162 INFO:tasks.workunit.client.1.smithi110.stdout:4/791: rename d0/d75/d84/fc4 to d0/f101 0 2024-04-12T13:42:14.163 INFO:tasks.workunit.client.1.smithi110.stdout:1/694: write de/d7b/fc8 [825460,26301] 0 2024-04-12T13:42:14.174 INFO:tasks.workunit.client.0.smithi060.stdout:9/590: symlink d4/d9/d19/d8c/d92/lc4 0 2024-04-12T13:42:14.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/730: dread - d1/d7/da/dc/d24/d2d/db0/fb8 zero size 2024-04-12T13:42:14.181 INFO:tasks.workunit.client.0.smithi060.stdout:6/731: write d1/d7/da/dc/d24/d34/d51/d59/f87 [315659,10228] 0 2024-04-12T13:42:14.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/732: fsync d1/d7/da/dc/d24/d34/d51/d59/f4d 0 2024-04-12T13:42:14.216 INFO:tasks.workunit.client.1.smithi110.stdout:2/749: sync 2024-04-12T13:42:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:13 smithi110 ceph-mon[36055]: pgmap v31: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 192 MiB/s wr, 375 op/s 2024-04-12T13:42:14.255 INFO:tasks.workunit.client.1.smithi110.stdout:1/695: symlink de/d1d/d86/lf0 0 2024-04-12T13:42:14.256 INFO:tasks.workunit.client.0.smithi060.stdout:2/668: getdents d6/d56/d58 0 2024-04-12T13:42:14.259 INFO:tasks.workunit.client.1.smithi110.stdout:1/696: chown de/d15/d32/d61/c90 0 1 2024-04-12T13:42:14.263 INFO:tasks.workunit.client.1.smithi110.stdout:1/697: write de/d15/fed [38373,100508] 0 2024-04-12T13:42:14.264 INFO:tasks.workunit.client.1.smithi110.stdout:7/731: mknod d1/d31/cf7 0 2024-04-12T13:42:14.266 INFO:tasks.workunit.client.1.smithi110.stdout:7/732: stat d1/d3/f4c 0 2024-04-12T13:42:14.274 INFO:tasks.workunit.client.1.smithi110.stdout:9/779: rename df/d13/d26/d37/c106 to df/d38/d6e/dcb/c10b 0 2024-04-12T13:42:14.276 INFO:tasks.workunit.client.0.smithi060.stdout:9/591: symlink d4/d9/d19/d8c/lc5 0 2024-04-12T13:42:14.281 INFO:tasks.workunit.client.0.smithi060.stdout:1/775: mknod d1e/d23/d2e/d86/ddb/d107/c110 0 2024-04-12T13:42:14.281 INFO:tasks.workunit.client.0.smithi060.stdout:2/669: dwrite d6/f1b [0,4194304] 0 2024-04-12T13:42:14.281 INFO:tasks.workunit.client.1.smithi110.stdout:6/692: sync 2024-04-12T13:42:14.282 INFO:tasks.workunit.client.1.smithi110.stdout:8/719: sync 2024-04-12T13:42:14.282 INFO:tasks.workunit.client.1.smithi110.stdout:0/631: dwrite d1/d48/db2/f82 [0,4194304] 0 2024-04-12T13:42:14.287 INFO:tasks.workunit.client.1.smithi110.stdout:4/792: mkdir d0/de/d2c/d102 0 2024-04-12T13:42:14.291 INFO:tasks.workunit.client.1.smithi110.stdout:5/691: creat da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/d7c/fef x:0 0 0 2024-04-12T13:42:14.292 INFO:tasks.workunit.client.0.smithi060.stdout:6/733: symlink d1/d7/da/dc/d24/d34/d51/d97/lf3 0 2024-04-12T13:42:14.300 INFO:tasks.workunit.client.1.smithi110.stdout:2/750: sync 2024-04-12T13:42:14.302 INFO:tasks.workunit.client.0.smithi060.stdout:2/670: dwrite d6/f1b [0,4194304] 0 2024-04-12T13:42:14.302 INFO:tasks.workunit.client.1.smithi110.stdout:2/751: stat d6/f8 0 2024-04-12T13:42:14.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/702: sync 2024-04-12T13:42:14.313 INFO:tasks.workunit.client.0.smithi060.stdout:3/703: write d7/d17/d27/fc7 [558897,116552] 0 2024-04-12T13:42:14.317 INFO:tasks.workunit.client.0.smithi060.stdout:3/704: write d7/d17/d19/f4e [1041691,57356] 0 2024-04-12T13:42:14.324 INFO:tasks.workunit.client.0.smithi060.stdout:1/776: creat d1e/d46/d8d/f111 x:0 0 0 2024-04-12T13:42:14.325 INFO:tasks.workunit.client.0.smithi060.stdout:2/671: dread d6/d64/d99/f9e [0,4194304] 0 2024-04-12T13:42:14.328 INFO:tasks.workunit.client.0.smithi060.stdout:8/649: dwrite d9/d1b/d37/d4d/d63/f89 [0,4194304] 0 2024-04-12T13:42:14.329 INFO:tasks.workunit.client.1.smithi110.stdout:0/632: creat d1/d8/d8a/fe0 x:0 0 0 2024-04-12T13:42:14.330 INFO:tasks.workunit.client.1.smithi110.stdout:8/720: creat d1/d3/d35/d3a/d3e/d64/d85/fe7 x:0 0 0 2024-04-12T13:42:14.331 INFO:tasks.workunit.client.0.smithi060.stdout:8/650: read f1 [2442098,36399] 0 2024-04-12T13:42:14.331 INFO:tasks.workunit.client.0.smithi060.stdout:7/650: rename d0/d7/l20 to d0/ld4 0 2024-04-12T13:42:14.334 INFO:tasks.workunit.client.1.smithi110.stdout:3/682: truncate d5/dc/f19 930703 0 2024-04-12T13:42:14.336 INFO:tasks.workunit.client.0.smithi060.stdout:8/651: fsync d9/d1b/d37/d4d/d63/fa9 0 2024-04-12T13:42:14.338 INFO:tasks.workunit.client.1.smithi110.stdout:4/793: chown d0/de/d2c/cfb 1564 1 2024-04-12T13:42:14.339 INFO:tasks.workunit.client.1.smithi110.stdout:5/692: creat da/d2e/d45/d25/d9d/d7a/dae/ff0 x:0 0 0 2024-04-12T13:42:14.342 INFO:tasks.workunit.client.1.smithi110.stdout:2/752: unlink d6/c8b 0 2024-04-12T13:42:14.342 INFO:tasks.workunit.client.0.smithi060.stdout:1/777: symlink d1e/dcc/l112 0 2024-04-12T13:42:14.345 INFO:tasks.workunit.client.1.smithi110.stdout:7/733: rename d1/d3/d4/d55/d56/d72/cc9 to d1/d3/d4/dbf/db6/cf8 0 2024-04-12T13:42:14.346 INFO:tasks.workunit.client.1.smithi110.stdout:9/780: mkdir df/d13/d26/d37/d6a/dfe/d10c 0 2024-04-12T13:42:14.346 INFO:tasks.workunit.client.0.smithi060.stdout:2/672: symlink d6/d10/d16/lc9 0 2024-04-12T13:42:14.349 INFO:tasks.workunit.client.0.smithi060.stdout:7/651: mknod d0/d3d/d74/cd5 0 2024-04-12T13:42:14.349 INFO:tasks.workunit.client.1.smithi110.stdout:5/693: readlink da/db/la8 0 2024-04-12T13:42:14.350 INFO:tasks.workunit.client.0.smithi060.stdout:7/652: dread - d0/d7/d43/d63/d6f/f82 zero size 2024-04-12T13:42:14.351 INFO:tasks.workunit.client.1.smithi110.stdout:4/794: mkdir d0/d75/d84/d89/d103 0 2024-04-12T13:42:14.354 INFO:tasks.workunit.client.1.smithi110.stdout:4/795: chown d0/d13/f52 35 1 2024-04-12T13:42:14.354 INFO:tasks.workunit.client.1.smithi110.stdout:0/633: dwrite d1/fdf [0,4194304] 0 2024-04-12T13:42:14.354 INFO:tasks.workunit.client.0.smithi060.stdout:8/652: write d9/d1b/d2b/fe0 [16090,4985] 0 2024-04-12T13:42:14.355 INFO:tasks.workunit.client.0.smithi060.stdout:3/705: creat d7/d17/d27/d36/db0/dc4/fe7 x:0 0 0 2024-04-12T13:42:14.356 INFO:tasks.workunit.client.1.smithi110.stdout:4/796: fdatasync d0/f15 0 2024-04-12T13:42:14.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/653: chown d9/d1b/d37/d48/lb0 2 1 2024-04-12T13:42:14.359 INFO:tasks.workunit.client.1.smithi110.stdout:0/634: write d1/d5e/fd1 [196599,74235] 0 2024-04-12T13:42:14.360 INFO:tasks.workunit.client.1.smithi110.stdout:6/693: dread d7/d10/d1c/f42 [0,4194304] 0 2024-04-12T13:42:14.360 INFO:tasks.workunit.client.1.smithi110.stdout:9/781: symlink df/d38/d6e/dcb/l10d 0 2024-04-12T13:42:14.366 INFO:tasks.workunit.client.1.smithi110.stdout:7/734: truncate d1/d3/d4/d36/d76/f8a 340623 0 2024-04-12T13:42:14.367 INFO:tasks.workunit.client.1.smithi110.stdout:8/721: dread d1/d3/d35/d3a/d41/f51 [0,4194304] 0 2024-04-12T13:42:14.371 INFO:tasks.workunit.client.0.smithi060.stdout:9/592: dwrite d4/d8/d32/f99 [0,4194304] 0 2024-04-12T13:42:14.374 INFO:tasks.workunit.client.1.smithi110.stdout:6/694: read - d7/d10/fb6 zero size 2024-04-12T13:42:14.376 INFO:tasks.workunit.client.0.smithi060.stdout:8/654: unlink d9/d1b/d3c/d6e/d7b/db1/ccb 0 2024-04-12T13:42:14.377 INFO:tasks.workunit.client.1.smithi110.stdout:6/695: chown d7/d10/d1c/d2b/d48/d4b/dcc 471 1 2024-04-12T13:42:14.378 INFO:tasks.workunit.client.0.smithi060.stdout:3/706: dwrite d7/d17/d19/d96/fd4 [0,4194304] 0 2024-04-12T13:42:14.380 INFO:tasks.workunit.client.0.smithi060.stdout:3/707: readlink d7/d17/d19/dc9/d3f/laa 0 2024-04-12T13:42:14.382 INFO:tasks.workunit.client.0.smithi060.stdout:3/708: fdatasync d7/f47 0 2024-04-12T13:42:14.384 INFO:tasks.workunit.client.1.smithi110.stdout:4/797: fsync d0/d78/fb4 0 2024-04-12T13:42:14.384 INFO:tasks.workunit.client.1.smithi110.stdout:1/698: dwrite fb [0,4194304] 0 2024-04-12T13:42:14.385 INFO:tasks.workunit.client.1.smithi110.stdout:1/699: readlink de/d14/l24 0 2024-04-12T13:42:14.386 INFO:tasks.workunit.client.0.smithi060.stdout:8/655: readlink d9/l34 0 2024-04-12T13:42:14.387 INFO:tasks.workunit.client.1.smithi110.stdout:1/700: readlink de/d14/d34/d55/d6b/l94 0 2024-04-12T13:42:14.397 INFO:tasks.workunit.client.0.smithi060.stdout:4/651: sync 2024-04-12T13:42:14.397 INFO:tasks.workunit.client.0.smithi060.stdout:5/668: sync 2024-04-12T13:42:14.397 INFO:tasks.workunit.client.1.smithi110.stdout:9/782: dread df/d13/d2c/d2d/dc1/d83/d5d/f7e [0,4194304] 0 2024-04-12T13:42:14.401 INFO:tasks.workunit.client.1.smithi110.stdout:0/635: truncate d1/d8/f3d 1317487 0 2024-04-12T13:42:14.404 INFO:tasks.workunit.client.1.smithi110.stdout:7/735: dread d1/d3/d4/dbf/fb9 [0,4194304] 0 2024-04-12T13:42:14.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/683: truncate d5/f99 4130055 0 2024-04-12T13:42:14.405 INFO:tasks.workunit.client.0.smithi060.stdout:2/673: write d6/d10/daa/db0/f4c [998921,22449] 0 2024-04-12T13:42:14.407 INFO:tasks.workunit.client.0.smithi060.stdout:7/653: truncate d0/d78/f97 414555 0 2024-04-12T13:42:14.409 INFO:tasks.workunit.client.0.smithi060.stdout:8/656: creat d9/d1d/d5e/d90/fe7 x:0 0 0 2024-04-12T13:42:14.409 INFO:tasks.workunit.client.1.smithi110.stdout:2/753: dwrite d6/dc/dd/d49/d64/d25/f73 [0,4194304] 0 2024-04-12T13:42:14.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/709: creat d7/d17/d27/d36/db0/dd9/fe8 x:0 0 0 2024-04-12T13:42:14.415 INFO:tasks.workunit.client.0.smithi060.stdout:8/657: dread - d9/d1b/d84/fb9 zero size 2024-04-12T13:42:14.418 INFO:tasks.workunit.client.1.smithi110.stdout:0/636: dread d1/d8/d36/d51/d60/f18 [0,4194304] 0 2024-04-12T13:42:14.419 INFO:tasks.workunit.client.1.smithi110.stdout:5/694: getdents da/d2e 0 2024-04-12T13:42:14.420 INFO:tasks.workunit.client.1.smithi110.stdout:1/701: chown de/d15/da9/lb0 6065178 1 2024-04-12T13:42:14.422 INFO:tasks.workunit.client.0.smithi060.stdout:1/778: dwrite d1e/d23/dd9/faf [0,4194304] 0 2024-04-12T13:42:14.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/669: dwrite d6/dd/d1f/d32/da2/fbf [0,4194304] 0 2024-04-12T13:42:14.432 INFO:tasks.workunit.client.1.smithi110.stdout:8/722: rename d1/d3/d35/d3a/d3e/d4f/lbd to d1/d5/dd/le8 0 2024-04-12T13:42:14.433 INFO:tasks.workunit.client.1.smithi110.stdout:7/736: dwrite d1/d3/d4/d55/d82/fd4 [0,4194304] 0 2024-04-12T13:42:14.433 INFO:tasks.workunit.client.1.smithi110.stdout:9/783: rmdir df/d13/d26/d37/d6a/dfe 39 2024-04-12T13:42:14.434 INFO:tasks.workunit.client.0.smithi060.stdout:7/654: dread d0/d7/d43/d63/f9f [0,4194304] 0 2024-04-12T13:42:14.437 INFO:tasks.workunit.client.0.smithi060.stdout:9/593: dwrite d4/f2d [4194304,4194304] 0 2024-04-12T13:42:14.438 INFO:tasks.workunit.client.1.smithi110.stdout:5/695: dread - da/d2e/d45/d25/d9d/d79/d88/dd3/fe3 zero size 2024-04-12T13:42:14.439 INFO:tasks.workunit.client.0.smithi060.stdout:3/710: fdatasync d7/d17/d27/d36/f46 0 2024-04-12T13:42:14.440 INFO:tasks.workunit.client.1.smithi110.stdout:3/684: creat d5/dc/d31/d74/fd4 x:0 0 0 2024-04-12T13:42:14.450 INFO:tasks.workunit.client.1.smithi110.stdout:4/798: creat d0/de/d32/d61/f104 x:0 0 0 2024-04-12T13:42:14.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/618: sync 2024-04-12T13:42:14.452 INFO:tasks.workunit.client.0.smithi060.stdout:2/674: dread d6/f15 [0,4194304] 0 2024-04-12T13:42:14.452 INFO:tasks.workunit.client.0.smithi060.stdout:6/734: sync 2024-04-12T13:42:14.454 INFO:tasks.workunit.client.1.smithi110.stdout:0/637: rmdir d1/d27/d31/d67/dcb 39 2024-04-12T13:42:14.457 INFO:tasks.workunit.client.0.smithi060.stdout:4/652: getdents d6/d7/dd/d1a/d19/d7a 0 2024-04-12T13:42:14.458 INFO:tasks.workunit.client.0.smithi060.stdout:6/735: fdatasync d1/d7/da/dc/fdd 0 2024-04-12T13:42:14.459 INFO:tasks.workunit.client.1.smithi110.stdout:1/702: unlink de/d7b/fc8 0 2024-04-12T13:42:14.461 INFO:tasks.workunit.client.0.smithi060.stdout:6/736: fdatasync d1/d7/f5d 0 2024-04-12T13:42:14.464 INFO:tasks.workunit.client.0.smithi060.stdout:4/653: write d6/d7/dd/d4d/d69/f8a [349722,38588] 0 2024-04-12T13:42:14.465 INFO:tasks.workunit.client.0.smithi060.stdout:9/594: dwrite d4/d33/d65/f91 [4194304,4194304] 0 2024-04-12T13:42:14.469 INFO:tasks.workunit.client.0.smithi060.stdout:8/658: dread d9/d1b/d3c/d6e/fa5 [0,4194304] 0 2024-04-12T13:42:14.482 INFO:tasks.workunit.client.1.smithi110.stdout:1/703: dread de/d15/d32/fb2 [0,4194304] 0 2024-04-12T13:42:14.486 INFO:tasks.workunit.client.0.smithi060.stdout:0/619: dread d7/d9/f21 [0,4194304] 0 2024-04-12T13:42:14.501 INFO:tasks.workunit.client.1.smithi110.stdout:1/704: dwrite de/d15/dab/dd8/dd9/dda/fbe [4194304,4194304] 0 2024-04-12T13:42:14.509 INFO:tasks.workunit.client.1.smithi110.stdout:2/754: sync 2024-04-12T13:42:14.556 INFO:tasks.workunit.client.0.smithi060.stdout:1/779: mknod d1e/d23/d2e/d5e/df0/df7/c113 0 2024-04-12T13:42:14.559 INFO:tasks.workunit.client.0.smithi060.stdout:1/780: truncate d1e/d1f/f6e 558446 0 2024-04-12T13:42:14.563 INFO:tasks.workunit.client.1.smithi110.stdout:6/696: truncate d7/d10/f62 1496703 0 2024-04-12T13:42:14.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/670: dwrite d6/d10/d12/d38/f66 [0,4194304] 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:5/671: read - d6/dd/fcf zero size 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:3/711: write d7/d17/d19/d33/d63/d9b/dc0/fe0 [808681,124153] 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:4/654: unlink d6/d7/dd/d1a/d19/d42/d7c/cb4 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:5/672: dread f2 [0,4194304] 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:1/781: dread d1e/d23/d2e/d30/d51/f8a [0,4194304] 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.0.smithi060.stdout:5/673: chown d6/dd/d27/cb9 1027568 1 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:4/799: chown d0/de/d2c/c38 970000 1 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:0/638: rename d1/d27/d31/d67/lb4 to d1/d3c/dd8/le1 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:1/705: mknod de/d15/d32/d61/d6a/dac/dc0/dea/cf1 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:1/706: write de/d14/dd0/f7a [3726438,129850] 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:8/723: mknod d1/d3/d35/d3a/d3e/ce9 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:9/784: mkdir df/d13/d2c/d2d/dd3/d10e 0 2024-04-12T13:42:14.617 INFO:tasks.workunit.client.1.smithi110.stdout:3/685: mkdir d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5 0 2024-04-12T13:42:14.620 INFO:tasks.workunit.client.0.smithi060.stdout:5/674: fsync d6/d10/d12/d38/f40 0 2024-04-12T13:42:14.627 INFO:tasks.workunit.client.0.smithi060.stdout:6/737: link d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/cd9 d1/d7/da/dc/d24/d34/d51/cf4 0 2024-04-12T13:42:14.629 INFO:tasks.workunit.client.1.smithi110.stdout:9/785: symlink df/d8a/l10f 0 2024-04-12T13:42:14.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/782: truncate d1e/d29/f44 1078274 0 2024-04-12T13:42:14.634 INFO:tasks.workunit.client.1.smithi110.stdout:6/697: creat d7/d25/d2c/d4c/d77/db9/fdd x:0 0 0 2024-04-12T13:42:14.637 INFO:tasks.workunit.client.1.smithi110.stdout:5/696: link da/d2e/d45/d25/d5d/fbd da/ff1 0 2024-04-12T13:42:14.637 INFO:tasks.workunit.client.0.smithi060.stdout:2/675: getdents d6/d56/d55 0 2024-04-12T13:42:14.640 INFO:tasks.workunit.client.0.smithi060.stdout:6/738: unlink d1/d7/da/dc/d24/d30/d52/d78/d80/fe4 0 2024-04-12T13:42:14.641 INFO:tasks.workunit.client.0.smithi060.stdout:1/783: dread d1e/d23/d2e/d30/d51/d85/ffb [0,4194304] 0 2024-04-12T13:42:14.642 INFO:tasks.workunit.client.1.smithi110.stdout:5/697: chown da/d2e/d45/d25/d9d/d79/cde 3 1 2024-04-12T13:42:14.643 INFO:tasks.workunit.client.0.smithi060.stdout:1/784: fdatasync d1e/d23/d49/d4e/ff6 0 2024-04-12T13:42:14.647 INFO:tasks.workunit.client.0.smithi060.stdout:8/659: sync 2024-04-12T13:42:14.649 INFO:tasks.workunit.client.0.smithi060.stdout:8/660: dread - d9/d1b/d2b/fb4 zero size 2024-04-12T13:42:14.650 INFO:tasks.workunit.client.1.smithi110.stdout:5/698: dread - da/db/d3b/d40/da2/fdf zero size 2024-04-12T13:42:14.650 INFO:tasks.workunit.client.1.smithi110.stdout:1/707: unlink de/d14/d34/d55/d6b/f6f 0 2024-04-12T13:42:14.651 INFO:tasks.workunit.client.1.smithi110.stdout:7/737: getdents d1/d1b/d3d 0 2024-04-12T13:42:14.654 INFO:tasks.workunit.client.0.smithi060.stdout:8/661: write d9/d1b/d37/d4d/d63/fa9 [352329,37410] 0 2024-04-12T13:42:14.659 INFO:tasks.workunit.client.0.smithi060.stdout:5/675: dread d6/dd/d1f/d32/d46/f82 [0,4194304] 0 2024-04-12T13:42:14.659 INFO:tasks.workunit.client.1.smithi110.stdout:6/698: dwrite d7/d10/d1c/d2b/f91 [0,4194304] 0 2024-04-12T13:42:14.660 INFO:tasks.workunit.client.0.smithi060.stdout:4/655: rename d6/d7/dd/d1a/d19/d7a/lb3 to d6/d7/dd/d1a/d57/d63/d68/d76/dbd/ld8 0 2024-04-12T13:42:14.662 INFO:tasks.workunit.client.0.smithi060.stdout:6/739: creat d1/d7/da/dc/ff5 x:0 0 0 2024-04-12T13:42:14.664 INFO:tasks.workunit.client.0.smithi060.stdout:5/676: truncate d6/d10/d12/d4c/fcd 715291 0 2024-04-12T13:42:14.664 INFO:tasks.workunit.client.1.smithi110.stdout:6/699: write d7/d25/d2c/d4c/d77/d93/fd4 [543586,69125] 0 2024-04-12T13:42:14.664 INFO:tasks.workunit.client.1.smithi110.stdout:0/639: rmdir d1/d8/d36/dc6 0 2024-04-12T13:42:14.667 INFO:tasks.workunit.client.1.smithi110.stdout:8/724: dread d1/d7/f3f [0,4194304] 0 2024-04-12T13:42:14.668 INFO:tasks.workunit.client.1.smithi110.stdout:6/700: fsync d7/da9/fd8 0 2024-04-12T13:42:14.669 INFO:tasks.workunit.client.0.smithi060.stdout:8/662: rename f2 to d9/d1b/d3c/d6e/dbd/fe8 0 2024-04-12T13:42:14.672 INFO:tasks.workunit.client.1.smithi110.stdout:9/786: mkdir df/d13/d2c/d2d/dc1/d83/d63/db4/ddb/d110 0 2024-04-12T13:42:14.677 INFO:tasks.workunit.client.1.smithi110.stdout:9/787: stat df/d13/d2c/d2d/dc1/d83/d5d/f7e 0 2024-04-12T13:42:14.680 INFO:tasks.workunit.client.0.smithi060.stdout:5/677: creat d6/dd/d1f/d25/d42/d52/fe1 x:0 0 0 2024-04-12T13:42:14.681 INFO:tasks.workunit.client.1.smithi110.stdout:7/738: dwrite d1/d3/d4/d36/d76/ff6 [0,4194304] 0 2024-04-12T13:42:14.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/678: stat d6/d10/d12/d4c/cb1 0 2024-04-12T13:42:14.686 INFO:tasks.workunit.client.0.smithi060.stdout:5/679: rmdir d6/dd/d1f/d25/d53/d87 39 2024-04-12T13:42:14.693 INFO:tasks.workunit.client.1.smithi110.stdout:8/725: dread d1/d5/d1f/f66 [0,4194304] 0 2024-04-12T13:42:14.695 INFO:tasks.workunit.client.1.smithi110.stdout:9/788: truncate df/d38/f95 659106 0 2024-04-12T13:42:14.696 INFO:tasks.workunit.client.0.smithi060.stdout:5/680: fsync d6/d10/f31 0 2024-04-12T13:42:14.697 INFO:tasks.workunit.client.1.smithi110.stdout:9/789: read - df/d13/d2c/d2d/dc1/ffa zero size 2024-04-12T13:42:14.698 INFO:tasks.workunit.client.1.smithi110.stdout:8/726: truncate d1/d3/d35/d3a/d3e/d4f/fd6 320428 0 2024-04-12T13:42:14.699 INFO:tasks.workunit.client.1.smithi110.stdout:0/640: getdents d1/d27/d31/d89 0 2024-04-12T13:42:14.702 INFO:tasks.workunit.client.0.smithi060.stdout:5/681: unlink d6/dd/d1f/d32/d3d/c58 0 2024-04-12T13:42:14.706 INFO:tasks.workunit.client.1.smithi110.stdout:6/701: getdents d7/d25/d2c/d4c/d77/dd3 0 2024-04-12T13:42:14.707 INFO:tasks.workunit.client.0.smithi060.stdout:5/682: dread - d6/dd/d1f/d25/d42/d52/d7a/fa4 zero size 2024-04-12T13:42:14.710 INFO:tasks.workunit.client.1.smithi110.stdout:8/727: creat d1/d5/dd/d31/fea x:0 0 0 2024-04-12T13:42:14.719 INFO:tasks.workunit.client.1.smithi110.stdout:9/790: dwrite df/d13/d26/f45 [0,4194304] 0 2024-04-12T13:42:14.720 INFO:tasks.workunit.client.1.smithi110.stdout:0/641: dwrite d1/fd9 [0,4194304] 0 2024-04-12T13:42:14.720 INFO:tasks.workunit.client.1.smithi110.stdout:8/728: mknod d1/d3/d35/d43/d9f/ceb 0 2024-04-12T13:42:14.725 INFO:tasks.workunit.client.1.smithi110.stdout:9/791: chown df/d13/d26/d37/d6a/f76 318167934 1 2024-04-12T13:42:14.732 INFO:tasks.workunit.client.1.smithi110.stdout:8/729: creat d1/d45/fec x:0 0 0 2024-04-12T13:42:14.734 INFO:tasks.workunit.client.1.smithi110.stdout:9/792: creat df/d13/d2c/d9e/f111 x:0 0 0 2024-04-12T13:42:14.736 INFO:tasks.workunit.client.1.smithi110.stdout:8/730: dread d1/d3/d35/d3a/d41/fb0 [0,4194304] 0 2024-04-12T13:42:14.740 INFO:tasks.workunit.client.1.smithi110.stdout:9/793: symlink df/d13/d2c/l112 0 2024-04-12T13:42:14.741 INFO:tasks.workunit.client.1.smithi110.stdout:8/731: truncate d1/d3/d3c/d75/d79/fad 5200642 0 2024-04-12T13:42:14.742 INFO:tasks.workunit.client.0.smithi060.stdout:7/655: truncate d0/d1b/d8c/faf 838483 0 2024-04-12T13:42:14.744 INFO:tasks.workunit.client.1.smithi110.stdout:8/732: fsync d1/d3/d3c/d75/d79/fa5 0 2024-04-12T13:42:14.745 INFO:tasks.workunit.client.1.smithi110.stdout:9/794: creat df/d13/d2c/d66/f113 x:0 0 0 2024-04-12T13:42:14.758 INFO:tasks.workunit.client.0.smithi060.stdout:7/656: link d0/d7/d92/l99 d0/d7/d43/d63/ld6 0 2024-04-12T13:42:14.761 INFO:tasks.workunit.client.0.smithi060.stdout:7/657: chown d0/d7/c15 1082251675 1 2024-04-12T13:42:14.766 INFO:tasks.workunit.client.0.smithi060.stdout:7/658: mkdir d0/d3d/dd7 0 2024-04-12T13:42:14.770 INFO:tasks.workunit.client.0.smithi060.stdout:9/595: dwrite d4/d9/d19/d21/d73/d67/f2b [0,4194304] 0 2024-04-12T13:42:14.771 INFO:tasks.workunit.client.1.smithi110.stdout:8/733: dread d1/d5/dd/fc0 [0,4194304] 0 2024-04-12T13:42:14.771 INFO:tasks.workunit.client.1.smithi110.stdout:2/755: write d6/dc/d13/f7b [4699,57928] 0 2024-04-12T13:42:14.776 INFO:tasks.workunit.client.1.smithi110.stdout:8/734: unlink d1/d5/dd/fc0 0 2024-04-12T13:42:14.778 INFO:tasks.workunit.client.1.smithi110.stdout:2/756: mknod d6/dc/d13/d80/d8d/dcc/ce6 0 2024-04-12T13:42:14.779 INFO:tasks.workunit.client.0.smithi060.stdout:3/712: write d7/d17/d19/dc9/d3f/d5c/f8d [3069145,90927] 0 2024-04-12T13:42:14.780 INFO:tasks.workunit.client.1.smithi110.stdout:8/735: chown d1/d3/d3c/d5a/d6f/d7e/f71 308 1 2024-04-12T13:42:14.782 INFO:tasks.workunit.client.1.smithi110.stdout:8/736: read d1/d7/f3f [1514227,26772] 0 2024-04-12T13:42:14.784 INFO:tasks.workunit.client.0.smithi060.stdout:3/713: chown d7/d17/d19/dc9/d3f/d5c/l15 1094 1 2024-04-12T13:42:14.790 INFO:tasks.workunit.client.1.smithi110.stdout:2/757: creat d6/dc/dd/d49/d64/d4a/d51/fe7 x:0 0 0 2024-04-12T13:42:14.790 INFO:tasks.workunit.client.1.smithi110.stdout:2/758: write d6/dc/f3f [436679,111221] 0 2024-04-12T13:42:14.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/714: mkdir d7/d17/d27/d36/db0/dc4/de9 0 2024-04-12T13:42:14.803 INFO:tasks.workunit.client.1.smithi110.stdout:4/800: truncate d0/de/d2c/d57/fd8 1507465 0 2024-04-12T13:42:14.807 INFO:tasks.workunit.client.0.smithi060.stdout:4/656: mkdir d6/d7/dd/d1a/d19/d42/dd9 0 2024-04-12T13:42:14.811 INFO:tasks.workunit.client.0.smithi060.stdout:3/715: dwrite d7/d17/d27/d36/db0/fd6 [0,4194304] 0 2024-04-12T13:42:14.811 INFO:tasks.workunit.client.0.smithi060.stdout:4/657: mknod d6/db7/dbb/cda 0 2024-04-12T13:42:14.813 INFO:tasks.workunit.client.1.smithi110.stdout:3/686: truncate d5/dc/d31/d3b/d32/d3e/f44 3397219 0 2024-04-12T13:42:14.814 INFO:tasks.workunit.client.0.smithi060.stdout:3/716: readlink d7/d17/d19/l93 0 2024-04-12T13:42:14.818 INFO:tasks.workunit.client.1.smithi110.stdout:8/737: dread d1/d7/d20/f36 [0,4194304] 0 2024-04-12T13:42:14.821 INFO:tasks.workunit.client.1.smithi110.stdout:8/738: stat d1/d3/d3c/d5a 0 2024-04-12T13:42:14.823 INFO:tasks.workunit.client.1.smithi110.stdout:3/687: creat d5/dc/dcf/fd6 x:0 0 0 2024-04-12T13:42:14.824 INFO:tasks.workunit.client.1.smithi110.stdout:1/708: sync 2024-04-12T13:42:14.825 INFO:tasks.workunit.client.0.smithi060.stdout:2/676: symlink d6/dae/d31/lca 0 2024-04-12T13:42:14.826 INFO:tasks.workunit.client.1.smithi110.stdout:8/739: stat d1/d3/d35/d3a/l54 0 2024-04-12T13:42:14.826 INFO:tasks.workunit.client.1.smithi110.stdout:4/801: dwrite d0/de/d32/f7d [0,4194304] 0 2024-04-12T13:42:14.831 INFO:tasks.workunit.client.1.smithi110.stdout:8/740: write d1/d3/d35/d43/d9f/fbf [858940,119162] 0 2024-04-12T13:42:14.831 INFO:tasks.workunit.client.1.smithi110.stdout:7/739: write d1/d3/d4/d55/d82/f6a [1027480,54169] 0 2024-04-12T13:42:14.833 INFO:tasks.workunit.client.1.smithi110.stdout:5/699: dwrite f9 [4194304,4194304] 0 2024-04-12T13:42:14.834 INFO:tasks.workunit.client.0.smithi060.stdout:0/620: dread d7/d9/d14/f34 [0,4194304] 0 2024-04-12T13:42:14.834 INFO:tasks.workunit.client.1.smithi110.stdout:1/709: fsync de/d15/d32/d61/d6a/dac/fdf 0 2024-04-12T13:42:14.839 INFO:tasks.workunit.client.1.smithi110.stdout:3/688: mkdir d5/dc/d20/d2d/d4f/dce/dd7 0 2024-04-12T13:42:14.840 INFO:tasks.workunit.client.0.smithi060.stdout:6/740: dwrite d1/d7/da/dc/d24/d30/d52/d78/d80/f85 [0,4194304] 0 2024-04-12T13:42:14.842 INFO:tasks.workunit.client.0.smithi060.stdout:6/741: readlink d1/d7/da/dc/d24/d30/l53 0 2024-04-12T13:42:14.845 INFO:tasks.workunit.client.1.smithi110.stdout:4/802: creat d0/de/d32/d61/de9/f105 x:0 0 0 2024-04-12T13:42:14.850 INFO:tasks.workunit.client.0.smithi060.stdout:0/621: creat d7/d9/de/fce x:0 0 0 2024-04-12T13:42:14.852 INFO:tasks.workunit.client.0.smithi060.stdout:2/677: getdents d6/d10/d16/d36 0 2024-04-12T13:42:14.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/658: dread d6/d21/f27 [0,4194304] 0 2024-04-12T13:42:14.855 INFO:tasks.workunit.client.1.smithi110.stdout:5/700: symlink da/db/d3b/lf2 0 2024-04-12T13:42:14.855 INFO:tasks.workunit.client.1.smithi110.stdout:7/740: creat d1/d3/d4/d55/d82/ff9 x:0 0 0 2024-04-12T13:42:14.855 INFO:tasks.workunit.client.1.smithi110.stdout:1/710: truncate de/d14/d34/f40 4418876 0 2024-04-12T13:42:14.857 INFO:tasks.workunit.client.1.smithi110.stdout:7/741: chown d1/d1b/d3d/f9e 21 1 2024-04-12T13:42:14.859 INFO:tasks.workunit.client.1.smithi110.stdout:1/711: dread - de/d15/dab/dd8/dd9/dda/fb9 zero size 2024-04-12T13:42:14.860 INFO:tasks.workunit.client.0.smithi060.stdout:3/717: dread d7/d17/d19/d33/fe4 [0,4194304] 0 2024-04-12T13:42:14.860 INFO:tasks.workunit.client.0.smithi060.stdout:2/678: write d6/dae/d31/d33/fa5 [41218,62024] 0 2024-04-12T13:42:14.860 INFO:tasks.workunit.client.0.smithi060.stdout:5/683: dwrite d6/d10/d12/d38/f40 [0,4194304] 0 2024-04-12T13:42:14.866 INFO:tasks.workunit.client.0.smithi060.stdout:5/684: chown d6/d10/d12/l5d 1 1 2024-04-12T13:42:14.868 INFO:tasks.workunit.client.0.smithi060.stdout:3/718: chown d7/d17/d19/d33/d63/d9b/fd0 65 1 2024-04-12T13:42:14.868 INFO:tasks.workunit.client.0.smithi060.stdout:6/742: creat d1/d7/da/dc/d24/d30/d52/d5e/d7b/ff6 x:0 0 0 2024-04-12T13:42:14.869 INFO:tasks.workunit.client.1.smithi110.stdout:6/702: dwrite d7/f73 [0,4194304] 0 2024-04-12T13:42:14.870 INFO:tasks.workunit.client.0.smithi060.stdout:0/622: dread d7/f66 [0,4194304] 0 2024-04-12T13:42:14.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/679: truncate d6/dae/d31/fab 82528 0 2024-04-12T13:42:14.878 INFO:tasks.workunit.client.0.smithi060.stdout:8/663: rename d9/d1b/f47 to d9/d1b/d3c/d6e/fe9 0 2024-04-12T13:42:14.881 INFO:tasks.workunit.client.0.smithi060.stdout:3/719: chown d7/d17/l1b 90994 1 2024-04-12T13:42:14.881 INFO:tasks.workunit.client.0.smithi060.stdout:8/664: chown d9/d1b/d2b/d82/d8a/dce 1 1 2024-04-12T13:42:14.883 INFO:tasks.workunit.client.1.smithi110.stdout:6/703: dwrite d7/d25/dc6/fca [0,4194304] 0 2024-04-12T13:42:14.888 INFO:tasks.workunit.client.0.smithi060.stdout:3/720: readlink d7/d17/d19/d33/d63/d6d/d91/lb3 0 2024-04-12T13:42:14.892 INFO:tasks.workunit.client.1.smithi110.stdout:0/642: write d1/d3c/da6/fdd [4279903,47402] 0 2024-04-12T13:42:14.898 INFO:tasks.workunit.client.0.smithi060.stdout:0/623: mkdir d7/d9/d14/d35/d44/d49/dcf 0 2024-04-12T13:42:14.906 INFO:tasks.workunit.client.1.smithi110.stdout:9/795: write df/d38/d6e/faa [4143155,103580] 0 2024-04-12T13:42:14.907 INFO:tasks.workunit.client.1.smithi110.stdout:0/643: dwrite d1/d8/d36/d51/d60/f2b [0,4194304] 0 2024-04-12T13:42:14.909 INFO:tasks.workunit.client.1.smithi110.stdout:9/796: chown df/d38/d6e/lf9 3 1 2024-04-12T13:42:14.909 INFO:tasks.workunit.client.0.smithi060.stdout:8/665: creat d9/d1b/d2b/fea x:0 0 0 2024-04-12T13:42:14.911 INFO:tasks.workunit.client.1.smithi110.stdout:9/797: chown df/d13/d2c/d2d/d39/d4f/l75 28103 1 2024-04-12T13:42:14.912 INFO:tasks.workunit.client.0.smithi060.stdout:2/680: link d6/d10/d81/dbd/f28 d6/d64/d99/fcb 0 2024-04-12T13:42:14.916 INFO:tasks.workunit.client.0.smithi060.stdout:3/721: dwrite d7/d17/d19/d33/d63/d9b/fd0 [0,4194304] 0 2024-04-12T13:42:14.917 INFO:tasks.workunit.client.0.smithi060.stdout:6/743: dread d1/d7/da/dc/d24/d2d/f3d [0,4194304] 0 2024-04-12T13:42:14.918 INFO:tasks.workunit.client.0.smithi060.stdout:7/659: rename d0/d1b/f72 to d0/fd8 0 2024-04-12T13:42:14.931 INFO:tasks.workunit.client.0.smithi060.stdout:8/666: symlink d9/d1b/d37/d4d/d63/leb 0 2024-04-12T13:42:14.931 INFO:tasks.workunit.client.0.smithi060.stdout:4/659: symlink d6/d7/ldb 0 2024-04-12T13:42:14.934 INFO:tasks.workunit.client.0.smithi060.stdout:0/624: mkdir d7/d9/d14/d35/d44/d49/dcf/dd0 0 2024-04-12T13:42:14.936 INFO:tasks.workunit.client.0.smithi060.stdout:7/660: dwrite d0/fb0 [0,4194304] 0 2024-04-12T13:42:14.937 INFO:tasks.workunit.client.0.smithi060.stdout:8/667: chown d9/d1b/d2b/d82/f8e 398 1 2024-04-12T13:42:14.942 INFO:tasks.workunit.client.0.smithi060.stdout:4/660: write d6/d7/dd/d1a/d19/d42/d7c/fb9 [4254459,68275] 0 2024-04-12T13:42:14.947 INFO:tasks.workunit.client.0.smithi060.stdout:5/685: rename d6/dd/d1f/l24 to d6/dd/d1f/d25/d53/d87/d7e/dca/le2 0 2024-04-12T13:42:14.949 INFO:tasks.workunit.client.1.smithi110.stdout:8/741: link d1/d3/d35/d3a/d3e/d4f/fd6 d1/d3/d35/d3a/d84/d9e/fed 0 2024-04-12T13:42:14.949 INFO:tasks.workunit.client.0.smithi060.stdout:1/785: write d1e/d29/f44 [726298,69495] 0 2024-04-12T13:42:14.955 INFO:tasks.workunit.client.0.smithi060.stdout:0/625: creat d7/d9/d14/d35/d44/d49/d74/fd1 x:0 0 0 2024-04-12T13:42:14.957 INFO:tasks.workunit.client.0.smithi060.stdout:3/722: dread d7/d17/d19/dc9/f35 [0,4194304] 0 2024-04-12T13:42:14.957 INFO:tasks.workunit.client.0.smithi060.stdout:0/626: stat d7 0 2024-04-12T13:42:14.963 INFO:tasks.workunit.client.1.smithi110.stdout:1/712: unlink de/d15/d32/d61/d6a/dac/dc0/dea/fee 0 2024-04-12T13:42:14.964 INFO:tasks.workunit.client.1.smithi110.stdout:2/759: dwrite d6/dc/dd/d49/d64/d8c/f95 [0,4194304] 0 2024-04-12T13:42:14.970 INFO:tasks.workunit.client.0.smithi060.stdout:1/786: symlink d1e/d23/d2e/d5e/df0/l114 0 2024-04-12T13:42:14.981 INFO:tasks.workunit.client.0.smithi060.stdout:4/661: dread d6/d7/db/d85/f4e [0,4194304] 0 2024-04-12T13:42:14.982 INFO:tasks.workunit.client.0.smithi060.stdout:3/723: dwrite d7/d17/d27/d36/f62 [0,4194304] 0 2024-04-12T13:42:14.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/724: chown d7/d17/d19/d33/d63/d9b/dc0/fd1 34110 1 2024-04-12T13:42:14.986 INFO:tasks.workunit.client.1.smithi110.stdout:8/742: creat d1/d3/d3c/d5a/d6f/d7e/fee x:0 0 0 2024-04-12T13:42:14.987 INFO:tasks.workunit.client.1.smithi110.stdout:7/742: symlink d1/d3/d4/d36/lfa 0 2024-04-12T13:42:14.990 INFO:tasks.workunit.client.0.smithi060.stdout:5/686: getdents d6/dd/d1f/d25/d35 0 2024-04-12T13:42:14.997 INFO:tasks.workunit.client.0.smithi060.stdout:5/687: fsync d6/d10/d12/d4c/f85 0 2024-04-12T13:42:15.000 INFO:tasks.workunit.client.1.smithi110.stdout:1/713: creat de/d15/dab/dd8/dd9/dda/ff2 x:0 0 0 2024-04-12T13:42:15.001 INFO:tasks.workunit.client.0.smithi060.stdout:4/662: dwrite d6/d7/dd/d1a/fcd [0,4194304] 0 2024-04-12T13:42:15.004 INFO:tasks.workunit.client.1.smithi110.stdout:2/760: rename d6/f4b to d6/dc/d13/d80/d8d/dcc/d82/fe8 0 2024-04-12T13:42:15.004 INFO:tasks.workunit.client.1.smithi110.stdout:8/743: rename d1/d5/d1f to d1/d5/d1f/def 22 2024-04-12T13:42:15.005 INFO:tasks.workunit.client.0.smithi060.stdout:4/663: chown d6/f55 0 1 2024-04-12T13:42:15.008 INFO:tasks.workunit.client.0.smithi060.stdout:4/664: write d6/d2f/d51/f89 [732259,102585] 0 2024-04-12T13:42:15.010 INFO:tasks.workunit.client.1.smithi110.stdout:4/803: creat d0/d75/d84/f106 x:0 0 0 2024-04-12T13:42:15.010 INFO:tasks.workunit.client.0.smithi060.stdout:5/688: chown d6/dd/d1f/d32/d46/lb7 6254 1 2024-04-12T13:42:15.011 INFO:tasks.workunit.client.1.smithi110.stdout:9/798: fdatasync df/d13/d3b/d40/d56/fd5 0 2024-04-12T13:42:15.015 INFO:tasks.workunit.client.0.smithi060.stdout:5/689: write d6/dd/d1f/d25/d53/d87/da6/fcc [2129901,105466] 0 2024-04-12T13:42:15.015 INFO:tasks.workunit.client.0.smithi060.stdout:2/681: rmdir d6 39 2024-04-12T13:42:15.022 INFO:tasks.workunit.client.1.smithi110.stdout:8/744: fsync d1/d3/d3c/d5a/f8a 0 2024-04-12T13:42:15.024 INFO:tasks.workunit.client.0.smithi060.stdout:2/682: dread - d6/dae/d5b/fbe zero size 2024-04-12T13:42:15.025 INFO:tasks.workunit.client.1.smithi110.stdout:9/799: rmdir df/d38 39 2024-04-12T13:42:15.026 INFO:tasks.workunit.client.1.smithi110.stdout:1/714: dread de/d14/f53 [0,4194304] 0 2024-04-12T13:42:15.027 INFO:tasks.workunit.client.0.smithi060.stdout:5/690: creat d6/dd/d1f/d25/d53/d8d/fe3 x:0 0 0 2024-04-12T13:42:15.028 INFO:tasks.workunit.client.0.smithi060.stdout:2/683: fdatasync d6/d56/d43/f72 0 2024-04-12T13:42:15.031 INFO:tasks.workunit.client.1.smithi110.stdout:2/761: mkdir d6/d18/de9 0 2024-04-12T13:42:15.035 INFO:tasks.workunit.client.0.smithi060.stdout:2/684: read f3 [2440992,106905] 0 2024-04-12T13:42:15.035 INFO:tasks.workunit.client.1.smithi110.stdout:8/745: mknod d1/d5/dd/d31/dba/cf0 0 2024-04-12T13:42:15.037 INFO:tasks.workunit.client.0.smithi060.stdout:5/691: write d6/dd/d1f/d25/d42/d52/f8c [120013,81709] 0 2024-04-12T13:42:15.038 INFO:tasks.workunit.client.1.smithi110.stdout:9/800: creat df/d13/d2c/d9e/d107/f114 x:0 0 0 2024-04-12T13:42:15.038 INFO:tasks.workunit.client.0.smithi060.stdout:4/665: dread d6/d7/dd/d1a/d19/f33 [0,4194304] 0 2024-04-12T13:42:15.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/666: write d6/d7/dd/d1a/d57/dc7/fd7 [1028625,39794] 0 2024-04-12T13:42:15.043 INFO:tasks.workunit.client.0.smithi060.stdout:2/685: creat d6/d64/fcc x:0 0 0 2024-04-12T13:42:15.046 INFO:tasks.workunit.client.1.smithi110.stdout:2/762: unlink d6/dc/d13/d80/f9b 0 2024-04-12T13:42:15.047 INFO:tasks.workunit.client.0.smithi060.stdout:5/692: truncate d6/dd/d1f/d25/d42/d6b/fac 478990 0 2024-04-12T13:42:15.049 INFO:tasks.workunit.client.1.smithi110.stdout:3/689: write d5/dc/d20/d2d/fb0 [507254,9176] 0 2024-04-12T13:42:15.052 INFO:tasks.workunit.client.0.smithi060.stdout:2/686: getdents d6/d56/d55 0 2024-04-12T13:42:15.053 INFO:tasks.workunit.client.1.smithi110.stdout:5/701: dwrite da/d2e/d45/d25/d5d/fbd [0,4194304] 0 2024-04-12T13:42:15.054 INFO:tasks.workunit.client.1.smithi110.stdout:1/715: creat de/d15/d32/d61/d6a/d8b/ff3 x:0 0 0 2024-04-12T13:42:15.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/687: truncate d6/dae/d5b/d6d/fc8 345539 0 2024-04-12T13:42:15.055 INFO:tasks.workunit.client.1.smithi110.stdout:5/702: write da/d35/f41 [29091,98021] 0 2024-04-12T13:42:15.058 INFO:tasks.workunit.client.0.smithi060.stdout:5/693: unlink d6/dd/d1f/d25/d53/d87/da6/fe0 0 2024-04-12T13:42:15.058 INFO:tasks.workunit.client.1.smithi110.stdout:6/704: write d7/d25/f9f [189418,128310] 0 2024-04-12T13:42:15.061 INFO:tasks.workunit.client.1.smithi110.stdout:8/746: symlink d1/d3/d35/d3a/d41/dd7/lf1 0 2024-04-12T13:42:15.063 INFO:tasks.workunit.client.0.smithi060.stdout:2/688: truncate d6/d56/f54 889430 0 2024-04-12T13:42:15.064 INFO:tasks.workunit.client.0.smithi060.stdout:0/627: write d7/d9/d14/d35/d44/d8c/d8d/fc3 [3345269,45510] 0 2024-04-12T13:42:15.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/689: chown d6/d56/d58/laf 46 1 2024-04-12T13:42:15.066 INFO:tasks.workunit.client.0.smithi060.stdout:0/628: chown d7/d9/d14/d4a/l5e 531544662 1 2024-04-12T13:42:15.068 INFO:tasks.workunit.client.0.smithi060.stdout:5/694: readlink d6/dd/d1f/d25/l83 0 2024-04-12T13:42:15.069 INFO:tasks.workunit.client.0.smithi060.stdout:4/667: link d6/d7/dd/d1a/d57/d63/c74 d6/d7/dd/d1a/d19/d42/cdc 0 2024-04-12T13:42:15.072 INFO:tasks.workunit.client.0.smithi060.stdout:1/787: truncate d1e/d23/d2e/d5e/ff8 3305147 0 2024-04-12T13:42:15.073 INFO:tasks.workunit.client.0.smithi060.stdout:5/695: read d6/dd/d1f/d25/d53/f77 [6160237,84820] 0 2024-04-12T13:42:15.073 INFO:tasks.workunit.client.0.smithi060.stdout:0/629: dread d7/f66 [0,4194304] 0 2024-04-12T13:42:15.077 INFO:tasks.workunit.client.0.smithi060.stdout:5/696: stat d6/dd/d1f/d25/d53/d87/d7e/dca 0 2024-04-12T13:42:15.079 INFO:tasks.workunit.client.0.smithi060.stdout:4/668: truncate d6/d7/db/f72 3164849 0 2024-04-12T13:42:15.085 INFO:tasks.workunit.client.0.smithi060.stdout:3/725: dwrite d7/d17/d19/d33/f86 [0,4194304] 0 2024-04-12T13:42:15.086 INFO:tasks.workunit.client.0.smithi060.stdout:0/630: rename d7/d9/f82 to d7/d9/de/d63/fd2 0 2024-04-12T13:42:15.090 INFO:tasks.workunit.client.0.smithi060.stdout:0/631: stat d7/d9/d14/d35/d44/d49/d74/fd1 0 2024-04-12T13:42:15.097 INFO:tasks.workunit.client.1.smithi110.stdout:6/705: truncate d7/d10/d7e/fb5 4773890 0 2024-04-12T13:42:15.098 INFO:tasks.workunit.client.1.smithi110.stdout:9/801: symlink df/d13/d3b/d40/d56/l115 0 2024-04-12T13:42:15.099 INFO:tasks.workunit.client.1.smithi110.stdout:1/716: symlink de/d14/d34/d55/d6b/dc7/lf4 0 2024-04-12T13:42:15.099 INFO:tasks.workunit.client.1.smithi110.stdout:7/743: write d1/d3/d4/d55/d56/d72/de0/f3b [2197259,39509] 0 2024-04-12T13:42:15.100 INFO:tasks.workunit.client.0.smithi060.stdout:5/697: creat d6/dd/d1f/d25/d42/d52/dc8/fe4 x:0 0 0 2024-04-12T13:42:15.100 INFO:tasks.workunit.client.0.smithi060.stdout:0/632: chown d7/d9/d14/d35/d44/d7d/l84 53 1 2024-04-12T13:42:15.106 INFO:tasks.workunit.client.1.smithi110.stdout:5/703: mkdir da/d2e/d45/d25/d9d/d7a/db5/df3 0 2024-04-12T13:42:15.107 INFO:tasks.workunit.client.0.smithi060.stdout:5/698: truncate d6/dd/d1f/d25/d42/d52/dc8/fe4 176802 0 2024-04-12T13:42:15.108 INFO:tasks.workunit.client.1.smithi110.stdout:0/644: dwrite d1/f2f [0,4194304] 0 2024-04-12T13:42:15.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/788: dread d1e/dcc/ff4 [0,4194304] 0 2024-04-12T13:42:15.109 INFO:tasks.workunit.client.1.smithi110.stdout:6/706: mknod d7/da9/cde 0 2024-04-12T13:42:15.110 INFO:tasks.workunit.client.1.smithi110.stdout:4/804: dwrite d0/de/da0/dd9/df3/f8d [0,4194304] 0 2024-04-12T13:42:15.110 INFO:tasks.workunit.client.0.smithi060.stdout:2/690: getdents d6/d64 0 2024-04-12T13:42:15.112 INFO:tasks.workunit.client.1.smithi110.stdout:0/645: read d1/d8/d36/d65/f6c [293437,91110] 0 2024-04-12T13:42:15.112 INFO:tasks.workunit.client.1.smithi110.stdout:4/805: write d0/de/d32/d61/de9/f105 [679119,4293] 0 2024-04-12T13:42:15.112 INFO:tasks.workunit.client.0.smithi060.stdout:1/789: write d1e/d23/d49/d4e/fef [885790,56248] 0 2024-04-12T13:42:15.114 INFO:tasks.workunit.client.0.smithi060.stdout:1/790: fsync d1e/d94/fe9 0 2024-04-12T13:42:15.115 INFO:tasks.workunit.client.1.smithi110.stdout:0/646: readlink d1/d8/d36/d51/d60/l40 0 2024-04-12T13:42:15.116 INFO:tasks.workunit.client.1.smithi110.stdout:9/802: mkdir df/d13/df4/d116 0 2024-04-12T13:42:15.118 INFO:tasks.workunit.client.1.smithi110.stdout:0/647: write d1/d8/d8a/fa8 [757551,100386] 0 2024-04-12T13:42:15.120 INFO:tasks.workunit.client.1.smithi110.stdout:0/648: write d1/d48/db2/fb8 [423026,47193] 0 2024-04-12T13:42:15.132 INFO:tasks.workunit.client.1.smithi110.stdout:5/704: mkdir da/db/d3b/d40/da2/df4 0 2024-04-12T13:42:15.134 INFO:tasks.workunit.client.1.smithi110.stdout:6/707: creat d7/d10/d1c/d7f/fdf x:0 0 0 2024-04-12T13:42:15.138 INFO:tasks.workunit.client.1.smithi110.stdout:1/717: symlink de/lf5 0 2024-04-12T13:42:15.140 INFO:tasks.workunit.client.1.smithi110.stdout:4/806: creat d0/d19/d1c/d50/d6f/db9/f107 x:0 0 0 2024-04-12T13:42:15.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/669: dwrite d6/d7/db/d85/f67 [0,4194304] 0 2024-04-12T13:42:15.148 INFO:tasks.workunit.client.1.smithi110.stdout:0/649: mknod d1/d8/d8a/ce2 0 2024-04-12T13:42:15.148 INFO:tasks.workunit.client.1.smithi110.stdout:9/803: write df/d38/db3/fc8 [494100,114264] 0 2024-04-12T13:42:15.151 INFO:tasks.workunit.client.1.smithi110.stdout:0/650: write d1/d8/d36/d51/d60/fda [8526,32687] 0 2024-04-12T13:42:15.153 INFO:tasks.workunit.client.1.smithi110.stdout:6/708: unlink d7/d25/d2c/d4c/d77/dd3/l98 0 2024-04-12T13:42:15.160 INFO:tasks.workunit.client.1.smithi110.stdout:3/690: dwrite d5/dc/d20/d2d/d4f/f7b [0,4194304] 0 2024-04-12T13:42:15.162 INFO:tasks.workunit.client.1.smithi110.stdout:8/747: link d1/d3/d35/l68 d1/d3/d35/d3a/d41/d77/lf2 0 2024-04-12T13:42:15.162 INFO:tasks.workunit.client.0.smithi060.stdout:5/699: rename d6/dd to d6/dd/de5 22 2024-04-12T13:42:15.165 INFO:tasks.workunit.client.0.smithi060.stdout:2/691: symlink d6/d56/d86/lcd 0 2024-04-12T13:42:15.166 INFO:tasks.workunit.client.0.smithi060.stdout:2/692: stat d6/dae/d31/d87 0 2024-04-12T13:42:15.168 INFO:tasks.workunit.client.1.smithi110.stdout:9/804: mkdir df/d13/d2c/d2d/d94/d117 0 2024-04-12T13:42:15.170 INFO:tasks.workunit.client.0.smithi060.stdout:2/693: truncate d6/d10/d2b/d60/fa2 310259 0 2024-04-12T13:42:15.172 INFO:tasks.workunit.client.1.smithi110.stdout:5/705: dwrite da/db/d3b/d40/d97/db6/fd9 [0,4194304] 0 2024-04-12T13:42:15.189 INFO:tasks.workunit.client.1.smithi110.stdout:4/807: mknod d0/de/d2c/c108 0 2024-04-12T13:42:15.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/633: creat d7/d9/d4c/d93/fd3 x:0 0 0 2024-04-12T13:42:15.193 INFO:tasks.workunit.client.0.smithi060.stdout:0/634: rename d7/d9/d14/d35 to d7/d9/d14/d35/d44/d49/d67/dd4 22 2024-04-12T13:42:15.194 INFO:tasks.workunit.client.0.smithi060.stdout:0/635: chown d7/d9/f1c 1 1 2024-04-12T13:42:15.195 INFO:tasks.workunit.client.0.smithi060.stdout:9/596: sync 2024-04-12T13:42:15.196 INFO:tasks.workunit.client.0.smithi060.stdout:9/597: fdatasync d4/d8/fa 0 2024-04-12T13:42:15.198 INFO:tasks.workunit.client.1.smithi110.stdout:8/748: creat d1/d3/d35/d3a/d3e/d64/ff3 x:0 0 0 2024-04-12T13:42:15.200 INFO:tasks.workunit.client.1.smithi110.stdout:7/744: getdents d1/d3/d4/d55/d82 0 2024-04-12T13:42:15.202 INFO:tasks.workunit.client.1.smithi110.stdout:7/745: chown d1/d31/d7b/cd3 533341 1 2024-04-12T13:42:15.202 INFO:tasks.workunit.client.0.smithi060.stdout:2/694: dread - d6/d10/d16/d36/fa7 zero size 2024-04-12T13:42:15.204 INFO:tasks.workunit.client.1.smithi110.stdout:9/805: fsync df/d13/d2c/d2d/dc1/d83/f68 0 2024-04-12T13:42:15.206 INFO:tasks.workunit.client.0.smithi060.stdout:3/726: write d7/d17/d19/dc9/d3f/d5c/f54 [164868,18250] 0 2024-04-12T13:42:15.207 INFO:tasks.workunit.client.1.smithi110.stdout:1/718: write de/d15/d32/d61/d6a/d8b/fb5 [567971,13188] 0 2024-04-12T13:42:15.208 INFO:tasks.workunit.client.1.smithi110.stdout:6/709: truncate d7/d10/d1c/d2b/d3a/fdc 1465363 0 2024-04-12T13:42:15.211 INFO:tasks.workunit.client.1.smithi110.stdout:4/808: dread d0/de/d2c/d57/f94 [0,4194304] 0 2024-04-12T13:42:15.211 INFO:tasks.workunit.client.0.smithi060.stdout:5/700: mkdir d6/d10/de6 0 2024-04-12T13:42:15.213 INFO:tasks.workunit.client.0.smithi060.stdout:5/701: chown d6/dd/d1f/d25 662 1 2024-04-12T13:42:15.215 INFO:tasks.workunit.client.0.smithi060.stdout:9/598: fdatasync d4/d8/d32/f5b 0 2024-04-12T13:42:15.215 INFO:tasks.workunit.client.1.smithi110.stdout:0/651: creat d1/fe3 x:0 0 0 2024-04-12T13:42:15.218 INFO:tasks.workunit.client.1.smithi110.stdout:8/749: dread d1/f94 [0,4194304] 0 2024-04-12T13:42:15.219 INFO:tasks.workunit.client.1.smithi110.stdout:0/652: write d1/d8/d36/d51/fbf [720387,70363] 0 2024-04-12T13:42:15.219 INFO:tasks.workunit.client.0.smithi060.stdout:1/791: link d1e/d23/d2e/d5e/df0/l114 d1e/d29/d65/l115 0 2024-04-12T13:42:15.220 INFO:tasks.workunit.client.1.smithi110.stdout:7/746: dread d1/f18 [0,4194304] 0 2024-04-12T13:42:15.220 INFO:tasks.workunit.client.1.smithi110.stdout:3/691: write d5/dc/d20/d2d/f51 [600455,42536] 0 2024-04-12T13:42:15.221 INFO:tasks.workunit.client.0.smithi060.stdout:4/670: dwrite d6/f55 [0,4194304] 0 2024-04-12T13:42:15.222 INFO:tasks.workunit.client.1.smithi110.stdout:5/706: link da/db/f4a da/db/d15/de9/ff5 0 2024-04-12T13:42:15.228 INFO:tasks.workunit.client.1.smithi110.stdout:3/692: read d5/dc/d20/d2d/d4e/f6d [1116951,122814] 0 2024-04-12T13:42:15.231 INFO:tasks.workunit.client.0.smithi060.stdout:5/702: rename d6/d89/da3 to d6/dd/d1f/dd3/de7 0 2024-04-12T13:42:15.232 INFO:tasks.workunit.client.0.smithi060.stdout:5/703: fsync f1 0 2024-04-12T13:42:15.235 INFO:tasks.workunit.client.0.smithi060.stdout:2/695: dwrite d6/dae/d5b/f96 [0,4194304] 0 2024-04-12T13:42:15.235 INFO:tasks.workunit.client.0.smithi060.stdout:5/704: write d6/dd/d1f/d32/d46/f62 [4306724,124473] 0 2024-04-12T13:42:15.237 INFO:tasks.workunit.client.1.smithi110.stdout:1/719: fsync de/d14/d34/d55/f5c 0 2024-04-12T13:42:15.238 INFO:tasks.workunit.client.1.smithi110.stdout:4/809: fdatasync d0/d19/d1c/d50/f67 0 2024-04-12T13:42:15.238 INFO:tasks.workunit.client.1.smithi110.stdout:9/806: dread df/d38/d6e/dcb/fff [0,4194304] 0 2024-04-12T13:42:15.239 INFO:tasks.workunit.client.1.smithi110.stdout:2/763: sync 2024-04-12T13:42:15.240 INFO:tasks.workunit.client.0.smithi060.stdout:5/705: chown d6/dd/d1f/d25/d35/f72 26021 1 2024-04-12T13:42:15.242 INFO:tasks.workunit.client.1.smithi110.stdout:0/653: creat d1/d5e/fe4 x:0 0 0 2024-04-12T13:42:15.244 INFO:tasks.workunit.client.0.smithi060.stdout:3/727: mkdir d7/d17/d27/da7/dbe/dce/de6/dea 0 2024-04-12T13:42:15.244 INFO:tasks.workunit.client.0.smithi060.stdout:5/706: chown d6/dd/d1f/d25/d42/d52/d7a 64 1 2024-04-12T13:42:15.245 INFO:tasks.workunit.client.1.smithi110.stdout:0/654: chown d1/d48/db2/f82 0 1 2024-04-12T13:42:15.245 INFO:tasks.workunit.client.0.smithi060.stdout:4/671: creat d6/d7/dd/d1a/d19/d42/d7c/fdd x:0 0 0 2024-04-12T13:42:15.247 INFO:tasks.workunit.client.1.smithi110.stdout:0/655: write d1/d5e/fb3 [20978,82437] 0 2024-04-12T13:42:15.253 INFO:tasks.workunit.client.0.smithi060.stdout:9/599: rename d4/d9/d19/c88 to d4/d9/d19/daf/cc6 0 2024-04-12T13:42:15.257 INFO:tasks.workunit.client.1.smithi110.stdout:3/693: dwrite d5/dc/da0/fc4 [0,4194304] 0 2024-04-12T13:42:15.258 INFO:tasks.workunit.client.1.smithi110.stdout:0/656: truncate d1/d8/d36/d51/d60/faf 307471 0 2024-04-12T13:42:15.258 INFO:tasks.workunit.client.1.smithi110.stdout:8/750: truncate d1/d3/d3c/d5a/d6f/d7e/f8e 1553557 0 2024-04-12T13:42:15.258 INFO:tasks.workunit.client.0.smithi060.stdout:2/696: creat d6/d10/d81/fce x:0 0 0 2024-04-12T13:42:15.258 INFO:tasks.workunit.client.0.smithi060.stdout:7/661: sync 2024-04-12T13:42:15.258 INFO:tasks.workunit.client.0.smithi060.stdout:6/744: sync 2024-04-12T13:42:15.259 INFO:tasks.workunit.client.0.smithi060.stdout:8/668: sync 2024-04-12T13:42:15.259 INFO:tasks.workunit.client.1.smithi110.stdout:8/751: write d1/d3/d35/d3a/d3e/d64/d85/fe5 [484260,36452] 0 2024-04-12T13:42:15.264 INFO:tasks.workunit.client.0.smithi060.stdout:5/707: dread f1 [4194304,4194304] 0 2024-04-12T13:42:15.264 INFO:tasks.workunit.client.0.smithi060.stdout:6/745: chown d1/d7/da/dc 439 1 2024-04-12T13:42:15.266 INFO:tasks.workunit.client.0.smithi060.stdout:2/697: write d6/d10/daa/db0/f4c [2399848,59983] 0 2024-04-12T13:42:15.271 INFO:tasks.workunit.client.0.smithi060.stdout:0/636: getdents d7/d9/d14/d35/d44/d49/d74 0 2024-04-12T13:42:15.271 INFO:tasks.workunit.client.0.smithi060.stdout:5/708: chown d6/d10/d12/d4c/fcd 6 1 2024-04-12T13:42:15.271 INFO:tasks.workunit.client.1.smithi110.stdout:9/807: chown df/d38/d6e/c7c 49066 1 2024-04-12T13:42:15.273 INFO:tasks.workunit.client.1.smithi110.stdout:9/808: write df/f3d [3457621,11374] 0 2024-04-12T13:42:15.274 INFO:tasks.workunit.client.1.smithi110.stdout:6/710: dread d7/f39 [0,4194304] 0 2024-04-12T13:42:15.274 INFO:tasks.workunit.client.0.smithi060.stdout:3/728: truncate d7/d17/d19/d33/d63/d6d/f98 1548633 0 2024-04-12T13:42:15.277 INFO:tasks.workunit.client.1.smithi110.stdout:9/809: chown df/d13/d2c/d2d/d39/l47 52 1 2024-04-12T13:42:15.281 INFO:tasks.workunit.client.1.smithi110.stdout:7/747: creat d1/d3/d4/d55/d56/ddd/ffb x:0 0 0 2024-04-12T13:42:15.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/662: dread d0/d7/f73 [0,4194304] 0 2024-04-12T13:42:15.286 INFO:tasks.workunit.client.0.smithi060.stdout:7/663: fsync d0/d1b/f48 0 2024-04-12T13:42:15.288 INFO:tasks.workunit.client.1.smithi110.stdout:5/707: dwrite da/d2e/d45/d25/f5a [0,4194304] 0 2024-04-12T13:42:15.296 INFO:tasks.workunit.client.1.smithi110.stdout:2/764: write d6/dc/dd/d49/f61 [3767622,90404] 0 2024-04-12T13:42:15.301 INFO:tasks.workunit.client.1.smithi110.stdout:3/694: dread d5/dc/f85 [0,4194304] 0 2024-04-12T13:42:15.305 INFO:tasks.workunit.client.0.smithi060.stdout:1/792: dwrite d1e/d29/d37/fdc [0,4194304] 0 2024-04-12T13:42:15.307 INFO:tasks.workunit.client.0.smithi060.stdout:0/637: dread - d7/d9/d14/d35/fb7 zero size 2024-04-12T13:42:15.308 INFO:tasks.workunit.client.1.smithi110.stdout:4/810: dread d0/de/d2c/fc2 [0,4194304] 0 2024-04-12T13:42:15.309 INFO:tasks.workunit.client.0.smithi060.stdout:5/709: dwrite d6/dd/d1f/d25/d42/d52/fe1 [0,4194304] 0 2024-04-12T13:42:15.311 INFO:tasks.workunit.client.1.smithi110.stdout:1/720: dwrite de/f64 [0,4194304] 0 2024-04-12T13:42:15.315 INFO:tasks.workunit.client.1.smithi110.stdout:5/708: dwrite da/d2e/d45/d29/f50 [0,4194304] 0 2024-04-12T13:42:15.317 INFO:tasks.workunit.client.0.smithi060.stdout:7/664: dwrite d0/d1b/da4/fba [0,4194304] 0 2024-04-12T13:42:15.323 INFO:tasks.workunit.client.1.smithi110.stdout:9/810: mkdir df/d13/d2c/d9e/dd6/da3/dab/d118 0 2024-04-12T13:42:15.325 INFO:tasks.workunit.client.1.smithi110.stdout:0/657: dwrite d1/d8/d36/d51/d60/f18 [0,4194304] 0 2024-04-12T13:42:15.331 INFO:tasks.workunit.client.1.smithi110.stdout:0/658: dread - d1/d48/db2/d4a/fbb zero size 2024-04-12T13:42:15.340 INFO:tasks.workunit.client.1.smithi110.stdout:2/765: rename d6/dc/dd/d49/d64/d5d/db9/fbe to d6/dc/dd/dc6/fea 0 2024-04-12T13:42:15.343 INFO:tasks.workunit.client.0.smithi060.stdout:9/600: truncate d4/d8/f17 3175776 0 2024-04-12T13:42:15.348 INFO:tasks.workunit.client.1.smithi110.stdout:3/695: creat d5/dc/d31/d3b/d5b/fd8 x:0 0 0 2024-04-12T13:42:15.352 INFO:tasks.workunit.client.1.smithi110.stdout:4/811: dread - d0/de/d2c/d57/fe6 zero size 2024-04-12T13:42:15.354 INFO:tasks.workunit.client.0.smithi060.stdout:5/710: rename d6/dd/d27/d7d/cbd to d6/dd/d1f/dd3/de7/ce8 0 2024-04-12T13:42:15.357 INFO:tasks.workunit.client.1.smithi110.stdout:9/811: rmdir df/d38/d6e 39 2024-04-12T13:42:15.360 INFO:tasks.workunit.client.0.smithi060.stdout:4/672: getdents d6/d7/db/dc8 0 2024-04-12T13:42:15.362 INFO:tasks.workunit.client.1.smithi110.stdout:8/752: link d1/d3/d35/d3a/d84/d9e/ld0 d1/d3/d3c/d5a/lf4 0 2024-04-12T13:42:15.362 INFO:tasks.workunit.client.0.smithi060.stdout:2/698: link d6/d10/d16/c1a d6/dae/d5b/d6d/ccf 0 2024-04-12T13:42:15.363 INFO:tasks.workunit.client.0.smithi060.stdout:7/665: fdatasync d0/fd8 0 2024-04-12T13:42:15.364 INFO:tasks.workunit.client.1.smithi110.stdout:1/721: symlink de/d14/d34/d55/ddc/lf6 0 2024-04-12T13:42:15.365 INFO:tasks.workunit.client.1.smithi110.stdout:8/753: dread - d1/d3/d3c/d5a/f6d zero size 2024-04-12T13:42:15.367 INFO:tasks.workunit.client.0.smithi060.stdout:6/746: mknod d1/d7/da/dc/d24/d34/d51/d97/dc0/cf7 0 2024-04-12T13:42:15.368 INFO:tasks.workunit.client.1.smithi110.stdout:6/711: creat d7/fe0 x:0 0 0 2024-04-12T13:42:15.370 INFO:tasks.workunit.client.0.smithi060.stdout:1/793: dread d1e/f38 [0,4194304] 0 2024-04-12T13:42:15.370 INFO:tasks.workunit.client.0.smithi060.stdout:8/669: dread d9/d1b/f1e [0,4194304] 0 2024-04-12T13:42:15.374 INFO:tasks.workunit.client.1.smithi110.stdout:3/696: read d5/dc/d31/d3b/d32/d3e/f44 [1890477,74887] 0 2024-04-12T13:42:15.374 INFO:tasks.workunit.client.1.smithi110.stdout:4/812: creat d0/d75/f109 x:0 0 0 2024-04-12T13:42:15.375 INFO:tasks.workunit.client.0.smithi060.stdout:3/729: link d7/l11 d7/d17/d19/dc9/d3f/d5c/d25/d4d/leb 0 2024-04-12T13:42:15.376 INFO:tasks.workunit.client.1.smithi110.stdout:7/748: dread d1/f2a [0,4194304] 0 2024-04-12T13:42:15.382 INFO:tasks.workunit.client.1.smithi110.stdout:0/659: mknod d1/d8/d8a/dce/ce5 0 2024-04-12T13:42:15.387 INFO:tasks.workunit.client.0.smithi060.stdout:7/666: unlink d0/d1b/d8c/f91 0 2024-04-12T13:42:15.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/601: creat d4/d9/d19/d21/fc7 x:0 0 0 2024-04-12T13:42:15.392 INFO:tasks.workunit.client.1.smithi110.stdout:5/709: write da/d2e/d45/f90 [100043,114089] 0 2024-04-12T13:42:15.395 INFO:tasks.workunit.client.1.smithi110.stdout:2/766: write d6/d18/fac [525964,47025] 0 2024-04-12T13:42:15.398 INFO:tasks.workunit.client.1.smithi110.stdout:3/697: chown d5/dc/d20/d2d/l77 29137 1 2024-04-12T13:42:15.398 INFO:tasks.workunit.client.0.smithi060.stdout:0/638: dwrite d7/d9/d14/d35/d44/d49/d74/f95 [0,4194304] 0 2024-04-12T13:42:15.399 INFO:tasks.workunit.client.0.smithi060.stdout:6/747: creat d1/d7/da/dc/d24/d8b/ff8 x:0 0 0 2024-04-12T13:42:15.402 INFO:tasks.workunit.client.1.smithi110.stdout:7/749: creat d1/d3/d4/d55/d82/ffc x:0 0 0 2024-04-12T13:42:15.402 INFO:tasks.workunit.client.0.smithi060.stdout:6/748: chown d1/d7/da/dc/d24/d2d 2247 1 2024-04-12T13:42:15.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/639: chown d7/d9/d14/d35/f94 454 1 2024-04-12T13:42:15.404 INFO:tasks.workunit.client.0.smithi060.stdout:8/670: mknod d9/d1b/d84/cec 0 2024-04-12T13:42:15.407 INFO:tasks.workunit.client.0.smithi060.stdout:1/794: rmdir d1e/d23/d2e/d86/ddb/d107 39 2024-04-12T13:42:15.408 INFO:tasks.workunit.client.1.smithi110.stdout:0/660: creat d1/d56/fe6 x:0 0 0 2024-04-12T13:42:15.411 INFO:tasks.workunit.client.1.smithi110.stdout:8/754: mkdir d1/d3/d35/d43/d9f/dd5/df5 0 2024-04-12T13:42:15.414 INFO:tasks.workunit.client.1.smithi110.stdout:6/712: fdatasync d7/d10/d41/fab 0 2024-04-12T13:42:15.415 INFO:tasks.workunit.client.0.smithi060.stdout:4/673: mkdir d6/d7/dd/d1a/dde 0 2024-04-12T13:42:15.418 INFO:tasks.workunit.client.1.smithi110.stdout:1/722: link de/d15/d32/d61/d6a/d8b/ff3 de/d14/d83/ff7 0 2024-04-12T13:42:15.419 INFO:tasks.workunit.client.1.smithi110.stdout:1/723: stat de/d14/l24 0 2024-04-12T13:42:15.422 INFO:tasks.workunit.client.1.smithi110.stdout:5/710: symlink da/d2e/lf6 0 2024-04-12T13:42:15.422 INFO:tasks.workunit.client.0.smithi060.stdout:3/730: write d7/d17/d19/d33/fe4 [5179958,72182] 0 2024-04-12T13:42:15.424 INFO:tasks.workunit.client.0.smithi060.stdout:5/711: rename d6/dd/d1f/d25/d53/d87/da6 to d6/d10/de9 0 2024-04-12T13:42:15.427 INFO:tasks.workunit.client.0.smithi060.stdout:9/602: dread d4/d8/f40 [0,4194304] 0 2024-04-12T13:42:15.428 INFO:tasks.workunit.client.1.smithi110.stdout:4/813: mkdir d0/de/da0/dd9/df3/de0/dfa/d10a 0 2024-04-12T13:42:15.428 INFO:tasks.workunit.client.0.smithi060.stdout:5/712: chown d6/dd/d1f/d32 29747107 1 2024-04-12T13:42:15.431 INFO:tasks.workunit.client.0.smithi060.stdout:6/749: chown d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/cd9 1267 1 2024-04-12T13:42:15.431 INFO:tasks.workunit.client.1.smithi110.stdout:3/698: creat d5/dc/d20/d2d/d4f/dce/fd9 x:0 0 0 2024-04-12T13:42:15.432 INFO:tasks.workunit.client.0.smithi060.stdout:9/603: truncate d4/f2d 8422797 0 2024-04-12T13:42:15.432 INFO:tasks.workunit.client.0.smithi060.stdout:8/671: dwrite d9/d1b/d84/fb9 [0,4194304] 0 2024-04-12T13:42:15.435 INFO:tasks.workunit.client.0.smithi060.stdout:0/640: fdatasync d7/d9/d14/d35/d44/d49/d67/f76 0 2024-04-12T13:42:15.440 INFO:tasks.workunit.client.0.smithi060.stdout:1/795: dwrite d1e/d23/d2e/d5e/d68/d9a/de1/ffc [0,4194304] 0 2024-04-12T13:42:15.440 INFO:tasks.workunit.client.0.smithi060.stdout:4/674: symlink d6/d7/dd/d1a/d57/ldf 0 2024-04-12T13:42:15.441 INFO:tasks.workunit.client.1.smithi110.stdout:8/755: mknod d1/d7/d20/cf6 0 2024-04-12T13:42:15.444 INFO:tasks.workunit.client.0.smithi060.stdout:4/675: fdatasync d6/d7/dd/df/f18 0 2024-04-12T13:42:15.450 INFO:tasks.workunit.client.1.smithi110.stdout:6/713: fdatasync d7/d25/d2c/d4c/d77/f96 0 2024-04-12T13:42:15.452 INFO:tasks.workunit.client.1.smithi110.stdout:6/714: dread - d7/d25/d30/d44/d3d/fcb zero size 2024-04-12T13:42:15.452 INFO:tasks.workunit.client.0.smithi060.stdout:3/731: unlink d7/d17/d27/d36/fb1 0 2024-04-12T13:42:15.454 INFO:tasks.workunit.client.1.smithi110.stdout:1/724: truncate de/d15/f1c 3170408 0 2024-04-12T13:42:15.454 INFO:tasks.workunit.client.0.smithi060.stdout:7/667: rename d0/d7/da9/dc9/ca7 to d0/d3d/d74/cd9 0 2024-04-12T13:42:15.456 INFO:tasks.workunit.client.1.smithi110.stdout:1/725: write de/d14/dd0/f7a [1058854,18782] 0 2024-04-12T13:42:15.459 INFO:tasks.workunit.client.1.smithi110.stdout:9/812: getdents df/d13/d2c/d2d/dc1/d83/d63 0 2024-04-12T13:42:15.459 INFO:tasks.workunit.client.0.smithi060.stdout:7/668: dread - d0/d7/d43/fce zero size 2024-04-12T13:42:15.463 INFO:tasks.workunit.client.1.smithi110.stdout:7/750: unlink d1/d3/d4/d36/l39 0 2024-04-12T13:42:15.467 INFO:tasks.workunit.client.1.smithi110.stdout:0/661: rename d1/d48/db2/d4a/ca5 to d1/d27/d31/d67/dcb/ce7 0 2024-04-12T13:42:15.470 INFO:tasks.workunit.client.1.smithi110.stdout:0/662: read d1/d8/d36/d51/f68 [1675270,35344] 0 2024-04-12T13:42:15.471 INFO:tasks.workunit.client.1.smithi110.stdout:8/756: creat d1/d3/d3c/d75/ff7 x:0 0 0 2024-04-12T13:42:15.471 INFO:tasks.workunit.client.0.smithi060.stdout:0/641: readlink d7/d9/l18 0 2024-04-12T13:42:15.473 INFO:tasks.workunit.client.1.smithi110.stdout:8/757: read d1/d3/d35/d43/d9f/fbf [283815,46177] 0 2024-04-12T13:42:15.474 INFO:tasks.workunit.client.0.smithi060.stdout:8/672: mkdir d9/d1d/d5e/ded 0 2024-04-12T13:42:15.475 INFO:tasks.workunit.client.0.smithi060.stdout:6/750: write d1/f57 [2042377,75114] 0 2024-04-12T13:42:15.477 INFO:tasks.workunit.client.0.smithi060.stdout:1/796: dread - d1e/d23/d49/f83 zero size 2024-04-12T13:42:15.480 INFO:tasks.workunit.client.1.smithi110.stdout:4/814: creat d0/d75/d84/d89/d103/f10b x:0 0 0 2024-04-12T13:42:15.482 INFO:tasks.workunit.client.1.smithi110.stdout:4/815: chown d0/de/d2c/fc2 5827 1 2024-04-12T13:42:15.483 INFO:tasks.workunit.client.0.smithi060.stdout:4/676: truncate d6/d7/dd/d1a/d19/f1b 3399827 0 2024-04-12T13:42:15.485 INFO:tasks.workunit.client.1.smithi110.stdout:6/715: creat d7/d10/d7e/d85/fe1 x:0 0 0 2024-04-12T13:42:15.486 INFO:tasks.workunit.client.1.smithi110.stdout:6/716: chown d7/d25/d2c/d4c/da6/caf 1223693 1 2024-04-12T13:42:15.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/713: mknod d6/dd/d1f/d25/d53/cea 0 2024-04-12T13:42:15.488 INFO:tasks.workunit.client.1.smithi110.stdout:3/699: symlink d5/d86/dca/lda 0 2024-04-12T13:42:15.490 INFO:tasks.workunit.client.1.smithi110.stdout:1/726: write de/d14/f3a [3891950,69522] 0 2024-04-12T13:42:15.491 INFO:tasks.workunit.client.0.smithi060.stdout:8/673: dwrite d9/d1d/d2f/fe2 [0,4194304] 0 2024-04-12T13:42:15.494 INFO:tasks.workunit.client.1.smithi110.stdout:0/663: symlink d1/d48/db2/d4a/le8 0 2024-04-12T13:42:15.499 INFO:tasks.workunit.client.1.smithi110.stdout:8/758: rmdir d1/d3/d3c/d5a/d6f 39 2024-04-12T13:42:15.504 INFO:tasks.workunit.client.1.smithi110.stdout:4/816: creat d0/de/da0/dd9/df3/de0/f10c x:0 0 0 2024-04-12T13:42:15.506 INFO:tasks.workunit.client.0.smithi060.stdout:5/714: unlink d6/dd/d1f/dd3/d5f/cad 0 2024-04-12T13:42:15.510 INFO:tasks.workunit.client.0.smithi060.stdout:0/642: symlink d7/d9/d14/d35/d44/d8c/d8d/ld5 0 2024-04-12T13:42:15.510 INFO:tasks.workunit.client.0.smithi060.stdout:7/669: write d0/d7/d43/d4d/f79 [543748,56170] 0 2024-04-12T13:42:15.511 INFO:tasks.workunit.client.1.smithi110.stdout:9/813: write df/d13/d2c/f53 [39824,95343] 0 2024-04-12T13:42:15.511 INFO:tasks.workunit.client.0.smithi060.stdout:8/674: dwrite d9/d1b/d37/d4d/f6b [4194304,4194304] 0 2024-04-12T13:42:15.515 INFO:tasks.workunit.client.1.smithi110.stdout:1/727: truncate de/d14/f53 2795929 0 2024-04-12T13:42:15.516 INFO:tasks.workunit.client.0.smithi060.stdout:6/751: mknod d1/d7/da/dc/d24/d2d/db0/cf9 0 2024-04-12T13:42:15.516 INFO:tasks.workunit.client.1.smithi110.stdout:0/664: rmdir d1/d27 39 2024-04-12T13:42:15.518 INFO:tasks.workunit.client.1.smithi110.stdout:1/728: dread - de/d15/fd4 zero size 2024-04-12T13:42:15.518 INFO:tasks.workunit.client.0.smithi060.stdout:1/797: mknod d1e/d46/c116 0 2024-04-12T13:42:15.522 INFO:tasks.workunit.client.0.smithi060.stdout:9/604: getdents d4/d33/d50 0 2024-04-12T13:42:15.524 INFO:tasks.workunit.client.1.smithi110.stdout:6/717: mkdir d7/d10/d1c/d2b/d3a/dbf/de2 0 2024-04-12T13:42:15.524 INFO:tasks.workunit.client.0.smithi060.stdout:9/605: readlink d4/d9/d19/d21/d73/lbe 0 2024-04-12T13:42:15.526 INFO:tasks.workunit.client.1.smithi110.stdout:1/729: dread de/d7b/fde [0,4194304] 0 2024-04-12T13:42:15.528 INFO:tasks.workunit.client.1.smithi110.stdout:4/817: truncate d0/d78/f81 651418 0 2024-04-12T13:42:15.529 INFO:tasks.workunit.client.0.smithi060.stdout:8/675: dread d9/d1d/d2f/fe2 [0,4194304] 0 2024-04-12T13:42:15.533 INFO:tasks.workunit.client.1.smithi110.stdout:1/730: dread de/d14/d34/d55/d6b/dc7/fdd [0,4194304] 0 2024-04-12T13:42:15.533 INFO:tasks.workunit.client.0.smithi060.stdout:4/677: truncate d6/d7/dd/d4d/f9b 3246855 0 2024-04-12T13:42:15.535 INFO:tasks.workunit.client.1.smithi110.stdout:1/731: fsync de/f5b 0 2024-04-12T13:42:15.535 INFO:tasks.workunit.client.1.smithi110.stdout:7/751: creat d1/d3/ffd x:0 0 0 2024-04-12T13:42:15.550 INFO:tasks.workunit.client.1.smithi110.stdout:3/700: creat d5/dc/d31/d3b/d32/d3e/fdb x:0 0 0 2024-04-12T13:42:15.552 INFO:tasks.workunit.client.1.smithi110.stdout:7/752: dwrite d1/d3/ffd [0,4194304] 0 2024-04-12T13:42:15.554 INFO:tasks.workunit.client.1.smithi110.stdout:3/701: dread - d5/dc/d31/d3b/d32/d3e/fdb zero size 2024-04-12T13:42:15.556 INFO:tasks.workunit.client.1.smithi110.stdout:0/665: dwrite d1/d8/f34 [0,4194304] 0 2024-04-12T13:42:15.556 INFO:tasks.workunit.client.1.smithi110.stdout:1/732: unlink de/d14/f7e 0 2024-04-12T13:42:15.557 INFO:tasks.workunit.client.1.smithi110.stdout:9/814: symlink df/d13/d2c/d2d/dc1/d83/l119 0 2024-04-12T13:42:15.562 INFO:tasks.workunit.client.1.smithi110.stdout:6/718: truncate d7/d10/d1c/d2b/d48/d4b/f94 1182823 0 2024-04-12T13:42:15.564 INFO:tasks.workunit.client.1.smithi110.stdout:3/702: rmdir d5/dc/d20/d2d/d4e/d89/d8c 39 2024-04-12T13:42:15.568 INFO:tasks.workunit.client.1.smithi110.stdout:8/759: link d1/d3/d3c/lcf d1/d3/d35/d3a/d3e/d64/lf8 0 2024-04-12T13:42:15.571 INFO:tasks.workunit.client.1.smithi110.stdout:4/818: link d0/d13/ce7 d0/de/d32/d5f/c10d 0 2024-04-12T13:42:15.573 INFO:tasks.workunit.client.1.smithi110.stdout:3/703: readlink d5/dc/d31/d3b/d32/d3e/d5f/dbd/lc3 0 2024-04-12T13:42:15.574 INFO:tasks.workunit.client.1.smithi110.stdout:4/819: fdatasync d0/de/d32/d5f/f7c 0 2024-04-12T13:42:15.576 INFO:tasks.workunit.client.1.smithi110.stdout:9/815: symlink df/d13/d2c/d2d/dc1/d83/d63/db4/ddb/d110/l11a 0 2024-04-12T13:42:15.582 INFO:tasks.workunit.client.1.smithi110.stdout:6/719: dread d7/d25/f87 [0,4194304] 0 2024-04-12T13:42:15.583 INFO:tasks.workunit.client.1.smithi110.stdout:9/816: unlink df/l6f 0 2024-04-12T13:42:15.583 INFO:tasks.workunit.client.1.smithi110.stdout:4/820: dread d0/d78/faf [0,4194304] 0 2024-04-12T13:42:15.585 INFO:tasks.workunit.client.1.smithi110.stdout:5/711: sync 2024-04-12T13:42:15.585 INFO:tasks.workunit.client.1.smithi110.stdout:2/767: sync 2024-04-12T13:42:15.589 INFO:tasks.workunit.client.1.smithi110.stdout:4/821: chown d0/de/da0/dd9/df3/de0/d7e 803489 1 2024-04-12T13:42:15.589 INFO:tasks.workunit.client.1.smithi110.stdout:2/768: stat d6/dc/d6f/f96 0 2024-04-12T13:42:15.589 INFO:tasks.workunit.client.1.smithi110.stdout:6/720: creat d7/d10/d7e/fe3 x:0 0 0 2024-04-12T13:42:15.591 INFO:tasks.workunit.client.1.smithi110.stdout:3/704: dread d5/dc/d20/d2d/f51 [0,4194304] 0 2024-04-12T13:42:15.592 INFO:tasks.workunit.client.1.smithi110.stdout:6/721: read d7/d25/d2c/f3c [1511588,73378] 0 2024-04-12T13:42:15.593 INFO:tasks.workunit.client.1.smithi110.stdout:5/712: write da/d2e/d45/d29/d58/f6d [2216209,40742] 0 2024-04-12T13:42:15.593 INFO:tasks.workunit.client.1.smithi110.stdout:2/769: mknod d6/dc/dd/dc6/ceb 0 2024-04-12T13:42:15.594 INFO:tasks.workunit.client.0.smithi060.stdout:8/676: truncate d9/d1b/d3c/f56 1308384 0 2024-04-12T13:42:15.594 INFO:tasks.workunit.client.0.smithi060.stdout:0/643: mkdir d7/d9/d14/d35/d44/d49/dcf/dd0/dd6 0 2024-04-12T13:42:15.594 INFO:tasks.workunit.client.0.smithi060.stdout:7/670: symlink d0/d7/lda 0 2024-04-12T13:42:15.595 INFO:tasks.workunit.client.0.smithi060.stdout:9/606: write d4/d8/f41 [1582524,34469] 0 2024-04-12T13:42:15.595 INFO:tasks.workunit.client.0.smithi060.stdout:4/678: unlink d6/d7/dd/d1a/d57/d63/d68/d76/ld0 0 2024-04-12T13:42:15.597 INFO:tasks.workunit.client.1.smithi110.stdout:9/817: truncate df/d13/d2c/d9e/dd6/fc2 667156 0 2024-04-12T13:42:15.598 INFO:tasks.workunit.client.0.smithi060.stdout:6/752: creat d1/d7/da/dc/d24/d34/d51/d59/d94/ffa x:0 0 0 2024-04-12T13:42:15.599 INFO:tasks.workunit.client.1.smithi110.stdout:2/770: fsync d6/dc/d1b/d57/d62/fdc 0 2024-04-12T13:42:15.599 INFO:tasks.workunit.client.0.smithi060.stdout:8/677: fdatasync d9/d1b/d84/fb9 0 2024-04-12T13:42:15.601 INFO:tasks.workunit.client.0.smithi060.stdout:5/715: creat d6/dd/feb x:0 0 0 2024-04-12T13:42:15.602 INFO:tasks.workunit.client.1.smithi110.stdout:6/722: creat d7/da9/fe4 x:0 0 0 2024-04-12T13:42:15.603 INFO:tasks.workunit.client.1.smithi110.stdout:0/666: write d1/d8/f2e [4594025,27263] 0 2024-04-12T13:42:15.605 INFO:tasks.workunit.client.0.smithi060.stdout:5/716: chown d6/dd/d1f/d25/d42/d52/d7a 482838439 1 2024-04-12T13:42:15.607 INFO:tasks.workunit.client.1.smithi110.stdout:3/705: mknod d5/dc/d31/d3b/d32/cdc 0 2024-04-12T13:42:15.608 INFO:tasks.workunit.client.1.smithi110.stdout:8/760: dread d1/d3/d35/d3a/d3e/d4f/f87 [0,4194304] 0 2024-04-12T13:42:15.611 INFO:tasks.workunit.client.0.smithi060.stdout:9/607: unlink d4/d8/l9e 0 2024-04-12T13:42:15.616 INFO:tasks.workunit.client.1.smithi110.stdout:1/733: dwrite de/d14/d34/d55/f5c [0,4194304] 0 2024-04-12T13:42:15.619 INFO:tasks.workunit.client.1.smithi110.stdout:7/753: dwrite d1/f38 [0,4194304] 0 2024-04-12T13:42:15.621 INFO:tasks.workunit.client.1.smithi110.stdout:7/754: stat d1/d1b/d70/dd2 0 2024-04-12T13:42:15.623 INFO:tasks.workunit.client.0.smithi060.stdout:6/753: dwrite d1/d7/da/dc/d24/d30/d52/d5e/f98 [0,4194304] 0 2024-04-12T13:42:15.623 INFO:tasks.workunit.client.1.smithi110.stdout:9/818: dwrite df/d13/d26/f41 [4194304,4194304] 0 2024-04-12T13:42:15.624 INFO:tasks.workunit.client.0.smithi060.stdout:9/608: mknod d4/d9/d19/d21/dbb/cc8 0 2024-04-12T13:42:15.625 INFO:tasks.workunit.client.1.smithi110.stdout:5/713: creat da/d35/dd6/ff7 x:0 0 0 2024-04-12T13:42:15.626 INFO:tasks.workunit.client.1.smithi110.stdout:0/667: creat d1/d8/d36/d51/d60/fe9 x:0 0 0 2024-04-12T13:42:15.628 INFO:tasks.workunit.client.0.smithi060.stdout:9/609: chown d4/d9/d19/d21/l95 11372241 1 2024-04-12T13:42:15.628 INFO:tasks.workunit.client.0.smithi060.stdout:5/717: symlink d6/d10/d12/lec 0 2024-04-12T13:42:15.632 INFO:tasks.workunit.client.1.smithi110.stdout:9/819: fsync df/d13/d2c/d9e/dd6/fa8 0 2024-04-12T13:42:15.633 INFO:tasks.workunit.client.1.smithi110.stdout:5/714: dread - da/d2e/d45/d25/d9d/d79/fd0 zero size 2024-04-12T13:42:15.633 INFO:tasks.workunit.client.0.smithi060.stdout:5/718: write d6/dd/d1f/d25/d42/d52/dc8/fe4 [619777,39219] 0 2024-04-12T13:42:15.634 INFO:tasks.workunit.client.0.smithi060.stdout:0/644: rename d7/f9a to d7/d9/d14/d35/d44/d49/fd7 0 2024-04-12T13:42:15.635 INFO:tasks.workunit.client.0.smithi060.stdout:8/678: link d9/d1d/d5e/fba d9/d1b/d84/fee 0 2024-04-12T13:42:15.635 INFO:tasks.workunit.client.0.smithi060.stdout:9/610: truncate d4/d33/d65/d7a/fc0 701334 0 2024-04-12T13:42:15.640 INFO:tasks.workunit.client.1.smithi110.stdout:6/723: dread d7/d25/d2c/f3c [4194304,4194304] 0 2024-04-12T13:42:15.640 INFO:tasks.workunit.client.1.smithi110.stdout:5/715: write da/d2e/d45/d25/d9d/d79/d88/dd3/fd8 [1562001,42686] 0 2024-04-12T13:42:15.640 INFO:tasks.workunit.client.0.smithi060.stdout:6/754: fdatasync d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/ff1 0 2024-04-12T13:42:15.644 INFO:tasks.workunit.client.1.smithi110.stdout:7/755: mknod d1/d3/d4/d55/d56/cfe 0 2024-04-12T13:42:15.646 INFO:tasks.workunit.client.0.smithi060.stdout:6/755: dread - d1/d7/da/dc/ff5 zero size 2024-04-12T13:42:15.646 INFO:tasks.workunit.client.0.smithi060.stdout:6/756: write d1/d7/f5d [100388,40638] 0 2024-04-12T13:42:15.647 INFO:tasks.workunit.client.1.smithi110.stdout:3/706: dwrite d5/dc/d31/d74/fd4 [0,4194304] 0 2024-04-12T13:42:15.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/611: creat d4/d33/d65/fc9 x:0 0 0 2024-04-12T13:42:15.662 INFO:tasks.workunit.client.0.smithi060.stdout:4/679: dwrite d6/d21/f2a [0,4194304] 0 2024-04-12T13:42:15.664 INFO:tasks.workunit.client.0.smithi060.stdout:5/719: mkdir d6/dd/d1f/d25/d53/d87/d7e/dca/ded 0 2024-04-12T13:42:15.667 INFO:tasks.workunit.client.0.smithi060.stdout:0/645: rename d7/d9/d4c/d8e to d7/d9/d14/dab/dd8 0 2024-04-12T13:42:15.669 INFO:tasks.workunit.client.0.smithi060.stdout:2/699: sync 2024-04-12T13:42:15.670 INFO:tasks.workunit.client.1.smithi110.stdout:6/724: dwrite d7/d25/d30/d44/f21 [4194304,4194304] 0 2024-04-12T13:42:15.671 INFO:tasks.workunit.client.0.smithi060.stdout:8/679: symlink d9/d1b/d3c/d6e/d7b/db1/de5/lef 0 2024-04-12T13:42:15.674 INFO:tasks.workunit.client.1.smithi110.stdout:7/756: dwrite d1/f1e [4194304,4194304] 0 2024-04-12T13:42:15.678 INFO:tasks.workunit.client.1.smithi110.stdout:8/761: write d1/d3/d35/d3a/d3e/d64/d85/d8d/f91 [3928966,41800] 0 2024-04-12T13:42:15.683 INFO:tasks.workunit.client.1.smithi110.stdout:5/716: fsync da/d2e/d45/d25/d9d/f9a 0 2024-04-12T13:42:15.685 INFO:tasks.workunit.client.0.smithi060.stdout:7/671: dwrite d0/d78/f97 [0,4194304] 0 2024-04-12T13:42:15.691 INFO:tasks.workunit.client.0.smithi060.stdout:5/720: mkdir d6/d10/db8/dee 0 2024-04-12T13:42:15.694 INFO:tasks.workunit.client.1.smithi110.stdout:4/822: sync 2024-04-12T13:42:15.699 INFO:tasks.workunit.client.1.smithi110.stdout:2/771: getdents d6/dc/d1b/d57/d62/dcb 0 2024-04-12T13:42:15.702 INFO:tasks.workunit.client.1.smithi110.stdout:3/707: mknod d5/dc/d31/d3b/d32/d3e/d98/cdd 0 2024-04-12T13:42:15.706 INFO:tasks.workunit.client.0.smithi060.stdout:4/680: read d6/d7/dd/d1a/d56/f5c [4150216,5502] 0 2024-04-12T13:42:15.706 INFO:tasks.workunit.client.1.smithi110.stdout:2/772: truncate d6/dc/dd/f22 839176 0 2024-04-12T13:42:15.706 INFO:tasks.workunit.client.1.smithi110.stdout:1/734: truncate de/d15/d32/d61/f73 1895582 0 2024-04-12T13:42:15.708 INFO:tasks.workunit.client.1.smithi110.stdout:3/708: read d5/dc/f2e [484033,75717] 0 2024-04-12T13:42:15.709 INFO:tasks.workunit.client.0.smithi060.stdout:6/757: write d1/d7/da/d20/fd0 [827876,51819] 0 2024-04-12T13:42:15.714 INFO:tasks.workunit.client.1.smithi110.stdout:9/820: creat df/d38/d6e/dcb/f11b x:0 0 0 2024-04-12T13:42:15.716 INFO:tasks.workunit.client.1.smithi110.stdout:4/823: dread d0/d19/f74 [0,4194304] 0 2024-04-12T13:42:15.717 INFO:tasks.workunit.client.1.smithi110.stdout:6/725: mknod d7/d10/d41/ce5 0 2024-04-12T13:42:15.717 INFO:tasks.workunit.client.0.smithi060.stdout:6/758: chown d1/d7/da/dc/d24/d34/d51/d59/ce7 397583801 1 2024-04-12T13:42:15.720 INFO:tasks.workunit.client.1.smithi110.stdout:5/717: dread da/d2e/d45/d25/d9d/f9a [0,4194304] 0 2024-04-12T13:42:15.722 INFO:tasks.workunit.client.0.smithi060.stdout:9/612: write d4/d33/d50/f85 [27449,58337] 0 2024-04-12T13:42:15.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/732: sync 2024-04-12T13:42:15.725 INFO:tasks.workunit.client.0.smithi060.stdout:1/798: sync 2024-04-12T13:42:15.726 INFO:tasks.workunit.client.0.smithi060.stdout:5/721: fsync d6/dd/f8a 0 2024-04-12T13:42:15.729 INFO:tasks.workunit.client.1.smithi110.stdout:1/735: dwrite de/d14/d34/d55/d6b/dc7/fd2 [0,4194304] 0 2024-04-12T13:42:15.729 INFO:tasks.workunit.client.0.smithi060.stdout:7/672: dread d0/d7/d43/d63/d6f/f7f [0,4194304] 0 2024-04-12T13:42:15.731 INFO:tasks.workunit.client.0.smithi060.stdout:8/680: rename d9/d1b/d37/f39 to d9/d1b/d2b/d82/d8a/dce/ff0 0 2024-04-12T13:42:15.737 INFO:tasks.workunit.client.0.smithi060.stdout:6/759: creat d1/d7/da/dc/d24/d2d/db0/db2/ffb x:0 0 0 2024-04-12T13:42:15.739 INFO:tasks.workunit.client.1.smithi110.stdout:7/757: write d1/d1b/d74/f79 [1037125,98795] 0 2024-04-12T13:42:15.743 INFO:tasks.workunit.client.0.smithi060.stdout:6/760: fsync d1/fb6 0 2024-04-12T13:42:15.744 INFO:tasks.workunit.client.1.smithi110.stdout:0/668: dwrite d1/d8/f53 [0,4194304] 0 2024-04-12T13:42:15.745 INFO:tasks.workunit.client.0.smithi060.stdout:7/673: chown d0/ld4 417365722 1 2024-04-12T13:42:15.746 INFO:tasks.workunit.client.1.smithi110.stdout:2/773: dread d6/dc/dd/d49/d64/d4a/d51/f78 [0,4194304] 0 2024-04-12T13:42:15.751 INFO:tasks.workunit.client.1.smithi110.stdout:8/762: fsync d1/d3/d3c/d5a/d6f/d83/fae 0 2024-04-12T13:42:15.752 INFO:tasks.workunit.client.0.smithi060.stdout:1/799: dwrite d1e/d94/fe9 [0,4194304] 0 2024-04-12T13:42:15.752 INFO:tasks.workunit.client.0.smithi060.stdout:9/613: truncate d4/d9/d19/f4e 2584312 0 2024-04-12T13:42:15.756 INFO:tasks.workunit.client.1.smithi110.stdout:7/758: dwrite d1/d3/d4/d55/d56/fd9 [0,4194304] 0 2024-04-12T13:42:15.758 INFO:tasks.workunit.client.0.smithi060.stdout:9/614: write d4/f2d [7711012,122775] 0 2024-04-12T13:42:15.758 INFO:tasks.workunit.client.1.smithi110.stdout:4/824: creat d0/de/da0/dd9/df3/dd7/f10e x:0 0 0 2024-04-12T13:42:15.762 INFO:tasks.workunit.client.0.smithi060.stdout:0/646: rename d7/d9/d14/dab to d7/d9/d14/d35/d44/dd9 0 2024-04-12T13:42:15.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/722: mknod d6/d10/de6/cef 0 2024-04-12T13:42:15.769 INFO:tasks.workunit.client.0.smithi060.stdout:2/700: dwrite d6/d10/d81/dbd/f63 [0,4194304] 0 2024-04-12T13:42:15.771 INFO:tasks.workunit.client.1.smithi110.stdout:6/726: write d7/d10/f20 [1135830,25902] 0 2024-04-12T13:42:15.771 INFO:tasks.workunit.client.1.smithi110.stdout:9/821: write df/d13/d2c/d2d/dc1/f74 [1834128,109758] 0 2024-04-12T13:42:15.774 INFO:tasks.workunit.client.1.smithi110.stdout:9/822: fsync df/d13/d26/d37/d6a/fec 0 2024-04-12T13:42:15.776 INFO:tasks.workunit.client.1.smithi110.stdout:9/823: write df/d8a/fe6 [3762249,19764] 0 2024-04-12T13:42:15.777 INFO:tasks.workunit.client.0.smithi060.stdout:8/681: dread d9/f11 [0,4194304] 0 2024-04-12T13:42:15.779 INFO:tasks.workunit.client.0.smithi060.stdout:1/800: symlink d1e/d23/d2e/d5e/d68/l117 0 2024-04-12T13:42:15.779 INFO:tasks.workunit.client.0.smithi060.stdout:2/701: chown d6/dae/d31/f41 71 1 2024-04-12T13:42:15.780 INFO:tasks.workunit.client.1.smithi110.stdout:9/824: fdatasync df/d13/d2c/d2d/dc1/d83/d63/db4/fbf 0 2024-04-12T13:42:15.782 INFO:tasks.workunit.client.0.smithi060.stdout:1/801: chown d1e/d23/dd9 157 1 2024-04-12T13:42:15.785 INFO:tasks.workunit.client.0.smithi060.stdout:1/802: write d1e/f4d [748606,99580] 0 2024-04-12T13:42:15.787 INFO:tasks.workunit.client.0.smithi060.stdout:4/681: rename d6/d7/dd/d1a/d57/fa7 to d6/d7/dd/d1a/d19/d42/fe0 0 2024-04-12T13:42:15.787 INFO:tasks.workunit.client.0.smithi060.stdout:6/761: dread d1/f15 [0,4194304] 0 2024-04-12T13:42:15.800 INFO:tasks.workunit.client.0.smithi060.stdout:2/702: creat d6/d10/d2b/d60/fd0 x:0 0 0 2024-04-12T13:42:15.803 INFO:tasks.workunit.client.0.smithi060.stdout:2/703: chown d6/d10/d81/dbd/fc2 93029 1 2024-04-12T13:42:15.803 INFO:tasks.workunit.client.0.smithi060.stdout:8/682: unlink d9/d1b/d37/d4d/f5a 0 2024-04-12T13:42:15.806 INFO:tasks.workunit.client.0.smithi060.stdout:7/674: dread d0/d3d/f58 [0,4194304] 0 2024-04-12T13:42:15.811 INFO:tasks.workunit.client.1.smithi110.stdout:7/759: unlink d1/d3/d4/d55/d56/d72/dad/ld8 0 2024-04-12T13:42:15.812 INFO:tasks.workunit.client.1.smithi110.stdout:5/718: write da/d2e/d45/d25/d9d/d7a/db5/d8f/f5b [847704,97905] 0 2024-04-12T13:42:15.812 INFO:tasks.workunit.client.0.smithi060.stdout:2/704: dread d6/dae/d5b/d6d/f90 [0,4194304] 0 2024-04-12T13:42:15.813 INFO:tasks.workunit.client.1.smithi110.stdout:1/736: write de/d15/d32/f52 [434988,26961] 0 2024-04-12T13:42:15.820 INFO:tasks.workunit.client.1.smithi110.stdout:8/763: dwrite d1/d5/d1f/f66 [8388608,4194304] 0 2024-04-12T13:42:15.823 INFO:tasks.workunit.client.1.smithi110.stdout:8/764: stat d1/d3/d35/d43/d9f/ceb 0 2024-04-12T13:42:15.825 INFO:tasks.workunit.client.1.smithi110.stdout:0/669: write d1/d5e/f95 [483891,39388] 0 2024-04-12T13:42:15.828 INFO:tasks.workunit.client.1.smithi110.stdout:4/825: dread d0/de/d32/d61/f7a [0,4194304] 0 2024-04-12T13:42:15.829 INFO:tasks.workunit.client.1.smithi110.stdout:3/709: link d5/dc/f53 d5/dc/d31/d3b/d32/d3e/d5f/dbd/fde 0 2024-04-12T13:42:15.831 INFO:tasks.workunit.client.1.smithi110.stdout:4/826: chown d0/d19/f62 218626338 1 2024-04-12T13:42:15.837 INFO:tasks.workunit.client.0.smithi060.stdout:3/733: rename d7/d17/l9c to d7/d17/d27/d36/db0/dc4/lec 0 2024-04-12T13:42:15.837 INFO:tasks.workunit.client.0.smithi060.stdout:5/723: dwrite d6/d10/d12/f36 [4194304,4194304] 0 2024-04-12T13:42:15.838 INFO:tasks.workunit.client.1.smithi110.stdout:7/760: creat d1/d1b/d70/fff x:0 0 0 2024-04-12T13:42:15.839 INFO:tasks.workunit.client.1.smithi110.stdout:5/719: mkdir da/d5c/df8 0 2024-04-12T13:42:15.843 INFO:tasks.workunit.client.1.smithi110.stdout:7/761: write d1/d3/d4/dbf/fe8 [240078,80936] 0 2024-04-12T13:42:15.843 INFO:tasks.workunit.client.0.smithi060.stdout:0/647: creat d7/d9/d14/fda x:0 0 0 2024-04-12T13:42:15.845 INFO:tasks.workunit.client.0.smithi060.stdout:2/705: rmdir d6/d10/d4b 39 2024-04-12T13:42:15.849 INFO:tasks.workunit.client.1.smithi110.stdout:8/765: chown d1/d5/dd/le8 64756529 1 2024-04-12T13:42:15.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/734: rmdir d7 39 2024-04-12T13:42:15.849 INFO:tasks.workunit.client.1.smithi110.stdout:4/827: dwrite d0/f5 [4194304,4194304] 0 2024-04-12T13:42:15.850 INFO:tasks.workunit.client.1.smithi110.stdout:3/710: dwrite d5/dc/d31/d3b/d32/d3e/d5f/f8b [0,4194304] 0 2024-04-12T13:42:15.851 INFO:tasks.workunit.client.0.smithi060.stdout:6/762: write d1/d7/da/dc/d24/d30/f71 [437725,37429] 0 2024-04-12T13:42:15.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/682: dread d6/d21/f53 [0,4194304] 0 2024-04-12T13:42:15.853 INFO:tasks.workunit.client.1.smithi110.stdout:2/774: rename d6/dc/d9d to d6/dc/d13/dec 0 2024-04-12T13:42:15.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/724: dread - d6/dd/d1f/d25/d42/d52/d7a/fde zero size 2024-04-12T13:42:15.856 INFO:tasks.workunit.client.0.smithi060.stdout:6/763: dread - d1/d7/da/dc/d24/d2d/db0/fb8 zero size 2024-04-12T13:42:15.861 INFO:tasks.workunit.client.1.smithi110.stdout:5/720: symlink da/d2e/d45/d25/d9d/d79/d88/db0/lf9 0 2024-04-12T13:42:15.861 INFO:tasks.workunit.client.1.smithi110.stdout:8/766: truncate d1/d5/dd/d31/dba/fd8 898309 0 2024-04-12T13:42:15.862 INFO:tasks.workunit.client.1.smithi110.stdout:3/711: readlink d5/dc/d31/d3b/d32/l81 0 2024-04-12T13:42:15.864 INFO:tasks.workunit.client.1.smithi110.stdout:6/727: sync 2024-04-12T13:42:15.865 INFO:tasks.workunit.client.1.smithi110.stdout:8/767: read d1/d5/dd/d31/dba/fd8 [749829,19429] 0 2024-04-12T13:42:15.865 INFO:tasks.workunit.client.0.smithi060.stdout:1/803: write d1e/d23/d2e/d30/fda [1756957,26230] 0 2024-04-12T13:42:15.867 INFO:tasks.workunit.client.0.smithi060.stdout:1/804: readlink d1e/l20 0 2024-04-12T13:42:15.874 INFO:tasks.workunit.client.0.smithi060.stdout:0/648: dread d7/d9/d14/f34 [0,4194304] 0 2024-04-12T13:42:15.876 INFO:tasks.workunit.client.0.smithi060.stdout:7/675: dwrite d0/d7/f9d [0,4194304] 0 2024-04-12T13:42:15.878 INFO:tasks.workunit.client.1.smithi110.stdout:7/762: dwrite d1/d3/f6d [0,4194304] 0 2024-04-12T13:42:15.878 INFO:tasks.workunit.client.0.smithi060.stdout:9/615: rename d4/d9/l23 to d4/d9/d19/d21/lca 0 2024-04-12T13:42:15.881 INFO:tasks.workunit.client.1.smithi110.stdout:4/828: creat d0/de/d32/d61/f10f x:0 0 0 2024-04-12T13:42:15.881 INFO:tasks.workunit.client.1.smithi110.stdout:1/737: dwrite de/d14/d34/d55/d6b/f7c [0,4194304] 0 2024-04-12T13:42:15.882 INFO:tasks.workunit.client.0.smithi060.stdout:9/616: dread - d4/d8/d7c/fa7 zero size 2024-04-12T13:42:15.885 INFO:tasks.workunit.client.0.smithi060.stdout:5/725: mknod d6/dd/d1f/d25/d53/d87/cf0 0 2024-04-12T13:42:15.885 INFO:tasks.workunit.client.0.smithi060.stdout:8/683: getdents d9/d1b/d2b/d82/d8a/dce 0 2024-04-12T13:42:15.887 INFO:tasks.workunit.client.0.smithi060.stdout:6/764: fdatasync d1/d7/da/dc/d24/d30/d52/d5e/f67 0 2024-04-12T13:42:15.892 INFO:tasks.workunit.client.1.smithi110.stdout:7/763: dread d1/f28 [0,4194304] 0 2024-04-12T13:42:15.894 INFO:tasks.workunit.client.0.smithi060.stdout:3/735: unlink d7/d17/d27/d36/d53/f6a 0 2024-04-12T13:42:15.899 INFO:tasks.workunit.client.0.smithi060.stdout:7/676: rename d0/d1b/d8c/l9a to d0/d1b/d8c/ldb 0 2024-04-12T13:42:15.903 INFO:tasks.workunit.client.0.smithi060.stdout:9/617: rename d4/d33/d50/f61 to d4/d9/d19/d8c/d92/fcb 0 2024-04-12T13:42:15.906 INFO:tasks.workunit.client.1.smithi110.stdout:7/764: dwrite d1/d3/d4/d55/d56/fd9 [0,4194304] 0 2024-04-12T13:42:15.908 INFO:tasks.workunit.client.0.smithi060.stdout:6/765: dread d1/d7/da/fbf [0,4194304] 0 2024-04-12T13:42:15.909 INFO:tasks.workunit.client.1.smithi110.stdout:7/765: write d1/d3/d4/dbf/fac [3446707,56197] 0 2024-04-12T13:42:15.910 INFO:tasks.workunit.client.0.smithi060.stdout:1/805: unlink d1e/d23/d2e/d5e/ff8 0 2024-04-12T13:42:15.919 INFO:tasks.workunit.client.0.smithi060.stdout:0/649: symlink d7/d9/de/d80/dc8/ldb 0 2024-04-12T13:42:15.920 INFO:tasks.workunit.client.0.smithi060.stdout:5/726: truncate d6/d10/d12/d4c/f85 2198508 0 2024-04-12T13:42:15.922 INFO:tasks.workunit.client.0.smithi060.stdout:3/736: mkdir d7/d17/d27/d36/db0/dc4/ded 0 2024-04-12T13:42:15.925 INFO:tasks.workunit.client.0.smithi060.stdout:2/706: truncate d6/d56/f2d 2560122 0 2024-04-12T13:42:15.926 INFO:tasks.workunit.client.0.smithi060.stdout:7/677: stat d0/d7/d92/l99 0 2024-04-12T13:42:15.933 INFO:tasks.workunit.client.0.smithi060.stdout:8/684: creat d9/dc9/ff1 x:0 0 0 2024-04-12T13:42:15.936 INFO:tasks.workunit.client.0.smithi060.stdout:4/683: dread d6/d7/dd/d1a/d19/d42/d7c/f9a [0,4194304] 0 2024-04-12T13:42:15.942 INFO:tasks.workunit.client.0.smithi060.stdout:2/707: creat d6/d56/d58/fd1 x:0 0 0 2024-04-12T13:42:15.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/618: rename d4/d8/f17 to d4/d33/d65/d7a/fcc 0 2024-04-12T13:42:15.947 INFO:tasks.workunit.client.0.smithi060.stdout:1/806: mkdir d1e/d118 0 2024-04-12T13:42:15.953 INFO:tasks.workunit.client.0.smithi060.stdout:8/685: write d9/d1d/d2f/f4b [1872616,84829] 0 2024-04-12T13:42:15.956 INFO:tasks.workunit.client.0.smithi060.stdout:4/684: symlink d6/d7/dd/d1a/d19/d7a/d9d/le1 0 2024-04-12T13:42:15.960 INFO:tasks.workunit.client.0.smithi060.stdout:2/708: fdatasync d6/dae/d31/f41 0 2024-04-12T13:42:15.963 INFO:tasks.workunit.client.0.smithi060.stdout:2/709: stat d6/d56/d55/f88 0 2024-04-12T13:42:15.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/710: readlink d6/d10/d2b/d60/lb1 0 2024-04-12T13:42:15.967 INFO:tasks.workunit.client.0.smithi060.stdout:2/711: chown d6/dae/d31/d33/fa5 3633852 1 2024-04-12T13:42:15.969 INFO:tasks.workunit.client.0.smithi060.stdout:2/712: write d6/d56/d43/f72 [1355199,115902] 0 2024-04-12T13:42:15.971 INFO:tasks.workunit.client.0.smithi060.stdout:3/737: rename d7/d17/d19/d33/fbb to d7/d17/d27/d36/db0/dc4/fee 0 2024-04-12T13:42:15.972 INFO:tasks.workunit.client.0.smithi060.stdout:9/619: mknod d4/d33/d50/ccd 0 2024-04-12T13:42:15.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/620: stat d4/d9/d19/d8c/da6/fac 0 2024-04-12T13:42:15.977 INFO:tasks.workunit.client.0.smithi060.stdout:0/650: link d7/c29 d7/d9/de/d63/cdc 0 2024-04-12T13:42:15.983 INFO:tasks.workunit.client.1.smithi110.stdout:3/712: creat d5/dc/d20/d2d/d4f/dce/fdf x:0 0 0 2024-04-12T13:42:15.983 INFO:tasks.workunit.client.0.smithi060.stdout:1/807: dread d1e/d23/dd9/faf [0,4194304] 0 2024-04-12T13:42:15.995 INFO:tasks.workunit.client.1.smithi110.stdout:9/825: getdents df/d13/d2c/d2d/dc1/d83/d63/db4/ddb 0 2024-04-12T13:42:15.999 INFO:tasks.workunit.client.0.smithi060.stdout:0/651: mknod d7/d9/d14/d35/d44/d49/dcf/dd0/cdd 0 2024-04-12T13:42:16.000 INFO:tasks.workunit.client.0.smithi060.stdout:8/686: dread d9/d1d/d2f/f30 [0,4194304] 0 2024-04-12T13:42:16.003 INFO:tasks.workunit.client.0.smithi060.stdout:1/808: mknod d1e/d23/d2e/d5e/d68/c119 0 2024-04-12T13:42:16.004 INFO:tasks.workunit.client.0.smithi060.stdout:8/687: readlink d9/d1d/d5e/d90/lc2 0 2024-04-12T13:42:16.010 INFO:tasks.workunit.client.0.smithi060.stdout:8/688: chown d9/d1b/d37/d4d/d63/d66/d8b/fbf 131722241 1 2024-04-12T13:42:16.014 INFO:tasks.workunit.client.0.smithi060.stdout:9/621: mkdir d4/d9/d19/d21/dbf/dce 0 2024-04-12T13:42:16.016 INFO:tasks.workunit.client.0.smithi060.stdout:6/766: truncate d1/d7/da/dc/d24/d30/d52/d78/d80/f85 3724475 0 2024-04-12T13:42:16.017 INFO:tasks.workunit.client.0.smithi060.stdout:1/809: dread d1e/d23/d49/d4e/fef [0,4194304] 0 2024-04-12T13:42:16.018 INFO:tasks.workunit.client.0.smithi060.stdout:7/678: dwrite d0/fd8 [0,4194304] 0 2024-04-12T13:42:16.021 INFO:tasks.workunit.client.0.smithi060.stdout:2/713: dread d6/dae/d31/d33/f49 [0,4194304] 0 2024-04-12T13:42:16.026 INFO:tasks.workunit.client.0.smithi060.stdout:0/652: read d7/d9/d14/f85 [114465,6534] 0 2024-04-12T13:42:16.029 INFO:tasks.workunit.client.0.smithi060.stdout:0/653: dread - d7/d33/d5b/f9f zero size 2024-04-12T13:42:16.030 INFO:tasks.workunit.client.1.smithi110.stdout:5/721: link da/d2e/d45/d25/d9d/d79/fd0 da/db/d3b/ffa 0 2024-04-12T13:42:16.034 INFO:tasks.workunit.client.0.smithi060.stdout:0/654: write d7/d33/d5b/f64 [454155,124836] 0 2024-04-12T13:42:16.035 INFO:tasks.workunit.client.1.smithi110.stdout:9/826: dwrite df/d13/d2c/d2d/d39/d4f/fdd [0,4194304] 0 2024-04-12T13:42:16.038 INFO:tasks.workunit.client.0.smithi060.stdout:3/738: unlink d7/d17/d19/dc9/f35 0 2024-04-12T13:42:16.040 INFO:tasks.workunit.client.1.smithi110.stdout:0/670: link d1/d27/d6e/f91 d1/d8/d36/d51/fea 0 2024-04-12T13:42:16.042 INFO:tasks.workunit.client.0.smithi060.stdout:9/622: creat d4/d9/d19/daf/fcf x:0 0 0 2024-04-12T13:42:16.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/685: write d6/d7/dd/df/fc0 [184411,127875] 0 2024-04-12T13:42:16.042 INFO:tasks.workunit.client.0.smithi060.stdout:7/679: dwrite d0/d3d/fc4 [0,4194304] 0 2024-04-12T13:42:16.046 INFO:tasks.workunit.client.1.smithi110.stdout:4/829: sync 2024-04-12T13:42:16.050 INFO:tasks.workunit.client.0.smithi060.stdout:1/810: creat d1e/d1f/f11a x:0 0 0 2024-04-12T13:42:16.052 INFO:tasks.workunit.client.1.smithi110.stdout:6/728: write d7/d25/d2c/d4c/d77/f8a [211056,624] 0 2024-04-12T13:42:16.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/714: creat d6/d10/d2b/d60/fd2 x:0 0 0 2024-04-12T13:42:16.058 INFO:tasks.workunit.client.1.smithi110.stdout:8/768: link d1/d7/d20/c7f d1/d3/d35/d3a/d41/d77/cf9 0 2024-04-12T13:42:16.062 INFO:tasks.workunit.client.1.smithi110.stdout:0/671: mkdir d1/d56/deb 0 2024-04-12T13:42:16.065 INFO:tasks.workunit.client.1.smithi110.stdout:3/713: dread d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:16.065 INFO:tasks.workunit.client.0.smithi060.stdout:8/689: symlink d9/d1b/lf2 0 2024-04-12T13:42:16.067 INFO:tasks.workunit.client.1.smithi110.stdout:2/775: creat d6/dc/dd/d49/d64/d25/db0/fed x:0 0 0 2024-04-12T13:42:16.068 INFO:tasks.workunit.client.1.smithi110.stdout:3/714: chown d5/dc/d20/cac 9850864 1 2024-04-12T13:42:16.070 INFO:tasks.workunit.client.1.smithi110.stdout:4/830: creat d0/de/da0/f110 x:0 0 0 2024-04-12T13:42:16.073 INFO:tasks.workunit.client.1.smithi110.stdout:7/766: dwrite d1/f2b [0,4194304] 0 2024-04-12T13:42:16.073 INFO:tasks.workunit.client.1.smithi110.stdout:5/722: mkdir da/dfb 0 2024-04-12T13:42:16.076 INFO:tasks.workunit.client.1.smithi110.stdout:6/729: fsync d7/d10/d1c/f42 0 2024-04-12T13:42:16.077 INFO:tasks.workunit.client.1.smithi110.stdout:6/730: chown d7/d10/f20 89457147 1 2024-04-12T13:42:16.079 INFO:tasks.workunit.client.1.smithi110.stdout:9/827: symlink df/d13/d2c/l11c 0 2024-04-12T13:42:16.081 INFO:tasks.workunit.client.0.smithi060.stdout:9/623: mkdir d4/d33/d50/dd0 0 2024-04-12T13:42:16.082 INFO:tasks.workunit.client.1.smithi110.stdout:8/769: symlink d1/d3/d35/d3a/d3e/d64/d85/d8d/lfa 0 2024-04-12T13:42:16.083 INFO:tasks.workunit.client.1.smithi110.stdout:8/770: stat d1/d3/d35/l5d 0 2024-04-12T13:42:16.086 INFO:tasks.workunit.client.1.smithi110.stdout:1/738: getdents de/d15/d32/d61/d6a 0 2024-04-12T13:42:16.088 INFO:tasks.workunit.client.1.smithi110.stdout:5/723: dwrite da/d2e/d45/d29/fbc [0,4194304] 0 2024-04-12T13:42:16.088 INFO:tasks.workunit.client.1.smithi110.stdout:1/739: chown de/d14/d34/d55/d6b/f7c 75476655 1 2024-04-12T13:42:16.090 INFO:tasks.workunit.client.1.smithi110.stdout:0/672: mknod d1/d3c/dd8/cec 0 2024-04-12T13:42:16.090 INFO:tasks.workunit.client.1.smithi110.stdout:5/724: chown da/d2e/d45/d25/d9d 28 1 2024-04-12T13:42:16.092 INFO:tasks.workunit.client.1.smithi110.stdout:1/740: write de/d15/dab/dd8/dd9/dda/ff2 [639753,118531] 0 2024-04-12T13:42:16.092 INFO:tasks.workunit.client.1.smithi110.stdout:2/776: fsync d6/dc/dd/d49/d64/f5e 0 2024-04-12T13:42:16.094 INFO:tasks.workunit.client.1.smithi110.stdout:5/725: stat da/d2e/d45/d25/d9d/d7a/db5/lb7 0 2024-04-12T13:42:16.095 INFO:tasks.workunit.client.1.smithi110.stdout:5/726: dread - da/db/fc9 zero size 2024-04-12T13:42:16.099 INFO:tasks.workunit.client.1.smithi110.stdout:7/767: mknod d1/d31/d5d/c100 0 2024-04-12T13:42:16.107 INFO:tasks.workunit.client.1.smithi110.stdout:9/828: mkdir df/d13/d2c/d9e/d11d 0 2024-04-12T13:42:16.108 INFO:tasks.workunit.client.0.smithi060.stdout:2/715: dread d6/d10/d6b/f84 [0,4194304] 0 2024-04-12T13:42:16.108 INFO:tasks.workunit.client.0.smithi060.stdout:7/680: write d0/d7/d43/d63/f9f [704119,1785] 0 2024-04-12T13:42:16.112 INFO:tasks.workunit.client.1.smithi110.stdout:8/771: symlink d1/d3/d35/d3a/d3e/d64/d85/lfb 0 2024-04-12T13:42:16.113 INFO:tasks.workunit.client.1.smithi110.stdout:0/673: mknod d1/d8/d36/d65/ced 0 2024-04-12T13:42:16.113 INFO:tasks.workunit.client.0.smithi060.stdout:7/681: truncate d0/d7/d43/fce 480581 0 2024-04-12T13:42:16.113 INFO:tasks.workunit.client.0.smithi060.stdout:1/811: mkdir d1e/d29/d65/de7/d11b 0 2024-04-12T13:42:16.115 INFO:tasks.workunit.client.1.smithi110.stdout:3/715: dread d5/dc/d31/d3b/f6b [0,4194304] 0 2024-04-12T13:42:16.120 INFO:tasks.workunit.client.0.smithi060.stdout:9/624: dwrite d4/d9/d19/d21/d73/d67/f39 [0,4194304] 0 2024-04-12T13:42:16.130 INFO:tasks.workunit.client.1.smithi110.stdout:3/716: dwrite d5/dc/d31/d3b/d32/d3e/d98/f9e [0,4194304] 0 2024-04-12T13:42:16.131 INFO:tasks.workunit.client.0.smithi060.stdout:9/625: dread d4/d33/d50/f85 [0,4194304] 0 2024-04-12T13:42:16.131 INFO:tasks.workunit.client.1.smithi110.stdout:6/731: creat d7/d25/d30/d6b/dd7/fe6 x:0 0 0 2024-04-12T13:42:16.137 INFO:tasks.workunit.client.1.smithi110.stdout:0/674: mkdir d1/d8/d36/d51/dee 0 2024-04-12T13:42:16.138 INFO:tasks.workunit.client.1.smithi110.stdout:0/675: chown d1/f6a 99 1 2024-04-12T13:42:16.139 INFO:tasks.workunit.client.1.smithi110.stdout:9/829: dread df/d13/d2c/d2d/d39/f79 [0,4194304] 0 2024-04-12T13:42:16.146 INFO:tasks.workunit.client.1.smithi110.stdout:4/831: truncate d0/de/d32/d61/de9/f105 488091 0 2024-04-12T13:42:16.146 INFO:tasks.workunit.client.1.smithi110.stdout:2/777: creat d6/dc/d1b/d8f/fee x:0 0 0 2024-04-12T13:42:16.146 INFO:tasks.workunit.client.1.smithi110.stdout:8/772: truncate d1/d3/d3c/d5a/d6f/d83/fae 308728 0 2024-04-12T13:42:16.147 INFO:tasks.workunit.client.1.smithi110.stdout:5/727: write da/db/d3b/ffa [426330,112525] 0 2024-04-12T13:42:16.158 INFO:tasks.workunit.client.0.smithi060.stdout:9/626: dwrite d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:16.159 INFO:tasks.workunit.client.1.smithi110.stdout:0/676: rename d1/d8/d8a/fe0 to d1/d27/d6e/fef 0 2024-04-12T13:42:16.162 INFO:tasks.workunit.client.1.smithi110.stdout:9/830: fdatasync df/d13/d26/d37/fcc 0 2024-04-12T13:42:16.167 INFO:tasks.workunit.client.1.smithi110.stdout:2/778: fsync d6/dc/f3f 0 2024-04-12T13:42:16.172 INFO:tasks.workunit.client.1.smithi110.stdout:7/768: link d1/d3/d4/d55/cb0 d1/d1b/dc6/c101 0 2024-04-12T13:42:16.179 INFO:tasks.workunit.client.0.smithi060.stdout:9/627: dwrite d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:15 smithi060 ceph-mon[29097]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 90 MiB/s rd, 276 MiB/s wr, 544 op/s 2024-04-12T13:42:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:15 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:15 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:15 smithi060 ceph-mon[29097]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-04-12T13:42:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:15 smithi060 ceph-mon[29097]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-04-12T13:42:16.185 INFO:tasks.workunit.client.1.smithi110.stdout:0/677: symlink d1/d27/d31/d67/dcb/lf0 0 2024-04-12T13:42:16.187 INFO:tasks.workunit.client.1.smithi110.stdout:0/678: chown d1/d5e/f80 13 1 2024-04-12T13:42:16.197 INFO:tasks.workunit.client.1.smithi110.stdout:6/732: dwrite d7/d25/d2c/f40 [0,4194304] 0 2024-04-12T13:42:16.203 INFO:tasks.workunit.client.1.smithi110.stdout:1/741: sync 2024-04-12T13:42:16.206 INFO:tasks.workunit.client.1.smithi110.stdout:4/832: dwrite d0/d13/f21 [4194304,4194304] 0 2024-04-12T13:42:16.207 INFO:tasks.workunit.client.1.smithi110.stdout:7/769: creat d1/f102 x:0 0 0 2024-04-12T13:42:16.212 INFO:tasks.workunit.client.1.smithi110.stdout:5/728: link da/d2e/d45/d25/d9d/fd7 da/d2e/d45/d25/d9d/d7a/db5/ffc 0 2024-04-12T13:42:16.214 INFO:tasks.workunit.client.1.smithi110.stdout:3/717: getdents d5/dc/d31/d74/d75 0 2024-04-12T13:42:16.216 INFO:tasks.workunit.client.1.smithi110.stdout:3/718: readlink d5/dc/d20/d2d/l94 0 2024-04-12T13:42:16.218 INFO:tasks.workunit.client.1.smithi110.stdout:8/773: rename d1/d5/dd/f27 to d1/d3/d35/ffc 0 2024-04-12T13:42:16.220 INFO:tasks.workunit.client.1.smithi110.stdout:3/719: write d5/dc/d31/d3b/d32/fcc [658164,26761] 0 2024-04-12T13:42:16.220 INFO:tasks.workunit.client.1.smithi110.stdout:8/774: fsync d1/d5/f4a 0 2024-04-12T13:42:16.221 INFO:tasks.workunit.client.1.smithi110.stdout:3/720: stat d5/dc/d31/d74 0 2024-04-12T13:42:16.223 INFO:tasks.workunit.client.1.smithi110.stdout:3/721: read - d5/dc/d31/d3b/d5b/fd8 zero size 2024-04-12T13:42:16.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:15 smithi110 ceph-mon[36055]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 90 MiB/s rd, 276 MiB/s wr, 544 op/s 2024-04-12T13:42:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:15 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:15 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:15 smithi110 ceph-mon[36055]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-04-12T13:42:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:15 smithi110 ceph-mon[36055]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-04-12T13:42:16.229 INFO:tasks.workunit.client.0.smithi060.stdout:4/686: creat d6/fe2 x:0 0 0 2024-04-12T13:42:16.229 INFO:tasks.workunit.client.1.smithi110.stdout:1/742: dread de/d1d/d86/fa3 [0,4194304] 0 2024-04-12T13:42:16.230 INFO:tasks.workunit.client.1.smithi110.stdout:9/831: sync 2024-04-12T13:42:16.230 INFO:tasks.workunit.client.1.smithi110.stdout:4/833: chown d0/de/d2c/f2b 935 1 2024-04-12T13:42:16.230 INFO:tasks.workunit.client.0.smithi060.stdout:4/687: read - d6/fe2 zero size 2024-04-12T13:42:16.233 INFO:tasks.workunit.client.1.smithi110.stdout:7/770: mknod d1/d3/d4/dbf/db6/c103 0 2024-04-12T13:42:16.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/767: getdents d1/d7/da/dc/d24/d30 0 2024-04-12T13:42:16.236 INFO:tasks.workunit.client.0.smithi060.stdout:2/716: symlink d6/dae/d31/d33/ld3 0 2024-04-12T13:42:16.239 INFO:tasks.workunit.client.1.smithi110.stdout:0/679: rename d1/l1b to d1/d56/lf1 0 2024-04-12T13:42:16.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/768: read d1/d7/da/dc/d24/d34/d51/d97/da9/fb7 [2967433,74721] 0 2024-04-12T13:42:16.240 INFO:tasks.workunit.client.0.smithi060.stdout:1/812: unlink d1e/d29/d37/f50 0 2024-04-12T13:42:16.244 INFO:tasks.workunit.client.0.smithi060.stdout:6/769: write d1/d7/da/dc/d24/fed [834305,108509] 0 2024-04-12T13:42:16.247 INFO:tasks.workunit.client.1.smithi110.stdout:3/722: rmdir d5/dc/d20/d2d/d4f 39 2024-04-12T13:42:16.250 INFO:tasks.workunit.client.1.smithi110.stdout:2/779: getdents d6/dc/dd/dc6 0 2024-04-12T13:42:16.254 INFO:tasks.workunit.client.1.smithi110.stdout:1/743: symlink de/d14/dd0/lf8 0 2024-04-12T13:42:16.256 INFO:tasks.workunit.client.0.smithi060.stdout:9/628: rename d4/c4c to d4/d8/db8/cd1 0 2024-04-12T13:42:16.260 INFO:tasks.workunit.client.1.smithi110.stdout:4/834: truncate d0/d75/f79 4935770 0 2024-04-12T13:42:16.261 INFO:tasks.workunit.client.0.smithi060.stdout:1/813: dwrite d1e/d23/d49/d4e/ff6 [0,4194304] 0 2024-04-12T13:42:16.263 INFO:tasks.workunit.client.1.smithi110.stdout:4/835: dread - d0/de/da0/f110 zero size 2024-04-12T13:42:16.266 INFO:tasks.workunit.client.1.smithi110.stdout:7/771: creat d1/d3/d4/d55/d82/db5/f104 x:0 0 0 2024-04-12T13:42:16.267 INFO:tasks.workunit.client.0.smithi060.stdout:7/682: getdents d0/d1b/d8c/db6 0 2024-04-12T13:42:16.268 INFO:tasks.workunit.client.1.smithi110.stdout:6/733: link d7/d10/d1c/d7f/l8c d7/d25/d2c/d4c/le7 0 2024-04-12T13:42:16.269 INFO:tasks.workunit.client.1.smithi110.stdout:7/772: stat d1/d3/d4/d55/d56/d72 0 2024-04-12T13:42:16.270 INFO:tasks.workunit.client.1.smithi110.stdout:7/773: chown d1/d3 266511490 1 2024-04-12T13:42:16.270 INFO:tasks.workunit.client.0.smithi060.stdout:3/739: dwrite d7/d17/d19/f74 [0,4194304] 0 2024-04-12T13:42:16.272 INFO:tasks.workunit.client.1.smithi110.stdout:5/729: rename da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/d7c/d8a to da/d35/dfd 0 2024-04-12T13:42:16.272 INFO:tasks.workunit.client.1.smithi110.stdout:6/734: chown d7/d10/d7e/d85/fc2 51 1 2024-04-12T13:42:16.276 INFO:tasks.workunit.client.1.smithi110.stdout:0/680: unlink d1/d3c/cca 0 2024-04-12T13:42:16.280 INFO:tasks.workunit.client.1.smithi110.stdout:0/681: dread - d1/d3c/d6b/fbd zero size 2024-04-12T13:42:16.281 INFO:tasks.workunit.client.1.smithi110.stdout:9/832: dread df/d13/d2c/d2d/d39/d3a/fd1 [0,4194304] 0 2024-04-12T13:42:16.286 INFO:tasks.workunit.client.1.smithi110.stdout:9/833: truncate df/d13/d2c/d9e/d107/f114 587029 0 2024-04-12T13:42:16.288 INFO:tasks.workunit.client.1.smithi110.stdout:4/836: mkdir d0/de/da0/d111 0 2024-04-12T13:42:16.290 INFO:tasks.workunit.client.1.smithi110.stdout:7/774: fsync d1/d3/d4/dbf/f9d 0 2024-04-12T13:42:16.295 INFO:tasks.workunit.client.1.smithi110.stdout:6/735: dread d7/d25/f9f [0,4194304] 0 2024-04-12T13:42:16.295 INFO:tasks.workunit.client.0.smithi060.stdout:2/717: dwrite d6/d10/d81/dbd/f7f [0,4194304] 0 2024-04-12T13:42:16.296 INFO:tasks.workunit.client.1.smithi110.stdout:6/736: readlink d7/d10/d41/l9a 0 2024-04-12T13:42:16.297 INFO:tasks.workunit.client.1.smithi110.stdout:5/730: rename da/d2e/d45/d25/d9d/f3e to da/d35/ffe 0 2024-04-12T13:42:16.298 INFO:tasks.workunit.client.1.smithi110.stdout:6/737: readlink d7/d10/d1c/d2b/d48/lce 0 2024-04-12T13:42:16.299 INFO:tasks.workunit.client.0.smithi060.stdout:7/683: creat d0/d1b/d8c/db6/fdc x:0 0 0 2024-04-12T13:42:16.308 INFO:tasks.workunit.client.1.smithi110.stdout:1/744: link de/d14/d34/d55/fcf de/d15/dab/dd8/ff9 0 2024-04-12T13:42:16.308 INFO:tasks.workunit.client.1.smithi110.stdout:8/775: write d1/d3/d35/ffc [3105426,97021] 0 2024-04-12T13:42:16.315 INFO:tasks.workunit.client.0.smithi060.stdout:2/718: creat d6/d56/d86/fd4 x:0 0 0 2024-04-12T13:42:16.316 INFO:tasks.workunit.client.1.smithi110.stdout:7/775: mknod d1/d3/d4/d55/d82/c105 0 2024-04-12T13:42:16.317 INFO:tasks.workunit.client.0.smithi060.stdout:3/740: dwrite d7/d17/d19/d33/fe4 [4194304,4194304] 0 2024-04-12T13:42:16.317 INFO:tasks.workunit.client.1.smithi110.stdout:4/837: dread d0/f5 [0,4194304] 0 2024-04-12T13:42:16.318 INFO:tasks.workunit.client.1.smithi110.stdout:9/834: truncate df/d13/d2c/d2d/d39/d3a/f77 3853876 0 2024-04-12T13:42:16.318 INFO:tasks.workunit.client.1.smithi110.stdout:5/731: rmdir da/d35/dd6 39 2024-04-12T13:42:16.321 INFO:tasks.workunit.client.0.smithi060.stdout:1/814: link d1e/d23/d2e/d5e/cf9 d1e/d23/d2e/d30/c11c 0 2024-04-12T13:42:16.322 INFO:tasks.workunit.client.1.smithi110.stdout:1/745: creat de/d15/dab/dd8/ffa x:0 0 0 2024-04-12T13:42:16.323 INFO:tasks.workunit.client.1.smithi110.stdout:2/780: symlink d6/dc/d13/lef 0 2024-04-12T13:42:16.324 INFO:tasks.workunit.client.0.smithi060.stdout:2/719: creat d6/d10/d81/dbd/fd5 x:0 0 0 2024-04-12T13:42:16.325 INFO:tasks.workunit.client.0.smithi060.stdout:5/727: sync 2024-04-12T13:42:16.326 INFO:tasks.workunit.client.1.smithi110.stdout:1/746: write de/d14/d34/d55/d6b/dc7/fd2 [3384410,123605] 0 2024-04-12T13:42:16.326 INFO:tasks.workunit.client.0.smithi060.stdout:2/720: truncate d6/d64/fcc 496109 0 2024-04-12T13:42:16.327 INFO:tasks.workunit.client.0.smithi060.stdout:9/629: dwrite d4/f6f [0,4194304] 0 2024-04-12T13:42:16.328 INFO:tasks.workunit.client.1.smithi110.stdout:1/747: chown de/d1d/d86/fa3 2 1 2024-04-12T13:42:16.338 INFO:tasks.workunit.client.1.smithi110.stdout:1/748: dread de/d14/d83/fb6 [0,4194304] 0 2024-04-12T13:42:16.339 INFO:tasks.workunit.client.1.smithi110.stdout:2/781: dwrite d6/dc/dd/dc6/fe4 [0,4194304] 0 2024-04-12T13:42:16.341 INFO:tasks.workunit.client.0.smithi060.stdout:7/684: write d0/fe [5321894,117541] 0 2024-04-12T13:42:16.348 INFO:tasks.workunit.client.0.smithi060.stdout:2/721: dwrite d6/d10/daa/db0/f94 [0,4194304] 0 2024-04-12T13:42:16.348 INFO:tasks.workunit.client.0.smithi060.stdout:9/630: symlink d4/d8/db8/ld2 0 2024-04-12T13:42:16.350 INFO:tasks.workunit.client.1.smithi110.stdout:0/682: creat d1/d27/ff2 x:0 0 0 2024-04-12T13:42:16.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/685: dread d0/d3d/f58 [0,4194304] 0 2024-04-12T13:42:16.353 INFO:tasks.workunit.client.0.smithi060.stdout:3/741: creat d7/d17/d19/dc9/fef x:0 0 0 2024-04-12T13:42:16.358 INFO:tasks.workunit.client.1.smithi110.stdout:3/723: getdents d5/dc/d31/d74/d75/da7/dad 0 2024-04-12T13:42:16.359 INFO:tasks.workunit.client.0.smithi060.stdout:1/815: truncate d1e/d46/d8d/fbc 1786721 0 2024-04-12T13:42:16.360 INFO:tasks.workunit.client.1.smithi110.stdout:7/776: write d1/d31/f81 [661392,86812] 0 2024-04-12T13:42:16.361 INFO:tasks.workunit.client.1.smithi110.stdout:4/838: write d0/d19/f5c [1896259,62194] 0 2024-04-12T13:42:16.362 INFO:tasks.workunit.client.0.smithi060.stdout:5/728: rename d6/dd/d1f/d25/d53/d87/d7e/dca/le2 to d6/dd/d27/d7d/lf1 0 2024-04-12T13:42:16.363 INFO:tasks.workunit.client.1.smithi110.stdout:9/835: symlink df/d13/d2c/d9e/l11e 0 2024-04-12T13:42:16.364 INFO:tasks.workunit.client.0.smithi060.stdout:2/722: mknod d6/dae/d31/d87/cd6 0 2024-04-12T13:42:16.364 INFO:tasks.workunit.client.1.smithi110.stdout:4/839: truncate d0/d75/f109 343759 0 2024-04-12T13:42:16.369 INFO:tasks.workunit.client.0.smithi060.stdout:9/631: creat d4/d9/d19/db1/fd3 x:0 0 0 2024-04-12T13:42:16.369 INFO:tasks.workunit.client.0.smithi060.stdout:7/686: rename d0/d7/d43/d63/ld3 to d0/d7/da9/dc9/db1/ldd 0 2024-04-12T13:42:16.379 INFO:tasks.workunit.client.1.smithi110.stdout:8/776: rename d1/d3/d3c/d75/d79/caa to d1/d3/d3c/cfd 0 2024-04-12T13:42:16.383 INFO:tasks.workunit.client.1.smithi110.stdout:5/732: dwrite da/db/f4a [0,4194304] 0 2024-04-12T13:42:16.384 INFO:tasks.workunit.client.1.smithi110.stdout:7/777: chown d1/d3/d4/d36/l51 1947391005 1 2024-04-12T13:42:16.387 INFO:tasks.workunit.client.1.smithi110.stdout:4/840: mkdir d0/d19/d8f/d112 0 2024-04-12T13:42:16.388 INFO:tasks.workunit.client.0.smithi060.stdout:5/729: dwrite f1 [4194304,4194304] 0 2024-04-12T13:42:16.392 INFO:tasks.workunit.client.0.smithi060.stdout:9/632: symlink d4/d9/d19/d21/dbf/dce/ld4 0 2024-04-12T13:42:16.394 INFO:tasks.workunit.client.0.smithi060.stdout:7/687: rmdir d0/dbb 0 2024-04-12T13:42:16.394 INFO:tasks.workunit.client.0.smithi060.stdout:2/723: dread f3 [0,4194304] 0 2024-04-12T13:42:16.397 INFO:tasks.workunit.client.0.smithi060.stdout:3/742: getdents d7/d17/d19/dc9/d3f/d5c 0 2024-04-12T13:42:16.397 INFO:tasks.workunit.client.0.smithi060.stdout:1/816: dwrite d1e/d23/d2e/d5e/df0/ffa [4194304,4194304] 0 2024-04-12T13:42:16.400 INFO:tasks.workunit.client.0.smithi060.stdout:2/724: chown d6/d56/c7a 8129 1 2024-04-12T13:42:16.400 INFO:tasks.workunit.client.0.smithi060.stdout:9/633: write d4/d9/f2a [2242817,93046] 0 2024-04-12T13:42:16.401 INFO:tasks.workunit.client.0.smithi060.stdout:5/730: unlink d6/dd/d1f/d25/d42/d52/f8c 0 2024-04-12T13:42:16.401 INFO:tasks.workunit.client.0.smithi060.stdout:7/688: stat d0/c65 0 2024-04-12T13:42:16.405 INFO:tasks.workunit.client.1.smithi110.stdout:4/841: dread d0/d19/d1c/f8b [0,4194304] 0 2024-04-12T13:42:16.408 INFO:tasks.workunit.client.1.smithi110.stdout:0/683: dwrite d1/f6a [0,4194304] 0 2024-04-12T13:42:16.409 INFO:tasks.workunit.client.1.smithi110.stdout:8/777: symlink d1/d3/d35/d3a/d3e/d64/d85/d8d/lfe 0 2024-04-12T13:42:16.414 INFO:tasks.workunit.client.0.smithi060.stdout:7/689: unlink d0/d3d/d74/l96 0 2024-04-12T13:42:16.415 INFO:tasks.workunit.client.1.smithi110.stdout:5/733: truncate da/d2e/d45/f6f 668279 0 2024-04-12T13:42:16.415 INFO:tasks.workunit.client.0.smithi060.stdout:2/725: mknod d6/dae/d31/d33/cd7 0 2024-04-12T13:42:16.417 INFO:tasks.workunit.client.1.smithi110.stdout:4/842: read d0/de/da0/dd9/df3/dd7/fd0 [3470459,7559] 0 2024-04-12T13:42:16.417 INFO:tasks.workunit.client.1.smithi110.stdout:6/738: sync 2024-04-12T13:42:16.418 INFO:tasks.workunit.client.0.smithi060.stdout:3/743: creat d7/d17/d27/da7/dbe/dce/de6/dea/ff0 x:0 0 0 2024-04-12T13:42:16.420 INFO:tasks.workunit.client.0.smithi060.stdout:1/817: creat d1e/d23/d2e/f11d x:0 0 0 2024-04-12T13:42:16.421 INFO:tasks.workunit.client.1.smithi110.stdout:6/739: truncate d7/d10/d1c/d2b/d3a/f81 4938069 0 2024-04-12T13:42:16.422 INFO:tasks.workunit.client.1.smithi110.stdout:8/778: write d1/d3/d3c/d5a/f9d [8229170,95249] 0 2024-04-12T13:42:16.425 INFO:tasks.workunit.client.1.smithi110.stdout:5/734: mkdir da/db/d3b/d40/d97/db6/dff 0 2024-04-12T13:42:16.425 INFO:tasks.workunit.client.1.smithi110.stdout:8/779: dread - d1/d3/d3c/d5a/dab/fd2 zero size 2024-04-12T13:42:16.426 INFO:tasks.workunit.client.0.smithi060.stdout:2/726: truncate d6/dae/d5b/d6d/f90 1124060 0 2024-04-12T13:42:16.427 INFO:tasks.workunit.client.0.smithi060.stdout:9/634: dwrite d4/d9/f2a [4194304,4194304] 0 2024-04-12T13:42:16.429 INFO:tasks.workunit.client.0.smithi060.stdout:2/727: fdatasync d6/d10/d2b/d60/fd2 0 2024-04-12T13:42:16.430 INFO:tasks.workunit.client.0.smithi060.stdout:7/690: rename d0/d7/d43/d85 to d0/d7/d43/d4d/dde 0 2024-04-12T13:42:16.430 INFO:tasks.workunit.client.1.smithi110.stdout:5/735: read da/d2e/d45/d25/d9d/d79/d88/db0/fd2 [3189082,43311] 0 2024-04-12T13:42:16.430 INFO:tasks.workunit.client.1.smithi110.stdout:0/684: rename d1/d27/d6e/f91 to d1/d8/d36/d51/ff3 0 2024-04-12T13:42:16.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/744: fsync d7/d17/d19/dc9/faf 0 2024-04-12T13:42:16.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/691: chown d0/d1b/d8c/db6 304535874 1 2024-04-12T13:42:16.434 INFO:tasks.workunit.client.1.smithi110.stdout:4/843: fdatasync d0/d19/d1c/d50/d6f/db9/f8e 0 2024-04-12T13:42:16.436 INFO:tasks.workunit.client.1.smithi110.stdout:7/778: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:42:16.438 INFO:tasks.workunit.client.0.smithi060.stdout:9/635: symlink d4/d9/d19/d21/dbf/ld5 0 2024-04-12T13:42:16.439 INFO:tasks.workunit.client.1.smithi110.stdout:0/685: rmdir d1/d48 39 2024-04-12T13:42:16.444 INFO:tasks.workunit.client.0.smithi060.stdout:3/745: chown d7/d17/d19/f1f 6943841 1 2024-04-12T13:42:16.447 INFO:tasks.workunit.client.0.smithi060.stdout:7/692: chown d0/d7/d43/d63/d6f/lc6 4621 1 2024-04-12T13:42:16.448 INFO:tasks.workunit.client.0.smithi060.stdout:7/693: chown d0/d7/f73 8329706 1 2024-04-12T13:42:16.451 INFO:tasks.workunit.client.0.smithi060.stdout:7/694: fsync d0/d7/da9/dc9/db1/fc1 0 2024-04-12T13:42:16.452 INFO:tasks.workunit.client.0.smithi060.stdout:7/695: readlink d0/d7/d43/d4d/l62 0 2024-04-12T13:42:16.452 INFO:tasks.workunit.client.1.smithi110.stdout:4/844: read d0/de/d32/f8c [4096886,121991] 0 2024-04-12T13:42:16.453 INFO:tasks.workunit.client.1.smithi110.stdout:1/749: dwrite de/fe7 [0,4194304] 0 2024-04-12T13:42:16.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/728: mknod d6/cd8 0 2024-04-12T13:42:16.454 INFO:tasks.workunit.client.1.smithi110.stdout:7/779: mknod d1/d3/d4/d55/d82/db5/c106 0 2024-04-12T13:42:16.456 INFO:tasks.workunit.client.1.smithi110.stdout:1/750: write de/fe7 [3265881,1421] 0 2024-04-12T13:42:16.456 INFO:tasks.workunit.client.1.smithi110.stdout:4/845: chown d0/de/d32/d61/ca8 25029869 1 2024-04-12T13:42:16.458 INFO:tasks.workunit.client.0.smithi060.stdout:3/746: unlink d7/d17/d27/d36/d53/da2/cd8 0 2024-04-12T13:42:16.458 INFO:tasks.workunit.client.1.smithi110.stdout:4/846: stat d0/de/d2c 0 2024-04-12T13:42:16.459 INFO:tasks.workunit.client.1.smithi110.stdout:7/780: chown d1/d3/d4/d55/d82/c37 1 1 2024-04-12T13:42:16.462 INFO:tasks.workunit.client.1.smithi110.stdout:1/751: chown de/d14/d34/d55/d6b/dc7/lf4 232270 1 2024-04-12T13:42:16.466 INFO:tasks.workunit.client.0.smithi060.stdout:7/696: creat d0/d78/fdf x:0 0 0 2024-04-12T13:42:16.468 INFO:tasks.workunit.client.0.smithi060.stdout:2/729: creat d6/dae/d31/d87/fd9 x:0 0 0 2024-04-12T13:42:16.468 INFO:tasks.workunit.client.1.smithi110.stdout:4/847: fdatasync d0/d19/d1c/fad 0 2024-04-12T13:42:16.470 INFO:tasks.workunit.client.1.smithi110.stdout:4/848: chown d0/de/da0/dd9/df3/de0/dfa 4 1 2024-04-12T13:42:16.472 INFO:tasks.workunit.client.1.smithi110.stdout:7/781: fdatasync d1/d3/d4/da6/f8d 0 2024-04-12T13:42:16.473 INFO:tasks.workunit.client.1.smithi110.stdout:7/782: dread - d1/d3/d4/dbf/db6/fea zero size 2024-04-12T13:42:16.476 INFO:tasks.workunit.client.1.smithi110.stdout:1/752: rmdir de/d14/d34/d55/ddc 39 2024-04-12T13:42:16.477 INFO:tasks.workunit.client.1.smithi110.stdout:1/753: readlink de/d15/d32/d61/d96/l9f 0 2024-04-12T13:42:16.478 INFO:tasks.workunit.client.1.smithi110.stdout:6/740: write d7/d25/d2c/d4c/da6/fb7 [834408,130916] 0 2024-04-12T13:42:16.481 INFO:tasks.workunit.client.1.smithi110.stdout:4/849: symlink d0/d75/l113 0 2024-04-12T13:42:16.481 INFO:tasks.workunit.client.1.smithi110.stdout:5/736: write da/d2e/d45/d25/d9d/d7a/db5/d89/fb1 [1463176,3987] 0 2024-04-12T13:42:16.482 INFO:tasks.workunit.client.0.smithi060.stdout:9/636: getdents d4/d9/d19 0 2024-04-12T13:42:16.483 INFO:tasks.workunit.client.0.smithi060.stdout:1/818: truncate fb 1357650 0 2024-04-12T13:42:16.484 INFO:tasks.workunit.client.0.smithi060.stdout:2/730: readlink d6/d10/d4b/l9d 0 2024-04-12T13:42:16.486 INFO:tasks.workunit.client.1.smithi110.stdout:7/783: rename d1/d3/d4/d55/d82/c37 to d1/d3/d4/d55/d56/d72/dad/c107 0 2024-04-12T13:42:16.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/819: dread - d1e/d23/d2e/d30/d51/d85/f10e zero size 2024-04-12T13:42:16.487 INFO:tasks.workunit.client.1.smithi110.stdout:2/782: sync 2024-04-12T13:42:16.487 INFO:tasks.workunit.client.0.smithi060.stdout:3/747: creat d7/d17/d19/d33/ff1 x:0 0 0 2024-04-12T13:42:16.491 INFO:tasks.workunit.client.0.smithi060.stdout:2/731: mkdir d6/d10/d16/dda 0 2024-04-12T13:42:16.496 INFO:tasks.workunit.client.0.smithi060.stdout:3/748: mknod d7/d17/d27/d36/d53/da2/dbc/cf2 0 2024-04-12T13:42:16.497 INFO:tasks.workunit.client.1.smithi110.stdout:2/783: creat d6/dc/d1b/d57/d62/dcb/ff0 x:0 0 0 2024-04-12T13:42:16.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/820: symlink d1e/d118/l11e 0 2024-04-12T13:42:16.499 INFO:tasks.workunit.client.1.smithi110.stdout:2/784: readlink d6/dc/dd/d49/d64/d5d/lbd 0 2024-04-12T13:42:16.499 INFO:tasks.workunit.client.1.smithi110.stdout:5/737: symlink da/db/d15/de9/l100 0 2024-04-12T13:42:16.500 INFO:tasks.workunit.client.0.smithi060.stdout:9/637: creat d4/d9/d19/d21/fd6 x:0 0 0 2024-04-12T13:42:16.500 INFO:tasks.workunit.client.1.smithi110.stdout:0/686: dwrite d1/f8c [4194304,4194304] 0 2024-04-12T13:42:16.501 INFO:tasks.workunit.client.1.smithi110.stdout:4/850: mknod d0/de/da0/d111/c114 0 2024-04-12T13:42:16.503 INFO:tasks.workunit.client.0.smithi060.stdout:1/821: mknod d1e/dcc/c11f 0 2024-04-12T13:42:16.503 INFO:tasks.workunit.client.1.smithi110.stdout:2/785: stat d6/dc/dd/d49 0 2024-04-12T13:42:16.505 INFO:tasks.workunit.client.1.smithi110.stdout:2/786: fsync d6/f12 0 2024-04-12T13:42:16.505 INFO:tasks.workunit.client.1.smithi110.stdout:0/687: dread - d1/d3c/d6b/fbd zero size 2024-04-12T13:42:16.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/638: write d4/d9/d19/d21/d73/d67/f39 [3641073,38271] 0 2024-04-12T13:42:16.506 INFO:tasks.workunit.client.0.smithi060.stdout:2/732: dread d6/dae/d5b/d6d/f90 [0,4194304] 0 2024-04-12T13:42:16.506 INFO:tasks.workunit.client.1.smithi110.stdout:7/784: creat d1/d3/d4/d55/d56/d72/de0/f108 x:0 0 0 2024-04-12T13:42:16.508 INFO:tasks.workunit.client.1.smithi110.stdout:6/741: getdents d7/d10/d1c/d7f 0 2024-04-12T13:42:16.512 INFO:tasks.workunit.client.1.smithi110.stdout:5/738: mkdir da/d2e/d45/d25/d9d/d7a/dae/d101 0 2024-04-12T13:42:16.514 INFO:tasks.workunit.client.1.smithi110.stdout:5/739: chown da/d2e/d45/f90 2548717 1 2024-04-12T13:42:16.515 INFO:tasks.workunit.client.0.smithi060.stdout:1/822: fsync d1e/d23/d2e/d30/f52 0 2024-04-12T13:42:16.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/823: chown d1e/d23 15688 1 2024-04-12T13:42:16.517 INFO:tasks.workunit.client.1.smithi110.stdout:1/754: dread de/d15/dab/dd8/dd9/dda/fa7 [0,4194304] 0 2024-04-12T13:42:16.521 INFO:tasks.workunit.client.1.smithi110.stdout:0/688: dread - d1/d8/fab zero size 2024-04-12T13:42:16.522 INFO:tasks.workunit.client.0.smithi060.stdout:9/639: unlink d4/d9/l54 0 2024-04-12T13:42:16.525 INFO:tasks.workunit.client.0.smithi060.stdout:3/749: dread d7/d17/d27/d36/fb9 [0,4194304] 0 2024-04-12T13:42:16.525 INFO:tasks.workunit.client.1.smithi110.stdout:4/851: rename d0/de/da0/dd9/df3/de0/f10c to d0/de/d32/d61/de9/f115 0 2024-04-12T13:42:16.526 INFO:tasks.workunit.client.0.smithi060.stdout:9/640: write d4/d8/fa [8805610,33583] 0 2024-04-12T13:42:16.526 INFO:tasks.workunit.client.0.smithi060.stdout:2/733: dwrite d6/f1b [4194304,4194304] 0 2024-04-12T13:42:16.526 INFO:tasks.workunit.client.1.smithi110.stdout:2/787: dwrite d6/dc/dd/d49/d64/d4a/f7c [0,4194304] 0 2024-04-12T13:42:16.529 INFO:tasks.workunit.client.0.smithi060.stdout:3/750: readlink d7/d17/d19/dc9/l92 0 2024-04-12T13:42:16.532 INFO:tasks.workunit.client.1.smithi110.stdout:5/740: dwrite da/d2e/d45/d25/d9d/d7a/dae/fe5 [0,4194304] 0 2024-04-12T13:42:16.537 INFO:tasks.workunit.client.0.smithi060.stdout:9/641: unlink d4/d8/d32/f5b 0 2024-04-12T13:42:16.541 INFO:tasks.workunit.client.1.smithi110.stdout:1/755: mknod de/d14/d34/cfb 0 2024-04-12T13:42:16.541 INFO:tasks.workunit.client.1.smithi110.stdout:1/756: fdatasync de/fe7 0 2024-04-12T13:42:16.542 INFO:tasks.workunit.client.1.smithi110.stdout:0/689: mkdir d1/d3c/dd8/df4 0 2024-04-12T13:42:16.549 INFO:tasks.workunit.client.1.smithi110.stdout:2/788: creat d6/dc/dd/d49/d64/d4a/dc1/dd0/ff1 x:0 0 0 2024-04-12T13:42:16.551 INFO:tasks.workunit.client.0.smithi060.stdout:3/751: mkdir d7/d17/d19/dc9/df3 0 2024-04-12T13:42:16.552 INFO:tasks.workunit.client.0.smithi060.stdout:2/734: dwrite d6/dae/d5b/d6d/fc8 [0,4194304] 0 2024-04-12T13:42:16.557 INFO:tasks.workunit.client.0.smithi060.stdout:1/824: creat d1e/d23/f120 x:0 0 0 2024-04-12T13:42:16.559 INFO:tasks.workunit.client.0.smithi060.stdout:2/735: dread d6/d10/d2b/fb7 [0,4194304] 0 2024-04-12T13:42:16.561 INFO:tasks.workunit.client.0.smithi060.stdout:9/642: creat d4/d8/dad/fd7 x:0 0 0 2024-04-12T13:42:16.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/643: fsync d4/d8/f98 0 2024-04-12T13:42:16.564 INFO:tasks.workunit.client.1.smithi110.stdout:3/724: sync 2024-04-12T13:42:16.564 INFO:tasks.workunit.client.1.smithi110.stdout:9/836: sync 2024-04-12T13:42:16.565 INFO:tasks.workunit.client.1.smithi110.stdout:2/789: symlink d6/dc/d13/d80/d8d/dcc/lf2 0 2024-04-12T13:42:16.566 INFO:tasks.workunit.client.1.smithi110.stdout:7/785: link d1/d1b/c4a d1/d31/d5d/c109 0 2024-04-12T13:42:16.568 INFO:tasks.workunit.client.1.smithi110.stdout:3/725: readlink d5/dc/d20/laa 0 2024-04-12T13:42:16.569 INFO:tasks.workunit.client.1.smithi110.stdout:2/790: chown d6/dc/dd/d49/d64/d4a/d3c/d50/dd5 169 1 2024-04-12T13:42:16.570 INFO:tasks.workunit.client.0.smithi060.stdout:2/736: creat d6/d10/d2b/fdb x:0 0 0 2024-04-12T13:42:16.570 INFO:tasks.workunit.client.1.smithi110.stdout:3/726: readlink d5/dc/d31/d74/d75/da7/dad/lae 0 2024-04-12T13:42:16.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/752: symlink d7/d17/d19/d96/lf4 0 2024-04-12T13:42:16.572 INFO:tasks.workunit.client.1.smithi110.stdout:2/791: stat d6/dc/dd/d49/d64/d4a/dc1/dd0 0 2024-04-12T13:42:16.575 INFO:tasks.workunit.client.1.smithi110.stdout:4/852: rename d0/de/da0/dd9/df3/de0/dfa/d10a to d0/de/d2c/d116 0 2024-04-12T13:42:16.576 INFO:tasks.workunit.client.1.smithi110.stdout:2/792: truncate d6/dc/d13/d80/d8d/dcc/d82/d84/f94 431130 0 2024-04-12T13:42:16.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/644: symlink d4/d33/d65/d7a/ld8 0 2024-04-12T13:42:16.577 INFO:tasks.workunit.client.1.smithi110.stdout:2/793: readlink d6/la 0 2024-04-12T13:42:16.579 INFO:tasks.workunit.client.0.smithi060.stdout:9/645: dread - d4/d9/d19/d21/fc7 zero size 2024-04-12T13:42:16.581 INFO:tasks.workunit.client.1.smithi110.stdout:8/780: sync 2024-04-12T13:42:16.581 INFO:tasks.workunit.client.1.smithi110.stdout:6/742: sync 2024-04-12T13:42:16.581 INFO:tasks.workunit.client.0.smithi060.stdout:1/825: creat d1e/d23/d2e/d86/ddb/d107/f121 x:0 0 0 2024-04-12T13:42:16.581 INFO:tasks.workunit.client.0.smithi060.stdout:9/646: write d4/d9/d19/d21/d73/fae [564349,116888] 0 2024-04-12T13:42:16.584 INFO:tasks.workunit.client.1.smithi110.stdout:7/786: fsync d1/d3/d43/f7c 0 2024-04-12T13:42:16.584 INFO:tasks.workunit.client.1.smithi110.stdout:1/757: dread de/d14/d34/f40 [0,4194304] 0 2024-04-12T13:42:16.585 INFO:tasks.workunit.client.1.smithi110.stdout:3/727: chown d5/dc/d20/d2d/d4f/dce/dd7 33856 1 2024-04-12T13:42:16.585 INFO:tasks.workunit.client.0.smithi060.stdout:3/753: rmdir d7/d17/d19/d33/d63/d6d 39 2024-04-12T13:42:16.586 INFO:tasks.workunit.client.1.smithi110.stdout:3/728: stat d5/dc/d31/d3b/d5b/f96 0 2024-04-12T13:42:16.588 INFO:tasks.workunit.client.0.smithi060.stdout:3/754: write d7/d17/d19/dc9/d3f/d5c/f8d [829536,22087] 0 2024-04-12T13:42:16.588 INFO:tasks.workunit.client.1.smithi110.stdout:5/741: truncate da/db/f37 2995920 0 2024-04-12T13:42:16.590 INFO:tasks.workunit.client.0.smithi060.stdout:1/826: read d1e/d46/fb8 [1368,117274] 0 2024-04-12T13:42:16.591 INFO:tasks.workunit.client.1.smithi110.stdout:4/853: fsync d0/de/da0/dd9/df3/dd7/fd0 0 2024-04-12T13:42:16.592 INFO:tasks.workunit.client.1.smithi110.stdout:5/742: write da/d2e/d45/d25/d9d/d7a/db5/d8f/fc7 [88489,76500] 0 2024-04-12T13:42:16.593 INFO:tasks.workunit.client.0.smithi060.stdout:2/737: symlink d6/d10/ldc 0 2024-04-12T13:42:16.594 INFO:tasks.workunit.client.0.smithi060.stdout:9/647: truncate d4/d33/d50/f85 208702 0 2024-04-12T13:42:16.594 INFO:tasks.workunit.client.1.smithi110.stdout:2/794: dread - d6/dc/fd3 zero size 2024-04-12T13:42:16.595 INFO:tasks.workunit.client.0.smithi060.stdout:9/648: stat d4/d33/d65/d7a/fc0 0 2024-04-12T13:42:16.596 INFO:tasks.workunit.client.1.smithi110.stdout:9/837: creat df/d13/d2c/d2d/dc1/d9f/dc6/f11f x:0 0 0 2024-04-12T13:42:16.596 INFO:tasks.workunit.client.0.smithi060.stdout:2/738: truncate d6/d10/d81/dbd/fd5 551502 0 2024-04-12T13:42:16.596 INFO:tasks.workunit.client.0.smithi060.stdout:9/649: fdatasync d4/d9/d19/d21/fd6 0 2024-04-12T13:42:16.597 INFO:tasks.workunit.client.0.smithi060.stdout:2/739: stat d6/d56 0 2024-04-12T13:42:16.598 INFO:tasks.workunit.client.0.smithi060.stdout:3/755: mkdir d7/d17/d19/d33/d63/d9b/df5 0 2024-04-12T13:42:16.599 INFO:tasks.workunit.client.1.smithi110.stdout:8/781: dwrite d1/d5/dd/d31/fea [0,4194304] 0 2024-04-12T13:42:16.599 INFO:tasks.workunit.client.0.smithi060.stdout:0/655: sync 2024-04-12T13:42:16.602 INFO:tasks.workunit.client.1.smithi110.stdout:7/787: dwrite d1/d3/d4/d55/d56/d72/de0/f108 [0,4194304] 0 2024-04-12T13:42:16.603 INFO:tasks.workunit.client.0.smithi060.stdout:9/650: mkdir d4/d8/dad/dd9 0 2024-04-12T13:42:16.605 INFO:tasks.workunit.client.0.smithi060.stdout:2/740: rmdir d6/d10 39 2024-04-12T13:42:16.606 INFO:tasks.workunit.client.1.smithi110.stdout:0/690: getdents d1/d8/d36/d51/d60 0 2024-04-12T13:42:16.610 INFO:tasks.workunit.client.0.smithi060.stdout:3/756: creat d7/d17/d27/d36/d53/da2/ff6 x:0 0 0 2024-04-12T13:42:16.620 INFO:tasks.workunit.client.0.smithi060.stdout:9/651: dread d4/d8/fb [0,4194304] 0 2024-04-12T13:42:16.621 INFO:tasks.workunit.client.0.smithi060.stdout:0/656: read d7/d9/d14/d35/d44/d49/d67/f76 [70385,110228] 0 2024-04-12T13:42:16.623 INFO:tasks.workunit.client.1.smithi110.stdout:4/854: creat d0/de/d32/d5f/dd3/f117 x:0 0 0 2024-04-12T13:42:16.624 INFO:tasks.workunit.client.1.smithi110.stdout:2/795: fdatasync d6/dc/f33 0 2024-04-12T13:42:16.629 INFO:tasks.workunit.client.0.smithi060.stdout:2/741: symlink d6/ldd 0 2024-04-12T13:42:16.630 INFO:tasks.workunit.client.1.smithi110.stdout:8/782: dread d1/d3/d35/d3a/d84/fb6 [0,4194304] 0 2024-04-12T13:42:16.632 INFO:tasks.workunit.client.0.smithi060.stdout:2/742: chown d6/dae/d31/d33/f98 5705453 1 2024-04-12T13:42:16.633 INFO:tasks.workunit.client.1.smithi110.stdout:0/691: symlink d1/d8/d36/d51/lf5 0 2024-04-12T13:42:16.638 INFO:tasks.workunit.client.1.smithi110.stdout:4/855: dwrite d0/d19/d1c/d50/fe2 [0,4194304] 0 2024-04-12T13:42:16.639 INFO:tasks.workunit.client.0.smithi060.stdout:3/757: dwrite d7/d17/d27/d36/db0/dc4/fe7 [0,4194304] 0 2024-04-12T13:42:16.640 INFO:tasks.workunit.client.1.smithi110.stdout:4/856: write d0/d19/d1c/d50/fe2 [3149018,78590] 0 2024-04-12T13:42:16.643 INFO:tasks.workunit.client.1.smithi110.stdout:6/743: creat d7/d10/d1c/d2b/fe8 x:0 0 0 2024-04-12T13:42:16.645 INFO:tasks.workunit.client.1.smithi110.stdout:1/758: creat de/d15/ffc x:0 0 0 2024-04-12T13:42:16.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/827: dwrite d1e/d23/f89 [0,4194304] 0 2024-04-12T13:42:16.648 INFO:tasks.workunit.client.1.smithi110.stdout:7/788: symlink d1/d1b/l10a 0 2024-04-12T13:42:16.651 INFO:tasks.workunit.client.1.smithi110.stdout:7/789: stat d1/d3/f6d 0 2024-04-12T13:42:16.653 INFO:tasks.workunit.client.1.smithi110.stdout:8/783: creat d1/d7/d20/fff x:0 0 0 2024-04-12T13:42:16.656 INFO:tasks.workunit.client.1.smithi110.stdout:0/692: mkdir d1/d3c/dd8/df6 0 2024-04-12T13:42:16.657 INFO:tasks.workunit.client.0.smithi060.stdout:3/758: mknod d7/d17/d19/d96/cf7 0 2024-04-12T13:42:16.658 INFO:tasks.workunit.client.1.smithi110.stdout:5/743: creat da/db/f102 x:0 0 0 2024-04-12T13:42:16.658 INFO:tasks.workunit.client.1.smithi110.stdout:8/784: chown d1/d3/d3c/d5a/d6f/d7e 5687268 1 2024-04-12T13:42:16.660 INFO:tasks.workunit.client.1.smithi110.stdout:4/857: creat d0/de/d32/d61/de9/f118 x:0 0 0 2024-04-12T13:42:16.660 INFO:tasks.workunit.client.1.smithi110.stdout:9/838: dread df/d13/f27 [0,4194304] 0 2024-04-12T13:42:16.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/652: dwrite d4/d9/d19/d21/d73/d67/f49 [0,4194304] 0 2024-04-12T13:42:16.663 INFO:tasks.workunit.client.1.smithi110.stdout:1/759: chown de/d15/c56 43511 1 2024-04-12T13:42:16.664 INFO:tasks.workunit.client.1.smithi110.stdout:9/839: chown df/d13/df4/d116 2100 1 2024-04-12T13:42:16.664 INFO:tasks.workunit.client.1.smithi110.stdout:7/790: chown d1/d3/d4/d36/da1 448 1 2024-04-12T13:42:16.665 INFO:tasks.workunit.client.1.smithi110.stdout:1/760: chown de/d15/dab 514791452 1 2024-04-12T13:42:16.665 INFO:tasks.workunit.client.1.smithi110.stdout:3/729: getdents d5/dc/d31 0 2024-04-12T13:42:16.667 INFO:tasks.workunit.client.1.smithi110.stdout:4/858: write d0/d19/d1c/d50/d6f/ff9 [7092,18894] 0 2024-04-12T13:42:16.669 INFO:tasks.workunit.client.0.smithi060.stdout:0/657: dwrite d7/d9/d14/d35/d44/d49/d67/f76 [0,4194304] 0 2024-04-12T13:42:16.670 INFO:tasks.workunit.client.1.smithi110.stdout:8/785: mkdir d1/d3/d3c/d75/d79/d100 0 2024-04-12T13:42:16.670 INFO:tasks.workunit.client.1.smithi110.stdout:3/730: stat d5/dc/d31/d74/d75/da7 0 2024-04-12T13:42:16.673 INFO:tasks.workunit.client.1.smithi110.stdout:2/796: link d6/dc/dd/c70 d6/dc/d6f/cf3 0 2024-04-12T13:42:16.675 INFO:tasks.workunit.client.1.smithi110.stdout:8/786: readlink d1/d5/d1f/l65 0 2024-04-12T13:42:16.675 INFO:tasks.workunit.client.0.smithi060.stdout:0/658: dread - d7/d9/d14/d35/d44/d7d/fc5 zero size 2024-04-12T13:42:16.676 INFO:tasks.workunit.client.1.smithi110.stdout:3/731: readlink d5/dc/d20/l5d 0 2024-04-12T13:42:16.676 INFO:tasks.workunit.client.1.smithi110.stdout:6/744: dwrite d7/d25/d30/d44/f21 [4194304,4194304] 0 2024-04-12T13:42:16.678 INFO:tasks.workunit.client.1.smithi110.stdout:3/732: chown d5/dc/d31 2505 1 2024-04-12T13:42:16.681 INFO:tasks.workunit.client.1.smithi110.stdout:0/693: mknod d1/d8/cf7 0 2024-04-12T13:42:16.681 INFO:tasks.workunit.client.1.smithi110.stdout:3/733: read d5/dc/d20/d2d/f51 [1800470,6274] 0 2024-04-12T13:42:16.681 INFO:tasks.workunit.client.0.smithi060.stdout:1/828: dwrite d1e/d23/d49/d4e/fee [0,4194304] 0 2024-04-12T13:42:16.682 INFO:tasks.workunit.client.1.smithi110.stdout:0/694: fsync d1/d5e/f95 0 2024-04-12T13:42:16.683 INFO:tasks.workunit.client.1.smithi110.stdout:3/734: chown d5/dc/d31/d74/d75/dbb 5228 1 2024-04-12T13:42:16.683 INFO:tasks.workunit.client.1.smithi110.stdout:9/840: chown df/d13/d3b/d40/d56/c92 202 1 2024-04-12T13:42:16.684 INFO:tasks.workunit.client.0.smithi060.stdout:0/659: rename d7/d9/d14/d35/d44/d49/d67/da5 to d7/d9/d14/d35/d44/d49/d67/da5/dde 22 2024-04-12T13:42:16.686 INFO:tasks.workunit.client.1.smithi110.stdout:9/841: chown df/d13/d2c/d2d/dc1/d83/f104 613059 1 2024-04-12T13:42:16.689 INFO:tasks.workunit.client.1.smithi110.stdout:7/791: mkdir d1/d3/d4/d55/d82/db5/d10b 0 2024-04-12T13:42:16.689 INFO:tasks.workunit.client.0.smithi060.stdout:0/660: write d7/d9/f1a [744583,116641] 0 2024-04-12T13:42:16.690 INFO:tasks.workunit.client.0.smithi060.stdout:3/759: getdents d7/d17/d27/da7 0 2024-04-12T13:42:16.691 INFO:tasks.workunit.client.1.smithi110.stdout:7/792: fdatasync d1/d3/d4/dbf/f95 0 2024-04-12T13:42:16.693 INFO:tasks.workunit.client.1.smithi110.stdout:5/744: creat da/d2e/d45/d25/d9d/d7a/db5/df3/f103 x:0 0 0 2024-04-12T13:42:16.694 INFO:tasks.workunit.client.0.smithi060.stdout:2/743: dread d6/d56/d43/f65 [0,4194304] 0 2024-04-12T13:42:16.695 INFO:tasks.workunit.client.1.smithi110.stdout:2/797: unlink d6/dc/dd/d49/d64/d4a/d51/l30 0 2024-04-12T13:42:16.702 INFO:tasks.workunit.client.0.smithi060.stdout:9/653: getdents d4/d33/d50 0 2024-04-12T13:42:16.702 INFO:tasks.workunit.client.1.smithi110.stdout:6/745: fsync d7/da4/fc4 0 2024-04-12T13:42:16.702 INFO:tasks.workunit.client.1.smithi110.stdout:1/761: write de/d14/f78 [43879,12105] 0 2024-04-12T13:42:16.703 INFO:tasks.workunit.client.1.smithi110.stdout:1/762: chown de/d15/d32/ld1 11795335 1 2024-04-12T13:42:16.705 INFO:tasks.workunit.client.1.smithi110.stdout:8/787: mkdir d1/d3/d35/d3a/d84/d101 0 2024-04-12T13:42:16.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/760: dread - d7/d17/d27/d36/f99 zero size 2024-04-12T13:42:16.707 INFO:tasks.workunit.client.1.smithi110.stdout:9/842: creat df/d13/d2c/d2d/dc1/d83/d5d/f120 x:0 0 0 2024-04-12T13:42:16.709 INFO:tasks.workunit.client.0.smithi060.stdout:9/654: creat d4/d9/d19/d8c/fda x:0 0 0 2024-04-12T13:42:16.711 INFO:tasks.workunit.client.1.smithi110.stdout:5/745: symlink da/db/d3b/d40/l104 0 2024-04-12T13:42:16.716 INFO:tasks.workunit.client.0.smithi060.stdout:2/744: getdents d6/d10/d16/dda 0 2024-04-12T13:42:16.716 INFO:tasks.workunit.client.1.smithi110.stdout:1/763: creat de/d15/dab/dd8/ffd x:0 0 0 2024-04-12T13:42:16.718 INFO:tasks.workunit.client.0.smithi060.stdout:9/655: creat d4/d33/fdb x:0 0 0 2024-04-12T13:42:16.721 INFO:tasks.workunit.client.1.smithi110.stdout:0/695: dread d1/d5e/f95 [0,4194304] 0 2024-04-12T13:42:16.722 INFO:tasks.workunit.client.0.smithi060.stdout:2/745: mknod d6/d56/d43/cde 0 2024-04-12T13:42:16.723 INFO:tasks.workunit.client.0.smithi060.stdout:0/661: dread d7/d9/d14/d35/d44/d7d/f3b [0,4194304] 0 2024-04-12T13:42:16.724 INFO:tasks.workunit.client.1.smithi110.stdout:9/843: mknod df/d13/dca/c121 0 2024-04-12T13:42:16.725 INFO:tasks.workunit.client.1.smithi110.stdout:9/844: read df/d38/db3/fc8 [319272,55280] 0 2024-04-12T13:42:16.726 INFO:tasks.workunit.client.1.smithi110.stdout:8/788: rename d1/d3/d3c/d5a/d6f/d7e/lc5 to d1/d3/d35/d3a/d3e/d64/d85/de1/l102 0 2024-04-12T13:42:16.732 INFO:tasks.workunit.client.1.smithi110.stdout:2/798: mkdir d6/dc/dd/d49/d64/d4a/df4 0 2024-04-12T13:42:16.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/829: dwrite d1e/d23/d2e/d86/f9c [0,4194304] 0 2024-04-12T13:42:16.734 INFO:tasks.workunit.client.0.smithi060.stdout:1/830: dread - d1e/d1f/f11a zero size 2024-04-12T13:42:16.737 INFO:tasks.workunit.client.1.smithi110.stdout:7/793: dwrite d1/d3/d4/da6/f8d [0,4194304] 0 2024-04-12T13:42:16.739 INFO:tasks.workunit.client.0.smithi060.stdout:9/656: write d4/d8/f6d [1036362,123759] 0 2024-04-12T13:42:16.740 INFO:tasks.workunit.client.0.smithi060.stdout:2/746: mkdir d6/d10/daa/ddf 0 2024-04-12T13:42:16.742 INFO:tasks.workunit.client.0.smithi060.stdout:9/657: dread - d4/d9/d19/db1/fd3 zero size 2024-04-12T13:42:16.742 INFO:tasks.workunit.client.0.smithi060.stdout:3/761: truncate d7/d17/d19/dc9/d3f/d5c/d25/d4d/f75 1563360 0 2024-04-12T13:42:16.742 INFO:tasks.workunit.client.0.smithi060.stdout:8/690: sync 2024-04-12T13:42:16.746 INFO:tasks.workunit.client.1.smithi110.stdout:4/859: link d0/de/d32/d5f/c34 d0/d19/d8f/dc5/c119 0 2024-04-12T13:42:16.747 INFO:tasks.workunit.client.0.smithi060.stdout:0/662: dread - d7/d9/d14/d35/d44/d8c/fbd zero size 2024-04-12T13:42:16.749 INFO:tasks.workunit.client.1.smithi110.stdout:0/696: mkdir d1/d8/d36/d51/df8 0 2024-04-12T13:42:16.752 INFO:tasks.workunit.client.0.smithi060.stdout:3/762: mknod d7/d17/d19/d33/d63/d9b/dc0/cf8 0 2024-04-12T13:42:16.756 INFO:tasks.workunit.client.0.smithi060.stdout:8/691: symlink d9/d1b/d37/d4d/d63/lf3 0 2024-04-12T13:42:16.758 INFO:tasks.workunit.client.0.smithi060.stdout:8/692: chown d9/d1b/d2b/f40 1 1 2024-04-12T13:42:16.762 INFO:tasks.workunit.client.1.smithi110.stdout:8/789: creat d1/d3/d35/d43/d9f/dd5/f103 x:0 0 0 2024-04-12T13:42:16.763 INFO:tasks.workunit.client.0.smithi060.stdout:9/658: dwrite d4/d9/fb0 [0,4194304] 0 2024-04-12T13:42:16.766 INFO:tasks.workunit.client.1.smithi110.stdout:8/790: truncate d1/d3/d35/d3a/d41/d77/fd3 331107 0 2024-04-12T13:42:16.766 INFO:tasks.workunit.client.0.smithi060.stdout:9/659: chown d4/d33/d65/f91 9 1 2024-04-12T13:42:16.767 INFO:tasks.workunit.client.1.smithi110.stdout:2/799: creat d6/dc/dd/d49/d64/d4a/dc1/ff5 x:0 0 0 2024-04-12T13:42:16.768 INFO:tasks.workunit.client.1.smithi110.stdout:5/746: getdents da/db/d3b/d40/d97/db6/dff 0 2024-04-12T13:42:16.769 INFO:tasks.workunit.client.0.smithi060.stdout:3/763: chown d7/l18 807542 1 2024-04-12T13:42:16.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/831: link d1e/dcc/c11f d1e/d29/d65/c122 0 2024-04-12T13:42:16.772 INFO:tasks.workunit.client.1.smithi110.stdout:7/794: unlink d1/d31/f96 0 2024-04-12T13:42:16.773 INFO:tasks.workunit.client.1.smithi110.stdout:6/746: link d7/d25/d30/d44/d3d/fcb d7/d25/d30/d44/fe9 0 2024-04-12T13:42:16.774 INFO:tasks.workunit.client.1.smithi110.stdout:7/795: readlink d1/d3/d4/d36/l51 0 2024-04-12T13:42:16.774 INFO:tasks.workunit.client.1.smithi110.stdout:1/764: symlink de/lfe 0 2024-04-12T13:42:16.775 INFO:tasks.workunit.client.0.smithi060.stdout:1/832: truncate d1e/d1f/f7b 783735 0 2024-04-12T13:42:16.776 INFO:tasks.workunit.client.1.smithi110.stdout:3/735: link d5/dc/d20/d2d/d4e/d89/lc9 d5/dc/d20/d2d/le0 0 2024-04-12T13:42:16.777 INFO:tasks.workunit.client.1.smithi110.stdout:9/845: dwrite df/d13/d26/f32 [4194304,4194304] 0 2024-04-12T13:42:16.777 INFO:tasks.workunit.client.0.smithi060.stdout:2/747: creat d6/d10/fe0 x:0 0 0 2024-04-12T13:42:16.786 INFO:tasks.workunit.client.0.smithi060.stdout:2/748: mkdir d6/dae/d5b/d6d/de1 0 2024-04-12T13:42:16.788 INFO:tasks.workunit.client.1.smithi110.stdout:8/791: mkdir d1/d3/d35/d3a/d84/d104 0 2024-04-12T13:42:16.789 INFO:tasks.workunit.client.1.smithi110.stdout:7/796: dread d1/d3/d4/da6/f8d [0,4194304] 0 2024-04-12T13:42:16.790 INFO:tasks.workunit.client.1.smithi110.stdout:8/792: chown d1/d3/d3c/l42 0 1 2024-04-12T13:42:16.791 INFO:tasks.workunit.client.1.smithi110.stdout:8/793: stat d1/d7/f3f 0 2024-04-12T13:42:16.791 INFO:tasks.workunit.client.0.smithi060.stdout:1/833: dread - d1e/d23/d2e/d5e/d68/d9a/fcd zero size 2024-04-12T13:42:16.795 INFO:tasks.workunit.client.0.smithi060.stdout:1/834: read d1e/d29/d37/f100 [964726,56941] 0 2024-04-12T13:42:16.795 INFO:tasks.workunit.client.0.smithi060.stdout:0/663: write d7/d9/d14/d35/d3c/f45 [4800301,78575] 0 2024-04-12T13:42:16.797 INFO:tasks.workunit.client.0.smithi060.stdout:2/749: unlink d6/d10/d16/f2e 0 2024-04-12T13:42:16.797 INFO:tasks.workunit.client.0.smithi060.stdout:7/697: sync 2024-04-12T13:42:16.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/731: sync 2024-04-12T13:42:16.797 INFO:tasks.workunit.client.0.smithi060.stdout:4/688: sync 2024-04-12T13:42:16.797 INFO:tasks.workunit.client.0.smithi060.stdout:6/770: sync 2024-04-12T13:42:16.798 INFO:tasks.workunit.client.0.smithi060.stdout:2/750: stat d6 0 2024-04-12T13:42:16.805 INFO:tasks.workunit.client.1.smithi110.stdout:4/860: symlink d0/d75/d84/l11a 0 2024-04-12T13:42:16.805 INFO:tasks.workunit.client.0.smithi060.stdout:8/693: getdents d9/d1b/d3c/d6e/d7b 0 2024-04-12T13:42:16.806 INFO:tasks.workunit.client.1.smithi110.stdout:9/846: dread df/d13/d2c/d2d/d39/f44 [0,4194304] 0 2024-04-12T13:42:16.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/771: dread - d1/d7/da/dc/d24/d30/d52/d5e/d7b/ff6 zero size 2024-04-12T13:42:16.808 INFO:tasks.workunit.client.1.smithi110.stdout:1/765: dread de/d15/d32/f71 [0,4194304] 0 2024-04-12T13:42:16.808 INFO:tasks.workunit.client.0.smithi060.stdout:1/835: creat d1e/d23/dd9/f123 x:0 0 0 2024-04-12T13:42:16.809 INFO:tasks.workunit.client.1.smithi110.stdout:0/697: creat d1/d8/d36/d51/dee/ff9 x:0 0 0 2024-04-12T13:42:16.810 INFO:tasks.workunit.client.0.smithi060.stdout:7/698: truncate d0/d78/da0/fd2 43126 0 2024-04-12T13:42:16.811 INFO:tasks.workunit.client.1.smithi110.stdout:7/797: dwrite d1/d3/d43/f7c [0,4194304] 0 2024-04-12T13:42:16.811 INFO:tasks.workunit.client.1.smithi110.stdout:9/847: chown df/d13/c2b 574 1 2024-04-12T13:42:16.814 INFO:tasks.workunit.client.0.smithi060.stdout:3/764: dwrite d7/d17/d19/dc9/d3f/f41 [0,4194304] 0 2024-04-12T13:42:16.814 INFO:tasks.workunit.client.1.smithi110.stdout:5/747: dwrite da/db/f8d [4194304,4194304] 0 2024-04-12T13:42:16.817 INFO:tasks.workunit.client.1.smithi110.stdout:5/748: fdatasync da/d2e/d45/d25/d5d/fbd 0 2024-04-12T13:42:16.818 INFO:tasks.workunit.client.0.smithi060.stdout:4/689: creat d6/d7/dd/d1a/d57/d63/fe3 x:0 0 0 2024-04-12T13:42:16.820 INFO:tasks.workunit.client.1.smithi110.stdout:5/749: readlink da/db/d3b/lca 0 2024-04-12T13:42:16.820 INFO:tasks.workunit.client.1.smithi110.stdout:9/848: chown df/d38/d6e/dcb/fff 3 1 2024-04-12T13:42:16.822 INFO:tasks.workunit.client.1.smithi110.stdout:8/794: dread d1/d5/f4a [0,4194304] 0 2024-04-12T13:42:16.822 INFO:tasks.workunit.client.1.smithi110.stdout:4/861: creat d0/d75/f11b x:0 0 0 2024-04-12T13:42:16.823 INFO:tasks.workunit.client.0.smithi060.stdout:1/836: rmdir d1e/d23/d2e/d5e/d68 39 2024-04-12T13:42:16.824 INFO:tasks.workunit.client.1.smithi110.stdout:4/862: dread - d0/ff4 zero size 2024-04-12T13:42:16.829 INFO:tasks.workunit.client.0.smithi060.stdout:4/690: truncate d6/d7/dd/d1a/d19/d7a/da8/fba 894464 0 2024-04-12T13:42:16.830 INFO:tasks.workunit.client.1.smithi110.stdout:1/766: mknod de/d14/d83/cff 0 2024-04-12T13:42:16.834 INFO:tasks.workunit.client.1.smithi110.stdout:7/798: mkdir d1/d3/d4/d55/d56/d72/dad/d10c 0 2024-04-12T13:42:16.836 INFO:tasks.workunit.client.0.smithi060.stdout:5/732: dwrite d6/d10/d12/d4c/fcd [0,4194304] 0 2024-04-12T13:42:16.837 INFO:tasks.workunit.client.1.smithi110.stdout:6/747: creat d7/d25/fea x:0 0 0 2024-04-12T13:42:16.838 INFO:tasks.workunit.client.1.smithi110.stdout:6/748: dread - d7/d10/d7e/d85/fc2 zero size 2024-04-12T13:42:16.843 INFO:tasks.workunit.client.1.smithi110.stdout:3/736: link d5/c5a d5/dc/d31/d3b/d32/ce1 0 2024-04-12T13:42:16.844 INFO:tasks.workunit.client.0.smithi060.stdout:0/664: dread d7/d33/d5b/f90 [4194304,4194304] 0 2024-04-12T13:42:16.846 INFO:tasks.workunit.client.0.smithi060.stdout:0/665: fdatasync d7/d9/f1c 0 2024-04-12T13:42:16.847 INFO:tasks.workunit.client.1.smithi110.stdout:9/849: dread - df/d13/d2c/d2d/dc1/d83/d63/fc7 zero size 2024-04-12T13:42:16.847 INFO:tasks.workunit.client.0.smithi060.stdout:4/691: creat d6/d7/dd/d1a/d56/d8d/fe4 x:0 0 0 2024-04-12T13:42:16.848 INFO:tasks.workunit.client.1.smithi110.stdout:8/795: symlink d1/d5/dd/l105 0 2024-04-12T13:42:16.852 INFO:tasks.workunit.client.1.smithi110.stdout:8/796: dread d1/d3/d35/d3a/d41/d77/fd3 [0,4194304] 0 2024-04-12T13:42:16.852 INFO:tasks.workunit.client.1.smithi110.stdout:2/800: getdents d6/dc/dd/d49/d64/d5d/db9 0 2024-04-12T13:42:16.854 INFO:tasks.workunit.client.1.smithi110.stdout:2/801: stat d6/dc/dd/d49/d64/d4a/d3c/d50 0 2024-04-12T13:42:16.855 INFO:tasks.workunit.client.1.smithi110.stdout:4/863: unlink d0/d19/d1c/l63 0 2024-04-12T13:42:16.859 INFO:tasks.workunit.client.0.smithi060.stdout:3/765: rename d7/d17/d27/da7/ccd to d7/d17/d19/dc9/d3f/cf9 0 2024-04-12T13:42:16.860 INFO:tasks.workunit.client.1.smithi110.stdout:1/767: mknod de/d14/d34/db4/c100 0 2024-04-12T13:42:16.862 INFO:tasks.workunit.client.0.smithi060.stdout:5/733: mknod d6/dd/d1f/d25/d53/d87/d7e/dca/ded/cf2 0 2024-04-12T13:42:16.865 INFO:tasks.workunit.client.0.smithi060.stdout:6/772: dread d1/d2c/fae [0,4194304] 0 2024-04-12T13:42:16.866 INFO:tasks.workunit.client.1.smithi110.stdout:0/698: symlink d1/d27/d31/d67/lfa 0 2024-04-12T13:42:16.869 INFO:tasks.workunit.client.0.smithi060.stdout:5/734: write d6/dd/d1f/d25/d42/d52/d7a/fc3 [94695,127050] 0 2024-04-12T13:42:16.869 INFO:tasks.workunit.client.0.smithi060.stdout:0/666: mkdir d7/ddf 0 2024-04-12T13:42:16.872 INFO:tasks.workunit.client.0.smithi060.stdout:6/773: fdatasync d1/d7/da/dc/d24/d30/d52/f81 0 2024-04-12T13:42:16.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/766: mkdir d7/d17/d27/d36/d53/da2/dbc/dfa 0 2024-04-12T13:42:16.874 INFO:tasks.workunit.client.1.smithi110.stdout:2/802: dwrite d6/dc/dd/f54 [4194304,4194304] 0 2024-04-12T13:42:16.880 INFO:tasks.workunit.client.0.smithi060.stdout:1/837: dread d1e/d23/d49/d4e/f58 [4194304,4194304] 0 2024-04-12T13:42:16.885 INFO:tasks.workunit.client.0.smithi060.stdout:5/735: rename d6/d10/d12 to d6/dd/d1f/dd3/df3 0 2024-04-12T13:42:16.885 INFO:tasks.workunit.client.0.smithi060.stdout:7/699: write d0/d7/f49 [430143,1967] 0 2024-04-12T13:42:16.885 INFO:tasks.workunit.client.1.smithi110.stdout:3/737: dread d5/dc/d31/d3b/d32/d3e/f44 [0,4194304] 0 2024-04-12T13:42:16.886 INFO:tasks.workunit.client.1.smithi110.stdout:4/864: mkdir d0/d75/d84/d89/d103/d11c 0 2024-04-12T13:42:16.889 INFO:tasks.workunit.client.0.smithi060.stdout:5/736: stat d6/dd/d1f/d25/d53/fd9 0 2024-04-12T13:42:16.892 INFO:tasks.workunit.client.0.smithi060.stdout:8/694: truncate d9/d1d/d2f/f4b 2884337 0 2024-04-12T13:42:16.896 INFO:tasks.workunit.client.0.smithi060.stdout:8/695: read d9/d1b/d84/da0/faa [2285037,74151] 0 2024-04-12T13:42:16.897 INFO:tasks.workunit.client.1.smithi110.stdout:4/865: dread d0/de/f24 [0,4194304] 0 2024-04-12T13:42:16.901 INFO:tasks.workunit.client.0.smithi060.stdout:1/838: rmdir d1e/d118 39 2024-04-12T13:42:16.907 INFO:tasks.workunit.client.0.smithi060.stdout:7/700: unlink d0/d7/d43/d63/d6f/c76 0 2024-04-12T13:42:16.911 INFO:tasks.workunit.client.0.smithi060.stdout:6/774: fsync d1/d7/f43 0 2024-04-12T13:42:16.912 INFO:tasks.workunit.client.0.smithi060.stdout:8/696: dwrite d9/d1b/d3c/d6e/f9c [0,4194304] 0 2024-04-12T13:42:16.915 INFO:tasks.workunit.client.0.smithi060.stdout:5/737: mkdir d6/dd/d27/df4 0 2024-04-12T13:42:16.915 INFO:tasks.workunit.client.1.smithi110.stdout:6/749: dwrite d7/d25/d30/d6b/fad [0,4194304] 0 2024-04-12T13:42:16.918 INFO:tasks.workunit.client.0.smithi060.stdout:4/692: link d6/d7/dd/ccf d6/d2f/d7d/ce5 0 2024-04-12T13:42:16.921 INFO:tasks.workunit.client.0.smithi060.stdout:8/697: read d9/d1b/f19 [1714235,46121] 0 2024-04-12T13:42:16.926 INFO:tasks.workunit.client.0.smithi060.stdout:3/767: creat d7/d17/d27/d36/db0/dc4/de9/ffb x:0 0 0 2024-04-12T13:42:16.927 INFO:tasks.workunit.client.0.smithi060.stdout:1/839: dwrite d1e/d23/d2e/d30/d51/d85/f10e [0,4194304] 0 2024-04-12T13:42:16.929 INFO:tasks.workunit.client.0.smithi060.stdout:8/698: write d9/d1d/d5e/fe4 [183865,57378] 0 2024-04-12T13:42:16.961 INFO:tasks.workunit.client.1.smithi110.stdout:1/768: symlink de/d7b/l101 0 2024-04-12T13:42:16.963 INFO:tasks.workunit.client.1.smithi110.stdout:5/750: rename da/db/d3b/d40/da2 to da/d2e/d45/d29/d105 0 2024-04-12T13:42:16.964 INFO:tasks.workunit.client.1.smithi110.stdout:1/769: readlink de/d14/d34/l99 0 2024-04-12T13:42:16.964 INFO:tasks.workunit.client.1.smithi110.stdout:8/797: symlink d1/d3/d35/d3a/d84/d101/l106 0 2024-04-12T13:42:16.968 INFO:tasks.workunit.client.1.smithi110.stdout:7/799: link d1/l61 d1/d1b/d3d/d68/d97/l10d 0 2024-04-12T13:42:16.969 INFO:tasks.workunit.client.0.smithi060.stdout:7/701: mknod d0/d7/d43/d4d/dde/ce0 0 2024-04-12T13:42:16.969 INFO:tasks.workunit.client.1.smithi110.stdout:2/803: symlink d6/dc/d1b/d8f/d9c/lf6 0 2024-04-12T13:42:16.970 INFO:tasks.workunit.client.0.smithi060.stdout:6/775: rename d1/d7/da/dc/l6c to d1/d7/da/dc/d24/d30/d52/d78/d80/lfc 0 2024-04-12T13:42:16.970 INFO:tasks.workunit.client.0.smithi060.stdout:0/667: dwrite d7/d9/d4c/f50 [0,4194304] 0 2024-04-12T13:42:16.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/738: chown d6/d10/f2a 24 1 2024-04-12T13:42:16.972 INFO:tasks.workunit.client.0.smithi060.stdout:3/768: write d7/d17/d19/d33/d63/fa8 [4495271,120664] 0 2024-04-12T13:42:16.973 INFO:tasks.workunit.client.0.smithi060.stdout:7/702: write d0/d7/f49 [953827,104645] 0 2024-04-12T13:42:16.973 INFO:tasks.workunit.client.1.smithi110.stdout:9/850: rename df/d13/c2b to df/d13/d2c/d9e/dd6/da3/dab/d118/c122 0 2024-04-12T13:42:16.977 INFO:tasks.workunit.client.0.smithi060.stdout:8/699: chown d9/c46 34581 1 2024-04-12T13:42:16.980 INFO:tasks.workunit.client.0.smithi060.stdout:8/700: fsync d9/d1b/d3c/d6e/d7b/fca 0 2024-04-12T13:42:16.982 INFO:tasks.workunit.client.0.smithi060.stdout:8/701: fsync d9/d1b/d37/d4d/d63/fa9 0 2024-04-12T13:42:16.990 INFO:tasks.workunit.client.1.smithi110.stdout:0/699: sync 2024-04-12T13:42:16.994 INFO:tasks.workunit.client.0.smithi060.stdout:3/769: dwrite d7/d17/d19/f1f [0,4194304] 0 2024-04-12T13:42:16.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/776: creat d1/d7/da/dc/d24/d30/d52/d78/ffd x:0 0 0 2024-04-12T13:42:16.997 INFO:tasks.workunit.client.1.smithi110.stdout:2/804: dwrite d6/dc/dd/d49/d64/d25/db0/fed [0,4194304] 0 2024-04-12T13:42:16.998 INFO:tasks.workunit.client.1.smithi110.stdout:9/851: rmdir df/d13/d2c/d2d/dc1/d83/d63 39 2024-04-12T13:42:17.005 INFO:tasks.workunit.client.1.smithi110.stdout:4/866: link d0/de/f7f d0/de/da0/dd9/df3/de0/d7e/daa/dcd/f11d 0 2024-04-12T13:42:17.011 INFO:tasks.workunit.client.1.smithi110.stdout:0/700: rmdir d1/d56 39 2024-04-12T13:42:17.013 INFO:tasks.workunit.client.1.smithi110.stdout:0/701: write d1/fdf [2108126,88114] 0 2024-04-12T13:42:17.014 INFO:tasks.workunit.client.0.smithi060.stdout:3/770: symlink d7/d17/d27/d36/db0/lfc 0 2024-04-12T13:42:17.014 INFO:tasks.workunit.client.1.smithi110.stdout:3/738: write d5/dc/f13 [4542071,25059] 0 2024-04-12T13:42:17.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/771: chown d7/d17/d27/d36/db0 444 1 2024-04-12T13:42:17.016 INFO:tasks.workunit.client.1.smithi110.stdout:8/798: creat d1/f107 x:0 0 0 2024-04-12T13:42:17.017 INFO:tasks.workunit.client.0.smithi060.stdout:1/840: write d1e/d23/d49/d4e/f77 [4370792,86651] 0 2024-04-12T13:42:17.018 INFO:tasks.workunit.client.1.smithi110.stdout:8/799: stat d1/d5/dd/la8 0 2024-04-12T13:42:17.019 INFO:tasks.workunit.client.1.smithi110.stdout:2/805: rename d6/d18/fe2 to d6/dc/dd/d49/d64/d25/ff7 0 2024-04-12T13:42:17.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/739: creat d6/d10/ff5 x:0 0 0 2024-04-12T13:42:17.023 INFO:tasks.workunit.client.0.smithi060.stdout:7/703: write d0/d78/f8d [1228266,63038] 0 2024-04-12T13:42:17.024 INFO:tasks.workunit.client.1.smithi110.stdout:1/770: creat de/d15/d32/d61/f102 x:0 0 0 2024-04-12T13:42:17.024 INFO:tasks.workunit.client.0.smithi060.stdout:7/704: fdatasync d0/d7/f49 0 2024-04-12T13:42:17.025 INFO:tasks.workunit.client.0.smithi060.stdout:1/841: mknod d1e/d23/dd9/c124 0 2024-04-12T13:42:17.026 INFO:tasks.workunit.client.0.smithi060.stdout:7/705: chown d0/d7/d43/d4d/f79 12 1 2024-04-12T13:42:17.028 INFO:tasks.workunit.client.1.smithi110.stdout:4/867: creat d0/de/da0/dd9/df3/de0/d7e/f11e x:0 0 0 2024-04-12T13:42:17.028 INFO:tasks.workunit.client.0.smithi060.stdout:8/702: write d9/d1d/d2f/f99 [256378,116674] 0 2024-04-12T13:42:17.029 INFO:tasks.workunit.client.1.smithi110.stdout:6/750: dwrite d7/d10/d1c/d2b/d48/d54/f86 [0,4194304] 0 2024-04-12T13:42:17.033 INFO:tasks.workunit.client.0.smithi060.stdout:5/740: symlink d6/dd/d1f/d25/d53/d87/lf6 0 2024-04-12T13:42:17.033 INFO:tasks.workunit.client.0.smithi060.stdout:0/668: truncate d7/d9/f1e 3324019 0 2024-04-12T13:42:17.038 INFO:tasks.workunit.client.1.smithi110.stdout:3/739: dwrite d5/dc/d20/d2d/d4f/dce/fd9 [0,4194304] 0 2024-04-12T13:42:17.043 INFO:tasks.workunit.client.1.smithi110.stdout:5/751: dwrite da/d2e/d45/d29/d32/f81 [0,4194304] 0 2024-04-12T13:42:17.044 INFO:tasks.workunit.client.1.smithi110.stdout:9/852: write df/d13/d2c/d2d/dc1/d83/f104 [2910927,86820] 0 2024-04-12T13:42:17.045 INFO:tasks.workunit.client.0.smithi060.stdout:7/706: dwrite d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:17.047 INFO:tasks.workunit.client.0.smithi060.stdout:6/777: getdents d1/d7/da 0 2024-04-12T13:42:17.052 INFO:tasks.workunit.client.0.smithi060.stdout:8/703: creat d9/d1b/d84/da0/d80/ff4 x:0 0 0 2024-04-12T13:42:17.053 INFO:tasks.workunit.client.0.smithi060.stdout:9/660: sync 2024-04-12T13:42:17.054 INFO:tasks.workunit.client.0.smithi060.stdout:0/669: mknod d7/d33/d88/ce0 0 2024-04-12T13:42:17.055 INFO:tasks.workunit.client.0.smithi060.stdout:9/661: readlink d4/d33/d50/l56 0 2024-04-12T13:42:17.059 INFO:tasks.workunit.client.0.smithi060.stdout:1/842: write d1e/d23/d2e/d30/f96 [738306,130299] 0 2024-04-12T13:42:17.059 INFO:tasks.workunit.client.0.smithi060.stdout:6/778: dread d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b [0,4194304] 0 2024-04-12T13:42:17.064 INFO:tasks.workunit.client.0.smithi060.stdout:1/843: write d1e/d29/d65/ff3 [409242,54864] 0 2024-04-12T13:42:17.065 INFO:tasks.workunit.client.1.smithi110.stdout:4/868: mkdir d0/de/da0/dd9/df3/de0/dfa/d11f 0 2024-04-12T13:42:17.066 INFO:tasks.workunit.client.1.smithi110.stdout:4/869: chown d0/de 101695 1 2024-04-12T13:42:17.068 INFO:tasks.workunit.client.0.smithi060.stdout:8/704: chown d9/f71 342523 1 2024-04-12T13:42:17.069 INFO:tasks.workunit.client.1.smithi110.stdout:4/870: stat d0/d19/d26/c6a 0 2024-04-12T13:42:17.069 INFO:tasks.workunit.client.1.smithi110.stdout:7/800: getdents d1/d3/d43 0 2024-04-12T13:42:17.072 INFO:tasks.workunit.client.1.smithi110.stdout:0/702: creat d1/d3c/dd8/df6/ffb x:0 0 0 2024-04-12T13:42:17.078 INFO:tasks.workunit.client.0.smithi060.stdout:9/662: creat d4/d9/d19/d21/dbf/fdc x:0 0 0 2024-04-12T13:42:17.079 INFO:tasks.workunit.client.1.smithi110.stdout:2/806: creat d6/dc/dd/d49/d64/d4a/d3c/d6e/ff8 x:0 0 0 2024-04-12T13:42:17.081 INFO:tasks.workunit.client.0.smithi060.stdout:8/705: creat d9/d1d/d2f/ff5 x:0 0 0 2024-04-12T13:42:17.082 INFO:tasks.workunit.client.1.smithi110.stdout:7/801: chown d1/d1b/d3d/d68/d97/l10d 3 1 2024-04-12T13:42:17.084 INFO:tasks.workunit.client.1.smithi110.stdout:3/740: rename d5/dc/d31/d3b/lb3 to d5/dc/d20/d2d/d4e/d89/db4/le2 0 2024-04-12T13:42:17.087 INFO:tasks.workunit.client.0.smithi060.stdout:7/707: link d0/l61 d0/d7/d43/d63/le1 0 2024-04-12T13:42:17.088 INFO:tasks.workunit.client.0.smithi060.stdout:6/779: dread d1/d7/da/dc/f74 [0,4194304] 0 2024-04-12T13:42:17.089 INFO:tasks.workunit.client.1.smithi110.stdout:2/807: rmdir d6/dc/dd/d49/d64/d4a/d3c/d50 39 2024-04-12T13:42:17.093 INFO:tasks.workunit.client.0.smithi060.stdout:5/741: write d6/dd/d1f/d25/f90 [1042349,77938] 0 2024-04-12T13:42:17.095 INFO:tasks.workunit.client.0.smithi060.stdout:5/742: readlink d6/dd/l95 0 2024-04-12T13:42:17.096 INFO:tasks.workunit.client.1.smithi110.stdout:7/802: mkdir d1/d3/d4/d55/d56/d10e 0 2024-04-12T13:42:17.097 INFO:tasks.workunit.client.0.smithi060.stdout:9/663: link d4/d9/d19/d21/d73/fb5 d4/d9/d19/d21/d73/fdd 0 2024-04-12T13:42:17.098 INFO:tasks.workunit.client.1.smithi110.stdout:6/751: write d7/d10/d1c/f42 [2698037,31798] 0 2024-04-12T13:42:17.100 INFO:tasks.workunit.client.0.smithi060.stdout:7/708: symlink d0/d7/da9/le2 0 2024-04-12T13:42:17.101 INFO:tasks.workunit.client.1.smithi110.stdout:3/741: chown d5/dc/d31/d3b/c5e 727939856 1 2024-04-12T13:42:17.101 INFO:tasks.workunit.client.1.smithi110.stdout:9/853: write df/d13/d2c/d2d/dc1/d83/d5d/d89/fb7 [2435257,114821] 0 2024-04-12T13:42:17.103 INFO:tasks.workunit.client.1.smithi110.stdout:9/854: readlink df/d13/d3b/d40/d56/l115 0 2024-04-12T13:42:17.106 INFO:tasks.workunit.client.1.smithi110.stdout:0/703: dread d1/d8/d36/d51/d60/f87 [0,4194304] 0 2024-04-12T13:42:17.108 INFO:tasks.workunit.client.0.smithi060.stdout:9/664: readlink d4/d9/d19/d21/dbf/dce/ld4 0 2024-04-12T13:42:17.111 INFO:tasks.workunit.client.0.smithi060.stdout:1/844: getdents d1e/d23/d2e 0 2024-04-12T13:42:17.112 INFO:tasks.workunit.client.1.smithi110.stdout:3/742: fsync d5/dc/d31/d3b/f4a 0 2024-04-12T13:42:17.113 INFO:tasks.workunit.client.1.smithi110.stdout:8/800: dwrite d1/d3/d3c/d5a/d6f/d83/fae [0,4194304] 0 2024-04-12T13:42:17.115 INFO:tasks.workunit.client.1.smithi110.stdout:6/752: dwrite d7/fe0 [0,4194304] 0 2024-04-12T13:42:17.117 INFO:tasks.workunit.client.1.smithi110.stdout:8/801: write d1/d7/d20/da3/fc3 [5173052,93951] 0 2024-04-12T13:42:17.118 INFO:tasks.workunit.client.0.smithi060.stdout:0/670: dwrite d7/d33/d5b/f9f [0,4194304] 0 2024-04-12T13:42:17.119 INFO:tasks.workunit.client.1.smithi110.stdout:8/802: chown d1/d3/f24 74739460 1 2024-04-12T13:42:17.121 INFO:tasks.workunit.client.0.smithi060.stdout:8/706: write d9/d1b/d3c/f56 [1287896,14305] 0 2024-04-12T13:42:17.122 INFO:tasks.workunit.client.1.smithi110.stdout:5/752: dwrite da/d35/ffe [0,4194304] 0 2024-04-12T13:42:17.125 INFO:tasks.workunit.client.0.smithi060.stdout:6/780: dread d1/d7/da/dc/d24/f96 [0,4194304] 0 2024-04-12T13:42:17.131 INFO:tasks.workunit.client.1.smithi110.stdout:9/855: mkdir df/d13/df4/d116/d123 0 2024-04-12T13:42:17.132 INFO:tasks.workunit.client.1.smithi110.stdout:9/856: write df/d8a/fe6 [1786105,43188] 0 2024-04-12T13:42:17.132 INFO:tasks.workunit.client.1.smithi110.stdout:5/753: truncate da/db/d3b/d40/d97/fd4 612894 0 2024-04-12T13:42:17.137 INFO:tasks.workunit.client.1.smithi110.stdout:5/754: write da/d2e/d45/d29/d105/fdf [209231,87250] 0 2024-04-12T13:42:17.142 INFO:tasks.workunit.client.1.smithi110.stdout:2/808: dwrite d6/dc/dd/d49/f7d [0,4194304] 0 2024-04-12T13:42:17.142 INFO:tasks.workunit.client.1.smithi110.stdout:8/803: creat d1/d5/dd/f108 x:0 0 0 2024-04-12T13:42:17.142 INFO:tasks.workunit.client.0.smithi060.stdout:8/707: dwrite d9/d1b/d84/da0/d80/ff4 [0,4194304] 0 2024-04-12T13:42:17.142 INFO:tasks.workunit.client.1.smithi110.stdout:2/809: dread - d6/dc/d13/d80/d8d/dcc/d82/fe1 zero size 2024-04-12T13:42:17.144 INFO:tasks.workunit.client.0.smithi060.stdout:8/708: read - d9/d1b/d2b/fea zero size 2024-04-12T13:42:17.144 INFO:tasks.workunit.client.1.smithi110.stdout:9/857: creat df/d13/d2c/d9e/dd6/da3/f124 x:0 0 0 2024-04-12T13:42:17.147 INFO:tasks.workunit.client.1.smithi110.stdout:1/771: sync 2024-04-12T13:42:17.147 INFO:tasks.workunit.client.1.smithi110.stdout:6/753: creat d7/d10/d1c/d2b/d48/d4b/dcc/feb x:0 0 0 2024-04-12T13:42:17.151 INFO:tasks.workunit.client.1.smithi110.stdout:7/803: link d1/d3/d4/da6/cec d1/d1b/d74/c10f 0 2024-04-12T13:42:17.153 INFO:tasks.workunit.client.1.smithi110.stdout:9/858: rmdir df/d13/d2c/d2d/d94 39 2024-04-12T13:42:17.156 INFO:tasks.workunit.client.1.smithi110.stdout:1/772: truncate de/d15/dab/dd8/ffa 427035 0 2024-04-12T13:42:17.158 INFO:tasks.workunit.client.1.smithi110.stdout:6/754: creat d7/d25/d30/d44/da3/fec x:0 0 0 2024-04-12T13:42:17.160 INFO:tasks.workunit.client.1.smithi110.stdout:8/804: symlink d1/d3/d3c/l109 0 2024-04-12T13:42:17.161 INFO:tasks.workunit.client.1.smithi110.stdout:5/755: dwrite f9 [4194304,4194304] 0 2024-04-12T13:42:17.165 INFO:tasks.workunit.client.1.smithi110.stdout:3/743: dread d5/d86/fb5 [0,4194304] 0 2024-04-12T13:42:17.167 INFO:tasks.workunit.client.0.smithi060.stdout:7/709: rename d0/d1b/f53 to d0/d3d/d74/fe3 0 2024-04-12T13:42:17.171 INFO:tasks.workunit.client.1.smithi110.stdout:9/859: mknod df/d13/d2c/d9e/dd6/da3/c125 0 2024-04-12T13:42:17.173 INFO:tasks.workunit.client.1.smithi110.stdout:8/805: stat d1/d3/d3c/lcf 0 2024-04-12T13:42:17.174 INFO:tasks.workunit.client.1.smithi110.stdout:6/755: truncate d7/d25/d30/f9b 1314876 0 2024-04-12T13:42:17.175 INFO:tasks.workunit.client.0.smithi060.stdout:1/845: symlink d1e/d23/d2e/d30/d51/l125 0 2024-04-12T13:42:17.175 INFO:tasks.workunit.client.1.smithi110.stdout:4/871: sync 2024-04-12T13:42:17.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:16 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:17.182 INFO:tasks.workunit.client.0.smithi060.stdout:8/709: creat d9/d1d/d5e/ff6 x:0 0 0 2024-04-12T13:42:17.183 INFO:tasks.workunit.client.0.smithi060.stdout:8/710: stat d9/d1b 0 2024-04-12T13:42:17.186 INFO:tasks.workunit.client.1.smithi110.stdout:0/704: dwrite d1/d56/fb1 [0,4194304] 0 2024-04-12T13:42:17.188 INFO:tasks.workunit.client.1.smithi110.stdout:2/810: dread d6/d18/f29 [0,4194304] 0 2024-04-12T13:42:17.188 INFO:tasks.workunit.client.0.smithi060.stdout:9/665: getdents d4/d8/dad/dd9 0 2024-04-12T13:42:17.189 INFO:tasks.workunit.client.1.smithi110.stdout:3/744: fdatasync d5/dc/f19 0 2024-04-12T13:42:17.193 INFO:tasks.workunit.client.1.smithi110.stdout:1/773: dread de/d15/d32/d61/d6a/d8b/fad [0,4194304] 0 2024-04-12T13:42:17.195 INFO:tasks.workunit.client.0.smithi060.stdout:6/781: getdents d1/d7/da/d20/da8/df0 0 2024-04-12T13:42:17.197 INFO:tasks.workunit.client.1.smithi110.stdout:3/745: dread d5/dc/d31/d3b/d32/fcc [0,4194304] 0 2024-04-12T13:42:17.200 INFO:tasks.workunit.client.0.smithi060.stdout:8/711: creat d9/d1b/d3c/d6e/d7b/db1/de5/ff7 x:0 0 0 2024-04-12T13:42:17.201 INFO:tasks.workunit.client.1.smithi110.stdout:0/705: creat d1/d3c/dd8/df6/ffc x:0 0 0 2024-04-12T13:42:17.201 INFO:tasks.workunit.client.0.smithi060.stdout:5/743: getdents d6/dd/d1f/dd3/df3/d4c/d7c 0 2024-04-12T13:42:17.203 INFO:tasks.workunit.client.0.smithi060.stdout:0/671: link d7/d9/d14/d4a/l5e d7/ddf/le1 0 2024-04-12T13:42:17.204 INFO:tasks.workunit.client.0.smithi060.stdout:5/744: chown d6/dd/d1f/d25/cb5 61703240 1 2024-04-12T13:42:17.205 INFO:tasks.workunit.client.0.smithi060.stdout:0/672: write d7/d9/f92 [1023811,42965] 0 2024-04-12T13:42:17.205 INFO:tasks.workunit.client.0.smithi060.stdout:5/745: chown d6/dd/d27/cc4 8 1 2024-04-12T13:42:17.208 INFO:tasks.workunit.client.1.smithi110.stdout:7/804: dwrite d1/d31/d5d/f83 [0,4194304] 0 2024-04-12T13:42:17.209 INFO:tasks.workunit.client.1.smithi110.stdout:7/805: read d1/d3/d4/d36/f3a [1024607,25201] 0 2024-04-12T13:42:17.210 INFO:tasks.workunit.client.0.smithi060.stdout:9/666: rename d4/d8/dad/fd7 to d4/d8/d7c/fde 0 2024-04-12T13:42:17.213 INFO:tasks.workunit.client.0.smithi060.stdout:1/846: creat d1e/d23/d2e/d5e/d68/f126 x:0 0 0 2024-04-12T13:42:17.221 INFO:tasks.workunit.client.0.smithi060.stdout:7/710: write d0/d7/fbd [208906,117248] 0 2024-04-12T13:42:17.223 INFO:tasks.workunit.client.1.smithi110.stdout:5/756: dwrite da/d2e/d45/d25/d9d/d79/d88/f95 [0,4194304] 0 2024-04-12T13:42:17.224 INFO:tasks.workunit.client.1.smithi110.stdout:1/774: truncate de/d7b/fde 431232 0 2024-04-12T13:42:17.226 INFO:tasks.workunit.client.1.smithi110.stdout:3/746: mkdir d5/d86/de3 0 2024-04-12T13:42:17.227 INFO:tasks.workunit.client.0.smithi060.stdout:0/673: rename d7/d9/f1a to d7/d9/de/d80/dc8/fe2 0 2024-04-12T13:42:17.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:16 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:17.228 INFO:tasks.workunit.client.1.smithi110.stdout:9/860: write df/d13/d2c/d2d/dc1/d83/d63/fc7 [636419,69232] 0 2024-04-12T13:42:17.229 INFO:tasks.workunit.client.0.smithi060.stdout:9/667: symlink d4/d8/d7c/ldf 0 2024-04-12T13:42:17.231 INFO:tasks.workunit.client.0.smithi060.stdout:2/751: sync 2024-04-12T13:42:17.231 INFO:tasks.workunit.client.1.smithi110.stdout:0/706: creat d1/d27/d31/d67/dcb/ffd x:0 0 0 2024-04-12T13:42:17.232 INFO:tasks.workunit.client.1.smithi110.stdout:2/811: write d6/dc/dd/d49/f6c [328035,42746] 0 2024-04-12T13:42:17.238 INFO:tasks.workunit.client.1.smithi110.stdout:6/756: truncate d7/d25/d30/d6b/fad 3823416 0 2024-04-12T13:42:17.238 INFO:tasks.workunit.client.1.smithi110.stdout:7/806: rmdir d1/d3/d4/d55/d56/d72/dad 39 2024-04-12T13:42:17.238 INFO:tasks.workunit.client.0.smithi060.stdout:8/712: write d9/d1b/d37/d4d/d63/d66/db3/d65/f67 [377051,64921] 0 2024-04-12T13:42:17.241 INFO:tasks.workunit.client.1.smithi110.stdout:7/807: chown d1/d3/d4/d55/d56/f8c 13 1 2024-04-12T13:42:17.242 INFO:tasks.workunit.client.0.smithi060.stdout:5/746: write d6/dd/d27/f2d [1642389,103089] 0 2024-04-12T13:42:17.244 INFO:tasks.workunit.client.1.smithi110.stdout:4/872: link d0/d75/d84/d89/fba d0/d19/d8f/d112/f120 0 2024-04-12T13:42:17.245 INFO:tasks.workunit.client.0.smithi060.stdout:0/674: symlink d7/d9/d14/d35/d44/dd9/le3 0 2024-04-12T13:42:17.246 INFO:tasks.workunit.client.0.smithi060.stdout:5/747: readlink d6/dd/d1f/d25/d42/d6b/ld0 0 2024-04-12T13:42:17.246 INFO:tasks.workunit.client.0.smithi060.stdout:0/675: chown d7/l9c 2025 1 2024-04-12T13:42:17.248 INFO:tasks.workunit.client.1.smithi110.stdout:1/775: rmdir de/d14/d34/d87 39 2024-04-12T13:42:17.248 INFO:tasks.workunit.client.0.smithi060.stdout:5/748: stat d6/dd/d1f/d25/d53/d87/l65 0 2024-04-12T13:42:17.249 INFO:tasks.workunit.client.1.smithi110.stdout:1/776: fsync de/d14/d34/d55/d6b/fe8 0 2024-04-12T13:42:17.251 INFO:tasks.workunit.client.1.smithi110.stdout:5/757: unlink da/d2e/d45/d25/d9d/d7a/dae/ff0 0 2024-04-12T13:42:17.251 INFO:tasks.workunit.client.1.smithi110.stdout:0/707: dread d1/f6a [4194304,4194304] 0 2024-04-12T13:42:17.252 INFO:tasks.workunit.client.1.smithi110.stdout:1/777: write de/d14/d34/d55/f5c [4676600,103265] 0 2024-04-12T13:42:17.255 INFO:tasks.workunit.client.1.smithi110.stdout:3/747: rmdir d5/dc/d31/d3b/d32/d3e 39 2024-04-12T13:42:17.257 INFO:tasks.workunit.client.0.smithi060.stdout:2/752: unlink d6/d10/d4b/lb2 0 2024-04-12T13:42:17.258 INFO:tasks.workunit.client.1.smithi110.stdout:4/873: dwrite d0/d13/f21 [0,4194304] 0 2024-04-12T13:42:17.259 INFO:tasks.workunit.client.0.smithi060.stdout:2/753: chown d6/d10/d4b/f7c 6 1 2024-04-12T13:42:17.265 INFO:tasks.workunit.client.0.smithi060.stdout:7/711: symlink d0/le4 0 2024-04-12T13:42:17.268 INFO:tasks.workunit.client.1.smithi110.stdout:6/757: symlink d7/d10/led 0 2024-04-12T13:42:17.269 INFO:tasks.workunit.client.0.smithi060.stdout:0/676: creat d7/d9/d14/d35/d44/d49/d67/fe4 x:0 0 0 2024-04-12T13:42:17.271 INFO:tasks.workunit.client.0.smithi060.stdout:9/668: dread d4/d8/f41 [0,4194304] 0 2024-04-12T13:42:17.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/782: getdents d1/d7/da/dc/d24/d34/d51/d97/dc0 0 2024-04-12T13:42:17.274 INFO:tasks.workunit.client.1.smithi110.stdout:8/806: sync 2024-04-12T13:42:17.275 INFO:tasks.workunit.client.0.smithi060.stdout:6/783: stat d1/d7/da/dc/d24/d8b/f8f 0 2024-04-12T13:42:17.277 INFO:tasks.workunit.client.0.smithi060.stdout:4/693: sync 2024-04-12T13:42:17.277 INFO:tasks.workunit.client.0.smithi060.stdout:3/772: sync 2024-04-12T13:42:17.279 INFO:tasks.workunit.client.0.smithi060.stdout:2/754: creat d6/d10/d4b/fe2 x:0 0 0 2024-04-12T13:42:17.280 INFO:tasks.workunit.client.0.smithi060.stdout:6/784: write d1/d7/da/dc/d24/f37 [3854615,66364] 0 2024-04-12T13:42:17.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/713: dwrite d9/d1b/d84/da0/faa [4194304,4194304] 0 2024-04-12T13:42:17.288 INFO:tasks.workunit.client.0.smithi060.stdout:7/712: symlink d0/d1b/d8c/le5 0 2024-04-12T13:42:17.291 INFO:tasks.workunit.client.0.smithi060.stdout:8/714: readlink d9/d1b/d84/lcf 0 2024-04-12T13:42:17.292 INFO:tasks.workunit.client.1.smithi110.stdout:0/708: chown d1/d56/lf1 1036340410 1 2024-04-12T13:42:17.293 INFO:tasks.workunit.client.0.smithi060.stdout:7/713: truncate d0/d1b/f48 4284482 0 2024-04-12T13:42:17.294 INFO:tasks.workunit.client.0.smithi060.stdout:0/677: mkdir d7/d9/d14/d35/d44/d8c/d8d/de5 0 2024-04-12T13:42:17.295 INFO:tasks.workunit.client.1.smithi110.stdout:1/778: mkdir de/d15/dab/dd8/d103 0 2024-04-12T13:42:17.297 INFO:tasks.workunit.client.1.smithi110.stdout:3/748: creat d5/dc/d31/d74/fe4 x:0 0 0 2024-04-12T13:42:17.301 INFO:tasks.workunit.client.1.smithi110.stdout:3/749: write d5/dc/d31/d3b/d5b/fd8 [568246,67715] 0 2024-04-12T13:42:17.303 INFO:tasks.workunit.client.0.smithi060.stdout:1/847: link d1e/d23/d2e/d30/d51/ld1 d1e/d23/l127 0 2024-04-12T13:42:17.304 INFO:tasks.workunit.client.0.smithi060.stdout:5/749: dwrite d6/dd/d1f/f98 [0,4194304] 0 2024-04-12T13:42:17.304 INFO:tasks.workunit.client.1.smithi110.stdout:2/812: mkdir d6/dc/dd/d49/df9 0 2024-04-12T13:42:17.305 INFO:tasks.workunit.client.0.smithi060.stdout:4/694: dread - d6/d7/dd/d1a/d57/d63/fb2 zero size 2024-04-12T13:42:17.307 INFO:tasks.workunit.client.0.smithi060.stdout:1/848: stat d1e/d23/d49/d4e/d9b 0 2024-04-12T13:42:17.308 INFO:tasks.workunit.client.1.smithi110.stdout:2/813: stat d6/dc/d13/d80 0 2024-04-12T13:42:17.309 INFO:tasks.workunit.client.0.smithi060.stdout:6/785: truncate d1/d7/da/dc/d24/d34/f28 686796 0 2024-04-12T13:42:17.311 INFO:tasks.workunit.client.1.smithi110.stdout:2/814: read - d6/dc/d1b/d8f/fee zero size 2024-04-12T13:42:17.312 INFO:tasks.workunit.client.0.smithi060.stdout:1/849: chown d1e/d23/d2e/f99 524437879 1 2024-04-12T13:42:17.313 INFO:tasks.workunit.client.0.smithi060.stdout:9/669: symlink d4/d9/dbd/le0 0 2024-04-12T13:42:17.314 INFO:tasks.workunit.client.1.smithi110.stdout:5/758: symlink da/d35/dd6/l106 0 2024-04-12T13:42:17.314 INFO:tasks.workunit.client.0.smithi060.stdout:0/678: creat d7/d9/de/d63/fe6 x:0 0 0 2024-04-12T13:42:17.314 INFO:tasks.workunit.client.1.smithi110.stdout:1/779: fsync f6 0 2024-04-12T13:42:17.317 INFO:tasks.workunit.client.1.smithi110.stdout:0/709: read d1/d8/d36/fac [521473,79527] 0 2024-04-12T13:42:17.319 INFO:tasks.workunit.client.0.smithi060.stdout:0/679: chown d7/d9/d14/d35/d3c/c6e 5 1 2024-04-12T13:42:17.324 INFO:tasks.workunit.client.1.smithi110.stdout:9/861: symlink df/d13/d26/d37/d6a/dfe/d10c/l126 0 2024-04-12T13:42:17.324 INFO:tasks.workunit.client.1.smithi110.stdout:7/808: creat d1/d1b/f110 x:0 0 0 2024-04-12T13:42:17.325 INFO:tasks.workunit.client.1.smithi110.stdout:3/750: truncate d5/dc/f19 513596 0 2024-04-12T13:42:17.325 INFO:tasks.workunit.client.0.smithi060.stdout:3/773: symlink d7/d17/d19/dc9/df3/lfd 0 2024-04-12T13:42:17.325 INFO:tasks.workunit.client.1.smithi110.stdout:9/862: fsync df/d8a/faf 0 2024-04-12T13:42:17.327 INFO:tasks.workunit.client.1.smithi110.stdout:6/758: mkdir d7/d10/d7e/d85/dd0/dee 0 2024-04-12T13:42:17.328 INFO:tasks.workunit.client.1.smithi110.stdout:9/863: chown df/d13/d2c/d9e/dd6/fa8 58 1 2024-04-12T13:42:17.332 INFO:tasks.workunit.client.0.smithi060.stdout:8/715: truncate d9/d1b/f19 1499186 0 2024-04-12T13:42:17.336 INFO:tasks.workunit.client.0.smithi060.stdout:7/714: creat d0/d3d/dcf/fe6 x:0 0 0 2024-04-12T13:42:17.337 INFO:tasks.workunit.client.0.smithi060.stdout:1/850: dwrite d1e/f4d [0,4194304] 0 2024-04-12T13:42:17.345 INFO:tasks.workunit.client.1.smithi110.stdout:1/780: rename de/d15/fc1 to de/d14/d83/f104 0 2024-04-12T13:42:17.346 INFO:tasks.workunit.client.0.smithi060.stdout:2/755: creat d6/d10/fe3 x:0 0 0 2024-04-12T13:42:17.346 INFO:tasks.workunit.client.1.smithi110.stdout:0/710: symlink d1/d8/d36/d65/lfe 0 2024-04-12T13:42:17.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/680: creat d7/d9/de/d80/d8b/fe7 x:0 0 0 2024-04-12T13:42:17.351 INFO:tasks.workunit.client.1.smithi110.stdout:7/809: creat d1/d3/d4/da6/f111 x:0 0 0 2024-04-12T13:42:17.354 INFO:tasks.workunit.client.1.smithi110.stdout:8/807: write d1/d5/d1f/f56 [466910,47161] 0 2024-04-12T13:42:17.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/716: creat d9/d1b/d37/d4d/d63/d66/db3/ff8 x:0 0 0 2024-04-12T13:42:17.360 INFO:tasks.workunit.client.0.smithi060.stdout:9/670: symlink d4/le1 0 2024-04-12T13:42:17.361 INFO:tasks.workunit.client.1.smithi110.stdout:2/815: link d6/f12 d6/dc/d13/d80/ffa 0 2024-04-12T13:42:17.362 INFO:tasks.workunit.client.0.smithi060.stdout:7/715: mkdir d0/d7/d43/d63/d90/de7 0 2024-04-12T13:42:17.363 INFO:tasks.workunit.client.1.smithi110.stdout:2/816: stat d6/dc/d13/d80/d8d/fa5 0 2024-04-12T13:42:17.365 INFO:tasks.workunit.client.0.smithi060.stdout:1/851: rename d1e/d23/dd9/faf to d1e/d1f/f128 0 2024-04-12T13:42:17.370 INFO:tasks.workunit.client.0.smithi060.stdout:2/756: symlink d6/d56/d55/le4 0 2024-04-12T13:42:17.372 INFO:tasks.workunit.client.1.smithi110.stdout:3/751: rename d5/dc/d31/d3b/d5b/l71 to d5/dc/d20/d2d/d4e/le5 0 2024-04-12T13:42:17.372 INFO:tasks.workunit.client.1.smithi110.stdout:7/810: dwrite d1/d3/d4/d55/d82/db5/f104 [0,4194304] 0 2024-04-12T13:42:17.372 INFO:tasks.workunit.client.1.smithi110.stdout:6/759: dwrite d7/d25/f87 [0,4194304] 0 2024-04-12T13:42:17.377 INFO:tasks.workunit.client.0.smithi060.stdout:0/681: unlink d7/fa 0 2024-04-12T13:42:17.378 INFO:tasks.workunit.client.1.smithi110.stdout:4/874: dwrite d0/de/d32/d61/de9/f105 [0,4194304] 0 2024-04-12T13:42:17.380 INFO:tasks.workunit.client.0.smithi060.stdout:5/750: creat d6/ff7 x:0 0 0 2024-04-12T13:42:17.385 INFO:tasks.workunit.client.0.smithi060.stdout:9/671: rmdir d4/d8/db8 39 2024-04-12T13:42:17.387 INFO:tasks.workunit.client.0.smithi060.stdout:6/786: write d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b [1414521,114665] 0 2024-04-12T13:42:17.394 INFO:tasks.workunit.client.0.smithi060.stdout:7/716: symlink d0/d7/d43/d4d/le8 0 2024-04-12T13:42:17.398 INFO:tasks.workunit.client.0.smithi060.stdout:1/852: rename d1e/d23/d2e/d5e/d68/d9a/fcd to d1e/d23/d49/d4e/d9b/f129 0 2024-04-12T13:42:17.399 INFO:tasks.workunit.client.0.smithi060.stdout:3/774: write d7/d17/d27/d36/db0/fc1 [1530691,31779] 0 2024-04-12T13:42:17.400 INFO:tasks.workunit.client.1.smithi110.stdout:0/711: rename d1/d8/d36/d65/ca7 to d1/d27/d31/cff 0 2024-04-12T13:42:17.403 INFO:tasks.workunit.client.1.smithi110.stdout:9/864: write df/d13/d2c/d2d/d39/d3a/f78 [4811772,64810] 0 2024-04-12T13:42:17.404 INFO:tasks.workunit.client.0.smithi060.stdout:4/695: getdents d6/d7/db/d85 0 2024-04-12T13:42:17.407 INFO:tasks.workunit.client.1.smithi110.stdout:9/865: stat df/d13/d2c/d2d/dc1/d83/d63/db4/ddb/d110 0 2024-04-12T13:42:17.409 INFO:tasks.workunit.client.1.smithi110.stdout:9/866: write df/d38/fdf [5057617,103508] 0 2024-04-12T13:42:17.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/682: mkdir d7/d9/d14/d35/d44/d7d/de8 0 2024-04-12T13:42:17.416 INFO:tasks.workunit.client.1.smithi110.stdout:4/875: truncate d0/d75/fe3 677720 0 2024-04-12T13:42:17.417 INFO:tasks.workunit.client.0.smithi060.stdout:8/717: mknod d9/cf9 0 2024-04-12T13:42:17.419 INFO:tasks.workunit.client.0.smithi060.stdout:8/718: chown d9/d1b/d2b/fb4 27 1 2024-04-12T13:42:17.420 INFO:tasks.workunit.client.1.smithi110.stdout:5/759: dwrite da/db/f14 [4194304,4194304] 0 2024-04-12T13:42:17.420 INFO:tasks.workunit.client.1.smithi110.stdout:3/752: truncate d5/f99 2456688 0 2024-04-12T13:42:17.424 INFO:tasks.workunit.client.1.smithi110.stdout:6/760: rename d7/l9 to d7/d10/d1c/d2b/d3a/dbf/de2/lef 0 2024-04-12T13:42:17.429 INFO:tasks.workunit.client.0.smithi060.stdout:2/757: rename d6/d10/d81/dbd/f7f to d6/d10/d4b/fe5 0 2024-04-12T13:42:17.432 INFO:tasks.workunit.client.1.smithi110.stdout:7/811: creat d1/d3/d4/d55/d56/d72/de0/da7/f112 x:0 0 0 2024-04-12T13:42:17.434 INFO:tasks.workunit.client.1.smithi110.stdout:9/867: dwrite df/d13/d2c/d2d/dc1/d83/d63/db4/fbf [0,4194304] 0 2024-04-12T13:42:17.437 INFO:tasks.workunit.client.0.smithi060.stdout:1/853: creat d1e/d23/d2e/d5e/d68/d9a/f12a x:0 0 0 2024-04-12T13:42:17.437 INFO:tasks.workunit.client.1.smithi110.stdout:7/812: readlink d1/d3/d4/d55/d82/db5/lcf 0 2024-04-12T13:42:17.438 INFO:tasks.workunit.client.1.smithi110.stdout:9/868: chown df/d13/d2c/d9e/f111 116975 1 2024-04-12T13:42:17.438 INFO:tasks.workunit.client.1.smithi110.stdout:2/817: dwrite d6/dc/dd/d49/d64/d8c/fc2 [0,4194304] 0 2024-04-12T13:42:17.439 INFO:tasks.workunit.client.0.smithi060.stdout:4/696: creat d6/d7/dd/d1a/d19/d42/d7c/fe6 x:0 0 0 2024-04-12T13:42:17.442 INFO:tasks.workunit.client.1.smithi110.stdout:2/818: chown d6/dc/dd/d49/d64/d4a/d3c/f26 3382 1 2024-04-12T13:42:17.443 INFO:tasks.workunit.client.0.smithi060.stdout:0/683: mkdir d7/d9/d14/d35/d44/d8c/d8d/de9 0 2024-04-12T13:42:17.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/717: write d0/d78/f95 [417676,51828] 0 2024-04-12T13:42:17.445 INFO:tasks.workunit.client.1.smithi110.stdout:7/813: dread d1/d3/d4/d55/f62 [0,4194304] 0 2024-04-12T13:42:17.445 INFO:tasks.workunit.client.0.smithi060.stdout:0/684: chown d7/f66 3 1 2024-04-12T13:42:17.446 INFO:tasks.workunit.client.1.smithi110.stdout:7/814: dread - d1/d3/d4/d55/d82/ffc zero size 2024-04-12T13:42:17.447 INFO:tasks.workunit.client.0.smithi060.stdout:5/751: mkdir d6/dd/d1f/dd3/de7/df8 0 2024-04-12T13:42:17.447 INFO:tasks.workunit.client.1.smithi110.stdout:3/753: rename d5/dc/d31/d3b/l9c to d5/dc/d31/d74/d75/dbb/le6 0 2024-04-12T13:42:17.448 INFO:tasks.workunit.client.0.smithi060.stdout:7/718: readlink d0/d7/d43/d4d/l4f 0 2024-04-12T13:42:17.449 INFO:tasks.workunit.client.0.smithi060.stdout:0/685: chown d7/d9/de/d80/d8b 45777996 1 2024-04-12T13:42:17.450 INFO:tasks.workunit.client.0.smithi060.stdout:9/672: mknod d4/d8/ce2 0 2024-04-12T13:42:17.450 INFO:tasks.workunit.client.1.smithi110.stdout:6/761: symlink d7/d25/d2c/lf0 0 2024-04-12T13:42:17.451 INFO:tasks.workunit.client.1.smithi110.stdout:6/762: readlink d7/d10/led 0 2024-04-12T13:42:17.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/719: readlink d0/d7/d43/d4d/l62 0 2024-04-12T13:42:17.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/720: chown d0/d3d/c4a 83848005 1 2024-04-12T13:42:17.455 INFO:tasks.workunit.client.1.smithi110.stdout:1/781: getdents de/d15/d32 0 2024-04-12T13:42:17.455 INFO:tasks.workunit.client.0.smithi060.stdout:6/787: mkdir d1/d7/da/dc/d7a/de1/dfe 0 2024-04-12T13:42:17.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/719: rename d9/d1b/d37/d48/c57 to d9/d1b/d37/d48/cfa 0 2024-04-12T13:42:17.458 INFO:tasks.workunit.client.1.smithi110.stdout:0/712: unlink d1/d27/d31/cff 0 2024-04-12T13:42:17.463 INFO:tasks.workunit.client.0.smithi060.stdout:1/854: write d1e/d23/dd9/fc6 [2477600,32132] 0 2024-04-12T13:42:17.469 INFO:tasks.workunit.client.1.smithi110.stdout:2/819: rename d6/dc/dd/d49/d64/d4a/d3c/d6e/la3 to d6/dc/d6f/lfb 0 2024-04-12T13:42:17.471 INFO:tasks.workunit.client.1.smithi110.stdout:3/754: truncate d5/dc/d31/d3b/f4b 102493 0 2024-04-12T13:42:17.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/721: dread - d0/d7/d43/d63/d90/fb9 zero size 2024-04-12T13:42:17.473 INFO:tasks.workunit.client.0.smithi060.stdout:8/720: creat d9/d1d/ffb x:0 0 0 2024-04-12T13:42:17.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/686: chown d7/d41/f7f 17 1 2024-04-12T13:42:17.475 INFO:tasks.workunit.client.1.smithi110.stdout:6/763: creat d7/d10/d1c/d2b/d48/d54/ff1 x:0 0 0 2024-04-12T13:42:17.475 INFO:tasks.workunit.client.0.smithi060.stdout:5/752: dwrite d6/dd/d1f/f98 [0,4194304] 0 2024-04-12T13:42:17.481 INFO:tasks.workunit.client.0.smithi060.stdout:2/758: symlink d6/dae/d5b/d6d/de1/le6 0 2024-04-12T13:42:17.487 INFO:tasks.workunit.client.0.smithi060.stdout:6/788: creat d1/d7/da/dc/d24/d30/d52/d78/fff x:0 0 0 2024-04-12T13:42:17.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/673: mknod d4/ce3 0 2024-04-12T13:42:17.490 INFO:tasks.workunit.client.1.smithi110.stdout:0/713: mknod d1/d27/d31/d67/dcb/c100 0 2024-04-12T13:42:17.491 INFO:tasks.workunit.client.0.smithi060.stdout:6/789: stat d1/d7/da/dc/d24/d30/d52/d78/d80/d93 0 2024-04-12T13:42:17.491 INFO:tasks.workunit.client.0.smithi060.stdout:7/722: fdatasync d0/f47 0 2024-04-12T13:42:17.494 INFO:tasks.workunit.client.1.smithi110.stdout:4/876: getdents d0/de/d32 0 2024-04-12T13:42:17.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/855: dread d1e/f31 [0,4194304] 0 2024-04-12T13:42:17.496 INFO:tasks.workunit.client.0.smithi060.stdout:7/723: chown d0/d1b/l44 30 1 2024-04-12T13:42:17.496 INFO:tasks.workunit.client.1.smithi110.stdout:7/815: symlink d1/d3/d4/d55/d56/d72/l113 0 2024-04-12T13:42:17.497 INFO:tasks.workunit.client.0.smithi060.stdout:6/790: fdatasync d1/d7/da/dc/d24/d8b/ff8 0 2024-04-12T13:42:17.498 INFO:tasks.workunit.client.1.smithi110.stdout:8/808: sync 2024-04-12T13:42:17.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/724: fsync d0/d78/da0/fb4 0 2024-04-12T13:42:17.502 INFO:tasks.workunit.client.1.smithi110.stdout:3/755: mknod d5/dc/d31/d74/d75/dbb/ce7 0 2024-04-12T13:42:17.504 INFO:tasks.workunit.client.0.smithi060.stdout:6/791: truncate d1/d7/f5d 4347859 0 2024-04-12T13:42:17.504 INFO:tasks.workunit.client.1.smithi110.stdout:2/820: chown d6/dc/d6f/lfb 164 1 2024-04-12T13:42:17.507 INFO:tasks.workunit.client.1.smithi110.stdout:6/764: symlink d7/d10/d41/lf2 0 2024-04-12T13:42:17.511 INFO:tasks.workunit.client.0.smithi060.stdout:8/721: dread d9/d1b/d2b/d82/d8a/dce/fc4 [0,4194304] 0 2024-04-12T13:42:17.515 INFO:tasks.workunit.client.1.smithi110.stdout:1/782: mkdir de/d14/d34/d87/d105 0 2024-04-12T13:42:17.517 INFO:tasks.workunit.client.0.smithi060.stdout:8/722: chown d9/d1b/d37/d4d/d63/d66/db3/ff8 40 1 2024-04-12T13:42:17.519 INFO:tasks.workunit.client.1.smithi110.stdout:0/714: creat d1/d8/d8a/f101 x:0 0 0 2024-04-12T13:42:17.521 INFO:tasks.workunit.client.1.smithi110.stdout:4/877: creat d0/de/da0/dd9/df3/de0/dfa/f121 x:0 0 0 2024-04-12T13:42:17.524 INFO:tasks.workunit.client.0.smithi060.stdout:7/725: creat d0/d7/d43/d63/d6f/fe9 x:0 0 0 2024-04-12T13:42:17.525 INFO:tasks.workunit.client.0.smithi060.stdout:0/687: truncate d7/d9/de/d63/fd2 3617306 0 2024-04-12T13:42:17.525 INFO:tasks.workunit.client.1.smithi110.stdout:5/760: sync 2024-04-12T13:42:17.526 INFO:tasks.workunit.client.0.smithi060.stdout:0/688: chown d7/f26 7 1 2024-04-12T13:42:17.529 INFO:tasks.workunit.client.0.smithi060.stdout:0/689: chown d7/d41/dbc/faf 263 1 2024-04-12T13:42:17.529 INFO:tasks.workunit.client.0.smithi060.stdout:2/759: dread d6/dae/d5b/f66 [0,4194304] 0 2024-04-12T13:42:17.533 INFO:tasks.workunit.client.0.smithi060.stdout:0/690: chown d7/d9/d14/f85 24 1 2024-04-12T13:42:17.535 INFO:tasks.workunit.client.0.smithi060.stdout:0/691: write d7/d9/d4c/d93/fd3 [275472,57804] 0 2024-04-12T13:42:17.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/692: chown d7/d9/d14/d35/d44/d8c 26391 1 2024-04-12T13:42:17.540 INFO:tasks.workunit.client.0.smithi060.stdout:5/753: rename d6/dd/d1f/dd3/c5c to d6/dd/d1f/d25/cf9 0 2024-04-12T13:42:17.540 INFO:tasks.workunit.client.1.smithi110.stdout:2/821: dread d6/dc/dd/d49/d64/f5e [0,4194304] 0 2024-04-12T13:42:17.540 INFO:tasks.workunit.client.0.smithi060.stdout:9/674: write d4/d9/d19/d21/d73/fb5 [776536,102759] 0 2024-04-12T13:42:17.541 INFO:tasks.workunit.client.1.smithi110.stdout:9/869: getdents df/d38 0 2024-04-12T13:42:17.545 INFO:tasks.workunit.client.1.smithi110.stdout:1/783: mknod de/d15/d32/d61/d6a/dac/dc0/dea/c106 0 2024-04-12T13:42:17.546 INFO:tasks.workunit.client.1.smithi110.stdout:9/870: dread - df/d13/d2c/d2d/dc1/ffa zero size 2024-04-12T13:42:17.550 INFO:tasks.workunit.client.0.smithi060.stdout:7/726: creat d0/d1b/da4/fea x:0 0 0 2024-04-12T13:42:17.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/727: truncate d0/d78/f95 871225 0 2024-04-12T13:42:17.552 INFO:tasks.workunit.client.0.smithi060.stdout:6/792: mkdir d1/d7/da/dc/d24/d30/d52/d5e/d7e/d100 0 2024-04-12T13:42:17.553 INFO:tasks.workunit.client.1.smithi110.stdout:8/809: write d1/f94 [895129,97997] 0 2024-04-12T13:42:17.554 INFO:tasks.workunit.client.1.smithi110.stdout:4/878: rmdir d0/d75 39 2024-04-12T13:42:17.557 INFO:tasks.workunit.client.0.smithi060.stdout:1/856: creat d1e/f12b x:0 0 0 2024-04-12T13:42:17.560 INFO:tasks.workunit.client.0.smithi060.stdout:2/760: creat d6/d10/d6b/fe7 x:0 0 0 2024-04-12T13:42:17.561 INFO:tasks.workunit.client.0.smithi060.stdout:9/675: rmdir d4/d9/d19 39 2024-04-12T13:42:17.564 INFO:tasks.workunit.client.0.smithi060.stdout:0/693: unlink d7/d9/d14/d35/d44/d7d/f3b 0 2024-04-12T13:42:17.568 INFO:tasks.workunit.client.0.smithi060.stdout:8/723: dwrite d9/d1b/d37/d4d/d63/d66/db3/f75 [0,4194304] 0 2024-04-12T13:42:17.570 INFO:tasks.workunit.client.0.smithi060.stdout:6/793: chown d1/d7/da/dc/d24/d34/f28 3724 1 2024-04-12T13:42:17.573 INFO:tasks.workunit.client.0.smithi060.stdout:9/676: chown d4/d9/d19/d21/dbf 15 1 2024-04-12T13:42:17.574 INFO:tasks.workunit.client.1.smithi110.stdout:0/715: read - d1/d48/db2/fb5 zero size 2024-04-12T13:42:17.577 INFO:tasks.workunit.client.1.smithi110.stdout:8/810: creat d1/d3/d35/d3a/d41/dd7/f10a x:0 0 0 2024-04-12T13:42:17.580 INFO:tasks.workunit.client.0.smithi060.stdout:2/761: rename d6/d10/d2b/c2c to d6/dae/d5b/d6d/de1/ce8 0 2024-04-12T13:42:17.583 INFO:tasks.workunit.client.1.smithi110.stdout:3/756: write d5/f99 [134387,27594] 0 2024-04-12T13:42:17.589 INFO:tasks.workunit.client.1.smithi110.stdout:5/761: link da/d2e/d45/f1f da/db/d3b/d40/da6/f107 0 2024-04-12T13:42:17.589 INFO:tasks.workunit.client.0.smithi060.stdout:1/857: mknod d1e/c12c 0 2024-04-12T13:42:17.590 INFO:tasks.workunit.client.0.smithi060.stdout:1/858: readlink d1e/d29/d65/le8 0 2024-04-12T13:42:17.592 INFO:tasks.workunit.client.0.smithi060.stdout:9/677: creat d4/d9/d19/d8c/d92/fe4 x:0 0 0 2024-04-12T13:42:17.596 INFO:tasks.workunit.client.0.smithi060.stdout:0/694: mknod d7/d9/d14/d35/d44/d8c/d8d/de9/cea 0 2024-04-12T13:42:17.596 INFO:tasks.workunit.client.0.smithi060.stdout:1/859: rmdir d1e/d23/dd9/dae 39 2024-04-12T13:42:17.597 INFO:tasks.workunit.client.1.smithi110.stdout:8/811: mknod d1/d3/d35/d3a/d84/c10b 0 2024-04-12T13:42:17.602 INFO:tasks.workunit.client.0.smithi060.stdout:8/724: dwrite d9/d1d/d2f/f30 [0,4194304] 0 2024-04-12T13:42:17.603 INFO:tasks.workunit.client.1.smithi110.stdout:4/879: mknod d0/de/da0/dd9/df3/de0/dfa/d11f/c122 0 2024-04-12T13:42:17.604 INFO:tasks.workunit.client.1.smithi110.stdout:7/816: getdents d1/d1b 0 2024-04-12T13:42:17.608 INFO:tasks.workunit.client.0.smithi060.stdout:2/762: dread d6/d10/d81/dbd/f28 [0,4194304] 0 2024-04-12T13:42:17.610 INFO:tasks.workunit.client.1.smithi110.stdout:6/765: dwrite d7/d25/d30/d44/f7d [4194304,4194304] 0 2024-04-12T13:42:17.615 INFO:tasks.workunit.client.1.smithi110.stdout:5/762: mkdir da/db/d15/de9/d108 0 2024-04-12T13:42:17.615 INFO:tasks.workunit.client.1.smithi110.stdout:1/784: rename de/d14/f3a to de/d15/d32/d61/f107 0 2024-04-12T13:42:17.616 INFO:tasks.workunit.client.1.smithi110.stdout:0/716: mkdir d1/d8/d102 0 2024-04-12T13:42:17.622 INFO:tasks.workunit.client.0.smithi060.stdout:8/725: rename d9/d1d/d2f to d9/d1b/d37/d4d/d63/d66/dd9/dfc 0 2024-04-12T13:42:17.623 INFO:tasks.workunit.client.0.smithi060.stdout:0/695: write d7/d9/de/f91 [5028862,1667] 0 2024-04-12T13:42:17.623 INFO:tasks.workunit.client.1.smithi110.stdout:3/757: write d5/dc/d20/d2d/f3c [4568303,113862] 0 2024-04-12T13:42:17.626 INFO:tasks.workunit.client.0.smithi060.stdout:1/860: creat d1e/f12d x:0 0 0 2024-04-12T13:42:17.628 INFO:tasks.workunit.client.1.smithi110.stdout:2/822: dwrite d6/dc/dd/f28 [0,4194304] 0 2024-04-12T13:42:17.635 INFO:tasks.workunit.client.1.smithi110.stdout:8/812: dwrite d1/d3/d35/d3a/d3e/d64/d85/fd4 [0,4194304] 0 2024-04-12T13:42:17.638 INFO:tasks.workunit.client.1.smithi110.stdout:0/717: mkdir d1/d3c/dd8/d103 0 2024-04-12T13:42:17.643 INFO:tasks.workunit.client.0.smithi060.stdout:1/861: mkdir d1e/d23/d2e/d30/d51/d12e 0 2024-04-12T13:42:17.646 INFO:tasks.workunit.client.1.smithi110.stdout:3/758: rmdir d5/dc/d20 39 2024-04-12T13:42:17.646 INFO:tasks.workunit.client.1.smithi110.stdout:2/823: mkdir d6/d53/dfc 0 2024-04-12T13:42:17.648 INFO:tasks.workunit.client.0.smithi060.stdout:9/678: getdents d4/d9/d19 0 2024-04-12T13:42:17.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/862: dread - d1e/d23/d49/f83 zero size 2024-04-12T13:42:17.651 INFO:tasks.workunit.client.1.smithi110.stdout:6/766: truncate d7/d25/d30/d44/d3d/f49 2825426 0 2024-04-12T13:42:17.655 INFO:tasks.workunit.client.0.smithi060.stdout:8/726: link d9/d1b/d37/d48/f62 d9/d1d/d5e/ded/ffd 0 2024-04-12T13:42:17.656 INFO:tasks.workunit.client.0.smithi060.stdout:9/679: write d4/d33/d50/f6c [94648,7065] 0 2024-04-12T13:42:17.656 INFO:tasks.workunit.client.0.smithi060.stdout:2/763: write d6/f9 [4785446,14435] 0 2024-04-12T13:42:17.659 INFO:tasks.workunit.client.1.smithi110.stdout:8/813: truncate d1/d7/f3f 1702518 0 2024-04-12T13:42:17.667 INFO:tasks.workunit.client.0.smithi060.stdout:1/863: truncate d1e/d29/d37/f73 5748483 0 2024-04-12T13:42:17.670 INFO:tasks.workunit.client.0.smithi060.stdout:8/727: truncate d9/d1b/d3c/d6e/d7b/f9e 425050 0 2024-04-12T13:42:17.674 INFO:tasks.workunit.client.1.smithi110.stdout:5/763: creat da/d35/f109 x:0 0 0 2024-04-12T13:42:17.674 INFO:tasks.workunit.client.0.smithi060.stdout:0/696: dwrite d7/d9/d4c/f55 [0,4194304] 0 2024-04-12T13:42:17.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/680: mknod d4/d9/d19/d21/dbf/dce/ce5 0 2024-04-12T13:42:17.676 INFO:tasks.workunit.client.1.smithi110.stdout:3/759: dread d5/dc/f19 [0,4194304] 0 2024-04-12T13:42:17.677 INFO:tasks.workunit.client.1.smithi110.stdout:7/817: getdents d1/d3/d4/d36 0 2024-04-12T13:42:17.680 INFO:tasks.workunit.client.0.smithi060.stdout:9/681: fsync d4/d8/d32/f99 0 2024-04-12T13:42:17.686 INFO:tasks.workunit.client.1.smithi110.stdout:1/785: rename de/d15/d32/d61/d6a/d8b to de/d14/d34/d108 0 2024-04-12T13:42:17.686 INFO:tasks.workunit.client.0.smithi060.stdout:2/764: write d6/d10/d16/f1c [2255979,74496] 0 2024-04-12T13:42:17.689 INFO:tasks.workunit.client.0.smithi060.stdout:1/864: mknod d1e/d23/d2e/d8e/c12f 0 2024-04-12T13:42:17.690 INFO:tasks.workunit.client.1.smithi110.stdout:8/814: unlink d1/d3/l6c 0 2024-04-12T13:42:17.691 INFO:tasks.workunit.client.0.smithi060.stdout:8/728: dwrite d9/d1d/ffb [0,4194304] 0 2024-04-12T13:42:17.692 INFO:tasks.workunit.client.0.smithi060.stdout:1/865: chown d1e/d23/d2e/f99 139426700 1 2024-04-12T13:42:17.694 INFO:tasks.workunit.client.0.smithi060.stdout:1/866: chown d1e/d1f/c3d 21 1 2024-04-12T13:42:17.694 INFO:tasks.workunit.client.1.smithi110.stdout:4/880: getdents d0/de/da0/dd9/df3/de0/dfa/d11f 0 2024-04-12T13:42:17.698 INFO:tasks.workunit.client.0.smithi060.stdout:0/697: write d7/d9/d14/d35/d44/d49/fd7 [705993,110463] 0 2024-04-12T13:42:17.702 INFO:tasks.workunit.client.0.smithi060.stdout:0/698: chown d7/d9/d14/d35/d44/d49/d67/f76 3 1 2024-04-12T13:42:17.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/765: mkdir d6/d64/d99/de9 0 2024-04-12T13:42:17.706 INFO:tasks.workunit.client.1.smithi110.stdout:7/818: rename d1/d3/d4/d55/d82/ffc to d1/d3/d4/d55/f114 0 2024-04-12T13:42:17.714 INFO:tasks.workunit.client.1.smithi110.stdout:3/760: write d5/dc/d31/fab [1618264,11698] 0 2024-04-12T13:42:17.715 INFO:tasks.workunit.client.1.smithi110.stdout:9/871: sync 2024-04-12T13:42:17.716 INFO:tasks.workunit.client.0.smithi060.stdout:0/699: chown d7/c29 20 1 2024-04-12T13:42:17.717 INFO:tasks.workunit.client.1.smithi110.stdout:8/815: chown d1/d3/d35/d3a/d3e/d64/d85/de1/l102 50 1 2024-04-12T13:42:17.718 INFO:tasks.workunit.client.1.smithi110.stdout:2/824: creat d6/ffd x:0 0 0 2024-04-12T13:42:17.719 INFO:tasks.workunit.client.1.smithi110.stdout:8/816: dread - d1/d3/fd9 zero size 2024-04-12T13:42:17.722 INFO:tasks.workunit.client.0.smithi060.stdout:8/729: write d9/d1b/fc0 [404043,100140] 0 2024-04-12T13:42:17.722 INFO:tasks.workunit.client.1.smithi110.stdout:2/825: dread d6/dc/d13/f7b [0,4194304] 0 2024-04-12T13:42:17.723 INFO:tasks.workunit.client.1.smithi110.stdout:4/881: symlink d0/d19/d1c/d50/d6f/l123 0 2024-04-12T13:42:17.727 INFO:tasks.workunit.client.0.smithi060.stdout:0/700: mknod d7/d33/d88/ceb 0 2024-04-12T13:42:17.727 INFO:tasks.workunit.client.1.smithi110.stdout:1/786: getdents de/d7b/da1 0 2024-04-12T13:42:17.729 INFO:tasks.workunit.client.0.smithi060.stdout:1/867: link d1e/d29/f109 d1e/d23/f130 0 2024-04-12T13:42:17.729 INFO:tasks.workunit.client.0.smithi060.stdout:0/701: write d7/d41/dbc/faf [91950,26196] 0 2024-04-12T13:42:17.730 INFO:tasks.workunit.client.0.smithi060.stdout:1/868: read d1e/f31 [463622,116337] 0 2024-04-12T13:42:17.732 INFO:tasks.workunit.client.1.smithi110.stdout:0/718: getdents d1/d27 0 2024-04-12T13:42:17.733 INFO:tasks.workunit.client.0.smithi060.stdout:0/702: readlink d7/d41/dbc/lc4 0 2024-04-12T13:42:17.733 INFO:tasks.workunit.client.0.smithi060.stdout:9/682: getdents d4/d8/d32 0 2024-04-12T13:42:17.735 INFO:tasks.workunit.client.1.smithi110.stdout:9/872: unlink fd 0 2024-04-12T13:42:17.737 INFO:tasks.workunit.client.1.smithi110.stdout:9/873: readlink df/d13/d2c/d2d/dc1/d83/l119 0 2024-04-12T13:42:17.739 INFO:tasks.workunit.client.1.smithi110.stdout:7/819: write d1/d3/d4/dbf/f9d [142285,101492] 0 2024-04-12T13:42:17.741 INFO:tasks.workunit.client.0.smithi060.stdout:2/766: dwrite d6/d10/d16/f18 [0,4194304] 0 2024-04-12T13:42:17.742 INFO:tasks.workunit.client.1.smithi110.stdout:5/764: creat da/d2e/d45/d25/f10a x:0 0 0 2024-04-12T13:42:17.743 INFO:tasks.workunit.client.0.smithi060.stdout:2/767: write d6/d64/fcc [649424,101919] 0 2024-04-12T13:42:17.746 INFO:tasks.workunit.client.0.smithi060.stdout:8/730: truncate d9/d1b/d84/da0/f24 7063746 0 2024-04-12T13:42:17.756 INFO:tasks.workunit.client.1.smithi110.stdout:0/719: creat d1/d3c/dd8/df6/f104 x:0 0 0 2024-04-12T13:42:17.759 INFO:tasks.workunit.client.1.smithi110.stdout:5/765: truncate da/db/d15/fb8 1999134 0 2024-04-12T13:42:17.765 INFO:tasks.workunit.client.1.smithi110.stdout:3/761: mkdir d5/dc/d20/d2d/d4e/d89/d8c/db6/de8 0 2024-04-12T13:42:17.767 INFO:tasks.workunit.client.0.smithi060.stdout:8/731: dwrite d9/d1b/d2b/f5c [0,4194304] 0 2024-04-12T13:42:17.767 INFO:tasks.workunit.client.1.smithi110.stdout:8/817: creat d1/d3/d35/d3a/d41/f10c x:0 0 0 2024-04-12T13:42:17.767 INFO:tasks.workunit.client.1.smithi110.stdout:0/720: readlink d1/d8/l1c 0 2024-04-12T13:42:17.769 INFO:tasks.workunit.client.0.smithi060.stdout:8/732: read - d9/d1b/f70 zero size 2024-04-12T13:42:17.769 INFO:tasks.workunit.client.1.smithi110.stdout:0/721: stat d1/d3c/d6b/c94 0 2024-04-12T13:42:17.772 INFO:tasks.workunit.client.1.smithi110.stdout:3/762: mknod d5/dc/d20/d2d/d4f/dce/ce9 0 2024-04-12T13:42:17.773 INFO:tasks.workunit.client.1.smithi110.stdout:8/818: chown d1/d3/d3c/d75/d79/fad 11053 1 2024-04-12T13:42:17.773 INFO:tasks.workunit.client.0.smithi060.stdout:1/869: dread d1e/d94/fe9 [0,4194304] 0 2024-04-12T13:42:17.774 INFO:tasks.workunit.client.0.smithi060.stdout:1/870: stat d1e/ld5 0 2024-04-12T13:42:17.774 INFO:tasks.workunit.client.1.smithi110.stdout:1/787: getdents de/d1d 0 2024-04-12T13:42:17.775 INFO:tasks.workunit.client.0.smithi060.stdout:8/733: mkdir d9/d1d/dfe 0 2024-04-12T13:42:17.780 INFO:tasks.workunit.client.1.smithi110.stdout:2/826: write d6/dc/d13/dec/fb7 [765570,26042] 0 2024-04-12T13:42:17.780 INFO:tasks.workunit.client.1.smithi110.stdout:0/722: read d1/d8/f3d [417599,34598] 0 2024-04-12T13:42:17.788 INFO:tasks.workunit.client.0.smithi060.stdout:0/703: dwrite d7/d33/fb4 [0,4194304] 0 2024-04-12T13:42:17.788 INFO:tasks.workunit.client.1.smithi110.stdout:2/827: symlink d6/dc/d6f/lfe 0 2024-04-12T13:42:17.789 INFO:tasks.workunit.client.0.smithi060.stdout:8/734: write d9/d1b/d37/d4d/d63/d66/dd9/dfc/fe2 [316908,121435] 0 2024-04-12T13:42:17.789 INFO:tasks.workunit.client.1.smithi110.stdout:5/766: dread da/d2e/d45/f1f [0,4194304] 0 2024-04-12T13:42:17.791 INFO:tasks.workunit.client.1.smithi110.stdout:4/882: dwrite d0/d19/d1c/f60 [0,4194304] 0 2024-04-12T13:42:17.797 INFO:tasks.workunit.client.0.smithi060.stdout:2/768: dwrite d6/f2a [0,4194304] 0 2024-04-12T13:42:17.800 INFO:tasks.workunit.client.1.smithi110.stdout:7/820: truncate d1/f1e 6238435 0 2024-04-12T13:42:17.803 INFO:tasks.workunit.client.1.smithi110.stdout:1/788: dwrite fb [0,4194304] 0 2024-04-12T13:42:17.806 INFO:tasks.workunit.client.0.smithi060.stdout:0/704: creat d7/d33/d5b/fec x:0 0 0 2024-04-12T13:42:17.811 INFO:tasks.workunit.client.0.smithi060.stdout:8/735: creat d9/d1d/d5e/d90/fff x:0 0 0 2024-04-12T13:42:17.813 INFO:tasks.workunit.client.0.smithi060.stdout:2/769: rmdir d6/d10/d81/dbd 39 2024-04-12T13:42:17.815 INFO:tasks.workunit.client.1.smithi110.stdout:3/763: write d5/dc/f24 [1282560,82697] 0 2024-04-12T13:42:17.816 INFO:tasks.workunit.client.1.smithi110.stdout:6/767: sync 2024-04-12T13:42:17.817 INFO:tasks.workunit.client.0.smithi060.stdout:0/705: symlink d7/d9/d14/d35/d44/d8c/d8d/led 0 2024-04-12T13:42:17.824 INFO:tasks.workunit.client.0.smithi060.stdout:8/736: creat d9/d1b/d3c/d6e/dbd/f100 x:0 0 0 2024-04-12T13:42:17.825 INFO:tasks.workunit.client.1.smithi110.stdout:1/789: read de/d14/d83/fb6 [302803,37390] 0 2024-04-12T13:42:17.833 INFO:tasks.workunit.client.0.smithi060.stdout:0/706: truncate d7/d9/f1e 1041775 0 2024-04-12T13:42:17.834 INFO:tasks.workunit.client.0.smithi060.stdout:2/770: link d6/d10/d2b/d60/c7b d6/dae/d5b/d6d/de1/cea 0 2024-04-12T13:42:17.835 INFO:tasks.workunit.client.1.smithi110.stdout:7/821: mkdir d1/d3/d4/d55/d56/d72/dad/d115 0 2024-04-12T13:42:17.836 INFO:tasks.workunit.client.0.smithi060.stdout:1/871: dread d1e/f2d [4194304,4194304] 0 2024-04-12T13:42:17.837 INFO:tasks.workunit.client.0.smithi060.stdout:0/707: symlink d7/d9/d14/d35/d44/lee 0 2024-04-12T13:42:17.839 INFO:tasks.workunit.client.1.smithi110.stdout:1/790: unlink de/d1d/c46 0 2024-04-12T13:42:17.840 INFO:tasks.workunit.client.0.smithi060.stdout:2/771: mkdir d6/d10/d2b/deb 0 2024-04-12T13:42:17.842 INFO:tasks.workunit.client.1.smithi110.stdout:1/791: write de/d14/d34/d55/f63 [2021979,50192] 0 2024-04-12T13:42:17.842 INFO:tasks.workunit.client.0.smithi060.stdout:8/737: dwrite d9/d1d/d5e/ff6 [0,4194304] 0 2024-04-12T13:42:17.843 INFO:tasks.workunit.client.1.smithi110.stdout:4/883: creat d0/d19/d1c/d50/f124 x:0 0 0 2024-04-12T13:42:17.844 INFO:tasks.workunit.client.1.smithi110.stdout:2/828: link l5 d6/dc/d13/d80/d8d/lff 0 2024-04-12T13:42:17.846 INFO:tasks.workunit.client.1.smithi110.stdout:2/829: fdatasync d6/dc/dd/dc6/fe4 0 2024-04-12T13:42:17.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/738: write d9/d1b/d37/d4d/d63/fa9 [887670,77501] 0 2024-04-12T13:42:17.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/872: unlink d1e/d23/l127 0 2024-04-12T13:42:17.852 INFO:tasks.workunit.client.0.smithi060.stdout:0/708: fdatasync d7/d9/d14/d35/d44/d49/d67/f86 0 2024-04-12T13:42:17.852 INFO:tasks.workunit.client.0.smithi060.stdout:1/873: dread - d1e/d23/f130 zero size 2024-04-12T13:42:17.853 INFO:tasks.workunit.client.0.smithi060.stdout:1/874: stat d1e/d23/d49/d4e/ff6 0 2024-04-12T13:42:17.857 INFO:tasks.workunit.client.0.smithi060.stdout:2/772: mkdir d6/dae/dec 0 2024-04-12T13:42:17.857 INFO:tasks.workunit.client.1.smithi110.stdout:0/723: link d1/d27/d31/d67/dcb/ce7 d1/d8/d36/c105 0 2024-04-12T13:42:17.861 INFO:tasks.workunit.client.0.smithi060.stdout:2/773: truncate d6/d56/d86/fd4 248864 0 2024-04-12T13:42:17.864 INFO:tasks.workunit.client.0.smithi060.stdout:2/774: write d6/d56/d43/f72 [842661,65861] 0 2024-04-12T13:42:17.864 INFO:tasks.workunit.client.0.smithi060.stdout:0/709: mknod d7/d9/d4c/cef 0 2024-04-12T13:42:17.865 INFO:tasks.workunit.client.0.smithi060.stdout:8/739: dwrite d9/d1b/d37/d4d/d63/d66/db3/fda [0,4194304] 0 2024-04-12T13:42:17.868 INFO:tasks.workunit.client.0.smithi060.stdout:1/875: creat d1e/d23/d2e/d30/d51/d85/f131 x:0 0 0 2024-04-12T13:42:17.868 INFO:tasks.workunit.client.1.smithi110.stdout:8/819: sync 2024-04-12T13:42:17.869 INFO:tasks.workunit.client.1.smithi110.stdout:9/874: sync 2024-04-12T13:42:17.872 INFO:tasks.workunit.client.1.smithi110.stdout:2/830: rmdir d6/dc/d1b 39 2024-04-12T13:42:17.873 INFO:tasks.workunit.client.0.smithi060.stdout:2/775: creat d6/d56/d43/fed x:0 0 0 2024-04-12T13:42:17.874 INFO:tasks.workunit.client.1.smithi110.stdout:0/724: truncate d1/d3c/d6b/d90/f9a 4311545 0 2024-04-12T13:42:17.874 INFO:tasks.workunit.client.0.smithi060.stdout:8/740: symlink d9/d1b/d3c/d6e/l101 0 2024-04-12T13:42:17.875 INFO:tasks.workunit.client.1.smithi110.stdout:3/764: getdents d5/d86/dca 0 2024-04-12T13:42:17.878 INFO:tasks.workunit.client.0.smithi060.stdout:2/776: fdatasync d6/d10/d4b/fe5 0 2024-04-12T13:42:17.880 INFO:tasks.workunit.client.1.smithi110.stdout:3/765: truncate d5/dc/d31/d74/fe4 565005 0 2024-04-12T13:42:17.882 INFO:tasks.workunit.client.0.smithi060.stdout:1/876: creat d1e/d23/dd9/dae/f132 x:0 0 0 2024-04-12T13:42:17.884 INFO:tasks.workunit.client.0.smithi060.stdout:1/877: write d1e/d23/d2e/d86/ddb/d107/f121 [691482,113546] 0 2024-04-12T13:42:17.888 INFO:tasks.workunit.client.0.smithi060.stdout:8/741: fdatasync d9/d1b/d3c/d6e/fa5 0 2024-04-12T13:42:17.889 INFO:tasks.workunit.client.0.smithi060.stdout:0/710: getdents d7/d41/dbc 0 2024-04-12T13:42:17.897 INFO:tasks.workunit.client.0.smithi060.stdout:8/742: rmdir d9/d1b/d3c/d6e/d7b/db1 39 2024-04-12T13:42:17.900 INFO:tasks.workunit.client.0.smithi060.stdout:8/743: stat d9/d1b/d37/d4d/d63/d66/db3/d65 0 2024-04-12T13:42:17.902 INFO:tasks.workunit.client.1.smithi110.stdout:3/766: dread d5/dc/d31/d74/fd4 [0,4194304] 0 2024-04-12T13:42:17.904 INFO:tasks.workunit.client.1.smithi110.stdout:0/725: dread d1/d8/d36/d51/fbf [0,4194304] 0 2024-04-12T13:42:17.905 INFO:tasks.workunit.client.0.smithi060.stdout:1/878: getdents d1e 0 2024-04-12T13:42:17.915 INFO:tasks.workunit.client.0.smithi060.stdout:1/879: dread d1e/f38 [0,4194304] 0 2024-04-12T13:42:17.916 INFO:tasks.workunit.client.0.smithi060.stdout:1/880: stat d1e/d23/d2e/d5e/d68/d9a/de1/ffc 0 2024-04-12T13:42:17.922 INFO:tasks.workunit.client.1.smithi110.stdout:5/767: dread da/d2e/d45/d29/d32/f36 [0,4194304] 0 2024-04-12T13:42:17.925 INFO:tasks.workunit.client.1.smithi110.stdout:5/768: chown da/d2e/d45/d25/d5d 0 1 2024-04-12T13:42:17.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/744: getdents d9/d1b/d37/d4d/d63/d66/dd9/dfc 0 2024-04-12T13:42:17.931 INFO:tasks.workunit.client.0.smithi060.stdout:1/881: link d1e/d23/d2e/d5e/d68/f126 d1e/d23/d2e/d5e/f133 0 2024-04-12T13:42:17.933 INFO:tasks.workunit.client.1.smithi110.stdout:6/768: truncate d7/d10/d1c/f42 1894335 0 2024-04-12T13:42:17.939 INFO:tasks.workunit.client.0.smithi060.stdout:8/745: dwrite d9/d1b/d2b/fb4 [0,4194304] 0 2024-04-12T13:42:17.942 INFO:tasks.workunit.client.0.smithi060.stdout:8/746: dread - d9/d1b/d84/da0/d80/fd3 zero size 2024-04-12T13:42:17.947 INFO:tasks.workunit.client.1.smithi110.stdout:7/822: truncate d1/f6b 1171088 0 2024-04-12T13:42:17.958 INFO:tasks.workunit.client.0.smithi060.stdout:2/777: write d6/dae/d31/f41 [607079,81101] 0 2024-04-12T13:42:17.960 INFO:tasks.workunit.client.1.smithi110.stdout:4/884: dwrite d0/de/d2c/f2b [4194304,4194304] 0 2024-04-12T13:42:17.961 INFO:tasks.workunit.client.1.smithi110.stdout:1/792: dwrite de/d15/d32/f44 [4194304,4194304] 0 2024-04-12T13:42:17.965 INFO:tasks.workunit.client.1.smithi110.stdout:6/769: dread d7/d10/d1c/d2b/d3a/fdc [0,4194304] 0 2024-04-12T13:42:17.968 INFO:tasks.workunit.client.1.smithi110.stdout:7/823: write d1/d3/f11 [744713,50656] 0 2024-04-12T13:42:17.968 INFO:tasks.workunit.client.0.smithi060.stdout:2/778: creat d6/dae/fee x:0 0 0 2024-04-12T13:42:17.975 INFO:tasks.workunit.client.1.smithi110.stdout:3/767: unlink d5/ca3 0 2024-04-12T13:42:17.980 INFO:tasks.workunit.client.1.smithi110.stdout:4/885: unlink d0/d19/d1c/fe4 0 2024-04-12T13:42:17.980 INFO:tasks.workunit.client.0.smithi060.stdout:0/711: dwrite d7/d9/d14/d35/fb7 [0,4194304] 0 2024-04-12T13:42:17.982 INFO:tasks.workunit.client.0.smithi060.stdout:2/779: dread d6/dae/d5b/f78 [0,4194304] 0 2024-04-12T13:42:17.984 INFO:tasks.workunit.client.0.smithi060.stdout:3/775: sync 2024-04-12T13:42:17.986 INFO:tasks.workunit.client.0.smithi060.stdout:2/780: read d6/f9 [1025059,47440] 0 2024-04-12T13:42:17.988 INFO:tasks.workunit.client.1.smithi110.stdout:6/770: rmdir d7/d10/d1c 39 2024-04-12T13:42:17.992 INFO:tasks.workunit.client.1.smithi110.stdout:0/726: dread d1/f22 [4194304,4194304] 0 2024-04-12T13:42:17.995 INFO:tasks.workunit.client.1.smithi110.stdout:7/824: creat d1/d1b/d3d/d68/f116 x:0 0 0 2024-04-12T13:42:17.997 INFO:tasks.workunit.client.1.smithi110.stdout:7/825: truncate d1/d1b/f110 916772 0 2024-04-12T13:42:17.998 INFO:tasks.workunit.client.0.smithi060.stdout:0/712: symlink d7/ddf/lf0 0 2024-04-12T13:42:17.999 INFO:tasks.workunit.client.1.smithi110.stdout:9/875: write df/d13/d2c/d9e/dd6/f96 [501487,21765] 0 2024-04-12T13:42:18.001 INFO:tasks.workunit.client.0.smithi060.stdout:3/776: mkdir d7/d17/d19/d96/dfe 0 2024-04-12T13:42:18.011 INFO:tasks.workunit.client.0.smithi060.stdout:3/777: symlink d7/d17/d19/d96/dfe/lff 0 2024-04-12T13:42:18.012 INFO:tasks.workunit.client.0.smithi060.stdout:2/781: dread d6/d10/d6b/f8e [0,4194304] 0 2024-04-12T13:42:18.012 INFO:tasks.workunit.client.1.smithi110.stdout:5/769: creat da/d2e/d45/d25/d9d/f10b x:0 0 0 2024-04-12T13:42:18.013 INFO:tasks.workunit.client.0.smithi060.stdout:0/713: creat d7/d9/d14/d35/ff1 x:0 0 0 2024-04-12T13:42:18.022 INFO:tasks.workunit.client.0.smithi060.stdout:8/747: write d9/d1b/d37/d4d/d63/d66/dd9/dfc/f4b [3310455,28042] 0 2024-04-12T13:42:18.024 INFO:tasks.workunit.client.0.smithi060.stdout:0/714: creat d7/d9/d14/d35/d44/d49/d74/ff2 x:0 0 0 2024-04-12T13:42:18.025 INFO:tasks.workunit.client.1.smithi110.stdout:9/876: rmdir df/d13/d2c/d2d 39 2024-04-12T13:42:18.027 INFO:tasks.workunit.client.1.smithi110.stdout:3/768: creat d5/dc/d20/d2d/d4e/d89/dc0/fea x:0 0 0 2024-04-12T13:42:18.029 INFO:tasks.workunit.client.0.smithi060.stdout:8/748: mkdir d9/d1b/d37/d4d/d63/d66/d8b/d102 0 2024-04-12T13:42:18.031 INFO:tasks.workunit.client.1.smithi110.stdout:5/770: mknod da/db/d3b/d40/d97/db6/c10c 0 2024-04-12T13:42:18.034 INFO:tasks.workunit.client.1.smithi110.stdout:2/831: creat d6/dc/dd/d49/d64/d4a/f100 x:0 0 0 2024-04-12T13:42:18.035 INFO:tasks.workunit.client.1.smithi110.stdout:8/820: truncate d1/d3/d3c/d5a/d6f/d7e/f71 2649366 0 2024-04-12T13:42:18.036 INFO:tasks.workunit.client.0.smithi060.stdout:8/749: mkdir d9/d1b/d2b/d82/d8a/d103 0 2024-04-12T13:42:18.038 INFO:tasks.workunit.client.1.smithi110.stdout:8/821: truncate d1/d7/d20/fff 296716 0 2024-04-12T13:42:18.038 INFO:tasks.workunit.client.0.smithi060.stdout:0/715: dread d7/d9/d14/d4a/f4f [0,4194304] 0 2024-04-12T13:42:18.039 INFO:tasks.workunit.client.1.smithi110.stdout:4/886: dread d0/d75/f9a [0,4194304] 0 2024-04-12T13:42:18.040 INFO:tasks.workunit.client.1.smithi110.stdout:4/887: dread - d0/d19/d1c/d50/d6f/fa7 zero size 2024-04-12T13:42:18.041 INFO:tasks.workunit.client.0.smithi060.stdout:2/782: rename d6/d10/d2b/deb to d6/d10/daa/db0/def 0 2024-04-12T13:42:18.044 INFO:tasks.workunit.client.1.smithi110.stdout:1/793: write de/f80 [589989,98121] 0 2024-04-12T13:42:18.047 INFO:tasks.workunit.client.0.smithi060.stdout:0/716: creat d7/d9/d14/d35/d44/ff3 x:0 0 0 2024-04-12T13:42:18.052 INFO:tasks.workunit.client.0.smithi060.stdout:8/750: creat d9/d1b/d2b/d81/f104 x:0 0 0 2024-04-12T13:42:18.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/783: unlink d6/dae/d31/d87/cc5 0 2024-04-12T13:42:18.058 INFO:tasks.workunit.client.1.smithi110.stdout:8/822: rmdir d1/d3/dbe/dd1 39 2024-04-12T13:42:18.059 INFO:tasks.workunit.client.0.smithi060.stdout:8/751: rmdir d9/d1b/d2b/d82/d8a/dce 39 2024-04-12T13:42:18.059 INFO:tasks.workunit.client.1.smithi110.stdout:9/877: dwrite df/d13/d2c/d9e/dd6/da3/fb5 [0,4194304] 0 2024-04-12T13:42:18.062 INFO:tasks.workunit.client.1.smithi110.stdout:4/888: unlink d0/d75/d84/d89/ff6 0 2024-04-12T13:42:18.064 INFO:tasks.workunit.client.1.smithi110.stdout:6/771: write d7/d25/d30/d44/d3d/fcb [566820,22617] 0 2024-04-12T13:42:18.067 INFO:tasks.workunit.client.1.smithi110.stdout:1/794: dread de/d15/dab/dd8/dd9/dda/fbe [4194304,4194304] 0 2024-04-12T13:42:18.075 INFO:tasks.workunit.client.0.smithi060.stdout:0/717: creat d7/d9/d14/ff4 x:0 0 0 2024-04-12T13:42:18.076 INFO:tasks.workunit.client.1.smithi110.stdout:7/826: dwrite d1/d3/d4/d55/d82/fd0 [0,4194304] 0 2024-04-12T13:42:18.077 INFO:tasks.workunit.client.0.smithi060.stdout:3/778: dwrite d7/d17/d19/d33/d63/d6d/fd3 [0,4194304] 0 2024-04-12T13:42:18.081 INFO:tasks.workunit.client.0.smithi060.stdout:3/779: write d7/d17/d27/fc7 [1122028,100231] 0 2024-04-12T13:42:18.083 INFO:tasks.workunit.client.0.smithi060.stdout:8/752: rmdir d9/d1b/d2b/d82 39 2024-04-12T13:42:18.090 INFO:tasks.workunit.client.0.smithi060.stdout:0/718: mkdir d7/d9/d14/d35/d44/d49/d67/da5/df5 0 2024-04-12T13:42:18.093 INFO:tasks.workunit.client.0.smithi060.stdout:3/780: readlink d7/d17/d27/d36/db0/dc4/lec 0 2024-04-12T13:42:18.093 INFO:tasks.workunit.client.0.smithi060.stdout:0/719: write d7/d33/d5b/f64 [1329322,18441] 0 2024-04-12T13:42:18.095 INFO:tasks.workunit.client.0.smithi060.stdout:0/720: chown d7/f66 3411627 1 2024-04-12T13:42:18.098 INFO:tasks.workunit.client.1.smithi110.stdout:9/878: chown df/d13/d2c/d9e/dd6/f73 2232 1 2024-04-12T13:42:18.099 INFO:tasks.workunit.client.1.smithi110.stdout:5/771: dwrite da/d2e/d45/d29/f48 [0,4194304] 0 2024-04-12T13:42:18.101 INFO:tasks.workunit.client.0.smithi060.stdout:3/781: truncate d7/d17/d19/d33/ff1 302867 0 2024-04-12T13:42:18.110 INFO:tasks.workunit.client.1.smithi110.stdout:6/772: creat d7/d10/d41/ff3 x:0 0 0 2024-04-12T13:42:18.117 INFO:tasks.workunit.client.0.smithi060.stdout:8/753: symlink d9/d1b/d2b/d82/d8a/l105 0 2024-04-12T13:42:18.118 INFO:tasks.workunit.client.0.smithi060.stdout:3/782: creat d7/d17/d19/d33/d63/d6d/dab/f100 x:0 0 0 2024-04-12T13:42:18.118 INFO:tasks.workunit.client.1.smithi110.stdout:3/769: creat d5/dc/d31/d3b/d32/feb x:0 0 0 2024-04-12T13:42:18.121 INFO:tasks.workunit.client.1.smithi110.stdout:7/827: fsync d1/d3/d4/d55/f62 0 2024-04-12T13:42:18.122 INFO:tasks.workunit.client.0.smithi060.stdout:2/784: dwrite d6/d56/d58/da0/f5c [0,4194304] 0 2024-04-12T13:42:18.122 INFO:tasks.workunit.client.0.smithi060.stdout:4/697: sync 2024-04-12T13:42:18.122 INFO:tasks.workunit.client.1.smithi110.stdout:4/889: write d0/d19/f74 [2051456,43728] 0 2024-04-12T13:42:18.128 INFO:tasks.workunit.client.0.smithi060.stdout:0/721: write d7/d9/d14/d35/d44/d49/fc0 [70351,63637] 0 2024-04-12T13:42:18.129 INFO:tasks.workunit.client.1.smithi110.stdout:2/832: link d6/dc/f33 d6/dc/dd/dc6/f101 0 2024-04-12T13:42:18.137 INFO:tasks.workunit.client.1.smithi110.stdout:5/772: truncate da/f11 1658833 0 2024-04-12T13:42:18.139 INFO:tasks.workunit.client.1.smithi110.stdout:6/773: mknod d7/d25/d2c/d4c/cf4 0 2024-04-12T13:42:18.141 INFO:tasks.workunit.client.1.smithi110.stdout:5/773: dread - da/d2e/d45/d25/d9d/d79/d88/dd3/fe3 zero size 2024-04-12T13:42:18.143 INFO:tasks.workunit.client.1.smithi110.stdout:6/774: write d7/d25/dc6/fca [768631,67280] 0 2024-04-12T13:42:18.144 INFO:tasks.workunit.client.1.smithi110.stdout:5/774: readlink da/db/d15/de9/l100 0 2024-04-12T13:42:18.145 INFO:tasks.workunit.client.1.smithi110.stdout:4/890: dwrite d0/f15 [0,4194304] 0 2024-04-12T13:42:18.149 INFO:tasks.workunit.client.1.smithi110.stdout:7/828: mknod d1/d3/d4/d36/c117 0 2024-04-12T13:42:18.152 INFO:tasks.workunit.client.1.smithi110.stdout:7/829: dread - d1/d3/d4/d55/d56/f8c zero size 2024-04-12T13:42:18.155 INFO:tasks.workunit.client.1.smithi110.stdout:0/727: dread d1/d3c/d6b/d90/f9a [0,4194304] 0 2024-04-12T13:42:18.159 INFO:tasks.workunit.client.1.smithi110.stdout:9/879: symlink df/d13/d2c/d2d/d39/d3a/db2/l127 0 2024-04-12T13:42:18.160 INFO:tasks.workunit.client.1.smithi110.stdout:1/795: write de/d7b/fde [368123,19153] 0 2024-04-12T13:42:18.168 INFO:tasks.workunit.client.1.smithi110.stdout:8/823: getdents d1/d3/d3c/d75 0 2024-04-12T13:42:18.171 INFO:tasks.workunit.client.0.smithi060.stdout:1/882: sync 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.0.smithi060.stdout:9/683: sync 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.0.smithi060.stdout:5/754: sync 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.0.smithi060.stdout:6/794: sync 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.0.smithi060.stdout:7/728: sync 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.1.smithi110.stdout:0/728: readlink d1/d27/d6e/l77 0 2024-04-12T13:42:18.172 INFO:tasks.workunit.client.1.smithi110.stdout:1/796: mkdir de/d14/d109 0 2024-04-12T13:42:18.176 INFO:tasks.workunit.client.1.smithi110.stdout:3/770: rename d5/dc/d31/d3b/d5b/f9a to d5/dc/d31/d74/d75/da7/fec 0 2024-04-12T13:42:18.178 INFO:tasks.workunit.client.1.smithi110.stdout:2/833: dwrite d6/dc/dd/d49/d64/d25/f40 [0,4194304] 0 2024-04-12T13:42:18.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:17 smithi060 ceph-mon[29097]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 189 MiB/s wr, 376 op/s 2024-04-12T13:42:18.180 INFO:tasks.workunit.client.1.smithi110.stdout:3/771: readlink d5/dc/d20/d2d/l77 0 2024-04-12T13:42:18.181 INFO:tasks.workunit.client.1.smithi110.stdout:6/775: dread d7/d25/d30/d44/d3d/f49 [0,4194304] 0 2024-04-12T13:42:18.185 INFO:tasks.workunit.client.0.smithi060.stdout:1/883: dread d1e/d23/d2e/d30/f96 [0,4194304] 0 2024-04-12T13:42:18.186 INFO:tasks.workunit.client.0.smithi060.stdout:1/884: stat d1e/d1f/c3d 0 2024-04-12T13:42:18.186 INFO:tasks.workunit.client.1.smithi110.stdout:5/775: link da/db/d15/l49 da/d2e/d45/ddc/l10d 0 2024-04-12T13:42:18.189 INFO:tasks.workunit.client.1.smithi110.stdout:0/729: mknod d1/d8/d8a/dc8/c106 0 2024-04-12T13:42:18.192 INFO:tasks.workunit.client.1.smithi110.stdout:3/772: truncate d5/dc/d31/d3b/d32/f37 864185 0 2024-04-12T13:42:18.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/783: creat d7/d17/d27/d36/d53/da2/dbc/f101 x:0 0 0 2024-04-12T13:42:18.193 INFO:tasks.workunit.client.1.smithi110.stdout:2/834: write d6/dc/dd/dc6/fea [392553,122154] 0 2024-04-12T13:42:18.196 INFO:tasks.workunit.client.1.smithi110.stdout:6/776: creat d7/d10/d1c/d2b/d48/d54/ff5 x:0 0 0 2024-04-12T13:42:18.199 INFO:tasks.workunit.client.0.smithi060.stdout:0/722: rename d7/d9/d14/d35/d3c/f42 to d7/d33/d5b/ff6 0 2024-04-12T13:42:18.200 INFO:tasks.workunit.client.1.smithi110.stdout:7/830: dread d1/d3/d4/f1c [4194304,4194304] 0 2024-04-12T13:42:18.204 INFO:tasks.workunit.client.1.smithi110.stdout:0/730: creat d1/d56/f107 x:0 0 0 2024-04-12T13:42:18.204 INFO:tasks.workunit.client.0.smithi060.stdout:0/723: write d7/d9/d4c/f50 [4244544,126847] 0 2024-04-12T13:42:18.208 INFO:tasks.workunit.client.1.smithi110.stdout:2/835: chown d6/dc/d13/d80/d8d/dcc/ce6 5 1 2024-04-12T13:42:18.212 INFO:tasks.workunit.client.0.smithi060.stdout:7/729: dread d0/d7/f9d [0,4194304] 0 2024-04-12T13:42:18.213 INFO:tasks.workunit.client.1.smithi110.stdout:3/773: unlink d5/dc/d31/d3b/d32/ld2 0 2024-04-12T13:42:18.215 INFO:tasks.workunit.client.0.smithi060.stdout:2/785: dwrite d6/dae/d31/d33/f49 [0,4194304] 0 2024-04-12T13:42:18.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/755: creat d6/dd/d1f/d25/d53/d87/d7e/dca/ded/ffa x:0 0 0 2024-04-12T13:42:18.217 INFO:tasks.workunit.client.1.smithi110.stdout:7/831: dread d1/d3/d43/f7c [0,4194304] 0 2024-04-12T13:42:18.218 INFO:tasks.workunit.client.0.smithi060.stdout:3/784: dwrite d7/d17/d19/d33/d63/d9b/fd0 [0,4194304] 0 2024-04-12T13:42:18.221 INFO:tasks.workunit.client.0.smithi060.stdout:5/756: stat d6/dd/d1f/d25/ld2 0 2024-04-12T13:42:18.224 INFO:tasks.workunit.client.1.smithi110.stdout:2/836: dwrite d6/dc/dd/d49/d64/d4a/d3c/d6e/ff8 [0,4194304] 0 2024-04-12T13:42:18.226 INFO:tasks.workunit.client.0.smithi060.stdout:8/754: creat d9/d1b/d2b/d82/d8a/d103/f106 x:0 0 0 2024-04-12T13:42:18.226 INFO:tasks.workunit.client.0.smithi060.stdout:1/885: unlink d1e/d23/d2e/d5e/f133 0 2024-04-12T13:42:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:17 smithi110 ceph-mon[36055]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 189 MiB/s wr, 376 op/s 2024-04-12T13:42:18.230 INFO:tasks.workunit.client.1.smithi110.stdout:0/731: truncate d1/d27/d31/f64 176194 0 2024-04-12T13:42:18.233 INFO:tasks.workunit.client.1.smithi110.stdout:9/880: write df/d13/d2c/d2d/d94/ff8 [539397,9022] 0 2024-04-12T13:42:18.239 INFO:tasks.workunit.client.0.smithi060.stdout:0/724: unlink d7/d41/c9e 0 2024-04-12T13:42:18.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/795: dread d1/d7/da/dc/f3c [0,4194304] 0 2024-04-12T13:42:18.240 INFO:tasks.workunit.client.1.smithi110.stdout:8/824: write d1/d3/d3c/d5a/d6f/d7e/f93 [580086,101621] 0 2024-04-12T13:42:18.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/825: read - d1/d3/d3c/d75/ff7 zero size 2024-04-12T13:42:18.250 INFO:tasks.workunit.client.1.smithi110.stdout:1/797: dwrite de/d14/d34/d55/d6b/f77 [0,4194304] 0 2024-04-12T13:42:18.251 INFO:tasks.workunit.client.1.smithi110.stdout:0/732: truncate d1/d3c/da6/fcd 139784 0 2024-04-12T13:42:18.251 INFO:tasks.workunit.client.0.smithi060.stdout:6/796: write d1/d7/da/dc/d24/d34/d51/d59/d94/ffa [127004,110528] 0 2024-04-12T13:42:18.252 INFO:tasks.workunit.client.1.smithi110.stdout:7/832: mkdir d1/d3/d118 0 2024-04-12T13:42:18.252 INFO:tasks.workunit.client.0.smithi060.stdout:7/730: creat d0/d1b/da4/feb x:0 0 0 2024-04-12T13:42:18.257 INFO:tasks.workunit.client.1.smithi110.stdout:8/826: dread d1/d3/d3c/d5a/d6f/d7e/f93 [0,4194304] 0 2024-04-12T13:42:18.257 INFO:tasks.workunit.client.0.smithi060.stdout:5/757: fsync d6/dd/d1f/d32/d46/f93 0 2024-04-12T13:42:18.260 INFO:tasks.workunit.client.0.smithi060.stdout:1/886: fsync d1e/d23/d2e/f99 0 2024-04-12T13:42:18.260 INFO:tasks.workunit.client.1.smithi110.stdout:5/776: truncate da/d35/f75 3168857 0 2024-04-12T13:42:18.261 INFO:tasks.workunit.client.1.smithi110.stdout:6/777: dwrite d7/d25/d30/d44/d3d/f69 [0,4194304] 0 2024-04-12T13:42:18.262 INFO:tasks.workunit.client.0.smithi060.stdout:8/755: rename d9/d1b/d37/d4d/d63/d66/dd9/dfc/lcd to d9/d1b/d37/d48/l107 0 2024-04-12T13:42:18.266 INFO:tasks.workunit.client.1.smithi110.stdout:6/778: write d7/d25/d30/d44/f31 [553102,51829] 0 2024-04-12T13:42:18.266 INFO:tasks.workunit.client.1.smithi110.stdout:3/774: creat d5/dc/d20/d2d/d4e/d89/fed x:0 0 0 2024-04-12T13:42:18.269 INFO:tasks.workunit.client.1.smithi110.stdout:0/733: mkdir d1/d48/d108 0 2024-04-12T13:42:18.271 INFO:tasks.workunit.client.0.smithi060.stdout:6/797: symlink d1/d7/da/dc/d24/d34/d51/d97/da9/l101 0 2024-04-12T13:42:18.272 INFO:tasks.workunit.client.1.smithi110.stdout:7/833: dwrite d1/f28 [4194304,4194304] 0 2024-04-12T13:42:18.272 INFO:tasks.workunit.client.0.smithi060.stdout:5/758: dread - d6/f99 zero size 2024-04-12T13:42:18.276 INFO:tasks.workunit.client.0.smithi060.stdout:4/698: dwrite d6/d7/db/fb1 [0,4194304] 0 2024-04-12T13:42:18.277 INFO:tasks.workunit.client.1.smithi110.stdout:9/881: rename df/d13/d2c/d9e/la9 to df/d13/d2c/d9e/d107/l128 0 2024-04-12T13:42:18.280 INFO:tasks.workunit.client.1.smithi110.stdout:9/882: write df/d13/d2c/d2d/d39/d3a/f78 [797825,47900] 0 2024-04-12T13:42:18.280 INFO:tasks.workunit.client.0.smithi060.stdout:5/759: write d6/dd/d1f/d25/d42/d52/dc8/fe4 [1491307,62375] 0 2024-04-12T13:42:18.282 INFO:tasks.workunit.client.0.smithi060.stdout:0/725: mknod d7/d9/d14/d35/d44/d8c/d8d/de5/cf7 0 2024-04-12T13:42:18.284 INFO:tasks.workunit.client.1.smithi110.stdout:9/883: truncate df/d13/dca/f105 899883 0 2024-04-12T13:42:18.286 INFO:tasks.workunit.client.1.smithi110.stdout:9/884: dread - df/d13/d2c/d9e/f111 zero size 2024-04-12T13:42:18.287 INFO:tasks.workunit.client.1.smithi110.stdout:3/775: mknod d5/d86/cee 0 2024-04-12T13:42:18.290 INFO:tasks.workunit.client.1.smithi110.stdout:9/885: write df/d13/d2c/d2d/dc1/d83/d5d/d89/fb7 [807978,67678] 0 2024-04-12T13:42:18.296 INFO:tasks.workunit.client.0.smithi060.stdout:1/887: mkdir d1e/d46/d134 0 2024-04-12T13:42:18.304 INFO:tasks.workunit.client.0.smithi060.stdout:7/731: dread d0/f3a [4194304,4194304] 0 2024-04-12T13:42:18.309 INFO:tasks.workunit.client.0.smithi060.stdout:6/798: rename d1/d7/da/dc/f74 to d1/d7/da/dc/d24/d2d/db3/f102 0 2024-04-12T13:42:18.309 INFO:tasks.workunit.client.1.smithi110.stdout:4/891: sync 2024-04-12T13:42:18.310 INFO:tasks.workunit.client.1.smithi110.stdout:8/827: mkdir d1/d3/d35/d3a/d10d 0 2024-04-12T13:42:18.311 INFO:tasks.workunit.client.1.smithi110.stdout:4/892: chown d0/de/d2c/d57/la5 70649 1 2024-04-12T13:42:18.312 INFO:tasks.workunit.client.0.smithi060.stdout:9/684: truncate d4/d8/fb 496315 0 2024-04-12T13:42:18.312 INFO:tasks.workunit.client.0.smithi060.stdout:8/756: rmdir d9/d1b/d3c/d6e/d7b/db1/de5 39 2024-04-12T13:42:18.314 INFO:tasks.workunit.client.1.smithi110.stdout:0/734: unlink d1/d27/d31/d67/dcb/lf0 0 2024-04-12T13:42:18.315 INFO:tasks.workunit.client.0.smithi060.stdout:8/757: chown d9/d1b/d37/d4d/d63/d66/db3/c9b 113108 1 2024-04-12T13:42:18.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/699: unlink d6/d7/dd/df/f92 0 2024-04-12T13:42:18.318 INFO:tasks.workunit.client.0.smithi060.stdout:2/786: write d6/dae/d5b/d6d/f6e [1043350,129488] 0 2024-04-12T13:42:18.323 INFO:tasks.workunit.client.1.smithi110.stdout:5/777: getdents da/db/d3b/d40/d97/db6/dff 0 2024-04-12T13:42:18.324 INFO:tasks.workunit.client.1.smithi110.stdout:5/778: chown f9 207 1 2024-04-12T13:42:18.330 INFO:tasks.workunit.client.1.smithi110.stdout:3/776: creat d5/dc/da0/fef x:0 0 0 2024-04-12T13:42:18.334 INFO:tasks.workunit.client.0.smithi060.stdout:1/888: rename d1e/d23/d2e/f39 to d1e/d23/d2e/d30/d51/d12e/f135 0 2024-04-12T13:42:18.336 INFO:tasks.workunit.client.1.smithi110.stdout:9/886: truncate df/d13/d26/d37/fa4 646907 0 2024-04-12T13:42:18.337 INFO:tasks.workunit.client.0.smithi060.stdout:6/799: mkdir d1/d7/da/dc/d24/d30/d52/d78/d103 0 2024-04-12T13:42:18.343 INFO:tasks.workunit.client.1.smithi110.stdout:4/893: mkdir d0/de/da0/dd9/df3/de0/d7e/d125 0 2024-04-12T13:42:18.345 INFO:tasks.workunit.client.1.smithi110.stdout:4/894: chown d0/d75/d84/lcf 479179 1 2024-04-12T13:42:18.348 INFO:tasks.workunit.client.1.smithi110.stdout:3/777: dread d5/dc/d20/d2d/f3c [0,4194304] 0 2024-04-12T13:42:18.348 INFO:tasks.workunit.client.1.smithi110.stdout:6/779: write d7/d10/d1c/d2b/d48/f5e [1426517,111420] 0 2024-04-12T13:42:18.351 INFO:tasks.workunit.client.1.smithi110.stdout:2/837: sync 2024-04-12T13:42:18.353 INFO:tasks.workunit.client.0.smithi060.stdout:2/787: rename d6/d10 to d6/d64/d99/df0 0 2024-04-12T13:42:18.356 INFO:tasks.workunit.client.0.smithi060.stdout:9/685: creat d4/d33/d50/dd0/fe6 x:0 0 0 2024-04-12T13:42:18.359 INFO:tasks.workunit.client.1.smithi110.stdout:1/798: link de/d15/d32/d61/f102 de/d15/d32/d61/d6a/f10a 0 2024-04-12T13:42:18.362 INFO:tasks.workunit.client.0.smithi060.stdout:6/800: truncate d1/d7/da/dc/d24/d2d/f5a 2370468 0 2024-04-12T13:42:18.364 INFO:tasks.workunit.client.1.smithi110.stdout:8/828: mknod d1/d3/d35/d3a/d41/c10e 0 2024-04-12T13:42:18.364 INFO:tasks.workunit.client.1.smithi110.stdout:7/834: write d1/d3/d4/da6/fc4 [186753,65547] 0 2024-04-12T13:42:18.366 INFO:tasks.workunit.client.1.smithi110.stdout:9/887: dread df/d13/d2c/d9e/dd6/fc2 [0,4194304] 0 2024-04-12T13:42:18.367 INFO:tasks.workunit.client.0.smithi060.stdout:9/686: mkdir d4/d33/d65/de7 0 2024-04-12T13:42:18.368 INFO:tasks.workunit.client.1.smithi110.stdout:5/779: dread da/d2e/d45/d25/d9d/d79/d88/f8c [0,4194304] 0 2024-04-12T13:42:18.369 INFO:tasks.workunit.client.0.smithi060.stdout:2/788: dread d6/dae/d31/d33/f6a [0,4194304] 0 2024-04-12T13:42:18.369 INFO:tasks.workunit.client.1.smithi110.stdout:4/895: truncate d0/d75/f9a 1320734 0 2024-04-12T13:42:18.370 INFO:tasks.workunit.client.0.smithi060.stdout:4/700: link d6/la6 d6/d2f/d7d/le7 0 2024-04-12T13:42:18.370 INFO:tasks.workunit.client.1.smithi110.stdout:3/778: dread d5/dc/d31/d74/f62 [0,4194304] 0 2024-04-12T13:42:18.372 INFO:tasks.workunit.client.0.smithi060.stdout:5/760: getdents d6/dd/d1f/dd3 0 2024-04-12T13:42:18.373 INFO:tasks.workunit.client.1.smithi110.stdout:6/780: symlink d7/d25/d30/d44/da3/lf6 0 2024-04-12T13:42:18.376 INFO:tasks.workunit.client.0.smithi060.stdout:0/726: dwrite d7/d41/f61 [0,4194304] 0 2024-04-12T13:42:18.376 INFO:tasks.workunit.client.0.smithi060.stdout:2/789: dread d6/d64/d99/df0/d2b/d60/fa2 [0,4194304] 0 2024-04-12T13:42:18.377 INFO:tasks.workunit.client.0.smithi060.stdout:6/801: creat d1/d7/da/dc/dac/f104 x:0 0 0 2024-04-12T13:42:18.382 INFO:tasks.workunit.client.0.smithi060.stdout:2/790: read d6/d56/d58/da0/f3c [1026146,28728] 0 2024-04-12T13:42:18.387 INFO:tasks.workunit.client.0.smithi060.stdout:7/732: dwrite d0/d78/f84 [0,4194304] 0 2024-04-12T13:42:18.389 INFO:tasks.workunit.client.1.smithi110.stdout:0/735: write d1/d8/d8a/f9e [139768,33849] 0 2024-04-12T13:42:18.391 INFO:tasks.workunit.client.0.smithi060.stdout:7/733: stat d0/d78/da0/fb8 0 2024-04-12T13:42:18.392 INFO:tasks.workunit.client.0.smithi060.stdout:5/761: creat d6/dd/d1f/d25/d53/d87/ffb x:0 0 0 2024-04-12T13:42:18.393 INFO:tasks.workunit.client.1.smithi110.stdout:8/829: rmdir d1/d3/d35/d3a/d3e/d64/d85 39 2024-04-12T13:42:18.398 INFO:tasks.workunit.client.1.smithi110.stdout:9/888: mknod df/d13/d2c/d2d/d39/c129 0 2024-04-12T13:42:18.399 INFO:tasks.workunit.client.0.smithi060.stdout:4/701: dwrite d6/d21/d88/fd6 [0,4194304] 0 2024-04-12T13:42:18.400 INFO:tasks.workunit.client.0.smithi060.stdout:0/727: mkdir d7/d33/d88/df8 0 2024-04-12T13:42:18.405 INFO:tasks.workunit.client.1.smithi110.stdout:5/780: dread da/d2e/d45/f6f [0,4194304] 0 2024-04-12T13:42:18.412 INFO:tasks.workunit.client.1.smithi110.stdout:4/896: mknod d0/de/da0/dd9/c126 0 2024-04-12T13:42:18.414 INFO:tasks.workunit.client.0.smithi060.stdout:6/802: symlink d1/d7/da/dc/d24/d34/d51/d97/da9/l105 0 2024-04-12T13:42:18.419 INFO:tasks.workunit.client.1.smithi110.stdout:6/781: symlink d7/d25/d30/d44/d3d/lf7 0 2024-04-12T13:42:18.420 INFO:tasks.workunit.client.0.smithi060.stdout:6/803: truncate d1/d7/da/ff 5229622 0 2024-04-12T13:42:18.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/728: dwrite d7/d9/d14/d35/d44/d7d/fc5 [0,4194304] 0 2024-04-12T13:42:18.425 INFO:tasks.workunit.client.1.smithi110.stdout:1/799: symlink de/d14/d34/d55/ddc/l10b 0 2024-04-12T13:42:18.428 INFO:tasks.workunit.client.0.smithi060.stdout:7/734: rename d0/c28 to d0/d7/d43/d4d/cec 0 2024-04-12T13:42:18.431 INFO:tasks.workunit.client.1.smithi110.stdout:7/835: read d1/d3/d4/d36/f3a [952163,63410] 0 2024-04-12T13:42:18.434 INFO:tasks.workunit.client.0.smithi060.stdout:1/889: truncate d1e/d23/d2e/d5e/d68/fbb 161593 0 2024-04-12T13:42:18.437 INFO:tasks.workunit.client.1.smithi110.stdout:9/889: truncate df/d13/d3b/d40/d56/fbc 745556 0 2024-04-12T13:42:18.440 INFO:tasks.workunit.client.1.smithi110.stdout:3/779: dread d5/dc/d31/d3b/d32/d3e/f44 [0,4194304] 0 2024-04-12T13:42:18.441 INFO:tasks.workunit.client.1.smithi110.stdout:9/890: dread df/d13/d2c/d2d/d39/f44 [0,4194304] 0 2024-04-12T13:42:18.442 INFO:tasks.workunit.client.0.smithi060.stdout:1/890: dread d1e/d29/d65/ff3 [0,4194304] 0 2024-04-12T13:42:18.443 INFO:tasks.workunit.client.0.smithi060.stdout:9/687: dwrite d4/d8/d32/f78 [0,4194304] 0 2024-04-12T13:42:18.443 INFO:tasks.workunit.client.1.smithi110.stdout:4/897: creat d0/de/da0/dd9/df3/de0/d7e/daa/dcd/f127 x:0 0 0 2024-04-12T13:42:18.444 INFO:tasks.workunit.client.1.smithi110.stdout:1/800: dwrite de/d15/fed [0,4194304] 0 2024-04-12T13:42:18.444 INFO:tasks.workunit.client.1.smithi110.stdout:9/891: dread - df/d13/d3b/d40/d56/fd5 zero size 2024-04-12T13:42:18.450 INFO:tasks.workunit.client.0.smithi060.stdout:6/804: truncate d1/d2c/fae 2621863 0 2024-04-12T13:42:18.450 INFO:tasks.workunit.client.0.smithi060.stdout:1/891: chown d1e/d1f/f7b 144824 1 2024-04-12T13:42:18.451 INFO:tasks.workunit.client.0.smithi060.stdout:5/762: rename d6/dd/d1f/d32 to d6/d10/db8/dee/dfc 0 2024-04-12T13:42:18.454 INFO:tasks.workunit.client.1.smithi110.stdout:2/838: mkdir d6/dc/d1b/d57/d62/dcb/dd8/d102 0 2024-04-12T13:42:18.458 INFO:tasks.workunit.client.0.smithi060.stdout:7/735: creat d0/d3d/d74/fed x:0 0 0 2024-04-12T13:42:18.462 INFO:tasks.workunit.client.1.smithi110.stdout:0/736: mkdir d1/d56/deb/d109 0 2024-04-12T13:42:18.463 INFO:tasks.workunit.client.0.smithi060.stdout:9/688: dread d4/d8/f40 [0,4194304] 0 2024-04-12T13:42:18.463 INFO:tasks.workunit.client.0.smithi060.stdout:4/702: symlink d6/d7/dd/d1a/dde/le8 0 2024-04-12T13:42:18.464 INFO:tasks.workunit.client.1.smithi110.stdout:0/737: chown d1/d48/l7f 132758642 1 2024-04-12T13:42:18.464 INFO:tasks.workunit.client.0.smithi060.stdout:9/689: fdatasync d4/f2d 0 2024-04-12T13:42:18.466 INFO:tasks.workunit.client.0.smithi060.stdout:9/690: fdatasync d4/d8/fa 0 2024-04-12T13:42:18.467 INFO:tasks.workunit.client.1.smithi110.stdout:7/836: fsync d1/d3/f4c 0 2024-04-12T13:42:18.469 INFO:tasks.workunit.client.1.smithi110.stdout:5/781: mknod da/d2e/d45/d29/c10e 0 2024-04-12T13:42:18.472 INFO:tasks.workunit.client.1.smithi110.stdout:3/780: symlink d5/dc/d31/d74/d75/lf0 0 2024-04-12T13:42:18.472 INFO:tasks.workunit.client.1.smithi110.stdout:5/782: stat da/d2e/d45/d25/d9d/d79/d9e/fd5 0 2024-04-12T13:42:18.475 INFO:tasks.workunit.client.0.smithi060.stdout:9/691: dread d4/d9/d19/d21/d73/fb5 [0,4194304] 0 2024-04-12T13:42:18.478 INFO:tasks.workunit.client.1.smithi110.stdout:0/738: dwrite d1/fd9 [0,4194304] 0 2024-04-12T13:42:18.484 INFO:tasks.workunit.client.1.smithi110.stdout:2/839: mkdir d6/dc/dd/d49/d64/d25/d103 0 2024-04-12T13:42:18.486 INFO:tasks.workunit.client.1.smithi110.stdout:5/783: dread da/d2e/d45/d29/d32/f36 [0,4194304] 0 2024-04-12T13:42:18.493 INFO:tasks.workunit.client.1.smithi110.stdout:3/781: dread - d5/dc/d31/d3b/d5b/f96 zero size 2024-04-12T13:42:18.494 INFO:tasks.workunit.client.0.smithi060.stdout:9/692: mkdir d4/d9/dbd/de8 0 2024-04-12T13:42:18.498 INFO:tasks.workunit.client.1.smithi110.stdout:4/898: dwrite d0/d19/f85 [4194304,4194304] 0 2024-04-12T13:42:18.506 INFO:tasks.workunit.client.1.smithi110.stdout:8/830: getdents d1/d3/d3c/d5a/d6f/d83 0 2024-04-12T13:42:18.508 INFO:tasks.workunit.client.1.smithi110.stdout:8/831: readlink d1/d3/d35/d3a/d3e/d64/le6 0 2024-04-12T13:42:18.509 INFO:tasks.workunit.client.0.smithi060.stdout:4/703: dread d6/d7/db/f4b [0,4194304] 0 2024-04-12T13:42:18.510 INFO:tasks.workunit.client.0.smithi060.stdout:5/763: rename d6/dd/d1f/d25/d42/d52/dc8/fe4 to d6/dd/d1f/dd3/df3/ffd 0 2024-04-12T13:42:18.516 INFO:tasks.workunit.client.1.smithi110.stdout:5/784: creat da/db/d3b/d40/d97/db6/f10f x:0 0 0 2024-04-12T13:42:18.517 INFO:tasks.workunit.client.0.smithi060.stdout:7/736: creat d0/d7/d43/d63/fee x:0 0 0 2024-04-12T13:42:18.520 INFO:tasks.workunit.client.0.smithi060.stdout:5/764: chown d6/dd/d1f/d25/d42/d52/d7a/fa4 1500768 1 2024-04-12T13:42:18.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/892: dwrite d1e/d23/d2e/d30/d51/d85/fd2 [0,4194304] 0 2024-04-12T13:42:18.521 INFO:tasks.workunit.client.1.smithi110.stdout:7/837: mknod d1/d3/d4/d55/d56/d72/dad/d10c/c119 0 2024-04-12T13:42:18.524 INFO:tasks.workunit.client.1.smithi110.stdout:3/782: unlink d5/d86/cb9 0 2024-04-12T13:42:18.524 INFO:tasks.workunit.client.0.smithi060.stdout:6/805: dwrite d1/d7/da/dc/f19 [0,4194304] 0 2024-04-12T13:42:18.525 INFO:tasks.workunit.client.1.smithi110.stdout:1/801: creat de/d15/d32/d61/d6a/dac/dc0/dea/f10c x:0 0 0 2024-04-12T13:42:18.527 INFO:tasks.workunit.client.1.smithi110.stdout:4/899: creat d0/d78/f128 x:0 0 0 2024-04-12T13:42:18.529 INFO:tasks.workunit.client.0.smithi060.stdout:7/737: mknod d0/d7/da9/cef 0 2024-04-12T13:42:18.529 INFO:tasks.workunit.client.0.smithi060.stdout:4/704: truncate d6/d7/dd/d1a/f50 7256584 0 2024-04-12T13:42:18.529 INFO:tasks.workunit.client.1.smithi110.stdout:6/782: getdents d7/d10 0 2024-04-12T13:42:18.530 INFO:tasks.workunit.client.0.smithi060.stdout:6/806: chown d1/d7/da/d20/f50 506641 1 2024-04-12T13:42:18.530 INFO:tasks.workunit.client.0.smithi060.stdout:4/705: chown d6/f70 254127 1 2024-04-12T13:42:18.531 INFO:tasks.workunit.client.1.smithi110.stdout:0/739: symlink d1/d56/deb/d109/l10a 0 2024-04-12T13:42:18.531 INFO:tasks.workunit.client.0.smithi060.stdout:9/693: creat d4/d9/d19/d21/fe9 x:0 0 0 2024-04-12T13:42:18.537 INFO:tasks.workunit.client.0.smithi060.stdout:4/706: write d6/d7/dd/d1a/d19/d42/d7c/fdd [309643,73943] 0 2024-04-12T13:42:18.537 INFO:tasks.workunit.client.0.smithi060.stdout:5/765: truncate d6/dd/d1f/dd3/df3/f9f 148505 0 2024-04-12T13:42:18.538 INFO:tasks.workunit.client.1.smithi110.stdout:8/832: creat d1/d3/d3c/d5a/d6f/d83/f10f x:0 0 0 2024-04-12T13:42:18.538 INFO:tasks.workunit.client.1.smithi110.stdout:0/740: read d1/d5e/fb3 [65114,32661] 0 2024-04-12T13:42:18.539 INFO:tasks.workunit.client.0.smithi060.stdout:4/707: fdatasync d6/d7/db/fb1 0 2024-04-12T13:42:18.539 INFO:tasks.workunit.client.1.smithi110.stdout:0/741: chown d1/fe3 1483164 1 2024-04-12T13:42:18.540 INFO:tasks.workunit.client.1.smithi110.stdout:2/840: dwrite d6/dc/d13/d80/d8d/dcc/d82/d84/fb3 [0,4194304] 0 2024-04-12T13:42:18.543 INFO:tasks.workunit.client.0.smithi060.stdout:9/694: symlink d4/d9/d19/db1/lea 0 2024-04-12T13:42:18.544 INFO:tasks.workunit.client.1.smithi110.stdout:3/783: mkdir d5/d86/df1 0 2024-04-12T13:42:18.544 INFO:tasks.workunit.client.1.smithi110.stdout:6/783: mkdir d7/da4/df8 0 2024-04-12T13:42:18.544 INFO:tasks.workunit.client.1.smithi110.stdout:2/841: chown d6/dc/dd/d49/d64/d25 1392 1 2024-04-12T13:42:18.545 INFO:tasks.workunit.client.0.smithi060.stdout:1/893: fsync d1e/d46/f48 0 2024-04-12T13:42:18.546 INFO:tasks.workunit.client.1.smithi110.stdout:6/784: stat d7/d10/d1c/d2b/d3a 0 2024-04-12T13:42:18.547 INFO:tasks.workunit.client.1.smithi110.stdout:9/892: getdents df/d13/d2c/d2d/d39/d3a 0 2024-04-12T13:42:18.550 INFO:tasks.workunit.client.1.smithi110.stdout:9/893: write df/d13/d2c/d2d/dc1/d83/d5d/f7e [4212403,63993] 0 2024-04-12T13:42:18.554 INFO:tasks.workunit.client.1.smithi110.stdout:8/833: fsync d1/d5/dd/d31/dba/fd8 0 2024-04-12T13:42:18.559 INFO:tasks.workunit.client.1.smithi110.stdout:7/838: write d1/d1b/fbe [1185288,111704] 0 2024-04-12T13:42:18.563 INFO:tasks.workunit.client.1.smithi110.stdout:2/842: dwrite d6/dc/dd/f47 [0,4194304] 0 2024-04-12T13:42:18.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/738: rmdir d0/d7/dc5 0 2024-04-12T13:42:18.567 INFO:tasks.workunit.client.1.smithi110.stdout:3/784: mknod d5/dc/d20/cf2 0 2024-04-12T13:42:18.570 INFO:tasks.workunit.client.1.smithi110.stdout:1/802: link de/d15/dab/dd8/dd9/dda/f7d de/d14/d34/d55/d6b/f10d 0 2024-04-12T13:42:18.573 INFO:tasks.workunit.client.0.smithi060.stdout:6/807: creat d1/d7/da/dc/d24/d34/f106 x:0 0 0 2024-04-12T13:42:18.574 INFO:tasks.workunit.client.1.smithi110.stdout:6/785: read d7/f1a [7412885,66478] 0 2024-04-12T13:42:18.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/695: write d4/d9/f97 [1341868,48862] 0 2024-04-12T13:42:18.581 INFO:tasks.workunit.client.1.smithi110.stdout:9/894: creat df/d13/d2c/d2d/dc1/d83/d5d/d89/f12a x:0 0 0 2024-04-12T13:42:18.583 INFO:tasks.workunit.client.0.smithi060.stdout:1/894: mkdir d1e/d23/d136 0 2024-04-12T13:42:18.584 INFO:tasks.workunit.client.1.smithi110.stdout:5/785: dwrite da/f6b [0,4194304] 0 2024-04-12T13:42:18.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/766: dwrite d6/d10/db8/dee/dfc/d46/f82 [0,4194304] 0 2024-04-12T13:42:18.587 INFO:tasks.workunit.client.1.smithi110.stdout:0/742: mkdir d1/d27/d31/d67/d10b 0 2024-04-12T13:42:18.587 INFO:tasks.workunit.client.0.smithi060.stdout:1/895: stat d1e/d23/d49/d4e/d9b/lcb 0 2024-04-12T13:42:18.588 INFO:tasks.workunit.client.0.smithi060.stdout:6/808: fsync d1/fa0 0 2024-04-12T13:42:18.590 INFO:tasks.workunit.client.0.smithi060.stdout:9/696: mknod d4/d9/d19/d21/d73/ceb 0 2024-04-12T13:42:18.591 INFO:tasks.workunit.client.1.smithi110.stdout:2/843: dread d6/dc/dd/d49/d64/d4a/f5b [0,4194304] 0 2024-04-12T13:42:18.591 INFO:tasks.workunit.client.1.smithi110.stdout:7/839: creat d1/d31/d7b/f11a x:0 0 0 2024-04-12T13:42:18.591 INFO:tasks.workunit.client.0.smithi060.stdout:9/697: chown d4/d8/f3b 493678751 1 2024-04-12T13:42:18.591 INFO:tasks.workunit.client.0.smithi060.stdout:4/708: write d6/d7/dd/d1a/f50 [3275978,115325] 0 2024-04-12T13:42:18.594 INFO:tasks.workunit.client.1.smithi110.stdout:4/900: link d0/de/d32/f8c d0/d19/d1c/d50/d6f/db9/f129 0 2024-04-12T13:42:18.597 INFO:tasks.workunit.client.1.smithi110.stdout:3/785: mknod d5/dc/d31/d3b/d32/d3e/d98/cf3 0 2024-04-12T13:42:18.598 INFO:tasks.workunit.client.0.smithi060.stdout:5/767: mknod d6/d10/db8/dee/dfc/d3d/cfe 0 2024-04-12T13:42:18.601 INFO:tasks.workunit.client.1.smithi110.stdout:1/803: mkdir de/d14/d34/d108/d10e 0 2024-04-12T13:42:18.603 INFO:tasks.workunit.client.0.smithi060.stdout:7/739: dread d0/d1b/f48 [0,4194304] 0 2024-04-12T13:42:18.605 INFO:tasks.workunit.client.1.smithi110.stdout:6/786: truncate d7/d10/d1c/f29 7761800 0 2024-04-12T13:42:18.606 INFO:tasks.workunit.client.1.smithi110.stdout:9/895: dwrite df/d13/d2c/d9e/dd6/f96 [0,4194304] 0 2024-04-12T13:42:18.608 INFO:tasks.workunit.client.1.smithi110.stdout:5/786: dwrite da/d2e/d45/d25/d9d/d79/d88/dd3/fd8 [0,4194304] 0 2024-04-12T13:42:18.609 INFO:tasks.workunit.client.1.smithi110.stdout:9/896: chown df/d13/d26/d37/d6a/fec 3 1 2024-04-12T13:42:18.614 INFO:tasks.workunit.client.0.smithi060.stdout:6/809: mknod d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/c107 0 2024-04-12T13:42:18.619 INFO:tasks.workunit.client.0.smithi060.stdout:4/709: creat d6/d7/dd/d1a/d19/d7a/fe9 x:0 0 0 2024-04-12T13:42:18.622 INFO:tasks.workunit.client.0.smithi060.stdout:5/768: creat d6/dd/d1f/dd3/d5f/fff x:0 0 0 2024-04-12T13:42:18.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/896: dread d1e/d23/d2e/d30/fda [0,4194304] 0 2024-04-12T13:42:18.627 INFO:tasks.workunit.client.1.smithi110.stdout:7/840: rename d1/d3/d4/d55/d56/fd9 to d1/d1b/d3d/d68/f11b 0 2024-04-12T13:42:18.628 INFO:tasks.workunit.client.1.smithi110.stdout:0/743: creat d1/d5e/f10c x:0 0 0 2024-04-12T13:42:18.630 INFO:tasks.workunit.client.1.smithi110.stdout:2/844: rmdir d6/dc/d1b/d57/d62/dcb 39 2024-04-12T13:42:18.633 INFO:tasks.workunit.client.1.smithi110.stdout:4/901: truncate d0/de/f36 3722693 0 2024-04-12T13:42:18.636 INFO:tasks.workunit.client.1.smithi110.stdout:3/786: creat d5/dc/d31/d74/d75/ff4 x:0 0 0 2024-04-12T13:42:18.645 INFO:tasks.workunit.client.1.smithi110.stdout:8/834: truncate d1/d3/fe 3885001 0 2024-04-12T13:42:18.646 INFO:tasks.workunit.client.1.smithi110.stdout:9/897: creat df/d13/d2c/d9e/d107/f12b x:0 0 0 2024-04-12T13:42:18.646 INFO:tasks.workunit.client.1.smithi110.stdout:6/787: truncate d7/d10/d1c/d2b/d48/d54/f5d 4999602 0 2024-04-12T13:42:18.648 INFO:tasks.workunit.client.1.smithi110.stdout:6/788: stat d7/d10/d1c/d2b/d3a/f81 0 2024-04-12T13:42:18.648 INFO:tasks.workunit.client.1.smithi110.stdout:7/841: creat d1/d1b/d3d/d68/f11c x:0 0 0 2024-04-12T13:42:18.649 INFO:tasks.workunit.client.1.smithi110.stdout:0/744: mknod d1/d56/c10d 0 2024-04-12T13:42:18.650 INFO:tasks.workunit.client.1.smithi110.stdout:2/845: fdatasync d6/dc/dd/d49/d64/d4a/d51/f78 0 2024-04-12T13:42:18.650 INFO:tasks.workunit.client.1.smithi110.stdout:0/745: fdatasync d1/d8/d8a/f101 0 2024-04-12T13:42:18.652 INFO:tasks.workunit.client.1.smithi110.stdout:2/846: stat d6/dc/d1b/d57/c83 0 2024-04-12T13:42:18.652 INFO:tasks.workunit.client.1.smithi110.stdout:7/842: write d1/d3/d4/d55/d56/d72/de0/f3b [1761145,89769] 0 2024-04-12T13:42:18.653 INFO:tasks.workunit.client.1.smithi110.stdout:3/787: mkdir d5/dc/d31/d3b/d5b/df5 0 2024-04-12T13:42:18.657 INFO:tasks.workunit.client.1.smithi110.stdout:5/787: fdatasync da/f11 0 2024-04-12T13:42:18.663 INFO:tasks.workunit.client.1.smithi110.stdout:5/788: chown da/db/l1c 13952074 1 2024-04-12T13:42:18.663 INFO:tasks.workunit.client.1.smithi110.stdout:4/902: creat d0/de/da0/dd9/df3/de0/d7e/d125/f12a x:0 0 0 2024-04-12T13:42:18.665 INFO:tasks.workunit.client.1.smithi110.stdout:1/804: rename de/d1d/l95 to de/d15/d32/d61/d6a/dac/dc0/l10f 0 2024-04-12T13:42:18.667 INFO:tasks.workunit.client.1.smithi110.stdout:2/847: truncate d6/dc/d13/d80/d8d/dcc/f68 4574270 0 2024-04-12T13:42:18.669 INFO:tasks.workunit.client.1.smithi110.stdout:8/835: creat d1/d3/d35/d3a/d3e/d64/d85/dc2/f110 x:0 0 0 2024-04-12T13:42:18.670 INFO:tasks.workunit.client.1.smithi110.stdout:3/788: truncate d5/dc/d20/d2d/d4e/d89/d8c/fb2 208301 0 2024-04-12T13:42:18.670 INFO:tasks.workunit.client.1.smithi110.stdout:2/848: readlink d6/dc/dd/l4c 0 2024-04-12T13:42:18.670 INFO:tasks.workunit.client.1.smithi110.stdout:4/903: read d0/de/d2c/f2b [1614482,58927] 0 2024-04-12T13:42:18.672 INFO:tasks.workunit.client.1.smithi110.stdout:5/789: creat da/d2e/d45/d29/d105/f110 x:0 0 0 2024-04-12T13:42:18.673 INFO:tasks.workunit.client.1.smithi110.stdout:6/789: dwrite d7/d25/d30/d44/fe9 [0,4194304] 0 2024-04-12T13:42:18.682 INFO:tasks.workunit.client.1.smithi110.stdout:6/790: write d7/d10/d7e/fe3 [918231,53725] 0 2024-04-12T13:42:18.682 INFO:tasks.workunit.client.1.smithi110.stdout:0/746: dwrite d1/d3c/dd8/df6/ffb [0,4194304] 0 2024-04-12T13:42:18.682 INFO:tasks.workunit.client.1.smithi110.stdout:7/843: getdents d1/d3/d4/d55/d56/d72/de0 0 2024-04-12T13:42:18.682 INFO:tasks.workunit.client.1.smithi110.stdout:6/791: stat d7/d10/d1c/d7f/l8c 0 2024-04-12T13:42:18.687 INFO:tasks.workunit.client.1.smithi110.stdout:9/898: dwrite df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [0,4194304] 0 2024-04-12T13:42:18.710 INFO:tasks.workunit.client.0.smithi060.stdout:9/698: creat d4/fec x:0 0 0 2024-04-12T13:42:18.710 INFO:tasks.workunit.client.0.smithi060.stdout:5/769: rename d6/dd/d1f/dd3/d5f/fff to d6/dd/d1f/d25/d42/d52/dc8/f100 0 2024-04-12T13:42:18.717 INFO:tasks.workunit.client.0.smithi060.stdout:6/810: link d1/d2c/fae d1/d2c/f108 0 2024-04-12T13:42:18.717 INFO:tasks.workunit.client.0.smithi060.stdout:9/699: creat d4/d9/d19/d21/d73/d67/fed x:0 0 0 2024-04-12T13:42:18.718 INFO:tasks.workunit.client.0.smithi060.stdout:1/897: mknod d1e/d23/d2e/d86/ddb/c137 0 2024-04-12T13:42:18.723 INFO:tasks.workunit.client.0.smithi060.stdout:6/811: mknod d1/d7/da/dc/d24/d2d/db3/c109 0 2024-04-12T13:42:18.724 INFO:tasks.workunit.client.0.smithi060.stdout:1/898: rmdir d1e/d23/d49 39 2024-04-12T13:42:18.729 INFO:tasks.workunit.client.1.smithi110.stdout:6/792: rename d7 to d7/d25/df9 22 2024-04-12T13:42:18.730 INFO:tasks.workunit.client.1.smithi110.stdout:4/904: write d0/d19/d26/fbe [642313,124089] 0 2024-04-12T13:42:18.730 INFO:tasks.workunit.client.0.smithi060.stdout:6/812: chown d1/d7/da/dc/d24/d30/d52/d78/d80/l92 22 1 2024-04-12T13:42:18.730 INFO:tasks.workunit.client.0.smithi060.stdout:4/710: dread d6/d7/dd/df/f93 [0,4194304] 0 2024-04-12T13:42:18.734 INFO:tasks.workunit.client.0.smithi060.stdout:5/770: dwrite d6/dd/d1f/dd3/de7/faf [0,4194304] 0 2024-04-12T13:42:18.736 INFO:tasks.workunit.client.1.smithi110.stdout:0/747: creat d1/d8/d36/d51/df8/f10e x:0 0 0 2024-04-12T13:42:18.737 INFO:tasks.workunit.client.0.smithi060.stdout:1/899: truncate d1e/d23/d2e/d30/f5c 717151 0 2024-04-12T13:42:18.737 INFO:tasks.workunit.client.1.smithi110.stdout:3/789: getdents d5/dc/d31/d3b/d32/d3e/d5f/dbd 0 2024-04-12T13:42:18.741 INFO:tasks.workunit.client.0.smithi060.stdout:6/813: chown d1/d7/da/dc/d24/d30/d52/d5e/l76 0 1 2024-04-12T13:42:18.741 INFO:tasks.workunit.client.0.smithi060.stdout:1/900: dread - d1e/d29/f109 zero size 2024-04-12T13:42:18.741 INFO:tasks.workunit.client.1.smithi110.stdout:4/905: mknod d0/de/da0/d111/c12b 0 2024-04-12T13:42:18.742 INFO:tasks.workunit.client.0.smithi060.stdout:5/771: chown d6/dd/d27/d7d/lf1 427400421 1 2024-04-12T13:42:18.742 INFO:tasks.workunit.client.1.smithi110.stdout:9/899: dread df/d38/f95 [0,4194304] 0 2024-04-12T13:42:18.744 INFO:tasks.workunit.client.1.smithi110.stdout:3/790: chown d5/d86/fb5 164 1 2024-04-12T13:42:18.744 INFO:tasks.workunit.client.1.smithi110.stdout:1/805: dwrite de/d15/d32/d61/f107 [0,4194304] 0 2024-04-12T13:42:18.747 INFO:tasks.workunit.client.0.smithi060.stdout:9/700: dwrite d4/fa1 [0,4194304] 0 2024-04-12T13:42:18.748 INFO:tasks.workunit.client.0.smithi060.stdout:4/711: write d6/d7/dd/f91 [978245,92299] 0 2024-04-12T13:42:18.749 INFO:tasks.workunit.client.1.smithi110.stdout:2/849: dwrite d6/dc/dd/d49/d64/fca [0,4194304] 0 2024-04-12T13:42:18.749 INFO:tasks.workunit.client.1.smithi110.stdout:9/900: write df/d13/d2c/d2d/dd3/ffb [4636521,8358] 0 2024-04-12T13:42:18.754 INFO:tasks.workunit.client.0.smithi060.stdout:1/901: creat d1e/d29/d65/de7/f138 x:0 0 0 2024-04-12T13:42:18.765 INFO:tasks.workunit.client.1.smithi110.stdout:4/906: fdatasync d0/d19/d1c/d50/d6f/fae 0 2024-04-12T13:42:18.771 INFO:tasks.workunit.client.0.smithi060.stdout:4/712: creat d6/d7/dd/d1a/d19/dad/fea x:0 0 0 2024-04-12T13:42:18.772 INFO:tasks.workunit.client.0.smithi060.stdout:6/814: dread d1/d2c/fae [0,4194304] 0 2024-04-12T13:42:18.775 INFO:tasks.workunit.client.0.smithi060.stdout:5/772: rename d6/f17 to d6/dd/d1f/d25/d42/d52/f101 0 2024-04-12T13:42:18.781 INFO:tasks.workunit.client.0.smithi060.stdout:6/815: symlink d1/d7/da/dc/l10a 0 2024-04-12T13:42:18.784 INFO:tasks.workunit.client.0.smithi060.stdout:1/902: rename d1e/d46/f6f to d1e/d29/d6d/f139 0 2024-04-12T13:42:18.788 INFO:tasks.workunit.client.0.smithi060.stdout:6/816: mkdir d1/d7/da/dc/d24/d2d/d10b 0 2024-04-12T13:42:18.790 INFO:tasks.workunit.client.0.smithi060.stdout:1/903: chown d1e/d23/d2e/d5e/df0/l114 1964601 1 2024-04-12T13:42:18.792 INFO:tasks.workunit.client.0.smithi060.stdout:4/713: dwrite d6/d7/dd/df/f18 [0,4194304] 0 2024-04-12T13:42:18.795 INFO:tasks.workunit.client.0.smithi060.stdout:9/701: dread d4/d8/f2e [0,4194304] 0 2024-04-12T13:42:18.795 INFO:tasks.workunit.client.1.smithi110.stdout:2/850: rmdir d6/dc/dd/d49/d64/d25/db0 39 2024-04-12T13:42:18.796 INFO:tasks.workunit.client.1.smithi110.stdout:3/791: rename d5/dc/d31/d74/d75/lf0 to d5/dc/d20/lf6 0 2024-04-12T13:42:18.797 INFO:tasks.workunit.client.0.smithi060.stdout:9/702: read - d4/d9/d19/d21/fe9 zero size 2024-04-12T13:42:18.797 INFO:tasks.workunit.client.1.smithi110.stdout:7/844: link d1/d3/d4/d55/d82/db5/f104 d1/d3/d4/d55/d56/d72/dad/d10c/f11d 0 2024-04-12T13:42:18.799 INFO:tasks.workunit.client.0.smithi060.stdout:4/714: fsync d6/d7/db/f8e 0 2024-04-12T13:42:18.799 INFO:tasks.workunit.client.0.smithi060.stdout:5/773: dwrite d6/dd/d1f/d25/d42/d52/dc8/f100 [0,4194304] 0 2024-04-12T13:42:18.802 INFO:tasks.workunit.client.0.smithi060.stdout:5/774: stat d6/dd/d27/df4 0 2024-04-12T13:42:18.803 INFO:tasks.workunit.client.0.smithi060.stdout:1/904: mknod d1e/d94/dd4/c13a 0 2024-04-12T13:42:18.805 INFO:tasks.workunit.client.0.smithi060.stdout:1/905: readlink d1e/d23/d2e/d30/l10f 0 2024-04-12T13:42:18.805 INFO:tasks.workunit.client.0.smithi060.stdout:9/703: dread - d4/d33/d65/d7a/fb3 zero size 2024-04-12T13:42:18.806 INFO:tasks.workunit.client.1.smithi110.stdout:2/851: chown d6/dc/dd/dc6/fd1 391431 1 2024-04-12T13:42:18.806 INFO:tasks.workunit.client.1.smithi110.stdout:4/907: read d0/d75/f9a [1259972,89079] 0 2024-04-12T13:42:18.809 INFO:tasks.workunit.client.1.smithi110.stdout:6/793: dwrite d7/d25/d30/d44/d3d/fc8 [0,4194304] 0 2024-04-12T13:42:18.811 INFO:tasks.workunit.client.0.smithi060.stdout:1/906: read d1e/d29/d65/f7a [1507945,65927] 0 2024-04-12T13:42:18.815 INFO:tasks.workunit.client.1.smithi110.stdout:3/792: rmdir d5/dc/d20/d2d/d4e/d89/d8c/dc5 39 2024-04-12T13:42:18.816 INFO:tasks.workunit.client.1.smithi110.stdout:6/794: chown d7/d10/d1c/d2b/d3a/dbf/de2 24134 1 2024-04-12T13:42:18.816 INFO:tasks.workunit.client.1.smithi110.stdout:9/901: dwrite df/d38/f102 [0,4194304] 0 2024-04-12T13:42:18.818 INFO:tasks.workunit.client.1.smithi110.stdout:0/748: dwrite d1/d27/d6e/fcf [4194304,4194304] 0 2024-04-12T13:42:18.819 INFO:tasks.workunit.client.0.smithi060.stdout:1/907: unlink d1e/d29/d65/cd3 0 2024-04-12T13:42:18.819 INFO:tasks.workunit.client.1.smithi110.stdout:2/852: dread - d6/dc/dd/d49/d64/d4a/f100 zero size 2024-04-12T13:42:18.819 INFO:tasks.workunit.client.0.smithi060.stdout:9/704: truncate d4/d9/d19/d21/d73/d67/f8f 887465 0 2024-04-12T13:42:18.820 INFO:tasks.workunit.client.1.smithi110.stdout:6/795: write d7/d10/d41/fab [2183254,285] 0 2024-04-12T13:42:18.820 INFO:tasks.workunit.client.0.smithi060.stdout:4/715: write d6/d7/db/f4b [2854884,57606] 0 2024-04-12T13:42:18.821 INFO:tasks.workunit.client.0.smithi060.stdout:6/817: truncate d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b 1473078 0 2024-04-12T13:42:18.826 INFO:tasks.workunit.client.1.smithi110.stdout:7/845: symlink d1/d3/d4/d55/d82/db5/d10b/l11e 0 2024-04-12T13:42:18.827 INFO:tasks.workunit.client.1.smithi110.stdout:8/836: sync 2024-04-12T13:42:18.829 INFO:tasks.workunit.client.1.smithi110.stdout:4/908: rename d0/d19/d26/lb8 to d0/de/da0/dd9/df3/de0/l12c 0 2024-04-12T13:42:18.831 INFO:tasks.workunit.client.0.smithi060.stdout:9/705: fdatasync d4/d33/d65/d7a/f9f 0 2024-04-12T13:42:18.835 INFO:tasks.workunit.client.1.smithi110.stdout:3/793: creat d5/dc/d31/d74/d75/ff7 x:0 0 0 2024-04-12T13:42:18.838 INFO:tasks.workunit.client.0.smithi060.stdout:6/818: readlink d1/d7/da/dc/d7a/lc8 0 2024-04-12T13:42:18.841 INFO:tasks.workunit.client.0.smithi060.stdout:8/758: sync 2024-04-12T13:42:18.841 INFO:tasks.workunit.client.0.smithi060.stdout:3/785: sync 2024-04-12T13:42:18.841 INFO:tasks.workunit.client.0.smithi060.stdout:0/729: sync 2024-04-12T13:42:18.841 INFO:tasks.workunit.client.0.smithi060.stdout:2/791: sync 2024-04-12T13:42:18.842 INFO:tasks.workunit.client.0.smithi060.stdout:5/775: dwrite d6/d10/db8/dee/dfc/d46/fb4 [0,4194304] 0 2024-04-12T13:42:18.843 INFO:tasks.workunit.client.0.smithi060.stdout:2/792: readlink d6/ld 0 2024-04-12T13:42:18.844 INFO:tasks.workunit.client.1.smithi110.stdout:8/837: dwrite d1/d3/d3c/d75/ff7 [0,4194304] 0 2024-04-12T13:42:18.845 INFO:tasks.workunit.client.1.smithi110.stdout:8/838: stat d1/d7/ca6 0 2024-04-12T13:42:18.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/716: creat d6/d7/dd/d1a/d57/d63/d68/feb x:0 0 0 2024-04-12T13:42:18.849 INFO:tasks.workunit.client.1.smithi110.stdout:0/749: mkdir d1/d3c/dd8/df4/d10f 0 2024-04-12T13:42:18.852 INFO:tasks.workunit.client.0.smithi060.stdout:0/730: write d7/d9/d14/f25 [3722412,10779] 0 2024-04-12T13:42:18.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/717: chown d6/d2f/fce 1446214 1 2024-04-12T13:42:18.858 INFO:tasks.workunit.client.0.smithi060.stdout:1/908: write d1e/d29/f6c [2065523,64037] 0 2024-04-12T13:42:18.859 INFO:tasks.workunit.client.1.smithi110.stdout:9/902: write df/d38/db3/fc8 [241553,41506] 0 2024-04-12T13:42:18.861 INFO:tasks.workunit.client.1.smithi110.stdout:4/909: creat d0/de/da0/dd9/df3/de0/d7e/f12d x:0 0 0 2024-04-12T13:42:18.862 INFO:tasks.workunit.client.0.smithi060.stdout:4/718: write d6/d7/dd/d1a/d19/d42/d7c/fdd [402645,72014] 0 2024-04-12T13:42:18.864 INFO:tasks.workunit.client.0.smithi060.stdout:6/819: creat d1/d7/da/dc/d24/d30/dd8/f10c x:0 0 0 2024-04-12T13:42:18.866 INFO:tasks.workunit.client.0.smithi060.stdout:9/706: dwrite d4/d8/d32/f78 [0,4194304] 0 2024-04-12T13:42:18.868 INFO:tasks.workunit.client.1.smithi110.stdout:3/794: rename d5/dc/c3a to d5/dc/d20/d2d/d4e/d89/d8c/db6/de8/cf8 0 2024-04-12T13:42:18.870 INFO:tasks.workunit.client.0.smithi060.stdout:1/909: dread d1e/d1f/f6e [0,4194304] 0 2024-04-12T13:42:18.876 INFO:tasks.workunit.client.0.smithi060.stdout:4/719: stat d6/d7/dd/d1a/d57/d63/d68/d94/fbf 0 2024-04-12T13:42:18.876 INFO:tasks.workunit.client.0.smithi060.stdout:9/707: write d4/f2d [6661115,130083] 0 2024-04-12T13:42:18.878 INFO:tasks.workunit.client.0.smithi060.stdout:2/793: read d6/d64/d99/df0/d2b/d60/fa2 [93076,30349] 0 2024-04-12T13:42:18.880 INFO:tasks.workunit.client.1.smithi110.stdout:8/839: symlink d1/d3/d35/d3a/d3e/d64/d85/d8d/l111 0 2024-04-12T13:42:18.881 INFO:tasks.workunit.client.1.smithi110.stdout:0/750: mkdir d1/d48/db2/d110 0 2024-04-12T13:42:18.882 INFO:tasks.workunit.client.1.smithi110.stdout:9/903: fsync df/d13/d2c/d2d/d94/fef 0 2024-04-12T13:42:18.885 INFO:tasks.workunit.client.0.smithi060.stdout:2/794: read d6/dae/d5b/f96 [1339423,8428] 0 2024-04-12T13:42:18.886 INFO:tasks.workunit.client.1.smithi110.stdout:4/910: write d0/f5 [4413489,25052] 0 2024-04-12T13:42:18.887 INFO:tasks.workunit.client.0.smithi060.stdout:3/786: getdents d7/d17/d27/d36/db0/dc4/ded 0 2024-04-12T13:42:18.889 INFO:tasks.workunit.client.1.smithi110.stdout:2/853: mknod d6/dc/d1b/d57/d62/dcb/dd8/d102/c104 0 2024-04-12T13:42:18.890 INFO:tasks.workunit.client.0.smithi060.stdout:7/740: sync 2024-04-12T13:42:18.892 INFO:tasks.workunit.client.0.smithi060.stdout:4/720: dread - d6/fb8 zero size 2024-04-12T13:42:18.893 INFO:tasks.workunit.client.0.smithi060.stdout:1/910: rmdir d1e/d23/d2e/d86 39 2024-04-12T13:42:18.894 INFO:tasks.workunit.client.1.smithi110.stdout:6/796: dwrite d7/d25/d30/d44/d3d/f49 [0,4194304] 0 2024-04-12T13:42:18.895 INFO:tasks.workunit.client.1.smithi110.stdout:3/795: dwrite d5/dc/f13 [0,4194304] 0 2024-04-12T13:42:18.896 INFO:tasks.workunit.client.1.smithi110.stdout:6/797: readlink d7/d10/d41/lf2 0 2024-04-12T13:42:18.898 INFO:tasks.workunit.client.1.smithi110.stdout:7/846: dread d1/d3/d4/d55/d56/d72/f88 [0,4194304] 0 2024-04-12T13:42:18.899 INFO:tasks.workunit.client.1.smithi110.stdout:7/847: fdatasync d1/d1b/fbe 0 2024-04-12T13:42:18.903 INFO:tasks.workunit.client.0.smithi060.stdout:2/795: fdatasync d6/d64/d99/f9e 0 2024-04-12T13:42:18.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/759: dread d9/d1b/d3c/d6e/f86 [0,4194304] 0 2024-04-12T13:42:18.913 INFO:tasks.workunit.client.0.smithi060.stdout:9/708: dwrite d4/d8/f98 [0,4194304] 0 2024-04-12T13:42:18.915 INFO:tasks.workunit.client.0.smithi060.stdout:7/741: creat d0/d7/d92/ff0 x:0 0 0 2024-04-12T13:42:18.916 INFO:tasks.workunit.client.1.smithi110.stdout:5/790: sync 2024-04-12T13:42:18.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/787: mkdir d7/d17/d102 0 2024-04-12T13:42:18.929 INFO:tasks.workunit.client.1.smithi110.stdout:6/798: dread d7/d25/dc6/fca [0,4194304] 0 2024-04-12T13:42:18.930 INFO:tasks.workunit.client.0.smithi060.stdout:4/721: dread d6/d21/f2a [0,4194304] 0 2024-04-12T13:42:18.931 INFO:tasks.workunit.client.0.smithi060.stdout:0/731: dread d7/d9/d14/d35/f36 [0,4194304] 0 2024-04-12T13:42:18.937 INFO:tasks.workunit.client.0.smithi060.stdout:5/776: dwrite d6/dd/d1f/d25/d53/fd9 [0,4194304] 0 2024-04-12T13:42:18.943 INFO:tasks.workunit.client.0.smithi060.stdout:1/911: symlink d1e/d29/d65/de7/d11b/l13b 0 2024-04-12T13:42:18.943 INFO:tasks.workunit.client.0.smithi060.stdout:5/777: fdatasync d6/dd/d1f/d25/d42/d52/d7a/fde 0 2024-04-12T13:42:18.944 INFO:tasks.workunit.client.0.smithi060.stdout:7/742: rmdir d0/d7/da9 39 2024-04-12T13:42:18.947 INFO:tasks.workunit.client.0.smithi060.stdout:8/760: creat d9/d1b/d37/d4d/f108 x:0 0 0 2024-04-12T13:42:18.954 INFO:tasks.workunit.client.0.smithi060.stdout:4/722: dwrite d6/d7/db/dc8/fca [0,4194304] 0 2024-04-12T13:42:18.955 INFO:tasks.workunit.client.0.smithi060.stdout:6/820: getdents d1/d7/da/dc/d24/d30/d52/d78/d80/d93 0 2024-04-12T13:42:18.964 INFO:tasks.workunit.client.0.smithi060.stdout:0/732: chown d7/d41/l7e 961 1 2024-04-12T13:42:18.966 INFO:tasks.workunit.client.0.smithi060.stdout:1/912: rmdir d1e/d1f 39 2024-04-12T13:42:18.969 INFO:tasks.workunit.client.0.smithi060.stdout:5/778: creat d6/d10/db8/dee/dfc/da2/f102 x:0 0 0 2024-04-12T13:42:18.969 INFO:tasks.workunit.client.0.smithi060.stdout:7/743: rmdir d0/d7/d43 39 2024-04-12T13:42:18.971 INFO:tasks.workunit.client.0.smithi060.stdout:8/761: rmdir d9/d1b/d37/d48 39 2024-04-12T13:42:18.971 INFO:tasks.workunit.client.0.smithi060.stdout:9/709: getdents d4/d9/dbd/de8 0 2024-04-12T13:42:18.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/796: mknod d6/d64/d99/df0/daa/db0/def/cf1 0 2024-04-12T13:42:18.979 INFO:tasks.workunit.client.0.smithi060.stdout:3/788: truncate d7/f47 1794071 0 2024-04-12T13:42:18.981 INFO:tasks.workunit.client.0.smithi060.stdout:4/723: creat d6/d7/dd/d1a/d57/d63/fec x:0 0 0 2024-04-12T13:42:18.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/821: creat d1/d7/da/dc/d24/d30/dd8/f10d x:0 0 0 2024-04-12T13:42:18.984 INFO:tasks.workunit.client.1.smithi110.stdout:1/806: sync 2024-04-12T13:42:18.989 INFO:tasks.workunit.client.0.smithi060.stdout:7/744: creat d0/d3d/d74/d9b/da1/ff1 x:0 0 0 2024-04-12T13:42:18.994 INFO:tasks.workunit.client.0.smithi060.stdout:2/797: creat d6/dae/d31/d87/ff2 x:0 0 0 2024-04-12T13:42:18.995 INFO:tasks.workunit.client.1.smithi110.stdout:9/904: mkdir df/d13/d2c/d2d/dc1/d83/d63/db4/d12c 0 2024-04-12T13:42:18.997 INFO:tasks.workunit.client.1.smithi110.stdout:4/911: fdatasync d0/d13/fc7 0 2024-04-12T13:42:19.000 INFO:tasks.workunit.client.0.smithi060.stdout:3/789: rename d7/d17/d19/d33 to d7/d17/d19/dc9/d3f/d5c/d103 0 2024-04-12T13:42:19.000 INFO:tasks.workunit.client.0.smithi060.stdout:4/724: rename d6/d7/dd/d1a/d19/d42/dd9 to d6/d7/dd/d1a/d19/d42/dd9/ded 22 2024-04-12T13:42:19.002 INFO:tasks.workunit.client.0.smithi060.stdout:4/725: readlink d6/d7/dd/d1a/d57/ldf 0 2024-04-12T13:42:19.005 INFO:tasks.workunit.client.0.smithi060.stdout:4/726: stat d6/d7/dd/d1a/d19/d7a/d9d 0 2024-04-12T13:42:19.006 INFO:tasks.workunit.client.1.smithi110.stdout:3/796: rmdir d5 39 2024-04-12T13:42:19.007 INFO:tasks.workunit.client.0.smithi060.stdout:4/727: write d6/fe2 [755902,121686] 0 2024-04-12T13:42:19.011 INFO:tasks.workunit.client.0.smithi060.stdout:6/822: unlink d1/d7/da/dc/d24/f91 0 2024-04-12T13:42:19.013 INFO:tasks.workunit.client.0.smithi060.stdout:5/779: mkdir d6/dd/d1f/d25/d103 0 2024-04-12T13:42:19.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/780: truncate d6/dd/d1f/d25/d42/d52/d7a/fc3 865813 0 2024-04-12T13:42:19.023 INFO:tasks.workunit.client.1.smithi110.stdout:6/799: unlink d7/d25/d30/dcf/ld1 0 2024-04-12T13:42:19.024 INFO:tasks.workunit.client.0.smithi060.stdout:9/710: dwrite d4/d9/d19/d8c/da6/fac [0,4194304] 0 2024-04-12T13:42:19.027 INFO:tasks.workunit.client.0.smithi060.stdout:5/781: write d6/ff7 [257102,8465] 0 2024-04-12T13:42:19.029 INFO:tasks.workunit.client.0.smithi060.stdout:0/733: write d7/d9/f68 [167616,25637] 0 2024-04-12T13:42:19.031 INFO:tasks.workunit.client.1.smithi110.stdout:8/840: getdents d1/d3/d3c/d5a/d6f/d9c 0 2024-04-12T13:42:19.035 INFO:tasks.workunit.client.0.smithi060.stdout:6/823: dread d1/d7/da/dc/d24/d34/d51/d97/da9/fb7 [0,4194304] 0 2024-04-12T13:42:19.035 INFO:tasks.workunit.client.0.smithi060.stdout:0/734: write d7/d9/d14/d35/d44/d8c/d8d/fc3 [2599846,1326] 0 2024-04-12T13:42:19.040 INFO:tasks.workunit.client.0.smithi060.stdout:7/745: chown d0/d7/d43/d4d/lc8 2898 1 2024-04-12T13:42:19.040 INFO:tasks.workunit.client.1.smithi110.stdout:9/905: fsync df/d13/d2c/d9e/dd6/fa8 0 2024-04-12T13:42:19.042 INFO:tasks.workunit.client.1.smithi110.stdout:4/912: symlink d0/de/d2c/d116/l12e 0 2024-04-12T13:42:19.046 INFO:tasks.workunit.client.1.smithi110.stdout:2/854: symlink d6/dc/db1/l105 0 2024-04-12T13:42:19.047 INFO:tasks.workunit.client.1.smithi110.stdout:9/906: read df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [1212898,33710] 0 2024-04-12T13:42:19.048 INFO:tasks.workunit.client.1.smithi110.stdout:0/751: truncate d1/d56/fb1 1766371 0 2024-04-12T13:42:19.050 INFO:tasks.workunit.client.0.smithi060.stdout:8/762: dwrite d9/d1b/d84/da0/f24 [4194304,4194304] 0 2024-04-12T13:42:19.051 INFO:tasks.workunit.client.1.smithi110.stdout:2/855: fsync d6/dc/dd/d49/d64/fca 0 2024-04-12T13:42:19.051 INFO:tasks.workunit.client.0.smithi060.stdout:2/798: rename d6/d64/d99/df0/daa/db0/f4e to d6/d64/d99/df0/daa/ddf/ff3 0 2024-04-12T13:42:19.053 INFO:tasks.workunit.client.1.smithi110.stdout:0/752: chown d1/d27/ld2 11014778 1 2024-04-12T13:42:19.054 INFO:tasks.workunit.client.0.smithi060.stdout:2/799: stat d6/d56/d86/cb5 0 2024-04-12T13:42:19.058 INFO:tasks.workunit.client.0.smithi060.stdout:1/913: creat d1e/d46/d134/f13c x:0 0 0 2024-04-12T13:42:19.058 INFO:tasks.workunit.client.1.smithi110.stdout:2/856: chown d6/dc/dd/d49/d64/d4a/d51/f2f 1521921574 1 2024-04-12T13:42:19.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/735: creat d7/d9/d14/d35/d44/dd9/ff9 x:0 0 0 2024-04-12T13:42:19.064 INFO:tasks.workunit.client.1.smithi110.stdout:1/807: dwrite de/d15/f31 [0,4194304] 0 2024-04-12T13:42:19.064 INFO:tasks.workunit.client.1.smithi110.stdout:4/913: creat d0/d75/f12f x:0 0 0 2024-04-12T13:42:19.067 INFO:tasks.workunit.client.0.smithi060.stdout:7/746: dwrite d0/d7/d92/ff0 [0,4194304] 0 2024-04-12T13:42:19.067 INFO:tasks.workunit.client.0.smithi060.stdout:6/824: rename d1/f15 to d1/d7/da/dc/d24/d30/d52/d5e/d7e/d100/f10e 0 2024-04-12T13:42:19.069 INFO:tasks.workunit.client.1.smithi110.stdout:3/797: chown d5/dc/d31/d3b/d5b/l70 51863057 1 2024-04-12T13:42:19.074 INFO:tasks.workunit.client.0.smithi060.stdout:3/790: dread d7/d17/d19/dc9/d3f/d5c/d25/f7b [0,4194304] 0 2024-04-12T13:42:19.077 INFO:tasks.workunit.client.1.smithi110.stdout:5/791: creat da/d2e/d45/d25/d9d/d7a/db5/f111 x:0 0 0 2024-04-12T13:42:19.080 INFO:tasks.workunit.client.0.smithi060.stdout:0/736: creat d7/d9/de/d80/ffa x:0 0 0 2024-04-12T13:42:19.085 INFO:tasks.workunit.client.0.smithi060.stdout:8/763: dwrite d9/d1b/fc0 [0,4194304] 0 2024-04-12T13:42:19.085 INFO:tasks.workunit.client.0.smithi060.stdout:2/800: dwrite d6/d64/d99/df0/d2b/d60/fd0 [0,4194304] 0 2024-04-12T13:42:19.086 INFO:tasks.workunit.client.1.smithi110.stdout:7/848: getdents d1/d3/d4/da6 0 2024-04-12T13:42:19.088 INFO:tasks.workunit.client.1.smithi110.stdout:7/849: dread - d1/d31/d7b/f11a zero size 2024-04-12T13:42:19.096 INFO:tasks.workunit.client.1.smithi110.stdout:8/841: rename d1/d3/cdd to d1/d3/d3c/d5a/c112 0 2024-04-12T13:42:19.099 INFO:tasks.workunit.client.0.smithi060.stdout:0/737: creat d7/d9/d4c/d93/ffb x:0 0 0 2024-04-12T13:42:19.100 INFO:tasks.workunit.client.1.smithi110.stdout:2/857: truncate d6/dc/dd/dc6/f101 732668 0 2024-04-12T13:42:19.108 INFO:tasks.workunit.client.0.smithi060.stdout:2/801: rename d6/d64/d99/lbb to d6/d64/d99/df0/daa/db0/def/lf4 0 2024-04-12T13:42:19.108 INFO:tasks.workunit.client.1.smithi110.stdout:5/792: unlink da/d2e/d45/f1f 0 2024-04-12T13:42:19.108 INFO:tasks.workunit.client.1.smithi110.stdout:5/793: write da/db/f8d [2488300,10041] 0 2024-04-12T13:42:19.109 INFO:tasks.workunit.client.1.smithi110.stdout:0/753: dread d1/d8/d36/d51/f62 [0,4194304] 0 2024-04-12T13:42:19.110 INFO:tasks.workunit.client.0.smithi060.stdout:2/802: dread - d6/d56/d58/fd1 zero size 2024-04-12T13:42:19.110 INFO:tasks.workunit.client.1.smithi110.stdout:1/808: truncate de/d14/d34/d55/d6b/f10d 2663364 0 2024-04-12T13:42:19.111 INFO:tasks.workunit.client.0.smithi060.stdout:1/914: readlink d1e/d23/d2e/d86/ddb/lfd 0 2024-04-12T13:42:19.116 INFO:tasks.workunit.client.1.smithi110.stdout:7/850: creat d1/d1b/d70/f11f x:0 0 0 2024-04-12T13:42:19.120 INFO:tasks.workunit.client.1.smithi110.stdout:7/851: truncate d1/d3/d4/d55/d82/db5/f104 4787257 0 2024-04-12T13:42:19.120 INFO:tasks.workunit.client.0.smithi060.stdout:5/782: truncate d6/dd/d1f/d25/d42/d52/dc8/f100 1180923 0 2024-04-12T13:42:19.120 INFO:tasks.workunit.client.1.smithi110.stdout:8/842: creat d1/d3/d35/d43/f113 x:0 0 0 2024-04-12T13:42:19.122 INFO:tasks.workunit.client.1.smithi110.stdout:2/858: rename d6/dc/dd/d49/d64/d4a/d3c/d6e/c93 to d6/dc/dd/d49/df9/c106 0 2024-04-12T13:42:19.124 INFO:tasks.workunit.client.1.smithi110.stdout:2/859: stat d6/dc/dd/d49/d64/d4a/dc1/dd0 0 2024-04-12T13:42:19.125 INFO:tasks.workunit.client.0.smithi060.stdout:8/764: rename d9/d1b/d3c/d6e to d9/d1b/d84/da0/d80/d109 0 2024-04-12T13:42:19.130 INFO:tasks.workunit.client.1.smithi110.stdout:5/794: fdatasync da/d2e/d45/d25/f43 0 2024-04-12T13:42:19.130 INFO:tasks.workunit.client.1.smithi110.stdout:3/798: write d5/dc/d31/d3b/d32/f78 [3561595,24637] 0 2024-04-12T13:42:19.131 INFO:tasks.workunit.client.0.smithi060.stdout:2/803: mknod d6/dae/d31/d87/cf5 0 2024-04-12T13:42:19.133 INFO:tasks.workunit.client.1.smithi110.stdout:0/754: creat d1/d56/f111 x:0 0 0 2024-04-12T13:42:19.135 INFO:tasks.workunit.client.1.smithi110.stdout:0/755: chown d1/d8/f2e 12 1 2024-04-12T13:42:19.139 INFO:tasks.workunit.client.1.smithi110.stdout:0/756: read d1/d5e/f95 [3488254,98991] 0 2024-04-12T13:42:19.139 INFO:tasks.workunit.client.0.smithi060.stdout:7/747: dwrite d0/d1b/f37 [0,4194304] 0 2024-04-12T13:42:19.141 INFO:tasks.workunit.client.1.smithi110.stdout:6/800: sync 2024-04-12T13:42:19.141 INFO:tasks.workunit.client.1.smithi110.stdout:7/852: creat d1/f120 x:0 0 0 2024-04-12T13:42:19.141 INFO:tasks.workunit.client.1.smithi110.stdout:0/757: chown d1/d48/db2/d4a/l79 281 1 2024-04-12T13:42:19.142 INFO:tasks.workunit.client.0.smithi060.stdout:0/738: write d7/d9/d14/d4a/f83 [632594,115644] 0 2024-04-12T13:42:19.143 INFO:tasks.workunit.client.1.smithi110.stdout:0/758: chown d1/f6a 11554 1 2024-04-12T13:42:19.145 INFO:tasks.workunit.client.0.smithi060.stdout:3/791: truncate d7/d17/d27/d36/f62 2708188 0 2024-04-12T13:42:19.154 INFO:tasks.workunit.client.1.smithi110.stdout:5/795: dread da/db/f4a [0,4194304] 0 2024-04-12T13:42:19.159 INFO:tasks.workunit.client.1.smithi110.stdout:5/796: write da/d2e/d45/d25/d9d/d7a/db5/d89/fb1 [3459285,67721] 0 2024-04-12T13:42:19.159 INFO:tasks.workunit.client.1.smithi110.stdout:6/801: dwrite d7/d25/d30/d44/d3d/fc8 [4194304,4194304] 0 2024-04-12T13:42:19.160 INFO:tasks.workunit.client.0.smithi060.stdout:7/748: dwrite d0/d7/d92/ff0 [4194304,4194304] 0 2024-04-12T13:42:19.161 INFO:tasks.workunit.client.1.smithi110.stdout:5/797: chown da/d2e/d45/c93 19085 1 2024-04-12T13:42:19.164 INFO:tasks.workunit.client.1.smithi110.stdout:1/809: mkdir de/d14/d34/d87/d105/d110 0 2024-04-12T13:42:19.170 INFO:tasks.workunit.client.1.smithi110.stdout:4/914: getdents d0/d19/d1c/d50/d6f/db9 0 2024-04-12T13:42:19.175 INFO:tasks.workunit.client.0.smithi060.stdout:0/739: dwrite d7/d9/d14/d35/fb7 [4194304,4194304] 0 2024-04-12T13:42:19.180 INFO:tasks.workunit.client.1.smithi110.stdout:8/843: write d1/d3/d35/d3a/d41/d77/fc9 [455290,13505] 0 2024-04-12T13:42:19.186 INFO:tasks.workunit.client.1.smithi110.stdout:7/853: dread d1/d31/d5d/fb3 [0,4194304] 0 2024-04-12T13:42:19.189 INFO:tasks.workunit.client.1.smithi110.stdout:6/802: unlink d7/da4/fbb 0 2024-04-12T13:42:19.190 INFO:tasks.workunit.client.1.smithi110.stdout:6/803: chown d7/d25/d2c/d4c/d77/cc0 29700007 1 2024-04-12T13:42:19.199 INFO:tasks.workunit.client.1.smithi110.stdout:3/799: rename d5/dc/d20/d2d/d4f/dce to d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9 0 2024-04-12T13:42:19.200 INFO:tasks.workunit.client.1.smithi110.stdout:4/915: fsync d0/de/d2c/fc2 0 2024-04-12T13:42:19.204 INFO:tasks.workunit.client.1.smithi110.stdout:8/844: unlink d1/d3/d35/d3a/d3e/d4f/fa4 0 2024-04-12T13:42:19.207 INFO:tasks.workunit.client.1.smithi110.stdout:8/845: read d1/d3/d35/d3a/d41/d77/fb1 [54722,110497] 0 2024-04-12T13:42:19.213 INFO:tasks.workunit.client.1.smithi110.stdout:9/907: sync 2024-04-12T13:42:19.215 INFO:tasks.workunit.client.1.smithi110.stdout:9/908: dread - df/d38/d6e/d7f/f10a zero size 2024-04-12T13:42:19.215 INFO:tasks.workunit.client.1.smithi110.stdout:3/800: creat d5/dc/d20/d2d/d4e/d89/d8c/dc5/ffa x:0 0 0 2024-04-12T13:42:19.220 INFO:tasks.workunit.client.1.smithi110.stdout:8/846: rmdir d1/d3/d3c/d75 39 2024-04-12T13:42:19.221 INFO:tasks.workunit.client.1.smithi110.stdout:7/854: unlink d1/d1b/d74/ceb 0 2024-04-12T13:42:19.222 INFO:tasks.workunit.client.1.smithi110.stdout:5/798: link da/d2e/d45/d25/d9d/l94 da/d35/dd6/l112 0 2024-04-12T13:42:19.223 INFO:tasks.workunit.client.1.smithi110.stdout:6/804: symlink d7/d10/d1c/d2b/lfa 0 2024-04-12T13:42:19.225 INFO:tasks.workunit.client.1.smithi110.stdout:5/799: chown da/d2e/d45/d25/d9d/f9a 6835 1 2024-04-12T13:42:19.227 INFO:tasks.workunit.client.1.smithi110.stdout:2/860: getdents d6/dc/dd/d49/d64/d4a/d3c/d50/dd5 0 2024-04-12T13:42:19.234 INFO:tasks.workunit.client.1.smithi110.stdout:6/805: fsync d7/d25/d2c/d4c/d77/dd3/f8e 0 2024-04-12T13:42:19.236 INFO:tasks.workunit.client.1.smithi110.stdout:9/909: dwrite df/d13/d2c/d2d/dc1/d83/d5d/f7e [0,4194304] 0 2024-04-12T13:42:19.236 INFO:tasks.workunit.client.1.smithi110.stdout:0/759: sync 2024-04-12T13:42:19.238 INFO:tasks.workunit.client.1.smithi110.stdout:0/760: stat d1/fd9 0 2024-04-12T13:42:19.241 INFO:tasks.workunit.client.0.smithi060.stdout:3/792: creat d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/f104 x:0 0 0 2024-04-12T13:42:19.242 INFO:tasks.workunit.client.1.smithi110.stdout:3/801: dread d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:19.243 INFO:tasks.workunit.client.1.smithi110.stdout:4/916: rename d0/de/d2c/d57/fe6 to d0/de/d2c/f130 0 2024-04-12T13:42:19.243 INFO:tasks.workunit.client.1.smithi110.stdout:7/855: dwrite d1/d3/d4/dbf/f9d [0,4194304] 0 2024-04-12T13:42:19.243 INFO:tasks.workunit.client.0.smithi060.stdout:7/749: mknod d0/d1b/d8c/cf2 0 2024-04-12T13:42:19.245 INFO:tasks.workunit.client.0.smithi060.stdout:5/783: dwrite d6/d89/f8f [4194304,4194304] 0 2024-04-12T13:42:19.246 INFO:tasks.workunit.client.1.smithi110.stdout:3/802: read d5/dc/d31/d3b/d32/f3f [1852827,59499] 0 2024-04-12T13:42:19.248 INFO:tasks.workunit.client.0.smithi060.stdout:7/750: chown d0/d7/d43/d63/f67 1032690 1 2024-04-12T13:42:19.249 INFO:tasks.workunit.client.0.smithi060.stdout:0/740: stat d7/d9/f48 0 2024-04-12T13:42:19.249 INFO:tasks.workunit.client.1.smithi110.stdout:1/810: link de/d1d/d86/fa8 de/d14/dd0/f111 0 2024-04-12T13:42:19.249 INFO:tasks.workunit.client.1.smithi110.stdout:7/856: dread - d1/d1b/d3d/d68/f116 zero size 2024-04-12T13:42:19.252 INFO:tasks.workunit.client.1.smithi110.stdout:4/917: chown d0/de/da0/lac 13151 1 2024-04-12T13:42:19.255 INFO:tasks.workunit.client.1.smithi110.stdout:6/806: creat d7/d10/d7e/d85/dd0/ffb x:0 0 0 2024-04-12T13:42:19.256 INFO:tasks.workunit.client.1.smithi110.stdout:5/800: dread da/d35/ffe [0,4194304] 0 2024-04-12T13:42:19.256 INFO:tasks.workunit.client.1.smithi110.stdout:6/807: dread - d7/d10/d7e/d85/fc2 zero size 2024-04-12T13:42:19.258 INFO:tasks.workunit.client.0.smithi060.stdout:3/793: dread d7/d17/d19/d96/fc5 [0,4194304] 0 2024-04-12T13:42:19.261 INFO:tasks.workunit.client.1.smithi110.stdout:9/910: fdatasync df/d13/d2c/d2d/dc1/d83/fe0 0 2024-04-12T13:42:19.265 INFO:tasks.workunit.client.0.smithi060.stdout:2/804: write d6/f24 [2256093,1655] 0 2024-04-12T13:42:19.275 INFO:tasks.workunit.client.0.smithi060.stdout:8/765: dwrite d9/d1d/d5e/f93 [0,4194304] 0 2024-04-12T13:42:19.277 INFO:tasks.workunit.client.0.smithi060.stdout:1/915: dwrite d1e/f28 [0,4194304] 0 2024-04-12T13:42:19.278 INFO:tasks.workunit.client.1.smithi110.stdout:5/801: symlink da/d2e/d45/d25/d9d/d79/d88/dd3/l113 0 2024-04-12T13:42:19.284 INFO:tasks.workunit.client.0.smithi060.stdout:2/805: symlink d6/d64/d99/df0/d2b/d60/lf6 0 2024-04-12T13:42:19.285 INFO:tasks.workunit.client.1.smithi110.stdout:7/857: dread d1/f2a [0,4194304] 0 2024-04-12T13:42:19.286 INFO:tasks.workunit.client.0.smithi060.stdout:7/751: mkdir d0/df3 0 2024-04-12T13:42:19.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/825: link d1/c6e d1/d7/da/d20/c10f 0 2024-04-12T13:42:19.292 INFO:tasks.workunit.client.1.smithi110.stdout:3/803: mknod d5/dc/d31/d74/d75/da7/cfb 0 2024-04-12T13:42:19.292 INFO:tasks.workunit.client.1.smithi110.stdout:2/861: creat d6/dc/d6f/da7/f107 x:0 0 0 2024-04-12T13:42:19.292 INFO:tasks.workunit.client.1.smithi110.stdout:0/761: dwrite d1/d48/f8f [0,4194304] 0 2024-04-12T13:42:19.294 INFO:tasks.workunit.client.1.smithi110.stdout:3/804: chown d5/dc 12 1 2024-04-12T13:42:19.295 INFO:tasks.workunit.client.1.smithi110.stdout:4/918: creat d0/de/d2c/d102/f131 x:0 0 0 2024-04-12T13:42:19.298 INFO:tasks.workunit.client.1.smithi110.stdout:9/911: dread df/d13/d2c/d2d/dc1/d83/d5d/d89/fa5 [0,4194304] 0 2024-04-12T13:42:19.299 INFO:tasks.workunit.client.0.smithi060.stdout:0/741: rename d7/d9/de/d80/ffa to d7/d9/d14/d35/ffc 0 2024-04-12T13:42:19.300 INFO:tasks.workunit.client.0.smithi060.stdout:5/784: dread d6/d10/de9/fcc [0,4194304] 0 2024-04-12T13:42:19.303 INFO:tasks.workunit.client.1.smithi110.stdout:6/808: fsync d7/d25/d30/f9b 0 2024-04-12T13:42:19.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/806: creat d6/dae/d5b/d6d/de1/ff7 x:0 0 0 2024-04-12T13:42:19.305 INFO:tasks.workunit.client.1.smithi110.stdout:5/802: creat da/db/d3b/d40/d97/f114 x:0 0 0 2024-04-12T13:42:19.307 INFO:tasks.workunit.client.1.smithi110.stdout:8/847: rename d1/l29 to d1/d3/d3c/d5a/l114 0 2024-04-12T13:42:19.308 INFO:tasks.workunit.client.1.smithi110.stdout:1/811: dwrite de/d14/d34/f75 [0,4194304] 0 2024-04-12T13:42:19.312 INFO:tasks.workunit.client.1.smithi110.stdout:2/862: fdatasync d6/dc/dd/d49/f8a 0 2024-04-12T13:42:19.313 INFO:tasks.workunit.client.0.smithi060.stdout:8/766: dwrite d9/dc9/ff1 [0,4194304] 0 2024-04-12T13:42:19.313 INFO:tasks.workunit.client.0.smithi060.stdout:0/742: readlink d7/d9/l96 0 2024-04-12T13:42:19.314 INFO:tasks.workunit.client.1.smithi110.stdout:3/805: unlink d5/dc/f19 0 2024-04-12T13:42:19.317 INFO:tasks.workunit.client.1.smithi110.stdout:4/919: truncate d0/d19/d1c/fad 3663742 0 2024-04-12T13:42:19.317 INFO:tasks.workunit.client.0.smithi060.stdout:1/916: creat d1e/f13d x:0 0 0 2024-04-12T13:42:19.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/752: mkdir d0/d7/da9/dc9/db1/df4 0 2024-04-12T13:42:19.321 INFO:tasks.workunit.client.1.smithi110.stdout:3/806: truncate d5/dc/d31/d3b/d32/d3e/d98/f9e 4692403 0 2024-04-12T13:42:19.324 INFO:tasks.workunit.client.0.smithi060.stdout:6/826: symlink d1/d7/da/dc/d24/d34/l110 0 2024-04-12T13:42:19.324 INFO:tasks.workunit.client.1.smithi110.stdout:6/809: mkdir d7/d25/d30/dcf/dc3/dfc 0 2024-04-12T13:42:19.326 INFO:tasks.workunit.client.1.smithi110.stdout:5/803: mknod da/db/d3b/d40/d97/c115 0 2024-04-12T13:42:19.328 INFO:tasks.workunit.client.0.smithi060.stdout:2/807: mkdir d6/dae/d5b/d6d/de1/df8 0 2024-04-12T13:42:19.328 INFO:tasks.workunit.client.0.smithi060.stdout:7/753: truncate d0/d78/fdf 362055 0 2024-04-12T13:42:19.330 INFO:tasks.workunit.client.1.smithi110.stdout:2/863: dwrite d6/dc/dd/d49/d64/d25/f40 [0,4194304] 0 2024-04-12T13:42:19.333 INFO:tasks.workunit.client.0.smithi060.stdout:7/754: write d0/d78/fdf [526105,52901] 0 2024-04-12T13:42:19.337 INFO:tasks.workunit.client.0.smithi060.stdout:8/767: dread d9/d1b/d84/da0/d80/d109/dbd/fe8 [4194304,4194304] 0 2024-04-12T13:42:19.338 INFO:tasks.workunit.client.1.smithi110.stdout:0/762: rename d1/d5e/f93 to d1/d3c/dd8/f112 0 2024-04-12T13:42:19.338 INFO:tasks.workunit.client.0.smithi060.stdout:2/808: read d6/f15 [2646946,10270] 0 2024-04-12T13:42:19.339 INFO:tasks.workunit.client.1.smithi110.stdout:7/858: dread d1/d3/d4/d36/d76/f8a [0,4194304] 0 2024-04-12T13:42:19.341 INFO:tasks.workunit.client.0.smithi060.stdout:5/785: dwrite d6/dd/d1f/dd3/df3/f36 [4194304,4194304] 0 2024-04-12T13:42:19.341 INFO:tasks.workunit.client.1.smithi110.stdout:7/859: fsync d1/d3/d4/d55/d82/ff9 0 2024-04-12T13:42:19.342 INFO:tasks.workunit.client.0.smithi060.stdout:1/917: mknod d1e/d46/c13e 0 2024-04-12T13:42:19.344 INFO:tasks.workunit.client.1.smithi110.stdout:1/812: creat de/d15/dab/dd8/dd9/dda/f112 x:0 0 0 2024-04-12T13:42:19.345 INFO:tasks.workunit.client.0.smithi060.stdout:2/809: read - d6/d64/d99/df0/d6b/fe7 zero size 2024-04-12T13:42:19.349 INFO:tasks.workunit.client.0.smithi060.stdout:6/827: chown d1/d7/da/dc/d24/d30/d52/c54 68218 1 2024-04-12T13:42:19.354 INFO:tasks.workunit.client.1.smithi110.stdout:9/912: symlink df/d13/d2c/d2d/dd3/d10e/l12d 0 2024-04-12T13:42:19.358 INFO:tasks.workunit.client.1.smithi110.stdout:4/920: mknod d0/d75/d84/d89/d103/c132 0 2024-04-12T13:42:19.360 INFO:tasks.workunit.client.1.smithi110.stdout:4/921: dread - d0/d19/d1c/d50/f69 zero size 2024-04-12T13:42:19.360 INFO:tasks.workunit.client.0.smithi060.stdout:5/786: unlink d6/d10/db8/fce 0 2024-04-12T13:42:19.363 INFO:tasks.workunit.client.1.smithi110.stdout:3/807: mkdir d5/dc/d20/d2d/d4e/d89/d8c/db6/de8/dfc 0 2024-04-12T13:42:19.368 INFO:tasks.workunit.client.1.smithi110.stdout:6/810: mkdir d7/d25/d2c/d4c/d77/db9/dfd 0 2024-04-12T13:42:19.373 INFO:tasks.workunit.client.0.smithi060.stdout:6/828: unlink d1/d7/da/d20/d99/lbe 0 2024-04-12T13:42:19.380 INFO:tasks.workunit.client.1.smithi110.stdout:4/922: dread d0/d13/f21 [4194304,4194304] 0 2024-04-12T13:42:19.382 INFO:tasks.workunit.client.0.smithi060.stdout:0/743: dread d7/d9/d14/d4a/fa1 [0,4194304] 0 2024-04-12T13:42:19.384 INFO:tasks.workunit.client.0.smithi060.stdout:5/787: dwrite d6/d89/f8f [4194304,4194304] 0 2024-04-12T13:42:19.386 INFO:tasks.workunit.client.0.smithi060.stdout:7/755: write d0/d3d/f40 [793861,25026] 0 2024-04-12T13:42:19.387 INFO:tasks.workunit.client.1.smithi110.stdout:7/860: dread d1/d31/d5d/f83 [0,4194304] 0 2024-04-12T13:42:19.394 INFO:tasks.workunit.client.0.smithi060.stdout:7/756: write d0/fd8 [4336723,18893] 0 2024-04-12T13:42:19.395 INFO:tasks.workunit.client.1.smithi110.stdout:3/808: creat d5/dc/d31/d74/ffd x:0 0 0 2024-04-12T13:42:19.395 INFO:tasks.workunit.client.0.smithi060.stdout:8/768: dread d9/d1b/d84/da0/faa [4194304,4194304] 0 2024-04-12T13:42:19.399 INFO:tasks.workunit.client.1.smithi110.stdout:6/811: truncate d7/d25/d30/f9b 2271663 0 2024-04-12T13:42:19.400 INFO:tasks.workunit.client.0.smithi060.stdout:7/757: dread d0/d1b/fa2 [0,4194304] 0 2024-04-12T13:42:19.402 INFO:tasks.workunit.client.1.smithi110.stdout:8/848: creat d1/d5/f115 x:0 0 0 2024-04-12T13:42:19.402 INFO:tasks.workunit.client.1.smithi110.stdout:0/763: mknod d1/d3c/dd8/d103/c113 0 2024-04-12T13:42:19.403 INFO:tasks.workunit.client.1.smithi110.stdout:7/861: dwrite d1/d3/d4/dbf/fe8 [0,4194304] 0 2024-04-12T13:42:19.405 INFO:tasks.workunit.client.1.smithi110.stdout:2/864: sync 2024-04-12T13:42:19.406 INFO:tasks.workunit.client.1.smithi110.stdout:5/804: write da/f11 [1076832,120938] 0 2024-04-12T13:42:19.407 INFO:tasks.workunit.client.0.smithi060.stdout:0/744: rename d7/d9/d14/d35/d44/dd9/dd8/cb8 to d7/d9/de/cfd 0 2024-04-12T13:42:19.409 INFO:tasks.workunit.client.0.smithi060.stdout:1/918: write d1e/f2b [779791,127301] 0 2024-04-12T13:42:19.412 INFO:tasks.workunit.client.1.smithi110.stdout:4/923: rename d0/de/d32/d61/ldb to d0/de/da0/dd9/df3/de0/d7e/d125/l133 0 2024-04-12T13:42:19.414 INFO:tasks.workunit.client.0.smithi060.stdout:2/810: truncate d6/d64/d99/df0/daa/db0/f4c 2325178 0 2024-04-12T13:42:19.416 INFO:tasks.workunit.client.0.smithi060.stdout:5/788: creat d6/dd/d27/df4/f104 x:0 0 0 2024-04-12T13:42:19.417 INFO:tasks.workunit.client.1.smithi110.stdout:1/813: getdents de/d15/dab/dd8/d103 0 2024-04-12T13:42:19.419 INFO:tasks.workunit.client.0.smithi060.stdout:7/758: creat d0/d7/da9/ff5 x:0 0 0 2024-04-12T13:42:19.420 INFO:tasks.workunit.client.1.smithi110.stdout:1/814: write de/d14/d34/d55/d6b/fe8 [2951579,49840] 0 2024-04-12T13:42:19.422 INFO:tasks.workunit.client.0.smithi060.stdout:8/769: dwrite d9/d1b/d37/d4d/f108 [0,4194304] 0 2024-04-12T13:42:19.422 INFO:tasks.workunit.client.0.smithi060.stdout:7/759: chown d0/fad 14 1 2024-04-12T13:42:19.425 INFO:tasks.workunit.client.0.smithi060.stdout:6/829: link d1/d7/da/dc/d24/d34/d51/d59/c4c d1/d7/da/dc/d24/d30/d52/d78/c111 0 2024-04-12T13:42:19.427 INFO:tasks.workunit.client.1.smithi110.stdout:9/913: dread df/f24 [0,4194304] 0 2024-04-12T13:42:19.428 INFO:tasks.workunit.client.1.smithi110.stdout:6/812: creat d7/d25/d2c/d4c/d77/db9/ffe x:0 0 0 2024-04-12T13:42:19.430 INFO:tasks.workunit.client.1.smithi110.stdout:0/764: creat d1/d56/f114 x:0 0 0 2024-04-12T13:42:19.431 INFO:tasks.workunit.client.0.smithi060.stdout:1/919: symlink d1e/d23/dd9/l13f 0 2024-04-12T13:42:19.433 INFO:tasks.workunit.client.0.smithi060.stdout:1/920: readlink d1e/d23/d2e/d86/l9e 0 2024-04-12T13:42:19.433 INFO:tasks.workunit.client.0.smithi060.stdout:2/811: mknod d6/d64/d99/df0/d16/dda/cf9 0 2024-04-12T13:42:19.434 INFO:tasks.workunit.client.0.smithi060.stdout:5/789: truncate d6/dd/d1f/d25/d53/d87/d7e/dca/ded/ffa 644816 0 2024-04-12T13:42:19.435 INFO:tasks.workunit.client.1.smithi110.stdout:2/865: unlink d6/d18/f29 0 2024-04-12T13:42:19.437 INFO:tasks.workunit.client.1.smithi110.stdout:5/805: readlink da/db/d15/l49 0 2024-04-12T13:42:19.439 INFO:tasks.workunit.client.1.smithi110.stdout:4/924: symlink d0/de/d32/d5f/l134 0 2024-04-12T13:42:19.440 INFO:tasks.workunit.client.1.smithi110.stdout:4/925: stat d0/d19/l3f 0 2024-04-12T13:42:19.441 INFO:tasks.workunit.client.1.smithi110.stdout:4/926: stat d0/d19/c30 0 2024-04-12T13:42:19.443 INFO:tasks.workunit.client.0.smithi060.stdout:7/760: rename d0/c81 to d0/d7/d43/cf6 0 2024-04-12T13:42:19.444 INFO:tasks.workunit.client.1.smithi110.stdout:4/927: truncate d0/de/d32/d61/f104 141614 0 2024-04-12T13:42:19.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/761: stat d0/d1b/l44 0 2024-04-12T13:42:19.450 INFO:tasks.workunit.client.1.smithi110.stdout:3/809: mknod d5/dc/d20/d2d/cfe 0 2024-04-12T13:42:19.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/812: truncate d6/d64/d99/df0/d6b/f84 444651 0 2024-04-12T13:42:19.455 INFO:tasks.workunit.client.1.smithi110.stdout:9/914: rename df/f3d to df/d13/d2c/d9e/d107/f12e 0 2024-04-12T13:42:19.458 INFO:tasks.workunit.client.1.smithi110.stdout:0/765: truncate d1/d8/f10 4522310 0 2024-04-12T13:42:19.465 INFO:tasks.workunit.client.0.smithi060.stdout:7/762: dread - d0/d7/d92/fc7 zero size 2024-04-12T13:42:19.467 INFO:tasks.workunit.client.1.smithi110.stdout:3/810: dwrite d5/dc/d31/d74/ffd [0,4194304] 0 2024-04-12T13:42:19.467 INFO:tasks.workunit.client.1.smithi110.stdout:7/862: dwrite d1/d1b/d74/f8b [0,4194304] 0 2024-04-12T13:42:19.478 INFO:tasks.workunit.client.1.smithi110.stdout:6/813: dread d7/f19 [0,4194304] 0 2024-04-12T13:42:19.580 INFO:tasks.workunit.client.1.smithi110.stdout:5/806: unlink da/d35/lc1 0 2024-04-12T13:42:19.583 INFO:tasks.workunit.client.1.smithi110.stdout:4/928: symlink d0/de/d2c/d102/l135 0 2024-04-12T13:42:19.585 INFO:tasks.workunit.client.0.smithi060.stdout:8/770: truncate d9/d1b/d37/d4d/d63/d66/dd9/dfc/f30 2738818 0 2024-04-12T13:42:19.587 INFO:tasks.workunit.client.1.smithi110.stdout:4/929: chown d0/d19/d26/c83 16 1 2024-04-12T13:42:19.592 INFO:tasks.workunit.client.1.smithi110.stdout:9/915: creat df/d38/d6e/d7f/f12f x:0 0 0 2024-04-12T13:42:19.592 INFO:tasks.workunit.client.0.smithi060.stdout:5/790: write d6/dd/d1f/d25/d42/d52/d7a/fb0 [2415291,52630] 0 2024-04-12T13:42:19.598 INFO:tasks.workunit.client.1.smithi110.stdout:0/766: unlink d1/d5e/fe4 0 2024-04-12T13:42:19.600 INFO:tasks.workunit.client.0.smithi060.stdout:8/771: unlink d9/d1b/d84/da0/d80/d109/dbd/fe8 0 2024-04-12T13:42:19.604 INFO:tasks.workunit.client.0.smithi060.stdout:5/791: readlink d6/dd/d1f/d25/d42/lbe 0 2024-04-12T13:42:19.612 INFO:tasks.workunit.client.1.smithi110.stdout:8/849: link d1/d7/d20/fcb d1/d3/d35/d3a/d41/dd7/f116 0 2024-04-12T13:42:19.614 INFO:tasks.workunit.client.0.smithi060.stdout:6/830: dwrite d1/d7/da/dc/d24/d34/d51/d59/d94/fc5 [0,4194304] 0 2024-04-12T13:42:19.614 INFO:tasks.workunit.client.0.smithi060.stdout:8/772: read - d9/d1b/d37/d4d/d63/d66/d8b/fbf zero size 2024-04-12T13:42:19.618 INFO:tasks.workunit.client.0.smithi060.stdout:6/831: chown d1/d7/da/fbf 1 1 2024-04-12T13:42:19.621 INFO:tasks.workunit.client.0.smithi060.stdout:1/921: dwrite d1e/f7c [0,4194304] 0 2024-04-12T13:42:19.624 INFO:tasks.workunit.client.0.smithi060.stdout:5/792: read - d6/dd/fd1 zero size 2024-04-12T13:42:19.633 INFO:tasks.workunit.client.1.smithi110.stdout:7/863: symlink d1/d3/d4/d55/d56/ddd/l121 0 2024-04-12T13:42:19.643 INFO:tasks.workunit.client.1.smithi110.stdout:7/864: dread d1/d3/d4/da6/fc4 [0,4194304] 0 2024-04-12T13:42:19.644 INFO:tasks.workunit.client.1.smithi110.stdout:4/930: symlink d0/d19/d1c/d50/d6f/l136 0 2024-04-12T13:42:19.653 INFO:tasks.workunit.client.0.smithi060.stdout:8/773: symlink d9/d1b/d84/da0/d80/d109/d7b/db1/l10a 0 2024-04-12T13:42:19.654 INFO:tasks.workunit.client.0.smithi060.stdout:8/774: chown d9/d1b/l29 55 1 2024-04-12T13:42:19.662 INFO:tasks.workunit.client.0.smithi060.stdout:8/775: rmdir d9/d1b/d37/d4d/d63/d66/db3/da4 39 2024-04-12T13:42:19.670 INFO:tasks.workunit.client.1.smithi110.stdout:6/814: unlink d7/d10/d1c/f42 0 2024-04-12T13:42:19.673 INFO:tasks.workunit.client.1.smithi110.stdout:5/807: mknod da/d2e/d45/d25/d9d/d7a/dc3/c116 0 2024-04-12T13:42:19.675 INFO:tasks.workunit.client.1.smithi110.stdout:6/815: chown d7/d10/d1c/d2b/d48/d4b/dcc/feb 3179 1 2024-04-12T13:42:19.678 INFO:tasks.workunit.client.1.smithi110.stdout:7/865: chown d1/d31/c54 1913697 1 2024-04-12T13:42:19.678 INFO:tasks.workunit.client.1.smithi110.stdout:6/816: dread - d7/da4/fc4 zero size 2024-04-12T13:42:19.678 INFO:tasks.workunit.client.1.smithi110.stdout:4/931: rename d0/d19/d26/c6a to d0/de/da0/dd9/df3/de0/dfa/c137 0 2024-04-12T13:42:19.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/728: sync 2024-04-12T13:42:19.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/776: dwrite d9/d1b/d37/d4d/d63/d66/db3/fda [0,4194304] 0 2024-04-12T13:42:19.681 INFO:tasks.workunit.client.0.smithi060.stdout:9/711: sync 2024-04-12T13:42:19.681 INFO:tasks.workunit.client.0.smithi060.stdout:3/794: sync 2024-04-12T13:42:19.687 INFO:tasks.workunit.client.0.smithi060.stdout:3/795: stat d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/f100 0 2024-04-12T13:42:19.696 INFO:tasks.workunit.client.0.smithi060.stdout:9/712: mkdir d4/d8/d7c/dee 0 2024-04-12T13:42:19.698 INFO:tasks.workunit.client.0.smithi060.stdout:4/729: mkdir d6/d7/dd/dee 0 2024-04-12T13:42:19.699 INFO:tasks.workunit.client.0.smithi060.stdout:4/730: readlink d6/d7/dd/l34 0 2024-04-12T13:42:19.703 INFO:tasks.workunit.client.0.smithi060.stdout:3/796: creat d7/d17/d27/d36/d53/da2/f105 x:0 0 0 2024-04-12T13:42:19.704 INFO:tasks.workunit.client.0.smithi060.stdout:3/797: chown d7/d17/d27/da7 7173 1 2024-04-12T13:42:19.716 INFO:tasks.workunit.client.0.smithi060.stdout:3/798: fsync d7/d17/f1a 0 2024-04-12T13:42:19.720 INFO:tasks.workunit.client.0.smithi060.stdout:9/713: creat d4/d9/d19/d21/fef x:0 0 0 2024-04-12T13:42:19.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/799: dread d7/f9f [0,4194304] 0 2024-04-12T13:42:19.726 INFO:tasks.workunit.client.0.smithi060.stdout:4/731: dread d6/d7/db/f8e [0,4194304] 0 2024-04-12T13:42:19.729 INFO:tasks.workunit.client.0.smithi060.stdout:4/732: chown d6/d7/db/dc8/cd1 7 1 2024-04-12T13:42:19.730 INFO:tasks.workunit.client.0.smithi060.stdout:3/800: dread - d7/d17/d27/d36/d53/da2/f105 zero size 2024-04-12T13:42:19.738 INFO:tasks.workunit.client.0.smithi060.stdout:4/733: mknod d6/d7/dd/d1a/d19/d42/d7c/cef 0 2024-04-12T13:42:19.751 INFO:tasks.workunit.client.1.smithi110.stdout:8/850: creat d1/d5/f117 x:0 0 0 2024-04-12T13:42:19.754 INFO:tasks.workunit.client.0.smithi060.stdout:9/714: dread d4/d8/d7c/f81 [0,4194304] 0 2024-04-12T13:42:19.755 INFO:tasks.workunit.client.1.smithi110.stdout:8/851: chown d1/d5/d1f/cb3 28 1 2024-04-12T13:42:19.770 INFO:tasks.workunit.client.0.smithi060.stdout:9/715: dread d4/d8/d32/f78 [0,4194304] 0 2024-04-12T13:42:19.771 INFO:tasks.workunit.client.0.smithi060.stdout:7/763: write d0/d3d/f58 [1049869,113063] 0 2024-04-12T13:42:19.776 INFO:tasks.workunit.client.0.smithi060.stdout:7/764: creat d0/d7/d92/ff7 x:0 0 0 2024-04-12T13:42:19.777 INFO:tasks.workunit.client.0.smithi060.stdout:9/716: fsync d4/d8/fb 0 2024-04-12T13:42:19.785 INFO:tasks.workunit.client.1.smithi110.stdout:1/815: dwrite de/d15/d32/d61/d6a/dac/fdf [0,4194304] 0 2024-04-12T13:42:19.805 INFO:tasks.workunit.client.0.smithi060.stdout:9/717: dread d4/f2d [4194304,4194304] 0 2024-04-12T13:42:19.807 INFO:tasks.workunit.client.0.smithi060.stdout:8/777: rename d9/c20 to d9/c10b 0 2024-04-12T13:42:19.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/813: sync 2024-04-12T13:42:19.809 INFO:tasks.workunit.client.0.smithi060.stdout:0/745: sync 2024-04-12T13:42:19.813 INFO:tasks.workunit.client.0.smithi060.stdout:2/814: mkdir d6/dae/d5b/d6d/dfa 0 2024-04-12T13:42:19.817 INFO:tasks.workunit.client.0.smithi060.stdout:0/746: unlink d7/d9/d14/d35/ff1 0 2024-04-12T13:42:19.818 INFO:tasks.workunit.client.0.smithi060.stdout:2/815: read d6/d56/d58/da0/f5c [3218247,104228] 0 2024-04-12T13:42:19.821 INFO:tasks.workunit.client.0.smithi060.stdout:8/778: creat d9/d1b/d37/d4d/d63/d66/db3/da4/f10c x:0 0 0 2024-04-12T13:42:19.822 INFO:tasks.workunit.client.0.smithi060.stdout:2/816: chown d6/d64/d99/df0/d16/f1c 2433 1 2024-04-12T13:42:19.825 INFO:tasks.workunit.client.0.smithi060.stdout:8/779: dread - d9/d1d/d5e/fd5 zero size 2024-04-12T13:42:19.827 INFO:tasks.workunit.client.0.smithi060.stdout:2/817: symlink d6/d64/d99/de9/lfb 0 2024-04-12T13:42:19.829 INFO:tasks.workunit.client.0.smithi060.stdout:9/718: dread d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:19.831 INFO:tasks.workunit.client.0.smithi060.stdout:8/780: mkdir d9/d1b/d37/d48/d10d 0 2024-04-12T13:42:19.834 INFO:tasks.workunit.client.0.smithi060.stdout:9/719: unlink d4/d9/d19/d21/d73/lbe 0 2024-04-12T13:42:19.838 INFO:tasks.workunit.client.0.smithi060.stdout:1/922: write d1e/d23/d2e/d5e/d68/fbb [208764,2754] 0 2024-04-12T13:42:19.841 INFO:tasks.workunit.client.0.smithi060.stdout:8/781: creat d9/d1b/d2b/f10e x:0 0 0 2024-04-12T13:42:19.841 INFO:tasks.workunit.client.1.smithi110.stdout:9/916: creat df/d13/d2c/d2d/f130 x:0 0 0 2024-04-12T13:42:19.842 INFO:tasks.workunit.client.0.smithi060.stdout:1/923: mknod d1e/d23/d2e/d86/c140 0 2024-04-12T13:42:19.847 INFO:tasks.workunit.client.1.smithi110.stdout:9/917: mkdir df/d13/d2c/d2d/dd3/d10e/d131 0 2024-04-12T13:42:19.849 INFO:tasks.workunit.client.1.smithi110.stdout:0/767: truncate d1/d8/d36/d51/f68 1726709 0 2024-04-12T13:42:19.851 INFO:tasks.workunit.client.1.smithi110.stdout:2/866: symlink d6/dc/d13/d80/d8d/l108 0 2024-04-12T13:42:19.852 INFO:tasks.workunit.client.1.smithi110.stdout:5/808: write da/d2e/d45/d29/d105/fcd [989799,58972] 0 2024-04-12T13:42:19.854 INFO:tasks.workunit.client.1.smithi110.stdout:5/809: stat da/db/lcc 0 2024-04-12T13:42:19.854 INFO:tasks.workunit.client.1.smithi110.stdout:3/811: symlink d5/dc/d31/d3b/d32/d3e/lff 0 2024-04-12T13:42:19.856 INFO:tasks.workunit.client.1.smithi110.stdout:0/768: unlink d1/d48/f8f 0 2024-04-12T13:42:19.858 INFO:tasks.workunit.client.1.smithi110.stdout:9/918: symlink df/d13/d2c/d9e/dd6/dcf/dd2/l132 0 2024-04-12T13:42:19.859 INFO:tasks.workunit.client.1.smithi110.stdout:6/817: write d7/d10/d1c/d2b/d48/f70 [3064422,1337] 0 2024-04-12T13:42:19.860 INFO:tasks.workunit.client.1.smithi110.stdout:2/867: mkdir d6/dc/d1b/d109 0 2024-04-12T13:42:19.861 INFO:tasks.workunit.client.1.smithi110.stdout:4/932: truncate d0/de/da0/dd9/df3/f8d 3599660 0 2024-04-12T13:42:19.863 INFO:tasks.workunit.client.0.smithi060.stdout:6/832: rename d1/d7/da/dc/d7a/leb to d1/d7/da/dc/l112 0 2024-04-12T13:42:19.866 INFO:tasks.workunit.client.1.smithi110.stdout:6/818: dread - d7/da4/fc4 zero size 2024-04-12T13:42:19.868 INFO:tasks.workunit.client.1.smithi110.stdout:3/812: creat d5/d86/df1/f100 x:0 0 0 2024-04-12T13:42:19.872 INFO:tasks.workunit.client.0.smithi060.stdout:0/747: rename d7/d9/de/d63/fd2 to d7/d9/d14/d35/d44/d8c/d8d/de9/ffe 0 2024-04-12T13:42:19.874 INFO:tasks.workunit.client.1.smithi110.stdout:4/933: mkdir d0/de/da0/dd9/d138 0 2024-04-12T13:42:19.875 INFO:tasks.workunit.client.1.smithi110.stdout:7/866: creat d1/d3/d4/d55/d56/f122 x:0 0 0 2024-04-12T13:42:19.877 INFO:tasks.workunit.client.1.smithi110.stdout:4/934: fsync d0/d75/d84/f106 0 2024-04-12T13:42:19.878 INFO:tasks.workunit.client.1.smithi110.stdout:2/868: creat d6/dc/dd/dc6/f10a x:0 0 0 2024-04-12T13:42:19.878 INFO:tasks.workunit.client.0.smithi060.stdout:0/748: fsync d7/d9/d14/d35/d44/d7d/f32 0 2024-04-12T13:42:19.878 INFO:tasks.workunit.client.1.smithi110.stdout:5/810: rmdir da/d2e/d45/d25/d9d/d79 39 2024-04-12T13:42:19.883 INFO:tasks.workunit.client.0.smithi060.stdout:4/734: dwrite d6/d7/dd/d1a/d57/d63/fb5 [0,4194304] 0 2024-04-12T13:42:19.885 INFO:tasks.workunit.client.0.smithi060.stdout:0/749: creat d7/d9/d14/d35/d44/d7d/fff x:0 0 0 2024-04-12T13:42:19.887 INFO:tasks.workunit.client.0.smithi060.stdout:0/750: readlink d7/d9/d14/lb2 0 2024-04-12T13:42:19.888 INFO:tasks.workunit.client.0.smithi060.stdout:8/782: rename d9/d1d/d5e/f61 to d9/d1b/d84/da0/d80/d109/d7b/db1/f10f 0 2024-04-12T13:42:19.888 INFO:tasks.workunit.client.1.smithi110.stdout:1/816: sync 2024-04-12T13:42:19.890 INFO:tasks.workunit.client.0.smithi060.stdout:0/751: read d7/d9/d14/d35/fb7 [7336251,6273] 0 2024-04-12T13:42:19.890 INFO:tasks.workunit.client.0.smithi060.stdout:4/735: mkdir d6/d7/dd/d1a/d57/dc7/df0 0 2024-04-12T13:42:19.890 INFO:tasks.workunit.client.1.smithi110.stdout:1/817: readlink de/d14/d34/db4/lcb 0 2024-04-12T13:42:19.895 INFO:tasks.workunit.client.0.smithi060.stdout:1/924: rename d1e/d23/dd9/c124 to d1e/d94/c141 0 2024-04-12T13:42:19.901 INFO:tasks.workunit.client.0.smithi060.stdout:8/783: mknod d9/d1b/d37/d4d/d63/d66/dd9/c110 0 2024-04-12T13:42:19.902 INFO:tasks.workunit.client.0.smithi060.stdout:7/765: getdents d0/d7/d92 0 2024-04-12T13:42:19.904 INFO:tasks.workunit.client.0.smithi060.stdout:8/784: write d9/d1b/d37/d4d/d63/fa9 [1045359,101835] 0 2024-04-12T13:42:19.905 INFO:tasks.workunit.client.0.smithi060.stdout:0/752: unlink d7/d9/d14/d35/d44/d8c/l97 0 2024-04-12T13:42:19.906 INFO:tasks.workunit.client.0.smithi060.stdout:0/753: stat d7/d9/d14/d4a/c58 0 2024-04-12T13:42:19.909 INFO:tasks.workunit.client.1.smithi110.stdout:8/852: dwrite d1/d3/d3c/d5a/d6f/d7e/f8e [0,4194304] 0 2024-04-12T13:42:19.913 INFO:tasks.workunit.client.1.smithi110.stdout:9/919: rename df/d13/d2c/fed to df/d38/db3/f133 0 2024-04-12T13:42:19.915 INFO:tasks.workunit.client.1.smithi110.stdout:8/853: truncate d1/d3/d35/d3a/d41/f10c 71141 0 2024-04-12T13:42:19.915 INFO:tasks.workunit.client.1.smithi110.stdout:0/769: mkdir d1/d115 0 2024-04-12T13:42:19.917 INFO:tasks.workunit.client.1.smithi110.stdout:0/770: chown d1/d3c/fd6 397108017 1 2024-04-12T13:42:19.920 INFO:tasks.workunit.client.0.smithi060.stdout:0/754: creat d7/d9/d14/d35/d44/d8c/d8d/de9/f100 x:0 0 0 2024-04-12T13:42:19.922 INFO:tasks.workunit.client.0.smithi060.stdout:7/766: rename d0/d1b/d8c/faf to d0/d1b/da4/ff8 0 2024-04-12T13:42:19.925 INFO:tasks.workunit.client.0.smithi060.stdout:0/755: unlink d7/d9/f68 0 2024-04-12T13:42:19.938 INFO:tasks.workunit.client.0.smithi060.stdout:7/767: link d0/d7/d43/d63/d90/fbf d0/d1b/ff9 0 2024-04-12T13:42:19.950 INFO:tasks.workunit.client.0.smithi060.stdout:2/818: dwrite d6/dae/f67 [4194304,4194304] 0 2024-04-12T13:42:19.951 INFO:tasks.workunit.client.1.smithi110.stdout:3/813: symlink d5/dc/d20/d2d/db1/l101 0 2024-04-12T13:42:19.954 INFO:tasks.workunit.client.1.smithi110.stdout:4/935: creat d0/de/da0/d111/f139 x:0 0 0 2024-04-12T13:42:19.954 INFO:tasks.workunit.client.1.smithi110.stdout:3/814: chown d5/d86 251817805 1 2024-04-12T13:42:19.955 INFO:tasks.workunit.client.0.smithi060.stdout:3/801: mknod d7/d17/d19/dc9/d3f/c106 0 2024-04-12T13:42:19.960 INFO:tasks.workunit.client.0.smithi060.stdout:2/819: dread d6/d64/d99/fcb [0,4194304] 0 2024-04-12T13:42:19.960 INFO:tasks.workunit.client.1.smithi110.stdout:1/818: rmdir de/d14/d34/d55/d6b/dc7 39 2024-04-12T13:42:19.962 INFO:tasks.workunit.client.0.smithi060.stdout:3/802: chown d7/d17/d19/l93 5 1 2024-04-12T13:42:19.963 INFO:tasks.workunit.client.1.smithi110.stdout:1/819: write f6 [3784343,95772] 0 2024-04-12T13:42:19.964 INFO:tasks.workunit.client.0.smithi060.stdout:3/803: chown d7/d17/d19/f1f 1195412051 1 2024-04-12T13:42:19.967 INFO:tasks.workunit.client.0.smithi060.stdout:2/820: creat d6/d64/d99/df0/d2b/d60/ffc x:0 0 0 2024-04-12T13:42:19.968 INFO:tasks.workunit.client.1.smithi110.stdout:7/867: rename d1/d1b/d74/f93 to d1/d3/d4/d55/d56/d72/dad/d115/f123 0 2024-04-12T13:42:19.970 INFO:tasks.workunit.client.1.smithi110.stdout:9/920: creat df/d13/d2c/d2d/dc1/d83/d63/d72/f134 x:0 0 0 2024-04-12T13:42:19.971 INFO:tasks.workunit.client.0.smithi060.stdout:3/804: mkdir d7/d17/d19/d96/d107 0 2024-04-12T13:42:19.973 INFO:tasks.workunit.client.1.smithi110.stdout:8/854: mknod d1/d3/d35/d43/d9f/dd5/c118 0 2024-04-12T13:42:19.974 INFO:tasks.workunit.client.0.smithi060.stdout:2/821: truncate d6/f9 149920 0 2024-04-12T13:42:19.975 INFO:tasks.workunit.client.0.smithi060.stdout:6/833: write d1/d7/da/fbf [1404168,72017] 0 2024-04-12T13:42:19.976 INFO:tasks.workunit.client.1.smithi110.stdout:3/815: symlink d5/dc/d20/d2d/d4f/l102 0 2024-04-12T13:42:19.979 INFO:tasks.workunit.client.0.smithi060.stdout:3/805: unlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/c70 0 2024-04-12T13:42:19.982 INFO:tasks.workunit.client.0.smithi060.stdout:2/822: symlink d6/d64/d99/df0/d2b/lfd 0 2024-04-12T13:42:19.984 INFO:tasks.workunit.client.0.smithi060.stdout:6/834: truncate d1/d7/da/dc/d24/d30/d52/f8a 2158976 0 2024-04-12T13:42:19.984 INFO:tasks.workunit.client.0.smithi060.stdout:2/823: fdatasync d6/d64/d99/df0/d4b/fe5 0 2024-04-12T13:42:19.984 INFO:tasks.workunit.client.1.smithi110.stdout:7/868: dread d1/d31/d5d/f83 [0,4194304] 0 2024-04-12T13:42:19.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/806: fsync d7/d17/d19/dc9/d3f/d5c/d103/f50 0 2024-04-12T13:42:19.988 INFO:tasks.workunit.client.0.smithi060.stdout:3/807: chown d7/d17/d27/d36/db0/fc1 1731 1 2024-04-12T13:42:19.988 INFO:tasks.workunit.client.0.smithi060.stdout:2/824: dread d6/d64/d99/df0/d2b/d60/fa2 [0,4194304] 0 2024-04-12T13:42:19.990 INFO:tasks.workunit.client.1.smithi110.stdout:1/820: chown de/d1d/fbf 7 1 2024-04-12T13:42:19.993 INFO:tasks.workunit.client.1.smithi110.stdout:6/819: dwrite d7/d10/fb6 [0,4194304] 0 2024-04-12T13:42:19.995 INFO:tasks.workunit.client.1.smithi110.stdout:2/869: rename d6/dc/dd/d49/d64/d4a/d51/fe7 to d6/dc/d13/d80/d8d/dc3/f10b 0 2024-04-12T13:42:19.999 INFO:tasks.workunit.client.1.smithi110.stdout:9/921: unlink df/d13/d2c/d2d/dc1/d83/d63/c6b 0 2024-04-12T13:42:20.006 INFO:tasks.workunit.client.0.smithi060.stdout:5/793: sync 2024-04-12T13:42:20.009 INFO:tasks.workunit.client.1.smithi110.stdout:5/811: symlink da/db/d3b/d40/da6/l117 0 2024-04-12T13:42:20.009 INFO:tasks.workunit.client.0.smithi060.stdout:4/736: write d6/d21/f5d [1397772,69491] 0 2024-04-12T13:42:20.014 INFO:tasks.workunit.client.1.smithi110.stdout:3/816: truncate d5/dc/d31/d3b/d32/f3f 2627472 0 2024-04-12T13:42:20.015 INFO:tasks.workunit.client.0.smithi060.stdout:5/794: dread d6/d10/f2b [0,4194304] 0 2024-04-12T13:42:20.015 INFO:tasks.workunit.client.1.smithi110.stdout:4/936: getdents d0/de/da0/dd9/df3/de0/dfa/d11f 0 2024-04-12T13:42:20.015 INFO:tasks.workunit.client.0.smithi060.stdout:3/808: dwrite d7/d17/d19/f4e [0,4194304] 0 2024-04-12T13:42:20.015 INFO:tasks.workunit.client.0.smithi060.stdout:4/737: chown d6/d7/dd/d1a/d19/c2b 14426 1 2024-04-12T13:42:20.017 INFO:tasks.workunit.client.1.smithi110.stdout:1/821: truncate de/d1d/d86/fa3 422886 0 2024-04-12T13:42:20.018 INFO:tasks.workunit.client.1.smithi110.stdout:2/870: rmdir d6/dc/d1b/d8f/d9c 39 2024-04-12T13:42:20.019 INFO:tasks.workunit.client.0.smithi060.stdout:3/809: chown d7/d17/d27/d36/l56 116120940 1 2024-04-12T13:42:20.019 INFO:tasks.workunit.client.0.smithi060.stdout:6/835: dread d1/d7/da/dc/f7c [0,4194304] 0 2024-04-12T13:42:20.019 INFO:tasks.workunit.client.1.smithi110.stdout:6/820: dwrite d7/d10/f20 [0,4194304] 0 2024-04-12T13:42:20.020 INFO:tasks.workunit.client.1.smithi110.stdout:4/937: write d0/de/d2c/fc2 [4444423,81125] 0 2024-04-12T13:42:20.023 INFO:tasks.workunit.client.1.smithi110.stdout:9/922: rename df/d13/d2c/d2d/dd3/d10e/l12d to df/d13/d2c/d9e/d107/l135 0 2024-04-12T13:42:20.024 INFO:tasks.workunit.client.0.smithi060.stdout:3/810: write d7/d17/d27/d36/db0/dc4/de9/ffb [55177,68149] 0 2024-04-12T13:42:20.024 INFO:tasks.workunit.client.0.smithi060.stdout:4/738: fsync d6/d21/d29/f73 0 2024-04-12T13:42:20.026 INFO:tasks.workunit.client.0.smithi060.stdout:4/739: stat d6/d2f/d7d/c87 0 2024-04-12T13:42:20.027 INFO:tasks.workunit.client.1.smithi110.stdout:6/821: read d7/d25/d2c/f40 [2885423,115735] 0 2024-04-12T13:42:20.027 INFO:tasks.workunit.client.1.smithi110.stdout:5/812: symlink da/d2e/d45/d25/d9d/d7a/l118 0 2024-04-12T13:42:20.029 INFO:tasks.workunit.client.1.smithi110.stdout:5/813: chown da/db/l1c 10469 1 2024-04-12T13:42:20.032 INFO:tasks.workunit.client.1.smithi110.stdout:1/822: symlink de/d15/d32/d61/d6a/dac/l113 0 2024-04-12T13:42:20.034 INFO:tasks.workunit.client.1.smithi110.stdout:8/855: truncate d1/d3/d35/d3a/d3e/d64/d85/fe7 799844 0 2024-04-12T13:42:20.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/795: link d6/ff7 d6/dd/d1f/dd3/de7/df8/f105 0 2024-04-12T13:42:20.035 INFO:tasks.workunit.client.1.smithi110.stdout:4/938: mkdir d0/d13/d13a 0 2024-04-12T13:42:20.037 INFO:tasks.workunit.client.1.smithi110.stdout:8/856: write d1/d3/d3c/d5a/d6f/d7e/fee [93524,124601] 0 2024-04-12T13:42:20.043 INFO:tasks.workunit.client.0.smithi060.stdout:4/740: dread d6/d2f/d51/f89 [0,4194304] 0 2024-04-12T13:42:20.043 INFO:tasks.workunit.client.1.smithi110.stdout:2/871: mknod d6/dc/dd/d49/df9/c10c 0 2024-04-12T13:42:20.046 INFO:tasks.workunit.client.0.smithi060.stdout:5/796: creat d6/dd/d1f/dd3/f106 x:0 0 0 2024-04-12T13:42:20.048 INFO:tasks.workunit.client.0.smithi060.stdout:1/925: dwrite d1e/f4d [4194304,4194304] 0 2024-04-12T13:42:20.050 INFO:tasks.workunit.client.0.smithi060.stdout:4/741: chown d6/d7/dd/df/c10 203854 1 2024-04-12T13:42:20.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/742: chown d6/d7 4570991 1 2024-04-12T13:42:20.053 INFO:tasks.workunit.client.0.smithi060.stdout:6/836: dwrite d1/d7/da/dc/fdd [0,4194304] 0 2024-04-12T13:42:20.054 INFO:tasks.workunit.client.0.smithi060.stdout:4/743: write d6/d7/db/dc8/fca [2817216,97154] 0 2024-04-12T13:42:20.057 INFO:tasks.workunit.client.0.smithi060.stdout:4/744: dread - d6/d7/dd/d1a/d57/d63/fb2 zero size 2024-04-12T13:42:20.073 INFO:tasks.workunit.client.0.smithi060.stdout:4/745: dwrite d6/d7/db/f4b [0,4194304] 0 2024-04-12T13:42:20.162 INFO:tasks.workunit.client.1.smithi110.stdout:6/822: rmdir d7/d25/d2c/d4c/d77/d93 39 2024-04-12T13:42:20.166 INFO:tasks.workunit.client.1.smithi110.stdout:1/823: dread - de/d15/dab/dd8/dd9/dda/fb9 zero size 2024-04-12T13:42:20.172 INFO:tasks.workunit.client.0.smithi060.stdout:1/926: write d1e/f12b [919222,67877] 0 2024-04-12T13:42:20.173 INFO:tasks.workunit.client.1.smithi110.stdout:4/939: dread - d0/d19/d26/fd6 zero size 2024-04-12T13:42:20.175 INFO:tasks.workunit.client.1.smithi110.stdout:6/823: dread d7/d25/d2c/fa2 [0,4194304] 0 2024-04-12T13:42:20.178 INFO:tasks.workunit.client.1.smithi110.stdout:8/857: rename d1/d3/d35/d3a/d3e/c61 to d1/d3/d35/d43/d9f/c119 0 2024-04-12T13:42:20.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:19 smithi060 ceph-mon[29097]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 274 MiB/s wr, 577 op/s 2024-04-12T13:42:20.179 INFO:tasks.workunit.client.1.smithi110.stdout:2/872: truncate d6/dc/d6f/fda 460553 0 2024-04-12T13:42:20.180 INFO:tasks.workunit.client.0.smithi060.stdout:4/746: rmdir d6/db7/dbb 39 2024-04-12T13:42:20.186 INFO:tasks.workunit.client.1.smithi110.stdout:5/814: link da/d2e/d45/d25/d9d/d7a/db5/df3/f103 da/d2e/d45/d25/d9d/d7a/dae/d101/f119 0 2024-04-12T13:42:20.188 INFO:tasks.workunit.client.1.smithi110.stdout:1/824: rmdir de/d15/da9 39 2024-04-12T13:42:20.191 INFO:tasks.workunit.client.1.smithi110.stdout:6/824: write d7/d10/d1c/d2b/d48/d4b/dcc/feb [761962,4634] 0 2024-04-12T13:42:20.194 INFO:tasks.workunit.client.0.smithi060.stdout:1/927: dwrite d1e/d23/dd9/f123 [0,4194304] 0 2024-04-12T13:42:20.196 INFO:tasks.workunit.client.1.smithi110.stdout:2/873: write d6/dc/dd/d49/d64/d4a/d3c/d6e/ff8 [5109943,74159] 0 2024-04-12T13:42:20.197 INFO:tasks.workunit.client.1.smithi110.stdout:1/825: read de/d14/d34/d108/fad [1557398,105813] 0 2024-04-12T13:42:20.200 INFO:tasks.workunit.client.1.smithi110.stdout:9/923: dwrite df/d13/d2c/d9e/d107/f12e [4194304,4194304] 0 2024-04-12T13:42:20.206 INFO:tasks.workunit.client.1.smithi110.stdout:0/771: write d1/d8/d36/d51/fbf [1774816,37028] 0 2024-04-12T13:42:20.211 INFO:tasks.workunit.client.1.smithi110.stdout:8/858: creat d1/d3/d35/d3a/d3e/d64/d85/de1/f11a x:0 0 0 2024-04-12T13:42:20.220 INFO:tasks.workunit.client.1.smithi110.stdout:6/825: rmdir d7/d10/d1c/d2b/d3a/dbf/de2 39 2024-04-12T13:42:20.224 INFO:tasks.workunit.client.1.smithi110.stdout:6/826: fsync d7/d10/d7e/d85/fc2 0 2024-04-12T13:42:20.226 INFO:tasks.workunit.client.1.smithi110.stdout:2/874: creat d6/dc/d6f/f10d x:0 0 0 2024-04-12T13:42:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:19 smithi110 ceph-mon[36055]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 274 MiB/s wr, 577 op/s 2024-04-12T13:42:20.229 INFO:tasks.workunit.client.1.smithi110.stdout:2/875: dread - d6/dc/d6f/f10d zero size 2024-04-12T13:42:20.232 INFO:tasks.workunit.client.1.smithi110.stdout:9/924: truncate df/d38/fa2 1304029 0 2024-04-12T13:42:20.237 INFO:tasks.workunit.client.1.smithi110.stdout:0/772: fdatasync d1/d48/f5b 0 2024-04-12T13:42:20.238 INFO:tasks.workunit.client.1.smithi110.stdout:2/876: truncate d6/dc/dd/dc6/f10a 686023 0 2024-04-12T13:42:20.243 INFO:tasks.workunit.client.1.smithi110.stdout:2/877: chown d6/dc/d13/lef 22 1 2024-04-12T13:42:20.243 INFO:tasks.workunit.client.1.smithi110.stdout:7/869: dwrite d1/d3/d43/f85 [0,4194304] 0 2024-04-12T13:42:20.248 INFO:tasks.workunit.client.1.smithi110.stdout:6/827: rename d7/d25/d2c/d4c/d77/dd3/c92 to d7/d10/d7e/d85/cff 0 2024-04-12T13:42:20.250 INFO:tasks.workunit.client.1.smithi110.stdout:1/826: creat de/d1d/f114 x:0 0 0 2024-04-12T13:42:20.251 INFO:tasks.workunit.client.1.smithi110.stdout:3/817: dwrite d5/dc/d31/d3b/d32/fcc [0,4194304] 0 2024-04-12T13:42:20.255 INFO:tasks.workunit.client.1.smithi110.stdout:9/925: truncate df/d13/d2c/d2d/d39/f79 317098 0 2024-04-12T13:42:20.257 INFO:tasks.workunit.client.1.smithi110.stdout:8/859: fsync d1/d3/d3c/d75/d79/fad 0 2024-04-12T13:42:20.259 INFO:tasks.workunit.client.1.smithi110.stdout:8/860: chown d1/d3/d35/d3a/d10d 3 1 2024-04-12T13:42:20.262 INFO:tasks.workunit.client.1.smithi110.stdout:5/815: link da/d2e/d45/d25/c4b da/d2e/d45/d29/d105/c11a 0 2024-04-12T13:42:20.266 INFO:tasks.workunit.client.0.smithi060.stdout:3/811: dwrite d7/d17/d19/dc9/d3f/d5c/d25/d4d/f75 [0,4194304] 0 2024-04-12T13:42:20.266 INFO:tasks.workunit.client.1.smithi110.stdout:0/773: dwrite d1/fdf [0,4194304] 0 2024-04-12T13:42:20.273 INFO:tasks.workunit.client.1.smithi110.stdout:2/878: read d6/dc/dd/d49/d64/d4a/d51/f4f [250637,49020] 0 2024-04-12T13:42:20.275 INFO:tasks.workunit.client.0.smithi060.stdout:5/797: truncate d6/f20 1954736 0 2024-04-12T13:42:20.277 INFO:tasks.workunit.client.1.smithi110.stdout:9/926: dwrite df/d13/d26/d37/d6a/fec [0,4194304] 0 2024-04-12T13:42:20.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/825: write d6/d56/d86/f8d [16539,64329] 0 2024-04-12T13:42:20.280 INFO:tasks.workunit.client.1.smithi110.stdout:3/818: mkdir d5/dc/d20/d2d/d4e/d89/d8c/db6/d103 0 2024-04-12T13:42:20.286 INFO:tasks.workunit.client.0.smithi060.stdout:9/720: sync 2024-04-12T13:42:20.298 INFO:tasks.workunit.client.0.smithi060.stdout:5/798: truncate d6/d10/f2b 173787 0 2024-04-12T13:42:20.300 INFO:tasks.workunit.client.0.smithi060.stdout:2/826: dread d6/dae/d5b/d6d/f6e [0,4194304] 0 2024-04-12T13:42:20.302 INFO:tasks.workunit.client.1.smithi110.stdout:4/940: write d0/de/d32/f7d [1262640,1877] 0 2024-04-12T13:42:20.303 INFO:tasks.workunit.client.1.smithi110.stdout:1/827: mknod de/d15/d32/d61/d6a/c115 0 2024-04-12T13:42:20.304 INFO:tasks.workunit.client.1.smithi110.stdout:8/861: stat d1/d3/fe 0 2024-04-12T13:42:20.305 INFO:tasks.workunit.client.1.smithi110.stdout:7/870: dread d1/d3/d4/d55/d82/f6a [0,4194304] 0 2024-04-12T13:42:20.306 INFO:tasks.workunit.client.1.smithi110.stdout:6/828: dread d7/d25/d2c/f57 [0,4194304] 0 2024-04-12T13:42:20.311 INFO:tasks.workunit.client.1.smithi110.stdout:7/871: dread - d1/d1b/d3d/d68/f116 zero size 2024-04-12T13:42:20.313 INFO:tasks.workunit.client.0.smithi060.stdout:9/721: symlink d4/d9/d19/d21/dbb/lf0 0 2024-04-12T13:42:20.314 INFO:tasks.workunit.client.0.smithi060.stdout:1/928: dwrite d1e/d23/d49/d4e/fee [0,4194304] 0 2024-04-12T13:42:20.320 INFO:tasks.workunit.client.1.smithi110.stdout:9/927: dwrite df/d13/d2c/d2d/d39/d3a/f8c [0,4194304] 0 2024-04-12T13:42:20.321 INFO:tasks.workunit.client.1.smithi110.stdout:4/941: mkdir d0/d19/d1c/d50/d6f/d13b 0 2024-04-12T13:42:20.327 INFO:tasks.workunit.client.0.smithi060.stdout:9/722: read d4/d8/f40 [5260,109187] 0 2024-04-12T13:42:20.330 INFO:tasks.workunit.client.1.smithi110.stdout:6/829: unlink d7/d25/d30/d44/d3d/lf7 0 2024-04-12T13:42:20.336 INFO:tasks.workunit.client.1.smithi110.stdout:0/774: dread d1/d8/f21 [4194304,4194304] 0 2024-04-12T13:42:20.337 INFO:tasks.workunit.client.0.smithi060.stdout:4/747: dread d6/d7/db/f22 [0,4194304] 0 2024-04-12T13:42:20.339 INFO:tasks.workunit.client.1.smithi110.stdout:1/828: mknod de/d14/d34/d108/d10e/c116 0 2024-04-12T13:42:20.343 INFO:tasks.workunit.client.1.smithi110.stdout:4/942: symlink d0/de/d32/l13c 0 2024-04-12T13:42:20.344 INFO:tasks.workunit.client.0.smithi060.stdout:7/768: sync 2024-04-12T13:42:20.344 INFO:tasks.workunit.client.0.smithi060.stdout:0/756: sync 2024-04-12T13:42:20.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/785: sync 2024-04-12T13:42:20.347 INFO:tasks.workunit.client.0.smithi060.stdout:2/827: dwrite d6/dae/d31/d33/f49 [0,4194304] 0 2024-04-12T13:42:20.348 INFO:tasks.workunit.client.1.smithi110.stdout:6/830: mkdir d7/da4/d100 0 2024-04-12T13:42:20.350 INFO:tasks.workunit.client.0.smithi060.stdout:6/837: write d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f4b [570583,55583] 0 2024-04-12T13:42:20.358 INFO:tasks.workunit.client.1.smithi110.stdout:7/872: mknod d1/d3/d118/c124 0 2024-04-12T13:42:20.360 INFO:tasks.workunit.client.1.smithi110.stdout:7/873: readlink d1/d3/d4/lc2 0 2024-04-12T13:42:20.360 INFO:tasks.workunit.client.0.smithi060.stdout:5/799: creat d6/dd/d1f/f107 x:0 0 0 2024-04-12T13:42:20.363 INFO:tasks.workunit.client.1.smithi110.stdout:0/775: fdatasync d1/d5e/fb3 0 2024-04-12T13:42:20.371 INFO:tasks.workunit.client.1.smithi110.stdout:3/819: creat d5/dc/d20/d2d/d4e/d89/d8c/f104 x:0 0 0 2024-04-12T13:42:20.374 INFO:tasks.workunit.client.0.smithi060.stdout:4/748: dread d6/d7/dd/d4d/d69/f8a [0,4194304] 0 2024-04-12T13:42:20.375 INFO:tasks.workunit.client.0.smithi060.stdout:0/757: mknod d7/d9/d14/d35/d44/d49/dcf/dd0/c101 0 2024-04-12T13:42:20.378 INFO:tasks.workunit.client.0.smithi060.stdout:0/758: fsync d7/d33/fb4 0 2024-04-12T13:42:20.382 INFO:tasks.workunit.client.1.smithi110.stdout:1/829: dread de/d15/f1c [0,4194304] 0 2024-04-12T13:42:20.385 INFO:tasks.workunit.client.0.smithi060.stdout:3/812: truncate d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/fd1 4247042 0 2024-04-12T13:42:20.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/786: dwrite d9/d1b/d37/d4d/d63/d66/dd9/dfc/f4b [0,4194304] 0 2024-04-12T13:42:20.390 INFO:tasks.workunit.client.1.smithi110.stdout:2/879: truncate d6/dc/dd/f47 1871819 0 2024-04-12T13:42:20.392 INFO:tasks.workunit.client.0.smithi060.stdout:6/838: rmdir d1/d7/da/dc/d24/d30/d52/d5e 39 2024-04-12T13:42:20.396 INFO:tasks.workunit.client.0.smithi060.stdout:5/800: rmdir d6/dd/d27/d7d 39 2024-04-12T13:42:20.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/801: chown d6/dd/d1f/d25/d53/fd9 2004 1 2024-04-12T13:42:20.401 INFO:tasks.workunit.client.0.smithi060.stdout:9/723: rename d4/d9/d19/d21/d73 to d4/d8/df1 0 2024-04-12T13:42:20.402 INFO:tasks.workunit.client.1.smithi110.stdout:1/830: dread de/d15/fed [0,4194304] 0 2024-04-12T13:42:20.404 INFO:tasks.workunit.client.1.smithi110.stdout:3/820: creat d5/dc/d20/d2d/d4e/d89/d8c/db6/f105 x:0 0 0 2024-04-12T13:42:20.409 INFO:tasks.workunit.client.1.smithi110.stdout:6/831: getdents d7/da4/df8 0 2024-04-12T13:42:20.410 INFO:tasks.workunit.client.1.smithi110.stdout:3/821: write d5/dc/d31/d3b/d32/f78 [3456005,50554] 0 2024-04-12T13:42:20.412 INFO:tasks.workunit.client.1.smithi110.stdout:8/862: dwrite d1/d3/d35/d3a/d41/d77/fb1 [0,4194304] 0 2024-04-12T13:42:20.416 INFO:tasks.workunit.client.0.smithi060.stdout:8/787: mkdir d9/d1b/d37/d4d/d63/d66/d111 0 2024-04-12T13:42:20.417 INFO:tasks.workunit.client.1.smithi110.stdout:9/928: dwrite df/d13/d2c/d2d/d39/f44 [0,4194304] 0 2024-04-12T13:42:20.422 INFO:tasks.workunit.client.1.smithi110.stdout:1/831: dread de/d15/fed [0,4194304] 0 2024-04-12T13:42:20.427 INFO:tasks.workunit.client.0.smithi060.stdout:0/759: rename d7/l1f to d7/d9/de/d63/l102 0 2024-04-12T13:42:20.440 INFO:tasks.workunit.client.1.smithi110.stdout:0/776: write d1/f26 [174584,88334] 0 2024-04-12T13:42:20.443 INFO:tasks.workunit.client.1.smithi110.stdout:4/943: dwrite d0/d75/d84/fee [0,4194304] 0 2024-04-12T13:42:20.448 INFO:tasks.workunit.client.0.smithi060.stdout:7/769: dwrite d0/f3a [0,4194304] 0 2024-04-12T13:42:20.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/828: dwrite d6/dae/d31/d33/f39 [0,4194304] 0 2024-04-12T13:42:20.453 INFO:tasks.workunit.client.0.smithi060.stdout:1/929: dwrite d1e/dcc/ff4 [0,4194304] 0 2024-04-12T13:42:20.455 INFO:tasks.workunit.client.1.smithi110.stdout:8/863: stat d1/d3/d3c/cfd 0 2024-04-12T13:42:20.456 INFO:tasks.workunit.client.1.smithi110.stdout:8/864: dread - d1/f107 zero size 2024-04-12T13:42:20.460 INFO:tasks.workunit.client.1.smithi110.stdout:8/865: truncate d1/d3/d35/d3a/d3e/d64/d85/de1/f11a 145664 0 2024-04-12T13:42:20.465 INFO:tasks.workunit.client.1.smithi110.stdout:2/880: mknod d6/dc/d1b/d57/d62/c10e 0 2024-04-12T13:42:20.471 INFO:tasks.workunit.client.1.smithi110.stdout:5/816: sync 2024-04-12T13:42:20.472 INFO:tasks.workunit.client.0.smithi060.stdout:6/839: write d1/d7/da/dc/d24/d30/d52/d78/d80/d93/ff2 [579857,14689] 0 2024-04-12T13:42:20.475 INFO:tasks.workunit.client.1.smithi110.stdout:5/817: chown da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/lcf 67528270 1 2024-04-12T13:42:20.477 INFO:tasks.workunit.client.1.smithi110.stdout:1/832: creat de/d15/dab/f117 x:0 0 0 2024-04-12T13:42:20.482 INFO:tasks.workunit.client.0.smithi060.stdout:2/829: fdatasync d6/dae/d31/d33/fa5 0 2024-04-12T13:42:20.483 INFO:tasks.workunit.client.0.smithi060.stdout:3/813: dwrite d7/d17/d27/d36/db0/fb7 [0,4194304] 0 2024-04-12T13:42:20.486 INFO:tasks.workunit.client.0.smithi060.stdout:8/788: dwrite d9/d1b/d2b/fe0 [4194304,4194304] 0 2024-04-12T13:42:20.492 INFO:tasks.workunit.client.0.smithi060.stdout:8/789: fdatasync d9/d1b/d37/d4d/f6b 0 2024-04-12T13:42:20.492 INFO:tasks.workunit.client.0.smithi060.stdout:9/724: creat d4/d9/ff2 x:0 0 0 2024-04-12T13:42:20.493 INFO:tasks.workunit.client.1.smithi110.stdout:6/832: symlink d7/d25/d30/d44/l101 0 2024-04-12T13:42:20.497 INFO:tasks.workunit.client.0.smithi060.stdout:5/802: rename d6/d10/f2b to d6/dd/d1f/d25/d103/f108 0 2024-04-12T13:42:20.504 INFO:tasks.workunit.client.1.smithi110.stdout:3/822: write d5/dc/f53 [436995,97216] 0 2024-04-12T13:42:20.505 INFO:tasks.workunit.client.0.smithi060.stdout:1/930: fsync d1e/d29/d65/fb5 0 2024-04-12T13:42:20.507 INFO:tasks.workunit.client.1.smithi110.stdout:9/929: write df/d13/d2c/d2d/f93 [664254,64987] 0 2024-04-12T13:42:20.510 INFO:tasks.workunit.client.0.smithi060.stdout:3/814: creat d7/d17/d27/da7/dbe/f108 x:0 0 0 2024-04-12T13:42:20.519 INFO:tasks.workunit.client.0.smithi060.stdout:0/760: dwrite d7/d9/de/fce [0,4194304] 0 2024-04-12T13:42:20.521 INFO:tasks.workunit.client.1.smithi110.stdout:4/944: dwrite d0/d75/d84/fee [4194304,4194304] 0 2024-04-12T13:42:20.524 INFO:tasks.workunit.client.1.smithi110.stdout:4/945: dread - d0/de/da0/dd9/df3/de0/d7e/f12d zero size 2024-04-12T13:42:20.524 INFO:tasks.workunit.client.1.smithi110.stdout:6/833: rename d7/d10/fb6 to d7/d10/d7e/d85/f102 0 2024-04-12T13:42:20.529 INFO:tasks.workunit.client.0.smithi060.stdout:6/840: rename d1/d7/da/dc/d24/d34/d51/d59 to d1/d7/da/dc/d7a/de1/d113 0 2024-04-12T13:42:20.530 INFO:tasks.workunit.client.1.smithi110.stdout:7/874: sync 2024-04-12T13:42:20.532 INFO:tasks.workunit.client.0.smithi060.stdout:9/725: write d4/d9/d19/f1a [1158927,31253] 0 2024-04-12T13:42:20.532 INFO:tasks.workunit.client.1.smithi110.stdout:5/818: creat da/d2e/d45/d25/d9d/d79/d82/f11b x:0 0 0 2024-04-12T13:42:20.536 INFO:tasks.workunit.client.1.smithi110.stdout:2/881: dwrite d6/dc/dd/d49/d64/d4a/f72 [0,4194304] 0 2024-04-12T13:42:20.537 INFO:tasks.workunit.client.1.smithi110.stdout:8/866: dread d1/d3/d35/d3a/fac [0,4194304] 0 2024-04-12T13:42:20.542 INFO:tasks.workunit.client.1.smithi110.stdout:3/823: dread d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:20.547 INFO:tasks.workunit.client.0.smithi060.stdout:7/770: link d0/c3e d0/d7/d43/d63/d90/de7/cfa 0 2024-04-12T13:42:20.547 INFO:tasks.workunit.client.1.smithi110.stdout:3/824: readlink d5/dc/d20/d2d/l88 0 2024-04-12T13:42:20.549 INFO:tasks.workunit.client.0.smithi060.stdout:7/771: stat d0/d7/d92/cb2 0 2024-04-12T13:42:20.550 INFO:tasks.workunit.client.1.smithi110.stdout:2/882: creat d6/d53/f10f x:0 0 0 2024-04-12T13:42:20.553 INFO:tasks.workunit.client.1.smithi110.stdout:0/777: dwrite d1/d3c/da6/fcd [0,4194304] 0 2024-04-12T13:42:20.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/761: creat d7/d9/d14/d35/d44/d8c/d8d/de5/f103 x:0 0 0 2024-04-12T13:42:20.555 INFO:tasks.workunit.client.0.smithi060.stdout:4/749: sync 2024-04-12T13:42:20.556 INFO:tasks.workunit.client.0.smithi060.stdout:2/830: rename d6/d64/d99/df0/d16/dda/cf9 to d6/d64/cfe 0 2024-04-12T13:42:20.556 INFO:tasks.workunit.client.1.smithi110.stdout:3/825: readlink d5/dc/d20/d2d/l88 0 2024-04-12T13:42:20.560 INFO:tasks.workunit.client.0.smithi060.stdout:9/726: mknod d4/d9/d19/cf3 0 2024-04-12T13:42:20.561 INFO:tasks.workunit.client.0.smithi060.stdout:5/803: dread - d6/dd/d27/d7d/fd7 zero size 2024-04-12T13:42:20.563 INFO:tasks.workunit.client.1.smithi110.stdout:6/834: mkdir d7/d25/d2c/d4c/d77/d103 0 2024-04-12T13:42:20.564 INFO:tasks.workunit.client.0.smithi060.stdout:3/815: fsync d7/d17/f72 0 2024-04-12T13:42:20.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/772: unlink d0/f3a 0 2024-04-12T13:42:20.565 INFO:tasks.workunit.client.1.smithi110.stdout:1/833: dread de/d1d/f42 [0,4194304] 0 2024-04-12T13:42:20.566 INFO:tasks.workunit.client.1.smithi110.stdout:7/875: dwrite d1/d3/d4/dbf/db6/fea [0,4194304] 0 2024-04-12T13:42:20.566 INFO:tasks.workunit.client.0.smithi060.stdout:7/773: readlink d0/l5c 0 2024-04-12T13:42:20.567 INFO:tasks.workunit.client.1.smithi110.stdout:4/946: creat d0/d19/d1c/d50/f13d x:0 0 0 2024-04-12T13:42:20.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/831: fdatasync d6/f9b 0 2024-04-12T13:42:20.571 INFO:tasks.workunit.client.0.smithi060.stdout:6/841: mknod d1/d7/da/dc/dac/dca/c114 0 2024-04-12T13:42:20.574 INFO:tasks.workunit.client.1.smithi110.stdout:6/835: mknod d7/da4/c104 0 2024-04-12T13:42:20.576 INFO:tasks.workunit.client.0.smithi060.stdout:4/750: creat d6/d7/dd/d1a/d57/d63/d68/d76/dbd/ff1 x:0 0 0 2024-04-12T13:42:20.577 INFO:tasks.workunit.client.1.smithi110.stdout:8/867: dwrite d1/d3/d35/d3a/d41/dd7/f10a [0,4194304] 0 2024-04-12T13:42:20.579 INFO:tasks.workunit.client.0.smithi060.stdout:1/931: dread d1e/f45 [0,4194304] 0 2024-04-12T13:42:20.579 INFO:tasks.workunit.client.0.smithi060.stdout:4/751: chown d6/d7/dd/d1a/d57/dc7/df0 2992156 1 2024-04-12T13:42:20.582 INFO:tasks.workunit.client.0.smithi060.stdout:1/932: stat d1e/d23/d49/d4e/d9b 0 2024-04-12T13:42:20.583 INFO:tasks.workunit.client.1.smithi110.stdout:0/778: truncate d1/d5e/fba 762152 0 2024-04-12T13:42:20.584 INFO:tasks.workunit.client.0.smithi060.stdout:9/727: dwrite d4/d9/d19/d21/fe9 [0,4194304] 0 2024-04-12T13:42:20.584 INFO:tasks.workunit.client.0.smithi060.stdout:0/762: mkdir d7/d9/d14/d35/d44/d7d/de8/d104 0 2024-04-12T13:42:20.585 INFO:tasks.workunit.client.1.smithi110.stdout:9/930: dwrite df/d13/d3b/d40/d56/fbc [0,4194304] 0 2024-04-12T13:42:20.585 INFO:tasks.workunit.client.1.smithi110.stdout:1/834: rmdir de/d15/d32/d61/d6a 39 2024-04-12T13:42:20.588 INFO:tasks.workunit.client.1.smithi110.stdout:3/826: truncate d5/dc/d31/d3b/f9d 4436070 0 2024-04-12T13:42:20.589 INFO:tasks.workunit.client.0.smithi060.stdout:5/804: creat d6/dd/d1f/dd3/df3/d4c/f109 x:0 0 0 2024-04-12T13:42:20.589 INFO:tasks.workunit.client.1.smithi110.stdout:5/819: dwrite da/d2e/d45/d25/d9d/d79/d9e/fd5 [0,4194304] 0 2024-04-12T13:42:20.590 INFO:tasks.workunit.client.0.smithi060.stdout:3/816: dread d7/d17/d19/f48 [0,4194304] 0 2024-04-12T13:42:20.590 INFO:tasks.workunit.client.1.smithi110.stdout:4/947: symlink d0/de/da0/d111/l13e 0 2024-04-12T13:42:20.593 INFO:tasks.workunit.client.0.smithi060.stdout:3/817: chown d7/d17/d19/f48 259702 1 2024-04-12T13:42:20.596 INFO:tasks.workunit.client.1.smithi110.stdout:4/948: dread - d0/de/da0/dd9/df3/de0/d7e/f12d zero size 2024-04-12T13:42:20.597 INFO:tasks.workunit.client.1.smithi110.stdout:2/883: truncate d6/dc/d13/d80/ffa 1222188 0 2024-04-12T13:42:20.600 INFO:tasks.workunit.client.1.smithi110.stdout:4/949: chown d0/d75/d84/d89 35302082 1 2024-04-12T13:42:20.602 INFO:tasks.workunit.client.1.smithi110.stdout:4/950: write d0/de/d2c/fc2 [4096099,121209] 0 2024-04-12T13:42:20.603 INFO:tasks.workunit.client.1.smithi110.stdout:0/779: mknod d1/d56/c116 0 2024-04-12T13:42:20.607 INFO:tasks.workunit.client.1.smithi110.stdout:4/951: chown d0/de/da0/lac 37 1 2024-04-12T13:42:20.609 INFO:tasks.workunit.client.1.smithi110.stdout:1/835: creat de/d14/d34/d108/d10e/f118 x:0 0 0 2024-04-12T13:42:20.610 INFO:tasks.workunit.client.1.smithi110.stdout:1/836: readlink de/d14/d34/l99 0 2024-04-12T13:42:20.610 INFO:tasks.workunit.client.1.smithi110.stdout:9/931: readlink df/d13/d2c/d2d/dc1/d83/d63/db4/lf3 0 2024-04-12T13:42:20.612 INFO:tasks.workunit.client.1.smithi110.stdout:1/837: chown de/d15/c5a 12 1 2024-04-12T13:42:20.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/805: dwrite d6/dd/d1f/d25/d42/d52/d7a/fc3 [0,4194304] 0 2024-04-12T13:42:20.620 INFO:tasks.workunit.client.0.smithi060.stdout:9/728: creat d4/d8/d32/ff4 x:0 0 0 2024-04-12T13:42:20.620 INFO:tasks.workunit.client.1.smithi110.stdout:5/820: mkdir da/d2e/d45/d25/d9d/d7a/db5/df3/d11c 0 2024-04-12T13:42:20.625 INFO:tasks.workunit.client.1.smithi110.stdout:6/836: readlink d7/d10/d7e/l8f 0 2024-04-12T13:42:20.626 INFO:tasks.workunit.client.0.smithi060.stdout:8/790: rename d9/d1b/d84/da0/l1c to d9/d1b/d2b/l112 0 2024-04-12T13:42:20.626 INFO:tasks.workunit.client.1.smithi110.stdout:9/932: dread df/d13/d2c/d2d/d39/f44 [0,4194304] 0 2024-04-12T13:42:20.628 INFO:tasks.workunit.client.1.smithi110.stdout:3/827: dread d5/dc/f85 [0,4194304] 0 2024-04-12T13:42:20.628 INFO:tasks.workunit.client.1.smithi110.stdout:9/933: fsync df/d38/d6e/d7f/f12f 0 2024-04-12T13:42:20.629 INFO:tasks.workunit.client.1.smithi110.stdout:2/884: creat d6/dc/dd/d49/d64/d5d/db9/f110 x:0 0 0 2024-04-12T13:42:20.631 INFO:tasks.workunit.client.1.smithi110.stdout:2/885: chown d6/dc/d13/d80/l85 12188793 1 2024-04-12T13:42:20.632 INFO:tasks.workunit.client.0.smithi060.stdout:2/832: write d6/dae/d5b/fbe [244060,57505] 0 2024-04-12T13:42:20.636 INFO:tasks.workunit.client.0.smithi060.stdout:2/833: write d6/dae/f67 [3969429,117987] 0 2024-04-12T13:42:20.638 INFO:tasks.workunit.client.1.smithi110.stdout:0/780: mknod d1/d3c/c117 0 2024-04-12T13:42:20.640 INFO:tasks.workunit.client.1.smithi110.stdout:7/876: dwrite d1/d3/d4/dbf/db6/fc8 [0,4194304] 0 2024-04-12T13:42:20.640 INFO:tasks.workunit.client.0.smithi060.stdout:3/818: creat d7/d17/d27/da7/dbe/dce/de6/dea/f109 x:0 0 0 2024-04-12T13:42:20.646 INFO:tasks.workunit.client.0.smithi060.stdout:4/752: symlink d6/dd3/lf2 0 2024-04-12T13:42:20.651 INFO:tasks.workunit.client.0.smithi060.stdout:6/842: dread d1/d7/da/dc/d24/d30/d52/d5e/f63 [0,4194304] 0 2024-04-12T13:42:20.652 INFO:tasks.workunit.client.0.smithi060.stdout:5/806: rmdir d6/d10 39 2024-04-12T13:42:20.654 INFO:tasks.workunit.client.0.smithi060.stdout:1/933: dwrite d1e/d23/d49/f54 [4194304,4194304] 0 2024-04-12T13:42:20.655 INFO:tasks.workunit.client.0.smithi060.stdout:5/807: readlink d6/dd/l95 0 2024-04-12T13:42:20.657 INFO:tasks.workunit.client.0.smithi060.stdout:9/729: creat d4/d8/df1/d67/ff5 x:0 0 0 2024-04-12T13:42:20.662 INFO:tasks.workunit.client.0.smithi060.stdout:0/763: link d7/d9/d14/d35/d44/d49/fd7 d7/d9/de/d80/f105 0 2024-04-12T13:42:20.665 INFO:tasks.workunit.client.1.smithi110.stdout:3/828: dread d5/f43 [0,4194304] 0 2024-04-12T13:42:20.665 INFO:tasks.workunit.client.1.smithi110.stdout:4/952: write d0/d75/f9a [2276180,86510] 0 2024-04-12T13:42:20.668 INFO:tasks.workunit.client.0.smithi060.stdout:3/819: mkdir d7/d17/d27/d36/d53/da2/d10a 0 2024-04-12T13:42:20.668 INFO:tasks.workunit.client.1.smithi110.stdout:4/953: write d0/de/da0/dd9/df3/de0/d7e/f11e [212083,16830] 0 2024-04-12T13:42:20.670 INFO:tasks.workunit.client.1.smithi110.stdout:5/821: write da/d2e/d45/d29/d32/f36 [1821878,106721] 0 2024-04-12T13:42:20.671 INFO:tasks.workunit.client.1.smithi110.stdout:0/781: creat d1/d56/f118 x:0 0 0 2024-04-12T13:42:20.679 INFO:tasks.workunit.client.0.smithi060.stdout:1/934: unlink d1e/d23/dd9/dae/f132 0 2024-04-12T13:42:20.681 INFO:tasks.workunit.client.1.smithi110.stdout:6/837: dwrite d7/d25/d2c/d4c/d77/db9/fdd [0,4194304] 0 2024-04-12T13:42:20.683 INFO:tasks.workunit.client.0.smithi060.stdout:9/730: unlink d4/d8/df1/d67/f39 0 2024-04-12T13:42:20.684 INFO:tasks.workunit.client.0.smithi060.stdout:6/843: dread d1/d7/da/dc/d24/d34/d51/d97/f9d [0,4194304] 0 2024-04-12T13:42:20.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/774: getdents d0/d7/d43/d4d/dde 0 2024-04-12T13:42:20.685 INFO:tasks.workunit.client.1.smithi110.stdout:9/934: dwrite df/d13/f87 [0,4194304] 0 2024-04-12T13:42:20.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/764: mkdir d7/d9/d14/d35/d44/d8c/d106 0 2024-04-12T13:42:20.689 INFO:tasks.workunit.client.1.smithi110.stdout:2/886: getdents d6/dc/d1b/d109 0 2024-04-12T13:42:20.692 INFO:tasks.workunit.client.1.smithi110.stdout:3/829: creat d5/dc/d31/d3b/d32/d3e/d5f/f106 x:0 0 0 2024-04-12T13:42:20.693 INFO:tasks.workunit.client.1.smithi110.stdout:7/877: dwrite d1/d1b/d3d/d68/f11b [0,4194304] 0 2024-04-12T13:42:20.693 INFO:tasks.workunit.client.1.smithi110.stdout:4/954: mkdir d0/d75/d84/d89/d103/d13f 0 2024-04-12T13:42:20.694 INFO:tasks.workunit.client.1.smithi110.stdout:2/887: chown d6/dc/dd/d49/d64/d4a/dc1/dd0/fd2 90 1 2024-04-12T13:42:20.696 INFO:tasks.workunit.client.0.smithi060.stdout:4/753: dwrite d6/d21/fc3 [0,4194304] 0 2024-04-12T13:42:20.697 INFO:tasks.workunit.client.1.smithi110.stdout:4/955: chown d0/d19/d1c/f58 3 1 2024-04-12T13:42:20.698 INFO:tasks.workunit.client.1.smithi110.stdout:0/782: creat d1/d5e/f119 x:0 0 0 2024-04-12T13:42:20.699 INFO:tasks.workunit.client.1.smithi110.stdout:2/888: chown d6/dc/dd/d49/d64/d5d/db9/lba 4 1 2024-04-12T13:42:20.704 INFO:tasks.workunit.client.1.smithi110.stdout:3/830: dread d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:20.707 INFO:tasks.workunit.client.0.smithi060.stdout:3/820: mknod d7/d17/d27/d36/d53/da2/dbc/dfa/c10b 0 2024-04-12T13:42:20.708 INFO:tasks.workunit.client.1.smithi110.stdout:8/868: sync 2024-04-12T13:42:20.708 INFO:tasks.workunit.client.0.smithi060.stdout:2/834: write d6/d64/d99/df0/daa/db0/f97 [941255,58466] 0 2024-04-12T13:42:20.712 INFO:tasks.workunit.client.0.smithi060.stdout:9/731: creat d4/d9/d19/d21/dbf/dce/ff6 x:0 0 0 2024-04-12T13:42:20.716 INFO:tasks.workunit.client.1.smithi110.stdout:7/878: dread d1/d1b/d74/f79 [0,4194304] 0 2024-04-12T13:42:20.718 INFO:tasks.workunit.client.1.smithi110.stdout:1/838: dwrite de/d14/d83/fe2 [0,4194304] 0 2024-04-12T13:42:20.718 INFO:tasks.workunit.client.1.smithi110.stdout:9/935: dread df/f19 [0,4194304] 0 2024-04-12T13:42:20.719 INFO:tasks.workunit.client.0.smithi060.stdout:4/754: unlink d6/f2e 0 2024-04-12T13:42:20.719 INFO:tasks.workunit.client.0.smithi060.stdout:9/732: chown d4/d9/dbd 5453315 1 2024-04-12T13:42:20.720 INFO:tasks.workunit.client.1.smithi110.stdout:5/822: creat da/d2e/d45/d29/d105/dea/f11d x:0 0 0 2024-04-12T13:42:20.720 INFO:tasks.workunit.client.1.smithi110.stdout:0/783: dread d1/d27/d31/f64 [0,4194304] 0 2024-04-12T13:42:20.725 INFO:tasks.workunit.client.1.smithi110.stdout:5/823: fdatasync da/f11 0 2024-04-12T13:42:20.725 INFO:tasks.workunit.client.0.smithi060.stdout:9/733: write d4/d8/df1/d67/fed [1018549,100210] 0 2024-04-12T13:42:20.726 INFO:tasks.workunit.client.0.smithi060.stdout:5/808: dread d6/dd/d1f/dd3/df3/d38/f86 [0,4194304] 0 2024-04-12T13:42:20.728 INFO:tasks.workunit.client.0.smithi060.stdout:0/765: link d7/d9/de/f91 d7/d9/d14/d35/d44/d7d/f107 0 2024-04-12T13:42:20.734 INFO:tasks.workunit.client.0.smithi060.stdout:1/935: truncate d1e/d23/d2e/d30/f5c 133545 0 2024-04-12T13:42:20.736 INFO:tasks.workunit.client.0.smithi060.stdout:5/809: truncate d6/dd/d1f/d25/d42/d52/d7a/fb0 4669149 0 2024-04-12T13:42:20.736 INFO:tasks.workunit.client.1.smithi110.stdout:8/869: dwrite d1/d3/fd9 [0,4194304] 0 2024-04-12T13:42:20.736 INFO:tasks.workunit.client.1.smithi110.stdout:1/839: mkdir de/d14/d34/d108/d119 0 2024-04-12T13:42:20.738 INFO:tasks.workunit.client.0.smithi060.stdout:6/844: truncate d1/d7/da/dc/d24/d2d/db3/f102 1264212 0 2024-04-12T13:42:20.739 INFO:tasks.workunit.client.1.smithi110.stdout:7/879: dread d1/d1b/d3d/d68/f11b [0,4194304] 0 2024-04-12T13:42:20.740 INFO:tasks.workunit.client.1.smithi110.stdout:0/784: mknod d1/d27/c11a 0 2024-04-12T13:42:20.741 INFO:tasks.workunit.client.1.smithi110.stdout:0/785: fsync d1/d48/f5b 0 2024-04-12T13:42:20.744 INFO:tasks.workunit.client.0.smithi060.stdout:0/766: rmdir d7/d41/dbc 39 2024-04-12T13:42:20.744 INFO:tasks.workunit.client.0.smithi060.stdout:6/845: stat d1/d7/da/dc/dac 0 2024-04-12T13:42:20.745 INFO:tasks.workunit.client.0.smithi060.stdout:9/734: dread d4/d8/f6d [0,4194304] 0 2024-04-12T13:42:20.745 INFO:tasks.workunit.client.1.smithi110.stdout:9/936: mkdir df/d13/d26/d37/d6a/dfe/d136 0 2024-04-12T13:42:20.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/936: mknod d1e/d94/dd4/c142 0 2024-04-12T13:42:20.751 INFO:tasks.workunit.client.1.smithi110.stdout:6/838: creat d7/d10/d1c/d2b/d3a/dbf/f105 x:0 0 0 2024-04-12T13:42:20.753 INFO:tasks.workunit.client.1.smithi110.stdout:6/839: chown d7/d10/d1c/d2b/d48/d54/ff5 5748 1 2024-04-12T13:42:20.754 INFO:tasks.workunit.client.1.smithi110.stdout:1/840: unlink de/d1d/f114 0 2024-04-12T13:42:20.757 INFO:tasks.workunit.client.1.smithi110.stdout:4/956: write d0/d78/fd2 [850124,5557] 0 2024-04-12T13:42:20.759 INFO:tasks.workunit.client.1.smithi110.stdout:2/889: dread d6/f12 [0,4194304] 0 2024-04-12T13:42:20.762 INFO:tasks.workunit.client.1.smithi110.stdout:2/890: read d6/dc/d1b/d57/d62/db4/fcd [1023011,34113] 0 2024-04-12T13:42:20.763 INFO:tasks.workunit.client.1.smithi110.stdout:2/891: dread - d6/dc/d1b/d57/d62/dcb/ff0 zero size 2024-04-12T13:42:20.765 INFO:tasks.workunit.client.0.smithi060.stdout:1/937: rmdir d1e/dcc 39 2024-04-12T13:42:20.768 INFO:tasks.workunit.client.0.smithi060.stdout:4/755: dread d6/d7/dd/d1a/f60 [0,4194304] 0 2024-04-12T13:42:20.770 INFO:tasks.workunit.client.0.smithi060.stdout:5/810: dread d6/d10/de9/fcc [0,4194304] 0 2024-04-12T13:42:20.770 INFO:tasks.workunit.client.1.smithi110.stdout:7/880: rename d1/d3/d4/dbf/fac to d1/d1b/dc6/f125 0 2024-04-12T13:42:20.771 INFO:tasks.workunit.client.1.smithi110.stdout:3/831: write d5/dc/d20/d2d/d4e/f6d [3942530,123783] 0 2024-04-12T13:42:20.772 INFO:tasks.workunit.client.0.smithi060.stdout:0/767: symlink d7/d9/d14/d35/d44/d8c/d8d/de5/l108 0 2024-04-12T13:42:20.773 INFO:tasks.workunit.client.0.smithi060.stdout:7/775: truncate d0/d1b/f37 2677806 0 2024-04-12T13:42:20.773 INFO:tasks.workunit.client.1.smithi110.stdout:3/832: readlink d5/dc/d31/d3b/d32/d3e/lff 0 2024-04-12T13:42:20.775 INFO:tasks.workunit.client.1.smithi110.stdout:5/824: truncate f5 4187269 0 2024-04-12T13:42:20.778 INFO:tasks.workunit.client.1.smithi110.stdout:5/825: chown da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/d7c/fef 33133696 1 2024-04-12T13:42:20.778 INFO:tasks.workunit.client.0.smithi060.stdout:2/835: dwrite d6/d56/d86/fbc [0,4194304] 0 2024-04-12T13:42:20.779 INFO:tasks.workunit.client.1.smithi110.stdout:5/826: truncate da/db/d3b/ffa 649968 0 2024-04-12T13:42:20.781 INFO:tasks.workunit.client.0.smithi060.stdout:9/735: unlink d4/c46 0 2024-04-12T13:42:20.784 INFO:tasks.workunit.client.1.smithi110.stdout:6/840: chown d7/d25/d2c/d4c/da6/cbe 6 1 2024-04-12T13:42:20.785 INFO:tasks.workunit.client.1.smithi110.stdout:6/841: fsync d7/d10/d1c/d2b/d48/d54/ff1 0 2024-04-12T13:42:20.787 INFO:tasks.workunit.client.1.smithi110.stdout:6/842: chown d7/d25/d2c/d4c/d77/cc0 768 1 2024-04-12T13:42:20.790 INFO:tasks.workunit.client.1.smithi110.stdout:4/957: dread - d0/d75/ffc zero size 2024-04-12T13:42:20.791 INFO:tasks.workunit.client.0.smithi060.stdout:9/736: truncate d4/d8/df1/d67/ff5 229929 0 2024-04-12T13:42:20.792 INFO:tasks.workunit.client.1.smithi110.stdout:6/843: truncate d7/d10/d1c/d2b/d48/d54/ff5 712941 0 2024-04-12T13:42:20.794 INFO:tasks.workunit.client.0.smithi060.stdout:5/811: rmdir d6/dd/d1f/dd3/d5f 39 2024-04-12T13:42:20.794 INFO:tasks.workunit.client.0.smithi060.stdout:3/821: dwrite d7/d17/d27/d36/db0/dc4/fee [0,4194304] 0 2024-04-12T13:42:20.798 INFO:tasks.workunit.client.0.smithi060.stdout:5/812: chown d6/dd/d1f/dd3/df3/l7b 0 1 2024-04-12T13:42:20.803 INFO:tasks.workunit.client.0.smithi060.stdout:1/938: dwrite d1e/d94/fe9 [0,4194304] 0 2024-04-12T13:42:20.808 INFO:tasks.workunit.client.1.smithi110.stdout:9/937: rename df/d13/d3b/d40/d56/fd5 to df/d8a/f137 0 2024-04-12T13:42:20.810 INFO:tasks.workunit.client.1.smithi110.stdout:9/938: readlink df/d38/d6e/dcb/l10d 0 2024-04-12T13:42:20.815 INFO:tasks.workunit.client.1.smithi110.stdout:0/786: write d1/f14 [5010155,65396] 0 2024-04-12T13:42:20.815 INFO:tasks.workunit.client.0.smithi060.stdout:2/836: rename d6/dae/d5b/d6d/de1/le6 to d6/d64/d99/lff 0 2024-04-12T13:42:20.820 INFO:tasks.workunit.client.1.smithi110.stdout:3/833: fdatasync d5/dc/d20/d2d/d4e/f66 0 2024-04-12T13:42:20.822 INFO:tasks.workunit.client.0.smithi060.stdout:0/768: mknod d7/d9/d14/d35/c109 0 2024-04-12T13:42:20.826 INFO:tasks.workunit.client.0.smithi060.stdout:5/813: fdatasync d6/dd/fd1 0 2024-04-12T13:42:20.827 INFO:tasks.workunit.client.1.smithi110.stdout:8/870: link d1/d3/fe d1/d45/f11b 0 2024-04-12T13:42:20.828 INFO:tasks.workunit.client.0.smithi060.stdout:5/814: chown d6/dd/f45 475710381 1 2024-04-12T13:42:20.830 INFO:tasks.workunit.client.1.smithi110.stdout:7/881: write d1/d1b/d74/fbb [775686,83295] 0 2024-04-12T13:42:20.830 INFO:tasks.workunit.client.1.smithi110.stdout:1/841: dwrite de/d14/dd0/f92 [0,4194304] 0 2024-04-12T13:42:20.831 INFO:tasks.workunit.client.1.smithi110.stdout:8/871: dread d1/d5/d1f/fbb [4194304,4194304] 0 2024-04-12T13:42:20.833 INFO:tasks.workunit.client.1.smithi110.stdout:2/892: rename d6/d18 to d6/dc/db1/d111 0 2024-04-12T13:42:20.834 INFO:tasks.workunit.client.0.smithi060.stdout:9/737: write d4/f77 [2193024,29089] 0 2024-04-12T13:42:20.836 INFO:tasks.workunit.client.1.smithi110.stdout:9/939: symlink df/d13/d2c/d66/l138 0 2024-04-12T13:42:20.838 INFO:tasks.workunit.client.1.smithi110.stdout:6/844: write d7/d25/d30/d44/d3d/fb3 [742225,73236] 0 2024-04-12T13:42:20.842 INFO:tasks.workunit.client.1.smithi110.stdout:6/845: chown d7/d10/d1c/d2b/d48/d54/ff1 119 1 2024-04-12T13:42:20.847 INFO:tasks.workunit.client.0.smithi060.stdout:9/738: dread d4/f6f [0,4194304] 0 2024-04-12T13:42:20.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/822: symlink d7/d17/l10c 0 2024-04-12T13:42:20.852 INFO:tasks.workunit.client.1.smithi110.stdout:9/940: dwrite df/d13/d3b/d40/d56/fbc [0,4194304] 0 2024-04-12T13:42:20.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/815: dread d6/dd/d1f/d25/d53/fd9 [0,4194304] 0 2024-04-12T13:42:20.856 INFO:tasks.workunit.client.1.smithi110.stdout:7/882: stat d1/d3/d43/l6e 0 2024-04-12T13:42:20.857 INFO:tasks.workunit.client.0.smithi060.stdout:5/816: stat d6/d10/db8/dee/dfc/d3d/cd4 0 2024-04-12T13:42:20.858 INFO:tasks.workunit.client.1.smithi110.stdout:7/883: chown d1/d3/d4/dbf/f95 338588815 1 2024-04-12T13:42:20.859 INFO:tasks.workunit.client.0.smithi060.stdout:1/939: symlink d1e/d23/d2e/d86/ddb/l143 0 2024-04-12T13:42:20.860 INFO:tasks.workunit.client.1.smithi110.stdout:7/884: write d1/d3/f6d [4488885,25666] 0 2024-04-12T13:42:20.861 INFO:tasks.workunit.client.1.smithi110.stdout:8/872: mknod d1/d3/d3c/d5a/d6f/d83/c11c 0 2024-04-12T13:42:20.861 INFO:tasks.workunit.client.1.smithi110.stdout:3/834: dwrite d5/dc/d20/f36 [4194304,4194304] 0 2024-04-12T13:42:20.864 INFO:tasks.workunit.client.0.smithi060.stdout:4/756: link d6/d21/d29/f7f d6/d7/dd/d1a/ff3 0 2024-04-12T13:42:20.865 INFO:tasks.workunit.client.1.smithi110.stdout:4/958: rename d0/de/da0/dd9/df3/de0/dfa/f121 to d0/d75/d84/d89/f140 0 2024-04-12T13:42:20.865 INFO:tasks.workunit.client.0.smithi060.stdout:2/837: mknod d6/dae/d5b/c100 0 2024-04-12T13:42:20.866 INFO:tasks.workunit.client.1.smithi110.stdout:1/842: rename de/d15/d32/d61/d6a to de/d15/d32/d61/d6a/dac/d11a 22 2024-04-12T13:42:20.866 INFO:tasks.workunit.client.1.smithi110.stdout:8/873: chown d1/d3/d35/d3a/d3e/l86 24019156 1 2024-04-12T13:42:20.866 INFO:tasks.workunit.client.1.smithi110.stdout:3/835: dread - d5/dc/d20/d2d/d4e/d89/d8c/db6/f105 zero size 2024-04-12T13:42:20.866 INFO:tasks.workunit.client.1.smithi110.stdout:2/893: mkdir d6/dc/dd/d49/d64/d4a/d51/d112 0 2024-04-12T13:42:20.868 INFO:tasks.workunit.client.0.smithi060.stdout:4/757: fsync d6/d7/dd/d1a/d57/d63/fe3 0 2024-04-12T13:42:20.869 INFO:tasks.workunit.client.0.smithi060.stdout:0/769: truncate d7/d9/f23 1311621 0 2024-04-12T13:42:20.869 INFO:tasks.workunit.client.0.smithi060.stdout:2/838: chown d6/dae/d5b/d6d/de1/ff7 1382 1 2024-04-12T13:42:20.870 INFO:tasks.workunit.client.1.smithi110.stdout:1/843: write de/d14/d34/d55/d6b/f7c [2945688,2840] 0 2024-04-12T13:42:20.871 INFO:tasks.workunit.client.0.smithi060.stdout:1/940: dread d1e/d23/d2e/d30/f5f [0,4194304] 0 2024-04-12T13:42:20.871 INFO:tasks.workunit.client.0.smithi060.stdout:9/739: rmdir d4/d33/d50/dd0 39 2024-04-12T13:42:20.873 INFO:tasks.workunit.client.0.smithi060.stdout:0/770: chown d7/d9/d14/d35/c37 7691 1 2024-04-12T13:42:20.874 INFO:tasks.workunit.client.1.smithi110.stdout:6/846: read - d7/d25/d2c/d4c/d77/f96 zero size 2024-04-12T13:42:20.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/823: fdatasync d7/d17/d27/d36/f46 0 2024-04-12T13:42:20.876 INFO:tasks.workunit.client.1.smithi110.stdout:7/885: symlink d1/d31/d7b/l126 0 2024-04-12T13:42:20.877 INFO:tasks.workunit.client.0.smithi060.stdout:3/824: readlink d7/d17/d19/d96/dfe/lff 0 2024-04-12T13:42:20.879 INFO:tasks.workunit.client.0.smithi060.stdout:9/740: unlink d4/d9/d19/f1a 0 2024-04-12T13:42:20.880 INFO:tasks.workunit.client.1.smithi110.stdout:4/959: creat d0/de/da0/d111/f141 x:0 0 0 2024-04-12T13:42:20.881 INFO:tasks.workunit.client.0.smithi060.stdout:1/941: symlink d1e/d29/d37/l144 0 2024-04-12T13:42:20.881 INFO:tasks.workunit.client.1.smithi110.stdout:4/960: dread - d0/d19/d1c/d50/f13d zero size 2024-04-12T13:42:20.884 INFO:tasks.workunit.client.1.smithi110.stdout:2/894: dread d6/dc/fbf [0,4194304] 0 2024-04-12T13:42:20.890 INFO:tasks.workunit.client.1.smithi110.stdout:2/895: chown d6/dc/d13/lef 4293 1 2024-04-12T13:42:20.890 INFO:tasks.workunit.client.0.smithi060.stdout:5/817: dread d6/fa0 [0,4194304] 0 2024-04-12T13:42:20.893 INFO:tasks.workunit.client.0.smithi060.stdout:4/758: rename d6/d7/db to d6/d7/dd/d1a/d57/d63/df4 0 2024-04-12T13:42:20.897 INFO:tasks.workunit.client.0.smithi060.stdout:0/771: dwrite d7/d9/d4c/f55 [0,4194304] 0 2024-04-12T13:42:20.898 INFO:tasks.workunit.client.1.smithi110.stdout:5/827: sync 2024-04-12T13:42:20.900 INFO:tasks.workunit.client.0.smithi060.stdout:3/825: mknod d7/d17/d19/dc9/d3f/d5c/c10d 0 2024-04-12T13:42:20.903 INFO:tasks.workunit.client.1.smithi110.stdout:9/941: creat df/d13/df4/d116/d123/f139 x:0 0 0 2024-04-12T13:42:20.905 INFO:tasks.workunit.client.0.smithi060.stdout:1/942: symlink d1e/d94/dd4/l145 0 2024-04-12T13:42:20.907 INFO:tasks.workunit.client.1.smithi110.stdout:7/886: truncate d1/f2a 4436520 0 2024-04-12T13:42:20.909 INFO:tasks.workunit.client.1.smithi110.stdout:3/836: mknod d5/dc/d31/d3b/d32/d3e/c107 0 2024-04-12T13:42:20.910 INFO:tasks.workunit.client.1.smithi110.stdout:1/844: dwrite de/d15/d32/f71 [4194304,4194304] 0 2024-04-12T13:42:20.912 INFO:tasks.workunit.client.1.smithi110.stdout:4/961: mkdir d0/d19/d8f/d142 0 2024-04-12T13:42:20.912 INFO:tasks.workunit.client.1.smithi110.stdout:8/874: write d1/d3/d3c/d5a/d6f/d83/f8c [858357,25028] 0 2024-04-12T13:42:20.913 INFO:tasks.workunit.client.1.smithi110.stdout:3/837: write d5/dc/d31/d74/d75/ff4 [1029806,38194] 0 2024-04-12T13:42:20.914 INFO:tasks.workunit.client.1.smithi110.stdout:1/845: dread - de/d15/dab/dd8/ff9 zero size 2024-04-12T13:42:20.914 INFO:tasks.workunit.client.0.smithi060.stdout:4/759: creat d6/d7/dd/d1a/d56/ff5 x:0 0 0 2024-04-12T13:42:20.918 INFO:tasks.workunit.client.0.smithi060.stdout:2/839: dwrite d6/d64/d99/df0/d16/d36/fa7 [0,4194304] 0 2024-04-12T13:42:20.919 INFO:tasks.workunit.client.1.smithi110.stdout:3/838: readlink d5/dc/d31/d74/d75/dbb/le6 0 2024-04-12T13:42:20.921 INFO:tasks.workunit.client.1.smithi110.stdout:3/839: dread - d5/dc/d20/d2d/d4e/d89/d8c/f104 zero size 2024-04-12T13:42:20.927 INFO:tasks.workunit.client.0.smithi060.stdout:3/826: unlink d7/d17/d19/dc9/d3f/d5c/d103/ff1 0 2024-04-12T13:42:20.927 INFO:tasks.workunit.client.0.smithi060.stdout:5/818: rename d6/d10/ff5 to d6/dd/d1f/dd3/d5f/f10a 0 2024-04-12T13:42:20.929 INFO:tasks.workunit.client.1.smithi110.stdout:9/942: dread df/d13/d2c/d9e/dd6/f73 [0,4194304] 0 2024-04-12T13:42:20.931 INFO:tasks.workunit.client.0.smithi060.stdout:2/840: creat d6/d64/d99/df0/d2b/f101 x:0 0 0 2024-04-12T13:42:20.936 INFO:tasks.workunit.client.0.smithi060.stdout:2/841: truncate d6/d64/d99/df0/d2b/d60/fd2 788717 0 2024-04-12T13:42:20.941 INFO:tasks.workunit.client.0.smithi060.stdout:9/741: write d4/d9/d19/d8c/d92/fcb [1117835,70087] 0 2024-04-12T13:42:20.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/943: write d1e/d23/d49/d4e/f58 [2460632,60286] 0 2024-04-12T13:42:20.948 INFO:tasks.workunit.client.0.smithi060.stdout:0/772: dwrite d7/d9/d14/d35/d44/d7d/f107 [0,4194304] 0 2024-04-12T13:42:20.953 INFO:tasks.workunit.client.0.smithi060.stdout:2/842: mknod d6/d64/d99/df0/daa/db0/def/c102 0 2024-04-12T13:42:20.959 INFO:tasks.workunit.client.0.smithi060.stdout:5/819: dread d6/dd/d1f/d25/d53/fd9 [0,4194304] 0 2024-04-12T13:42:20.960 INFO:tasks.workunit.client.0.smithi060.stdout:4/760: link d6/d2f/fa5 d6/d7/dd/d1a/d19/d7a/d9d/ff6 0 2024-04-12T13:42:20.962 INFO:tasks.workunit.client.0.smithi060.stdout:0/773: rename d7/d9/d14/d4a/fa1 to d7/d9/d14/d35/d44/d49/d67/da5/df5/f10a 0 2024-04-12T13:42:20.966 INFO:tasks.workunit.client.0.smithi060.stdout:1/944: unlink d1e/d23/d2e/d5e/lab 0 2024-04-12T13:42:20.968 INFO:tasks.workunit.client.0.smithi060.stdout:9/742: truncate d4/d33/d65/d7a/fcc 3891405 0 2024-04-12T13:42:20.968 INFO:tasks.workunit.client.0.smithi060.stdout:1/945: write d1e/d29/d37/fdc [4391690,26638] 0 2024-04-12T13:42:20.976 INFO:tasks.workunit.client.0.smithi060.stdout:3/827: getdents d7/d17/d27/d36/d53/da2 0 2024-04-12T13:42:20.982 INFO:tasks.workunit.client.0.smithi060.stdout:9/743: fsync d4/d9/fc 0 2024-04-12T13:42:20.986 INFO:tasks.workunit.client.0.smithi060.stdout:1/946: rmdir d1e/d29/d65/de7/d11b 39 2024-04-12T13:42:20.990 INFO:tasks.workunit.client.0.smithi060.stdout:5/820: write d6/dd/d1f/dd3/df3/fa5 [180962,61835] 0 2024-04-12T13:42:20.990 INFO:tasks.workunit.client.0.smithi060.stdout:4/761: dread d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:42:20.997 INFO:tasks.workunit.client.0.smithi060.stdout:0/774: truncate d7/d9/d14/d35/d3c/fa9 2040111 0 2024-04-12T13:42:21.000 INFO:tasks.workunit.client.0.smithi060.stdout:5/821: mknod d6/dd/d27/d7d/c10b 0 2024-04-12T13:42:21.010 INFO:tasks.workunit.client.0.smithi060.stdout:3/828: write d7/d17/d19/f85 [1589632,5930] 0 2024-04-12T13:42:21.012 INFO:tasks.workunit.client.0.smithi060.stdout:9/744: rename d4/d9/d19/d21/fef to d4/d9/ff7 0 2024-04-12T13:42:21.016 INFO:tasks.workunit.client.0.smithi060.stdout:1/947: creat d1e/d105/f146 x:0 0 0 2024-04-12T13:42:21.017 INFO:tasks.workunit.client.0.smithi060.stdout:3/829: read d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/fd3 [3794853,40880] 0 2024-04-12T13:42:21.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/822: dread d6/dd/d1f/dd3/df3/d4c/f85 [0,4194304] 0 2024-04-12T13:42:21.022 INFO:tasks.workunit.client.0.smithi060.stdout:0/775: rename d7/d9/d14/d35/d3c to d7/d9/d14/d35/d44/d8c/d8d/d10b 0 2024-04-12T13:42:21.023 INFO:tasks.workunit.client.0.smithi060.stdout:9/745: rmdir d4/d33/d50 39 2024-04-12T13:42:21.027 INFO:tasks.workunit.client.0.smithi060.stdout:4/762: dwrite d6/d7/dd/d1a/d57/d63/fb2 [0,4194304] 0 2024-04-12T13:42:21.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/776: dread - d7/d9/de/d63/fe6 zero size 2024-04-12T13:42:21.027 INFO:tasks.workunit.client.0.smithi060.stdout:1/948: creat d1e/d29/d65/f147 x:0 0 0 2024-04-12T13:42:21.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/830: rmdir d7/d17/d19/d96/dfe 39 2024-04-12T13:42:21.033 INFO:tasks.workunit.client.0.smithi060.stdout:3/831: truncate d7/d17/d19/f74 5106111 0 2024-04-12T13:42:21.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/823: read d6/dd/d1f/d25/d53/d87/f9d [4073478,97337] 0 2024-04-12T13:42:21.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/824: chown d6/dd/d1f/dd3/df3/ffd 925891 1 2024-04-12T13:42:21.045 INFO:tasks.workunit.client.0.smithi060.stdout:4/763: dread d6/f70 [0,4194304] 0 2024-04-12T13:42:21.046 INFO:tasks.workunit.client.0.smithi060.stdout:3/832: mkdir d7/d17/d27/d36/d53/da2/d10e 0 2024-04-12T13:42:21.048 INFO:tasks.workunit.client.1.smithi110.stdout:0/787: symlink d1/d27/d31/d67/l11b 0 2024-04-12T13:42:21.049 INFO:tasks.workunit.client.0.smithi060.stdout:0/777: symlink d7/d33/d88/df8/l10c 0 2024-04-12T13:42:21.049 INFO:tasks.workunit.client.0.smithi060.stdout:3/833: write d7/d17/d19/dc9/d3f/d5c/f54 [16465,1655] 0 2024-04-12T13:42:21.051 INFO:tasks.workunit.client.1.smithi110.stdout:6/847: mknod d7/d10/d1c/d2b/c106 0 2024-04-12T13:42:21.053 INFO:tasks.workunit.client.1.smithi110.stdout:5/828: fdatasync da/d2e/d45/d25/f43 0 2024-04-12T13:42:21.054 INFO:tasks.workunit.client.0.smithi060.stdout:1/949: mkdir d1e/d23/d2e/d86/ddb/d148 0 2024-04-12T13:42:21.057 INFO:tasks.workunit.client.1.smithi110.stdout:5/829: chown da/db/f4a 247992312 1 2024-04-12T13:42:21.058 INFO:tasks.workunit.client.1.smithi110.stdout:7/887: rename d1/d1b/d3d/d68 to d1/d31/d5d/d127 0 2024-04-12T13:42:21.059 INFO:tasks.workunit.client.0.smithi060.stdout:9/746: link d4/d8/df1/l89 d4/d33/d65/d7a/lf8 0 2024-04-12T13:42:21.062 INFO:tasks.workunit.client.0.smithi060.stdout:4/764: dread - d6/d7/dd/d1a/d19/d42/fc9 zero size 2024-04-12T13:42:21.066 INFO:tasks.workunit.client.0.smithi060.stdout:0/778: mkdir d7/d9/de/d80/dc8/d10d 0 2024-04-12T13:42:21.072 INFO:tasks.workunit.client.1.smithi110.stdout:2/896: write d6/dc/dd/d49/d64/d4a/f77 [586472,45488] 0 2024-04-12T13:42:21.075 INFO:tasks.workunit.client.0.smithi060.stdout:3/834: dread d7/d17/d19/dc9/d3f/d5c/f8d [0,4194304] 0 2024-04-12T13:42:21.076 INFO:tasks.workunit.client.0.smithi060.stdout:9/747: rename d4/d9/d19/d21/dbb/cc8 to d4/d9/d19/d8c/cf9 0 2024-04-12T13:42:21.077 INFO:tasks.workunit.client.0.smithi060.stdout:9/748: readlink d4/d9/d19/l8e 0 2024-04-12T13:42:21.078 INFO:tasks.workunit.client.0.smithi060.stdout:9/749: readlink d4/d8/l29 0 2024-04-12T13:42:21.082 INFO:tasks.workunit.client.1.smithi110.stdout:1/846: rename de/d14/d34/d55/d6b/f82 to de/d7b/da1/f11b 0 2024-04-12T13:42:21.083 INFO:tasks.workunit.client.0.smithi060.stdout:5/825: creat d6/dd/d1f/d25/f10c x:0 0 0 2024-04-12T13:42:21.084 INFO:tasks.workunit.client.1.smithi110.stdout:8/875: write d1/d3/f13 [3745559,34660] 0 2024-04-12T13:42:21.085 INFO:tasks.workunit.client.0.smithi060.stdout:4/765: symlink d6/d21/lf7 0 2024-04-12T13:42:21.086 INFO:tasks.workunit.client.0.smithi060.stdout:1/950: truncate d1e/d23/d49/d4e/d9b/f129 123341 0 2024-04-12T13:42:21.087 INFO:tasks.workunit.client.1.smithi110.stdout:1/847: fsync de/d14/d83/fe2 0 2024-04-12T13:42:21.090 INFO:tasks.workunit.client.0.smithi060.stdout:9/750: readlink d4/d33/d65/d7a/lf8 0 2024-04-12T13:42:21.091 INFO:tasks.workunit.client.1.smithi110.stdout:7/888: truncate d1/d3/d4/d36/d76/f8a 50531 0 2024-04-12T13:42:21.092 INFO:tasks.workunit.client.1.smithi110.stdout:3/840: mknod d5/dc/c108 0 2024-04-12T13:42:21.092 INFO:tasks.workunit.client.0.smithi060.stdout:0/779: truncate d7/d9/de/d80/f105 266067 0 2024-04-12T13:42:21.097 INFO:tasks.workunit.client.1.smithi110.stdout:4/962: write d0/de/da0/dd9/df3/de0/d7e/daa/dcd/f11d [6446104,10768] 0 2024-04-12T13:42:21.097 INFO:tasks.workunit.client.0.smithi060.stdout:9/751: write d4/f2d [4512001,18216] 0 2024-04-12T13:42:21.098 INFO:tasks.workunit.client.1.smithi110.stdout:6/848: dread d7/d25/f87 [0,4194304] 0 2024-04-12T13:42:21.098 INFO:tasks.workunit.client.0.smithi060.stdout:5/826: getdents d6/dd/d1f/dd3/df3/d4c/d7c 0 2024-04-12T13:42:21.100 INFO:tasks.workunit.client.1.smithi110.stdout:5/830: creat da/db/d3b/d40/d97/db6/dff/f11e x:0 0 0 2024-04-12T13:42:21.102 INFO:tasks.workunit.client.1.smithi110.stdout:9/943: rename df/d13/d2c/d2d/d39/d4f/l75 to df/d8a/l13a 0 2024-04-12T13:42:21.104 INFO:tasks.workunit.client.1.smithi110.stdout:4/963: dread d0/d75/f109 [0,4194304] 0 2024-04-12T13:42:21.105 INFO:tasks.workunit.client.1.smithi110.stdout:5/831: dread - da/db/d3b/d40/d97/db6/dff/f11e zero size 2024-04-12T13:42:21.107 INFO:tasks.workunit.client.1.smithi110.stdout:0/788: creat d1/d3c/d6b/f11c x:0 0 0 2024-04-12T13:42:21.107 INFO:tasks.workunit.client.0.smithi060.stdout:3/835: dwrite d7/f8 [0,4194304] 0 2024-04-12T13:42:21.107 INFO:tasks.workunit.client.0.smithi060.stdout:4/766: creat d6/ff8 x:0 0 0 2024-04-12T13:42:21.111 INFO:tasks.workunit.client.0.smithi060.stdout:9/752: creat d4/d33/d65/ffa x:0 0 0 2024-04-12T13:42:21.115 INFO:tasks.workunit.client.0.smithi060.stdout:0/780: mknod d7/d9/d14/d35/d44/d49/dcf/dd0/dd6/c10e 0 2024-04-12T13:42:21.118 INFO:tasks.workunit.client.0.smithi060.stdout:5/827: mkdir d6/dd/d1f/dd3/df3/d38/d10d 0 2024-04-12T13:42:21.123 INFO:tasks.workunit.client.1.smithi110.stdout:9/944: rmdir df/d13/d2c/d9e/dd6/da3/dab/d118 39 2024-04-12T13:42:21.125 INFO:tasks.workunit.client.1.smithi110.stdout:1/848: dwrite de/d15/ffc [0,4194304] 0 2024-04-12T13:42:21.125 INFO:tasks.workunit.client.0.smithi060.stdout:8/791: sync 2024-04-12T13:42:21.125 INFO:tasks.workunit.client.0.smithi060.stdout:1/951: truncate d1e/d29/d37/fdc 3295482 0 2024-04-12T13:42:21.126 INFO:tasks.workunit.client.1.smithi110.stdout:4/964: fsync d0/de/f4c 0 2024-04-12T13:42:21.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/753: symlink d4/d9/d19/d21/dbb/lfb 0 2024-04-12T13:42:21.130 INFO:tasks.workunit.client.0.smithi060.stdout:1/952: readlink d1e/d23/d2e/d86/ddb/lfd 0 2024-04-12T13:42:21.135 INFO:tasks.workunit.client.1.smithi110.stdout:2/897: dwrite d6/dc/fa9 [0,4194304] 0 2024-04-12T13:42:21.135 INFO:tasks.workunit.client.0.smithi060.stdout:5/828: fdatasync d6/dd/d1f/dd3/de7/df8/f105 0 2024-04-12T13:42:21.137 INFO:tasks.workunit.client.0.smithi060.stdout:5/829: chown d6/dd/d1f/d25/ld2 0 1 2024-04-12T13:42:21.143 INFO:tasks.workunit.client.1.smithi110.stdout:5/832: mknod da/d2e/d45/d25/d9d/d7a/dae/c11f 0 2024-04-12T13:42:21.146 INFO:tasks.workunit.client.1.smithi110.stdout:3/841: dwrite d5/dc/dcf/fd6 [0,4194304] 0 2024-04-12T13:42:21.150 INFO:tasks.workunit.client.1.smithi110.stdout:8/876: truncate d1/d5/d1f/f56 2380717 0 2024-04-12T13:42:21.151 INFO:tasks.workunit.client.0.smithi060.stdout:4/767: dwrite d6/f8f [4194304,4194304] 0 2024-04-12T13:42:21.154 INFO:tasks.workunit.client.1.smithi110.stdout:1/849: dwrite de/d15/dab/dd8/ffd [0,4194304] 0 2024-04-12T13:42:21.155 INFO:tasks.workunit.client.1.smithi110.stdout:7/889: dwrite d1/d3/d4/d55/fc0 [0,4194304] 0 2024-04-12T13:42:21.155 INFO:tasks.workunit.client.0.smithi060.stdout:6/846: sync 2024-04-12T13:42:21.156 INFO:tasks.workunit.client.0.smithi060.stdout:7/776: sync 2024-04-12T13:42:21.156 INFO:tasks.workunit.client.1.smithi110.stdout:3/842: chown d5/dc/d31/d3b/d32/d3e/l5c 10 1 2024-04-12T13:42:21.158 INFO:tasks.workunit.client.0.smithi060.stdout:2/843: sync 2024-04-12T13:42:21.168 INFO:tasks.workunit.client.1.smithi110.stdout:0/789: creat d1/d48/db2/d110/f11d x:0 0 0 2024-04-12T13:42:21.171 INFO:tasks.workunit.client.1.smithi110.stdout:2/898: symlink d6/dc/d6f/l113 0 2024-04-12T13:42:21.176 INFO:tasks.workunit.client.1.smithi110.stdout:6/849: creat d7/d10/d1c/d2b/d3a/dbf/f107 x:0 0 0 2024-04-12T13:42:21.179 INFO:tasks.workunit.client.1.smithi110.stdout:8/877: rmdir d1/d3/d35/d3a/d41/d77 39 2024-04-12T13:42:21.185 INFO:tasks.workunit.client.1.smithi110.stdout:9/945: write df/d13/d2c/f53 [362971,41378] 0 2024-04-12T13:42:21.187 INFO:tasks.workunit.client.1.smithi110.stdout:9/946: readlink df/d38/l99 0 2024-04-12T13:42:21.188 INFO:tasks.workunit.client.1.smithi110.stdout:4/965: creat d0/d13/d13a/f143 x:0 0 0 2024-04-12T13:42:21.193 INFO:tasks.workunit.client.1.smithi110.stdout:3/843: read d5/dc/d31/d3b/f59 [1633848,18144] 0 2024-04-12T13:42:21.194 INFO:tasks.workunit.client.1.smithi110.stdout:0/790: creat d1/d27/d31/d89/f11e x:0 0 0 2024-04-12T13:42:21.197 INFO:tasks.workunit.client.1.smithi110.stdout:3/844: write d5/dc/d31/d3b/d5b/fd8 [1679412,76288] 0 2024-04-12T13:42:21.200 INFO:tasks.workunit.client.1.smithi110.stdout:6/850: write d7/d10/d1c/f28 [133425,46811] 0 2024-04-12T13:42:21.204 INFO:tasks.workunit.client.1.smithi110.stdout:1/850: mknod de/d15/c11c 0 2024-04-12T13:42:21.206 INFO:tasks.workunit.client.1.smithi110.stdout:1/851: stat de/d14/d34/db4/fef 0 2024-04-12T13:42:21.207 INFO:tasks.workunit.client.1.smithi110.stdout:8/878: dread d1/d3/d35/d3a/d3e/d64/d85/fd4 [0,4194304] 0 2024-04-12T13:42:21.208 INFO:tasks.workunit.client.1.smithi110.stdout:9/947: truncate df/d13/d3b/fd0 77800 0 2024-04-12T13:42:21.210 INFO:tasks.workunit.client.0.smithi060.stdout:9/754: creat d4/d8/df1/d67/ffc x:0 0 0 2024-04-12T13:42:21.215 INFO:tasks.workunit.client.1.smithi110.stdout:7/890: dread d1/d3/d4/d55/faa [0,4194304] 0 2024-04-12T13:42:21.216 INFO:tasks.workunit.client.1.smithi110.stdout:3/845: mknod d5/dc/d20/d2d/d4e/d89/d8c/dc5/c109 0 2024-04-12T13:42:21.218 INFO:tasks.workunit.client.0.smithi060.stdout:5/830: creat d6/d89/f10e x:0 0 0 2024-04-12T13:42:21.221 INFO:tasks.workunit.client.1.smithi110.stdout:3/846: dread d5/dc/d31/d74/fe4 [0,4194304] 0 2024-04-12T13:42:21.221 INFO:tasks.workunit.client.1.smithi110.stdout:2/899: write d6/d53/fc8 [1510086,56489] 0 2024-04-12T13:42:21.222 INFO:tasks.workunit.client.1.smithi110.stdout:1/852: creat de/d14/d34/db4/f11d x:0 0 0 2024-04-12T13:42:21.224 INFO:tasks.workunit.client.1.smithi110.stdout:3/847: write d5/dc/da0/fef [888974,112946] 0 2024-04-12T13:42:21.225 INFO:tasks.workunit.client.1.smithi110.stdout:8/879: creat d1/d3/d35/d3a/d84/d101/f11d x:0 0 0 2024-04-12T13:42:21.226 INFO:tasks.workunit.client.1.smithi110.stdout:9/948: mknod df/d13/d2c/d9e/dd6/da3/c13b 0 2024-04-12T13:42:21.227 INFO:tasks.workunit.client.1.smithi110.stdout:3/848: readlink d5/dc/d31/d3b/d32/d3e/l60 0 2024-04-12T13:42:21.228 INFO:tasks.workunit.client.0.smithi060.stdout:7/777: dread - d0/d78/da0/fb8 zero size 2024-04-12T13:42:21.228 INFO:tasks.workunit.client.1.smithi110.stdout:4/966: dread d0/f4 [4194304,4194304] 0 2024-04-12T13:42:21.229 INFO:tasks.workunit.client.1.smithi110.stdout:3/849: write d5/dc/d31/d3b/d32/f78 [2142578,18966] 0 2024-04-12T13:42:21.230 INFO:tasks.workunit.client.0.smithi060.stdout:2/844: creat d6/d56/d86/f103 x:0 0 0 2024-04-12T13:42:21.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/847: creat d1/d7/da/dc/d24/d30/f115 x:0 0 0 2024-04-12T13:42:21.238 INFO:tasks.workunit.client.1.smithi110.stdout:5/833: creat da/db/d3b/d40/da6/f120 x:0 0 0 2024-04-12T13:42:21.244 INFO:tasks.workunit.client.0.smithi060.stdout:0/781: dwrite d7/d9/de/f43 [0,4194304] 0 2024-04-12T13:42:21.245 INFO:tasks.workunit.client.0.smithi060.stdout:4/768: dread d6/d7/dd/fe [0,4194304] 0 2024-04-12T13:42:21.247 INFO:tasks.workunit.client.1.smithi110.stdout:6/851: mkdir d7/d10/d1c/d2b/d3a/dbf/de2/d108 0 2024-04-12T13:42:21.249 INFO:tasks.workunit.client.1.smithi110.stdout:8/880: truncate d1/d3/d3c/f33 1358429 0 2024-04-12T13:42:21.252 INFO:tasks.workunit.client.1.smithi110.stdout:0/791: truncate d1/f8c 569947 0 2024-04-12T13:42:21.253 INFO:tasks.workunit.client.0.smithi060.stdout:5/831: creat d6/dd/d1f/d25/d53/d87/f10f x:0 0 0 2024-04-12T13:42:21.255 INFO:tasks.workunit.client.1.smithi110.stdout:0/792: write d1/d8/d36/d51/df8/f10e [237176,106166] 0 2024-04-12T13:42:21.258 INFO:tasks.workunit.client.0.smithi060.stdout:9/755: write d4/d33/d65/fc9 [172432,80264] 0 2024-04-12T13:42:21.259 INFO:tasks.workunit.client.1.smithi110.stdout:3/850: creat d5/dc/d31/d74/f10a x:0 0 0 2024-04-12T13:42:21.260 INFO:tasks.workunit.client.0.smithi060.stdout:3/836: getdents d7/d17/d19/d96 0 2024-04-12T13:42:21.260 INFO:tasks.workunit.client.0.smithi060.stdout:2/845: chown d6/d64/d99/df0/daa/db0/lac 117394105 1 2024-04-12T13:42:21.261 INFO:tasks.workunit.client.0.smithi060.stdout:9/756: write d4/d33/d65/ffa [516783,95752] 0 2024-04-12T13:42:21.262 INFO:tasks.workunit.client.1.smithi110.stdout:5/834: mkdir da/d2e/d45/d25/d9d/d79/d88/d121 0 2024-04-12T13:42:21.264 INFO:tasks.workunit.client.0.smithi060.stdout:6/848: write d1/d7/da/dc/d24/d8b/fa5 [445279,43849] 0 2024-04-12T13:42:21.264 INFO:tasks.workunit.client.1.smithi110.stdout:5/835: chown da/d2e/d45/d25/f10a 50602624 1 2024-04-12T13:42:21.266 INFO:tasks.workunit.client.1.smithi110.stdout:7/891: rename d1/d1b/d70/lc3 to d1/d3/d4/d55/d82/l128 0 2024-04-12T13:42:21.270 INFO:tasks.workunit.client.1.smithi110.stdout:3/851: dread d5/dc/dcf/fd6 [0,4194304] 0 2024-04-12T13:42:21.274 INFO:tasks.workunit.client.1.smithi110.stdout:3/852: read - d5/dc/d20/d2d/d4f/fd1 zero size 2024-04-12T13:42:21.275 INFO:tasks.workunit.client.0.smithi060.stdout:8/792: link d9/d1b/d84/da0/d80/d109/c7f d9/d1b/d37/d4d/d63/d66/d111/c113 0 2024-04-12T13:42:21.276 INFO:tasks.workunit.client.1.smithi110.stdout:3/853: chown d5/dc/d31/d3b/d32/d3e/d5f/f8b 3874 1 2024-04-12T13:42:21.277 INFO:tasks.workunit.client.1.smithi110.stdout:0/793: creat d1/d8/d8a/dce/f11f x:0 0 0 2024-04-12T13:42:21.278 INFO:tasks.workunit.client.0.smithi060.stdout:0/782: mkdir d7/d9/d14/d35/d44/d8c/d8d/de9/d10f 0 2024-04-12T13:42:21.281 INFO:tasks.workunit.client.0.smithi060.stdout:8/793: chown d9/d1b/d37/d4d/d63/d66/dd9/dfc/f99 2596710 1 2024-04-12T13:42:21.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/778: dwrite d0/d1b/f31 [0,4194304] 0 2024-04-12T13:42:21.284 INFO:tasks.workunit.client.0.smithi060.stdout:4/769: creat d6/d7/dd/d1a/dde/ff9 x:0 0 0 2024-04-12T13:42:21.287 INFO:tasks.workunit.client.0.smithi060.stdout:1/953: write d1e/d1f/f22 [198347,126273] 0 2024-04-12T13:42:21.287 INFO:tasks.workunit.client.0.smithi060.stdout:5/832: creat d6/dd/d1f/dd3/df3/d4c/f110 x:0 0 0 2024-04-12T13:42:21.289 INFO:tasks.workunit.client.1.smithi110.stdout:7/892: mkdir d1/d129 0 2024-04-12T13:42:21.290 INFO:tasks.workunit.client.0.smithi060.stdout:2/846: creat d6/d56/d58/f104 x:0 0 0 2024-04-12T13:42:21.293 INFO:tasks.workunit.client.1.smithi110.stdout:6/852: truncate d7/d10/d41/f65 113686 0 2024-04-12T13:42:21.296 INFO:tasks.workunit.client.0.smithi060.stdout:6/849: mkdir d1/d7/da/d116 0 2024-04-12T13:42:21.299 INFO:tasks.workunit.client.1.smithi110.stdout:0/794: creat d1/d8/d36/d51/d60/f120 x:0 0 0 2024-04-12T13:42:21.301 INFO:tasks.workunit.client.0.smithi060.stdout:7/779: dread d0/d1b/f31 [0,4194304] 0 2024-04-12T13:42:21.301 INFO:tasks.workunit.client.1.smithi110.stdout:0/795: dread - d1/d3c/d6b/fbd zero size 2024-04-12T13:42:21.303 INFO:tasks.workunit.client.0.smithi060.stdout:7/780: write d0/d1b/da4/feb [989595,20081] 0 2024-04-12T13:42:21.308 INFO:tasks.workunit.client.0.smithi060.stdout:5/833: symlink d6/dd/d1f/d25/d53/d87/l111 0 2024-04-12T13:42:21.309 INFO:tasks.workunit.client.1.smithi110.stdout:9/949: getdents df/d13/d2c/d9e/dd6/dcf/dd2 0 2024-04-12T13:42:21.310 INFO:tasks.workunit.client.1.smithi110.stdout:3/854: dread d5/dc/f13 [0,4194304] 0 2024-04-12T13:42:21.310 INFO:tasks.workunit.client.0.smithi060.stdout:9/757: mknod d4/d9/dbd/de8/cfd 0 2024-04-12T13:42:21.310 INFO:tasks.workunit.client.0.smithi060.stdout:5/834: chown d6/d10/db8/dee/dfc 14444 1 2024-04-12T13:42:21.314 INFO:tasks.workunit.client.0.smithi060.stdout:1/954: creat d1e/d46/d8d/f149 x:0 0 0 2024-04-12T13:42:21.315 INFO:tasks.workunit.client.0.smithi060.stdout:2/847: creat d6/d56/d86/f105 x:0 0 0 2024-04-12T13:42:21.316 INFO:tasks.workunit.client.1.smithi110.stdout:0/796: mknod d1/d56/c121 0 2024-04-12T13:42:21.318 INFO:tasks.workunit.client.0.smithi060.stdout:2/848: truncate d6/d56/d58/fd1 1002555 0 2024-04-12T13:42:21.319 INFO:tasks.workunit.client.1.smithi110.stdout:0/797: write d1/d5e/f10c [600456,25861] 0 2024-04-12T13:42:21.328 INFO:tasks.workunit.client.1.smithi110.stdout:7/893: mknod d1/d1b/d70/dd2/c12a 0 2024-04-12T13:42:21.330 INFO:tasks.workunit.client.0.smithi060.stdout:0/783: mknod d7/d33/c110 0 2024-04-12T13:42:21.332 INFO:tasks.workunit.client.1.smithi110.stdout:9/950: symlink df/d13/dca/l13c 0 2024-04-12T13:42:21.334 INFO:tasks.workunit.client.1.smithi110.stdout:3/855: fsync d5/dc/f67 0 2024-04-12T13:42:21.336 INFO:tasks.workunit.client.1.smithi110.stdout:9/951: chown df/d13/d2c/d2d/d39/d4f/fdd 76 1 2024-04-12T13:42:21.337 INFO:tasks.workunit.client.0.smithi060.stdout:7/781: stat d0/d7/d43/d63/d90/fbf 0 2024-04-12T13:42:21.338 INFO:tasks.workunit.client.0.smithi060.stdout:5/835: dwrite d6/dd/d1f/d25/d53/d87/f10f [0,4194304] 0 2024-04-12T13:42:21.346 INFO:tasks.workunit.client.1.smithi110.stdout:2/900: rename d6/dc/fd3 to d6/dc/dd/f114 0 2024-04-12T13:42:21.346 INFO:tasks.workunit.client.0.smithi060.stdout:9/758: mkdir d4/d8/d7c/dfe 0 2024-04-12T13:42:21.349 INFO:tasks.workunit.client.1.smithi110.stdout:0/798: creat d1/d48/db2/d4a/f122 x:0 0 0 2024-04-12T13:42:21.350 INFO:tasks.workunit.client.0.smithi060.stdout:8/794: dwrite d9/d1b/d84/da0/d80/d109/fe9 [0,4194304] 0 2024-04-12T13:42:21.350 INFO:tasks.workunit.client.1.smithi110.stdout:7/894: truncate d1/d3/d4/d55/f62 236261 0 2024-04-12T13:42:21.351 INFO:tasks.workunit.client.0.smithi060.stdout:1/955: mkdir d1e/d29/d37/d14a 0 2024-04-12T13:42:21.354 INFO:tasks.workunit.client.0.smithi060.stdout:3/837: link d7/d17/f90 d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/df5/f10f 0 2024-04-12T13:42:21.358 INFO:tasks.workunit.client.0.smithi060.stdout:2/849: mkdir d6/d64/d99/df0/d4b/d106 0 2024-04-12T13:42:21.364 INFO:tasks.workunit.client.0.smithi060.stdout:3/838: fdatasync d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/f100 0 2024-04-12T13:42:21.366 INFO:tasks.workunit.client.0.smithi060.stdout:1/956: dread d1e/f12b [0,4194304] 0 2024-04-12T13:42:21.373 INFO:tasks.workunit.client.1.smithi110.stdout:1/853: rename de/f80 to de/d14/d34/d108/f11e 0 2024-04-12T13:42:21.373 INFO:tasks.workunit.client.0.smithi060.stdout:1/957: write d1e/d23/dd9/f123 [4128781,16400] 0 2024-04-12T13:42:21.373 INFO:tasks.workunit.client.0.smithi060.stdout:7/782: dwrite d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:21.373 INFO:tasks.workunit.client.0.smithi060.stdout:0/784: unlink d7/d9/d14/d35/d44/d49/d74/f95 0 2024-04-12T13:42:21.388 INFO:tasks.workunit.client.0.smithi060.stdout:9/759: mkdir d4/d9/d19/d8c/d92/dff 0 2024-04-12T13:42:21.390 INFO:tasks.workunit.client.1.smithi110.stdout:6/853: write d7/d10/d1c/d2b/d48/d54/f5d [1139861,130921] 0 2024-04-12T13:42:21.391 INFO:tasks.workunit.client.0.smithi060.stdout:8/795: mkdir d9/d1b/d84/da0/d114 0 2024-04-12T13:42:21.393 INFO:tasks.workunit.client.1.smithi110.stdout:6/854: fsync d7/d25/d30/dcf/dc3/fb4 0 2024-04-12T13:42:21.400 INFO:tasks.workunit.client.1.smithi110.stdout:4/967: rename d0/de/d2c/d57/lb6 to d0/d78/l144 0 2024-04-12T13:42:21.402 INFO:tasks.workunit.client.1.smithi110.stdout:4/968: chown d0/d19/d26/fd6 127695 1 2024-04-12T13:42:21.403 INFO:tasks.workunit.client.1.smithi110.stdout:4/969: write d0/f15 [7311595,103862] 0 2024-04-12T13:42:21.411 INFO:tasks.workunit.client.1.smithi110.stdout:7/895: link d1/d1b/d70/f11f d1/d3/d4/d55/d56/d72/dad/d115/f12b 0 2024-04-12T13:42:21.412 INFO:tasks.workunit.client.1.smithi110.stdout:3/856: write d5/d86/fb5 [1936840,78643] 0 2024-04-12T13:42:21.415 INFO:tasks.workunit.client.1.smithi110.stdout:9/952: write df/d13/d2c/d9e/dd6/da3/dab/fad [515507,130651] 0 2024-04-12T13:42:21.418 INFO:tasks.workunit.client.0.smithi060.stdout:7/783: dread d0/d7/d92/ff0 [4194304,4194304] 0 2024-04-12T13:42:21.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/785: symlink d7/d9/d14/d35/d44/d49/d67/l111 0 2024-04-12T13:42:21.427 INFO:tasks.workunit.client.1.smithi110.stdout:8/881: rename d1/d3/d35/d3a/d3e/d64 to d1/d3/d35/d43/d9f/dd5/d11e 0 2024-04-12T13:42:21.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/770: link d6/d7/dd/d1a/d57/d63/c74 d6/d7/dd/d1a/d57/d63/cfa 0 2024-04-12T13:42:21.435 INFO:tasks.workunit.client.0.smithi060.stdout:9/760: rename d4/d9/d19/d8c/da6 to d4/d9/dbd/de8/d100 0 2024-04-12T13:42:21.439 INFO:tasks.workunit.client.1.smithi110.stdout:0/799: getdents d1/d8/d8a 0 2024-04-12T13:42:21.440 INFO:tasks.workunit.client.0.smithi060.stdout:8/796: stat d9/d1b/d37/d48/l107 0 2024-04-12T13:42:21.442 INFO:tasks.workunit.client.0.smithi060.stdout:8/797: readlink d9/d1b/d37/l3f 0 2024-04-12T13:42:21.446 INFO:tasks.workunit.client.1.smithi110.stdout:7/896: creat d1/d3/d4/d55/d82/db5/d10b/f12c x:0 0 0 2024-04-12T13:42:21.446 INFO:tasks.workunit.client.1.smithi110.stdout:2/901: write d6/dc/dd/d49/d64/d4a/d3c/d50/fa4 [871234,48571] 0 2024-04-12T13:42:21.447 INFO:tasks.workunit.client.0.smithi060.stdout:2/850: creat d6/dae/d5b/d6d/de1/df8/f107 x:0 0 0 2024-04-12T13:42:21.447 INFO:tasks.workunit.client.1.smithi110.stdout:3/857: truncate d5/dc/d31/d3b/d32/f56 897669 0 2024-04-12T13:42:21.448 INFO:tasks.workunit.client.0.smithi060.stdout:6/850: dwrite d1/d7/da/dc/d24/d30/d52/d5e/f9e [0,4194304] 0 2024-04-12T13:42:21.454 INFO:tasks.workunit.client.0.smithi060.stdout:6/851: fsync d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/fd3 0 2024-04-12T13:42:21.458 INFO:tasks.workunit.client.1.smithi110.stdout:2/902: dread d6/dc/d13/dec/fb7 [0,4194304] 0 2024-04-12T13:42:21.464 INFO:tasks.workunit.client.1.smithi110.stdout:0/800: creat d1/d3c/da6/f123 x:0 0 0 2024-04-12T13:42:21.465 INFO:tasks.workunit.client.0.smithi060.stdout:1/958: dwrite d1e/d23/d49/d4e/d9b/fac [0,4194304] 0 2024-04-12T13:42:21.468 INFO:tasks.workunit.client.0.smithi060.stdout:6/852: dread d1/d7/da/dc/d24/d34/d51/d97/f9d [0,4194304] 0 2024-04-12T13:42:21.471 INFO:tasks.workunit.client.0.smithi060.stdout:6/853: fdatasync d1/d7/da/dc/d24/d8b/fa5 0 2024-04-12T13:42:21.475 INFO:tasks.workunit.client.0.smithi060.stdout:3/839: link d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/fd3 d7/d17/d27/d36/db0/dd9/f110 0 2024-04-12T13:42:21.477 INFO:tasks.workunit.client.1.smithi110.stdout:5/836: rename da/d2e/d45/d25/d9d/le8 to da/d2e/d45/d29/d105/df4/l122 0 2024-04-12T13:42:21.480 INFO:tasks.workunit.client.0.smithi060.stdout:9/761: rename d4/d9/dbd to d4/d9/d19/daf/d101 0 2024-04-12T13:42:21.483 INFO:tasks.workunit.client.1.smithi110.stdout:8/882: mkdir d1/d5/d11f 0 2024-04-12T13:42:21.489 INFO:tasks.workunit.client.1.smithi110.stdout:2/903: chown d6/dc/db1/d111/c21 1 1 2024-04-12T13:42:21.493 INFO:tasks.workunit.client.0.smithi060.stdout:7/784: write d0/d7/f41 [124089,76380] 0 2024-04-12T13:42:21.494 INFO:tasks.workunit.client.1.smithi110.stdout:4/970: write d0/de/d2c/f130 [780602,6666] 0 2024-04-12T13:42:21.496 INFO:tasks.workunit.client.0.smithi060.stdout:4/771: mkdir d6/db7/dbb/dfb 0 2024-04-12T13:42:21.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/785: write d0/d7/f49 [1677805,116647] 0 2024-04-12T13:42:21.503 INFO:tasks.workunit.client.0.smithi060.stdout:3/840: dwrite d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/f100 [0,4194304] 0 2024-04-12T13:42:21.503 INFO:tasks.workunit.client.0.smithi060.stdout:4/772: readlink d6/d7/dd/d1a/d57/dc7/ld4 0 2024-04-12T13:42:21.505 INFO:tasks.workunit.client.1.smithi110.stdout:6/855: getdents d7/d25/d2c/d4c/d77/dd3 0 2024-04-12T13:42:21.506 INFO:tasks.workunit.client.0.smithi060.stdout:7/786: chown d0/f47 80349 1 2024-04-12T13:42:21.508 INFO:tasks.workunit.client.1.smithi110.stdout:9/953: write df/d13/d2c/d2d/dc1/d83/f68 [426605,8874] 0 2024-04-12T13:42:21.508 INFO:tasks.workunit.client.1.smithi110.stdout:3/858: dread d5/fba [0,4194304] 0 2024-04-12T13:42:21.509 INFO:tasks.workunit.client.0.smithi060.stdout:7/787: chown d0/f71 1185864 1 2024-04-12T13:42:21.510 INFO:tasks.workunit.client.0.smithi060.stdout:1/959: creat d1e/d23/dd9/dae/f14b x:0 0 0 2024-04-12T13:42:21.510 INFO:tasks.workunit.client.1.smithi110.stdout:6/856: write d7/d25/d30/d44/d3d/fb3 [1815266,32521] 0 2024-04-12T13:42:21.512 INFO:tasks.workunit.client.0.smithi060.stdout:0/786: dwrite d7/d9/d14/d35/fb7 [4194304,4194304] 0 2024-04-12T13:42:21.520 INFO:tasks.workunit.client.1.smithi110.stdout:2/904: dread d6/dc/dd/dc6/fe4 [0,4194304] 0 2024-04-12T13:42:21.521 INFO:tasks.workunit.client.1.smithi110.stdout:1/854: rename de/d15/dab/f117 to de/d14/d34/db4/f11f 0 2024-04-12T13:42:21.523 INFO:tasks.workunit.client.0.smithi060.stdout:2/851: dwrite d6/dae/d5b/f96 [0,4194304] 0 2024-04-12T13:42:21.529 INFO:tasks.workunit.client.0.smithi060.stdout:6/854: dread - d1/d7/da/dc/ff5 zero size 2024-04-12T13:42:21.544 INFO:tasks.workunit.client.1.smithi110.stdout:6/857: rmdir d7/d10/d1c/d2b/d3a/dbf 39 2024-04-12T13:42:21.546 INFO:tasks.workunit.client.0.smithi060.stdout:5/836: link d6/dd/d1f/d25/d42/d6b/fac d6/dd/d27/f112 0 2024-04-12T13:42:21.552 INFO:tasks.workunit.client.1.smithi110.stdout:6/858: read d7/d25/d30/d44/d3d/f49 [736794,18118] 0 2024-04-12T13:42:21.556 INFO:tasks.workunit.client.1.smithi110.stdout:7/897: rename d1/d3/d4/d55/d82/c105 to d1/d31/d7b/c12d 0 2024-04-12T13:42:21.556 INFO:tasks.workunit.client.0.smithi060.stdout:1/960: mknod d1e/d23/d49/d4e/d9b/c14c 0 2024-04-12T13:42:21.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/787: mkdir d7/d9/d14/d35/d44/d8c/d8d/de5/d112 0 2024-04-12T13:42:21.568 INFO:tasks.workunit.client.0.smithi060.stdout:3/841: dread d7/d17/d19/d96/fd4 [0,4194304] 0 2024-04-12T13:42:21.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/762: mknod d4/d8/d7c/dee/c102 0 2024-04-12T13:42:21.581 INFO:tasks.workunit.client.1.smithi110.stdout:9/954: mknod df/d13/d26/c13d 0 2024-04-12T13:42:21.582 INFO:tasks.workunit.client.0.smithi060.stdout:7/788: write d0/d7/f73 [1116671,103407] 0 2024-04-12T13:42:21.584 INFO:tasks.workunit.client.1.smithi110.stdout:9/955: readlink df/d38/d6e/lf9 0 2024-04-12T13:42:21.589 INFO:tasks.workunit.client.1.smithi110.stdout:7/898: rename d1/d3/d4/d55/d82/db5/c106 to d1/d3/d4/d55/d56/ddd/c12e 0 2024-04-12T13:42:21.590 INFO:tasks.workunit.client.0.smithi060.stdout:2/852: write d6/d64/d99/df0/d81/fce [392608,121752] 0 2024-04-12T13:42:21.592 INFO:tasks.workunit.client.0.smithi060.stdout:0/788: symlink d7/d9/d14/d35/d44/d8c/l113 0 2024-04-12T13:42:21.592 INFO:tasks.workunit.client.0.smithi060.stdout:4/773: dwrite d6/d21/f53 [4194304,4194304] 0 2024-04-12T13:42:21.597 INFO:tasks.workunit.client.1.smithi110.stdout:0/801: getdents d1/d8/d36/d51/dee 0 2024-04-12T13:42:21.598 INFO:tasks.workunit.client.0.smithi060.stdout:3/842: fdatasync d7/d17/d27/f8e 0 2024-04-12T13:42:21.599 INFO:tasks.workunit.client.1.smithi110.stdout:4/971: link d0/de/d2c/l82 d0/d19/d1c/d50/d6f/db9/l145 0 2024-04-12T13:42:21.600 INFO:tasks.workunit.client.1.smithi110.stdout:6/859: write d7/da4/fc4 [355753,22022] 0 2024-04-12T13:42:21.600 INFO:tasks.workunit.client.1.smithi110.stdout:2/905: dwrite d6/dc/d1b/d57/d62/f86 [0,4194304] 0 2024-04-12T13:42:21.601 INFO:tasks.workunit.client.0.smithi060.stdout:0/789: dread - d7/d9/d14/ff4 zero size 2024-04-12T13:42:21.601 INFO:tasks.workunit.client.1.smithi110.stdout:5/837: dwrite da/d2e/f30 [4194304,4194304] 0 2024-04-12T13:42:21.608 INFO:tasks.workunit.client.0.smithi060.stdout:8/798: rename d9/d1b/d84/cec to d9/d1b/d84/da0/d80/d109/d7b/c115 0 2024-04-12T13:42:21.609 INFO:tasks.workunit.client.1.smithi110.stdout:6/860: chown d7/da4/c104 17 1 2024-04-12T13:42:21.611 INFO:tasks.workunit.client.1.smithi110.stdout:2/906: write d6/dc/d6f/da7/f107 [928361,78379] 0 2024-04-12T13:42:21.613 INFO:tasks.workunit.client.0.smithi060.stdout:9/763: chown d4/c83 17967 1 2024-04-12T13:42:21.616 INFO:tasks.workunit.client.1.smithi110.stdout:7/899: rename d1/d1b/ld1 to d1/d31/d7b/l12f 0 2024-04-12T13:42:21.619 INFO:tasks.workunit.client.1.smithi110.stdout:0/802: chown d1/d27/ff2 358814 1 2024-04-12T13:42:21.619 INFO:tasks.workunit.client.1.smithi110.stdout:7/900: readlink d1/d3/d4/da6/lda 0 2024-04-12T13:42:21.622 INFO:tasks.workunit.client.1.smithi110.stdout:1/855: dwrite de/d14/f53 [0,4194304] 0 2024-04-12T13:42:21.629 INFO:tasks.workunit.client.0.smithi060.stdout:2/853: unlink d6/d64/d99/f9e 0 2024-04-12T13:42:21.634 INFO:tasks.workunit.client.1.smithi110.stdout:2/907: dwrite d6/dc/d1b/d8f/fee [0,4194304] 0 2024-04-12T13:42:21.635 INFO:tasks.workunit.client.0.smithi060.stdout:0/790: creat d7/d9/d14/d35/d44/d8c/d8d/d10b/f114 x:0 0 0 2024-04-12T13:42:21.645 INFO:tasks.workunit.client.1.smithi110.stdout:6/861: creat d7/d25/d30/d6b/dd7/f109 x:0 0 0 2024-04-12T13:42:21.645 INFO:tasks.workunit.client.1.smithi110.stdout:0/803: truncate d1/d8/d36/d51/d60/f2b 2029562 0 2024-04-12T13:42:21.646 INFO:tasks.workunit.client.1.smithi110.stdout:4/972: symlink d0/de/d2c/l146 0 2024-04-12T13:42:21.648 INFO:tasks.workunit.client.0.smithi060.stdout:4/774: dwrite d6/d7/dd/d1a/d57/d63/fec [0,4194304] 0 2024-04-12T13:42:21.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/843: dread - d7/d17/d27/d36/db0/fe1 zero size 2024-04-12T13:42:21.655 INFO:tasks.workunit.client.1.smithi110.stdout:6/862: write d7/d25/d30/d6b/dd7/f109 [465091,48475] 0 2024-04-12T13:42:21.664 INFO:tasks.workunit.client.1.smithi110.stdout:1/856: mknod de/d15/dab/dd8/d103/c120 0 2024-04-12T13:42:21.665 INFO:tasks.workunit.client.0.smithi060.stdout:5/837: write d6/dd/d1f/d25/d42/d52/f101 [2467222,80781] 0 2024-04-12T13:42:21.668 INFO:tasks.workunit.client.1.smithi110.stdout:0/804: unlink d1/d5e/f10c 0 2024-04-12T13:42:21.672 INFO:tasks.workunit.client.0.smithi060.stdout:5/838: read d6/dd/d1f/dd3/de7/faf [358969,117294] 0 2024-04-12T13:42:21.673 INFO:tasks.workunit.client.1.smithi110.stdout:4/973: truncate d0/de/d32/d61/f7a 2226652 0 2024-04-12T13:42:21.675 INFO:tasks.workunit.client.1.smithi110.stdout:6/863: creat d7/d25/d30/d44/da3/f10a x:0 0 0 2024-04-12T13:42:21.675 INFO:tasks.workunit.client.0.smithi060.stdout:3/844: stat d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/l76 0 2024-04-12T13:42:21.679 INFO:tasks.workunit.client.1.smithi110.stdout:4/974: write d0/d19/d1c/d50/fe2 [3202961,124093] 0 2024-04-12T13:42:21.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/775: symlink d6/d7/dd/d1a/d57/d63/df4/dc8/lfc 0 2024-04-12T13:42:21.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/799: truncate d9/d1b/d84/da0/d80/d109/d7b/db1/f10f 1175190 0 2024-04-12T13:42:21.685 INFO:tasks.workunit.client.1.smithi110.stdout:9/956: truncate df/d13/d26/f32 3552358 0 2024-04-12T13:42:21.689 INFO:tasks.workunit.client.1.smithi110.stdout:0/805: dwrite d1/d48/db2/d4a/f122 [0,4194304] 0 2024-04-12T13:42:21.690 INFO:tasks.workunit.client.1.smithi110.stdout:1/857: dread de/d14/d34/d108/fad [0,4194304] 0 2024-04-12T13:42:21.697 INFO:tasks.workunit.client.0.smithi060.stdout:7/789: rename d0/d7/f49 to d0/d7/ffb 0 2024-04-12T13:42:21.697 INFO:tasks.workunit.client.1.smithi110.stdout:2/908: link d6/dc/dd/d49/d64/d5d/f9f d6/dc/dd/d49/d64/d25/d103/f115 0 2024-04-12T13:42:21.701 INFO:tasks.workunit.client.1.smithi110.stdout:2/909: write d6/dc/d13/d80/d8d/dcc/d82/d84/fb3 [2890436,127674] 0 2024-04-12T13:42:21.702 INFO:tasks.workunit.client.1.smithi110.stdout:4/975: mkdir d0/de/d32/d61/de9/d147 0 2024-04-12T13:42:21.703 INFO:tasks.workunit.client.0.smithi060.stdout:1/961: getdents d1e/d29/d65 0 2024-04-12T13:42:21.703 INFO:tasks.workunit.client.1.smithi110.stdout:4/976: fdatasync d0/d75/d84/f106 0 2024-04-12T13:42:21.705 INFO:tasks.workunit.client.1.smithi110.stdout:8/883: sync 2024-04-12T13:42:21.705 INFO:tasks.workunit.client.1.smithi110.stdout:3/859: sync 2024-04-12T13:42:21.705 INFO:tasks.workunit.client.1.smithi110.stdout:4/977: chown d0/de/d2c/d57/l6b 2038227 1 2024-04-12T13:42:21.707 INFO:tasks.workunit.client.1.smithi110.stdout:3/860: write d5/dc/f24 [1177026,82855] 0 2024-04-12T13:42:21.711 INFO:tasks.workunit.client.1.smithi110.stdout:9/957: rmdir df/d13/d2c/d9e/dd6 39 2024-04-12T13:42:21.713 INFO:tasks.workunit.client.1.smithi110.stdout:5/838: dread da/d2e/d45/d25/d5d/fbd [0,4194304] 0 2024-04-12T13:42:21.713 INFO:tasks.workunit.client.0.smithi060.stdout:2/854: creat d6/dae/d5b/d6d/dfa/f108 x:0 0 0 2024-04-12T13:42:21.714 INFO:tasks.workunit.client.1.smithi110.stdout:9/958: write df/d13/d2c/d2d/d39/d3a/f8c [4610231,6987] 0 2024-04-12T13:42:21.714 INFO:tasks.workunit.client.0.smithi060.stdout:1/962: write d1e/f28 [2332373,122149] 0 2024-04-12T13:42:21.715 INFO:tasks.workunit.client.0.smithi060.stdout:6/855: link d1/l13 d1/d7/da/dc/d24/d30/d52/d5e/d7b/l117 0 2024-04-12T13:42:21.718 INFO:tasks.workunit.client.0.smithi060.stdout:6/856: chown d1/d7/c61 1435038 1 2024-04-12T13:42:21.718 INFO:tasks.workunit.client.1.smithi110.stdout:6/864: mkdir d7/d25/d2c/d4c/d77/d93/d10b 0 2024-04-12T13:42:21.720 INFO:tasks.workunit.client.0.smithi060.stdout:1/963: write d1e/d94/fe9 [2439521,26923] 0 2024-04-12T13:42:21.726 INFO:tasks.workunit.client.1.smithi110.stdout:0/806: dread - d1/d3c/fd6 zero size 2024-04-12T13:42:21.727 INFO:tasks.workunit.client.0.smithi060.stdout:5/839: mknod d6/dd/d1f/dd3/df3/d38/c113 0 2024-04-12T13:42:21.727 INFO:tasks.workunit.client.0.smithi060.stdout:1/964: dread - d1e/d29/f109 zero size 2024-04-12T13:42:21.730 INFO:tasks.workunit.client.0.smithi060.stdout:3/845: symlink d7/d17/d27/d36/d53/l111 0 2024-04-12T13:42:21.732 INFO:tasks.workunit.client.0.smithi060.stdout:8/800: dwrite d9/d1d/d5e/ff6 [0,4194304] 0 2024-04-12T13:42:21.735 INFO:tasks.workunit.client.1.smithi110.stdout:1/858: creat de/d15/d32/f121 x:0 0 0 2024-04-12T13:42:21.740 INFO:tasks.workunit.client.1.smithi110.stdout:7/901: sync 2024-04-12T13:42:21.743 INFO:tasks.workunit.client.1.smithi110.stdout:7/902: chown d1/d31/d5d/ce6 3292801 1 2024-04-12T13:42:21.744 INFO:tasks.workunit.client.0.smithi060.stdout:4/776: dread - d6/d7/dd/d1a/d19/d7a/d9d/ff6 zero size 2024-04-12T13:42:21.747 INFO:tasks.workunit.client.1.smithi110.stdout:7/903: write d1/d3/d4/d55/d56/f122 [206999,53726] 0 2024-04-12T13:42:21.763 INFO:tasks.workunit.client.1.smithi110.stdout:6/865: dread d7/d25/d30/dcf/dc3/fb4 [0,4194304] 0 2024-04-12T13:42:21.765 INFO:tasks.workunit.client.1.smithi110.stdout:4/978: mkdir d0/de/d2c/d116/d148 0 2024-04-12T13:42:21.766 INFO:tasks.workunit.client.1.smithi110.stdout:6/866: fdatasync d7/d10/d1c/d2b/d48/d54/ff1 0 2024-04-12T13:42:21.770 INFO:tasks.workunit.client.1.smithi110.stdout:3/861: fsync d5/dc/f67 0 2024-04-12T13:42:21.772 INFO:tasks.workunit.client.0.smithi060.stdout:7/790: read d0/d7/f6 [3107644,126515] 0 2024-04-12T13:42:21.777 INFO:tasks.workunit.client.1.smithi110.stdout:5/839: rmdir da/d2e/d45/ddc 39 2024-04-12T13:42:21.786 INFO:tasks.workunit.client.0.smithi060.stdout:2/855: creat d6/d64/d99/df0/d16/f109 x:0 0 0 2024-04-12T13:42:21.786 INFO:tasks.workunit.client.0.smithi060.stdout:9/764: truncate d4/d33/d50/f6c 3993981 0 2024-04-12T13:42:21.787 INFO:tasks.workunit.client.0.smithi060.stdout:6/857: fsync d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/f84 0 2024-04-12T13:42:21.789 INFO:tasks.workunit.client.1.smithi110.stdout:8/884: write d1/d5/d1f/f66 [12196932,49053] 0 2024-04-12T13:42:21.791 INFO:tasks.workunit.client.1.smithi110.stdout:1/859: unlink de/d15/c50 0 2024-04-12T13:42:21.801 INFO:tasks.workunit.client.1.smithi110.stdout:2/910: truncate d6/dc/dd/f47 1945571 0 2024-04-12T13:42:21.804 INFO:tasks.workunit.client.0.smithi060.stdout:4/777: creat d6/d2f/ffd x:0 0 0 2024-04-12T13:42:21.805 INFO:tasks.workunit.client.1.smithi110.stdout:2/911: write d6/dc/dd/dc6/fea [748700,12547] 0 2024-04-12T13:42:21.806 INFO:tasks.workunit.client.0.smithi060.stdout:7/791: fdatasync d0/d7/f87 0 2024-04-12T13:42:21.808 INFO:tasks.workunit.client.1.smithi110.stdout:4/979: mknod d0/de/d32/d61/c149 0 2024-04-12T13:42:21.814 INFO:tasks.workunit.client.1.smithi110.stdout:6/867: creat d7/d10/d1c/f10c x:0 0 0 2024-04-12T13:42:21.815 INFO:tasks.workunit.client.1.smithi110.stdout:2/912: truncate d6/dc/dd/dc6/fea 1067022 0 2024-04-12T13:42:21.816 INFO:tasks.workunit.client.0.smithi060.stdout:1/965: write d1e/d23/dd9/fc1 [757121,107411] 0 2024-04-12T13:42:21.819 INFO:tasks.workunit.client.0.smithi060.stdout:3/846: symlink d7/d17/d102/l112 0 2024-04-12T13:42:21.821 INFO:tasks.workunit.client.1.smithi110.stdout:9/959: dwrite df/d13/f1b [0,4194304] 0 2024-04-12T13:42:21.824 INFO:tasks.workunit.client.0.smithi060.stdout:9/765: read d4/f6f [330493,121421] 0 2024-04-12T13:42:21.824 INFO:tasks.workunit.client.1.smithi110.stdout:9/960: chown df/d13/d2c/d2d/d39/d3a 4 1 2024-04-12T13:42:21.824 INFO:tasks.workunit.client.0.smithi060.stdout:6/858: mknod d1/d7/da/dc/d24/d30/d52/d78/d80/c118 0 2024-04-12T13:42:21.829 INFO:tasks.workunit.client.0.smithi060.stdout:4/778: dread d6/d7/dd/d1a/d19/f1b [0,4194304] 0 2024-04-12T13:42:21.830 INFO:tasks.workunit.client.0.smithi060.stdout:9/766: fsync d4/d9/f3e 0 2024-04-12T13:42:21.832 INFO:tasks.workunit.client.0.smithi060.stdout:8/801: mkdir d9/d1b/d2b/d82/d8a/d116 0 2024-04-12T13:42:21.833 INFO:tasks.workunit.client.1.smithi110.stdout:8/885: rmdir d1/d3/d35/d3a/d84 39 2024-04-12T13:42:21.836 INFO:tasks.workunit.client.1.smithi110.stdout:1/860: creat de/d14/d34/db4/f122 x:0 0 0 2024-04-12T13:42:21.838 INFO:tasks.workunit.client.0.smithi060.stdout:2/856: write d6/d56/d43/f4a [1210580,103388] 0 2024-04-12T13:42:21.842 INFO:tasks.workunit.client.1.smithi110.stdout:4/980: fsync d0/d19/d8f/d112/f120 0 2024-04-12T13:42:21.842 INFO:tasks.workunit.client.1.smithi110.stdout:3/862: dwrite d5/dc/d20/d2d/d4f/fd1 [0,4194304] 0 2024-04-12T13:42:21.851 INFO:tasks.workunit.client.1.smithi110.stdout:9/961: unlink df/d13/d2c/d2d/l3c 0 2024-04-12T13:42:21.852 INFO:tasks.workunit.client.1.smithi110.stdout:9/962: chown df/d13/d26/dc9 3146 1 2024-04-12T13:42:21.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/840: link d6/d10/db8/dee/dfc/d46/lb7 d6/dd/d1f/d25/d35/l114 0 2024-04-12T13:42:21.861 INFO:tasks.workunit.client.1.smithi110.stdout:5/840: dwrite da/d2e/d45/faa [0,4194304] 0 2024-04-12T13:42:21.872 INFO:tasks.workunit.client.0.smithi060.stdout:4/779: stat d6/d7/c64 0 2024-04-12T13:42:21.875 INFO:tasks.workunit.client.0.smithi060.stdout:7/792: dwrite d0/d7/d92/ff0 [0,4194304] 0 2024-04-12T13:42:21.878 INFO:tasks.workunit.client.1.smithi110.stdout:0/807: dwrite d1/d8/f10 [0,4194304] 0 2024-04-12T13:42:21.879 INFO:tasks.workunit.client.0.smithi060.stdout:1/966: truncate d1e/d23/d2e/d30/d51/d85/ffb 1191607 0 2024-04-12T13:42:21.884 INFO:tasks.workunit.client.1.smithi110.stdout:3/863: creat d5/dc/d20/d2d/d4e/d89/d8c/dc5/f10b x:0 0 0 2024-04-12T13:42:21.888 INFO:tasks.workunit.client.1.smithi110.stdout:2/913: dwrite d6/d53/fe0 [0,4194304] 0 2024-04-12T13:42:21.889 INFO:tasks.workunit.client.0.smithi060.stdout:9/767: creat d4/d8/df1/d67/f103 x:0 0 0 2024-04-12T13:42:21.889 INFO:tasks.workunit.client.1.smithi110.stdout:7/904: dwrite d1/d3/d4/d55/f62 [0,4194304] 0 2024-04-12T13:42:21.891 INFO:tasks.workunit.client.0.smithi060.stdout:7/793: stat d0/l3f 0 2024-04-12T13:42:21.896 INFO:tasks.workunit.client.1.smithi110.stdout:2/914: dread - d6/d53/f10f zero size 2024-04-12T13:42:21.896 INFO:tasks.workunit.client.1.smithi110.stdout:9/963: dread - df/d13/f1c zero size 2024-04-12T13:42:21.897 INFO:tasks.workunit.client.0.smithi060.stdout:3/847: unlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/fd1 0 2024-04-12T13:42:21.897 INFO:tasks.workunit.client.1.smithi110.stdout:8/886: mknod d1/d3/d35/d3a/d84/c120 0 2024-04-12T13:42:21.899 INFO:tasks.workunit.client.0.smithi060.stdout:5/841: mknod d6/dd/d1f/d25/d53/d8d/c115 0 2024-04-12T13:42:21.904 INFO:tasks.workunit.client.0.smithi060.stdout:2/857: dwrite d6/dae/d31/d87/ff2 [0,4194304] 0 2024-04-12T13:42:21.912 INFO:tasks.workunit.client.0.smithi060.stdout:8/802: mknod d9/d1b/d2b/d82/d8a/dce/c117 0 2024-04-12T13:42:21.913 INFO:tasks.workunit.client.0.smithi060.stdout:6/859: dread d1/d7/da/dc/d24/d30/d52/f8a [0,4194304] 0 2024-04-12T13:42:21.914 INFO:tasks.workunit.client.1.smithi110.stdout:9/964: dwrite df/d13/d2c/d2d/dc1/d83/d63/d72/f134 [0,4194304] 0 2024-04-12T13:42:21.915 INFO:tasks.workunit.client.0.smithi060.stdout:6/860: chown d1/d7/da/dc/d24 543523 1 2024-04-12T13:42:21.916 INFO:tasks.workunit.client.1.smithi110.stdout:9/965: dread - df/d13/d2c/d2d/f130 zero size 2024-04-12T13:42:21.917 INFO:tasks.workunit.client.0.smithi060.stdout:5/842: mknod d6/d89/c116 0 2024-04-12T13:42:21.918 INFO:tasks.workunit.client.1.smithi110.stdout:6/868: sync 2024-04-12T13:42:21.921 INFO:tasks.workunit.client.1.smithi110.stdout:4/981: rename d0/d75/d91 to d0/de/d2c/d116/d148/d14a 0 2024-04-12T13:42:21.931 INFO:tasks.workunit.client.1.smithi110.stdout:9/966: dwrite df/d13/d2c/d2d/d39/d3a/f8c [0,4194304] 0 2024-04-12T13:42:21.933 INFO:tasks.workunit.client.1.smithi110.stdout:9/967: readlink df/d13/d2c/d2d/d94/lf0 0 2024-04-12T13:42:21.934 INFO:tasks.workunit.client.0.smithi060.stdout:7/794: creat d0/d3d/d74/d9b/da1/ffc x:0 0 0 2024-04-12T13:42:21.934 INFO:tasks.workunit.client.0.smithi060.stdout:7/795: dread - d0/d3d/d74/d9b/da1/ffc zero size 2024-04-12T13:42:21.936 INFO:tasks.workunit.client.1.smithi110.stdout:0/808: creat d1/d8/d8a/dce/f124 x:0 0 0 2024-04-12T13:42:21.939 INFO:tasks.workunit.client.1.smithi110.stdout:3/864: creat d5/dc/d31/d3b/d32/d3e/d98/f10c x:0 0 0 2024-04-12T13:42:21.941 INFO:tasks.workunit.client.0.smithi060.stdout:7/796: chown d0/d7/d92/db7 4 1 2024-04-12T13:42:21.945 INFO:tasks.workunit.client.0.smithi060.stdout:2/858: rmdir d6/dae/d5b 39 2024-04-12T13:42:21.948 INFO:tasks.workunit.client.0.smithi060.stdout:7/797: write d0/fe [989151,22687] 0 2024-04-12T13:42:21.949 INFO:tasks.workunit.client.0.smithi060.stdout:8/803: rename d9/d1b/d37/l3f to d9/d1b/d84/da0/d114/l118 0 2024-04-12T13:42:21.956 INFO:tasks.workunit.client.1.smithi110.stdout:9/968: dread df/d13/d2c/d2d/dc1/d83/f68 [0,4194304] 0 2024-04-12T13:42:21.957 INFO:tasks.workunit.client.0.smithi060.stdout:7/798: chown d0/d7/da9/ff5 0 1 2024-04-12T13:42:21.957 INFO:tasks.workunit.client.0.smithi060.stdout:8/804: chown d9/d1d/d5e/d90/fe7 805 1 2024-04-12T13:42:21.967 INFO:tasks.workunit.client.0.smithi060.stdout:5/843: mknod d6/dd/d1f/d25/d53/d8d/c117 0 2024-04-12T13:42:21.968 INFO:tasks.workunit.client.0.smithi060.stdout:1/967: creat d1e/d23/dd9/f14d x:0 0 0 2024-04-12T13:42:21.977 INFO:tasks.workunit.client.0.smithi060.stdout:8/805: mknod d9/d1b/d84/c119 0 2024-04-12T13:42:21.978 INFO:tasks.workunit.client.0.smithi060.stdout:8/806: stat d9/l13 0 2024-04-12T13:42:21.982 INFO:tasks.workunit.client.0.smithi060.stdout:4/780: write d6/d7/dd/d1a/d19/d7a/d9d/ff6 [247164,95333] 0 2024-04-12T13:42:21.984 INFO:tasks.workunit.client.0.smithi060.stdout:8/807: write d9/d1d/d5e/ff6 [2295754,33532] 0 2024-04-12T13:42:21.988 INFO:tasks.workunit.client.0.smithi060.stdout:5/844: creat d6/dd/d27/d7d/f118 x:0 0 0 2024-04-12T13:42:21.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/859: mkdir d6/d64/d99/df0/d81/dbd/d10a 0 2024-04-12T13:42:21.994 INFO:tasks.workunit.client.0.smithi060.stdout:2/860: chown d6/d56/d43 504296571 1 2024-04-12T13:42:21.995 INFO:tasks.workunit.client.0.smithi060.stdout:3/848: write d7/d17/d27/d36/d53/f89 [781441,95946] 0 2024-04-12T13:42:21.997 INFO:tasks.workunit.client.0.smithi060.stdout:2/861: chown d6/cf 17 1 2024-04-12T13:42:22.000 INFO:tasks.workunit.client.0.smithi060.stdout:8/808: dread d9/d1b/d84/da0/d80/d109/d7b/f9e [0,4194304] 0 2024-04-12T13:42:22.000 INFO:tasks.workunit.client.0.smithi060.stdout:7/799: creat d0/d7/d43/d63/d90/de7/ffd x:0 0 0 2024-04-12T13:42:22.014 INFO:tasks.workunit.client.0.smithi060.stdout:4/781: truncate d6/d7/dd/d1a/d19/f1b 366408 0 2024-04-12T13:42:22.015 INFO:tasks.workunit.client.0.smithi060.stdout:2/862: creat d6/d64/d99/df0/d4b/f10b x:0 0 0 2024-04-12T13:42:22.018 INFO:tasks.workunit.client.0.smithi060.stdout:5/845: symlink d6/d10/l119 0 2024-04-12T13:42:22.024 INFO:tasks.workunit.client.0.smithi060.stdout:6/861: dwrite d1/d7/da/dc/d24/d30/d52/d5e/fbb [4194304,4194304] 0 2024-04-12T13:42:22.024 INFO:tasks.workunit.client.0.smithi060.stdout:7/800: creat d0/d3d/dd7/ffe x:0 0 0 2024-04-12T13:42:22.024 INFO:tasks.workunit.client.0.smithi060.stdout:9/768: dread d4/d8/df1/fb5 [0,4194304] 0 2024-04-12T13:42:22.028 INFO:tasks.workunit.client.0.smithi060.stdout:2/863: chown d6/d64/d99/df0/d81/dbd/d10a 38274 1 2024-04-12T13:42:22.029 INFO:tasks.workunit.client.0.smithi060.stdout:9/769: readlink l3 0 2024-04-12T13:42:22.031 INFO:tasks.workunit.client.0.smithi060.stdout:8/809: mkdir d9/d1b/d2b/d82/d8a/d116/d11a 0 2024-04-12T13:42:22.031 INFO:tasks.workunit.client.0.smithi060.stdout:1/968: rename d1e/d23/d2e/d30/c11c to d1e/d23/d2e/d86/ddb/c14e 0 2024-04-12T13:42:22.033 INFO:tasks.workunit.client.0.smithi060.stdout:5/846: creat d6/dd/d1f/dd3/d5f/f11a x:0 0 0 2024-04-12T13:42:22.035 INFO:tasks.workunit.client.0.smithi060.stdout:7/801: rmdir d0/d7/d92 39 2024-04-12T13:42:22.040 INFO:tasks.workunit.client.0.smithi060.stdout:8/810: write d9/d1d/d5e/ff6 [3036587,47723] 0 2024-04-12T13:42:22.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/782: truncate d6/d7/dd/d1a/d57/d63/df4/dc8/fca 4953189 0 2024-04-12T13:42:22.044 INFO:tasks.workunit.client.0.smithi060.stdout:2/864: stat d6/d64/d99/df0/daa/db0/def/cf1 0 2024-04-12T13:42:22.047 INFO:tasks.workunit.client.0.smithi060.stdout:9/770: read - d4/d33/d50/dd0/fe6 zero size 2024-04-12T13:42:22.049 INFO:tasks.workunit.client.0.smithi060.stdout:1/969: chown d1e/d23/d2e/d86/c140 20 1 2024-04-12T13:42:22.050 INFO:tasks.workunit.client.0.smithi060.stdout:2/865: chown d6/d56/f75 1 1 2024-04-12T13:42:22.051 INFO:tasks.workunit.client.1.smithi110.stdout:2/915: rename d6/dc/d6f/f10d to d6/dc/d6f/f116 0 2024-04-12T13:42:22.051 INFO:tasks.workunit.client.1.smithi110.stdout:3/865: sync 2024-04-12T13:42:22.055 INFO:tasks.workunit.client.0.smithi060.stdout:7/802: creat d0/d1b/da4/fff x:0 0 0 2024-04-12T13:42:22.055 INFO:tasks.workunit.client.0.smithi060.stdout:3/849: dwrite d7/d17/d19/dc9/d3f/d5c/f8d [0,4194304] 0 2024-04-12T13:42:22.058 INFO:tasks.workunit.client.0.smithi060.stdout:6/862: mkdir d1/d7/da/dc/dc2/d119 0 2024-04-12T13:42:22.062 INFO:tasks.workunit.client.1.smithi110.stdout:8/887: truncate d1/d3/d35/d43/d9f/dd5/d11e/d85/dc2/fe0 359611 0 2024-04-12T13:42:22.069 INFO:tasks.workunit.client.0.smithi060.stdout:5/847: dwrite d6/d10/db8/dee/dfc/da2/f102 [0,4194304] 0 2024-04-12T13:42:22.069 INFO:tasks.workunit.client.1.smithi110.stdout:1/861: creat de/d14/d34/d55/f123 x:0 0 0 2024-04-12T13:42:22.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/783: symlink d6/d7/dd/d1a/d19/d42/d7c/lfe 0 2024-04-12T13:42:22.082 INFO:tasks.workunit.client.1.smithi110.stdout:3/866: dread d5/f99 [0,4194304] 0 2024-04-12T13:42:22.091 INFO:tasks.workunit.client.1.smithi110.stdout:6/869: rmdir d7/d10/d1c/d7f 39 2024-04-12T13:42:22.093 INFO:tasks.workunit.client.0.smithi060.stdout:1/970: mkdir d1e/d23/d2e/d5e/d68/d9a/de1/d14f 0 2024-04-12T13:42:22.093 INFO:tasks.workunit.client.0.smithi060.stdout:5/848: dread d6/dd/d1f/d25/d53/fd9 [0,4194304] 0 2024-04-12T13:42:22.095 INFO:tasks.workunit.client.1.smithi110.stdout:4/982: rmdir d0/d19/d1c/d50/d6f 39 2024-04-12T13:42:22.100 INFO:tasks.workunit.client.0.smithi060.stdout:5/849: write d6/dd/d1f/d25/d53/d87/f10f [879644,30235] 0 2024-04-12T13:42:22.101 INFO:tasks.workunit.client.0.smithi060.stdout:8/811: mknod d9/d1b/d2b/d82/d8a/d116/d11a/c11b 0 2024-04-12T13:42:22.102 INFO:tasks.workunit.client.1.smithi110.stdout:9/969: mknod df/d13/d2c/d2d/d39/d3a/db2/c13e 0 2024-04-12T13:42:22.103 INFO:tasks.workunit.client.1.smithi110.stdout:0/809: chown d1/d8/d36/d51/f68 6544308 1 2024-04-12T13:42:22.106 INFO:tasks.workunit.client.0.smithi060.stdout:4/784: mkdir d6/d7/dd/d1a/dde/dff 0 2024-04-12T13:42:22.107 INFO:tasks.workunit.client.0.smithi060.stdout:5/850: chown d6/dd/d1f/dd3/d5f/f7f 154030 1 2024-04-12T13:42:22.109 INFO:tasks.workunit.client.1.smithi110.stdout:9/970: write df/d13/d2c/d9e/d107/f12b [542488,94018] 0 2024-04-12T13:42:22.109 INFO:tasks.workunit.client.0.smithi060.stdout:7/803: creat d0/df3/f100 x:0 0 0 2024-04-12T13:42:22.112 INFO:tasks.workunit.client.0.smithi060.stdout:4/785: readlink d6/d7/dd/d1a/d57/d63/df4/l90 0 2024-04-12T13:42:22.113 INFO:tasks.workunit.client.0.smithi060.stdout:4/786: readlink d6/d21/lf7 0 2024-04-12T13:42:22.119 INFO:tasks.workunit.client.0.smithi060.stdout:3/850: fdatasync d7/d17/d27/d36/f62 0 2024-04-12T13:42:22.121 INFO:tasks.workunit.client.1.smithi110.stdout:1/862: mknod de/d15/dab/c124 0 2024-04-12T13:42:22.127 INFO:tasks.workunit.client.0.smithi060.stdout:1/971: dwrite d1e/d23/dd9/fc6 [0,4194304] 0 2024-04-12T13:42:22.128 INFO:tasks.workunit.client.1.smithi110.stdout:5/841: write da/d2e/d45/d25/d9d/d79/d88/dd3/f7d [1168501,46495] 0 2024-04-12T13:42:22.128 INFO:tasks.workunit.client.1.smithi110.stdout:8/888: dread d1/d3/d35/d43/d9f/dd5/d11e/d85/fe7 [0,4194304] 0 2024-04-12T13:42:22.132 INFO:tasks.workunit.client.1.smithi110.stdout:6/870: mkdir d7/d10/d1c/d2b/d48/d4b/dcc/d10d 0 2024-04-12T13:42:22.134 INFO:tasks.workunit.client.0.smithi060.stdout:5/851: stat d6/dd/d27/f112 0 2024-04-12T13:42:22.134 INFO:tasks.workunit.client.1.smithi110.stdout:4/983: rmdir d0/d19/d8f/dc5 39 2024-04-12T13:42:22.136 INFO:tasks.workunit.client.0.smithi060.stdout:7/804: fsync d0/d7/f87 0 2024-04-12T13:42:22.137 INFO:tasks.workunit.client.0.smithi060.stdout:5/852: fdatasync d6/d89/f10e 0 2024-04-12T13:42:22.143 INFO:tasks.workunit.client.0.smithi060.stdout:3/851: mknod d7/d17/d27/d36/d53/da2/dbc/c113 0 2024-04-12T13:42:22.154 INFO:tasks.workunit.client.0.smithi060.stdout:2/866: dwrite d6/d56/fa8 [0,4194304] 0 2024-04-12T13:42:22.157 INFO:tasks.workunit.client.0.smithi060.stdout:6/863: dread d1/d7/da/dc/d7a/de1/d113/f4d [0,4194304] 0 2024-04-12T13:42:22.168 INFO:tasks.workunit.client.1.smithi110.stdout:3/867: unlink d5/d86/c8a 0 2024-04-12T13:42:22.178 INFO:tasks.workunit.client.1.smithi110.stdout:5/842: fsync da/d2e/d45/d25/d9d/d7a/db5/fce 0 2024-04-12T13:42:22.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:21 smithi060 ceph-mon[29097]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 70 MiB/s rd, 179 MiB/s wr, 383 op/s 2024-04-12T13:42:22.184 INFO:tasks.workunit.client.0.smithi060.stdout:9/771: dwrite d4/d9/f2a [0,4194304] 0 2024-04-12T13:42:22.184 INFO:tasks.workunit.client.0.smithi060.stdout:9/772: chown d4/d33/d65 28187 1 2024-04-12T13:42:22.185 INFO:tasks.workunit.client.1.smithi110.stdout:4/984: unlink d0/d19/d26/c83 0 2024-04-12T13:42:22.186 INFO:tasks.workunit.client.0.smithi060.stdout:6/864: truncate d1/d7/da/dc/d24/d30/d52/d78/fff 79107 0 2024-04-12T13:42:22.191 INFO:tasks.workunit.client.1.smithi110.stdout:4/985: chown d0/d13/f21 4428 1 2024-04-12T13:42:22.192 INFO:tasks.workunit.client.1.smithi110.stdout:7/905: truncate d1/f18 442078 0 2024-04-12T13:42:22.195 INFO:tasks.workunit.client.1.smithi110.stdout:8/889: rename d1/d3/d35/d43/d9f/dd5/d11e/d85/dc2/f110 to d1/d3/f121 0 2024-04-12T13:42:22.199 INFO:tasks.workunit.client.1.smithi110.stdout:6/871: creat d7/d10/d1c/d2b/d48/d4b/dcc/f10e x:0 0 0 2024-04-12T13:42:22.203 INFO:tasks.workunit.client.1.smithi110.stdout:2/916: creat d6/f117 x:0 0 0 2024-04-12T13:42:22.205 INFO:tasks.workunit.client.1.smithi110.stdout:8/890: write d1/d3/d35/d3a/d84/d101/f11d [492836,70092] 0 2024-04-12T13:42:22.211 INFO:tasks.workunit.client.1.smithi110.stdout:3/868: creat d5/dc/d20/d2d/db1/f10d x:0 0 0 2024-04-12T13:42:22.217 INFO:tasks.workunit.client.1.smithi110.stdout:8/891: stat d1/d3/d35/d43/d9f/dd5/d11e/d85/d8d/fc4 0 2024-04-12T13:42:22.218 INFO:tasks.workunit.client.1.smithi110.stdout:1/863: write de/d14/d34/d55/d6b/fe5 [984253,49776] 0 2024-04-12T13:42:22.221 INFO:tasks.workunit.client.1.smithi110.stdout:7/906: truncate d1/d31/d5d/d127/d97/fe1 323370 0 2024-04-12T13:42:22.223 INFO:tasks.workunit.client.1.smithi110.stdout:8/892: fdatasync d1/d5/f117 0 2024-04-12T13:42:22.224 INFO:tasks.workunit.client.1.smithi110.stdout:3/869: chown d5/dc/d31/d3b/d32/d3e/c79 10 1 2024-04-12T13:42:22.226 INFO:tasks.workunit.client.1.smithi110.stdout:2/917: creat d6/dc/d13/dec/f118 x:0 0 0 2024-04-12T13:42:22.226 INFO:tasks.workunit.client.1.smithi110.stdout:6/872: truncate d7/d10/d1c/d2b/f71 2986883 0 2024-04-12T13:42:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:21 smithi110 ceph-mon[36055]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 70 MiB/s rd, 179 MiB/s wr, 383 op/s 2024-04-12T13:42:22.229 INFO:tasks.workunit.client.1.smithi110.stdout:7/907: chown d1/d3/d4/dbf/db6/fb7 33455 1 2024-04-12T13:42:22.229 INFO:tasks.workunit.client.1.smithi110.stdout:0/810: dwrite d1/d8/d36/d51/dee/ff9 [0,4194304] 0 2024-04-12T13:42:22.229 INFO:tasks.workunit.client.1.smithi110.stdout:4/986: symlink d0/d19/d1c/d50/d6f/l14b 0 2024-04-12T13:42:22.232 INFO:tasks.workunit.client.1.smithi110.stdout:6/873: chown d7/d10/d1c/c9c 881808 1 2024-04-12T13:42:22.233 INFO:tasks.workunit.client.1.smithi110.stdout:9/971: link df/d38/d6e/faa df/d13/d2c/d9e/dd6/dcf/f13f 0 2024-04-12T13:42:22.233 INFO:tasks.workunit.client.1.smithi110.stdout:0/811: chown d1/d3c/dd8/df4 594979018 1 2024-04-12T13:42:22.237 INFO:tasks.workunit.client.1.smithi110.stdout:0/812: chown d1/d8/d36/d51/d60/l39 519121357 1 2024-04-12T13:42:22.238 INFO:tasks.workunit.client.1.smithi110.stdout:1/864: creat de/d14/d34/d87/f125 x:0 0 0 2024-04-12T13:42:22.243 INFO:tasks.workunit.client.1.smithi110.stdout:5/843: creat da/d2e/d45/d29/f123 x:0 0 0 2024-04-12T13:42:22.248 INFO:tasks.workunit.client.1.smithi110.stdout:3/870: rename d5/dc/d31/d3b/d32/d3e/fdb to d5/dc/d20/d2d/d4f/f10e 0 2024-04-12T13:42:22.250 INFO:tasks.workunit.client.1.smithi110.stdout:2/918: dwrite d6/dc/dd/d49/d64/fca [0,4194304] 0 2024-04-12T13:42:22.251 INFO:tasks.workunit.client.1.smithi110.stdout:7/908: chown d1/d3/d4/d55/d82/l128 214 1 2024-04-12T13:42:22.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/791: sync 2024-04-12T13:42:22.387 INFO:tasks.workunit.client.1.smithi110.stdout:5/844: chown da/d2e/d45/d29/d105/df4/l122 0 1 2024-04-12T13:42:22.389 INFO:tasks.workunit.client.1.smithi110.stdout:4/987: creat d0/d19/d8f/d112/f14c x:0 0 0 2024-04-12T13:42:22.389 INFO:tasks.workunit.client.1.smithi110.stdout:2/919: dread d6/dc/dd/f28 [0,4194304] 0 2024-04-12T13:42:22.394 INFO:tasks.workunit.client.1.smithi110.stdout:6/874: rename d7/d25/d2c/d4c/d77/cb1 to d7/d25/d2c/d4c/d77/db9/c10f 0 2024-04-12T13:42:22.396 INFO:tasks.workunit.client.1.smithi110.stdout:2/920: write d6/dc/dd/f114 [526934,1452] 0 2024-04-12T13:42:22.403 INFO:tasks.workunit.client.1.smithi110.stdout:3/871: symlink d5/dc/d20/d2d/db1/l10f 0 2024-04-12T13:42:22.416 INFO:tasks.workunit.client.1.smithi110.stdout:9/972: getdents df/d13/d2c/d2d/d94/d117 0 2024-04-12T13:42:22.420 INFO:tasks.workunit.client.1.smithi110.stdout:6/875: read d7/d10/d1c/f28 [4095831,123401] 0 2024-04-12T13:42:22.426 INFO:tasks.workunit.client.1.smithi110.stdout:1/865: dwrite de/d15/dab/fc5 [0,4194304] 0 2024-04-12T13:42:22.428 INFO:tasks.workunit.client.1.smithi110.stdout:0/813: dread d1/d27/d31/f49 [4194304,4194304] 0 2024-04-12T13:42:22.431 INFO:tasks.workunit.client.1.smithi110.stdout:0/814: chown d1/d8/d36/d51/dee/ff9 17166 1 2024-04-12T13:42:22.432 INFO:tasks.workunit.client.1.smithi110.stdout:2/921: unlink d6/dc/dd/d49/faf 0 2024-04-12T13:42:22.433 INFO:tasks.workunit.client.1.smithi110.stdout:0/815: chown d1/d56/deb 35 1 2024-04-12T13:42:22.436 INFO:tasks.workunit.client.1.smithi110.stdout:8/893: link d1/d3/d3c/d5a/d6f/d83/c11c d1/d3/d35/d3a/d3e/d4f/c122 0 2024-04-12T13:42:22.446 INFO:tasks.workunit.client.1.smithi110.stdout:3/872: rename d5/dc/d20/d2d/d4e/d89/dc0/cc1 to d5/dc/da0/c110 0 2024-04-12T13:42:22.464 INFO:tasks.workunit.client.0.smithi060.stdout:4/787: fsync d6/d7/dd/d1a/d57/d63/df4/f72 0 2024-04-12T13:42:22.466 INFO:tasks.workunit.client.1.smithi110.stdout:4/988: sync 2024-04-12T13:42:22.467 INFO:tasks.workunit.client.0.smithi060.stdout:1/972: mkdir d1e/d23/d49/d4e/d9b/d150 0 2024-04-12T13:42:22.468 INFO:tasks.workunit.client.1.smithi110.stdout:1/866: truncate de/d15/dab/dd8/dd9/dda/ff2 276873 0 2024-04-12T13:42:22.474 INFO:tasks.workunit.client.1.smithi110.stdout:1/867: write de/d14/d34/d108/d10e/f118 [137023,78329] 0 2024-04-12T13:42:22.475 INFO:tasks.workunit.client.1.smithi110.stdout:0/816: symlink d1/d8/d8a/l125 0 2024-04-12T13:42:22.477 INFO:tasks.workunit.client.0.smithi060.stdout:3/852: truncate d7/d17/d27/d36/d53/f94 1702120 0 2024-04-12T13:42:22.483 INFO:tasks.workunit.client.1.smithi110.stdout:9/973: symlink df/d13/d2c/d9e/dd6/l140 0 2024-04-12T13:42:22.486 INFO:tasks.workunit.client.0.smithi060.stdout:2/867: creat d6/d64/d99/df0/d2b/d60/f10c x:0 0 0 2024-04-12T13:42:22.487 INFO:tasks.workunit.client.1.smithi110.stdout:5/845: write da/d2e/d45/d25/f5a [4529724,5414] 0 2024-04-12T13:42:22.493 INFO:tasks.workunit.client.1.smithi110.stdout:5/846: chown da/d2e/d45/d25/d9d/d7a/db5/l7f 187 1 2024-04-12T13:42:22.499 INFO:tasks.workunit.client.1.smithi110.stdout:2/922: unlink d6/dc/dd/f47 0 2024-04-12T13:42:22.505 INFO:tasks.workunit.client.1.smithi110.stdout:4/989: rename d0/d19/d1c/d50/d6f/l136 to d0/de/da0/dd9/df3/de0/d7e/daa/dcd/l14d 0 2024-04-12T13:42:22.507 INFO:tasks.workunit.client.0.smithi060.stdout:2/868: dread d6/d64/d99/df0/d16/d36/fa7 [0,4194304] 0 2024-04-12T13:42:22.513 INFO:tasks.workunit.client.0.smithi060.stdout:2/869: truncate d6/d64/d99/df0/daa/ddf/ff3 935334 0 2024-04-12T13:42:22.516 INFO:tasks.workunit.client.0.smithi060.stdout:1/973: write d1e/d29/fdf [988619,28251] 0 2024-04-12T13:42:22.521 INFO:tasks.workunit.client.0.smithi060.stdout:8/812: getdents d9/d1d/d5e/d90 0 2024-04-12T13:42:22.523 INFO:tasks.workunit.client.0.smithi060.stdout:3/853: symlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/l114 0 2024-04-12T13:42:22.525 INFO:tasks.workunit.client.1.smithi110.stdout:3/873: dread d5/dc/da0/fc4 [0,4194304] 0 2024-04-12T13:42:22.526 INFO:tasks.workunit.client.0.smithi060.stdout:7/805: write d0/d7/f5e [1065079,36138] 0 2024-04-12T13:42:22.531 INFO:tasks.workunit.client.0.smithi060.stdout:6/865: mknod d1/d7/da/d20/da8/df0/c11a 0 2024-04-12T13:42:22.535 INFO:tasks.workunit.client.0.smithi060.stdout:1/974: dread d1e/d29/fdf [0,4194304] 0 2024-04-12T13:42:22.538 INFO:tasks.workunit.client.1.smithi110.stdout:9/974: rename fc to df/d13/d2c/d2d/dd3/d10e/d131/f141 0 2024-04-12T13:42:22.542 INFO:tasks.workunit.client.0.smithi060.stdout:4/788: symlink d6/d7/dd/l100 0 2024-04-12T13:42:22.544 INFO:tasks.workunit.client.1.smithi110.stdout:4/990: symlink d0/de/d2c/d57/l14e 0 2024-04-12T13:42:22.546 INFO:tasks.workunit.client.1.smithi110.stdout:9/975: dread df/d38/f95 [0,4194304] 0 2024-04-12T13:42:22.550 INFO:tasks.workunit.client.1.smithi110.stdout:8/894: creat d1/d3/d35/d43/d9f/dd5/d11e/f123 x:0 0 0 2024-04-12T13:42:22.551 INFO:tasks.workunit.client.1.smithi110.stdout:4/991: write d0/de/da0/dd9/df3/de0/d7e/f11e [273214,123200] 0 2024-04-12T13:42:22.555 INFO:tasks.workunit.client.1.smithi110.stdout:6/876: creat d7/d10/d1c/d2b/d3a/dbf/f110 x:0 0 0 2024-04-12T13:42:22.557 INFO:tasks.workunit.client.1.smithi110.stdout:7/909: link d1/d1b/d70/fef d1/d3/d4/f130 0 2024-04-12T13:42:22.558 INFO:tasks.workunit.client.1.smithi110.stdout:8/895: write d1/d3/f13 [84704,82048] 0 2024-04-12T13:42:22.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/806: rmdir d0/d1b/d8c/db6 39 2024-04-12T13:42:22.562 INFO:tasks.workunit.client.1.smithi110.stdout:3/874: rmdir d5/d86/dca 39 2024-04-12T13:42:22.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/975: fdatasync d1e/d23/d49/fcf 0 2024-04-12T13:42:22.570 INFO:tasks.workunit.client.1.smithi110.stdout:7/910: truncate d1/d31/d5d/d127/f11c 80512 0 2024-04-12T13:42:22.571 INFO:tasks.workunit.client.1.smithi110.stdout:9/976: fsync df/f24 0 2024-04-12T13:42:22.571 INFO:tasks.workunit.client.1.smithi110.stdout:3/875: stat d5/dc/d20/d2d/d4e/d89/d8c/db6/f105 0 2024-04-12T13:42:22.574 INFO:tasks.workunit.client.0.smithi060.stdout:4/789: rmdir d6/d7/dd/d1a/d57/d63/df4 39 2024-04-12T13:42:22.574 INFO:tasks.workunit.client.1.smithi110.stdout:0/817: dwrite d1/d8/f21 [0,4194304] 0 2024-04-12T13:42:22.575 INFO:tasks.workunit.client.0.smithi060.stdout:2/870: getdents d6/d64/d99/df0/dc4 0 2024-04-12T13:42:22.576 INFO:tasks.workunit.client.1.smithi110.stdout:1/868: fsync de/d15/d32/d61/d6a/f10a 0 2024-04-12T13:42:22.577 INFO:tasks.workunit.client.0.smithi060.stdout:8/813: write d9/d1b/d37/d4d/d63/f89 [3191517,126411] 0 2024-04-12T13:42:22.578 INFO:tasks.workunit.client.1.smithi110.stdout:5/847: dwrite da/db/d15/fec [0,4194304] 0 2024-04-12T13:42:22.578 INFO:tasks.workunit.client.1.smithi110.stdout:9/977: readlink df/d13/l2a 0 2024-04-12T13:42:22.584 INFO:tasks.workunit.client.1.smithi110.stdout:2/923: dwrite d6/dc/dd/d49/d64/d25/f6d [0,4194304] 0 2024-04-12T13:42:22.586 INFO:tasks.workunit.client.0.smithi060.stdout:4/790: truncate d6/d7/dd/d1a/d57/d63/fec 4626046 0 2024-04-12T13:42:22.587 INFO:tasks.workunit.client.1.smithi110.stdout:2/924: stat d6/dc/d1b/l58 0 2024-04-12T13:42:22.589 INFO:tasks.workunit.client.1.smithi110.stdout:4/992: creat d0/de/d2c/d116/f14f x:0 0 0 2024-04-12T13:42:22.592 INFO:tasks.workunit.client.0.smithi060.stdout:0/792: getdents d7/d9/d14/d35/d44/d7d 0 2024-04-12T13:42:22.595 INFO:tasks.workunit.client.0.smithi060.stdout:7/807: symlink d0/d3d/d74/d9b/l101 0 2024-04-12T13:42:22.601 INFO:tasks.workunit.client.0.smithi060.stdout:8/814: creat d9/d1b/d84/da0/f11c x:0 0 0 2024-04-12T13:42:22.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/866: dread d1/d7/da/dc/d24/d2d/db3/f102 [0,4194304] 0 2024-04-12T13:42:22.601 INFO:tasks.workunit.client.1.smithi110.stdout:7/911: symlink d1/d1b/d70/l131 0 2024-04-12T13:42:22.607 INFO:tasks.workunit.client.0.smithi060.stdout:2/871: fsync d6/d64/d99/df0/d81/dbd/f59 0 2024-04-12T13:42:22.615 INFO:tasks.workunit.client.1.smithi110.stdout:9/978: fdatasync df/d13/d26/f45 0 2024-04-12T13:42:22.621 INFO:tasks.workunit.client.0.smithi060.stdout:0/793: creat d7/d9/d14/d35/d44/d49/dcf/f115 x:0 0 0 2024-04-12T13:42:22.622 INFO:tasks.workunit.client.1.smithi110.stdout:1/869: unlink de/d15/d32/d61/d6a/dac/dc0/dea/cf1 0 2024-04-12T13:42:22.623 INFO:tasks.workunit.client.1.smithi110.stdout:1/870: fsync de/d14/d34/d55/f5c 0 2024-04-12T13:42:22.624 INFO:tasks.workunit.client.0.smithi060.stdout:0/794: dread - d7/d9/d14/d35/d44/d8c/d8d/de9/f100 zero size 2024-04-12T13:42:22.629 INFO:tasks.workunit.client.1.smithi110.stdout:2/925: creat d6/dc/dd/d49/d64/d4a/dc1/f119 x:0 0 0 2024-04-12T13:42:22.631 INFO:tasks.workunit.client.1.smithi110.stdout:9/979: dwrite df/d13/d2c/d9e/f111 [0,4194304] 0 2024-04-12T13:42:22.635 INFO:tasks.workunit.client.0.smithi060.stdout:3/854: link d7/d17/l37 d7/d17/d102/l115 0 2024-04-12T13:42:22.635 INFO:tasks.workunit.client.1.smithi110.stdout:6/877: symlink d7/d25/d2c/d4c/d77/l111 0 2024-04-12T13:42:22.636 INFO:tasks.workunit.client.0.smithi060.stdout:8/815: symlink d9/d1b/d84/da0/d80/l11d 0 2024-04-12T13:42:22.640 INFO:tasks.workunit.client.1.smithi110.stdout:9/980: dread df/d13/d2c/d2d/dc1/d83/d63/fc7 [0,4194304] 0 2024-04-12T13:42:22.645 INFO:tasks.workunit.client.0.smithi060.stdout:4/791: dwrite d6/d7/dd/d1a/d57/d63/df4/fb1 [0,4194304] 0 2024-04-12T13:42:22.650 INFO:tasks.workunit.client.0.smithi060.stdout:0/795: fdatasync d7/d9/de/d80/dc8/fe2 0 2024-04-12T13:42:22.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/976: link d1e/d94/dd4/c142 d1e/d46/d134/c151 0 2024-04-12T13:42:22.651 INFO:tasks.workunit.client.1.smithi110.stdout:8/896: dwrite d1/d3/d35/d3a/d3e/f99 [0,4194304] 0 2024-04-12T13:42:22.653 INFO:tasks.workunit.client.1.smithi110.stdout:8/897: readlink d1/d3/d35/d43/d9f/dd5/d11e/d85/lfb 0 2024-04-12T13:42:22.653 INFO:tasks.workunit.client.0.smithi060.stdout:7/808: rename d0/d7/d92/ff0 to d0/d7/d92/f102 0 2024-04-12T13:42:22.663 INFO:tasks.workunit.client.1.smithi110.stdout:5/848: creat da/d2e/d45/d25/d9d/d79/d88/d121/f124 x:0 0 0 2024-04-12T13:42:22.665 INFO:tasks.workunit.client.1.smithi110.stdout:5/849: fsync da/d35/f109 0 2024-04-12T13:42:22.671 INFO:tasks.workunit.client.0.smithi060.stdout:6/867: dread d1/d7/da/fc4 [0,4194304] 0 2024-04-12T13:42:22.671 INFO:tasks.workunit.client.1.smithi110.stdout:3/876: write d5/dc/d31/d3b/d32/d3e/f44 [3816891,50953] 0 2024-04-12T13:42:22.674 INFO:tasks.workunit.client.1.smithi110.stdout:4/993: write d0/de/da0/dd9/df3/de0/fb3 [964255,101273] 0 2024-04-12T13:42:22.678 INFO:tasks.workunit.client.0.smithi060.stdout:0/796: symlink d7/d9/d14/d35/d44/l116 0 2024-04-12T13:42:22.678 INFO:tasks.workunit.client.0.smithi060.stdout:6/868: write d1/d7/da/dc/d24/d30/d52/d78/fff [922586,96389] 0 2024-04-12T13:42:22.679 INFO:tasks.workunit.client.1.smithi110.stdout:2/926: symlink d6/dc/dd/d49/d64/d4a/d3c/d6e/l11a 0 2024-04-12T13:42:22.679 INFO:tasks.workunit.client.0.smithi060.stdout:1/977: truncate d1e/d23/fe4 1579037 0 2024-04-12T13:42:22.681 INFO:tasks.workunit.client.1.smithi110.stdout:0/818: dwrite d1/d8/d36/d51/f68 [0,4194304] 0 2024-04-12T13:42:22.682 INFO:tasks.workunit.client.1.smithi110.stdout:6/878: unlink d7/d10/d7e/d85/f102 0 2024-04-12T13:42:22.685 INFO:tasks.workunit.client.1.smithi110.stdout:6/879: write d7/d10/d1c/d2b/d48/f70 [2398821,127609] 0 2024-04-12T13:42:22.686 INFO:tasks.workunit.client.0.smithi060.stdout:7/809: mknod d0/d3d/d74/c103 0 2024-04-12T13:42:22.687 INFO:tasks.workunit.client.0.smithi060.stdout:3/855: mkdir d7/d17/d19/dc9/d3f/d116 0 2024-04-12T13:42:22.688 INFO:tasks.workunit.client.1.smithi110.stdout:7/912: unlink d1/d1b/d74/l7d 0 2024-04-12T13:42:22.694 INFO:tasks.workunit.client.0.smithi060.stdout:8/816: rename d9/d1b/d37/d4d/d63/d66/dd9/dfc/f30 to d9/d1b/d84/da0/d114/f11e 0 2024-04-12T13:42:22.697 INFO:tasks.workunit.client.0.smithi060.stdout:2/872: creat d6/f10d x:0 0 0 2024-04-12T13:42:22.699 INFO:tasks.workunit.client.0.smithi060.stdout:9/773: sync 2024-04-12T13:42:22.699 INFO:tasks.workunit.client.0.smithi060.stdout:5/853: sync 2024-04-12T13:42:22.699 INFO:tasks.workunit.client.1.smithi110.stdout:5/850: mknod da/db/d3b/c125 0 2024-04-12T13:42:22.706 INFO:tasks.workunit.client.1.smithi110.stdout:1/871: symlink de/d14/d109/l126 0 2024-04-12T13:42:22.709 INFO:tasks.workunit.client.0.smithi060.stdout:0/797: unlink d7/d9/d14/d35/f36 0 2024-04-12T13:42:22.714 INFO:tasks.workunit.client.0.smithi060.stdout:0/798: write d7/d9/d4c/f55 [3442266,45770] 0 2024-04-12T13:42:22.715 INFO:tasks.workunit.client.0.smithi060.stdout:6/869: creat d1/d7/da/d20/da8/df0/f11b x:0 0 0 2024-04-12T13:42:22.719 INFO:tasks.workunit.client.0.smithi060.stdout:6/870: chown d1/d7/da/dc/f3b 0 1 2024-04-12T13:42:22.722 INFO:tasks.workunit.client.0.smithi060.stdout:7/810: truncate d0/fb0 1481390 0 2024-04-12T13:42:22.724 INFO:tasks.workunit.client.1.smithi110.stdout:2/927: symlink d6/dc/db1/l11b 0 2024-04-12T13:42:22.727 INFO:tasks.workunit.client.1.smithi110.stdout:2/928: chown d6/dc/dd/f114 22768729 1 2024-04-12T13:42:22.734 INFO:tasks.workunit.client.1.smithi110.stdout:0/819: rename d1/d8/d36/d51/f9c to d1/d3c/dd8/d103/f126 0 2024-04-12T13:42:22.737 INFO:tasks.workunit.client.1.smithi110.stdout:0/820: chown d1/d8/d8a/ce2 39 1 2024-04-12T13:42:22.738 INFO:tasks.workunit.client.0.smithi060.stdout:9/774: mkdir d4/d33/d50/dd0/d104 0 2024-04-12T13:42:22.745 INFO:tasks.workunit.client.0.smithi060.stdout:4/792: link d6/d7/dd/d1a/d57/d63/c74 d6/d7/dd/df/c101 0 2024-04-12T13:42:22.748 INFO:tasks.workunit.client.1.smithi110.stdout:7/913: chown d1/d1b/c5e 2901 1 2024-04-12T13:42:22.749 INFO:tasks.workunit.client.0.smithi060.stdout:6/871: dwrite d1/d7/da/dc/dac/f104 [0,4194304] 0 2024-04-12T13:42:22.750 INFO:tasks.workunit.client.1.smithi110.stdout:8/898: symlink d1/d3/d3c/d5a/d6f/d9c/l124 0 2024-04-12T13:42:22.753 INFO:tasks.workunit.client.1.smithi110.stdout:5/851: truncate da/db/d3b/d40/d97/db6/fd9 839431 0 2024-04-12T13:42:22.755 INFO:tasks.workunit.client.0.smithi060.stdout:1/978: symlink d1e/d29/d37/d14a/l152 0 2024-04-12T13:42:22.758 INFO:tasks.workunit.client.1.smithi110.stdout:5/852: dread - da/d2e/d45/d25/d9d/f10b zero size 2024-04-12T13:42:22.759 INFO:tasks.workunit.client.1.smithi110.stdout:9/981: sync 2024-04-12T13:42:22.771 INFO:tasks.workunit.client.0.smithi060.stdout:3/856: rename d7/d17/d19/f31 to d7/d17/d19/d96/d107/f117 0 2024-04-12T13:42:22.777 INFO:tasks.workunit.client.0.smithi060.stdout:7/811: creat d0/d3d/d74/d9b/da1/f104 x:0 0 0 2024-04-12T13:42:22.782 INFO:tasks.workunit.client.0.smithi060.stdout:7/812: chown d0/d7/d43/d4d/lc8 0 1 2024-04-12T13:42:22.787 INFO:tasks.workunit.client.1.smithi110.stdout:0/821: chown d1/d27/d6e/caa 111 1 2024-04-12T13:42:22.798 INFO:tasks.workunit.client.1.smithi110.stdout:4/994: write d0/d78/fb4 [879709,127644] 0 2024-04-12T13:42:22.803 INFO:tasks.workunit.client.1.smithi110.stdout:8/899: chown d1/d3/d35/d3a/d3e/f49 107079 1 2024-04-12T13:42:22.807 INFO:tasks.workunit.client.1.smithi110.stdout:7/914: truncate d1/d3/d4/d36/f3a 758071 0 2024-04-12T13:42:22.809 INFO:tasks.workunit.client.1.smithi110.stdout:5/853: mkdir da/db/d15/de9/d126 0 2024-04-12T13:42:22.826 INFO:tasks.workunit.client.1.smithi110.stdout:6/880: write d7/d25/d30/f9b [1823172,93925] 0 2024-04-12T13:42:22.831 INFO:tasks.workunit.client.0.smithi060.stdout:8/817: truncate d9/d1b/d37/d4d/d63/d66/db3/f75 2029457 0 2024-04-12T13:42:22.832 INFO:tasks.workunit.client.1.smithi110.stdout:8/900: rename d1/d3/d35/d3a/lb4 to d1/d5/d1f/l125 0 2024-04-12T13:42:22.832 INFO:tasks.workunit.client.1.smithi110.stdout:0/822: dwrite d1/d5e/f119 [0,4194304] 0 2024-04-12T13:42:22.834 INFO:tasks.workunit.client.0.smithi060.stdout:2/873: dwrite d6/d56/d58/da0/f3c [0,4194304] 0 2024-04-12T13:42:22.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/818: stat d9/d1b/d84/da0/c35 0 2024-04-12T13:42:22.834 INFO:tasks.workunit.client.0.smithi060.stdout:3/857: mknod d7/d17/d27/d36/d53/da2/dbc/dfa/c118 0 2024-04-12T13:42:22.835 INFO:tasks.workunit.client.1.smithi110.stdout:3/877: getdents d5/dc/d31/d3b 0 2024-04-12T13:42:22.836 INFO:tasks.workunit.client.1.smithi110.stdout:7/915: creat d1/d31/d5d/f132 x:0 0 0 2024-04-12T13:42:22.842 INFO:tasks.workunit.client.1.smithi110.stdout:8/901: fsync d1/d7/d20/fff 0 2024-04-12T13:42:22.842 INFO:tasks.workunit.client.0.smithi060.stdout:8/819: stat d9/d1b/d37/d4d/d63/d66/db3/lab 0 2024-04-12T13:42:22.843 INFO:tasks.workunit.client.1.smithi110.stdout:9/982: mkdir df/d13/d2c/d9e/d11d/d142 0 2024-04-12T13:42:22.843 INFO:tasks.workunit.client.0.smithi060.stdout:4/793: write d6/d21/d29/f73 [1386426,102156] 0 2024-04-12T13:42:22.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/858: chown d7/d17/d19/dc9/d3f/d5c/d103/f6c 8557 1 2024-04-12T13:42:22.850 INFO:tasks.workunit.client.1.smithi110.stdout:1/872: dwrite de/d14/d34/f40 [0,4194304] 0 2024-04-12T13:42:22.851 INFO:tasks.workunit.client.1.smithi110.stdout:9/983: write df/d13/d2c/d9e/d107/f12b [888262,96650] 0 2024-04-12T13:42:22.852 INFO:tasks.workunit.client.1.smithi110.stdout:2/929: link d6/f117 d6/dc/d13/f11c 0 2024-04-12T13:42:22.855 INFO:tasks.workunit.client.0.smithi060.stdout:1/979: write d1e/d23/dd9/ff5 [875671,79674] 0 2024-04-12T13:42:22.858 INFO:tasks.workunit.client.1.smithi110.stdout:5/854: mknod da/d2e/d45/d25/c127 0 2024-04-12T13:42:22.863 INFO:tasks.workunit.client.0.smithi060.stdout:0/799: dwrite d7/d9/f48 [0,4194304] 0 2024-04-12T13:42:22.864 INFO:tasks.workunit.client.1.smithi110.stdout:2/930: fdatasync d6/dc/dd/d49/d64/d4a/dc1/f119 0 2024-04-12T13:42:22.867 INFO:tasks.workunit.client.0.smithi060.stdout:5/854: getdents d6/d10/db8/dee/dfc 0 2024-04-12T13:42:22.870 INFO:tasks.workunit.client.1.smithi110.stdout:0/823: creat d1/d3c/d6b/d90/f127 x:0 0 0 2024-04-12T13:42:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:1/980: fsync d1e/d23/d2e/d30/f52 0 2024-04-12T13:42:22.878 INFO:tasks.workunit.client.1.smithi110.stdout:4/995: truncate d0/d75/f79 1174067 0 2024-04-12T13:42:22.882 INFO:tasks.workunit.client.0.smithi060.stdout:2/874: dwrite d6/dae/fee [0,4194304] 0 2024-04-12T13:42:22.901 INFO:tasks.workunit.client.1.smithi110.stdout:3/878: symlink d5/dc/d31/d3b/d32/d3e/d5f/l111 0 2024-04-12T13:42:22.904 INFO:tasks.workunit.client.0.smithi060.stdout:9/775: link d4/d8/df1/d67/f8f d4/d33/d65/d7a/f105 0 2024-04-12T13:42:22.910 INFO:tasks.workunit.client.1.smithi110.stdout:8/902: mkdir d1/d3/d35/d43/d9f/dd5/d11e/d85/dc2/d126 0 2024-04-12T13:42:22.914 INFO:tasks.workunit.client.0.smithi060.stdout:7/813: dread d0/d7/f33 [0,4194304] 0 2024-04-12T13:42:22.920 INFO:tasks.workunit.client.1.smithi110.stdout:6/881: fsync d7/d10/d1c/f29 0 2024-04-12T13:42:22.921 INFO:tasks.workunit.client.0.smithi060.stdout:8/820: fdatasync d9/d1b/d84/da0/d114/f11e 0 2024-04-12T13:42:22.924 INFO:tasks.workunit.client.0.smithi060.stdout:8/821: chown d9/d1d/ca2 256756174 1 2024-04-12T13:42:22.924 INFO:tasks.workunit.client.0.smithi060.stdout:5/855: dwrite d6/dd/d1f/d25/d42/d52/d7a/fde [0,4194304] 0 2024-04-12T13:42:22.926 INFO:tasks.workunit.client.0.smithi060.stdout:7/814: stat d0/d3d/d74/cd5 0 2024-04-12T13:42:22.936 INFO:tasks.workunit.client.0.smithi060.stdout:1/981: creat d1e/d94/f153 x:0 0 0 2024-04-12T13:42:22.938 INFO:tasks.workunit.client.1.smithi110.stdout:7/916: unlink d1/d1b/dc6/f125 0 2024-04-12T13:42:22.941 INFO:tasks.workunit.client.1.smithi110.stdout:7/917: chown d1/d31/d5d/ca3 928232 1 2024-04-12T13:42:22.944 INFO:tasks.workunit.client.1.smithi110.stdout:7/918: dread - d1/d1b/d70/f11f zero size 2024-04-12T13:42:22.946 INFO:tasks.workunit.client.0.smithi060.stdout:6/872: dwrite d1/d7d/fcc [0,4194304] 0 2024-04-12T13:42:22.952 INFO:tasks.workunit.client.1.smithi110.stdout:5/855: mkdir da/d2e/d45/d29/d105/d128 0 2024-04-12T13:42:22.962 INFO:tasks.workunit.client.1.smithi110.stdout:2/931: rename d6/dc/d13/d80/d8d/dcc/d82/d84/le3 to d6/dc/dd/d49/d64/d4a/d3c/d50/l11d 0 2024-04-12T13:42:22.968 INFO:tasks.workunit.client.0.smithi060.stdout:4/794: dwrite d6/d7/dd/d1a/d57/d63/df4/d85/f4e [0,4194304] 0 2024-04-12T13:42:22.981 INFO:tasks.workunit.client.0.smithi060.stdout:9/776: mkdir d4/d9/d19/daf/d106 0 2024-04-12T13:42:22.981 INFO:tasks.workunit.client.0.smithi060.stdout:3/859: creat d7/d17/d19/dc9/d3f/d116/f119 x:0 0 0 2024-04-12T13:42:22.986 INFO:tasks.workunit.client.0.smithi060.stdout:9/777: fdatasync d4/d8/df1/d67/fed 0 2024-04-12T13:42:22.997 INFO:tasks.workunit.client.0.smithi060.stdout:3/860: dread d7/f8 [0,4194304] 0 2024-04-12T13:42:23.000 INFO:tasks.workunit.client.0.smithi060.stdout:5/856: unlink d6/dd/d1f/dd3/f106 0 2024-04-12T13:42:23.025 INFO:tasks.workunit.client.1.smithi110.stdout:0/824: write d1/d27/d31/f49 [65372,119694] 0 2024-04-12T13:42:23.028 INFO:tasks.workunit.client.0.smithi060.stdout:6/873: write d1/d7/da/dc/d24/d2d/f3d [4494055,8423] 0 2024-04-12T13:42:23.046 INFO:tasks.workunit.client.0.smithi060.stdout:9/778: fdatasync d4/d9/fc 0 2024-04-12T13:42:23.051 INFO:tasks.workunit.client.0.smithi060.stdout:8/822: unlink d9/fc 0 2024-04-12T13:42:23.051 INFO:tasks.workunit.client.0.smithi060.stdout:1/982: dwrite d1e/d23/d49/d4e/f77 [0,4194304] 0 2024-04-12T13:42:23.055 INFO:tasks.workunit.client.0.smithi060.stdout:1/983: dread - d1e/d29/d37/fd8 zero size 2024-04-12T13:42:23.060 INFO:tasks.workunit.client.0.smithi060.stdout:8/823: stat d9/d1b/d2b/d82/d8a/d116/d11a/c11b 0 2024-04-12T13:42:23.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/875: rmdir d6/d64/d99/df0/d16/dda 0 2024-04-12T13:42:23.074 INFO:tasks.workunit.client.0.smithi060.stdout:3/861: truncate d7/d17/d19/dc9/d3f/d5c/d103/f5b 396738 0 2024-04-12T13:42:23.074 INFO:tasks.workunit.client.0.smithi060.stdout:5/857: mkdir d6/dd/d1f/d25/d42/d6b/d11b 0 2024-04-12T13:42:23.078 INFO:tasks.workunit.client.0.smithi060.stdout:4/795: mknod d6/d7/dd/d4d/c102 0 2024-04-12T13:42:23.089 INFO:tasks.workunit.client.0.smithi060.stdout:9/779: rename d4/d8/f98 to d4/d9/d19/d8c/f107 0 2024-04-12T13:42:23.094 INFO:tasks.workunit.client.0.smithi060.stdout:6/874: creat d1/d7/da/dc/d24/d30/dd8/f11c x:0 0 0 2024-04-12T13:42:23.099 INFO:tasks.workunit.client.0.smithi060.stdout:2/876: mknod d6/d64/d99/df0/daa/db0/def/c10e 0 2024-04-12T13:42:23.099 INFO:tasks.workunit.client.0.smithi060.stdout:4/796: rmdir d6/db7/dbb 39 2024-04-12T13:42:23.104 INFO:tasks.workunit.client.0.smithi060.stdout:4/797: chown d6/d21/fc5 34831546 1 2024-04-12T13:42:23.105 INFO:tasks.workunit.client.0.smithi060.stdout:7/815: link d0/d3d/d74/d9b/da1/cd0 d0/d7/d43/d63/d90/de7/c105 0 2024-04-12T13:42:23.109 INFO:tasks.workunit.client.1.smithi110.stdout:8/903: creat d1/d3/d3c/d5a/dab/f127 x:0 0 0 2024-04-12T13:42:23.112 INFO:tasks.workunit.client.0.smithi060.stdout:4/798: chown d6/d7/dd/d1a/d19/d42/d7c/fe6 468 1 2024-04-12T13:42:23.118 INFO:tasks.workunit.client.1.smithi110.stdout:1/873: symlink de/d15/d32/l127 0 2024-04-12T13:42:23.118 INFO:tasks.workunit.client.0.smithi060.stdout:3/862: rename d7/d17/d27/d36/l69 to d7/d17/d27/d36/d53/l11a 0 2024-04-12T13:42:23.126 INFO:tasks.workunit.client.0.smithi060.stdout:9/780: rmdir d4/d8/df1 39 2024-04-12T13:42:23.130 INFO:tasks.workunit.client.0.smithi060.stdout:9/781: chown d4/d9/d19/lb9 140 1 2024-04-12T13:42:23.138 INFO:tasks.workunit.client.0.smithi060.stdout:1/984: write d1e/d23/d49/d4e/ff6 [4969909,14683] 0 2024-04-12T13:42:23.149 INFO:tasks.workunit.client.1.smithi110.stdout:5/856: rename da/db/d3b/d40/d97/db6/f10f to da/d2e/d45/d25/d9d/d7a/dae/f129 0 2024-04-12T13:42:23.155 INFO:tasks.workunit.client.1.smithi110.stdout:2/932: mknod d6/dc/dd/d49/d64/d4a/d3c/d6e/c11e 0 2024-04-12T13:42:23.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/824: link d9/d1b/f1e d9/d1b/d84/f11f 0 2024-04-12T13:42:23.161 INFO:tasks.workunit.client.1.smithi110.stdout:4/996: symlink d0/de/da0/dd9/ddf/l150 0 2024-04-12T13:42:23.163 INFO:tasks.workunit.client.0.smithi060.stdout:4/799: rename d6/d2f/fce to d6/d7/dd/d1a/d57/d63/d68/d76/f103 0 2024-04-12T13:42:23.163 INFO:tasks.workunit.client.0.smithi060.stdout:2/877: dread d6/dae/d5b/d6d/f6e [0,4194304] 0 2024-04-12T13:42:23.167 INFO:tasks.workunit.client.0.smithi060.stdout:3/863: fsync d7/d17/d19/dc9/d3f/f78 0 2024-04-12T13:42:23.172 INFO:tasks.workunit.client.1.smithi110.stdout:0/825: truncate d1/d27/d31/f64 809564 0 2024-04-12T13:42:23.177 INFO:tasks.workunit.client.0.smithi060.stdout:5/858: dwrite d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:42:23.180 INFO:tasks.workunit.client.1.smithi110.stdout:3/879: getdents d5/dc/d31/d3b/d5b/df5 0 2024-04-12T13:42:23.190 INFO:tasks.workunit.client.1.smithi110.stdout:9/984: truncate df/d13/f1b 1823222 0 2024-04-12T13:42:23.192 INFO:tasks.workunit.client.0.smithi060.stdout:6/875: write d1/d7/da/dc/d24/d30/d52/d5e/f72 [792797,12424] 0 2024-04-12T13:42:23.194 INFO:tasks.workunit.client.0.smithi060.stdout:7/816: write d0/f71 [3615833,111236] 0 2024-04-12T13:42:23.205 INFO:tasks.workunit.client.1.smithi110.stdout:2/933: creat d6/dc/dd/d49/d64/d4a/d3c/d50/dd5/f11f x:0 0 0 2024-04-12T13:42:23.210 INFO:tasks.workunit.client.1.smithi110.stdout:1/874: sync 2024-04-12T13:42:23.214 INFO:tasks.workunit.client.1.smithi110.stdout:6/882: dwrite d7/d10/d1c/f24 [0,4194304] 0 2024-04-12T13:42:23.217 INFO:tasks.workunit.client.1.smithi110.stdout:2/934: stat d6/dc/d13/d80/d8d/dcc/d82/fe1 0 2024-04-12T13:42:23.218 INFO:tasks.workunit.client.0.smithi060.stdout:4/800: dread d6/d21/fc5 [0,4194304] 0 2024-04-12T13:42:23.224 INFO:tasks.workunit.client.1.smithi110.stdout:3/880: creat d5/dc/d20/d2d/db1/f112 x:0 0 0 2024-04-12T13:42:23.226 INFO:tasks.workunit.client.1.smithi110.stdout:2/935: chown d6/dc/dd/l3a 607230831 1 2024-04-12T13:42:23.230 INFO:tasks.workunit.client.1.smithi110.stdout:9/985: creat df/d13/d26/dc9/f143 x:0 0 0 2024-04-12T13:42:23.233 INFO:tasks.workunit.client.0.smithi060.stdout:4/801: dread d6/d7/dd/d1a/d57/d63/fec [0,4194304] 0 2024-04-12T13:42:23.234 INFO:tasks.workunit.client.1.smithi110.stdout:3/881: dread - d5/dc/d20/d2d/db1/f10d zero size 2024-04-12T13:42:23.237 INFO:tasks.workunit.client.0.smithi060.stdout:4/802: truncate d6/d7/dd/f91 1473058 0 2024-04-12T13:42:23.238 INFO:tasks.workunit.client.1.smithi110.stdout:1/875: truncate de/f10 3780523 0 2024-04-12T13:42:23.239 INFO:tasks.workunit.client.1.smithi110.stdout:8/904: write d1/d3/d3c/fa1 [1100295,129194] 0 2024-04-12T13:42:23.243 INFO:tasks.workunit.client.1.smithi110.stdout:6/883: mkdir d7/d25/d2c/d4c/d77/d93/d112 0 2024-04-12T13:42:23.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/905: chown d1/d3/d3c/lcf 297 1 2024-04-12T13:42:23.249 INFO:tasks.workunit.client.1.smithi110.stdout:4/997: dread d0/fc [0,4194304] 0 2024-04-12T13:42:23.250 INFO:tasks.workunit.client.1.smithi110.stdout:4/998: readlink d0/d19/ldc 0 2024-04-12T13:42:23.254 INFO:tasks.workunit.client.1.smithi110.stdout:7/919: truncate d1/d31/d5d/d127/f11b 1810467 0 2024-04-12T13:42:23.257 INFO:tasks.workunit.client.1.smithi110.stdout:7/920: write d1/d3/d4/d55/d82/ff9 [814059,127337] 0 2024-04-12T13:42:23.261 INFO:tasks.workunit.client.1.smithi110.stdout:7/921: read - d1/d3/d4/d55/d56/d72/dad/d115/f12b zero size 2024-04-12T13:42:23.270 INFO:tasks.workunit.client.1.smithi110.stdout:9/986: symlink df/d13/d2c/d2d/dd3/d10e/l144 0 2024-04-12T13:42:23.272 INFO:tasks.workunit.client.1.smithi110.stdout:0/826: dwrite d1/d8/d36/d51/d60/fe9 [0,4194304] 0 2024-04-12T13:42:23.275 INFO:tasks.workunit.client.1.smithi110.stdout:3/882: mknod d5/dc/d20/d2d/d4e/c113 0 2024-04-12T13:42:23.288 INFO:tasks.workunit.client.1.smithi110.stdout:4/999: rename d0/de/d32/d61/l76 to d0/de/da0/dd9/d138/l151 0 2024-04-12T13:42:23.290 INFO:tasks.workunit.client.1.smithi110.stdout:5/857: link da/db/d15/fb8 da/d2e/d45/d25/d9d/d7a/db5/d89/f12a 0 2024-04-12T13:42:23.294 INFO:tasks.workunit.client.1.smithi110.stdout:5/858: write da/db/d3b/d40/d97/db6/dff/f11e [627900,36819] 0 2024-04-12T13:42:23.295 INFO:tasks.workunit.client.1.smithi110.stdout:7/922: rmdir d1/d3/d4/d36 39 2024-04-12T13:42:23.297 INFO:tasks.workunit.client.1.smithi110.stdout:2/936: symlink d6/dc/dd/d49/d64/d4a/d51/d112/l120 0 2024-04-12T13:42:23.309 INFO:tasks.workunit.client.1.smithi110.stdout:6/884: mknod d7/d10/d1c/d2b/d3a/c113 0 2024-04-12T13:42:23.313 INFO:tasks.workunit.client.1.smithi110.stdout:8/906: symlink d1/d3/d35/d3a/d41/d77/l128 0 2024-04-12T13:42:23.320 INFO:tasks.workunit.client.1.smithi110.stdout:5/859: creat da/db/d52/f12b x:0 0 0 2024-04-12T13:42:23.332 INFO:tasks.workunit.client.1.smithi110.stdout:1/876: rename de/d14/d34/d55/d6b/dc7/fd6 to de/d15/d32/d61/d6a/dac/dc0/dea/f128 0 2024-04-12T13:42:23.335 INFO:tasks.workunit.client.1.smithi110.stdout:0/827: write d1/d5e/fd1 [633797,1668] 0 2024-04-12T13:42:23.335 INFO:tasks.workunit.client.1.smithi110.stdout:9/987: sync 2024-04-12T13:42:23.337 INFO:tasks.workunit.client.1.smithi110.stdout:6/885: truncate d7/d25/f9f 98220 0 2024-04-12T13:42:23.344 INFO:tasks.workunit.client.1.smithi110.stdout:6/886: write d7/d25/d2c/d4c/d77/db9/fdd [4423613,54241] 0 2024-04-12T13:42:23.348 INFO:tasks.workunit.client.1.smithi110.stdout:2/937: mknod d6/dc/dd/d49/d64/c121 0 2024-04-12T13:42:23.350 INFO:tasks.workunit.client.1.smithi110.stdout:6/887: chown d7/d10/d1c/d2b/d48/d54/ff5 2818850 1 2024-04-12T13:42:23.352 INFO:tasks.workunit.client.1.smithi110.stdout:6/888: chown d7/da4 236493 1 2024-04-12T13:42:23.352 INFO:tasks.workunit.client.1.smithi110.stdout:2/938: chown d6/dc/db1/fe5 4341108 1 2024-04-12T13:42:23.353 INFO:tasks.workunit.client.1.smithi110.stdout:0/828: symlink d1/d48/db2/d4a/l128 0 2024-04-12T13:42:23.354 INFO:tasks.workunit.client.1.smithi110.stdout:2/939: chown d6/dc/d13 2142961 1 2024-04-12T13:42:23.363 INFO:tasks.workunit.client.1.smithi110.stdout:7/923: rename d1/d31/d5d/d127/c9a to d1/d1b/d3d/c133 0 2024-04-12T13:42:23.364 INFO:tasks.workunit.client.1.smithi110.stdout:3/883: link d5/dc/d31/d74/d75/dbb/ca8 d5/c114 0 2024-04-12T13:42:23.368 INFO:tasks.workunit.client.0.smithi060.stdout:8/825: readlink d9/d1b/d84/da0/d80/d109/d7b/db1/de5/lef 0 2024-04-12T13:42:23.369 INFO:tasks.workunit.client.1.smithi110.stdout:6/889: mkdir d7/d10/d1c/d2b/d48/d4b/dcc/d114 0 2024-04-12T13:42:23.370 INFO:tasks.workunit.client.1.smithi110.stdout:7/924: write d1/d31/d5d/f132 [631881,30800] 0 2024-04-12T13:42:23.372 INFO:tasks.workunit.client.1.smithi110.stdout:2/940: mknod d6/dc/d6f/c122 0 2024-04-12T13:42:23.373 INFO:tasks.workunit.client.0.smithi060.stdout:9/782: mkdir d4/d33/d108 0 2024-04-12T13:42:23.374 INFO:tasks.workunit.client.1.smithi110.stdout:7/925: fdatasync d1/f120 0 2024-04-12T13:42:23.375 INFO:tasks.workunit.client.1.smithi110.stdout:9/988: dwrite df/d38/d6e/d7f/f8b [0,4194304] 0 2024-04-12T13:42:23.377 INFO:tasks.workunit.client.0.smithi060.stdout:9/783: write d4/d8/d32/ff4 [683970,47071] 0 2024-04-12T13:42:23.377 INFO:tasks.workunit.client.1.smithi110.stdout:1/877: dwrite de/d15/d32/d61/d6a/dac/dc0/dea/f10c [0,4194304] 0 2024-04-12T13:42:23.377 INFO:tasks.workunit.client.0.smithi060.stdout:2/878: mkdir d6/d64/d10f 0 2024-04-12T13:42:23.380 INFO:tasks.workunit.client.1.smithi110.stdout:2/941: write d6/dc/dd/d49/d64/fca [255670,6478] 0 2024-04-12T13:42:23.383 INFO:tasks.workunit.client.1.smithi110.stdout:6/890: truncate d7/d10/d1c/d2b/d3a/dbf/f105 520638 0 2024-04-12T13:42:23.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/864: mkdir d7/d17/d27/d36/db0/dc4/d11b 0 2024-04-12T13:42:23.392 INFO:tasks.workunit.client.0.smithi060.stdout:5/859: rename d6/dd/d1f/d25/ld2 to d6/d10/db8/dee/dfc/d3d/l11c 0 2024-04-12T13:42:23.395 INFO:tasks.workunit.client.1.smithi110.stdout:3/884: rename d5/dc/c108 to d5/dc/d20/c115 0 2024-04-12T13:42:23.401 INFO:tasks.workunit.client.0.smithi060.stdout:7/817: readlink d0/d7/d92/lcc 0 2024-04-12T13:42:23.406 INFO:tasks.workunit.client.1.smithi110.stdout:8/907: dwrite d1/d3/d3c/d5a/d6f/d7e/f93 [0,4194304] 0 2024-04-12T13:42:23.411 INFO:tasks.workunit.client.0.smithi060.stdout:4/803: creat d6/d7/dd/d1a/d19/d7a/da8/f104 x:0 0 0 2024-04-12T13:42:23.417 INFO:tasks.workunit.client.1.smithi110.stdout:1/878: creat de/d14/d34/d87/f129 x:0 0 0 2024-04-12T13:42:23.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/804: truncate d6/fe2 1125799 0 2024-04-12T13:42:23.419 INFO:tasks.workunit.client.1.smithi110.stdout:2/942: fsync d6/dc/d13/d80/d8d/dcc/d82/d84/f91 0 2024-04-12T13:42:23.424 INFO:tasks.workunit.client.0.smithi060.stdout:2/879: creat d6/d64/d99/df0/daa/f110 x:0 0 0 2024-04-12T13:42:23.424 INFO:tasks.workunit.client.1.smithi110.stdout:0/829: creat d1/d27/f129 x:0 0 0 2024-04-12T13:42:23.424 INFO:tasks.workunit.client.0.smithi060.stdout:3/865: truncate d7/d17/d19/dc9/d3f/d5c/d103/d63/f9e 696840 0 2024-04-12T13:42:23.428 INFO:tasks.workunit.client.0.smithi060.stdout:2/880: chown d6/d56/c7a 127546 1 2024-04-12T13:42:23.428 INFO:tasks.workunit.client.0.smithi060.stdout:9/784: rename d4/d8/d32/fc2 to d4/d9/d19/d21/dbb/f109 0 2024-04-12T13:42:23.432 INFO:tasks.workunit.client.1.smithi110.stdout:5/860: dwrite da/d2e/d45/d25/d5d/fe1 [0,4194304] 0 2024-04-12T13:42:23.434 INFO:tasks.workunit.client.0.smithi060.stdout:1/985: creat d1e/d29/f154 x:0 0 0 2024-04-12T13:42:23.436 INFO:tasks.workunit.client.0.smithi060.stdout:7/818: fdatasync d0/d7/d92/fc2 0 2024-04-12T13:42:23.440 INFO:tasks.workunit.client.1.smithi110.stdout:2/943: unlink d6/dc/dd/d49/d64/d4a/f92 0 2024-04-12T13:42:23.440 INFO:tasks.workunit.client.1.smithi110.stdout:3/885: mknod d5/d86/c116 0 2024-04-12T13:42:23.441 INFO:tasks.workunit.client.1.smithi110.stdout:8/908: mkdir d1/d3/d35/d129 0 2024-04-12T13:42:23.443 INFO:tasks.workunit.client.1.smithi110.stdout:7/926: getdents d1/d3/d4/d55/d56/d72/dad/d115 0 2024-04-12T13:42:23.445 INFO:tasks.workunit.client.1.smithi110.stdout:1/879: rename de/d14/d34/d87/c8c to de/d14/d34/d55/c12a 0 2024-04-12T13:42:23.445 INFO:tasks.workunit.client.1.smithi110.stdout:5/861: mknod da/d2e/d45/d29/d105/d128/c12c 0 2024-04-12T13:42:23.450 INFO:tasks.workunit.client.0.smithi060.stdout:2/881: creat d6/d64/d99/df0/d2b/f111 x:0 0 0 2024-04-12T13:42:23.453 INFO:tasks.workunit.client.0.smithi060.stdout:7/819: fdatasync d0/d1b/f48 0 2024-04-12T13:42:23.455 INFO:tasks.workunit.client.1.smithi110.stdout:3/886: creat d5/d86/de3/f117 x:0 0 0 2024-04-12T13:42:23.457 INFO:tasks.workunit.client.0.smithi060.stdout:7/820: chown d0/d7/ffb 4410435 1 2024-04-12T13:42:23.459 INFO:tasks.workunit.client.1.smithi110.stdout:8/909: read d1/d3/d3c/d5a/d6f/d7e/f63 [74076,12035] 0 2024-04-12T13:42:23.459 INFO:tasks.workunit.client.1.smithi110.stdout:3/887: chown d5/dc/d20/laa 48982687 1 2024-04-12T13:42:23.462 INFO:tasks.workunit.client.1.smithi110.stdout:3/888: fsync d5/d86/fb5 0 2024-04-12T13:42:23.466 INFO:tasks.workunit.client.0.smithi060.stdout:9/785: dread - d4/d8/df1/d67/f7e zero size 2024-04-12T13:42:23.479 INFO:tasks.workunit.client.0.smithi060.stdout:1/986: creat d1e/d23/d2e/d30/d51/d85/dfe/f155 x:0 0 0 2024-04-12T13:42:23.479 INFO:tasks.workunit.client.0.smithi060.stdout:4/805: link d6/d7/dd/d1a/d57/d63/d68/c6f d6/d2f/d51/c105 0 2024-04-12T13:42:23.479 INFO:tasks.workunit.client.0.smithi060.stdout:6/876: dread d1/d7/da/dc/d24/d30/d52/fa4 [0,4194304] 0 2024-04-12T13:42:23.482 INFO:tasks.workunit.client.1.smithi110.stdout:8/910: chown d1/d7/f3f 0 1 2024-04-12T13:42:23.483 INFO:tasks.workunit.client.0.smithi060.stdout:7/821: chown d0/l61 10515073 1 2024-04-12T13:42:23.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/987: rmdir d1e/d23/d2e/d30/d51 39 2024-04-12T13:42:23.491 INFO:tasks.workunit.client.1.smithi110.stdout:5/862: dread da/db/d3b/d40/da6/f107 [0,4194304] 0 2024-04-12T13:42:23.494 INFO:tasks.workunit.client.1.smithi110.stdout:5/863: readlink da/db/l1c 0 2024-04-12T13:42:23.503 INFO:tasks.workunit.client.0.smithi060.stdout:9/786: rmdir d4/d9/d19/daf/d106 0 2024-04-12T13:42:23.504 INFO:tasks.workunit.client.1.smithi110.stdout:8/911: creat d1/d5/f12a x:0 0 0 2024-04-12T13:42:23.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/877: mknod d1/d7/da/dc/dc2/c11d 0 2024-04-12T13:42:23.511 INFO:tasks.workunit.client.0.smithi060.stdout:4/806: dread d6/d7/dd/df/fc0 [0,4194304] 0 2024-04-12T13:42:23.516 INFO:tasks.workunit.client.0.smithi060.stdout:1/988: read d1e/d23/d2e/d30/d51/f81 [1838068,10349] 0 2024-04-12T13:42:23.516 INFO:tasks.workunit.client.0.smithi060.stdout:9/787: creat d4/d8/df1/f10a x:0 0 0 2024-04-12T13:42:23.547 INFO:tasks.workunit.client.1.smithi110.stdout:8/912: link d1/d3/d3c/d5a/d6f/d7e/f71 d1/d3/d3c/d5a/d6f/d9c/f12b 0 2024-04-12T13:42:23.548 INFO:tasks.workunit.client.0.smithi060.stdout:6/878: mknod d1/d7/da/dc/d24/d30/d52/d5e/d7b/c11e 0 2024-04-12T13:42:23.550 INFO:tasks.workunit.client.0.smithi060.stdout:9/788: dread d4/d9/d19/f63 [0,4194304] 0 2024-04-12T13:42:23.551 INFO:tasks.workunit.client.1.smithi110.stdout:9/989: write df/d13/d2c/d9e/dd6/da3/fe5 [558749,59981] 0 2024-04-12T13:42:23.552 INFO:tasks.workunit.client.0.smithi060.stdout:9/789: write d4/d9/f97 [1669748,9848] 0 2024-04-12T13:42:23.555 INFO:tasks.workunit.client.0.smithi060.stdout:4/807: getdents d6/d2f/dbe 0 2024-04-12T13:42:23.555 INFO:tasks.workunit.client.1.smithi110.stdout:8/913: chown d1/d3/d3c/d5a/d6f/d83/fae 19157 1 2024-04-12T13:42:23.557 INFO:tasks.workunit.client.0.smithi060.stdout:4/808: stat d6/d7/dd/d1a/f50 0 2024-04-12T13:42:23.560 INFO:tasks.workunit.client.0.smithi060.stdout:4/809: chown d6/d2f/lc4 20691 1 2024-04-12T13:42:23.566 INFO:tasks.workunit.client.0.smithi060.stdout:9/790: truncate d4/d33/d65/f91 4775050 0 2024-04-12T13:42:23.572 INFO:tasks.workunit.client.0.smithi060.stdout:4/810: fsync d6/d21/fc5 0 2024-04-12T13:42:23.572 INFO:tasks.workunit.client.0.smithi060.stdout:5/860: write d6/dd/d1f/d25/f90 [905744,1300] 0 2024-04-12T13:42:23.574 INFO:tasks.workunit.client.1.smithi110.stdout:9/990: fdatasync df/d13/d26/f32 0 2024-04-12T13:42:23.578 INFO:tasks.workunit.client.0.smithi060.stdout:9/791: symlink d4/d8/df1/d67/l10b 0 2024-04-12T13:42:23.579 INFO:tasks.workunit.client.0.smithi060.stdout:5/861: write d6/dd/d1f/d25/d42/d52/d7a/fb0 [367788,4848] 0 2024-04-12T13:42:23.582 INFO:tasks.workunit.client.0.smithi060.stdout:5/862: chown d6/dd/d1f/dd3/df3/d4c/da8 10048 1 2024-04-12T13:42:23.584 INFO:tasks.workunit.client.1.smithi110.stdout:0/830: write d1/d27/d31/f52 [3568931,12397] 0 2024-04-12T13:42:23.585 INFO:tasks.workunit.client.0.smithi060.stdout:4/811: mkdir d6/d7/dd/d1a/d56/d8d/d106 0 2024-04-12T13:42:23.586 INFO:tasks.workunit.client.0.smithi060.stdout:9/792: rmdir d4/d9/d19/d8c 39 2024-04-12T13:42:23.589 INFO:tasks.workunit.client.1.smithi110.stdout:9/991: symlink df/l145 0 2024-04-12T13:42:23.590 INFO:tasks.workunit.client.0.smithi060.stdout:4/812: creat d6/d7/dd/d1a/d19/d7a/f107 x:0 0 0 2024-04-12T13:42:23.590 INFO:tasks.workunit.client.0.smithi060.stdout:9/793: write d4/d8/df1/d67/ff5 [380578,56153] 0 2024-04-12T13:42:23.592 INFO:tasks.workunit.client.0.smithi060.stdout:5/863: mknod d6/dd/d1f/d25/d53/c11d 0 2024-04-12T13:42:23.593 INFO:tasks.workunit.client.1.smithi110.stdout:2/944: write d6/dc/d13/d80/ffa [2123190,123143] 0 2024-04-12T13:42:23.595 INFO:tasks.workunit.client.1.smithi110.stdout:1/880: rename de/d14/d34/d55/c12a to de/d15/d32/d61/d96/c12b 0 2024-04-12T13:42:23.598 INFO:tasks.workunit.client.0.smithi060.stdout:2/882: write d6/d64/d99/df0/fe3 [952345,57010] 0 2024-04-12T13:42:23.600 INFO:tasks.workunit.client.0.smithi060.stdout:1/989: rename d1e/d23 to d1e/d1f/d156 0 2024-04-12T13:42:23.603 INFO:tasks.workunit.client.0.smithi060.stdout:9/794: read d4/d8/df1/d67/f49 [512785,22955] 0 2024-04-12T13:42:23.604 INFO:tasks.workunit.client.1.smithi110.stdout:5/864: rename da/db/d15/de9/d108 to da/d2e/d45/d25/d9d/d79/d82/d12d 0 2024-04-12T13:42:23.604 INFO:tasks.workunit.client.0.smithi060.stdout:2/883: mknod d6/d56/d55/c112 0 2024-04-12T13:42:23.605 INFO:tasks.workunit.client.1.smithi110.stdout:2/945: fsync d6/dc/dd/d49/d64/d4a/d3c/d6e/ff8 0 2024-04-12T13:42:23.607 INFO:tasks.workunit.client.1.smithi110.stdout:7/927: write d1/d3/d4/d36/da1/fcc [4061578,59299] 0 2024-04-12T13:42:23.608 INFO:tasks.workunit.client.0.smithi060.stdout:5/864: rename d6/dd/d1f/d25/d42/lbe to d6/dd/d1f/dd3/df3/d38/l11e 0 2024-04-12T13:42:23.609 INFO:tasks.workunit.client.0.smithi060.stdout:3/866: dwrite d7/d17/d19/d96/d107/f117 [0,4194304] 0 2024-04-12T13:42:23.616 INFO:tasks.workunit.client.0.smithi060.stdout:2/884: unlink d6/d64/d99/df0/d2b/lfd 0 2024-04-12T13:42:23.622 INFO:tasks.workunit.client.1.smithi110.stdout:2/946: unlink d6/dc/dd/l3a 0 2024-04-12T13:42:23.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/822: dwrite d0/d1b/f5f [0,4194304] 0 2024-04-12T13:42:23.626 INFO:tasks.workunit.client.0.smithi060.stdout:4/813: dread d6/d7/dd/d4d/f9b [0,4194304] 0 2024-04-12T13:42:23.626 INFO:tasks.workunit.client.1.smithi110.stdout:5/865: truncate da/d2e/d45/d25/d9d/d79/d88/dd3/fe3 623885 0 2024-04-12T13:42:23.626 INFO:tasks.workunit.client.1.smithi110.stdout:3/889: dwrite d5/dc/d31/d3b/f4a [0,4194304] 0 2024-04-12T13:42:23.627 INFO:tasks.workunit.client.1.smithi110.stdout:2/947: chown d6/dc/dd/dc6/fe4 530349 1 2024-04-12T13:42:23.628 INFO:tasks.workunit.client.1.smithi110.stdout:7/928: mknod d1/d3/d4/d55/d82/db5/c134 0 2024-04-12T13:42:23.634 INFO:tasks.workunit.client.1.smithi110.stdout:0/831: dread d1/d3c/f5f [0,4194304] 0 2024-04-12T13:42:23.635 INFO:tasks.workunit.client.1.smithi110.stdout:8/914: sync 2024-04-12T13:42:23.636 INFO:tasks.workunit.client.1.smithi110.stdout:9/992: rename df/d13/d3b/d40/d56/l9c to df/d13/d2c/d9e/dd6/dcf/dd2/l146 0 2024-04-12T13:42:23.641 INFO:tasks.workunit.client.1.smithi110.stdout:5/866: truncate da/db/d15/fb8 1443297 0 2024-04-12T13:42:23.641 INFO:tasks.workunit.client.0.smithi060.stdout:7/823: stat d0/d3d/d74/fe3 0 2024-04-12T13:42:23.643 INFO:tasks.workunit.client.1.smithi110.stdout:6/891: dread d7/d25/d30/d44/d3d/f76 [0,4194304] 0 2024-04-12T13:42:23.643 INFO:tasks.workunit.client.1.smithi110.stdout:9/993: write df/d13/d3b/d40/d56/fdc [2777818,79130] 0 2024-04-12T13:42:23.644 INFO:tasks.workunit.client.0.smithi060.stdout:7/824: readlink d0/d1b/d8c/le5 0 2024-04-12T13:42:23.651 INFO:tasks.workunit.client.0.smithi060.stdout:9/795: dread d4/d8/d7c/f81 [0,4194304] 0 2024-04-12T13:42:23.651 INFO:tasks.workunit.client.1.smithi110.stdout:1/881: dread de/d15/dab/dd8/dd9/dda/fbe [0,4194304] 0 2024-04-12T13:42:23.658 INFO:tasks.workunit.client.0.smithi060.stdout:6/879: dwrite d1/d7/da/dc/f29 [4194304,4194304] 0 2024-04-12T13:42:23.659 INFO:tasks.workunit.client.1.smithi110.stdout:8/915: unlink d1/d3/d35/d3a/d41/f53 0 2024-04-12T13:42:23.666 INFO:tasks.workunit.client.0.smithi060.stdout:6/880: write d1/d7/da/dc/dac/f104 [3460858,41410] 0 2024-04-12T13:42:23.667 INFO:tasks.workunit.client.1.smithi110.stdout:0/832: creat d1/d27/d31/d89/f12a x:0 0 0 2024-04-12T13:42:23.667 INFO:tasks.workunit.client.1.smithi110.stdout:8/916: write d1/d3/d35/d43/d9f/dd5/d11e/f123 [114040,116024] 0 2024-04-12T13:42:23.667 INFO:tasks.workunit.client.1.smithi110.stdout:2/948: dread d6/dc/dd/d49/d64/d4a/f5b [0,4194304] 0 2024-04-12T13:42:23.667 INFO:tasks.workunit.client.1.smithi110.stdout:7/929: dread d1/d3/d4/dbf/f95 [0,4194304] 0 2024-04-12T13:42:23.667 INFO:tasks.workunit.client.0.smithi060.stdout:9/796: getdents d4/d8/dad/dd9 0 2024-04-12T13:42:23.669 INFO:tasks.workunit.client.1.smithi110.stdout:9/994: rmdir df/d13/d2c/d2d/dc1/d83/d63/db4/ddb 39 2024-04-12T13:42:23.669 INFO:tasks.workunit.client.0.smithi060.stdout:9/797: stat d4/d33/d65/de7 0 2024-04-12T13:42:23.672 INFO:tasks.workunit.client.0.smithi060.stdout:6/881: read - d1/d7/da/dc/ff5 zero size 2024-04-12T13:42:23.673 INFO:tasks.workunit.client.0.smithi060.stdout:7/825: fsync d0/d1b/f5f 0 2024-04-12T13:42:23.675 INFO:tasks.workunit.client.0.smithi060.stdout:7/826: dread - d0/d7/d43/d63/d90/fbf zero size 2024-04-12T13:42:23.678 INFO:tasks.workunit.client.1.smithi110.stdout:6/892: creat d7/d10/d1c/d2b/d48/d4b/dcc/d114/f115 x:0 0 0 2024-04-12T13:42:23.678 INFO:tasks.workunit.client.1.smithi110.stdout:1/882: dwrite de/d14/d34/d55/d6b/f7c [0,4194304] 0 2024-04-12T13:42:23.678 INFO:tasks.workunit.client.0.smithi060.stdout:6/882: chown d1/d2c/faa 111820 1 2024-04-12T13:42:23.680 INFO:tasks.workunit.client.1.smithi110.stdout:6/893: chown d7/d10/d41/fab 6799975 1 2024-04-12T13:42:23.681 INFO:tasks.workunit.client.1.smithi110.stdout:1/883: readlink de/d15/d32/l127 0 2024-04-12T13:42:23.687 INFO:tasks.workunit.client.1.smithi110.stdout:0/833: dwrite d1/d8/d36/d51/d60/f70 [4194304,4194304] 0 2024-04-12T13:42:23.692 INFO:tasks.workunit.client.0.smithi060.stdout:7/827: mknod d0/d7/d43/d63/d6f/c106 0 2024-04-12T13:42:23.694 INFO:tasks.workunit.client.0.smithi060.stdout:5/865: dread d6/dd/f45 [0,4194304] 0 2024-04-12T13:42:23.696 INFO:tasks.workunit.client.1.smithi110.stdout:1/884: read de/d15/dab/dd8/dd9/dda/fa7 [2045759,69174] 0 2024-04-12T13:42:23.701 INFO:tasks.workunit.client.1.smithi110.stdout:2/949: dread - d6/dc/dd/d49/d64/d4a/dc1/dd0/ff1 zero size 2024-04-12T13:42:23.704 INFO:tasks.workunit.client.0.smithi060.stdout:7/828: mknod d0/d1b/da4/c107 0 2024-04-12T13:42:23.710 INFO:tasks.workunit.client.0.smithi060.stdout:5/866: dread - d6/dd/d1f/dd3/df3/d38/fda zero size 2024-04-12T13:42:23.711 INFO:tasks.workunit.client.0.smithi060.stdout:3/867: write d7/d17/d27/d36/d53/f71 [1145693,21785] 0 2024-04-12T13:42:23.712 INFO:tasks.workunit.client.0.smithi060.stdout:6/883: dwrite d1/d7/da/dc/d24/d30/d52/d78/d80/d93/ff2 [0,4194304] 0 2024-04-12T13:42:23.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/798: dread d4/d33/d50/f74 [0,4194304] 0 2024-04-12T13:42:23.716 INFO:tasks.workunit.client.1.smithi110.stdout:0/834: rename d1/d8/f21 to d1/d8/d8a/f12b 0 2024-04-12T13:42:23.721 INFO:tasks.workunit.client.1.smithi110.stdout:1/885: rmdir de/d15/d32/d61/d96 39 2024-04-12T13:42:23.726 INFO:tasks.workunit.client.0.smithi060.stdout:4/814: write d6/d7/f3b [2316397,40388] 0 2024-04-12T13:42:23.727 INFO:tasks.workunit.client.1.smithi110.stdout:2/950: mkdir d6/dc/dd/d49/d64/d4a/dc1/d123 0 2024-04-12T13:42:23.728 INFO:tasks.workunit.client.0.smithi060.stdout:1/990: dwrite d1e/d1f/d156/d2e/f3a [4194304,4194304] 0 2024-04-12T13:42:23.731 INFO:tasks.workunit.client.1.smithi110.stdout:6/894: dread d7/d10/d1c/d2b/d3a/f81 [0,4194304] 0 2024-04-12T13:42:23.735 INFO:tasks.workunit.client.1.smithi110.stdout:3/890: dwrite d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/fdf [0,4194304] 0 2024-04-12T13:42:23.740 INFO:tasks.workunit.client.1.smithi110.stdout:5/867: dwrite da/db/f14 [4194304,4194304] 0 2024-04-12T13:42:23.741 INFO:tasks.workunit.client.1.smithi110.stdout:8/917: dwrite d1/d3/d35/d3a/d84/fb6 [0,4194304] 0 2024-04-12T13:42:23.742 INFO:tasks.workunit.client.1.smithi110.stdout:0/835: fdatasync d1/d3c/f5f 0 2024-04-12T13:42:23.751 INFO:tasks.workunit.client.0.smithi060.stdout:3/868: dwrite d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/f100 [0,4194304] 0 2024-04-12T13:42:23.756 INFO:tasks.workunit.client.1.smithi110.stdout:2/951: fdatasync d6/f117 0 2024-04-12T13:42:23.759 INFO:tasks.workunit.client.0.smithi060.stdout:3/869: dread - d7/d17/d19/dc9/d3f/d5c/f9a zero size 2024-04-12T13:42:23.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/867: symlink d6/l11f 0 2024-04-12T13:42:23.770 INFO:tasks.workunit.client.1.smithi110.stdout:9/995: write df/d38/db3/f133 [608620,101064] 0 2024-04-12T13:42:23.775 INFO:tasks.workunit.client.0.smithi060.stdout:6/884: creat d1/d7/da/dc/d24/d2d/d10b/f11f x:0 0 0 2024-04-12T13:42:23.785 INFO:tasks.workunit.client.0.smithi060.stdout:1/991: mknod d1e/d1f/d156/d2e/d86/c157 0 2024-04-12T13:42:23.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/829: link d0/c65 d0/d3d/d74/d9b/c108 0 2024-04-12T13:42:23.789 INFO:tasks.workunit.client.0.smithi060.stdout:7/830: readlink d0/d7/d43/d4d/l62 0 2024-04-12T13:42:23.789 INFO:tasks.workunit.client.1.smithi110.stdout:5/868: symlink da/d2e/d45/d25/d9d/d79/d88/d121/l12e 0 2024-04-12T13:42:23.791 INFO:tasks.workunit.client.0.smithi060.stdout:4/815: dread d6/d2f/d51/f71 [0,4194304] 0 2024-04-12T13:42:23.795 INFO:tasks.workunit.client.0.smithi060.stdout:7/831: chown d0/d7/d92/cb2 1333 1 2024-04-12T13:42:23.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/799: dwrite d4/d33/d65/d7a/fb3 [0,4194304] 0 2024-04-12T13:42:23.800 INFO:tasks.workunit.client.1.smithi110.stdout:8/918: creat d1/d3/d3c/d5a/d6f/f12c x:0 0 0 2024-04-12T13:42:23.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/870: mkdir d7/d17/d27/d36/d53/da2/dbc/dfa/d11c 0 2024-04-12T13:42:23.806 INFO:tasks.workunit.client.1.smithi110.stdout:0/836: unlink d1/d5e/fb3 0 2024-04-12T13:42:23.807 INFO:tasks.workunit.client.0.smithi060.stdout:5/868: symlink d6/d10/db8/dee/dfc/d3d/l120 0 2024-04-12T13:42:23.809 INFO:tasks.workunit.client.0.smithi060.stdout:6/885: truncate d1/d7/da/dc/d24/d2d/db0/fb8 290540 0 2024-04-12T13:42:23.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/832: dwrite d0/d7/f5e [0,4194304] 0 2024-04-12T13:42:23.812 INFO:tasks.workunit.client.1.smithi110.stdout:1/886: dwrite de/d15/fc4 [0,4194304] 0 2024-04-12T13:42:23.814 INFO:tasks.workunit.client.0.smithi060.stdout:1/992: creat d1e/d1f/d156/d2e/d30/d51/d12e/f158 x:0 0 0 2024-04-12T13:42:23.816 INFO:tasks.workunit.client.1.smithi110.stdout:9/996: symlink df/d13/d26/d37/d6a/dfe/l147 0 2024-04-12T13:42:23.819 INFO:tasks.workunit.client.0.smithi060.stdout:7/833: write d0/d7/da9/ff5 [750810,130437] 0 2024-04-12T13:42:23.822 INFO:tasks.workunit.client.1.smithi110.stdout:7/930: sync 2024-04-12T13:42:23.826 INFO:tasks.workunit.client.1.smithi110.stdout:6/895: rename d7/d10/d1c/d2b/d48/d4b to d7/d10/d1c/d7f/d116 0 2024-04-12T13:42:23.829 INFO:tasks.workunit.client.1.smithi110.stdout:5/869: mkdir da/d2e/d45/d29/d105/df4/d12f 0 2024-04-12T13:42:23.832 INFO:tasks.workunit.client.0.smithi060.stdout:3/871: dwrite d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/fd0 [4194304,4194304] 0 2024-04-12T13:42:23.834 INFO:tasks.workunit.client.1.smithi110.stdout:8/919: unlink d1/d5/dd/d31/dba/cf0 0 2024-04-12T13:42:23.840 INFO:tasks.workunit.client.1.smithi110.stdout:9/997: mkdir df/d13/d2c/d2d/dd3/d148 0 2024-04-12T13:42:23.843 INFO:tasks.workunit.client.0.smithi060.stdout:5/869: creat d6/dd/d1f/d25/d53/d8d/f121 x:0 0 0 2024-04-12T13:42:23.844 INFO:tasks.workunit.client.1.smithi110.stdout:9/998: dread - df/d13/d26/d37/fcc zero size 2024-04-12T13:42:23.845 INFO:tasks.workunit.client.0.smithi060.stdout:9/800: mknod d4/d9/d19/d21/c10c 0 2024-04-12T13:42:23.846 INFO:tasks.workunit.client.1.smithi110.stdout:0/837: dread d1/d48/db2/d4a/f4f [0,4194304] 0 2024-04-12T13:42:23.846 INFO:tasks.workunit.client.1.smithi110.stdout:1/887: truncate de/d14/d34/d55/f63 3125564 0 2024-04-12T13:42:23.846 INFO:tasks.workunit.client.1.smithi110.stdout:6/896: mkdir d7/d25/d30/d117 0 2024-04-12T13:42:23.847 INFO:tasks.workunit.client.0.smithi060.stdout:1/993: read d1e/d1f/d156/d2e/d30/d51/d85/f10e [962631,14771] 0 2024-04-12T13:42:23.847 INFO:tasks.workunit.client.1.smithi110.stdout:0/838: stat d1/d8/d8a/dc8 0 2024-04-12T13:42:23.847 INFO:tasks.workunit.client.1.smithi110.stdout:5/870: rename da/d2e/d45/d25/d9d/d79/dbe to da/d2e/d45/d25/d9d/d79/d88/d130 0 2024-04-12T13:42:23.849 INFO:tasks.workunit.client.1.smithi110.stdout:8/920: unlink d1/d3/d3c/d5a/f6d 0 2024-04-12T13:42:23.850 INFO:tasks.workunit.client.1.smithi110.stdout:7/931: mknod d1/d1b/c135 0 2024-04-12T13:42:23.854 INFO:tasks.workunit.client.0.smithi060.stdout:7/834: dwrite d0/d3d/d74/d9b/da1/f104 [0,4194304] 0 2024-04-12T13:42:23.855 INFO:tasks.workunit.client.1.smithi110.stdout:9/999: fdatasync df/f1e 0 2024-04-12T13:42:23.861 INFO:tasks.workunit.client.1.smithi110.stdout:3/891: sync 2024-04-12T13:42:23.864 INFO:tasks.workunit.client.1.smithi110.stdout:3/892: stat d5/dc/d31/d3b/d32/l34 0 2024-04-12T13:42:23.864 INFO:tasks.workunit.client.1.smithi110.stdout:0/839: symlink d1/d56/deb/l12c 0 2024-04-12T13:42:23.866 INFO:tasks.workunit.client.1.smithi110.stdout:8/921: dwrite d1/d5/f117 [0,4194304] 0 2024-04-12T13:42:23.866 INFO:tasks.workunit.client.1.smithi110.stdout:3/893: stat d5/d86/de3/f117 0 2024-04-12T13:42:23.869 INFO:tasks.workunit.client.0.smithi060.stdout:7/835: symlink d0/d7/d43/d63/d90/de7/l109 0 2024-04-12T13:42:23.869 INFO:tasks.workunit.client.1.smithi110.stdout:3/894: chown d5/dc/f12 1680 1 2024-04-12T13:42:23.871 INFO:tasks.workunit.client.1.smithi110.stdout:5/871: read - da/db/d52/fe0 zero size 2024-04-12T13:42:23.871 INFO:tasks.workunit.client.1.smithi110.stdout:2/952: write d6/f48 [204252,52971] 0 2024-04-12T13:42:23.874 INFO:tasks.workunit.client.0.smithi060.stdout:7/836: chown d0/d7/d43/d63/c69 427 1 2024-04-12T13:42:23.875 INFO:tasks.workunit.client.0.smithi060.stdout:9/801: mknod d4/d8/d7c/dfe/c10d 0 2024-04-12T13:42:23.877 INFO:tasks.workunit.client.0.smithi060.stdout:4/816: write d6/d7/dd/d1a/d56/f5c [3996894,28372] 0 2024-04-12T13:42:23.885 INFO:tasks.workunit.client.0.smithi060.stdout:3/872: getdents d7/d17 0 2024-04-12T13:42:23.887 INFO:tasks.workunit.client.0.smithi060.stdout:7/837: creat d0/d78/f10a x:0 0 0 2024-04-12T13:42:23.893 INFO:tasks.workunit.client.0.smithi060.stdout:5/870: dread d6/d10/db8/dee/dfc/d46/f82 [0,4194304] 0 2024-04-12T13:42:23.893 INFO:tasks.workunit.client.0.smithi060.stdout:1/994: rename d1e/d29/d37/c42 to d1e/c159 0 2024-04-12T13:42:23.894 INFO:tasks.workunit.client.0.smithi060.stdout:3/873: read d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/df5/f10f [2135876,89067] 0 2024-04-12T13:42:23.895 INFO:tasks.workunit.client.1.smithi110.stdout:2/953: mknod d6/dc/d13/d80/c124 0 2024-04-12T13:42:23.898 INFO:tasks.workunit.client.0.smithi060.stdout:9/802: mkdir d4/d8/d7c/d10e 0 2024-04-12T13:42:23.901 INFO:tasks.workunit.client.0.smithi060.stdout:4/817: fdatasync d6/d7/dd/d1a/d57/d63/fec 0 2024-04-12T13:42:23.906 INFO:tasks.workunit.client.0.smithi060.stdout:7/838: rename d0/d78/da0 to d0/d3d/dcf/d10b 0 2024-04-12T13:42:23.908 INFO:tasks.workunit.client.1.smithi110.stdout:1/888: creat de/d14/d34/d55/f12c x:0 0 0 2024-04-12T13:42:23.908 INFO:tasks.workunit.client.1.smithi110.stdout:0/840: symlink d1/d8/l12d 0 2024-04-12T13:42:23.908 INFO:tasks.workunit.client.1.smithi110.stdout:7/932: write d1/d3/d4/d36/d76/ff6 [4901516,117008] 0 2024-04-12T13:42:23.909 INFO:tasks.workunit.client.0.smithi060.stdout:6/886: dread d1/d7/da/d20/f26 [0,4194304] 0 2024-04-12T13:42:23.911 INFO:tasks.workunit.client.1.smithi110.stdout:1/889: write de/d15/dab/dd8/ffd [3826881,98441] 0 2024-04-12T13:42:23.914 INFO:tasks.workunit.client.1.smithi110.stdout:6/897: dwrite d7/d10/d1c/f28 [0,4194304] 0 2024-04-12T13:42:23.917 INFO:tasks.workunit.client.0.smithi060.stdout:5/871: dread d6/dd/d1f/d25/f34 [0,4194304] 0 2024-04-12T13:42:23.928 INFO:tasks.workunit.client.1.smithi110.stdout:1/890: dwrite de/d14/d34/d55/d6b/fe5 [0,4194304] 0 2024-04-12T13:42:23.933 INFO:tasks.workunit.client.1.smithi110.stdout:3/895: unlink d5/dc/d20/d2d/d4e/d89/db4/le2 0 2024-04-12T13:42:23.938 INFO:tasks.workunit.client.0.smithi060.stdout:0/800: sync 2024-04-12T13:42:23.942 INFO:tasks.workunit.client.0.smithi060.stdout:0/801: chown d7/d9/d14/d35/d44/d8c/d8d/de5/f103 1941699 1 2024-04-12T13:42:23.943 INFO:tasks.workunit.client.0.smithi060.stdout:1/995: mknod d1e/dcc/c15a 0 2024-04-12T13:42:23.947 INFO:tasks.workunit.client.0.smithi060.stdout:3/874: rename d7/d17/d27/d36/l56 to d7/d17/d19/dc9/d3f/d5c/l11d 0 2024-04-12T13:42:23.952 INFO:tasks.workunit.client.1.smithi110.stdout:8/922: sync 2024-04-12T13:42:23.953 INFO:tasks.workunit.client.0.smithi060.stdout:5/872: write d6/d10/de9/fcc [3534691,15465] 0 2024-04-12T13:42:23.970 INFO:tasks.workunit.client.0.smithi060.stdout:7/839: rename d0/d7/da9/dc9/db1/ldd to d0/d3d/d74/d9b/l10c 0 2024-04-12T13:42:23.972 INFO:tasks.workunit.client.0.smithi060.stdout:6/887: dwrite d1/d7/da/dc/d24/d30/d52/d78/d80/d93/ff2 [4194304,4194304] 0 2024-04-12T13:42:23.976 INFO:tasks.workunit.client.0.smithi060.stdout:6/888: write d1/d7/da/dc/f19 [3206981,126236] 0 2024-04-12T13:42:23.977 INFO:tasks.workunit.client.0.smithi060.stdout:0/802: truncate d7/d9/f1e 144353 0 2024-04-12T13:42:23.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/889: stat d1/d7/da/dc/d24/d30/d52/d78 0 2024-04-12T13:42:23.989 INFO:tasks.workunit.client.0.smithi060.stdout:6/890: fsync d1/d7/da/d20/da8/df0/f11b 0 2024-04-12T13:42:23.990 INFO:tasks.workunit.client.0.smithi060.stdout:9/803: dwrite d4/d33/d65/d7a/f105 [0,4194304] 0 2024-04-12T13:42:23.995 INFO:tasks.workunit.client.0.smithi060.stdout:1/996: dwrite d1e/d1f/f128 [0,4194304] 0 2024-04-12T13:42:23.997 INFO:tasks.workunit.client.0.smithi060.stdout:5/873: write d6/dd/d27/d7d/fd7 [920777,85276] 0 2024-04-12T13:42:24.002 INFO:tasks.workunit.client.1.smithi110.stdout:5/872: sync 2024-04-12T13:42:24.007 INFO:tasks.workunit.client.0.smithi060.stdout:4/818: getdents d6/d7/dd/d1a/d57 0 2024-04-12T13:42:24.010 INFO:tasks.workunit.client.0.smithi060.stdout:7/840: read d0/d7/d43/d63/f9f [121112,11268] 0 2024-04-12T13:42:24.012 INFO:tasks.workunit.client.0.smithi060.stdout:0/803: truncate d7/d9/d14/d35/d44/d49/d67/f76 876430 0 2024-04-12T13:42:24.021 INFO:tasks.workunit.client.0.smithi060.stdout:3/875: dwrite d7/d17/d19/f23 [4194304,4194304] 0 2024-04-12T13:42:24.026 INFO:tasks.workunit.client.0.smithi060.stdout:1/997: rename d1e/f2b to d1e/d29/d65/f15b 0 2024-04-12T13:42:24.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/841: chown d0/d7/d43/d4d/lc8 89512443 1 2024-04-12T13:42:24.036 INFO:tasks.workunit.client.1.smithi110.stdout:5/873: dwrite da/d2e/d45/d25/d9d/d79/d9e/fd5 [0,4194304] 0 2024-04-12T13:42:24.036 INFO:tasks.workunit.client.0.smithi060.stdout:6/891: symlink d1/d7/da/dc/d24/d30/d52/d5e/l120 0 2024-04-12T13:42:24.047 INFO:tasks.workunit.client.0.smithi060.stdout:3/876: unlink d7/d17/d19/l93 0 2024-04-12T13:42:24.053 INFO:tasks.workunit.client.0.smithi060.stdout:4/819: write d6/d7/dd/d1a/d57/d63/df4/f72 [1324374,114068] 0 2024-04-12T13:42:24.055 INFO:tasks.workunit.client.0.smithi060.stdout:7/842: fdatasync d0/d78/f97 0 2024-04-12T13:42:24.060 INFO:tasks.workunit.client.0.smithi060.stdout:9/804: link d4/d8/d32/l9d d4/d9/d19/daf/d101/de8/l10f 0 2024-04-12T13:42:24.062 INFO:tasks.workunit.client.0.smithi060.stdout:7/843: write d0/d7/da9/ff5 [1462209,37376] 0 2024-04-12T13:42:24.066 INFO:tasks.workunit.client.0.smithi060.stdout:7/844: chown d0/d1b/d8c/le5 403 1 2024-04-12T13:42:24.069 INFO:tasks.workunit.client.0.smithi060.stdout:0/804: dwrite d7/d9/d14/d35/d44/d49/d74/ff2 [0,4194304] 0 2024-04-12T13:42:24.079 INFO:tasks.workunit.client.1.smithi110.stdout:7/933: fdatasync d1/d3/d4/f2d 0 2024-04-12T13:42:24.084 INFO:tasks.workunit.client.1.smithi110.stdout:6/898: symlink d7/d10/d7e/l118 0 2024-04-12T13:42:24.085 INFO:tasks.workunit.client.1.smithi110.stdout:1/891: truncate de/d14/d34/d87/fe6 55776 0 2024-04-12T13:42:24.088 INFO:tasks.workunit.client.1.smithi110.stdout:2/954: mknod d6/dc/dd/c125 0 2024-04-12T13:42:24.091 INFO:tasks.workunit.client.0.smithi060.stdout:3/877: write d7/d17/d27/d36/f79 [859453,25859] 0 2024-04-12T13:42:24.092 INFO:tasks.workunit.client.0.smithi060.stdout:7/845: symlink d0/d1b/l10d 0 2024-04-12T13:42:24.092 INFO:tasks.workunit.client.1.smithi110.stdout:8/923: creat d1/d5/d1f/f12d x:0 0 0 2024-04-12T13:42:24.094 INFO:tasks.workunit.client.0.smithi060.stdout:1/998: truncate d1e/f4d 3974515 0 2024-04-12T13:42:24.094 INFO:tasks.workunit.client.0.smithi060.stdout:3/878: readlink d7/d17/d19/dc9/d3f/d5c/d103/l8a 0 2024-04-12T13:42:24.096 INFO:tasks.workunit.client.0.smithi060.stdout:0/805: rename d7/d9/d14/d4a/l79 to d7/d9/de/d80/dc8/d10d/l117 0 2024-04-12T13:42:24.096 INFO:tasks.workunit.client.1.smithi110.stdout:8/924: stat d1/d7/d20/l7c 0 2024-04-12T13:42:24.098 INFO:tasks.workunit.client.0.smithi060.stdout:4/820: fsync d6/d7/dd/d1a/d19/f1b 0 2024-04-12T13:42:24.100 INFO:tasks.workunit.client.1.smithi110.stdout:0/841: fdatasync d1/d8/d36/d51/d60/f2b 0 2024-04-12T13:42:24.108 INFO:tasks.workunit.client.0.smithi060.stdout:9/805: mkdir d4/d33/d50/dd0/d104/d110 0 2024-04-12T13:42:24.110 INFO:tasks.workunit.client.1.smithi110.stdout:3/896: mkdir d5/d86/d118 0 2024-04-12T13:42:24.112 INFO:tasks.workunit.client.0.smithi060.stdout:7/846: mknod d0/d7/d43/d63/d90/de7/c10e 0 2024-04-12T13:42:24.113 INFO:tasks.workunit.client.0.smithi060.stdout:7/847: readlink d0/ld4 0 2024-04-12T13:42:24.114 INFO:tasks.workunit.client.1.smithi110.stdout:3/897: fsync d5/dc/d31/d3b/d32/d3e/d5f/dbd/fde 0 2024-04-12T13:42:24.120 INFO:tasks.workunit.client.1.smithi110.stdout:7/934: dread d1/d3/d4/d36/da1/fcc [0,4194304] 0 2024-04-12T13:42:24.121 INFO:tasks.workunit.client.0.smithi060.stdout:3/879: mknod d7/d17/d27/d36/db0/dc4/de9/c11e 0 2024-04-12T13:42:24.123 INFO:tasks.workunit.client.1.smithi110.stdout:7/935: chown d1/d3/d4/d55/d56/d72/de0 1416 1 2024-04-12T13:42:24.124 INFO:tasks.workunit.client.1.smithi110.stdout:2/955: rename d6/dc/db1/d111/de9 to d6/dc/dd/d49/d64/d4a/d3c/d6e/d126 0 2024-04-12T13:42:24.124 INFO:tasks.workunit.client.0.smithi060.stdout:1/999: dread d1e/f12b [0,4194304] 0 2024-04-12T13:42:24.127 INFO:tasks.workunit.client.0.smithi060.stdout:0/806: truncate d7/d9/de/d80/d8b/fe7 21784 0 2024-04-12T13:42:24.129 INFO:tasks.workunit.client.1.smithi110.stdout:0/842: creat d1/d27/d6e/f12e x:0 0 0 2024-04-12T13:42:24.129 INFO:tasks.workunit.client.1.smithi110.stdout:7/936: truncate d1/d31/d5d/d127/f116 543075 0 2024-04-12T13:42:24.132 INFO:tasks.workunit.client.0.smithi060.stdout:6/892: getdents d1/d7d 0 2024-04-12T13:42:24.132 INFO:tasks.workunit.client.1.smithi110.stdout:7/937: readlink d1/d3/d4/d55/d56/d72/l113 0 2024-04-12T13:42:24.142 INFO:tasks.workunit.client.0.smithi060.stdout:0/807: rename d7/d9/d14/d35/d44/d7d/f7a to d7/d9/d14/d35/d44/d49/dcf/dd0/dd6/f118 0 2024-04-12T13:42:24.146 INFO:tasks.workunit.client.0.smithi060.stdout:7/848: mknod d0/d7/d92/db7/c10f 0 2024-04-12T13:42:24.147 INFO:tasks.workunit.client.1.smithi110.stdout:5/874: link da/d2e/d45/d29/f48 da/d2e/d45/d29/d105/df4/d12f/f131 0 2024-04-12T13:42:24.148 INFO:tasks.workunit.client.0.smithi060.stdout:6/893: dread - d1/d2c/faa zero size 2024-04-12T13:42:24.152 INFO:tasks.workunit.client.1.smithi110.stdout:8/925: rename d1/d3/d35/d43/d9f/fbf to d1/d5/dd/d31/dba/f12e 0 2024-04-12T13:42:24.156 INFO:tasks.workunit.client.1.smithi110.stdout:2/956: symlink d6/dc/dd/d49/df9/l127 0 2024-04-12T13:42:24.158 INFO:tasks.workunit.client.1.smithi110.stdout:1/892: truncate f6 2666075 0 2024-04-12T13:42:24.158 INFO:tasks.workunit.client.1.smithi110.stdout:8/926: write d1/d3/d35/d3a/d3e/f99 [3535020,12186] 0 2024-04-12T13:42:24.163 INFO:tasks.workunit.client.0.smithi060.stdout:4/821: dwrite d6/d7/dd/df/f93 [0,4194304] 0 2024-04-12T13:42:24.163 INFO:tasks.workunit.client.0.smithi060.stdout:7/849: creat d0/d7/d43/d4d/f110 x:0 0 0 2024-04-12T13:42:24.164 INFO:tasks.workunit.client.0.smithi060.stdout:0/808: dwrite d7/d9/d4c/f50 [0,4194304] 0 2024-04-12T13:42:24.171 INFO:tasks.workunit.client.0.smithi060.stdout:3/880: dwrite d7/d17/d19/dc9/d3f/d5c/d103/fcb [0,4194304] 0 2024-04-12T13:42:24.172 INFO:tasks.workunit.client.0.smithi060.stdout:6/894: mknod d1/d7/da/dc/d7a/c121 0 2024-04-12T13:42:24.174 INFO:tasks.workunit.client.1.smithi110.stdout:7/938: mknod d1/d31/d5d/d127/d97/c136 0 2024-04-12T13:42:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:23 smithi060 ceph-mon[29097]: pgmap v36: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 73 MiB/s rd, 188 MiB/s wr, 414 op/s 2024-04-12T13:42:24.186 INFO:tasks.workunit.client.1.smithi110.stdout:3/898: dwrite d5/dc/d20/d2d/d4f/f58 [0,4194304] 0 2024-04-12T13:42:24.186 INFO:tasks.workunit.client.1.smithi110.stdout:6/899: write d7/d10/d1c/d2b/d48/f5e [2250987,35452] 0 2024-04-12T13:42:24.188 INFO:tasks.workunit.client.1.smithi110.stdout:3/899: readlink d5/dc/d31/d3b/d32/d3e/l5c 0 2024-04-12T13:42:24.197 INFO:tasks.workunit.client.1.smithi110.stdout:0/843: mknod d1/d8/c12f 0 2024-04-12T13:42:24.198 INFO:tasks.workunit.client.1.smithi110.stdout:2/957: creat d6/dc/dd/d49/d64/d4a/d3c/d6e/f128 x:0 0 0 2024-04-12T13:42:24.198 INFO:tasks.workunit.client.1.smithi110.stdout:8/927: mkdir d1/d3/d3c/d5a/d6f/d7e/d12f 0 2024-04-12T13:42:24.201 INFO:tasks.workunit.client.1.smithi110.stdout:7/939: creat d1/d3/d4/d36/d76/f137 x:0 0 0 2024-04-12T13:42:24.202 INFO:tasks.workunit.client.1.smithi110.stdout:5/875: write da/db/f102 [964171,40713] 0 2024-04-12T13:42:24.204 INFO:tasks.workunit.client.1.smithi110.stdout:6/900: mknod d7/d10/d7e/d85/dd0/c119 0 2024-04-12T13:42:24.204 INFO:tasks.workunit.client.0.smithi060.stdout:4/822: dread d6/f8f [0,4194304] 0 2024-04-12T13:42:24.205 INFO:tasks.workunit.client.1.smithi110.stdout:3/900: rmdir d5/dc/d31/d74/d75 39 2024-04-12T13:42:24.206 INFO:tasks.workunit.client.0.smithi060.stdout:8/826: sync 2024-04-12T13:42:24.208 INFO:tasks.workunit.client.1.smithi110.stdout:1/893: creat de/f12d x:0 0 0 2024-04-12T13:42:24.209 INFO:tasks.workunit.client.0.smithi060.stdout:8/827: stat d9/d1b/d37/d4d/d63/d66/d8b/cad 0 2024-04-12T13:42:24.210 INFO:tasks.workunit.client.1.smithi110.stdout:1/894: chown de/d14/d34/d55/f12c 100317696 1 2024-04-12T13:42:24.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/828: chown d9/d1b/d37/d48/c52 9 1 2024-04-12T13:42:24.216 INFO:tasks.workunit.client.1.smithi110.stdout:5/876: dread da/db/d3b/d40/da6/f107 [0,4194304] 0 2024-04-12T13:42:24.220 INFO:tasks.workunit.client.1.smithi110.stdout:3/901: dwrite d5/d86/fb5 [0,4194304] 0 2024-04-12T13:42:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:23 smithi110 ceph-mon[36055]: pgmap v36: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 73 MiB/s rd, 188 MiB/s wr, 414 op/s 2024-04-12T13:42:24.236 INFO:tasks.workunit.client.1.smithi110.stdout:6/901: dread d7/d25/d30/d44/d3d/f47 [0,4194304] 0 2024-04-12T13:42:24.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/928: write d1/d3/d3c/d5a/d6f/d7e/fdf [292157,11097] 0 2024-04-12T13:42:24.245 INFO:tasks.workunit.client.1.smithi110.stdout:7/940: write d1/d3/d4/da6/fc4 [415494,108145] 0 2024-04-12T13:42:24.246 INFO:tasks.workunit.client.1.smithi110.stdout:2/958: getdents d6/dc/dd/d49/d64/d4a 0 2024-04-12T13:42:24.248 INFO:tasks.workunit.client.1.smithi110.stdout:0/844: write d1/d48/db2/d4a/f73 [1149082,129610] 0 2024-04-12T13:42:24.248 INFO:tasks.workunit.client.1.smithi110.stdout:2/959: chown d6/dc/dd/dc6/fe4 3447266 1 2024-04-12T13:42:24.249 INFO:tasks.workunit.client.1.smithi110.stdout:2/960: chown d6/la 2691219 1 2024-04-12T13:42:24.252 INFO:tasks.workunit.client.1.smithi110.stdout:1/895: link de/d15/d32/d61/d6a/dac/dc0/dea/c106 de/d14/d34/c12e 0 2024-04-12T13:42:24.252 INFO:tasks.workunit.client.1.smithi110.stdout:2/961: dread - d6/dc/d13/d80/d8d/dcc/d82/d84/f91 zero size 2024-04-12T13:42:24.254 INFO:tasks.workunit.client.1.smithi110.stdout:2/962: truncate d6/d53/f10f 254922 0 2024-04-12T13:42:24.255 INFO:tasks.workunit.client.1.smithi110.stdout:0/845: read d1/d8/d8a/fa8 [740707,64250] 0 2024-04-12T13:42:24.256 INFO:tasks.workunit.client.1.smithi110.stdout:7/941: symlink d1/d3/d4/d36/d76/l138 0 2024-04-12T13:42:24.259 INFO:tasks.workunit.client.1.smithi110.stdout:3/902: write d5/dc/d20/d2d/d4e/d89/d8c/db6/fd0 [2135542,68176] 0 2024-04-12T13:42:24.263 INFO:tasks.workunit.client.1.smithi110.stdout:5/877: dwrite da/db/d15/de9/ff5 [0,4194304] 0 2024-04-12T13:42:24.264 INFO:tasks.workunit.client.1.smithi110.stdout:3/903: read d5/dc/d31/d3b/f4b [30460,88674] 0 2024-04-12T13:42:24.265 INFO:tasks.workunit.client.0.smithi060.stdout:6/895: stat d1/d7/ce8 0 2024-04-12T13:42:24.267 INFO:tasks.workunit.client.1.smithi110.stdout:0/846: creat d1/d56/deb/d109/f130 x:0 0 0 2024-04-12T13:42:24.268 INFO:tasks.workunit.client.1.smithi110.stdout:8/929: dwrite d1/d3/d35/d43/d9f/dd5/d11e/d85/fd4 [0,4194304] 0 2024-04-12T13:42:24.271 INFO:tasks.workunit.client.1.smithi110.stdout:6/902: write d7/da9/fe4 [67787,126599] 0 2024-04-12T13:42:24.271 INFO:tasks.workunit.client.1.smithi110.stdout:7/942: fdatasync d1/d3/d4/d55/d56/f8c 0 2024-04-12T13:42:24.274 INFO:tasks.workunit.client.1.smithi110.stdout:2/963: symlink d6/dc/dd/d49/d64/d4a/d3c/d6e/d126/l129 0 2024-04-12T13:42:24.275 INFO:tasks.workunit.client.0.smithi060.stdout:4/823: read d6/f55 [2618249,16740] 0 2024-04-12T13:42:24.276 INFO:tasks.workunit.client.0.smithi060.stdout:8/829: rmdir d9/d1b/d2b/d82 39 2024-04-12T13:42:24.278 INFO:tasks.workunit.client.0.smithi060.stdout:4/824: chown d6/d7/dd/d1a/d56/l61 417931825 1 2024-04-12T13:42:24.278 INFO:tasks.workunit.client.0.smithi060.stdout:8/830: chown d9/d1b/d37/d48/l59 1702655 1 2024-04-12T13:42:24.281 INFO:tasks.workunit.client.1.smithi110.stdout:1/896: unlink de/d1d/c59 0 2024-04-12T13:42:24.281 INFO:tasks.workunit.client.1.smithi110.stdout:2/964: chown d6/dc/dd/d49/d64/d4a/d3c/d6e/d126/l129 1007192854 1 2024-04-12T13:42:24.283 INFO:tasks.workunit.client.1.smithi110.stdout:5/878: read - da/d2e/d45/d29/d105/f110 zero size 2024-04-12T13:42:24.287 INFO:tasks.workunit.client.1.smithi110.stdout:0/847: symlink d1/d3c/dd8/l131 0 2024-04-12T13:42:24.294 INFO:tasks.workunit.client.0.smithi060.stdout:7/850: dwrite d0/f21 [0,4194304] 0 2024-04-12T13:42:24.294 INFO:tasks.workunit.client.1.smithi110.stdout:7/943: creat d1/d3/d4/d55/d56/ddd/f139 x:0 0 0 2024-04-12T13:42:24.299 INFO:tasks.workunit.client.1.smithi110.stdout:1/897: stat de/d15/da9 0 2024-04-12T13:42:24.299 INFO:tasks.workunit.client.0.smithi060.stdout:3/881: dwrite d7/d17/d27/d36/f3c [0,4194304] 0 2024-04-12T13:42:24.300 INFO:tasks.workunit.client.1.smithi110.stdout:2/965: fdatasync d6/dc/d1b/d57/d62/db4/fcd 0 2024-04-12T13:42:24.301 INFO:tasks.workunit.client.1.smithi110.stdout:3/904: mknod d5/dc/d31/d3b/d32/d3e/c119 0 2024-04-12T13:42:24.307 INFO:tasks.workunit.client.0.smithi060.stdout:0/809: getdents d7/d9/de/d7c 0 2024-04-12T13:42:24.307 INFO:tasks.workunit.client.1.smithi110.stdout:0/848: rmdir d1 39 2024-04-12T13:42:24.307 INFO:tasks.workunit.client.1.smithi110.stdout:5/879: creat da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/f132 x:0 0 0 2024-04-12T13:42:24.322 INFO:tasks.workunit.client.0.smithi060.stdout:4/825: write d6/d7/dd/d4d/d69/f8a [953195,106135] 0 2024-04-12T13:42:24.324 INFO:tasks.workunit.client.1.smithi110.stdout:2/966: creat d6/dc/d1b/d57/d62/db4/f12a x:0 0 0 2024-04-12T13:42:24.327 INFO:tasks.workunit.client.1.smithi110.stdout:3/905: dwrite d5/dc/d20/d2d/d4e/d89/d8c/f104 [0,4194304] 0 2024-04-12T13:42:24.328 INFO:tasks.workunit.client.1.smithi110.stdout:3/906: readlink d5/dc/d20/l55 0 2024-04-12T13:42:24.329 INFO:tasks.workunit.client.0.smithi060.stdout:0/810: fdatasync d7/d9/d14/d35/d44/d7d/f2a 0 2024-04-12T13:42:24.330 INFO:tasks.workunit.client.1.smithi110.stdout:3/907: read - d5/dc/d20/d2d/db1/f10d zero size 2024-04-12T13:42:24.331 INFO:tasks.workunit.client.0.smithi060.stdout:8/831: dwrite d9/d1b/d2b/f55 [0,4194304] 0 2024-04-12T13:42:24.331 INFO:tasks.workunit.client.0.smithi060.stdout:6/896: dwrite d1/d7/da/dc/d24/d34/f9c [0,4194304] 0 2024-04-12T13:42:24.332 INFO:tasks.workunit.client.1.smithi110.stdout:8/930: rename d1/d3/c30 to d1/d5/c130 0 2024-04-12T13:42:24.336 INFO:tasks.workunit.client.1.smithi110.stdout:5/880: symlink da/d2e/d45/d25/d9d/d7a/db5/d8f/l133 0 2024-04-12T13:42:24.337 INFO:tasks.workunit.client.0.smithi060.stdout:7/851: write d0/d3d/dcf/d10b/fb8 [529669,87129] 0 2024-04-12T13:42:24.341 INFO:tasks.workunit.client.0.smithi060.stdout:7/852: stat d0/d7/d92/db7/c10f 0 2024-04-12T13:42:24.341 INFO:tasks.workunit.client.0.smithi060.stdout:3/882: write d7/d17/d19/dc9/d3f/d5c/d103/f5b [889710,71576] 0 2024-04-12T13:42:24.349 INFO:tasks.workunit.client.0.smithi060.stdout:7/853: fdatasync d0/d3d/d74/d9b/da1/ffc 0 2024-04-12T13:42:24.349 INFO:tasks.workunit.client.0.smithi060.stdout:0/811: unlink d7/d9/d14/faa 0 2024-04-12T13:42:24.349 INFO:tasks.workunit.client.0.smithi060.stdout:0/812: readlink d7/l4d 0 2024-04-12T13:42:24.350 INFO:tasks.workunit.client.1.smithi110.stdout:7/944: dwrite d1/d1b/d3d/fc5 [0,4194304] 0 2024-04-12T13:42:24.351 INFO:tasks.workunit.client.1.smithi110.stdout:6/903: dwrite d7/d10/d1c/d2b/f71 [0,4194304] 0 2024-04-12T13:42:24.351 INFO:tasks.workunit.client.1.smithi110.stdout:5/881: dread da/db/d3b/ffa [0,4194304] 0 2024-04-12T13:42:24.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/826: dwrite d6/d21/d29/f73 [0,4194304] 0 2024-04-12T13:42:24.353 INFO:tasks.workunit.client.1.smithi110.stdout:5/882: chown da/d2e/d45/d29 7 1 2024-04-12T13:42:24.355 INFO:tasks.workunit.client.1.smithi110.stdout:2/967: truncate d6/dc/dd/d49/f61 3879728 0 2024-04-12T13:42:24.357 INFO:tasks.workunit.client.0.smithi060.stdout:8/832: mkdir d9/dc9/d120 0 2024-04-12T13:42:24.360 INFO:tasks.workunit.client.1.smithi110.stdout:0/849: rename d1/d27/d31/d89/f12a to d1/d8/d8a/f132 0 2024-04-12T13:42:24.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/897: dread - d1/d7/da/dc/d24/d34/d51/fcd zero size 2024-04-12T13:42:24.363 INFO:tasks.workunit.client.1.smithi110.stdout:0/850: write d1/d56/f118 [795259,69951] 0 2024-04-12T13:42:24.366 INFO:tasks.workunit.client.1.smithi110.stdout:0/851: stat d1/d8/d36/d51/d60/f120 0 2024-04-12T13:42:24.367 INFO:tasks.workunit.client.1.smithi110.stdout:5/883: dread da/d2e/d45/d25/d9d/d79/d88/dd3/f7d [0,4194304] 0 2024-04-12T13:42:24.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/813: dread - d7/d9/d14/d35/fcd zero size 2024-04-12T13:42:24.377 INFO:tasks.workunit.client.0.smithi060.stdout:4/827: fdatasync d6/d7/dd/d1a/d19/d42/d7c/fb9 0 2024-04-12T13:42:24.379 INFO:tasks.workunit.client.0.smithi060.stdout:8/833: mkdir d9/dc9/d121 0 2024-04-12T13:42:24.384 INFO:tasks.workunit.client.0.smithi060.stdout:6/898: dread d1/d7/da/dc/d7a/de1/d113/d94/ffa [0,4194304] 0 2024-04-12T13:42:24.391 INFO:tasks.workunit.client.0.smithi060.stdout:4/828: chown d6/d7/dd/d1a/d57/d63/c74 1527610957 1 2024-04-12T13:42:24.397 INFO:tasks.workunit.client.1.smithi110.stdout:2/968: mknod d6/dc/dd/d49/d64/d4a/c12b 0 2024-04-12T13:42:24.397 INFO:tasks.workunit.client.1.smithi110.stdout:3/908: dread d5/dc/d31/d3b/d32/d3e/d5f/f9b [0,4194304] 0 2024-04-12T13:42:24.403 INFO:tasks.workunit.client.1.smithi110.stdout:8/931: mkdir d1/d3/d3c/d5a/d131 0 2024-04-12T13:42:24.406 INFO:tasks.workunit.client.0.smithi060.stdout:6/899: chown d1/d7/da/dc/d24/d30/f71 2366 1 2024-04-12T13:42:24.406 INFO:tasks.workunit.client.1.smithi110.stdout:8/932: readlink d1/d3/d35/d43/d9f/dd5/d11e/d85/d8d/lfa 0 2024-04-12T13:42:24.407 INFO:tasks.workunit.client.0.smithi060.stdout:8/834: mkdir d9/d1d/d5e/ded/d122 0 2024-04-12T13:42:24.409 INFO:tasks.workunit.client.1.smithi110.stdout:1/898: getdents de/d15/d32/d61/d6a/dac 0 2024-04-12T13:42:24.410 INFO:tasks.workunit.client.0.smithi060.stdout:5/874: sync 2024-04-12T13:42:24.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/885: sync 2024-04-12T13:42:24.411 INFO:tasks.workunit.client.0.smithi060.stdout:8/835: write d9/d1b/d37/d4d/f6b [8248271,3875] 0 2024-04-12T13:42:24.412 INFO:tasks.workunit.client.0.smithi060.stdout:7/854: dwrite d0/d1b/da4/fea [0,4194304] 0 2024-04-12T13:42:24.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/814: link d7/d9/d14/d4a/l5a d7/d9/de/dca/l119 0 2024-04-12T13:42:24.431 INFO:tasks.workunit.client.0.smithi060.stdout:2/886: mkdir d6/d56/d55/d113 0 2024-04-12T13:42:24.435 INFO:tasks.workunit.client.1.smithi110.stdout:0/852: write d1/d8/d8a/fa8 [265393,65721] 0 2024-04-12T13:42:24.437 INFO:tasks.workunit.client.1.smithi110.stdout:6/904: dwrite d7/d25/d2c/d4c/f8b [0,4194304] 0 2024-04-12T13:42:24.439 INFO:tasks.workunit.client.1.smithi110.stdout:6/905: chown d7/d25/dc6/fca 0 1 2024-04-12T13:42:24.444 INFO:tasks.workunit.client.1.smithi110.stdout:8/933: creat d1/d3/d3c/d75/f132 x:0 0 0 2024-04-12T13:42:24.446 INFO:tasks.workunit.client.0.smithi060.stdout:2/887: dread d6/d56/d43/f4a [0,4194304] 0 2024-04-12T13:42:24.452 INFO:tasks.workunit.client.1.smithi110.stdout:1/899: creat de/d14/d34/d108/d10e/f12f x:0 0 0 2024-04-12T13:42:24.452 INFO:tasks.workunit.client.1.smithi110.stdout:7/945: write d1/f28 [372915,29983] 0 2024-04-12T13:42:24.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/815: dread d7/fa3 [0,4194304] 0 2024-04-12T13:42:24.454 INFO:tasks.workunit.client.1.smithi110.stdout:2/969: dread d6/dc/dd/f1f [0,4194304] 0 2024-04-12T13:42:24.455 INFO:tasks.workunit.client.0.smithi060.stdout:0/816: chown d7/d9/de/d63/ccb 2074 1 2024-04-12T13:42:24.457 INFO:tasks.workunit.client.1.smithi110.stdout:0/853: dwrite d1/d27/d6e/f12e [0,4194304] 0 2024-04-12T13:42:24.460 INFO:tasks.workunit.client.1.smithi110.stdout:6/906: dread d7/d25/d30/d44/d3d/fb3 [0,4194304] 0 2024-04-12T13:42:24.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/855: mkdir d0/d111 0 2024-04-12T13:42:24.464 INFO:tasks.workunit.client.0.smithi060.stdout:8/836: rename d9/d1b/d2b/d82/d8a/ld7 to d9/d1b/d84/da0/d114/l123 0 2024-04-12T13:42:24.470 INFO:tasks.workunit.client.1.smithi110.stdout:5/884: rename da/d35/ffe to da/d2e/f134 0 2024-04-12T13:42:24.569 INFO:tasks.workunit.client.0.smithi060.stdout:9/806: sync 2024-04-12T13:42:24.572 INFO:tasks.workunit.client.0.smithi060.stdout:9/807: chown d4/d9/d19/d21/f31 135092360 1 2024-04-12T13:42:24.602 INFO:tasks.workunit.client.0.smithi060.stdout:3/883: sync 2024-04-12T13:42:24.653 INFO:tasks.workunit.client.0.smithi060.stdout:5/875: dwrite d6/dd/d1f/d25/d53/d8d/fe3 [0,4194304] 0 2024-04-12T13:42:24.654 INFO:tasks.workunit.client.0.smithi060.stdout:6/900: write d1/d7/da/dc/d24/d30/dd8/fe2 [3797318,21895] 0 2024-04-12T13:42:24.666 INFO:tasks.workunit.client.0.smithi060.stdout:0/817: write d7/d9/d14/d35/ffc [1021224,4253] 0 2024-04-12T13:42:24.674 INFO:tasks.workunit.client.1.smithi110.stdout:7/946: truncate d1/d1b/d3d/f9e 434867 0 2024-04-12T13:42:24.674 INFO:tasks.workunit.client.0.smithi060.stdout:6/901: dread d1/d7/da/dc/d24/d2d/db3/f102 [0,4194304] 0 2024-04-12T13:42:24.680 INFO:tasks.workunit.client.1.smithi110.stdout:7/947: truncate d1/d1b/d74/f79 2194884 0 2024-04-12T13:42:24.686 INFO:tasks.workunit.client.1.smithi110.stdout:3/909: rmdir d5/dc/d20/d2d/d4e/d89/d8c/db6/d103 0 2024-04-12T13:42:24.690 INFO:tasks.workunit.client.1.smithi110.stdout:3/910: stat d5/dc/d31/d3b/d32/d3e/d98/f9e 0 2024-04-12T13:42:24.699 INFO:tasks.workunit.client.0.smithi060.stdout:3/884: fdatasync d7/d17/d27/fa5 0 2024-04-12T13:42:24.701 INFO:tasks.workunit.client.0.smithi060.stdout:6/902: dwrite d1/d7/da/dc/d24/d30/dd8/f11c [0,4194304] 0 2024-04-12T13:42:24.722 INFO:tasks.workunit.client.0.smithi060.stdout:4/829: link d6/d7/dd/d1a/d57/d63/d68/c6f d6/db7/dbb/dfb/c108 0 2024-04-12T13:42:24.734 INFO:tasks.workunit.client.0.smithi060.stdout:0/818: read d7/d9/f2b [64362,99306] 0 2024-04-12T13:42:24.737 INFO:tasks.workunit.client.1.smithi110.stdout:3/911: creat d5/dc/d31/d3b/d32/d3e/d98/f11a x:0 0 0 2024-04-12T13:42:24.745 INFO:tasks.workunit.client.1.smithi110.stdout:8/934: link d1/d3/d35/d43/d9f/dd5/d11e/d85/fe3 d1/d3/d35/d3a/d10d/f133 0 2024-04-12T13:42:24.754 INFO:tasks.workunit.client.1.smithi110.stdout:0/854: creat d1/f133 x:0 0 0 2024-04-12T13:42:24.760 INFO:tasks.workunit.client.0.smithi060.stdout:3/885: read d7/d17/d19/dc9/d3f/d5c/d25/d4d/f95 [205065,76127] 0 2024-04-12T13:42:24.764 INFO:tasks.workunit.client.0.smithi060.stdout:4/830: unlink d6/d7/dd/d1a/dde/le8 0 2024-04-12T13:42:24.768 INFO:tasks.workunit.client.0.smithi060.stdout:5/876: creat d6/dd/d1f/dc6/f122 x:0 0 0 2024-04-12T13:42:24.769 INFO:tasks.workunit.client.1.smithi110.stdout:1/900: getdents de/d14/d34/d55/d6b/dc7 0 2024-04-12T13:42:24.777 INFO:tasks.workunit.client.1.smithi110.stdout:8/935: unlink d1/d7/d20/f5f 0 2024-04-12T13:42:24.777 INFO:tasks.workunit.client.1.smithi110.stdout:1/901: write de/d14/d34/d55/d6b/f7c [5153358,74294] 0 2024-04-12T13:42:24.787 INFO:tasks.workunit.client.1.smithi110.stdout:1/902: readlink de/d15/d32/d61/d6a/lce 0 2024-04-12T13:42:24.791 INFO:tasks.workunit.client.0.smithi060.stdout:3/886: symlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/l11f 0 2024-04-12T13:42:24.797 INFO:tasks.workunit.client.1.smithi110.stdout:8/936: truncate d1/d3/d35/d3a/d41/d77/f78 5024175 0 2024-04-12T13:42:24.802 INFO:tasks.workunit.client.0.smithi060.stdout:3/887: fdatasync d7/d17/d19/f48 0 2024-04-12T13:42:24.806 INFO:tasks.workunit.client.1.smithi110.stdout:8/937: readlink d1/d3/d35/l40 0 2024-04-12T13:42:24.811 INFO:tasks.workunit.client.1.smithi110.stdout:1/903: rename de/d15/d32/d5e/lca to de/d15/dab/dd8/dd9/dda/l130 0 2024-04-12T13:42:24.816 INFO:tasks.workunit.client.1.smithi110.stdout:8/938: rename d1/d5/d1f/fbb to d1/d45/f134 0 2024-04-12T13:42:24.820 INFO:tasks.workunit.client.0.smithi060.stdout:2/888: symlink d6/d64/d99/df0/daa/db0/l114 0 2024-04-12T13:42:24.823 INFO:tasks.workunit.client.1.smithi110.stdout:1/904: mkdir de/d15/d32/d61/d6a/d131 0 2024-04-12T13:42:24.825 INFO:tasks.workunit.client.1.smithi110.stdout:8/939: creat d1/d3/d35/d43/d9f/dd5/f135 x:0 0 0 2024-04-12T13:42:24.829 INFO:tasks.workunit.client.1.smithi110.stdout:1/905: readlink de/d14/d83/lbb 0 2024-04-12T13:42:24.832 INFO:tasks.workunit.client.1.smithi110.stdout:1/906: dread - de/d15/d32/f121 zero size 2024-04-12T13:42:24.836 INFO:tasks.workunit.client.1.smithi110.stdout:1/907: write de/f12d [417464,96803] 0 2024-04-12T13:42:24.843 INFO:tasks.workunit.client.1.smithi110.stdout:1/908: write de/d14/d34/d87/f129 [681379,46397] 0 2024-04-12T13:42:24.853 INFO:tasks.workunit.client.1.smithi110.stdout:1/909: mknod de/d14/d83/c132 0 2024-04-12T13:42:24.861 INFO:tasks.workunit.client.0.smithi060.stdout:5/877: unlink d6/dd/d1f/d25/d42/d52/f75 0 2024-04-12T13:42:24.869 INFO:tasks.workunit.client.0.smithi060.stdout:5/878: mknod d6/dd/d1f/d25/d53/d87/d7e/dca/c123 0 2024-04-12T13:42:24.872 INFO:tasks.workunit.client.0.smithi060.stdout:7/856: rename d0/d3d/c4e to d0/d3d/d74/c112 0 2024-04-12T13:42:24.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/857: creat d0/df3/f113 x:0 0 0 2024-04-12T13:42:24.880 INFO:tasks.workunit.client.0.smithi060.stdout:8/837: creat d9/d1b/d37/d4d/d63/d66/db3/f124 x:0 0 0 2024-04-12T13:42:24.882 INFO:tasks.workunit.client.0.smithi060.stdout:7/858: mknod d0/d7/d43/d4d/dde/c114 0 2024-04-12T13:42:24.886 INFO:tasks.workunit.client.0.smithi060.stdout:8/838: creat d9/d1b/d37/d4d/d63/d66/db3/da4/f125 x:0 0 0 2024-04-12T13:42:24.893 INFO:tasks.workunit.client.0.smithi060.stdout:8/839: creat d9/d1b/d37/d4d/d63/d66/dd9/f126 x:0 0 0 2024-04-12T13:42:24.903 INFO:tasks.workunit.client.1.smithi110.stdout:2/970: write d6/dc/d13/f7b [427563,81119] 0 2024-04-12T13:42:24.905 INFO:tasks.workunit.client.0.smithi060.stdout:5/879: dread d6/d10/db8/dee/dfc/d46/fb4 [0,4194304] 0 2024-04-12T13:42:24.908 INFO:tasks.workunit.client.0.smithi060.stdout:8/840: rename d9/d1b/d84/da0/d114/l123 to d9/d1b/d37/d4d/d63/d66/l127 0 2024-04-12T13:42:24.929 INFO:tasks.workunit.client.1.smithi110.stdout:6/907: write d7/d25/d2c/d4c/d77/d93/fd4 [1594518,102948] 0 2024-04-12T13:42:24.930 INFO:tasks.workunit.client.0.smithi060.stdout:5/880: dread d6/dd/d1f/d25/d53/fd9 [0,4194304] 0 2024-04-12T13:42:24.934 INFO:tasks.workunit.client.0.smithi060.stdout:5/881: read d6/d10/db8/dee/dfc/d46/f93 [253693,30348] 0 2024-04-12T13:42:24.936 INFO:tasks.workunit.client.1.smithi110.stdout:5/885: write da/d2e/d45/d25/d9d/d7a/db5/d8f/f7b [7617698,40244] 0 2024-04-12T13:42:24.942 INFO:tasks.workunit.client.1.smithi110.stdout:5/886: chown da/d2e/d45/d25/d9d/d79/d88/d121 209344063 1 2024-04-12T13:42:24.945 INFO:tasks.workunit.client.0.smithi060.stdout:5/882: fdatasync d6/fa0 0 2024-04-12T13:42:24.966 INFO:tasks.workunit.client.1.smithi110.stdout:7/948: write d1/d1b/d3d/f63 [1170002,126067] 0 2024-04-12T13:42:24.979 INFO:tasks.workunit.client.1.smithi110.stdout:6/908: truncate d7/d10/d1c/d2b/fe8 473072 0 2024-04-12T13:42:24.981 INFO:tasks.workunit.client.1.smithi110.stdout:5/887: fsync da/d2e/d45/d25/d9d/d79/d88/dd3/fd8 0 2024-04-12T13:42:24.985 INFO:tasks.workunit.client.0.smithi060.stdout:9/808: dwrite d4/d9/d19/d8c/fda [0,4194304] 0 2024-04-12T13:42:24.991 INFO:tasks.workunit.client.1.smithi110.stdout:7/949: unlink d1/d3/d4/d55/l6c 0 2024-04-12T13:42:24.993 INFO:tasks.workunit.client.1.smithi110.stdout:6/909: symlink d7/d25/d2c/d4c/d77/d93/l11a 0 2024-04-12T13:42:24.998 INFO:tasks.workunit.client.1.smithi110.stdout:7/950: write d1/d31/d5d/d127/f11c [48457,7032] 0 2024-04-12T13:42:25.004 INFO:tasks.workunit.client.1.smithi110.stdout:0/855: write d1/d8/d36/d65/fdc [169054,112170] 0 2024-04-12T13:42:25.006 INFO:tasks.workunit.client.0.smithi060.stdout:4/831: write d6/f8f [7610450,33146] 0 2024-04-12T13:42:25.008 INFO:tasks.workunit.client.1.smithi110.stdout:0/856: stat d1/d5e/fd1 0 2024-04-12T13:42:25.012 INFO:tasks.workunit.client.0.smithi060.stdout:0/819: dwrite d7/d9/d14/d35/d44/d7d/f2a [0,4194304] 0 2024-04-12T13:42:25.013 INFO:tasks.workunit.client.1.smithi110.stdout:7/951: chown d1/f1e 3787067 1 2024-04-12T13:42:25.017 INFO:tasks.workunit.client.1.smithi110.stdout:6/910: creat d7/d25/d30/dcf/dc3/dfc/f11b x:0 0 0 2024-04-12T13:42:25.017 INFO:tasks.workunit.client.0.smithi060.stdout:0/820: chown d7/d9/d14/d35/d44/d7d/f2a 8063 1 2024-04-12T13:42:25.020 INFO:tasks.workunit.client.0.smithi060.stdout:3/888: write d7/d17/f72 [224509,35253] 0 2024-04-12T13:42:25.022 INFO:tasks.workunit.client.0.smithi060.stdout:0/821: truncate d7/d33/d5b/fec 221614 0 2024-04-12T13:42:25.022 INFO:tasks.workunit.client.1.smithi110.stdout:0/857: symlink d1/d8/d8a/dc8/l134 0 2024-04-12T13:42:25.022 INFO:tasks.workunit.client.1.smithi110.stdout:3/912: dwrite d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:25.025 INFO:tasks.workunit.client.0.smithi060.stdout:3/889: chown d7/d17/d19/dc9/d3f/d5c/l11d 13858463 1 2024-04-12T13:42:25.026 INFO:tasks.workunit.client.0.smithi060.stdout:3/890: dread - d7/d17/fe3 zero size 2024-04-12T13:42:25.027 INFO:tasks.workunit.client.1.smithi110.stdout:3/913: chown d5/dc/d20/d2d/d4e/f66 29214 1 2024-04-12T13:42:25.032 INFO:tasks.workunit.client.1.smithi110.stdout:0/858: write d1/d56/f114 [88333,60780] 0 2024-04-12T13:42:25.034 INFO:tasks.workunit.client.1.smithi110.stdout:3/914: truncate d5/dc/d31/d3b/d32/d3e/d5f/f106 130563 0 2024-04-12T13:42:25.037 INFO:tasks.workunit.client.0.smithi060.stdout:3/891: rmdir d7/d17/d27/d36/d53/da2/dbc 39 2024-04-12T13:42:25.047 INFO:tasks.workunit.client.0.smithi060.stdout:2/889: dwrite d6/dae/d31/d33/f6a [0,4194304] 0 2024-04-12T13:42:25.047 INFO:tasks.workunit.client.1.smithi110.stdout:6/911: dwrite d7/d25/d30/dcf/dc3/fb4 [4194304,4194304] 0 2024-04-12T13:42:25.052 INFO:tasks.workunit.client.1.smithi110.stdout:8/940: dwrite d1/d3/d35/d43/d9f/dd5/d11e/d85/d8d/f91 [0,4194304] 0 2024-04-12T13:42:25.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/890: creat d6/d64/d99/df0/daa/db0/def/f115 x:0 0 0 2024-04-12T13:42:25.062 INFO:tasks.workunit.client.1.smithi110.stdout:0/859: dwrite d1/d56/f114 [0,4194304] 0 2024-04-12T13:42:25.065 INFO:tasks.workunit.client.1.smithi110.stdout:3/915: dwrite d5/dc/d31/d3b/d32/d3e/d5f/f106 [0,4194304] 0 2024-04-12T13:42:25.066 INFO:tasks.workunit.client.1.smithi110.stdout:8/941: mknod d1/d3/d3c/d5a/d6f/d7e/c136 0 2024-04-12T13:42:25.071 INFO:tasks.workunit.client.1.smithi110.stdout:8/942: fsync d1/d3/d35/d3a/d84/fb6 0 2024-04-12T13:42:25.073 INFO:tasks.workunit.client.1.smithi110.stdout:5/888: rename da/d2e/f134 to da/d2e/d45/d25/d9d/d7a/db5/f135 0 2024-04-12T13:42:25.075 INFO:tasks.workunit.client.0.smithi060.stdout:2/891: dwrite d6/f10d [0,4194304] 0 2024-04-12T13:42:25.075 INFO:tasks.workunit.client.1.smithi110.stdout:1/910: dwrite de/d14/d34/d55/d6b/f10d [0,4194304] 0 2024-04-12T13:42:25.079 INFO:tasks.workunit.client.1.smithi110.stdout:5/889: write da/d2e/d45/d25/d9d/d79/d88/d121/f124 [464843,45533] 0 2024-04-12T13:42:25.080 INFO:tasks.workunit.client.1.smithi110.stdout:0/860: creat d1/d8/d8a/f135 x:0 0 0 2024-04-12T13:42:25.087 INFO:tasks.workunit.client.0.smithi060.stdout:2/892: dread d6/d64/d99/df0/d2b/d60/fd2 [0,4194304] 0 2024-04-12T13:42:25.088 INFO:tasks.workunit.client.0.smithi060.stdout:8/841: dwrite d9/d1b/d84/fb9 [0,4194304] 0 2024-04-12T13:42:25.089 INFO:tasks.workunit.client.1.smithi110.stdout:7/952: rename d1/d3/d4/dbf/db6/fc8 to d1/d3/d4/d55/d82/db5/f13a 0 2024-04-12T13:42:25.093 INFO:tasks.workunit.client.1.smithi110.stdout:8/943: mkdir d1/d5/d11f/d137 0 2024-04-12T13:42:25.093 INFO:tasks.workunit.client.0.smithi060.stdout:8/842: stat d9/d1b/d37/d4d/d63/d66/d111/c113 0 2024-04-12T13:42:25.101 INFO:tasks.workunit.client.1.smithi110.stdout:3/916: dwrite d5/dc/d20/d2d/db1/f112 [0,4194304] 0 2024-04-12T13:42:25.104 INFO:tasks.workunit.client.0.smithi060.stdout:8/843: symlink d9/d1b/d84/da0/d80/l128 0 2024-04-12T13:42:25.110 INFO:tasks.workunit.client.1.smithi110.stdout:5/890: mknod da/d2e/d45/d25/d9d/d79/d9e/c136 0 2024-04-12T13:42:25.114 INFO:tasks.workunit.client.0.smithi060.stdout:5/883: dwrite d6/dd/d1f/dd3/df3/d38/f66 [0,4194304] 0 2024-04-12T13:42:25.116 INFO:tasks.workunit.client.1.smithi110.stdout:5/891: fsync da/d2e/d45/d25/f5a 0 2024-04-12T13:42:25.117 INFO:tasks.workunit.client.1.smithi110.stdout:5/892: chown da/d2e/d45/d29/d32 44661 1 2024-04-12T13:42:25.123 INFO:tasks.workunit.client.1.smithi110.stdout:3/917: truncate d5/dc/d31/d3b/d32/d3e/d5f/f8b 2263805 0 2024-04-12T13:42:25.127 INFO:tasks.workunit.client.1.smithi110.stdout:1/911: dread de/d1d/d86/fa6 [0,4194304] 0 2024-04-12T13:42:25.129 INFO:tasks.workunit.client.1.smithi110.stdout:1/912: write de/d14/d34/d55/d6b/f10d [4594809,14308] 0 2024-04-12T13:42:25.130 INFO:tasks.workunit.client.1.smithi110.stdout:5/893: creat da/d2e/d45/d29/d105/dea/f137 x:0 0 0 2024-04-12T13:42:25.132 INFO:tasks.workunit.client.0.smithi060.stdout:5/884: write d6/d10/db8/dee/dfc/d46/f82 [4372734,19766] 0 2024-04-12T13:42:25.135 INFO:tasks.workunit.client.1.smithi110.stdout:3/918: readlink d5/dc/d31/d74/d75/da7/dad/lae 0 2024-04-12T13:42:25.136 INFO:tasks.workunit.client.1.smithi110.stdout:8/944: getdents d1/d3/d3c/d75/d79 0 2024-04-12T13:42:25.141 INFO:tasks.workunit.client.1.smithi110.stdout:1/913: chown de/d15/d32/fb2 39859587 1 2024-04-12T13:42:25.142 INFO:tasks.workunit.client.1.smithi110.stdout:1/914: chown de/d1d/d86/fa8 84556038 1 2024-04-12T13:42:25.142 INFO:tasks.workunit.client.0.smithi060.stdout:5/885: truncate d6/dd/d1f/d25/d53/d87/ffb 878637 0 2024-04-12T13:42:25.143 INFO:tasks.workunit.client.1.smithi110.stdout:2/971: write d6/dc/dd/d49/d64/d4a/dc1/dd0/fd2 [927511,105531] 0 2024-04-12T13:42:25.144 INFO:tasks.workunit.client.1.smithi110.stdout:5/894: symlink da/d2e/d45/d25/d9d/d79/d88/d121/l138 0 2024-04-12T13:42:25.144 INFO:tasks.workunit.client.1.smithi110.stdout:1/915: write de/d14/d34/db4/f11d [602632,91531] 0 2024-04-12T13:42:25.147 INFO:tasks.workunit.client.0.smithi060.stdout:4/832: write d6/d7/dd/d1a/d19/d7a/da8/fba [209703,4527] 0 2024-04-12T13:42:25.149 INFO:tasks.workunit.client.0.smithi060.stdout:4/833: dread - d6/d2f/ffd zero size 2024-04-12T13:42:25.153 INFO:tasks.workunit.client.1.smithi110.stdout:1/916: fsync f6 0 2024-04-12T13:42:25.153 INFO:tasks.workunit.client.1.smithi110.stdout:8/945: dwrite d1/d3/d35/d3a/d84/d101/f11d [0,4194304] 0 2024-04-12T13:42:25.153 INFO:tasks.workunit.client.0.smithi060.stdout:9/809: dwrite d4/d8/df1/d67/f2b [4194304,4194304] 0 2024-04-12T13:42:25.154 INFO:tasks.workunit.client.0.smithi060.stdout:5/886: symlink d6/dd/d1f/dd3/d5f/l124 0 2024-04-12T13:42:25.154 INFO:tasks.workunit.client.1.smithi110.stdout:8/946: readlink d1/d45/l67 0 2024-04-12T13:42:25.159 INFO:tasks.workunit.client.0.smithi060.stdout:5/887: write d6/dd/d27/d7d/f118 [151180,27851] 0 2024-04-12T13:42:25.169 INFO:tasks.workunit.client.1.smithi110.stdout:6/912: dwrite d7/d25/d2c/d4c/d77/f96 [0,4194304] 0 2024-04-12T13:42:25.172 INFO:tasks.workunit.client.0.smithi060.stdout:0/822: dwrite d7/d9/de/d80/d8b/fc9 [0,4194304] 0 2024-04-12T13:42:25.173 INFO:tasks.workunit.client.0.smithi060.stdout:2/893: write d6/f2a [392436,73736] 0 2024-04-12T13:42:25.174 INFO:tasks.workunit.client.1.smithi110.stdout:0/861: dwrite d1/d3c/f5f [4194304,4194304] 0 2024-04-12T13:42:25.176 INFO:tasks.workunit.client.1.smithi110.stdout:6/913: dread d7/d25/d2c/f57 [0,4194304] 0 2024-04-12T13:42:25.176 INFO:tasks.workunit.client.1.smithi110.stdout:0/862: fsync d1/d3c/d6b/d90/f9a 0 2024-04-12T13:42:25.182 INFO:tasks.workunit.client.1.smithi110.stdout:8/947: rename d1/d3/d35/d3a/d41/c10e to d1/d3/d35/d3a/d41/d77/c138 0 2024-04-12T13:42:25.183 INFO:tasks.workunit.client.1.smithi110.stdout:1/917: dread de/d14/d34/d55/d6b/dc7/fdd [0,4194304] 0 2024-04-12T13:42:25.183 INFO:tasks.workunit.client.1.smithi110.stdout:7/953: write d1/d31/f59 [3917609,44369] 0 2024-04-12T13:42:25.186 INFO:tasks.workunit.client.1.smithi110.stdout:7/954: chown d1/d3/d4/d36 3 1 2024-04-12T13:42:25.187 INFO:tasks.workunit.client.1.smithi110.stdout:1/918: chown de/d15/d32/d5e/c60 353369 1 2024-04-12T13:42:25.191 INFO:tasks.workunit.client.1.smithi110.stdout:7/955: chown d1/d31/d5d/fb3 64349 1 2024-04-12T13:42:25.196 INFO:tasks.workunit.client.0.smithi060.stdout:8/844: dwrite d9/d1b/d84/da0/d80/d109/f96 [0,4194304] 0 2024-04-12T13:42:25.197 INFO:tasks.workunit.client.1.smithi110.stdout:6/914: mkdir d7/da4/d11c 0 2024-04-12T13:42:25.203 INFO:tasks.workunit.client.0.smithi060.stdout:8/845: chown d9/d1d/c26 10856351 1 2024-04-12T13:42:25.206 INFO:tasks.workunit.client.1.smithi110.stdout:2/972: rename d6/dc/db1/fe5 to d6/dc/dd/d49/d64/d4a/d51/f12c 0 2024-04-12T13:42:25.207 INFO:tasks.workunit.client.1.smithi110.stdout:5/895: write da/d2e/d45/d29/f2d [2820255,2720] 0 2024-04-12T13:42:25.209 INFO:tasks.workunit.client.1.smithi110.stdout:8/948: rmdir d1/d3/d35/d43/d9f/dd5/d11e/d85/dc2 39 2024-04-12T13:42:25.212 INFO:tasks.workunit.client.1.smithi110.stdout:8/949: chown d1/d3/d3c/d75/d79/l88 263001588 1 2024-04-12T13:42:25.218 INFO:tasks.workunit.client.1.smithi110.stdout:0/863: dread d1/d5e/f95 [0,4194304] 0 2024-04-12T13:42:25.220 INFO:tasks.workunit.client.0.smithi060.stdout:8/846: dwrite d9/d1b/d2b/fe0 [4194304,4194304] 0 2024-04-12T13:42:25.224 INFO:tasks.workunit.client.0.smithi060.stdout:8/847: chown d9/d1b/d37/d4d/d63/d66/dd9/f126 32 1 2024-04-12T13:42:25.226 INFO:tasks.workunit.client.1.smithi110.stdout:2/973: rename d6/dc/dd/d49/d64/d5d/db9/f110 to d6/dc/d13/dec/f12d 0 2024-04-12T13:42:25.228 INFO:tasks.workunit.client.1.smithi110.stdout:8/950: creat d1/d3/d3c/d5a/dab/f139 x:0 0 0 2024-04-12T13:42:25.229 INFO:tasks.workunit.client.0.smithi060.stdout:6/903: sync 2024-04-12T13:42:25.229 INFO:tasks.workunit.client.1.smithi110.stdout:2/974: chown d6/dc/d13/dec/fb7 12 1 2024-04-12T13:42:25.230 INFO:tasks.workunit.client.0.smithi060.stdout:6/904: readlink d1/d7/da/dc/d24/d30/d52/d5e/l76 0 2024-04-12T13:42:25.232 INFO:tasks.workunit.client.1.smithi110.stdout:8/951: write d1/d5/f117 [1116252,106037] 0 2024-04-12T13:42:25.232 INFO:tasks.workunit.client.1.smithi110.stdout:7/956: link d1/d3/d4/d36/d76/ff6 d1/d3/d4/d55/f13b 0 2024-04-12T13:42:25.234 INFO:tasks.workunit.client.1.smithi110.stdout:2/975: write d6/dc/d13/dec/f118 [625978,113352] 0 2024-04-12T13:42:25.245 INFO:tasks.workunit.client.1.smithi110.stdout:6/915: write d7/d25/d30/d44/f31 [3285825,82262] 0 2024-04-12T13:42:25.248 INFO:tasks.workunit.client.1.smithi110.stdout:8/952: rmdir d1/d3/d3c/d75 39 2024-04-12T13:42:25.251 INFO:tasks.workunit.client.1.smithi110.stdout:1/919: dwrite de/d15/d32/fb2 [0,4194304] 0 2024-04-12T13:42:25.251 INFO:tasks.workunit.client.1.smithi110.stdout:7/957: unlink d1/d3/d4/dbf/fb9 0 2024-04-12T13:42:25.253 INFO:tasks.workunit.client.1.smithi110.stdout:1/920: stat de/d14/d83/l85 0 2024-04-12T13:42:25.255 INFO:tasks.workunit.client.1.smithi110.stdout:5/896: dwrite da/d35/f41 [0,4194304] 0 2024-04-12T13:42:25.256 INFO:tasks.workunit.client.1.smithi110.stdout:0/864: mknod d1/d27/d31/d67/d10b/c136 0 2024-04-12T13:42:25.259 INFO:tasks.workunit.client.1.smithi110.stdout:2/976: mknod d6/dc/d1b/d57/d62/dcb/dd8/c12e 0 2024-04-12T13:42:25.268 INFO:tasks.workunit.client.1.smithi110.stdout:8/953: dwrite d1/d3/d35/d3a/d3e/f99 [0,4194304] 0 2024-04-12T13:42:25.280 INFO:tasks.workunit.client.1.smithi110.stdout:0/865: dread d1/d27/d31/f52 [0,4194304] 0 2024-04-12T13:42:25.282 INFO:tasks.workunit.client.1.smithi110.stdout:0/866: chown d1/d27/d31/d67 74926 1 2024-04-12T13:42:25.285 INFO:tasks.workunit.client.1.smithi110.stdout:8/954: creat d1/d3/d35/d3a/d3e/d4f/f13a x:0 0 0 2024-04-12T13:42:25.296 INFO:tasks.workunit.client.1.smithi110.stdout:0/867: symlink d1/d5e/l137 0 2024-04-12T13:42:25.298 INFO:tasks.workunit.client.1.smithi110.stdout:6/916: write d7/d25/d30/d44/d3d/fc8 [7195593,88871] 0 2024-04-12T13:42:25.299 INFO:tasks.workunit.client.1.smithi110.stdout:2/977: truncate d6/dc/f3f 200220 0 2024-04-12T13:42:25.300 INFO:tasks.workunit.client.1.smithi110.stdout:2/978: readlink d6/d53/l7e 0 2024-04-12T13:42:25.301 INFO:tasks.workunit.client.1.smithi110.stdout:6/917: truncate d7/d10/d1c/f10c 964092 0 2024-04-12T13:42:25.303 INFO:tasks.workunit.client.1.smithi110.stdout:8/955: write d1/d3/f121 [316801,65021] 0 2024-04-12T13:42:25.304 INFO:tasks.workunit.client.1.smithi110.stdout:7/958: rename d1/d3/d4/d36/da1 to d1/d1b/d13c 0 2024-04-12T13:42:25.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/892: sync 2024-04-12T13:42:25.305 INFO:tasks.workunit.client.0.smithi060.stdout:7/859: sync 2024-04-12T13:42:25.306 INFO:tasks.workunit.client.1.smithi110.stdout:1/921: write de/d14/d34/d55/d6b/f77 [1145836,74021] 0 2024-04-12T13:42:25.306 INFO:tasks.workunit.client.0.smithi060.stdout:5/888: symlink d6/dd/d1f/d25/d53/d87/d7e/dca/ded/l125 0 2024-04-12T13:42:25.307 INFO:tasks.workunit.client.1.smithi110.stdout:0/868: mkdir d1/d8/d8a/dc8/d138 0 2024-04-12T13:42:25.307 INFO:tasks.workunit.client.1.smithi110.stdout:7/959: chown d1/d3/d4/d55/d56/c64 930 1 2024-04-12T13:42:25.308 INFO:tasks.workunit.client.0.smithi060.stdout:4/834: mkdir d6/d7/dd/d109 0 2024-04-12T13:42:25.310 INFO:tasks.workunit.client.1.smithi110.stdout:8/956: readlink d1/d3/d35/d3a/d41/d77/lf2 0 2024-04-12T13:42:25.312 INFO:tasks.workunit.client.1.smithi110.stdout:8/957: chown d1/d3/d35 161 1 2024-04-12T13:42:25.312 INFO:tasks.workunit.client.1.smithi110.stdout:0/869: symlink d1/d3c/da6/l139 0 2024-04-12T13:42:25.316 INFO:tasks.workunit.client.1.smithi110.stdout:2/979: dread d6/dc/d1b/f2a [0,4194304] 0 2024-04-12T13:42:25.316 INFO:tasks.workunit.client.1.smithi110.stdout:6/918: mknod d7/d10/d1c/c11d 0 2024-04-12T13:42:25.320 INFO:tasks.workunit.client.0.smithi060.stdout:8/848: mknod d9/d1d/c129 0 2024-04-12T13:42:25.326 INFO:tasks.workunit.client.0.smithi060.stdout:7/860: mkdir d0/d7/da9/dc9/db1/d115 0 2024-04-12T13:42:25.329 INFO:tasks.workunit.client.1.smithi110.stdout:2/980: dread - d6/dc/dd/d49/d64/d4a/d3c/d50/dd5/f11f zero size 2024-04-12T13:42:25.331 INFO:tasks.workunit.client.1.smithi110.stdout:7/960: dread d1/d3/d4/d55/f77 [4194304,4194304] 0 2024-04-12T13:42:25.334 INFO:tasks.workunit.client.1.smithi110.stdout:8/958: creat d1/d3/d35/d3a/f13b x:0 0 0 2024-04-12T13:42:25.336 INFO:tasks.workunit.client.0.smithi060.stdout:2/894: dread f4 [0,4194304] 0 2024-04-12T13:42:25.339 INFO:tasks.workunit.client.1.smithi110.stdout:0/870: creat d1/d27/d31/d67/f13a x:0 0 0 2024-04-12T13:42:25.342 INFO:tasks.workunit.client.0.smithi060.stdout:4/835: dread d6/d7/dd/d1a/d19/d42/d7c/fb9 [0,4194304] 0 2024-04-12T13:42:25.349 INFO:tasks.workunit.client.0.smithi060.stdout:8/849: rmdir d9/d1b/d84/da0/d80/d109 39 2024-04-12T13:42:25.349 INFO:tasks.workunit.client.1.smithi110.stdout:6/919: dread d7/d25/d30/d6b/fad [0,4194304] 0 2024-04-12T13:42:25.352 INFO:tasks.workunit.client.0.smithi060.stdout:3/893: dread d7/d17/f28 [0,4194304] 0 2024-04-12T13:42:25.356 INFO:tasks.workunit.client.0.smithi060.stdout:3/894: chown d7/d17/d19/dc9/d3f/d5c/d25/c43 25020 1 2024-04-12T13:42:25.356 INFO:tasks.workunit.client.1.smithi110.stdout:3/919: sync 2024-04-12T13:42:25.356 INFO:tasks.workunit.client.1.smithi110.stdout:8/959: rename d1/d3/l4 to d1/d7/d20/l13c 0 2024-04-12T13:42:25.359 INFO:tasks.workunit.client.0.smithi060.stdout:9/810: getdents d4/d9/d19/d21 0 2024-04-12T13:42:25.360 INFO:tasks.workunit.client.1.smithi110.stdout:1/922: truncate de/d15/fed 730481 0 2024-04-12T13:42:25.362 INFO:tasks.workunit.client.0.smithi060.stdout:9/811: dread - d4/d8/df1/d67/f103 zero size 2024-04-12T13:42:25.362 INFO:tasks.workunit.client.0.smithi060.stdout:3/895: stat d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/cd2 0 2024-04-12T13:42:25.367 INFO:tasks.workunit.client.0.smithi060.stdout:4/836: fsync d6/d7/dd/d1a/d19/d42/f9c 0 2024-04-12T13:42:25.368 INFO:tasks.workunit.client.0.smithi060.stdout:5/889: write d6/dd/d1f/d25/d53/d87/f4f [1497093,126941] 0 2024-04-12T13:42:25.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/823: write d7/d9/d14/d35/d44/d49/dcf/dd0/dd6/f118 [942398,74307] 0 2024-04-12T13:42:25.375 INFO:tasks.workunit.client.0.smithi060.stdout:6/905: write d1/d7/da/dc/d24/d2d/db0/fb8 [905021,42737] 0 2024-04-12T13:42:25.377 INFO:tasks.workunit.client.0.smithi060.stdout:9/812: creat d4/d9/d19/d21/f111 x:0 0 0 2024-04-12T13:42:25.377 INFO:tasks.workunit.client.1.smithi110.stdout:3/920: mknod d5/dc/d31/d3b/d5b/df5/c11b 0 2024-04-12T13:42:25.378 INFO:tasks.workunit.client.1.smithi110.stdout:2/981: write d6/dc/dd/d49/d64/d5d/f71 [4463528,101932] 0 2024-04-12T13:42:25.379 INFO:tasks.workunit.client.0.smithi060.stdout:2/895: link d6/f10d d6/d64/d10f/f116 0 2024-04-12T13:42:25.382 INFO:tasks.workunit.client.0.smithi060.stdout:3/896: truncate d7/d17/d27/fc7 1280929 0 2024-04-12T13:42:25.387 INFO:tasks.workunit.client.1.smithi110.stdout:8/960: write d1/d3/d35/d3a/d84/d9e/fed [761420,39210] 0 2024-04-12T13:42:25.388 INFO:tasks.workunit.client.1.smithi110.stdout:0/871: dread d1/d8/d36/d51/d60/f41 [0,4194304] 0 2024-04-12T13:42:25.388 INFO:tasks.workunit.client.0.smithi060.stdout:4/837: mkdir d6/d7/dd/d1a/d19/d7a/da8/d10a 0 2024-04-12T13:42:25.390 INFO:tasks.workunit.client.1.smithi110.stdout:7/961: dwrite d1/d3/d4/d55/f77 [8388608,4194304] 0 2024-04-12T13:42:25.390 INFO:tasks.workunit.client.1.smithi110.stdout:1/923: write de/d15/dab/dd8/ff9 [793186,128784] 0 2024-04-12T13:42:25.391 INFO:tasks.workunit.client.0.smithi060.stdout:7/861: dwrite d0/d7/f9d [0,4194304] 0 2024-04-12T13:42:25.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/824: creat d7/d9/d14/d35/d44/d7d/f11a x:0 0 0 2024-04-12T13:42:25.391 INFO:tasks.workunit.client.0.smithi060.stdout:7/862: chown d0/d1b 0 1 2024-04-12T13:42:25.393 INFO:tasks.workunit.client.1.smithi110.stdout:0/872: write d1/d3c/da6/fcd [2517966,10684] 0 2024-04-12T13:42:25.393 INFO:tasks.workunit.client.1.smithi110.stdout:8/961: chown d1/d3/d3c/d5a/c81 508517494 1 2024-04-12T13:42:25.394 INFO:tasks.workunit.client.0.smithi060.stdout:7/863: dread - d0/d7/d92/fc7 zero size 2024-04-12T13:42:25.395 INFO:tasks.workunit.client.0.smithi060.stdout:9/813: chown d4/d8/d7c/ca5 13456450 1 2024-04-12T13:42:25.396 INFO:tasks.workunit.client.1.smithi110.stdout:8/962: chown d1/f94 3816966 1 2024-04-12T13:42:25.396 INFO:tasks.workunit.client.1.smithi110.stdout:7/962: write d1/d3/d4/d55/fc0 [5035930,88079] 0 2024-04-12T13:42:25.396 INFO:tasks.workunit.client.1.smithi110.stdout:6/920: dwrite d7/d10/d1c/d2b/d3a/f81 [0,4194304] 0 2024-04-12T13:42:25.404 INFO:tasks.workunit.client.1.smithi110.stdout:8/963: truncate d1/d3/d35/d3a/d84/d9e/fed 1297846 0 2024-04-12T13:42:25.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/890: dwrite d6/dd/d1f/d25/f34 [4194304,4194304] 0 2024-04-12T13:42:25.411 INFO:tasks.workunit.client.1.smithi110.stdout:5/897: sync 2024-04-12T13:42:25.412 INFO:tasks.workunit.client.0.smithi060.stdout:5/891: dread - d6/d89/f10e zero size 2024-04-12T13:42:25.412 INFO:tasks.workunit.client.0.smithi060.stdout:3/897: unlink d7/d17/d19/f4e 0 2024-04-12T13:42:25.414 INFO:tasks.workunit.client.0.smithi060.stdout:4/838: chown d6/d2f/d51/c54 468 1 2024-04-12T13:42:25.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/825: truncate d7/f26 1610803 0 2024-04-12T13:42:25.422 INFO:tasks.workunit.client.1.smithi110.stdout:7/963: truncate d1/d3/ffd 2307823 0 2024-04-12T13:42:25.423 INFO:tasks.workunit.client.1.smithi110.stdout:6/921: creat d7/d25/d2c/d4c/d77/d93/f11e x:0 0 0 2024-04-12T13:42:25.425 INFO:tasks.workunit.client.1.smithi110.stdout:8/964: chown d1/d3/d3c/d75/f132 264264 1 2024-04-12T13:42:25.431 INFO:tasks.workunit.client.0.smithi060.stdout:3/898: unlink d7/d17/fe3 0 2024-04-12T13:42:25.433 INFO:tasks.workunit.client.0.smithi060.stdout:5/892: mknod d6/dd/d1f/d25/d53/d87/d7e/dca/c126 0 2024-04-12T13:42:25.435 INFO:tasks.workunit.client.0.smithi060.stdout:4/839: read - d6/d7/dd/d1a/d57/d63/d68/d94/fbf zero size 2024-04-12T13:42:25.437 INFO:tasks.workunit.client.1.smithi110.stdout:3/921: getdents d5/d86/df1 0 2024-04-12T13:42:25.439 INFO:tasks.workunit.client.1.smithi110.stdout:0/873: getdents d1/d8/d8a/dc8/d138 0 2024-04-12T13:42:25.445 INFO:tasks.workunit.client.1.smithi110.stdout:7/964: creat d1/d3/d118/f13d x:0 0 0 2024-04-12T13:42:25.453 INFO:tasks.workunit.client.1.smithi110.stdout:6/922: rename d7/d25/d30/d44/d3d/f76 to d7/d10/d7e/f11f 0 2024-04-12T13:42:25.456 INFO:tasks.workunit.client.0.smithi060.stdout:6/906: dwrite d1/d7/da/dc/d24/d30/d52/fa4 [0,4194304] 0 2024-04-12T13:42:25.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/893: rmdir d6/d10/de9 39 2024-04-12T13:42:25.461 INFO:tasks.workunit.client.0.smithi060.stdout:5/894: chown d6/dd/d1f/d25/d42/d52/dc8 0 1 2024-04-12T13:42:25.461 INFO:tasks.workunit.client.0.smithi060.stdout:2/896: truncate d6/d64/d99/df0/daa/ddf/ff3 272173 0 2024-04-12T13:42:25.462 INFO:tasks.workunit.client.1.smithi110.stdout:2/982: getdents d6/dc/d6f/da7 0 2024-04-12T13:42:25.463 INFO:tasks.workunit.client.1.smithi110.stdout:1/924: creat de/d15/d32/f133 x:0 0 0 2024-04-12T13:42:25.466 INFO:tasks.workunit.client.1.smithi110.stdout:2/983: chown d6/dc/dd/d49/d64/d4a/dc1/f119 77 1 2024-04-12T13:42:25.466 INFO:tasks.workunit.client.0.smithi060.stdout:7/864: link d0/d1b/da4/fff d0/f116 0 2024-04-12T13:42:25.467 INFO:tasks.workunit.client.1.smithi110.stdout:0/874: mkdir d1/d3c/d13b 0 2024-04-12T13:42:25.468 INFO:tasks.workunit.client.1.smithi110.stdout:2/984: fdatasync d6/dc/d13/f7b 0 2024-04-12T13:42:25.468 INFO:tasks.workunit.client.1.smithi110.stdout:6/923: dwrite d7/d10/d7e/d85/fc2 [0,4194304] 0 2024-04-12T13:42:25.471 INFO:tasks.workunit.client.1.smithi110.stdout:3/922: mkdir d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/d11c 0 2024-04-12T13:42:25.472 INFO:tasks.workunit.client.1.smithi110.stdout:5/898: write da/db/f37 [4807624,49253] 0 2024-04-12T13:42:25.472 INFO:tasks.workunit.client.1.smithi110.stdout:6/924: dread d7/fd5 [0,4194304] 0 2024-04-12T13:42:25.474 INFO:tasks.workunit.client.1.smithi110.stdout:3/923: dread - d5/dc/d31/d3b/d5b/f96 zero size 2024-04-12T13:42:25.474 INFO:tasks.workunit.client.1.smithi110.stdout:7/965: readlink d1/d1b/l3c 0 2024-04-12T13:42:25.475 INFO:tasks.workunit.client.1.smithi110.stdout:1/925: dread de/d15/dab/dd8/ff9 [0,4194304] 0 2024-04-12T13:42:25.479 INFO:tasks.workunit.client.1.smithi110.stdout:8/965: creat d1/d5/d11f/d137/f13d x:0 0 0 2024-04-12T13:42:25.490 INFO:tasks.workunit.client.1.smithi110.stdout:2/985: mknod d6/dc/dd/d49/d64/d5d/db9/c12f 0 2024-04-12T13:42:25.493 INFO:tasks.workunit.client.1.smithi110.stdout:6/925: rmdir d7/d25/d30/d44/d3d 39 2024-04-12T13:42:25.499 INFO:tasks.workunit.client.0.smithi060.stdout:6/907: mkdir d1/d7/da/dc/d24/d122 0 2024-04-12T13:42:25.500 INFO:tasks.workunit.client.1.smithi110.stdout:5/899: truncate da/d2e/d45/d29/f48 3318772 0 2024-04-12T13:42:25.502 INFO:tasks.workunit.client.0.smithi060.stdout:4/840: creat d6/d7/dd/d4d/f10b x:0 0 0 2024-04-12T13:42:25.507 INFO:tasks.workunit.client.1.smithi110.stdout:8/966: symlink d1/d3/d35/d43/d9f/dd5/d11e/d85/d8d/l13e 0 2024-04-12T13:42:25.509 INFO:tasks.workunit.client.1.smithi110.stdout:5/900: dread da/d2e/d45/faa [4194304,4194304] 0 2024-04-12T13:42:25.513 INFO:tasks.workunit.client.0.smithi060.stdout:0/826: link d7/l9c d7/d9/d14/d35/l11b 0 2024-04-12T13:42:25.518 INFO:tasks.workunit.client.0.smithi060.stdout:0/827: read d7/d9/de/d80/dc8/fe2 [1314993,13358] 0 2024-04-12T13:42:25.519 INFO:tasks.workunit.client.0.smithi060.stdout:9/814: link d4/d9/d19/d21/l38 d4/d33/d108/l112 0 2024-04-12T13:42:25.522 INFO:tasks.workunit.client.0.smithi060.stdout:6/908: fsync d1/d7/da/dc/ff5 0 2024-04-12T13:42:25.523 INFO:tasks.workunit.client.1.smithi110.stdout:0/875: dwrite d1/d8/f53 [0,4194304] 0 2024-04-12T13:42:25.524 INFO:tasks.workunit.client.0.smithi060.stdout:5/895: dwrite f1 [4194304,4194304] 0 2024-04-12T13:42:25.526 INFO:tasks.workunit.client.1.smithi110.stdout:0/876: dread - d1/d3c/da6/f123 zero size 2024-04-12T13:42:25.529 INFO:tasks.workunit.client.0.smithi060.stdout:4/841: mknod d6/d21/d88/c10c 0 2024-04-12T13:42:25.531 INFO:tasks.workunit.client.1.smithi110.stdout:1/926: link de/f12d de/d14/d34/d87/d105/d110/f134 0 2024-04-12T13:42:25.532 INFO:tasks.workunit.client.1.smithi110.stdout:3/924: dwrite d5/dc/d31/d74/ffd [4194304,4194304] 0 2024-04-12T13:42:25.533 INFO:tasks.workunit.client.0.smithi060.stdout:3/899: chown d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/l76 234742031 1 2024-04-12T13:42:25.534 INFO:tasks.workunit.client.1.smithi110.stdout:6/926: dread d7/d10/d1c/d7f/d116/f94 [0,4194304] 0 2024-04-12T13:42:25.535 INFO:tasks.workunit.client.1.smithi110.stdout:2/986: write d6/dc/d13/d80/d8d/dcc/d82/d84/f91 [414916,90394] 0 2024-04-12T13:42:25.537 INFO:tasks.workunit.client.0.smithi060.stdout:3/900: chown d7/d17/d19/f1f 819232733 1 2024-04-12T13:42:25.539 INFO:tasks.workunit.client.1.smithi110.stdout:8/967: rename d1/d3/d35/d3a/d41/c59 to d1/d3/d35/d3a/d3e/d4f/c13f 0 2024-04-12T13:42:25.540 INFO:tasks.workunit.client.0.smithi060.stdout:2/897: dwrite d6/d64/d99/df0/daa/db0/f4c [0,4194304] 0 2024-04-12T13:42:25.549 INFO:tasks.workunit.client.0.smithi060.stdout:0/828: fdatasync d7/d9/d14/d4a/f5f 0 2024-04-12T13:42:25.550 INFO:tasks.workunit.client.0.smithi060.stdout:4/842: symlink d6/d2f/l10d 0 2024-04-12T13:42:25.560 INFO:tasks.workunit.client.0.smithi060.stdout:5/896: mkdir d6/d127 0 2024-04-12T13:42:25.565 INFO:tasks.workunit.client.1.smithi110.stdout:0/877: creat d1/d8/d8a/dc8/d138/f13c x:0 0 0 2024-04-12T13:42:25.566 INFO:tasks.workunit.client.1.smithi110.stdout:5/901: write da/d2e/d45/d25/f10a [234409,30644] 0 2024-04-12T13:42:25.566 INFO:tasks.workunit.client.0.smithi060.stdout:6/909: symlink d1/d7/da/dc/d24/d30/d52/d5e/l123 0 2024-04-12T13:42:25.567 INFO:tasks.workunit.client.0.smithi060.stdout:9/815: write d4/fd [2571379,92185] 0 2024-04-12T13:42:25.572 INFO:tasks.workunit.client.0.smithi060.stdout:4/843: rmdir d6/d7/dd/d1a/dde 39 2024-04-12T13:42:25.572 INFO:tasks.workunit.client.1.smithi110.stdout:6/927: dwrite d7/d25/f87 [0,4194304] 0 2024-04-12T13:42:25.573 INFO:tasks.workunit.client.1.smithi110.stdout:0/878: symlink d1/d48/db2/d4a/l13d 0 2024-04-12T13:42:25.575 INFO:tasks.workunit.client.0.smithi060.stdout:2/898: dread d6/d64/d99/df0/d2b/d60/fd2 [0,4194304] 0 2024-04-12T13:42:25.576 INFO:tasks.workunit.client.0.smithi060.stdout:9/816: dread d4/d33/d65/fc9 [0,4194304] 0 2024-04-12T13:42:25.577 INFO:tasks.workunit.client.1.smithi110.stdout:0/879: dread - d1/d8/d36/d51/d60/f74 zero size 2024-04-12T13:42:25.577 INFO:tasks.workunit.client.0.smithi060.stdout:0/829: dread d7/d9/f1e [0,4194304] 0 2024-04-12T13:42:25.580 INFO:tasks.workunit.client.0.smithi060.stdout:0/830: chown d7/d41/f7f 12955677 1 2024-04-12T13:42:25.587 INFO:tasks.workunit.client.0.smithi060.stdout:6/910: rmdir d1/d7/da/dc/d24/d30/d52/d5e 39 2024-04-12T13:42:25.589 INFO:tasks.workunit.client.1.smithi110.stdout:6/928: read d7/d25/d2c/d4c/d77/d93/f95 [3766357,63752] 0 2024-04-12T13:42:25.589 INFO:tasks.workunit.client.0.smithi060.stdout:0/831: dread d7/d9/d14/f6f [0,4194304] 0 2024-04-12T13:42:25.590 INFO:tasks.workunit.client.1.smithi110.stdout:2/987: truncate d6/dc/dd/d49/d64/fca 1233127 0 2024-04-12T13:42:25.591 INFO:tasks.workunit.client.0.smithi060.stdout:3/901: mknod d7/d17/d27/d36/db0/dc4/ded/c120 0 2024-04-12T13:42:25.592 INFO:tasks.workunit.client.0.smithi060.stdout:6/911: readlink d1/d7/da/dc/d24/d30/d52/d78/d80/l92 0 2024-04-12T13:42:25.593 INFO:tasks.workunit.client.0.smithi060.stdout:4/844: mknod d6/d7/dd/d1a/d57/d63/df4/d85/c10e 0 2024-04-12T13:42:25.594 INFO:tasks.workunit.client.1.smithi110.stdout:3/925: dread d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/fd9 [0,4194304] 0 2024-04-12T13:42:25.595 INFO:tasks.workunit.client.0.smithi060.stdout:2/899: fdatasync d6/d56/d43/f65 0 2024-04-12T13:42:25.596 INFO:tasks.workunit.client.0.smithi060.stdout:9/817: truncate d4/d9/fb0 1278487 0 2024-04-12T13:42:25.596 INFO:tasks.workunit.client.0.smithi060.stdout:3/902: read d7/d17/d27/d36/f3c [2086669,39665] 0 2024-04-12T13:42:25.597 INFO:tasks.workunit.client.1.smithi110.stdout:8/968: dwrite d1/d3/d35/d43/d9f/dd5/d11e/ff3 [0,4194304] 0 2024-04-12T13:42:25.599 INFO:tasks.workunit.client.1.smithi110.stdout:6/929: unlink d7/d25/d2c/d4c/c84 0 2024-04-12T13:42:25.600 INFO:tasks.workunit.client.1.smithi110.stdout:0/880: dread d1/d8/d36/d51/d60/f2b [0,4194304] 0 2024-04-12T13:42:25.600 INFO:tasks.workunit.client.1.smithi110.stdout:3/926: write d5/dc/d20/d2d/d4e/d89/d8c/db6/f105 [445710,11328] 0 2024-04-12T13:42:25.600 INFO:tasks.workunit.client.1.smithi110.stdout:5/902: write da/d2e/d45/d25/d9d/fd7 [614471,6781] 0 2024-04-12T13:42:25.602 INFO:tasks.workunit.client.1.smithi110.stdout:2/988: rename d6/dc/db1/l11b to d6/dc/d13/d80/d8d/dc3/l130 0 2024-04-12T13:42:25.610 INFO:tasks.workunit.client.1.smithi110.stdout:7/966: sync 2024-04-12T13:42:25.612 INFO:tasks.workunit.client.0.smithi060.stdout:4/845: creat d6/d21/d29/f10f x:0 0 0 2024-04-12T13:42:25.615 INFO:tasks.workunit.client.0.smithi060.stdout:5/897: dread d6/dd/d1f/f98 [0,4194304] 0 2024-04-12T13:42:25.618 INFO:tasks.workunit.client.0.smithi060.stdout:5/898: read d6/dd/d1f/dd3/df3/d38/f66 [161085,115912] 0 2024-04-12T13:42:25.618 INFO:tasks.workunit.client.0.smithi060.stdout:3/903: mkdir d7/d17/d19/dc9/d3f/d5c/d25/d121 0 2024-04-12T13:42:25.624 INFO:tasks.workunit.client.0.smithi060.stdout:6/912: creat d1/d7/da/dc/d24/d34/d51/d97/da9/f124 x:0 0 0 2024-04-12T13:42:25.628 INFO:tasks.workunit.client.1.smithi110.stdout:1/927: sync 2024-04-12T13:42:25.629 INFO:tasks.workunit.client.0.smithi060.stdout:0/832: link d7/d9/d14/d35/d44/d7d/f2a d7/d9/d4c/d93/f11c 0 2024-04-12T13:42:25.630 INFO:tasks.workunit.client.1.smithi110.stdout:5/903: write da/d2e/d45/d25/d9d/d7a/db5/f111 [593773,83774] 0 2024-04-12T13:42:25.634 INFO:tasks.workunit.client.0.smithi060.stdout:4/846: rename d6/d7/dd/dee to d6/d7/dd/d1a/d19/d42/d110 0 2024-04-12T13:42:25.636 INFO:tasks.workunit.client.0.smithi060.stdout:4/847: readlink d6/d7/dd/d1a/d56/l79 0 2024-04-12T13:42:25.637 INFO:tasks.workunit.client.0.smithi060.stdout:3/904: truncate d7/d17/d27/d36/d53/da2/ff6 961318 0 2024-04-12T13:42:25.642 INFO:tasks.workunit.client.0.smithi060.stdout:5/899: truncate d6/d10/db8/dee/dfc/d46/f62 626205 0 2024-04-12T13:42:25.645 INFO:tasks.workunit.client.1.smithi110.stdout:2/989: dwrite d6/dc/d13/dec/fb7 [0,4194304] 0 2024-04-12T13:42:25.652 INFO:tasks.workunit.client.1.smithi110.stdout:1/928: dread de/d15/d32/f52 [0,4194304] 0 2024-04-12T13:42:25.652 INFO:tasks.workunit.client.1.smithi110.stdout:0/881: link d1/d8/d36/d51/d60/l55 d1/d56/l13e 0 2024-04-12T13:42:25.653 INFO:tasks.workunit.client.1.smithi110.stdout:3/927: dwrite d5/dc/d20/d2d/d4f/f10e [0,4194304] 0 2024-04-12T13:42:25.654 INFO:tasks.workunit.client.0.smithi060.stdout:4/848: creat d6/d7/dd/d4d/d69/f111 x:0 0 0 2024-04-12T13:42:25.659 INFO:tasks.workunit.client.1.smithi110.stdout:6/930: link d7/c97 d7/d10/d1c/d7f/d116/c120 0 2024-04-12T13:42:25.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/818: link d4/d8/df1/d67/c5a d4/d8/d7c/dee/c113 0 2024-04-12T13:42:25.660 INFO:tasks.workunit.client.0.smithi060.stdout:6/913: write d1/d7/da/dc/d24/d2d/db0/db2/fe9 [747255,117493] 0 2024-04-12T13:42:25.662 INFO:tasks.workunit.client.1.smithi110.stdout:8/969: getdents d1/d3/d35/d3a/d84/d9e 0 2024-04-12T13:42:25.663 INFO:tasks.workunit.client.0.smithi060.stdout:9/819: chown d4/d33/d65/d7a/fb3 102624 1 2024-04-12T13:42:25.670 INFO:tasks.workunit.client.1.smithi110.stdout:2/990: read d6/dc/f33 [47982,74427] 0 2024-04-12T13:42:25.672 INFO:tasks.workunit.client.0.smithi060.stdout:3/905: fsync d7/d17/d27/d36/db0/dd9/f110 0 2024-04-12T13:42:25.674 INFO:tasks.workunit.client.1.smithi110.stdout:0/882: fdatasync d1/d8/d36/d51/d60/f41 0 2024-04-12T13:42:25.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/820: unlink d4/c8a 0 2024-04-12T13:42:25.679 INFO:tasks.workunit.client.0.smithi060.stdout:0/833: dwrite d7/d9/f92 [0,4194304] 0 2024-04-12T13:42:25.680 INFO:tasks.workunit.client.0.smithi060.stdout:4/849: dwrite d6/d21/f53 [0,4194304] 0 2024-04-12T13:42:25.684 INFO:tasks.workunit.client.1.smithi110.stdout:7/967: getdents d1/d3/d4/d36/d76 0 2024-04-12T13:42:25.688 INFO:tasks.workunit.client.1.smithi110.stdout:8/970: fdatasync d1/d5/dd/d31/f3d 0 2024-04-12T13:42:25.689 INFO:tasks.workunit.client.0.smithi060.stdout:5/900: write d6/dd/d1f/dd3/de7/df8/f105 [1120052,20953] 0 2024-04-12T13:42:25.692 INFO:tasks.workunit.client.1.smithi110.stdout:5/904: write da/d35/f75 [4178709,76082] 0 2024-04-12T13:42:25.695 INFO:tasks.workunit.client.1.smithi110.stdout:1/929: fdatasync de/d7b/da1/f11b 0 2024-04-12T13:42:25.701 INFO:tasks.workunit.client.0.smithi060.stdout:3/906: symlink d7/d17/d27/d36/d53/da2/d10e/l122 0 2024-04-12T13:42:25.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/914: dwrite d1/d7/da/dc/d24/d30/d52/d5e/fbb [0,4194304] 0 2024-04-12T13:42:25.704 INFO:tasks.workunit.client.1.smithi110.stdout:3/928: mknod d5/d86/d118/c11d 0 2024-04-12T13:42:25.709 INFO:tasks.workunit.client.0.smithi060.stdout:9/821: dread d4/d33/d65/d7a/f105 [0,4194304] 0 2024-04-12T13:42:25.710 INFO:tasks.workunit.client.0.smithi060.stdout:4/850: mkdir d6/d7/dd/d1a/d112 0 2024-04-12T13:42:25.712 INFO:tasks.workunit.client.1.smithi110.stdout:8/971: dread d1/d3/d35/d3a/d84/fb6 [0,4194304] 0 2024-04-12T13:42:25.717 INFO:tasks.workunit.client.0.smithi060.stdout:6/915: mknod d1/d7/da/dc/d24/d30/dd8/c125 0 2024-04-12T13:42:25.718 INFO:tasks.workunit.client.1.smithi110.stdout:3/929: dread d5/d86/fb5 [0,4194304] 0 2024-04-12T13:42:25.718 INFO:tasks.workunit.client.0.smithi060.stdout:9/822: stat d4/d33/d65/d7a/fcc 0 2024-04-12T13:42:25.720 INFO:tasks.workunit.client.1.smithi110.stdout:0/883: symlink d1/d3c/d13b/l13f 0 2024-04-12T13:42:25.721 INFO:tasks.workunit.client.1.smithi110.stdout:0/884: dread - d1/d48/db2/d110/f11d zero size 2024-04-12T13:42:25.722 INFO:tasks.workunit.client.0.smithi060.stdout:4/851: fsync d6/d21/d88/fd6 0 2024-04-12T13:42:25.723 INFO:tasks.workunit.client.1.smithi110.stdout:6/931: creat d7/d10/d1c/d2b/d3a/f121 x:0 0 0 2024-04-12T13:42:25.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/907: rmdir d7/d17/d27/d36/db0/dc4/d11b 0 2024-04-12T13:42:25.725 INFO:tasks.workunit.client.1.smithi110.stdout:2/991: write d6/dc/dd/d49/d64/f5e [467682,98682] 0 2024-04-12T13:42:25.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/850: sync 2024-04-12T13:42:25.726 INFO:tasks.workunit.client.0.smithi060.stdout:7/865: sync 2024-04-12T13:42:25.727 INFO:tasks.workunit.client.0.smithi060.stdout:6/916: truncate d1/d2c/faa 38284 0 2024-04-12T13:42:25.728 INFO:tasks.workunit.client.0.smithi060.stdout:0/834: dread d7/d41/f7f [0,4194304] 0 2024-04-12T13:42:25.740 INFO:tasks.workunit.client.0.smithi060.stdout:9/823: rename d4/d9/d19/db1/lea to d4/d9/d19/d8c/l114 0 2024-04-12T13:42:25.741 INFO:tasks.workunit.client.1.smithi110.stdout:3/930: mknod d5/dc/d31/d3b/d32/d3e/d98/c11e 0 2024-04-12T13:42:25.743 INFO:tasks.workunit.client.1.smithi110.stdout:3/931: chown d5/dc/d31/d3b/c4c 24898 1 2024-04-12T13:42:25.745 INFO:tasks.workunit.client.0.smithi060.stdout:5/901: dwrite d6/dd/d1f/d25/d42/d52/dc8/f100 [0,4194304] 0 2024-04-12T13:42:25.746 INFO:tasks.workunit.client.1.smithi110.stdout:3/932: write d5/dc/d20/d2d/db1/f10d [521536,9866] 0 2024-04-12T13:42:25.748 INFO:tasks.workunit.client.1.smithi110.stdout:1/930: dread de/f64 [0,4194304] 0 2024-04-12T13:42:25.749 INFO:tasks.workunit.client.0.smithi060.stdout:3/908: write d7/f9f [575538,72661] 0 2024-04-12T13:42:25.754 INFO:tasks.workunit.client.1.smithi110.stdout:5/905: dread da/d2e/d45/d25/d9d/d79/d88/f95 [0,4194304] 0 2024-04-12T13:42:25.754 INFO:tasks.workunit.client.1.smithi110.stdout:7/968: creat d1/d3/d4/d55/d56/d72/f13e x:0 0 0 2024-04-12T13:42:25.755 INFO:tasks.workunit.client.0.smithi060.stdout:8/851: write d9/d1b/d37/d4d/d63/d66/fd6 [83510,44121] 0 2024-04-12T13:42:25.755 INFO:tasks.workunit.client.0.smithi060.stdout:0/835: mkdir d7/d9/d14/d35/d44/d49/dcf/d11d 0 2024-04-12T13:42:25.755 INFO:tasks.workunit.client.1.smithi110.stdout:8/972: unlink d1/d3/d3c/d5a/d6f/d83/c11c 0 2024-04-12T13:42:25.755 INFO:tasks.workunit.client.1.smithi110.stdout:5/906: chown da/d2e/d45/d25/d9d/d7a/db5/d89/cd1 50070 1 2024-04-12T13:42:25.756 INFO:tasks.workunit.client.0.smithi060.stdout:0/836: readlink d7/d9/d14/d35/d44/d7d/l9d 0 2024-04-12T13:42:25.758 INFO:tasks.workunit.client.1.smithi110.stdout:5/907: chown da/ff1 7280284 1 2024-04-12T13:42:25.759 INFO:tasks.workunit.client.1.smithi110.stdout:6/932: symlink d7/d25/l122 0 2024-04-12T13:42:25.760 INFO:tasks.workunit.client.1.smithi110.stdout:1/931: mknod de/d15/da9/c135 0 2024-04-12T13:42:25.760 INFO:tasks.workunit.client.1.smithi110.stdout:2/992: rename d6/dc/l34 to d6/dc/dd/d49/d64/d4a/d3c/d6e/d126/l131 0 2024-04-12T13:42:25.764 INFO:tasks.workunit.client.1.smithi110.stdout:0/885: creat d1/f140 x:0 0 0 2024-04-12T13:42:25.767 INFO:tasks.workunit.client.0.smithi060.stdout:3/909: truncate d7/f10 580809 0 2024-04-12T13:42:25.768 INFO:tasks.workunit.client.0.smithi060.stdout:8/852: rename d9/d1b/d84/c95 to d9/dc9/c12a 0 2024-04-12T13:42:25.771 INFO:tasks.workunit.client.0.smithi060.stdout:8/853: chown d9/d1b/d2b/d82/d8a/d116/d11a/c11b 1674405 1 2024-04-12T13:42:25.773 INFO:tasks.workunit.client.0.smithi060.stdout:7/866: creat d0/d7/d43/f117 x:0 0 0 2024-04-12T13:42:25.777 INFO:tasks.workunit.client.1.smithi110.stdout:1/932: creat de/d14/dd0/f136 x:0 0 0 2024-04-12T13:42:25.778 INFO:tasks.workunit.client.1.smithi110.stdout:7/969: write d1/f102 [221794,80542] 0 2024-04-12T13:42:25.779 INFO:tasks.workunit.client.0.smithi060.stdout:5/902: write d6/d10/db8/dee/dfc/f6f [4450903,26298] 0 2024-04-12T13:42:25.781 INFO:tasks.workunit.client.0.smithi060.stdout:9/824: dwrite d4/d9/d19/daf/d101/de8/d100/fac [0,4194304] 0 2024-04-12T13:42:25.784 INFO:tasks.workunit.client.1.smithi110.stdout:8/973: link d1/d3/d35/d3a/d84/d9e/fed d1/d3/d3c/d75/d79/f140 0 2024-04-12T13:42:25.786 INFO:tasks.workunit.client.1.smithi110.stdout:0/886: mknod d1/d8/d36/d51/d60/c141 0 2024-04-12T13:42:25.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/825: dread - d4/d9/ff2 zero size 2024-04-12T13:42:25.790 INFO:tasks.workunit.client.0.smithi060.stdout:6/917: dwrite d1/d7/da/dc/d24/d2d/f5a [0,4194304] 0 2024-04-12T13:42:25.793 INFO:tasks.workunit.client.0.smithi060.stdout:8/854: truncate d9/d1b/f70 48846 0 2024-04-12T13:42:25.794 INFO:tasks.workunit.client.0.smithi060.stdout:9/826: read d4/d8/f2e [236607,74977] 0 2024-04-12T13:42:25.796 INFO:tasks.workunit.client.0.smithi060.stdout:8/855: chown d9/d1b/d2b/caf 201498944 1 2024-04-12T13:42:25.799 INFO:tasks.workunit.client.0.smithi060.stdout:2/900: sync 2024-04-12T13:42:25.799 INFO:tasks.workunit.client.0.smithi060.stdout:7/867: creat d0/d7/da9/f118 x:0 0 0 2024-04-12T13:42:25.800 INFO:tasks.workunit.client.1.smithi110.stdout:6/933: dwrite d7/d10/d41/ff3 [0,4194304] 0 2024-04-12T13:42:25.801 INFO:tasks.workunit.client.1.smithi110.stdout:0/887: dread d1/d8/f3d [0,4194304] 0 2024-04-12T13:42:25.803 INFO:tasks.workunit.client.0.smithi060.stdout:0/837: fdatasync d7/d9/de/d80/f105 0 2024-04-12T13:42:25.807 INFO:tasks.workunit.client.1.smithi110.stdout:6/934: chown d7/d10/d1c/d2b/d48 1 1 2024-04-12T13:42:25.807 INFO:tasks.workunit.client.0.smithi060.stdout:4/852: link d6/d7/dd/d1a/d57/d63/d68/f6c d6/d7/dd/d1a/d57/d63/f113 0 2024-04-12T13:42:25.810 INFO:tasks.workunit.client.1.smithi110.stdout:7/970: truncate d1/d3/d4/da6/f111 216858 0 2024-04-12T13:42:25.812 INFO:tasks.workunit.client.0.smithi060.stdout:5/903: unlink d6/dd/d1f/d25/d53/cea 0 2024-04-12T13:42:25.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/853: truncate d6/d7/dd/d4d/f10b 118725 0 2024-04-12T13:42:25.814 INFO:tasks.workunit.client.1.smithi110.stdout:5/908: write da/d2e/d45/d29/d105/df4/d12f/f131 [2174761,47651] 0 2024-04-12T13:42:25.814 INFO:tasks.workunit.client.1.smithi110.stdout:3/933: getdents d5/dc/d31/d3b/d32/d3e/d5f 0 2024-04-12T13:42:25.815 INFO:tasks.workunit.client.0.smithi060.stdout:3/910: symlink d7/d17/d19/dc9/d3f/d5c/d103/l123 0 2024-04-12T13:42:25.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/904: fsync d6/dd/d1f/d25/d53/d87/f4f 0 2024-04-12T13:42:25.821 INFO:tasks.workunit.client.0.smithi060.stdout:8/856: rmdir d9/d1b/d2b/d82/d8a 39 2024-04-12T13:42:25.823 INFO:tasks.workunit.client.0.smithi060.stdout:7/868: mkdir d0/d7/d43/d4d/dde/d119 0 2024-04-12T13:42:25.824 INFO:tasks.workunit.client.1.smithi110.stdout:0/888: mknod d1/d3c/da6/c142 0 2024-04-12T13:42:25.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/827: dread d4/d8/d7c/f81 [0,4194304] 0 2024-04-12T13:42:25.826 INFO:tasks.workunit.client.1.smithi110.stdout:6/935: mkdir d7/d10/d7e/d85/d123 0 2024-04-12T13:42:25.827 INFO:tasks.workunit.client.0.smithi060.stdout:2/901: dread d6/d56/d86/fd4 [0,4194304] 0 2024-04-12T13:42:25.829 INFO:tasks.workunit.client.1.smithi110.stdout:7/971: rename d1/d31/d5d to d1/d3/d4/d55/d56/d72/de0/da7/d13f 0 2024-04-12T13:42:25.832 INFO:tasks.workunit.client.1.smithi110.stdout:5/909: creat da/d5c/f139 x:0 0 0 2024-04-12T13:42:25.834 INFO:tasks.workunit.client.1.smithi110.stdout:5/910: chown da/d2e/d45/d25/d9d/d79/d88/ced 14747758 1 2024-04-12T13:42:25.835 INFO:tasks.workunit.client.1.smithi110.stdout:3/934: unlink d5/dc/d31/d3b/d32/d3e/l83 0 2024-04-12T13:42:25.837 INFO:tasks.workunit.client.0.smithi060.stdout:3/911: creat d7/d17/d19/dc9/df3/f124 x:0 0 0 2024-04-12T13:42:25.840 INFO:tasks.workunit.client.0.smithi060.stdout:3/912: stat d7/d17/d27/d36/db0/lfc 0 2024-04-12T13:42:25.841 INFO:tasks.workunit.client.0.smithi060.stdout:6/918: dwrite d1/d7/da/dc/fcf [0,4194304] 0 2024-04-12T13:42:25.841 INFO:tasks.workunit.client.1.smithi110.stdout:1/933: link de/d14/d83/fe4 de/d7b/da1/f137 0 2024-04-12T13:42:25.844 INFO:tasks.workunit.client.0.smithi060.stdout:4/854: rename d6/d7/dd/d1a/d19/d42/cdc to d6/d2f/dbe/c114 0 2024-04-12T13:42:25.846 INFO:tasks.workunit.client.0.smithi060.stdout:4/855: write d6/d7/dd/d4d/f10b [601667,32108] 0 2024-04-12T13:42:25.848 INFO:tasks.workunit.client.0.smithi060.stdout:8/857: chown d9/cd 6723 1 2024-04-12T13:42:25.849 INFO:tasks.workunit.client.1.smithi110.stdout:0/889: truncate d1/d8/d36/d51/d60/f2b 653615 0 2024-04-12T13:42:25.851 INFO:tasks.workunit.client.0.smithi060.stdout:5/905: write d6/dd/feb [992382,49400] 0 2024-04-12T13:42:25.853 INFO:tasks.workunit.client.1.smithi110.stdout:7/972: mknod d1/d3/d4/dbf/c140 0 2024-04-12T13:42:25.854 INFO:tasks.workunit.client.1.smithi110.stdout:2/993: sync 2024-04-12T13:42:25.855 INFO:tasks.workunit.client.1.smithi110.stdout:5/911: creat da/d2e/d45/d25/d9d/d79/d82/f13a x:0 0 0 2024-04-12T13:42:25.856 INFO:tasks.workunit.client.0.smithi060.stdout:0/838: link d7/d9/d14/d35/d44/d49/d74/ff2 d7/d9/d14/d35/d44/d8c/d8d/de5/f11e 0 2024-04-12T13:42:25.858 INFO:tasks.workunit.client.1.smithi110.stdout:1/934: dwrite de/d15/d32/f133 [0,4194304] 0 2024-04-12T13:42:25.860 INFO:tasks.workunit.client.1.smithi110.stdout:1/935: chown de/d14/d34/d108/d10e/c116 96 1 2024-04-12T13:42:25.861 INFO:tasks.workunit.client.1.smithi110.stdout:8/974: link d1/d3/d3c/d5a/d6f/d7e/f8e d1/d3/dbe/dd1/f141 0 2024-04-12T13:42:25.861 INFO:tasks.workunit.client.1.smithi110.stdout:0/890: mknod d1/d27/d31/c143 0 2024-04-12T13:42:25.864 INFO:tasks.workunit.client.0.smithi060.stdout:3/913: fdatasync d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/fe0 0 2024-04-12T13:42:25.866 INFO:tasks.workunit.client.0.smithi060.stdout:3/914: chown d7/f8 70766 1 2024-04-12T13:42:25.869 INFO:tasks.workunit.client.1.smithi110.stdout:5/912: creat da/db/d3b/d40/f13b x:0 0 0 2024-04-12T13:42:25.872 INFO:tasks.workunit.client.0.smithi060.stdout:4/856: stat d6/d2f/d51/l98 0 2024-04-12T13:42:25.872 INFO:tasks.workunit.client.1.smithi110.stdout:5/913: fsync da/d2e/d45/d29/d105/dea/f137 0 2024-04-12T13:42:25.875 INFO:tasks.workunit.client.1.smithi110.stdout:6/936: creat d7/d10/d1c/d2b/d48/f124 x:0 0 0 2024-04-12T13:42:25.877 INFO:tasks.workunit.client.1.smithi110.stdout:6/937: fdatasync d7/d10/d1c/f10c 0 2024-04-12T13:42:25.879 INFO:tasks.workunit.client.1.smithi110.stdout:7/973: dwrite d1/d3/f6d [4194304,4194304] 0 2024-04-12T13:42:25.880 INFO:tasks.workunit.client.1.smithi110.stdout:1/936: creat de/d15/dab/dd8/dd9/dda/f138 x:0 0 0 2024-04-12T13:42:25.881 INFO:tasks.workunit.client.1.smithi110.stdout:6/938: write d7/d25/d30/f9b [516571,5500] 0 2024-04-12T13:42:25.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/828: mkdir d4/d33/d115 0 2024-04-12T13:42:25.885 INFO:tasks.workunit.client.0.smithi060.stdout:5/906: dread d6/dd/d1f/d25/d53/d87/ffb [0,4194304] 0 2024-04-12T13:42:25.885 INFO:tasks.workunit.client.1.smithi110.stdout:3/935: creat d5/dc/d31/d74/d75/da7/f11f x:0 0 0 2024-04-12T13:42:25.887 INFO:tasks.workunit.client.0.smithi060.stdout:2/902: getdents d6/d64/d99/df0/d4b/d106 0 2024-04-12T13:42:25.889 INFO:tasks.workunit.client.0.smithi060.stdout:9/829: dread d4/d8/f40 [0,4194304] 0 2024-04-12T13:42:25.890 INFO:tasks.workunit.client.1.smithi110.stdout:5/914: mknod da/db/d15/de9/c13c 0 2024-04-12T13:42:25.890 INFO:tasks.workunit.client.0.smithi060.stdout:2/903: chown d6/d64/d99/df0/d2b/fb7 6168319 1 2024-04-12T13:42:25.892 INFO:tasks.workunit.client.0.smithi060.stdout:9/830: chown d4/d33/lb6 1 1 2024-04-12T13:42:25.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/831: stat d4/d9/d19/d8c/d92/lc4 0 2024-04-12T13:42:25.895 INFO:tasks.workunit.client.0.smithi060.stdout:3/915: symlink d7/d17/d27/d36/d53/l125 0 2024-04-12T13:42:25.899 INFO:tasks.workunit.client.1.smithi110.stdout:8/975: creat d1/d3/d35/d43/d9f/dd5/df5/f142 x:0 0 0 2024-04-12T13:42:25.901 INFO:tasks.workunit.client.0.smithi060.stdout:4/857: dread - d6/d7/dd/d1a/d19/d42/d7c/fe6 zero size 2024-04-12T13:42:25.901 INFO:tasks.workunit.client.1.smithi110.stdout:6/939: dread - d7/d25/d30/d6b/dd7/fe6 zero size 2024-04-12T13:42:25.901 INFO:tasks.workunit.client.0.smithi060.stdout:5/907: dread - d6/dd/fd1 zero size 2024-04-12T13:42:25.903 INFO:tasks.workunit.client.1.smithi110.stdout:3/936: fsync d5/dc/d31/d3b/f9d 0 2024-04-12T13:42:25.903 INFO:tasks.workunit.client.1.smithi110.stdout:0/891: dread d1/fd9 [0,4194304] 0 2024-04-12T13:42:25.905 INFO:tasks.workunit.client.1.smithi110.stdout:5/915: symlink da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/l13d 0 2024-04-12T13:42:25.905 INFO:tasks.workunit.client.1.smithi110.stdout:2/994: dwrite d6/dc/d1b/f2a [0,4194304] 0 2024-04-12T13:42:25.907 INFO:tasks.workunit.client.1.smithi110.stdout:7/974: truncate d1/f2a 331694 0 2024-04-12T13:42:25.909 INFO:tasks.workunit.client.0.smithi060.stdout:8/858: dread d9/d1b/d84/da0/d80/d109/f86 [0,4194304] 0 2024-04-12T13:42:25.909 INFO:tasks.workunit.client.0.smithi060.stdout:2/904: mknod d6/d64/d99/df0/d16/c117 0 2024-04-12T13:42:25.910 INFO:tasks.workunit.client.1.smithi110.stdout:1/937: dread de/d15/dab/fc5 [0,4194304] 0 2024-04-12T13:42:25.910 INFO:tasks.workunit.client.0.smithi060.stdout:6/919: link d1/d7/da/dc/d24/d2d/db0/db2/fce d1/d7/da/dc/d24/d30/dd8/f126 0 2024-04-12T13:42:25.911 INFO:tasks.workunit.client.0.smithi060.stdout:2/905: chown d6/d64/d99/df0/d4b/f10b 209 1 2024-04-12T13:42:25.912 INFO:tasks.workunit.client.1.smithi110.stdout:8/976: read - d1/d3/d3c/d5a/dab/fd2 zero size 2024-04-12T13:42:25.917 INFO:tasks.workunit.client.0.smithi060.stdout:3/916: mknod d7/d17/d27/d36/d53/da2/d10e/c126 0 2024-04-12T13:42:25.919 INFO:tasks.workunit.client.0.smithi060.stdout:3/917: readlink d7/d17/d27/d36/d53/l111 0 2024-04-12T13:42:25.920 INFO:tasks.workunit.client.0.smithi060.stdout:7/869: getdents d0/d7/d43/d63/d6f 0 2024-04-12T13:42:25.921 INFO:tasks.workunit.client.0.smithi060.stdout:7/870: chown d0/c5d 491 1 2024-04-12T13:42:25.921 INFO:tasks.workunit.client.1.smithi110.stdout:3/937: rmdir d5/dc/d31/d74/d75 39 2024-04-12T13:42:25.922 INFO:tasks.workunit.client.0.smithi060.stdout:7/871: stat d0/f64 0 2024-04-12T13:42:25.923 INFO:tasks.workunit.client.0.smithi060.stdout:4/858: fsync d6/d2f/d7d/fb6 0 2024-04-12T13:42:25.925 INFO:tasks.workunit.client.1.smithi110.stdout:0/892: creat d1/d56/deb/f144 x:0 0 0 2024-04-12T13:42:25.925 INFO:tasks.workunit.client.0.smithi060.stdout:0/839: link d7/c2c d7/d9/d14/d4a/c11f 0 2024-04-12T13:42:25.926 INFO:tasks.workunit.client.1.smithi110.stdout:2/995: unlink d6/d53/l7e 0 2024-04-12T13:42:25.927 INFO:tasks.workunit.client.1.smithi110.stdout:0/893: write d1/d8/d36/d51/f68 [2306033,14178] 0 2024-04-12T13:42:25.927 INFO:tasks.workunit.client.0.smithi060.stdout:0/840: dread - d7/d9/de/d63/fe6 zero size 2024-04-12T13:42:25.930 INFO:tasks.workunit.client.0.smithi060.stdout:2/906: dwrite d6/d64/d99/df0/d4b/f10b [0,4194304] 0 2024-04-12T13:42:25.931 INFO:tasks.workunit.client.1.smithi110.stdout:7/975: rmdir d1/d3/d4/d55/d56/d72/de0/da7/d13f 39 2024-04-12T13:42:25.936 INFO:tasks.workunit.client.1.smithi110.stdout:7/976: dread d1/d3/d4/d36/d76/f8a [0,4194304] 0 2024-04-12T13:42:25.937 INFO:tasks.workunit.client.1.smithi110.stdout:1/938: dread de/d15/f3f [0,4194304] 0 2024-04-12T13:42:25.944 INFO:tasks.workunit.client.0.smithi060.stdout:7/872: rmdir d0/d7 39 2024-04-12T13:42:25.946 INFO:tasks.workunit.client.0.smithi060.stdout:9/832: write d4/d9/d19/d21/f31 [6456925,123543] 0 2024-04-12T13:42:25.948 INFO:tasks.workunit.client.0.smithi060.stdout:7/873: chown d0/d1b/f31 0 1 2024-04-12T13:42:25.949 INFO:tasks.workunit.client.0.smithi060.stdout:4/859: write d6/d7/f8c [5018329,65655] 0 2024-04-12T13:42:25.950 INFO:tasks.workunit.client.0.smithi060.stdout:0/841: creat d7/d9/de/d80/d8b/f120 x:0 0 0 2024-04-12T13:42:25.953 INFO:tasks.workunit.client.0.smithi060.stdout:8/859: symlink d9/d1b/d37/l12b 0 2024-04-12T13:42:25.953 INFO:tasks.workunit.client.0.smithi060.stdout:2/907: dread - d6/d56/d58/da0/f5f zero size 2024-04-12T13:42:25.958 INFO:tasks.workunit.client.0.smithi060.stdout:6/920: dwrite d1/d2c/f108 [0,4194304] 0 2024-04-12T13:42:25.959 INFO:tasks.workunit.client.1.smithi110.stdout:1/939: dread de/d14/d34/d55/d6b/f77 [0,4194304] 0 2024-04-12T13:42:25.961 INFO:tasks.workunit.client.0.smithi060.stdout:3/918: truncate d7/d17/d19/dc9/d3f/d5c/d103/fe4 3835978 0 2024-04-12T13:42:25.961 INFO:tasks.workunit.client.1.smithi110.stdout:1/940: chown de/d15/d32/d5e/c60 341573 1 2024-04-12T13:42:25.964 INFO:tasks.workunit.client.0.smithi060.stdout:3/919: dread - d7/d17/d19/dc9/df3/f124 zero size 2024-04-12T13:42:25.964 INFO:tasks.workunit.client.0.smithi060.stdout:5/908: link d6/dd/d1f/dd3/df3/d38/f86 d6/dd/d1f/dd3/df3/d4c/da8/f128 0 2024-04-12T13:42:25.966 INFO:tasks.workunit.client.0.smithi060.stdout:5/909: chown d6/dd/d1f/d25/d42/d6b 131 1 2024-04-12T13:42:25.967 INFO:tasks.workunit.client.0.smithi060.stdout:9/833: readlink d4/d9/d19/d21/dbb/lfb 0 2024-04-12T13:42:25.970 INFO:tasks.workunit.client.0.smithi060.stdout:8/860: creat d9/d1b/d37/d48/f12c x:0 0 0 2024-04-12T13:42:25.975 INFO:tasks.workunit.client.1.smithi110.stdout:1/941: dwrite de/d15/ffc [0,4194304] 0 2024-04-12T13:42:25.978 INFO:tasks.workunit.client.0.smithi060.stdout:2/908: truncate d6/d56/d43/f5e 107931 0 2024-04-12T13:42:25.978 INFO:tasks.workunit.client.0.smithi060.stdout:0/842: dread d7/d9/d14/d4a/f4f [0,4194304] 0 2024-04-12T13:42:25.980 INFO:tasks.workunit.client.0.smithi060.stdout:5/910: dread d6/dd/d27/d7d/f118 [0,4194304] 0 2024-04-12T13:42:25.980 INFO:tasks.workunit.client.0.smithi060.stdout:3/920: unlink d7/d17/d19/dc9/d3f/d5c/f54 0 2024-04-12T13:42:25.980 INFO:tasks.workunit.client.0.smithi060.stdout:9/834: fsync d4/d9/ff7 0 2024-04-12T13:42:25.981 INFO:tasks.workunit.client.0.smithi060.stdout:7/874: creat d0/d7/da9/dc9/db1/f11a x:0 0 0 2024-04-12T13:42:25.981 INFO:tasks.workunit.client.0.smithi060.stdout:2/909: read - d6/d64/d99/df0/d2b/f101 zero size 2024-04-12T13:42:25.989 INFO:tasks.workunit.client.0.smithi060.stdout:5/911: stat d6/dd/d1f/d25/d53/d87/cf0 0 2024-04-12T13:42:25.996 INFO:tasks.workunit.client.0.smithi060.stdout:4/860: truncate d6/d7/dd/d1a/d57/d63/d68/d76/f103 268987 0 2024-04-12T13:42:25.999 INFO:tasks.workunit.client.0.smithi060.stdout:9/835: write d4/d33/d65/d7a/f105 [3576980,88707] 0 2024-04-12T13:42:26.004 INFO:tasks.workunit.client.0.smithi060.stdout:2/910: rename d6/d64/d10f/f116 to d6/d56/d43/f118 0 2024-04-12T13:42:26.011 INFO:tasks.workunit.client.0.smithi060.stdout:3/921: mknod d7/d17/d19/dc9/c127 0 2024-04-12T13:42:26.020 INFO:tasks.workunit.client.0.smithi060.stdout:6/921: dwrite d1/d7/da/fbf [0,4194304] 0 2024-04-12T13:42:26.038 INFO:tasks.workunit.client.0.smithi060.stdout:7/875: rmdir d0/d7/d43/d4d/dde/d119 0 2024-04-12T13:42:26.039 INFO:tasks.workunit.client.0.smithi060.stdout:9/836: dwrite d4/d9/d19/d21/dbf/dce/ff6 [0,4194304] 0 2024-04-12T13:42:26.043 INFO:tasks.workunit.client.0.smithi060.stdout:5/912: write d6/dd/d1f/d25/d53/d87/ffb [515121,113971] 0 2024-04-12T13:42:26.044 INFO:tasks.workunit.client.0.smithi060.stdout:3/922: getdents d7/d17/d19/dc9/d3f/d5c/d25/d121 0 2024-04-12T13:42:26.049 INFO:tasks.workunit.client.1.smithi110.stdout:6/940: mkdir d7/d10/d1c/d2b/d48/d125 0 2024-04-12T13:42:26.063 INFO:tasks.workunit.client.1.smithi110.stdout:5/916: symlink da/d2e/d45/d25/d9d/l13e 0 2024-04-12T13:42:26.064 INFO:tasks.workunit.client.0.smithi060.stdout:9/837: dwrite d4/d9/d19/d21/f111 [0,4194304] 0 2024-04-12T13:42:26.064 INFO:tasks.workunit.client.0.smithi060.stdout:0/843: dwrite d7/d9/d14/d35/d44/d49/d67/f76 [0,4194304] 0 2024-04-12T13:42:26.068 INFO:tasks.workunit.client.1.smithi110.stdout:0/894: rename d1/d56/c10d to d1/d3c/dd8/df4/d10f/c145 0 2024-04-12T13:42:26.069 INFO:tasks.workunit.client.0.smithi060.stdout:9/838: stat d4/d8/d32/lab 0 2024-04-12T13:42:26.071 INFO:tasks.workunit.client.0.smithi060.stdout:4/861: dwrite d6/d2f/d51/f71 [0,4194304] 0 2024-04-12T13:42:26.074 INFO:tasks.workunit.client.1.smithi110.stdout:8/977: creat d1/d3/d35/d3a/d10d/f143 x:0 0 0 2024-04-12T13:42:26.075 INFO:tasks.workunit.client.0.smithi060.stdout:5/913: mknod d6/dd/d1f/d25/d53/d87/d7e/dca/ded/c129 0 2024-04-12T13:42:26.084 INFO:tasks.workunit.client.0.smithi060.stdout:7/876: truncate d0/d1b/f5b 5147005 0 2024-04-12T13:42:26.086 INFO:tasks.workunit.client.1.smithi110.stdout:3/938: write d5/dc/d20/d2d/d4f/f7b [3808791,50544] 0 2024-04-12T13:42:26.088 INFO:tasks.workunit.client.1.smithi110.stdout:6/941: dwrite d7/d25/d2c/d4c/d77/d93/f11e [0,4194304] 0 2024-04-12T13:42:26.090 INFO:tasks.workunit.client.1.smithi110.stdout:2/996: write d6/dc/dd/d49/f7d [1234703,30098] 0 2024-04-12T13:42:26.090 INFO:tasks.workunit.client.0.smithi060.stdout:9/839: rmdir d4/d9/d19/d21 39 2024-04-12T13:42:26.097 INFO:tasks.workunit.client.1.smithi110.stdout:1/942: write de/d15/dab/dd8/dd9/dda/fb9 [159817,14136] 0 2024-04-12T13:42:26.098 INFO:tasks.workunit.client.0.smithi060.stdout:6/922: dwrite d1/d2c/f70 [0,4194304] 0 2024-04-12T13:42:26.100 INFO:tasks.workunit.client.1.smithi110.stdout:5/917: fsync da/d2e/d45/d29/d58/f6d 0 2024-04-12T13:42:26.101 INFO:tasks.workunit.client.0.smithi060.stdout:7/877: truncate d0/d7/f6 2765472 0 2024-04-12T13:42:26.103 INFO:tasks.workunit.client.1.smithi110.stdout:1/943: read de/d7b/da1/f137 [1010683,74785] 0 2024-04-12T13:42:26.107 INFO:tasks.workunit.client.0.smithi060.stdout:3/923: dwrite d7/d17/d19/dc9/fa9 [0,4194304] 0 2024-04-12T13:42:26.108 INFO:tasks.workunit.client.0.smithi060.stdout:9/840: creat d4/d8/d7c/dee/f116 x:0 0 0 2024-04-12T13:42:26.109 INFO:tasks.workunit.client.1.smithi110.stdout:7/977: link d1/f120 d1/d3/d4/d55/d82/db5/f141 0 2024-04-12T13:42:26.111 INFO:tasks.workunit.client.0.smithi060.stdout:0/844: write d7/d9/d14/d35/d44/d49/d67/f86 [1129850,78036] 0 2024-04-12T13:42:26.117 INFO:tasks.workunit.client.0.smithi060.stdout:3/924: stat d7/d17/d27/d36/db0/fc1 0 2024-04-12T13:42:26.117 INFO:tasks.workunit.client.0.smithi060.stdout:5/914: creat d6/dd/d1f/dd3/df3/d4c/da8/f12a x:0 0 0 2024-04-12T13:42:26.118 INFO:tasks.workunit.client.0.smithi060.stdout:4/862: truncate d6/d7/dd/d1a/d56/d8d/fab 529569 0 2024-04-12T13:42:26.119 INFO:tasks.workunit.client.0.smithi060.stdout:6/923: symlink d1/d7/da/dbd/l127 0 2024-04-12T13:42:26.120 INFO:tasks.workunit.client.1.smithi110.stdout:3/939: chown d5/dc/d31/d74/d75/da7 82103 1 2024-04-12T13:42:26.122 INFO:tasks.workunit.client.0.smithi060.stdout:7/878: chown d0/d7/l80 1362398 1 2024-04-12T13:42:26.123 INFO:tasks.workunit.client.0.smithi060.stdout:4/863: write d6/d7/dd/d1a/d19/d7a/da8/fba [425154,1438] 0 2024-04-12T13:42:26.127 INFO:tasks.workunit.client.1.smithi110.stdout:8/978: write d1/d5/f4a [2521507,106323] 0 2024-04-12T13:42:26.128 INFO:tasks.workunit.client.0.smithi060.stdout:9/841: rmdir d4/d9/d19/d8c 39 2024-04-12T13:42:26.128 INFO:tasks.workunit.client.0.smithi060.stdout:4/864: chown d6/d7/dd/d1a/d19/d7a/f97 501103108 1 2024-04-12T13:42:26.131 INFO:tasks.workunit.client.0.smithi060.stdout:0/845: fsync d7/d9/d14/d35/d44/d49/d67/fe4 0 2024-04-12T13:42:26.136 INFO:tasks.workunit.client.1.smithi110.stdout:1/944: symlink de/d14/d34/d87/d9c/l139 0 2024-04-12T13:42:26.138 INFO:tasks.workunit.client.1.smithi110.stdout:7/978: rename d1/d3/d4/d55/d82/fd0 to d1/d3/d4/d55/d56/d10e/f142 0 2024-04-12T13:42:26.138 INFO:tasks.workunit.client.1.smithi110.stdout:6/942: dwrite d7/d10/d7e/fe3 [0,4194304] 0 2024-04-12T13:42:26.142 INFO:tasks.workunit.client.0.smithi060.stdout:7/879: mknod d0/d7/d43/d4d/c11b 0 2024-04-12T13:42:26.144 INFO:tasks.workunit.client.1.smithi110.stdout:8/979: creat d1/d3/dbe/dd1/f144 x:0 0 0 2024-04-12T13:42:26.145 INFO:tasks.workunit.client.1.smithi110.stdout:2/997: dwrite d6/dc/d13/d80/d8d/dcc/d82/fe1 [0,4194304] 0 2024-04-12T13:42:26.156 INFO:tasks.workunit.client.0.smithi060.stdout:9/842: dread d4/d9/fc [0,4194304] 0 2024-04-12T13:42:26.156 INFO:tasks.workunit.client.0.smithi060.stdout:3/925: dwrite d7/d17/f72 [0,4194304] 0 2024-04-12T13:42:26.158 INFO:tasks.workunit.client.1.smithi110.stdout:1/945: mknod de/d14/c13a 0 2024-04-12T13:42:26.161 INFO:tasks.workunit.client.0.smithi060.stdout:6/924: truncate d1/d7/da/dc/d24/d2d/db0/db2/fce 3956668 0 2024-04-12T13:42:26.161 INFO:tasks.workunit.client.1.smithi110.stdout:1/946: chown de/d14/d83/f104 88598085 1 2024-04-12T13:42:26.162 INFO:tasks.workunit.client.0.smithi060.stdout:7/880: rename d0/d7/d92/fc7 to d0/d7/d43/d63/d6f/f11c 0 2024-04-12T13:42:26.169 INFO:tasks.workunit.client.0.smithi060.stdout:6/925: fsync d1/d7/da/dc/d24/d2d/d10b/f11f 0 2024-04-12T13:42:26.169 INFO:tasks.workunit.client.1.smithi110.stdout:0/895: getdents d1/d8 0 2024-04-12T13:42:26.170 INFO:tasks.workunit.client.1.smithi110.stdout:7/979: dread d1/f2a [0,4194304] 0 2024-04-12T13:42:26.172 INFO:tasks.workunit.client.1.smithi110.stdout:7/980: fsync d1/d3/d4/d55/d56/f122 0 2024-04-12T13:42:26.172 INFO:tasks.workunit.client.0.smithi060.stdout:4/865: dread d6/f70 [0,4194304] 0 2024-04-12T13:42:26.174 INFO:tasks.workunit.client.1.smithi110.stdout:3/940: creat d5/d86/dca/f120 x:0 0 0 2024-04-12T13:42:26.175 INFO:tasks.workunit.client.0.smithi060.stdout:3/926: creat d7/d17/d27/d36/db0/dc4/de9/f128 x:0 0 0 2024-04-12T13:42:26.175 INFO:tasks.workunit.client.1.smithi110.stdout:7/981: chown d1/d3/d4/dbf/db6 131041 1 2024-04-12T13:42:26.175 INFO:tasks.workunit.client.1.smithi110.stdout:1/947: dread de/d14/d34/d55/f5c [4194304,4194304] 0 2024-04-12T13:42:26.176 INFO:tasks.workunit.client.1.smithi110.stdout:5/918: creat da/db/f13f x:0 0 0 2024-04-12T13:42:26.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:25 smithi060 ceph-mon[29097]: pgmap v37: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 238 MiB/s wr, 542 op/s 2024-04-12T13:42:26.179 INFO:tasks.workunit.client.1.smithi110.stdout:8/980: dread d1/d3/dbe/dd1/f141 [0,4194304] 0 2024-04-12T13:42:26.182 INFO:tasks.workunit.client.1.smithi110.stdout:0/896: chown d1/d8/d36/fa2 2435 1 2024-04-12T13:42:26.191 INFO:tasks.workunit.client.1.smithi110.stdout:5/919: rmdir da/d2e/d45/d25 39 2024-04-12T13:42:26.194 INFO:tasks.workunit.client.1.smithi110.stdout:1/948: write de/d14/d34/db4/f11f [936550,42927] 0 2024-04-12T13:42:26.194 INFO:tasks.workunit.client.1.smithi110.stdout:7/982: dread d1/d3/d4/d36/f3a [0,4194304] 0 2024-04-12T13:42:26.198 INFO:tasks.workunit.client.1.smithi110.stdout:0/897: truncate d1/fe3 725478 0 2024-04-12T13:42:26.201 INFO:tasks.workunit.client.0.smithi060.stdout:6/926: dread d1/d7/da/dc/d24/d30/dd8/fe2 [4194304,4194304] 0 2024-04-12T13:42:26.201 INFO:tasks.workunit.client.0.smithi060.stdout:9/843: dwrite d4/d33/d65/d7a/fc0 [0,4194304] 0 2024-04-12T13:42:26.203 INFO:tasks.workunit.client.1.smithi110.stdout:2/998: dwrite d6/dc/d1b/d57/d62/db4/fcd [0,4194304] 0 2024-04-12T13:42:26.207 INFO:tasks.workunit.client.1.smithi110.stdout:6/943: dwrite d7/d25/d30/d44/f1d [0,4194304] 0 2024-04-12T13:42:26.210 INFO:tasks.workunit.client.1.smithi110.stdout:3/941: write d5/dc/d20/d2d/fb0 [700661,89985] 0 2024-04-12T13:42:26.211 INFO:tasks.workunit.client.1.smithi110.stdout:7/983: symlink d1/d3/d4/d55/d56/d72/dad/d115/l143 0 2024-04-12T13:42:26.214 INFO:tasks.workunit.client.1.smithi110.stdout:1/949: rename de/d14/d34/d87/f129 to de/d15/dab/dd8/dd9/dda/f13b 0 2024-04-12T13:42:26.216 INFO:tasks.workunit.client.1.smithi110.stdout:2/999: read d6/dc/d13/dec/f118 [614201,96978] 0 2024-04-12T13:42:26.225 INFO:tasks.workunit.client.1.smithi110.stdout:5/920: creat da/d2e/d45/d25/d9d/d7a/db5/d89/f140 x:0 0 0 2024-04-12T13:42:26.227 INFO:tasks.workunit.client.1.smithi110.stdout:0/898: dread d1/d27/d31/f64 [0,4194304] 0 2024-04-12T13:42:26.227 INFO:tasks.workunit.client.1.smithi110.stdout:8/981: write d1/d5/d1f/f56 [2448308,12999] 0 2024-04-12T13:42:26.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:25 smithi110 ceph-mon[36055]: pgmap v37: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 238 MiB/s wr, 542 op/s 2024-04-12T13:42:26.230 INFO:tasks.workunit.client.1.smithi110.stdout:7/984: truncate d1/d3/d4/d36/d76/f8a 1034114 0 2024-04-12T13:42:26.233 INFO:tasks.workunit.client.1.smithi110.stdout:3/942: truncate d5/dc/d31/d3b/d32/fcc 3433169 0 2024-04-12T13:42:26.239 INFO:tasks.workunit.client.1.smithi110.stdout:6/944: rename d7/d10/l23 to d7/d25/d2c/d4c/l126 0 2024-04-12T13:42:26.241 INFO:tasks.workunit.client.1.smithi110.stdout:0/899: fsync d1/d8/d36/d51/d60/f41 0 2024-04-12T13:42:26.243 INFO:tasks.workunit.client.1.smithi110.stdout:8/982: stat d1/d3/d3c/d5a/lf4 0 2024-04-12T13:42:26.245 INFO:tasks.workunit.client.1.smithi110.stdout:7/985: rmdir d1/d3/d4/d55/d56/d72/de0 39 2024-04-12T13:42:26.246 INFO:tasks.workunit.client.1.smithi110.stdout:1/950: write de/d1d/f42 [2323614,58970] 0 2024-04-12T13:42:26.250 INFO:tasks.workunit.client.1.smithi110.stdout:5/921: rename da/d2e/d45/d25/d9d/d79/d82/f11b to da/d2e/d45/d29/d58/f141 0 2024-04-12T13:42:26.255 INFO:tasks.workunit.client.1.smithi110.stdout:0/900: dwrite d1/d8/d8a/dce/f11f [0,4194304] 0 2024-04-12T13:42:26.258 INFO:tasks.workunit.client.1.smithi110.stdout:3/943: mkdir d5/dc/d121 0 2024-04-12T13:42:26.260 INFO:tasks.workunit.client.1.smithi110.stdout:7/986: unlink d1/d3/d4/d36/d76/le9 0 2024-04-12T13:42:26.262 INFO:tasks.workunit.client.0.smithi060.stdout:7/881: mkdir d0/d3d/dcf/d11d 0 2024-04-12T13:42:26.267 INFO:tasks.workunit.client.1.smithi110.stdout:6/945: mkdir d7/d25/d2c/d4c/d77/d93/d112/d127 0 2024-04-12T13:42:26.268 INFO:tasks.workunit.client.1.smithi110.stdout:0/901: dread d1/f2f [0,4194304] 0 2024-04-12T13:42:26.270 INFO:tasks.workunit.client.0.smithi060.stdout:5/915: getdents d6/dd/d1f/dd3/de7/df8 0 2024-04-12T13:42:26.271 INFO:tasks.workunit.client.1.smithi110.stdout:5/922: symlink da/d2e/d45/d29/d32/l142 0 2024-04-12T13:42:26.272 INFO:tasks.workunit.client.0.smithi060.stdout:4/866: symlink d6/dd3/l115 0 2024-04-12T13:42:26.274 INFO:tasks.workunit.client.1.smithi110.stdout:8/983: mkdir d1/d3/d35/d43/d9f/dd5/d11e/d85/dc2/d145 0 2024-04-12T13:42:26.276 INFO:tasks.workunit.client.1.smithi110.stdout:3/944: creat d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/f122 x:0 0 0 2024-04-12T13:42:26.278 INFO:tasks.workunit.client.1.smithi110.stdout:7/987: dwrite d1/d3/d4/d55/d56/d72/f13e [0,4194304] 0 2024-04-12T13:42:26.279 INFO:tasks.workunit.client.1.smithi110.stdout:1/951: fsync de/d15/d32/f39 0 2024-04-12T13:42:26.281 INFO:tasks.workunit.client.1.smithi110.stdout:1/952: stat de/d15/d32/d61/d6a/d131 0 2024-04-12T13:42:26.287 INFO:tasks.workunit.client.1.smithi110.stdout:0/902: mknod d1/d8/d36/d51/c146 0 2024-04-12T13:42:26.287 INFO:tasks.workunit.client.0.smithi060.stdout:0/846: getdents d7/d9/d14/d35/d44/d7d 0 2024-04-12T13:42:26.288 INFO:tasks.workunit.client.1.smithi110.stdout:6/946: read d7/d10/d1c/d2b/d48/f70 [924557,51220] 0 2024-04-12T13:42:26.289 INFO:tasks.workunit.client.1.smithi110.stdout:6/947: stat d7 0 2024-04-12T13:42:26.292 INFO:tasks.workunit.client.0.smithi060.stdout:7/882: creat d0/d3d/dcf/d10b/f11e x:0 0 0 2024-04-12T13:42:26.296 INFO:tasks.workunit.client.0.smithi060.stdout:5/916: unlink d6/dd/d1f/d25/d42/d52/f5e 0 2024-04-12T13:42:26.297 INFO:tasks.workunit.client.1.smithi110.stdout:3/945: truncate d5/fa2 3264517 0 2024-04-12T13:42:26.298 INFO:tasks.workunit.client.0.smithi060.stdout:4/867: fsync d6/d21/f5d 0 2024-04-12T13:42:26.302 INFO:tasks.workunit.client.1.smithi110.stdout:1/953: rename de/d14/dd0/f136 to de/d7b/f13c 0 2024-04-12T13:42:26.302 INFO:tasks.workunit.client.0.smithi060.stdout:8/861: sync 2024-04-12T13:42:26.302 INFO:tasks.workunit.client.0.smithi060.stdout:2/911: sync 2024-04-12T13:42:26.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/927: dwrite d7/d17/d19/dc9/d3f/d5c/d103/d63/fa8 [4194304,4194304] 0 2024-04-12T13:42:26.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/927: mkdir d1/d7/da/dc/d24/d30/d128 0 2024-04-12T13:42:26.309 INFO:tasks.workunit.client.1.smithi110.stdout:8/984: write d1/d3/d35/ffc [2049477,40825] 0 2024-04-12T13:42:26.311 INFO:tasks.workunit.client.1.smithi110.stdout:7/988: truncate d1/d3/d4/d55/d82/db5/f104 5759738 0 2024-04-12T13:42:26.313 INFO:tasks.workunit.client.0.smithi060.stdout:9/844: dwrite d4/d33/d65/d7a/fcc [0,4194304] 0 2024-04-12T13:42:26.314 INFO:tasks.workunit.client.0.smithi060.stdout:9/845: write d4/d33/d50/dd0/fe6 [432485,33765] 0 2024-04-12T13:42:26.316 INFO:tasks.workunit.client.1.smithi110.stdout:0/903: unlink d1/d8/l1a 0 2024-04-12T13:42:26.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/883: unlink d0/d3d/dcf/fe6 0 2024-04-12T13:42:26.322 INFO:tasks.workunit.client.0.smithi060.stdout:8/862: fsync d9/f71 0 2024-04-12T13:42:26.325 INFO:tasks.workunit.client.0.smithi060.stdout:2/912: mkdir d6/dae/d5b/d6d/de1/d119 0 2024-04-12T13:42:26.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/928: mkdir d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/d91/d129 0 2024-04-12T13:42:26.332 INFO:tasks.workunit.client.1.smithi110.stdout:0/904: dread d1/f2f [0,4194304] 0 2024-04-12T13:42:26.332 INFO:tasks.workunit.client.1.smithi110.stdout:3/946: rename d5/dc/d20/c29 to d5/dc/dcf/c123 0 2024-04-12T13:42:26.336 INFO:tasks.workunit.client.1.smithi110.stdout:3/947: read d5/dc/d20/d2d/d4f/fd1 [3737046,61577] 0 2024-04-12T13:42:26.341 INFO:tasks.workunit.client.0.smithi060.stdout:0/847: dread d7/d9/d14/f25 [0,4194304] 0 2024-04-12T13:42:26.341 INFO:tasks.workunit.client.1.smithi110.stdout:8/985: mknod d1/d3/d35/d3a/d84/d101/c146 0 2024-04-12T13:42:26.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/863: creat d9/d1b/d37/d4d/d63/d66/dd9/f12d x:0 0 0 2024-04-12T13:42:26.346 INFO:tasks.workunit.client.1.smithi110.stdout:6/948: mkdir d7/d25/d30/d117/d128 0 2024-04-12T13:42:26.347 INFO:tasks.workunit.client.0.smithi060.stdout:4/868: dread d6/d7/dd/d1a/d57/d63/fec [0,4194304] 0 2024-04-12T13:42:26.348 INFO:tasks.workunit.client.1.smithi110.stdout:1/954: write de/f12d [1123788,116251] 0 2024-04-12T13:42:26.348 INFO:tasks.workunit.client.1.smithi110.stdout:5/923: link da/db/d3b/c62 da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/c143 0 2024-04-12T13:42:26.350 INFO:tasks.workunit.client.0.smithi060.stdout:2/913: truncate d6/d64/d99/df0/d2b/fb7 1389057 0 2024-04-12T13:42:26.354 INFO:tasks.workunit.client.1.smithi110.stdout:5/924: dread da/db/f37 [4194304,4194304] 0 2024-04-12T13:42:26.355 INFO:tasks.workunit.client.1.smithi110.stdout:0/905: rmdir d1/d3c/dd8 39 2024-04-12T13:42:26.360 INFO:tasks.workunit.client.1.smithi110.stdout:7/989: dwrite d1/d3/d4/d55/d56/d72/dad/d115/f12b [0,4194304] 0 2024-04-12T13:42:26.361 INFO:tasks.workunit.client.0.smithi060.stdout:9/846: dread d4/d8/d32/f99 [0,4194304] 0 2024-04-12T13:42:26.362 INFO:tasks.workunit.client.0.smithi060.stdout:6/928: creat d1/d7/da/dc/d24/d34/d51/f129 x:0 0 0 2024-04-12T13:42:26.363 INFO:tasks.workunit.client.1.smithi110.stdout:3/948: creat d5/dc/d31/d3b/d32/d3e/d5f/f124 x:0 0 0 2024-04-12T13:42:26.365 INFO:tasks.workunit.client.0.smithi060.stdout:7/884: write d0/d1b/f37 [2982870,38225] 0 2024-04-12T13:42:26.371 INFO:tasks.workunit.client.1.smithi110.stdout:8/986: creat d1/d3/d3c/d5a/d6f/d9c/f147 x:0 0 0 2024-04-12T13:42:26.371 INFO:tasks.workunit.client.0.smithi060.stdout:6/929: dread - d1/d7/da/dc/d24/d2d/d10b/f11f zero size 2024-04-12T13:42:26.371 INFO:tasks.workunit.client.0.smithi060.stdout:4/869: rename d6/d21/lf7 to d6/d7/dd/d1a/d19/d7a/da8/d10a/l116 0 2024-04-12T13:42:26.371 INFO:tasks.workunit.client.0.smithi060.stdout:7/885: readlink d0/d7/d92/l99 0 2024-04-12T13:42:26.373 INFO:tasks.workunit.client.0.smithi060.stdout:7/886: stat d0/d7/d92/l9c 0 2024-04-12T13:42:26.376 INFO:tasks.workunit.client.0.smithi060.stdout:9/847: dread - d4/d8/d7c/fa7 zero size 2024-04-12T13:42:26.379 INFO:tasks.workunit.client.0.smithi060.stdout:8/864: mknod d9/d1b/d37/d4d/d63/d66/db3/c12e 0 2024-04-12T13:42:26.380 INFO:tasks.workunit.client.1.smithi110.stdout:7/990: rmdir d1/d3/d118 39 2024-04-12T13:42:26.381 INFO:tasks.workunit.client.0.smithi060.stdout:3/929: dwrite d7/d17/d27/d36/d53/da2/f105 [0,4194304] 0 2024-04-12T13:42:26.383 INFO:tasks.workunit.client.1.smithi110.stdout:3/949: mkdir d5/dc/dcf/d125 0 2024-04-12T13:42:26.384 INFO:tasks.workunit.client.1.smithi110.stdout:5/925: dread da/db/d3b/d40/d97/db6/fd9 [0,4194304] 0 2024-04-12T13:42:26.385 INFO:tasks.workunit.client.0.smithi060.stdout:2/914: symlink d6/d64/d99/df0/d4b/d106/l11a 0 2024-04-12T13:42:26.386 INFO:tasks.workunit.client.1.smithi110.stdout:5/926: fdatasync da/d2e/d45/d29/d105/dea/f137 0 2024-04-12T13:42:26.387 INFO:tasks.workunit.client.0.smithi060.stdout:0/848: dwrite d7/d9/d14/d35/d44/d7d/f2a [0,4194304] 0 2024-04-12T13:42:26.387 INFO:tasks.workunit.client.1.smithi110.stdout:6/949: mkdir d7/da4/df8/d129 0 2024-04-12T13:42:26.393 INFO:tasks.workunit.client.0.smithi060.stdout:0/849: write d7/d9/d4c/d93/f11c [905052,1104] 0 2024-04-12T13:42:26.394 INFO:tasks.workunit.client.1.smithi110.stdout:8/987: creat d1/d3/d3c/d5a/d6f/d9c/f148 x:0 0 0 2024-04-12T13:42:26.398 INFO:tasks.workunit.client.0.smithi060.stdout:7/887: dwrite d0/df3/f113 [0,4194304] 0 2024-04-12T13:42:26.398 INFO:tasks.workunit.client.0.smithi060.stdout:4/870: dread d6/d7/dd/d1a/d56/d8d/fab [0,4194304] 0 2024-04-12T13:42:26.403 INFO:tasks.workunit.client.1.smithi110.stdout:7/991: truncate d1/d3/d4/dbf/db6/fea 176809 0 2024-04-12T13:42:26.409 INFO:tasks.workunit.client.1.smithi110.stdout:6/950: mknod d7/d25/d30/dcf/dc3/dfc/c12a 0 2024-04-12T13:42:26.411 INFO:tasks.workunit.client.1.smithi110.stdout:0/906: dread d1/d8/d8a/fa8 [0,4194304] 0 2024-04-12T13:42:26.411 INFO:tasks.workunit.client.1.smithi110.stdout:5/927: rename da/d2e/d45/d25/d9d/l13e to da/d35/dd6/l144 0 2024-04-12T13:42:26.414 INFO:tasks.workunit.client.1.smithi110.stdout:5/928: chown da/d2e/d45/d25/d9d/d7a/dae 1341 1 2024-04-12T13:42:26.415 INFO:tasks.workunit.client.1.smithi110.stdout:5/929: fdatasync da/d35/f109 0 2024-04-12T13:42:26.416 INFO:tasks.workunit.client.0.smithi060.stdout:9/848: dread d4/d9/d19/d21/dbf/dce/ff6 [0,4194304] 0 2024-04-12T13:42:26.417 INFO:tasks.workunit.client.1.smithi110.stdout:8/988: truncate d1/d5/dd/fa0 1115479 0 2024-04-12T13:42:26.418 INFO:tasks.workunit.client.1.smithi110.stdout:8/989: fsync d1/d7/d20/fff 0 2024-04-12T13:42:26.421 INFO:tasks.workunit.client.0.smithi060.stdout:3/930: creat d7/d17/d27/d36/d53/da2/d10a/f12a x:0 0 0 2024-04-12T13:42:26.424 INFO:tasks.workunit.client.1.smithi110.stdout:6/951: read - d7/d10/d1c/d2b/d48/d54/ff1 zero size 2024-04-12T13:42:26.425 INFO:tasks.workunit.client.1.smithi110.stdout:0/907: dread - d1/d48/db2/d4a/fbb zero size 2024-04-12T13:42:26.425 INFO:tasks.workunit.client.1.smithi110.stdout:3/950: dread d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/fdf [0,4194304] 0 2024-04-12T13:42:26.427 INFO:tasks.workunit.client.0.smithi060.stdout:4/871: chown d6/d2f/d51/l80 810 1 2024-04-12T13:42:26.433 INFO:tasks.workunit.client.0.smithi060.stdout:6/930: link d1/d7/da/dc/caf d1/d7/da/dc/dcb/c12a 0 2024-04-12T13:42:26.441 INFO:tasks.workunit.client.0.smithi060.stdout:0/850: dread d7/d9/de/fce [0,4194304] 0 2024-04-12T13:42:26.442 INFO:tasks.workunit.client.1.smithi110.stdout:1/955: dwrite de/d1d/f97 [0,4194304] 0 2024-04-12T13:42:26.447 INFO:tasks.workunit.client.1.smithi110.stdout:3/951: rename d5/f40 to d5/dc/d20/d2d/d4e/d89/d8c/dc5/f126 0 2024-04-12T13:42:26.448 INFO:tasks.workunit.client.1.smithi110.stdout:5/930: creat da/d2e/d45/d25/d9d/d7a/dae/d101/f145 x:0 0 0 2024-04-12T13:42:26.453 INFO:tasks.workunit.client.1.smithi110.stdout:7/992: link d1/d3/d4/dbf/db6/lbc d1/d3/d4/dbf/l144 0 2024-04-12T13:42:26.454 INFO:tasks.workunit.client.0.smithi060.stdout:4/872: symlink d6/d21/d29/l117 0 2024-04-12T13:42:26.455 INFO:tasks.workunit.client.1.smithi110.stdout:8/990: symlink d1/d3/d35/d43/d9f/dd5/d11e/d85/l149 0 2024-04-12T13:42:26.457 INFO:tasks.workunit.client.0.smithi060.stdout:7/888: truncate d0/d3d/d74/d9b/da1/fd1 1817922 0 2024-04-12T13:42:26.458 INFO:tasks.workunit.client.1.smithi110.stdout:6/952: mkdir d7/d10/d1c/d2b/d48/d12b 0 2024-04-12T13:42:26.458 INFO:tasks.workunit.client.0.smithi060.stdout:8/865: getdents d9/d1b/d84/da0/d114 0 2024-04-12T13:42:26.459 INFO:tasks.workunit.client.0.smithi060.stdout:4/873: chown d6/d7/dd/d1a/d57/d63/d68/d94/c99 439223669 1 2024-04-12T13:42:26.461 INFO:tasks.workunit.client.1.smithi110.stdout:1/956: chown de/d15/d32/d61/d96/lbc 43 1 2024-04-12T13:42:26.466 INFO:tasks.workunit.client.0.smithi060.stdout:2/915: truncate d6/d64/d99/df0/daa/db0/f4c 1916946 0 2024-04-12T13:42:26.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/851: creat d7/d9/d4c/f121 x:0 0 0 2024-04-12T13:42:26.467 INFO:tasks.workunit.client.0.smithi060.stdout:2/916: chown d6/d56/d86/fbc 52 1 2024-04-12T13:42:26.468 INFO:tasks.workunit.client.1.smithi110.stdout:8/991: creat d1/d3/d3c/d75/f14a x:0 0 0 2024-04-12T13:42:26.469 INFO:tasks.workunit.client.0.smithi060.stdout:2/917: write d6/d56/d58/f104 [360421,21943] 0 2024-04-12T13:42:26.471 INFO:tasks.workunit.client.1.smithi110.stdout:0/908: dwrite d1/d27/d31/f50 [4194304,4194304] 0 2024-04-12T13:42:26.472 INFO:tasks.workunit.client.0.smithi060.stdout:3/931: write d7/d17/d27/da7/dbe/f108 [233241,116506] 0 2024-04-12T13:42:26.475 INFO:tasks.workunit.client.1.smithi110.stdout:6/953: dread d7/d25/d30/d44/da3/fb8 [0,4194304] 0 2024-04-12T13:42:26.477 INFO:tasks.workunit.client.0.smithi060.stdout:4/874: truncate d6/d7/dd/fc1 550592 0 2024-04-12T13:42:26.478 INFO:tasks.workunit.client.0.smithi060.stdout:9/849: truncate d4/d8/d32/ff4 638299 0 2024-04-12T13:42:26.483 INFO:tasks.workunit.client.0.smithi060.stdout:8/866: mknod d9/d1d/dfe/c12f 0 2024-04-12T13:42:26.486 INFO:tasks.workunit.client.1.smithi110.stdout:3/952: rename d5/dc/d20/d2d/d4e/d89/d8c/db6/de8 to d5/dc/d20/d2d/d4e/d89/d8c/d127 0 2024-04-12T13:42:26.488 INFO:tasks.workunit.client.1.smithi110.stdout:7/993: dwrite d1/d3/d4/d55/d56/ddd/ffb [0,4194304] 0 2024-04-12T13:42:26.488 INFO:tasks.workunit.client.1.smithi110.stdout:8/992: mknod d1/d7/d20/da3/dc6/c14b 0 2024-04-12T13:42:26.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/850: mknod d4/d8/d7c/dfe/c117 0 2024-04-12T13:42:26.491 INFO:tasks.workunit.client.0.smithi060.stdout:0/852: mkdir d7/d9/d14/d122 0 2024-04-12T13:42:26.492 INFO:tasks.workunit.client.1.smithi110.stdout:0/909: symlink d1/d8/d36/d51/df8/l147 0 2024-04-12T13:42:26.494 INFO:tasks.workunit.client.0.smithi060.stdout:9/851: chown d4/fd 2199285 1 2024-04-12T13:42:26.498 INFO:tasks.workunit.client.0.smithi060.stdout:8/867: fdatasync d9/d1b/d84/da0/d80/d109/f86 0 2024-04-12T13:42:26.500 INFO:tasks.workunit.client.1.smithi110.stdout:8/993: rmdir d1/d3/d35/d43/d9f/dd5 39 2024-04-12T13:42:26.500 INFO:tasks.workunit.client.1.smithi110.stdout:3/953: dread d5/dc/d20/d2d/d4e/d89/d8c/fb2 [0,4194304] 0 2024-04-12T13:42:26.502 INFO:tasks.workunit.client.0.smithi060.stdout:6/931: truncate d1/d7/da/dc/d24/d34/f9c 445588 0 2024-04-12T13:42:26.503 INFO:tasks.workunit.client.0.smithi060.stdout:0/853: creat d7/d9/de/d80/f123 x:0 0 0 2024-04-12T13:42:26.505 INFO:tasks.workunit.client.1.smithi110.stdout:7/994: unlink d1/d3/d4/d55/d56/l9c 0 2024-04-12T13:42:26.513 INFO:tasks.workunit.client.1.smithi110.stdout:8/994: readlink d1/d3/d3c/d5a/l114 0 2024-04-12T13:42:26.514 INFO:tasks.workunit.client.0.smithi060.stdout:2/918: write d6/dae/d5b/d6d/fc8 [2586666,87084] 0 2024-04-12T13:42:26.519 INFO:tasks.workunit.client.1.smithi110.stdout:7/995: dwrite d1/d31/f59 [0,4194304] 0 2024-04-12T13:42:26.520 INFO:tasks.workunit.client.0.smithi060.stdout:3/932: link d7/d17/d27/d36/f46 d7/d17/d102/f12b 0 2024-04-12T13:42:26.524 INFO:tasks.workunit.client.1.smithi110.stdout:3/954: truncate d5/dc/d31/d3b/d32/f56 1320201 0 2024-04-12T13:42:26.525 INFO:tasks.workunit.client.0.smithi060.stdout:4/875: dwrite d6/d21/fc3 [0,4194304] 0 2024-04-12T13:42:26.528 INFO:tasks.workunit.client.1.smithi110.stdout:1/957: rename de/d15/d32/d61/d6a/dac/dc0/dea/c106 to de/d14/d34/d55/d6b/c13d 0 2024-04-12T13:42:26.529 INFO:tasks.workunit.client.1.smithi110.stdout:8/995: read d1/d3/d3c/d5a/d6f/d83/f8c [659997,76649] 0 2024-04-12T13:42:26.532 INFO:tasks.workunit.client.0.smithi060.stdout:8/868: creat d9/d1b/d2b/d82/d8a/d116/f130 x:0 0 0 2024-04-12T13:42:26.534 INFO:tasks.workunit.client.1.smithi110.stdout:1/958: write de/d14/d34/db4/f11f [1063711,28308] 0 2024-04-12T13:42:26.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/854: mkdir d7/d9/d14/d35/d124 0 2024-04-12T13:42:26.543 INFO:tasks.workunit.client.1.smithi110.stdout:3/955: dwrite d5/dc/d31/d3b/d5b/fd8 [0,4194304] 0 2024-04-12T13:42:26.544 INFO:tasks.workunit.client.1.smithi110.stdout:6/954: rename d7/d25/d2c/lf0 to d7/d25/d2c/d4c/da6/l12c 0 2024-04-12T13:42:26.549 INFO:tasks.workunit.client.1.smithi110.stdout:3/956: read d5/dc/d20/d2d/d4f/f58 [3628685,48543] 0 2024-04-12T13:42:26.549 INFO:tasks.workunit.client.1.smithi110.stdout:8/996: mkdir d1/d3/d35/d3a/d84/d101/d14c 0 2024-04-12T13:42:26.550 INFO:tasks.workunit.client.0.smithi060.stdout:9/852: dwrite d4/d8/df1/d67/fa9 [0,4194304] 0 2024-04-12T13:42:26.552 INFO:tasks.workunit.client.1.smithi110.stdout:8/997: chown d1/d3/d35/d3a/d41/d77/fb1 9577 1 2024-04-12T13:42:26.553 INFO:tasks.workunit.client.0.smithi060.stdout:8/869: fsync f1 0 2024-04-12T13:42:26.561 INFO:tasks.workunit.client.1.smithi110.stdout:7/996: mkdir d1/d31/d145 0 2024-04-12T13:42:26.565 INFO:tasks.workunit.client.1.smithi110.stdout:0/910: rename d1/fdf to d1/d3c/dd8/f148 0 2024-04-12T13:42:26.566 INFO:tasks.workunit.client.0.smithi060.stdout:3/933: write d7/d17/d19/dc9/d3f/d5c/d25/d4d/f6e [4133916,50010] 0 2024-04-12T13:42:26.574 INFO:tasks.workunit.client.0.smithi060.stdout:9/853: dread - d4/d9/fa0 zero size 2024-04-12T13:42:26.588 INFO:tasks.workunit.client.1.smithi110.stdout:5/931: sync 2024-04-12T13:42:26.681 INFO:tasks.workunit.client.0.smithi060.stdout:8/870: mkdir d9/d1b/d84/da0/d114/d131 0 2024-04-12T13:42:26.683 INFO:tasks.workunit.client.1.smithi110.stdout:1/959: creat de/d14/d34/d108/d119/f13e x:0 0 0 2024-04-12T13:42:26.684 INFO:tasks.workunit.client.0.smithi060.stdout:4/876: truncate d6/d7/f3b 755770 0 2024-04-12T13:42:26.685 INFO:tasks.workunit.client.0.smithi060.stdout:0/855: truncate d7/d9/d14/d35/d44/d49/d74/ff2 334217 0 2024-04-12T13:42:26.688 INFO:tasks.workunit.client.1.smithi110.stdout:0/911: chown d1/d27/ld2 14 1 2024-04-12T13:42:26.689 INFO:tasks.workunit.client.0.smithi060.stdout:0/856: fsync d7/d9/d14/d35/d44/d8c/d8d/de9/f100 0 2024-04-12T13:42:26.689 INFO:tasks.workunit.client.0.smithi060.stdout:9/854: rename d4/d8/d7c/l93 to d4/d33/d50/dd0/d104/d110/l118 0 2024-04-12T13:42:26.692 INFO:tasks.workunit.client.0.smithi060.stdout:8/871: fsync d9/d1b/d37/d4d/d63/fc6 0 2024-04-12T13:42:26.693 INFO:tasks.workunit.client.1.smithi110.stdout:8/998: creat d1/d3/d3c/d75/d79/d100/f14d x:0 0 0 2024-04-12T13:42:26.696 INFO:tasks.workunit.client.1.smithi110.stdout:5/932: mkdir da/d2e/d45/d25/d9d/d7a/db5/d8f/d146 0 2024-04-12T13:42:26.704 INFO:tasks.workunit.client.0.smithi060.stdout:9/855: truncate d4/d8/df1/d67/f49 1965902 0 2024-04-12T13:42:26.705 INFO:tasks.workunit.client.1.smithi110.stdout:3/957: creat d5/dc/d20/d2d/d4e/d89/d8c/f128 x:0 0 0 2024-04-12T13:42:26.709 INFO:tasks.workunit.client.0.smithi060.stdout:0/857: dwrite d7/d9/f92 [0,4194304] 0 2024-04-12T13:42:26.710 INFO:tasks.workunit.client.0.smithi060.stdout:3/934: link d7/d17/d19/dc9/d3f/d5c/f8d d7/d17/d19/f12c 0 2024-04-12T13:42:26.712 INFO:tasks.workunit.client.1.smithi110.stdout:6/955: dwrite d7/d10/d1c/d2b/f91 [0,4194304] 0 2024-04-12T13:42:26.721 INFO:tasks.workunit.client.1.smithi110.stdout:3/958: dread - d5/d86/dca/f120 zero size 2024-04-12T13:42:26.721 INFO:tasks.workunit.client.1.smithi110.stdout:8/999: readlink d1/d3/d35/d43/d9f/dd5/d11e/d85/d8d/lfe 0 2024-04-12T13:42:26.722 INFO:tasks.workunit.client.0.smithi060.stdout:0/858: mknod d7/d33/c125 0 2024-04-12T13:42:26.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/877: write d6/d7/dd/d1a/d57/d63/fb2 [1087974,97597] 0 2024-04-12T13:42:26.726 INFO:tasks.workunit.client.0.smithi060.stdout:9/856: truncate d4/d9/d19/d8c/d92/fcb 2504009 0 2024-04-12T13:42:26.731 INFO:tasks.workunit.client.0.smithi060.stdout:0/859: unlink d7/d9/d14/d35/d44/d8c/d8d/d10b/l70 0 2024-04-12T13:42:26.733 INFO:tasks.workunit.client.0.smithi060.stdout:9/857: mknod d4/d33/d65/d7a/c119 0 2024-04-12T13:42:26.738 INFO:tasks.workunit.client.0.smithi060.stdout:0/860: creat d7/d9/de/d80/d8b/f126 x:0 0 0 2024-04-12T13:42:26.741 INFO:tasks.workunit.client.1.smithi110.stdout:6/956: truncate d7/d25/d2c/d4c/d77/d93/f95 4504836 0 2024-04-12T13:42:26.741 INFO:tasks.workunit.client.0.smithi060.stdout:0/861: dread - d7/d9/d4c/f121 zero size 2024-04-12T13:42:26.748 INFO:tasks.workunit.client.1.smithi110.stdout:7/997: dwrite d1/f6b [0,4194304] 0 2024-04-12T13:42:26.749 INFO:tasks.workunit.client.0.smithi060.stdout:4/878: write d6/d21/f27 [3905895,107898] 0 2024-04-12T13:42:26.750 INFO:tasks.workunit.client.1.smithi110.stdout:0/912: dwrite d1/d3c/fd6 [0,4194304] 0 2024-04-12T13:42:26.750 INFO:tasks.workunit.client.1.smithi110.stdout:3/959: getdents d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/dd7 0 2024-04-12T13:42:26.752 INFO:tasks.workunit.client.1.smithi110.stdout:6/957: symlink d7/d25/d2c/d4c/d77/db9/l12d 0 2024-04-12T13:42:26.752 INFO:tasks.workunit.client.0.smithi060.stdout:3/935: dwrite d7/d17/d27/da7/dbe/dce/de6/dea/ff0 [0,4194304] 0 2024-04-12T13:42:26.754 INFO:tasks.workunit.client.0.smithi060.stdout:0/862: creat d7/d9/de/d80/dc8/d10d/f127 x:0 0 0 2024-04-12T13:42:26.756 INFO:tasks.workunit.client.1.smithi110.stdout:1/960: dwrite de/d15/d32/f39 [0,4194304] 0 2024-04-12T13:42:26.756 INFO:tasks.workunit.client.0.smithi060.stdout:9/858: symlink d4/d8/db8/l11a 0 2024-04-12T13:42:26.766 INFO:tasks.workunit.client.1.smithi110.stdout:7/998: dread - d1/d3/d4/d55/d82/db5/f141 zero size 2024-04-12T13:42:26.766 INFO:tasks.workunit.client.1.smithi110.stdout:5/933: dwrite da/d35/f41 [0,4194304] 0 2024-04-12T13:42:26.767 INFO:tasks.workunit.client.1.smithi110.stdout:6/958: rmdir d7 39 2024-04-12T13:42:26.772 INFO:tasks.workunit.client.1.smithi110.stdout:0/913: mknod d1/d27/d31/d67/dcb/c149 0 2024-04-12T13:42:26.773 INFO:tasks.workunit.client.1.smithi110.stdout:5/934: fsync da/d2e/d45/d25/d9d/d79/d88/dd3/fe3 0 2024-04-12T13:42:26.775 INFO:tasks.workunit.client.1.smithi110.stdout:0/914: chown d1/d3c/dd8 7 1 2024-04-12T13:42:26.782 INFO:tasks.workunit.client.0.smithi060.stdout:9/859: dwrite d4/f2d [4194304,4194304] 0 2024-04-12T13:42:26.782 INFO:tasks.workunit.client.1.smithi110.stdout:3/960: rename d5/dc/d31/d3b/d32/d3e/d5f/l111 to d5/dc/d20/d2d/d4e/d89/d8c/d127/dfc/l129 0 2024-04-12T13:42:26.784 INFO:tasks.workunit.client.1.smithi110.stdout:6/959: mknod d7/d10/d1c/d2b/d48/d54/c12e 0 2024-04-12T13:42:26.784 INFO:tasks.workunit.client.1.smithi110.stdout:3/961: chown d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/dd7 0 1 2024-04-12T13:42:26.786 INFO:tasks.workunit.client.1.smithi110.stdout:3/962: fdatasync d5/dc/da0/fef 0 2024-04-12T13:42:26.789 INFO:tasks.workunit.client.1.smithi110.stdout:6/960: truncate d7/d25/d30/d44/da3/f10a 924523 0 2024-04-12T13:42:26.792 INFO:tasks.workunit.client.1.smithi110.stdout:3/963: truncate d5/dc/d20/d2d/d4e/d89/d8c/dc5/f10b 751694 0 2024-04-12T13:42:26.794 INFO:tasks.workunit.client.1.smithi110.stdout:0/915: rename d1/d8/d8a/f101 to d1/d48/db2/f14a 0 2024-04-12T13:42:26.802 INFO:tasks.workunit.client.1.smithi110.stdout:7/999: dwrite d1/d3/d4/d55/d56/d72/dad/d115/f123 [4194304,4194304] 0 2024-04-12T13:42:26.806 INFO:tasks.workunit.client.1.smithi110.stdout:1/961: dwrite de/d15/dab/dd8/dd9/dda/ff2 [0,4194304] 0 2024-04-12T13:42:26.811 INFO:tasks.workunit.client.1.smithi110.stdout:3/964: getdents d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9 0 2024-04-12T13:42:26.821 INFO:tasks.workunit.client.1.smithi110.stdout:5/935: write da/d2e/d45/d25/d9d/d7a/db5/d8f/fc7 [313398,53666] 0 2024-04-12T13:42:26.824 INFO:tasks.workunit.client.1.smithi110.stdout:0/916: write d1/d3c/dd8/f148 [540488,33094] 0 2024-04-12T13:42:26.830 INFO:tasks.workunit.client.1.smithi110.stdout:6/961: dread d7/d10/d1c/d2b/d48/d54/f86 [0,4194304] 0 2024-04-12T13:42:26.833 INFO:tasks.workunit.client.1.smithi110.stdout:6/962: write d7/d25/d2c/d4c/d77/d93/fd4 [2322177,21631] 0 2024-04-12T13:42:26.834 INFO:tasks.workunit.client.0.smithi060.stdout:5/917: sync 2024-04-12T13:42:26.836 INFO:tasks.workunit.client.1.smithi110.stdout:5/936: link da/d2e/d45/d25/d9d/fd7 da/d2e/d45/ddc/f147 0 2024-04-12T13:42:26.837 INFO:tasks.workunit.client.1.smithi110.stdout:5/937: write da/d2e/d45/d29/f123 [140369,18325] 0 2024-04-12T13:42:26.840 INFO:tasks.workunit.client.1.smithi110.stdout:6/963: read d7/d10/d1c/d2b/fe8 [324413,129288] 0 2024-04-12T13:42:26.841 INFO:tasks.workunit.client.0.smithi060.stdout:0/863: write d7/d9/de/d80/f105 [335580,19743] 0 2024-04-12T13:42:26.841 INFO:tasks.workunit.client.1.smithi110.stdout:3/965: write d5/dc/d20/d2d/f51 [228001,98599] 0 2024-04-12T13:42:26.842 INFO:tasks.workunit.client.0.smithi060.stdout:9/860: creat d4/d33/d50/dd0/f11b x:0 0 0 2024-04-12T13:42:26.842 INFO:tasks.workunit.client.1.smithi110.stdout:5/938: read - da/d2e/d45/d29/d105/f110 zero size 2024-04-12T13:42:26.844 INFO:tasks.workunit.client.0.smithi060.stdout:5/918: mknod d6/dd/d1f/dd3/de7/df8/c12b 0 2024-04-12T13:42:26.845 INFO:tasks.workunit.client.0.smithi060.stdout:9/861: readlink d4/d8/d32/l5f 0 2024-04-12T13:42:26.847 INFO:tasks.workunit.client.0.smithi060.stdout:0/864: stat d7/d9/d14/d35/d44/d49/fd7 0 2024-04-12T13:42:26.850 INFO:tasks.workunit.client.1.smithi110.stdout:1/962: dwrite de/d15/dab/dd8/ff9 [0,4194304] 0 2024-04-12T13:42:26.850 INFO:tasks.workunit.client.0.smithi060.stdout:3/936: dwrite d7/d17/d19/f48 [0,4194304] 0 2024-04-12T13:42:26.851 INFO:tasks.workunit.client.0.smithi060.stdout:5/919: mknod d6/dd/d1f/dd3/d5f/c12c 0 2024-04-12T13:42:26.852 INFO:tasks.workunit.client.1.smithi110.stdout:0/917: dwrite d1/d3c/dd8/df6/f104 [0,4194304] 0 2024-04-12T13:42:26.856 INFO:tasks.workunit.client.0.smithi060.stdout:9/862: fsync d4/d9/d19/f4e 0 2024-04-12T13:42:26.857 INFO:tasks.workunit.client.1.smithi110.stdout:0/918: chown d1/d3c/d6b/d90/f9a 15416 1 2024-04-12T13:42:26.858 INFO:tasks.workunit.client.1.smithi110.stdout:1/963: symlink de/d14/d34/d55/ddc/l13f 0 2024-04-12T13:42:26.861 INFO:tasks.workunit.client.1.smithi110.stdout:3/966: write d5/dc/d31/d3b/d32/feb [178624,118495] 0 2024-04-12T13:42:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.860+0000 7fc7b5000700 1 -- 172.21.15.60:0/698839139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00662f0 msgr2=0x7fc7b00fd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.860+0000 7fc7b5000700 1 --2- 172.21.15.60:0/698839139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00662f0 0x7fc7b00fd820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0004940 tx=0x7fc7a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:26.865 INFO:tasks.workunit.client.1.smithi110.stdout:5/939: rename da/d2e/d45/d29/d105 to da/d2e/d45/d29/d148 0 2024-04-12T13:42:26.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.864+0000 7fc7b5000700 1 -- 172.21.15.60:0/698839139 shutdown_connections 2024-04-12T13:42:26.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.864+0000 7fc7b5000700 1 --2- 172.21.15.60:0/698839139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:26.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.864+0000 7fc7b5000700 1 --2- 172.21.15.60:0/698839139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00662f0 0x7fc7b00fd820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:26.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.864+0000 7fc7b5000700 1 -- 172.21.15.60:0/698839139 >> 172.21.15.60:0/698839139 conn(0x7fc7b00f74c0 msgr2=0x7fc7b00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:26.867 INFO:tasks.workunit.client.1.smithi110.stdout:6/964: dwrite d7/d10/d1c/f10c [0,4194304] 0 2024-04-12T13:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.864+0000 7fc7b5000700 1 -- 172.21.15.60:0/698839139 shutdown_connections 2024-04-12T13:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.865+0000 7fc7b5000700 1 -- 172.21.15.60:0/698839139 wait complete. 2024-04-12T13:42:26.868 INFO:tasks.workunit.client.0.smithi060.stdout:9/863: write d4/d8/df1/f10a [712217,27241] 0 2024-04-12T13:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.866+0000 7fc7b5000700 1 Processor -- start 2024-04-12T13:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.866+0000 7fc7b5000700 1 -- start start 2024-04-12T13:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.867+0000 7fc7b5000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 0x7fc7b0114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.867+0000 7fc7b5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.867+0000 7fc7b5000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0114ba0 con 0x7fc7b00662f0 2024-04-12T13:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.867+0000 7fc7b5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b01153f0 con 0x7fc7b00fdd60 2024-04-12T13:42:26.870 INFO:tasks.workunit.client.1.smithi110.stdout:3/967: chown d5/dc/d20/d2d/d4e/d89/d8c/db6/fc7 1200 1 2024-04-12T13:42:26.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.868+0000 7fc7ad400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:26.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.868+0000 7fc7ad400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:44834/0 (socket says 172.21.15.60:44834) 2024-04-12T13:42:26.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.868+0000 7fc7ad400700 1 -- 172.21.15.60:0/18399648 learned_addr learned my addr 172.21.15.60:0/18399648 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:26.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.868+0000 7fc7ade00700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 0x7fc7b0114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.869+0000 7fc7ad400700 1 -- 172.21.15.60:0/18399648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 msgr2=0x7fc7b0114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.869+0000 7fc7ad400700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 0x7fc7b0114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.869+0000 7fc7ad400700 1 -- 172.21.15.60:0/18399648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0005040 con 0x7fc7b00fdd60 2024-04-12T13:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.869+0000 7fc7ade00700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 0x7fc7b0114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:42:26.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/937: mkdir d7/d17/d27/d36/db0/dd9/d12d 0 2024-04-12T13:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.870+0000 7fc7ad400700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c8c0 tx=0x7fc79c0044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.871+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79c00a980 con 0x7fc7b00fdd60 2024-04-12T13:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.871+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc79c00ce60 con 0x7fc7b00fdd60 2024-04-12T13:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.871+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79c0113a0 con 0x7fc7b00fdd60 2024-04-12T13:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.871+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b01156d0 con 0x7fc7b00fdd60 2024-04-12T13:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.872+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b0115c10 con 0x7fc7b00fdd60 2024-04-12T13:42:26.875 INFO:tasks.workunit.client.0.smithi060.stdout:9/864: rmdir d4/d33 39 2024-04-12T13:42:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.874+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fc79c012400 con 0x7fc7b00fdd60 2024-04-12T13:42:26.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.875+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b005f5f0 con 0x7fc7b00fdd60 2024-04-12T13:42:26.879 INFO:tasks.workunit.client.1.smithi110.stdout:1/964: truncate fb 2771232 0 2024-04-12T13:42:26.879 INFO:tasks.workunit.client.1.smithi110.stdout:6/965: creat d7/d25/d30/d117/f12f x:0 0 0 2024-04-12T13:42:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.875+0000 7fc7a6000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 0x7fc79406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.876+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc79c08aa70 con 0x7fc7b00fdd60 2024-04-12T13:42:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.877+0000 7fc7ade00700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 0x7fc79406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.878+0000 7fc7ade00700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 0x7fc79406e1f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000b3b0 tx=0x7fc7a0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:26.882 INFO:tasks.workunit.client.1.smithi110.stdout:3/968: creat d5/dc/d20/d2d/d4e/d89/d8c/d127/f12a x:0 0 0 2024-04-12T13:42:26.885 INFO:tasks.workunit.client.1.smithi110.stdout:0/919: mkdir d1/d3c/d14b 0 2024-04-12T13:42:26.887 INFO:tasks.workunit.client.1.smithi110.stdout:0/920: readlink d1/d8/d36/d51/d60/l39 0 2024-04-12T13:42:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:26.885+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fc79c057ca0 con 0x7fc7b00fdd60 2024-04-12T13:42:26.894 INFO:tasks.workunit.client.1.smithi110.stdout:1/965: rename de/d14/l66 to de/d15/d32/d61/d96/l140 0 2024-04-12T13:42:26.894 INFO:tasks.workunit.client.1.smithi110.stdout:3/969: fdatasync d5/dc/d31/d3b/d32/d3e/d98/f9e 0 2024-04-12T13:42:26.895 INFO:tasks.workunit.client.1.smithi110.stdout:6/966: dread d7/d25/d30/d44/d3d/f5b [0,4194304] 0 2024-04-12T13:42:26.898 INFO:tasks.workunit.client.0.smithi060.stdout:0/865: dwrite d7/d9/d14/d35/d44/f77 [0,4194304] 0 2024-04-12T13:42:26.900 INFO:tasks.workunit.client.1.smithi110.stdout:5/940: getdents da/d2e/d45/d25/d9d/d7a 0 2024-04-12T13:42:26.901 INFO:tasks.workunit.client.1.smithi110.stdout:6/967: symlink d7/d10/d1c/d7f/d116/dcc/l130 0 2024-04-12T13:42:26.901 INFO:tasks.workunit.client.0.smithi060.stdout:5/920: dwrite d6/dd/fd1 [0,4194304] 0 2024-04-12T13:42:26.902 INFO:tasks.workunit.client.1.smithi110.stdout:1/966: mknod de/d1d/c141 0 2024-04-12T13:42:26.911 INFO:tasks.workunit.client.1.smithi110.stdout:5/941: mkdir da/db/d3b/d40/d149 0 2024-04-12T13:42:26.911 INFO:tasks.workunit.client.1.smithi110.stdout:3/970: mknod d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/d11c/c12b 0 2024-04-12T13:42:26.911 INFO:tasks.workunit.client.1.smithi110.stdout:0/921: link d1/d3c/dd8/f112 d1/d8/d8a/dc8/d138/f14c 0 2024-04-12T13:42:26.913 INFO:tasks.workunit.client.1.smithi110.stdout:1/967: truncate de/d14/d83/fe4 3173450 0 2024-04-12T13:42:26.913 INFO:tasks.workunit.client.0.smithi060.stdout:0/866: link d7/d9/d14/d35/d44/d7d/fff d7/d9/d14/d35/d44/d49/dcf/d11d/f128 0 2024-04-12T13:42:26.914 INFO:tasks.workunit.client.1.smithi110.stdout:3/971: readlink d5/dc/d31/d74/d75/da7/dad/lae 0 2024-04-12T13:42:26.916 INFO:tasks.workunit.client.1.smithi110.stdout:1/968: write de/d14/d34/d55/f5c [3892031,11704] 0 2024-04-12T13:42:26.917 INFO:tasks.workunit.client.1.smithi110.stdout:6/968: rename d7/d10/d1c/d2b/d48/d54/f88 to d7/d10/d1c/d7f/d116/dcc/d114/f131 0 2024-04-12T13:42:26.919 INFO:tasks.workunit.client.1.smithi110.stdout:0/922: mkdir d1/d48/db2/d110/d14d 0 2024-04-12T13:42:26.925 INFO:tasks.workunit.client.1.smithi110.stdout:0/923: readlink d1/d8/d36/d51/d60/l42 0 2024-04-12T13:42:26.925 INFO:tasks.workunit.client.1.smithi110.stdout:5/942: rename da/d2e/d45/d29/d32/l142 to da/d2e/d45/d25/d9d/d7a/db5/df3/l14a 0 2024-04-12T13:42:26.928 INFO:tasks.workunit.client.1.smithi110.stdout:6/969: fsync d7/d10/d1c/d2b/d48/fae 0 2024-04-12T13:42:26.930 INFO:tasks.workunit.client.1.smithi110.stdout:6/970: readlink d7/d10/d1c/d2b/d48/d54/lb0 0 2024-04-12T13:42:26.934 INFO:tasks.workunit.client.0.smithi060.stdout:3/938: dwrite d7/d17/d27/d36/d53/da2/dbc/f101 [0,4194304] 0 2024-04-12T13:42:26.935 INFO:tasks.workunit.client.0.smithi060.stdout:7/889: sync 2024-04-12T13:42:26.939 INFO:tasks.workunit.client.1.smithi110.stdout:5/943: dwrite da/db/d3b/d40/d97/db6/dff/f11e [0,4194304] 0 2024-04-12T13:42:26.943 INFO:tasks.workunit.client.0.smithi060.stdout:9/865: dwrite d4/d9/fb0 [0,4194304] 0 2024-04-12T13:42:26.953 INFO:tasks.workunit.client.0.smithi060.stdout:0/867: dread d7/d9/f48 [0,4194304] 0 2024-04-12T13:42:26.955 INFO:tasks.workunit.client.0.smithi060.stdout:9/866: mkdir d4/d8/df1/d11c 0 2024-04-12T13:42:26.956 INFO:tasks.workunit.client.0.smithi060.stdout:0/868: fsync d7/d9/de/f43 0 2024-04-12T13:42:26.969 INFO:tasks.workunit.client.0.smithi060.stdout:0/869: mkdir d7/d9/de/d63/d129 0 2024-04-12T13:42:26.972 INFO:tasks.workunit.client.0.smithi060.stdout:3/939: dread d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/fd3 [0,4194304] 0 2024-04-12T13:42:26.978 INFO:tasks.workunit.client.0.smithi060.stdout:0/870: unlink d7/d33/d5b/ff6 0 2024-04-12T13:42:26.986 INFO:tasks.workunit.client.0.smithi060.stdout:9/867: creat d4/d8/db8/f11d x:0 0 0 2024-04-12T13:42:26.988 INFO:tasks.workunit.client.0.smithi060.stdout:0/871: fsync d7/d9/d14/d35/fcd 0 2024-04-12T13:42:26.989 INFO:tasks.workunit.client.0.smithi060.stdout:7/890: dwrite d0/d7/d43/d63/d6f/f7f [0,4194304] 0 2024-04-12T13:42:26.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/891: readlink d0/lcb 0 2024-04-12T13:42:26.994 INFO:tasks.workunit.client.0.smithi060.stdout:3/940: dread d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:42:26.995 INFO:tasks.workunit.client.0.smithi060.stdout:9/868: mknod d4/d9/d19/daf/d101/c11e 0 2024-04-12T13:42:27.020 INFO:tasks.workunit.client.0.smithi060.stdout:0/872: rename d7/d9/d14/d35/d44/d49/d67/da5/df5 to d7/d33/d12a 0 2024-04-12T13:42:27.028 INFO:tasks.workunit.client.0.smithi060.stdout:0/873: mknod d7/d9/de/d80/dc8/d10d/c12b 0 2024-04-12T13:42:27.030 INFO:tasks.workunit.client.0.smithi060.stdout:7/892: link d0/d3d/d74/d9b/c108 d0/d1b/d8c/db6/c11f 0 2024-04-12T13:42:27.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/893: fsync d0/d1b/f37 0 2024-04-12T13:42:27.031 INFO:tasks.workunit.client.0.smithi060.stdout:3/941: getdents d7/d17/d27/da7/dbe/dce/de6 0 2024-04-12T13:42:27.032 INFO:tasks.workunit.client.0.smithi060.stdout:7/894: fsync d0/d1b/da4/feb 0 2024-04-12T13:42:27.035 INFO:tasks.workunit.client.0.smithi060.stdout:0/874: mknod d7/d9/de/d80/c12c 0 2024-04-12T13:42:27.037 INFO:tasks.workunit.client.0.smithi060.stdout:9/869: write d4/d9/d19/d8c/d92/fcb [1936998,22790] 0 2024-04-12T13:42:27.041 INFO:tasks.workunit.client.0.smithi060.stdout:3/942: rmdir d7/d17/d27 39 2024-04-12T13:42:27.044 INFO:tasks.workunit.client.0.smithi060.stdout:0/875: chown d7/d9/de/dca/l119 7159 1 2024-04-12T13:42:27.046 INFO:tasks.workunit.client.0.smithi060.stdout:9/870: truncate d4/d8/f6d 1436280 0 2024-04-12T13:42:27.046 INFO:tasks.workunit.client.0.smithi060.stdout:0/876: write d7/d9/d14/ff4 [293638,31719] 0 2024-04-12T13:42:27.050 INFO:tasks.workunit.client.1.smithi110.stdout:3/972: rename d5/dc/d31/d3b/d32/d3e/d5f/dbd/cc2 to d5/dc/d31/d3b/d32/d3e/d98/c12c 0 2024-04-12T13:42:27.059 INFO:tasks.workunit.client.0.smithi060.stdout:0/877: mknod d7/c12d 0 2024-04-12T13:42:27.061 INFO:tasks.workunit.client.0.smithi060.stdout:3/943: rmdir d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b 39 2024-04-12T13:42:27.065 INFO:tasks.workunit.client.1.smithi110.stdout:6/971: rename d7/d10/d1c/f24 to d7/d25/d2c/d4c/d77/d103/f132 0 2024-04-12T13:42:27.066 INFO:tasks.workunit.client.0.smithi060.stdout:0/878: creat d7/d9/d14/d35/d44/d8c/d8d/de5/f12e x:0 0 0 2024-04-12T13:42:27.069 INFO:tasks.workunit.client.0.smithi060.stdout:0/879: fdatasync d7/d9/d4c/d93/f11c 0 2024-04-12T13:42:27.070 INFO:tasks.workunit.client.0.smithi060.stdout:9/871: dread d4/d8/df1/d67/f2b [0,4194304] 0 2024-04-12T13:42:27.072 INFO:tasks.workunit.client.0.smithi060.stdout:3/944: symlink d7/d17/d19/dc9/d3f/d5c/d103/d63/l12e 0 2024-04-12T13:42:27.073 INFO:tasks.workunit.client.1.smithi110.stdout:1/969: write f5 [385090,102973] 0 2024-04-12T13:42:27.077 INFO:tasks.workunit.client.0.smithi060.stdout:0/880: mkdir d7/d9/d14/d35/d44/d7d/de8/d12f 0 2024-04-12T13:42:27.077 INFO:tasks.workunit.client.1.smithi110.stdout:0/924: write d1/f26 [791464,83171] 0 2024-04-12T13:42:27.080 INFO:tasks.workunit.client.1.smithi110.stdout:1/970: stat de/d15/d32/f39 0 2024-04-12T13:42:27.081 INFO:tasks.workunit.client.0.smithi060.stdout:9/872: symlink d4/d33/d65/d7a/l11f 0 2024-04-12T13:42:27.082 INFO:tasks.workunit.client.1.smithi110.stdout:3/973: dread d5/dc/d31/d3b/d32/d3e/d5f/dbd/fde [0,4194304] 0 2024-04-12T13:42:27.082 INFO:tasks.workunit.client.1.smithi110.stdout:5/944: rename da/d2e/d45/d25/d9d/d7a/db5/lb7 to da/d2e/l14b 0 2024-04-12T13:42:27.083 INFO:tasks.workunit.client.0.smithi060.stdout:0/881: rmdir d7/d9/de 39 2024-04-12T13:42:27.084 INFO:tasks.workunit.client.1.smithi110.stdout:0/925: chown d1/d8/d36/d51/fbf 634 1 2024-04-12T13:42:27.087 INFO:tasks.workunit.client.0.smithi060.stdout:0/882: mknod d7/d9/d14/d35/d44/d8c/d106/c130 0 2024-04-12T13:42:27.088 INFO:tasks.workunit.client.1.smithi110.stdout:1/971: chown de/d15/dab/dd8/dd9/dda/c8d 2873888 1 2024-04-12T13:42:27.091 INFO:tasks.workunit.client.1.smithi110.stdout:0/926: mknod d1/d8/d36/d51/df8/c14e 0 2024-04-12T13:42:27.092 INFO:tasks.workunit.client.0.smithi060.stdout:0/883: creat d7/d9/d14/d4a/f131 x:0 0 0 2024-04-12T13:42:27.094 INFO:tasks.workunit.client.1.smithi110.stdout:1/972: rmdir de/d1d/d86 39 2024-04-12T13:42:27.098 INFO:tasks.workunit.client.1.smithi110.stdout:0/927: symlink d1/d56/deb/d109/l14f 0 2024-04-12T13:42:27.102 INFO:tasks.workunit.client.0.smithi060.stdout:0/884: creat d7/d9/d14/f132 x:0 0 0 2024-04-12T13:42:27.104 INFO:tasks.workunit.client.1.smithi110.stdout:0/928: chown d1/d8/cc 88782 1 2024-04-12T13:42:27.108 INFO:tasks.workunit.client.0.smithi060.stdout:9/873: dread d4/d9/d19/d21/fe9 [0,4194304] 0 2024-04-12T13:42:27.110 INFO:tasks.workunit.client.1.smithi110.stdout:0/929: creat d1/d3c/dd8/f150 x:0 0 0 2024-04-12T13:42:27.110 INFO:tasks.workunit.client.1.smithi110.stdout:6/972: dread d7/d10/f20 [0,4194304] 0 2024-04-12T13:42:27.112 INFO:tasks.workunit.client.0.smithi060.stdout:3/945: truncate d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/f100 2179624 0 2024-04-12T13:42:27.113 INFO:tasks.workunit.client.0.smithi060.stdout:9/874: mknod d4/d33/d65/d7a/c120 0 2024-04-12T13:42:27.114 INFO:tasks.workunit.client.1.smithi110.stdout:3/974: write d5/dc/d31/d74/fe4 [1550696,99265] 0 2024-04-12T13:42:27.117 INFO:tasks.workunit.client.1.smithi110.stdout:6/973: mknod d7/d10/d7e/d85/dd0/c133 0 2024-04-12T13:42:27.119 INFO:tasks.workunit.client.1.smithi110.stdout:0/930: mknod d1/d27/d31/d67/d10b/c151 0 2024-04-12T13:42:27.119 INFO:tasks.workunit.client.0.smithi060.stdout:9/875: mknod d4/d9/d19/daf/d101/de8/c121 0 2024-04-12T13:42:27.120 INFO:tasks.workunit.client.0.smithi060.stdout:9/876: readlink d4/d9/l22 0 2024-04-12T13:42:27.120 INFO:tasks.workunit.client.1.smithi110.stdout:5/945: dwrite da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/f132 [0,4194304] 0 2024-04-12T13:42:27.121 INFO:tasks.workunit.client.0.smithi060.stdout:3/946: mknod d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/dab/c12f 0 2024-04-12T13:42:27.122 INFO:tasks.workunit.client.0.smithi060.stdout:0/885: write d7/d33/d5b/f9f [2456009,125094] 0 2024-04-12T13:42:27.125 INFO:tasks.workunit.client.1.smithi110.stdout:3/975: write d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/f122 [764243,122414] 0 2024-04-12T13:42:27.128 INFO:tasks.workunit.client.1.smithi110.stdout:6/974: read d7/fe0 [3921795,60073] 0 2024-04-12T13:42:27.129 INFO:tasks.workunit.client.0.smithi060.stdout:3/947: read - d7/d17/d27/d36/f99 zero size 2024-04-12T13:42:27.130 INFO:tasks.workunit.client.0.smithi060.stdout:0/886: fsync d7/d9/de/d80/dc8/fe2 0 2024-04-12T13:42:27.130 INFO:tasks.workunit.client.1.smithi110.stdout:0/931: creat d1/d48/d108/f152 x:0 0 0 2024-04-12T13:42:27.132 INFO:tasks.workunit.client.1.smithi110.stdout:5/946: mknod da/d2e/d45/d25/d9d/d7a/db5/d8f/c14c 0 2024-04-12T13:42:27.132 INFO:tasks.workunit.client.0.smithi060.stdout:6/932: sync 2024-04-12T13:42:27.134 INFO:tasks.workunit.client.0.smithi060.stdout:0/887: write d7/d9/d14/f132 [597666,56556] 0 2024-04-12T13:42:27.135 INFO:tasks.workunit.client.1.smithi110.stdout:1/973: dwrite de/d14/d83/fe4 [0,4194304] 0 2024-04-12T13:42:27.138 INFO:tasks.workunit.client.1.smithi110.stdout:5/947: mknod da/db/d15/de9/c14d 0 2024-04-12T13:42:27.139 INFO:tasks.workunit.client.1.smithi110.stdout:1/974: fdatasync de/d14/d34/d87/f125 0 2024-04-12T13:42:27.143 INFO:tasks.workunit.client.0.smithi060.stdout:9/877: dwrite d4/d8/fb [0,4194304] 0 2024-04-12T13:42:27.143 INFO:tasks.workunit.client.1.smithi110.stdout:0/932: rename d1/d27/d6e/fcf to d1/d3c/dd8/df4/d10f/f153 0 2024-04-12T13:42:27.146 INFO:tasks.workunit.client.1.smithi110.stdout:5/948: creat da/d2e/d45/d29/d148/f14e x:0 0 0 2024-04-12T13:42:27.148 INFO:tasks.workunit.client.1.smithi110.stdout:1/975: creat de/d15/d32/d61/d96/f142 x:0 0 0 2024-04-12T13:42:27.150 INFO:tasks.workunit.client.0.smithi060.stdout:6/933: fdatasync d1/d7/da/dc/d24/d30/d52/d5e/f9e 0 2024-04-12T13:42:27.151 INFO:tasks.workunit.client.1.smithi110.stdout:0/933: unlink d1/d56/fbc 0 2024-04-12T13:42:27.151 INFO:tasks.workunit.client.1.smithi110.stdout:3/976: dwrite d5/dc/d20/d2d/d4e/d89/d8c/f128 [0,4194304] 0 2024-04-12T13:42:27.153 INFO:tasks.workunit.client.0.smithi060.stdout:3/948: creat d7/d17/d27/d36/d53/da2/dbc/dfa/d11c/f130 x:0 0 0 2024-04-12T13:42:27.155 INFO:tasks.workunit.client.1.smithi110.stdout:5/949: mkdir da/d5c/d14f 0 2024-04-12T13:42:27.160 INFO:tasks.workunit.client.1.smithi110.stdout:1/976: unlink de/d15/dab/dd8/ff9 0 2024-04-12T13:42:27.164 INFO:tasks.workunit.client.1.smithi110.stdout:3/977: creat d5/dc/d20/d2d/d4e/d89/d8c/db6/f12d x:0 0 0 2024-04-12T13:42:27.166 INFO:tasks.workunit.client.0.smithi060.stdout:6/934: mknod d1/d7/da/dc/d24/d34/d51/d97/dc0/c12b 0 2024-04-12T13:42:27.168 INFO:tasks.workunit.client.1.smithi110.stdout:5/950: unlink da/db/f4c 0 2024-04-12T13:42:27.186 INFO:tasks.workunit.client.1.smithi110.stdout:5/951: dread da/db/d3b/d40/f47 [0,4194304] 0 2024-04-12T13:42:27.189 INFO:tasks.workunit.client.1.smithi110.stdout:0/934: rmdir d1/d3c/d14b 0 2024-04-12T13:42:27.189 INFO:tasks.workunit.client.0.smithi060.stdout:3/949: dread d7/d17/d19/dc9/d3f/d5c/d25/d4d/f6e [0,4194304] 0 2024-04-12T13:42:27.191 INFO:tasks.workunit.client.1.smithi110.stdout:0/935: chown d1/d8/d36/d65/c7b 55 1 2024-04-12T13:42:27.192 INFO:tasks.workunit.client.1.smithi110.stdout:0/936: chown d1/d48/db2 124363 1 2024-04-12T13:42:27.195 INFO:tasks.workunit.client.1.smithi110.stdout:0/937: write d1/d3c/da6/fdd [3444337,19229] 0 2024-04-12T13:42:27.201 INFO:tasks.workunit.client.1.smithi110.stdout:5/952: symlink da/d2e/d45/d25/d9d/d79/d88/d130/l150 0 2024-04-12T13:42:27.203 INFO:tasks.workunit.client.1.smithi110.stdout:5/953: chown da/d35/dd6 118957 1 2024-04-12T13:42:27.203 INFO:tasks.workunit.client.0.smithi060.stdout:6/935: dread d1/d7/da/dc/d24/d30/d52/fa4 [0,4194304] 0 2024-04-12T13:42:27.204 INFO:tasks.workunit.client.1.smithi110.stdout:3/978: creat d5/f12e x:0 0 0 2024-04-12T13:42:27.205 INFO:tasks.workunit.client.1.smithi110.stdout:0/938: rmdir d1/d48/d108 39 2024-04-12T13:42:27.209 INFO:tasks.workunit.client.1.smithi110.stdout:3/979: rmdir d5/dc/d20/d2d/d4e 39 2024-04-12T13:42:27.210 INFO:tasks.workunit.client.1.smithi110.stdout:0/939: chown d1/d8/d36/d51/d60/l42 1 1 2024-04-12T13:42:27.213 INFO:tasks.workunit.client.1.smithi110.stdout:3/980: chown d5/dc/f12 639635 1 2024-04-12T13:42:27.214 INFO:tasks.workunit.client.1.smithi110.stdout:5/954: truncate da/d2e/d45/d25/d9d/d7a/db5/ffc 1277479 0 2024-04-12T13:42:27.216 INFO:tasks.workunit.client.1.smithi110.stdout:0/940: creat d1/d8/d8a/f154 x:0 0 0 2024-04-12T13:42:27.218 INFO:tasks.workunit.client.1.smithi110.stdout:3/981: chown d5/dc/d31/d3b/l90 483 1 2024-04-12T13:42:27.218 INFO:tasks.workunit.client.1.smithi110.stdout:1/977: dwrite de/d14/d34/db4/fef [0,4194304] 0 2024-04-12T13:42:27.222 INFO:tasks.workunit.client.1.smithi110.stdout:5/955: read da/db/d3b/d40/da6/f107 [547275,99067] 0 2024-04-12T13:42:27.226 INFO:tasks.workunit.client.1.smithi110.stdout:1/978: chown de/d15/d32/d61/d96/c12b 101 1 2024-04-12T13:42:27.228 INFO:tasks.workunit.client.0.smithi060.stdout:2/919: sync 2024-04-12T13:42:27.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/879: sync 2024-04-12T13:42:27.228 INFO:tasks.workunit.client.0.smithi060.stdout:8/872: sync 2024-04-12T13:42:27.238 INFO:tasks.workunit.client.1.smithi110.stdout:5/956: mknod da/dfb/c151 0 2024-04-12T13:42:27.241 INFO:tasks.workunit.client.1.smithi110.stdout:1/979: chown de/d1d/d86/fa3 62531 1 2024-04-12T13:42:27.242 INFO:tasks.workunit.client.1.smithi110.stdout:3/982: rename d5/dc/da0/c110 to d5/dc/d20/d2d/d4e/d89/db4/c12f 0 2024-04-12T13:42:27.246 INFO:tasks.workunit.client.1.smithi110.stdout:5/957: creat da/d2e/d45/d25/d9d/d79/d88/d130/f152 x:0 0 0 2024-04-12T13:42:27.248 INFO:tasks.workunit.client.1.smithi110.stdout:1/980: mkdir de/d15/dab/dd8/d103/d143 0 2024-04-12T13:42:27.249 INFO:tasks.workunit.client.0.smithi060.stdout:0/888: getdents d7/d9/de/d80/dc8/d10d 0 2024-04-12T13:42:27.251 INFO:tasks.workunit.client.0.smithi060.stdout:0/889: fdatasync d7/d9/de/d80/f123 0 2024-04-12T13:42:27.256 INFO:tasks.workunit.client.1.smithi110.stdout:6/975: sync 2024-04-12T13:42:27.256 INFO:tasks.workunit.client.1.smithi110.stdout:0/941: dwrite d1/d8/d36/d65/f6c [0,4194304] 0 2024-04-12T13:42:27.257 INFO:tasks.workunit.client.0.smithi060.stdout:9/878: getdents d4/d33/d50/dd0 0 2024-04-12T13:42:27.259 INFO:tasks.workunit.client.1.smithi110.stdout:0/942: write d1/d5e/fd1 [1144294,58285] 0 2024-04-12T13:42:27.261 INFO:tasks.workunit.client.1.smithi110.stdout:1/981: rename de/d14/d34/d87 to de/d15/d32/d61/d96/d144 0 2024-04-12T13:42:27.263 INFO:tasks.workunit.client.1.smithi110.stdout:5/958: mkdir da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/d7c/d153 0 2024-04-12T13:42:27.263 INFO:tasks.workunit.client.1.smithi110.stdout:3/983: dread d5/f99 [0,4194304] 0 2024-04-12T13:42:27.267 INFO:tasks.workunit.client.1.smithi110.stdout:6/976: symlink d7/d25/d2c/d4c/d77/d93/d112/l134 0 2024-04-12T13:42:27.269 INFO:tasks.workunit.client.0.smithi060.stdout:4/880: mknod d6/d7/dd/d1a/d57/d63/c118 0 2024-04-12T13:42:27.273 INFO:tasks.workunit.client.0.smithi060.stdout:8/873: truncate d9/f1f 6562658 0 2024-04-12T13:42:27.274 INFO:tasks.workunit.client.1.smithi110.stdout:0/943: truncate d1/d5e/f9f 812632 0 2024-04-12T13:42:27.275 INFO:tasks.workunit.client.0.smithi060.stdout:8/874: chown d9/d1b/d3c/f56 21 1 2024-04-12T13:42:27.276 INFO:tasks.workunit.client.0.smithi060.stdout:9/879: dread - d4/d8/df1/d67/ffc zero size 2024-04-12T13:42:27.276 INFO:tasks.workunit.client.1.smithi110.stdout:3/984: chown d5/dc/c16 1926 1 2024-04-12T13:42:27.279 INFO:tasks.workunit.client.0.smithi060.stdout:9/880: write d4/d9/f2a [2890468,94890] 0 2024-04-12T13:42:27.279 INFO:tasks.workunit.client.1.smithi110.stdout:5/959: rename da/d2e/d45/d29/d32/c53 to da/d2e/d45/d25/d9d/d7a/c154 0 2024-04-12T13:42:27.282 INFO:tasks.workunit.client.0.smithi060.stdout:0/890: dread d7/fa3 [0,4194304] 0 2024-04-12T13:42:27.284 INFO:tasks.workunit.client.0.smithi060.stdout:4/881: creat d6/d7/dd/d1a/d19/d7a/da8/d10a/f119 x:0 0 0 2024-04-12T13:42:27.284 INFO:tasks.workunit.client.0.smithi060.stdout:6/936: write d1/d7/da/d20/f4e [5172299,129737] 0 2024-04-12T13:42:27.285 INFO:tasks.workunit.client.0.smithi060.stdout:8/875: creat d9/d1b/d84/f132 x:0 0 0 2024-04-12T13:42:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.284+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7b0115f90 con 0x7fc79406bd40 2024-04-12T13:42:27.287 INFO:tasks.workunit.client.0.smithi060.stdout:2/920: write d6/d56/d58/da0/f5c [47843,3540] 0 2024-04-12T13:42:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.286+0000 7fc7a6000700 1 -- 172.21.15.60:0/18399648 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc7b0115f90 con 0x7fc79406bd40 2024-04-12T13:42:27.289 INFO:tasks.workunit.client.0.smithi060.stdout:9/881: fdatasync d4/d8/df1/fae 0 2024-04-12T13:42:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 msgr2=0x7fc79406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 0x7fc79406e1f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000b3b0 tx=0x7fc7a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 msgr2=0x7fc7b01145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00c8c0 tx=0x7fc79c0044c0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 shutdown_connections 2024-04-12T13:42:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fc79406bd40 0x7fc79406e1f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7b00662f0 0x7fc7b0114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 --2- 172.21.15.60:0/18399648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b00fdd60 0x7fc7b01145a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.291+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 >> 172.21.15.60:0/18399648 conn(0x7fc7b00f74c0 msgr2=0x7fc7b00f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.292+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 shutdown_connections 2024-04-12T13:42:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.292+0000 7fc7b5000700 1 -- 172.21.15.60:0/18399648 wait complete. 2024-04-12T13:42:27.301 INFO:tasks.workunit.client.1.smithi110.stdout:3/985: dwrite d5/dc/d20/d2d/d4e/d89/d8c/f128 [0,4194304] 0 2024-04-12T13:42:27.303 INFO:tasks.workunit.client.1.smithi110.stdout:5/960: dwrite da/d2e/d45/d29/f2d [0,4194304] 0 2024-04-12T13:42:27.303 INFO:tasks.workunit.client.0.smithi060.stdout:9/882: creat d4/d33/d50/dd0/d104/f122 x:0 0 0 2024-04-12T13:42:27.306 INFO:tasks.workunit.client.1.smithi110.stdout:5/961: write da/d2e/d45/d29/f48 [2911532,43314] 0 2024-04-12T13:42:27.314 INFO:tasks.workunit.client.1.smithi110.stdout:6/977: getdents d7/d10/d7e/d85/dd0 0 2024-04-12T13:42:27.319 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:42:27.322 INFO:tasks.workunit.client.1.smithi110.stdout:0/944: getdents d1/d8/d8a/dc8 0 2024-04-12T13:42:27.324 INFO:tasks.workunit.client.0.smithi060.stdout:8/876: creat d9/dc9/d121/f133 x:0 0 0 2024-04-12T13:42:27.328 INFO:tasks.workunit.client.0.smithi060.stdout:4/882: dread d6/d21/f41 [0,4194304] 0 2024-04-12T13:42:27.333 INFO:tasks.workunit.client.1.smithi110.stdout:5/962: fsync da/db/f1d 0 2024-04-12T13:42:27.334 INFO:tasks.workunit.client.1.smithi110.stdout:1/982: dwrite de/d15/d32/f71 [0,4194304] 0 2024-04-12T13:42:27.337 INFO:tasks.workunit.client.1.smithi110.stdout:6/978: symlink d7/d10/d1c/d2b/d3a/dbf/de2/l135 0 2024-04-12T13:42:27.340 INFO:tasks.workunit.client.1.smithi110.stdout:0/945: rename d1/d8/d36/fa2 to d1/d48/db2/f155 0 2024-04-12T13:42:27.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/877: truncate d9/d1b/d2b/d82/d8a/fb8 9272 0 2024-04-12T13:42:27.348 INFO:tasks.workunit.client.0.smithi060.stdout:4/883: creat d6/d7/dd/d1a/d57/d63/df4/d85/f11a x:0 0 0 2024-04-12T13:42:27.350 INFO:tasks.workunit.client.0.smithi060.stdout:6/937: link d1/l13 d1/d7/da/dc/dac/dca/l12c 0 2024-04-12T13:42:27.352 INFO:tasks.workunit.client.1.smithi110.stdout:5/963: rename da/d2e/d45/f90 to da/d2e/d45/d25/d9d/d79/d88/d121/f155 0 2024-04-12T13:42:27.352 INFO:tasks.workunit.client.0.smithi060.stdout:0/891: dwrite d7/d9/d14/d4a/f5f [0,4194304] 0 2024-04-12T13:42:27.357 INFO:tasks.workunit.client.1.smithi110.stdout:3/986: dwrite d5/dc/f13 [0,4194304] 0 2024-04-12T13:42:27.359 INFO:tasks.workunit.client.0.smithi060.stdout:2/921: dwrite d6/dae/d5b/d6d/de1/ff7 [0,4194304] 0 2024-04-12T13:42:27.362 INFO:tasks.workunit.client.0.smithi060.stdout:5/921: sync 2024-04-12T13:42:27.363 INFO:tasks.workunit.client.0.smithi060.stdout:7/895: sync 2024-04-12T13:42:27.364 INFO:tasks.workunit.client.1.smithi110.stdout:6/979: dwrite d7/fd5 [0,4194304] 0 2024-04-12T13:42:27.367 INFO:tasks.workunit.client.0.smithi060.stdout:2/922: write d6/d64/d99/df0/fe3 [499740,30436] 0 2024-04-12T13:42:27.371 INFO:tasks.workunit.client.1.smithi110.stdout:1/983: dwrite de/d15/d32/d61/d6a/dac/fdf [4194304,4194304] 0 2024-04-12T13:42:27.376 INFO:tasks.workunit.client.1.smithi110.stdout:5/964: dwrite da/d2e/d45/d29/f48 [4194304,4194304] 0 2024-04-12T13:42:27.377 INFO:tasks.workunit.client.0.smithi060.stdout:0/892: readlink d7/d9/d14/d4a/l5e 0 2024-04-12T13:42:27.386 INFO:tasks.workunit.client.1.smithi110.stdout:0/946: link d1/d56/deb/d109/l10a d1/d27/d31/d67/dcb/l156 0 2024-04-12T13:42:27.386 INFO:tasks.workunit.client.0.smithi060.stdout:9/883: getdents d4/d33/d50/dd0/d104/d110 0 2024-04-12T13:42:27.388 INFO:tasks.workunit.client.0.smithi060.stdout:5/922: dwrite d6/ff7 [0,4194304] 0 2024-04-12T13:42:27.390 INFO:tasks.workunit.client.1.smithi110.stdout:3/987: mkdir d5/dc/d31/d3b/d32/d3e/d130 0 2024-04-12T13:42:27.392 INFO:tasks.workunit.client.1.smithi110.stdout:1/984: creat de/d15/dab/dd8/dd9/dda/f145 x:0 0 0 2024-04-12T13:42:27.403 INFO:tasks.workunit.client.1.smithi110.stdout:0/947: unlink d1/d8/d36/d51/d60/fda 0 2024-04-12T13:42:27.404 INFO:tasks.workunit.client.1.smithi110.stdout:0/948: stat d1/d48/db2/d4a/f4f 0 2024-04-12T13:42:27.408 INFO:tasks.workunit.client.1.smithi110.stdout:1/985: creat de/d15/dab/f146 x:0 0 0 2024-04-12T13:42:27.409 INFO:tasks.workunit.client.0.smithi060.stdout:4/884: rename d6/d7/dd to d6/d2f/d7d/d11b 0 2024-04-12T13:42:27.409 INFO:tasks.workunit.client.1.smithi110.stdout:1/986: chown de/c98 20619 1 2024-04-12T13:42:27.417 INFO:tasks.workunit.client.0.smithi060.stdout:6/938: creat d1/d7/da/dc/d24/d122/f12d x:0 0 0 2024-04-12T13:42:27.420 INFO:tasks.workunit.client.1.smithi110.stdout:0/949: dread - d1/d27/d31/d89/f11e zero size 2024-04-12T13:42:27.422 INFO:tasks.workunit.client.1.smithi110.stdout:5/965: dread da/db/f1d [0,4194304] 0 2024-04-12T13:42:27.423 INFO:tasks.workunit.client.0.smithi060.stdout:8/878: dread d9/d1d/f33 [0,4194304] 0 2024-04-12T13:42:27.425 INFO:tasks.workunit.client.0.smithi060.stdout:9/884: creat d4/d9/d19/d8c/d92/f123 x:0 0 0 2024-04-12T13:42:27.425 INFO:tasks.workunit.client.0.smithi060.stdout:8/879: chown d9/d1d/d5e/ded 307140 1 2024-04-12T13:42:27.426 INFO:tasks.workunit.client.1.smithi110.stdout:1/987: creat de/d15/dab/f147 x:0 0 0 2024-04-12T13:42:27.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/923: fdatasync d6/dd/d1f/dd3/d5f/f10a 0 2024-04-12T13:42:27.428 INFO:tasks.workunit.client.1.smithi110.stdout:0/950: fsync d1/d8/d36/d51/f69 0 2024-04-12T13:42:27.430 INFO:tasks.workunit.client.0.smithi060.stdout:2/923: mkdir d6/d64/d99/df0/d11b 0 2024-04-12T13:42:27.432 INFO:tasks.workunit.client.1.smithi110.stdout:5/966: mknod da/d2e/d45/d25/d9d/d7a/c156 0 2024-04-12T13:42:27.434 INFO:tasks.workunit.client.1.smithi110.stdout:1/988: rename de/d15/d32/d61/d96/ldb to de/d14/dd0/l148 0 2024-04-12T13:42:27.435 INFO:tasks.workunit.client.1.smithi110.stdout:1/989: dread - de/d15/dab/f146 zero size 2024-04-12T13:42:27.438 INFO:tasks.workunit.client.1.smithi110.stdout:0/951: creat d1/d56/deb/d109/f157 x:0 0 0 2024-04-12T13:42:27.440 INFO:tasks.workunit.client.0.smithi060.stdout:9/885: truncate d4/d9/d19/f6a 611071 0 2024-04-12T13:42:27.445 INFO:tasks.workunit.client.0.smithi060.stdout:5/924: symlink d6/dd/d1f/d25/d42/d52/dc8/l12d 0 2024-04-12T13:42:27.447 INFO:tasks.workunit.client.0.smithi060.stdout:9/886: truncate d4/d33/d50/dd0/d104/f122 103198 0 2024-04-12T13:42:27.449 INFO:tasks.workunit.client.1.smithi110.stdout:1/990: symlink de/d7b/da1/l149 0 2024-04-12T13:42:27.452 INFO:tasks.workunit.client.1.smithi110.stdout:0/952: fdatasync d1/d27/d6e/f96 0 2024-04-12T13:42:27.454 INFO:tasks.workunit.client.0.smithi060.stdout:4/885: unlink d6/d2f/d7d/d11b/d1a/d57/d63/d68/d76/dbd/ld8 0 2024-04-12T13:42:27.456 INFO:tasks.workunit.client.0.smithi060.stdout:6/939: symlink d1/d7/da/dc/d7a/de1/dfe/l12e 0 2024-04-12T13:42:27.458 INFO:tasks.workunit.client.1.smithi110.stdout:1/991: creat de/d15/da9/f14a x:0 0 0 2024-04-12T13:42:27.460 INFO:tasks.workunit.client.1.smithi110.stdout:1/992: dread - de/d15/d32/d61/d96/f142 zero size 2024-04-12T13:42:27.462 INFO:tasks.workunit.client.1.smithi110.stdout:1/993: chown de/d14/d34/d55/d6b/fe5 79045366 1 2024-04-12T13:42:27.463 INFO:tasks.workunit.client.0.smithi060.stdout:9/887: creat d4/d9/d19/daf/d101/de8/d100/f124 x:0 0 0 2024-04-12T13:42:27.470 INFO:tasks.workunit.client.0.smithi060.stdout:9/888: readlink d4/d33/d50/dd0/d104/d110/l118 0 2024-04-12T13:42:27.472 INFO:tasks.workunit.client.1.smithi110.stdout:1/994: unlink de/d14/d34/d55/d6b/c13d 0 2024-04-12T13:42:27.474 INFO:tasks.workunit.client.0.smithi060.stdout:9/889: chown d4/d33/d50/dd0/fe6 4 1 2024-04-12T13:42:27.474 INFO:tasks.workunit.client.1.smithi110.stdout:1/995: readlink de/d14/d34/db4/lcb 0 2024-04-12T13:42:27.476 INFO:tasks.workunit.client.0.smithi060.stdout:6/940: dread d1/d7/da/dc/f75 [0,4194304] 0 2024-04-12T13:42:27.481 INFO:tasks.workunit.client.0.smithi060.stdout:4/886: dwrite d6/d2f/ffd [0,4194304] 0 2024-04-12T13:42:27.482 INFO:tasks.workunit.client.1.smithi110.stdout:1/996: mknod de/d15/da9/c14b 0 2024-04-12T13:42:27.482 INFO:tasks.workunit.client.0.smithi060.stdout:8/880: dwrite d9/d1b/d2b/d82/f8e [0,4194304] 0 2024-04-12T13:42:27.483 INFO:tasks.workunit.client.1.smithi110.stdout:5/967: dwrite da/d2e/d45/d29/f7e [4194304,4194304] 0 2024-04-12T13:42:27.484 INFO:tasks.workunit.client.0.smithi060.stdout:9/890: mkdir d4/d9/d19/d125 0 2024-04-12T13:42:27.486 INFO:tasks.workunit.client.1.smithi110.stdout:5/968: chown da/d2e/d45/d25/d9d/d7a/dae/d101 3045015 1 2024-04-12T13:42:27.490 INFO:tasks.workunit.client.1.smithi110.stdout:0/953: dread d1/d48/db2/f82 [0,4194304] 0 2024-04-12T13:42:27.491 INFO:tasks.workunit.client.0.smithi060.stdout:8/881: mkdir d9/d1d/d5e/d134 0 2024-04-12T13:42:27.493 INFO:tasks.workunit.client.0.smithi060.stdout:2/924: write d6/d56/d58/da0/f6f [1353140,72939] 0 2024-04-12T13:42:27.493 INFO:tasks.workunit.client.1.smithi110.stdout:1/997: rename de/d15/d32/d61/d96/f142 to de/d14/d34/d108/d10e/f14c 0 2024-04-12T13:42:27.493 INFO:tasks.workunit.client.0.smithi060.stdout:8/882: chown d9/d1b/d37/d4d/d63/d66/d8b 15502741 1 2024-04-12T13:42:27.496 INFO:tasks.workunit.client.0.smithi060.stdout:2/925: readlink d6/d56/d55/lc1 0 2024-04-12T13:42:27.500 INFO:tasks.workunit.client.1.smithi110.stdout:0/954: rmdir d1/d8/d36/d51 39 2024-04-12T13:42:27.501 INFO:tasks.workunit.client.1.smithi110.stdout:6/980: sync 2024-04-12T13:42:27.501 INFO:tasks.workunit.client.1.smithi110.stdout:3/988: sync 2024-04-12T13:42:27.502 INFO:tasks.workunit.client.1.smithi110.stdout:1/998: fsync de/d15/dab/dd8/dd9/dda/fa7 0 2024-04-12T13:42:27.509 INFO:tasks.workunit.client.0.smithi060.stdout:5/925: dwrite d6/dd/d1f/dd3/df3/d38/fda [0,4194304] 0 2024-04-12T13:42:27.510 INFO:tasks.workunit.client.1.smithi110.stdout:5/969: mkdir da/d35/d157 0 2024-04-12T13:42:27.516 INFO:tasks.workunit.client.0.smithi060.stdout:4/887: rmdir d6/d2f/d7d/d11b/d1a/d57/dc7/df0 0 2024-04-12T13:42:27.518 INFO:tasks.workunit.client.0.smithi060.stdout:5/926: fdatasync d6/dd/d1f/d25/d53/d8d/f121 0 2024-04-12T13:42:27.524 INFO:tasks.workunit.client.0.smithi060.stdout:9/891: dwrite d4/d9/f2a [0,4194304] 0 2024-04-12T13:42:27.526 INFO:tasks.workunit.client.1.smithi110.stdout:0/955: dread d1/d3c/dd8/f148 [0,4194304] 0 2024-04-12T13:42:27.527 INFO:tasks.workunit.client.0.smithi060.stdout:9/892: chown d4/d8/d7c/dee/c113 4138689 1 2024-04-12T13:42:27.527 INFO:tasks.workunit.client.0.smithi060.stdout:8/883: symlink d9/d1b/d37/d48/d10d/l135 0 2024-04-12T13:42:27.529 INFO:tasks.workunit.client.0.smithi060.stdout:3/950: sync 2024-04-12T13:42:27.534 INFO:tasks.workunit.client.1.smithi110.stdout:3/989: dread d5/dc/da0/fc4 [0,4194304] 0 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 -- 172.21.15.60:0/3326525366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 msgr2=0x7f117406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 --2- 172.21.15.60:0/3326525366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f117406f160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1164004940 tx=0x7f1164009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 -- 172.21.15.60:0/3326525366 shutdown_connections 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 --2- 172.21.15.60:0/3326525366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f117406f160 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 --2- 172.21.15.60:0/3326525366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f117406e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.535+0000 7f1179a00700 1 -- 172.21.15.60:0/3326525366 >> 172.21.15.60:0/3326525366 conn(0x7f117406a390 msgr2=0x7f117406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:27.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.536+0000 7f1179a00700 1 -- 172.21.15.60:0/3326525366 shutdown_connections 2024-04-12T13:42:27.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.536+0000 7f1179a00700 1 -- 172.21.15.60:0/3326525366 wait complete. 2024-04-12T13:42:27.539 INFO:tasks.workunit.client.0.smithi060.stdout:2/926: mkdir d6/d64/d99/df0/d11c 0 2024-04-12T13:42:27.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.537+0000 7f1179a00700 1 Processor -- start 2024-04-12T13:42:27.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.538+0000 7f1179a00700 1 -- start start 2024-04-12T13:42:27.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.538+0000 7f1179a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:27.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.538+0000 7f1179a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f1174118840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:27.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.538+0000 7f1179a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174118ed0 con 0x7f1174066ad0 2024-04-12T13:42:27.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.538+0000 7f1179a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117411d870 con 0x7f117406ecf0 2024-04-12T13:42:27.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.539+0000 7f1172a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:27.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/941: dwrite d1/d7/da/dc/d24/d30/dd8/fe2 [4194304,4194304] 0 2024-04-12T13:42:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.539+0000 7f1172a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57954/0 (socket says 172.21.15.60:57954) 2024-04-12T13:42:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.539+0000 7f1172a00700 1 -- 172.21.15.60:0/3076804827 learned_addr learned my addr 172.21.15.60:0/3076804827 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.539+0000 7f1172000700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f1174118840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.540+0000 7f1172a00700 1 -- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 msgr2=0x7f1174118840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.540+0000 7f1172a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f1174118840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.540+0000 7f1172a00700 1 -- 172.21.15.60:0/3076804827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164005040 con 0x7f1174066ad0 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.540+0000 7f1172a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f116000b790 tx=0x7f1160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.541+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116000f770 con 0x7f1174066ad0 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.541+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f116000fda0 con 0x7f1174066ad0 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.541+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116000d310 con 0x7f1174066ad0 2024-04-12T13:42:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.541+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117411dad0 con 0x7f1174066ad0 2024-04-12T13:42:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.541+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117411e040 con 0x7f1174066ad0 2024-04-12T13:42:27.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.544+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11540052e0 con 0x7f1174066ad0 2024-04-12T13:42:27.548 INFO:tasks.workunit.client.0.smithi060.stdout:6/942: chown d1/d7/da/dc/d24/d2d/l73 120384 1 2024-04-12T13:42:27.551 INFO:tasks.workunit.client.1.smithi110.stdout:5/970: creat da/d2e/d45/d25/d9d/d79/d88/dd3/f158 x:0 0 0 2024-04-12T13:42:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.549+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f11600107d0 con 0x7f1174066ad0 2024-04-12T13:42:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.551+0000 7f116aa00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 0x7f115806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.551+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f116008b070 con 0x7f1174066ad0 2024-04-12T13:42:27.554 INFO:tasks.workunit.client.0.smithi060.stdout:6/943: chown d1/d7/da/dc/d7a/de1/d113/c8d 1933225 1 2024-04-12T13:42:27.554 INFO:tasks.workunit.client.1.smithi110.stdout:5/971: dread - da/d2e/d45/d25/d9d/d7a/dae/d101/f119 zero size 2024-04-12T13:42:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.552+0000 7f1172000700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 0x7f115806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:27.555 INFO:tasks.workunit.client.0.smithi060.stdout:5/927: stat d6/d10/db8/dee/dfc/d46/f62 0 2024-04-12T13:42:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.555+0000 7f1172000700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 0x7f115806e1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1164009fd0 tx=0x7f1164009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:27.560 INFO:tasks.workunit.client.1.smithi110.stdout:6/981: write d7/d25/d2c/d4c/d77/f8a [627038,120133] 0 2024-04-12T13:42:27.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.559+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f11600582a0 con 0x7f1174066ad0 2024-04-12T13:42:27.565 INFO:tasks.workunit.client.0.smithi060.stdout:9/893: truncate d4/fa1 1120040 0 2024-04-12T13:42:27.567 INFO:tasks.workunit.client.1.smithi110.stdout:1/999: readlink de/d14/d34/d55/d6b/l94 0 2024-04-12T13:42:27.570 INFO:tasks.workunit.client.0.smithi060.stdout:2/927: truncate d6/dae/d5b/f78 1519769 0 2024-04-12T13:42:27.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/951: dread d7/d17/d19/dc9/d3f/d5c/fdb [0,4194304] 0 2024-04-12T13:42:27.573 INFO:tasks.workunit.client.0.smithi060.stdout:5/928: creat d6/dd/d1f/d25/d35/f12e x:0 0 0 2024-04-12T13:42:27.574 INFO:tasks.workunit.client.0.smithi060.stdout:8/884: write d9/d1b/d3c/f56 [950960,1046] 0 2024-04-12T13:42:27.576 INFO:tasks.workunit.client.1.smithi110.stdout:5/972: fdatasync da/db/d15/f1a 0 2024-04-12T13:42:27.579 INFO:tasks.workunit.client.1.smithi110.stdout:3/990: mknod d5/dc/d31/d3b/d32/dd3/c131 0 2024-04-12T13:42:27.584 INFO:tasks.workunit.client.0.smithi060.stdout:4/888: dwrite d6/d2f/d7d/d11b/d1a/d19/f33 [0,4194304] 0 2024-04-12T13:42:27.584 INFO:tasks.workunit.client.0.smithi060.stdout:3/952: rmdir d7/d17/d19/d96 39 2024-04-12T13:42:27.586 INFO:tasks.workunit.client.1.smithi110.stdout:5/973: mknod da/d2e/d45/d25/d9d/d7a/c159 0 2024-04-12T13:42:27.588 INFO:tasks.workunit.client.0.smithi060.stdout:4/889: stat d6/d2f/d7d/d11b/l100 0 2024-04-12T13:42:27.589 INFO:tasks.workunit.client.1.smithi110.stdout:3/991: creat d5/dc/d31/d3b/d5b/df5/f132 x:0 0 0 2024-04-12T13:42:27.592 INFO:tasks.workunit.client.0.smithi060.stdout:2/928: rename d6/d64/d99/df0/c3b to d6/d64/d10f/c11d 0 2024-04-12T13:42:27.593 INFO:tasks.workunit.client.1.smithi110.stdout:6/982: link d7/d25/d30/d44/d3d/f47 d7/d25/d2c/d4c/d77/d103/f136 0 2024-04-12T13:42:27.594 INFO:tasks.workunit.client.1.smithi110.stdout:0/956: truncate d1/d56/f114 3158881 0 2024-04-12T13:42:27.598 INFO:tasks.workunit.client.1.smithi110.stdout:5/974: dread - da/d2e/d45/d29/d58/f141 zero size 2024-04-12T13:42:27.602 INFO:tasks.workunit.client.0.smithi060.stdout:6/944: truncate d1/d7/da/dc/fcf 1931007 0 2024-04-12T13:42:27.617 INFO:tasks.workunit.client.1.smithi110.stdout:6/983: mkdir d7/da4/d100/d137 0 2024-04-12T13:42:27.619 INFO:tasks.workunit.client.1.smithi110.stdout:3/992: dwrite d5/dc/d20/d2d/d4e/d89/d8c/dc5/dd5/df9/fdf [0,4194304] 0 2024-04-12T13:42:27.620 INFO:tasks.workunit.client.0.smithi060.stdout:9/894: getdents d4 0 2024-04-12T13:42:27.621 INFO:tasks.workunit.client.1.smithi110.stdout:5/975: write da/d2e/d45/d25/d9d/d7a/db5/fce [1754074,26472] 0 2024-04-12T13:42:27.622 INFO:tasks.workunit.client.1.smithi110.stdout:0/957: write d1/d3c/dd8/f112 [3516165,2916] 0 2024-04-12T13:42:27.625 INFO:tasks.workunit.client.0.smithi060.stdout:9/895: truncate d4/d33/d50/dd0/d104/f122 355227 0 2024-04-12T13:42:27.627 INFO:tasks.workunit.client.1.smithi110.stdout:6/984: fdatasync d7/f39 0 2024-04-12T13:42:27.627 INFO:tasks.workunit.client.0.smithi060.stdout:2/929: mkdir d6/d56/d55/d113/d11e 0 2024-04-12T13:42:27.629 INFO:tasks.workunit.client.0.smithi060.stdout:5/929: link d6/dd/d1f/d25/d42/d52/f101 d6/dd/d1f/dd3/de7/f12f 0 2024-04-12T13:42:27.631 INFO:tasks.workunit.client.0.smithi060.stdout:3/953: dread d7/f8 [0,4194304] 0 2024-04-12T13:42:27.632 INFO:tasks.workunit.client.0.smithi060.stdout:9/896: fsync d4/d33/d65/fc9 0 2024-04-12T13:42:27.632 INFO:tasks.workunit.client.1.smithi110.stdout:3/993: read d5/dc/d20/d2d/d4e/d89/d8c/dc5/f126 [2659425,53774] 0 2024-04-12T13:42:27.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/890: link d6/d2f/d7d/d11b/d1a/d19/f5a d6/d2f/d7d/d11b/d1a/d19/d42/d7c/f11c 0 2024-04-12T13:42:27.634 INFO:tasks.workunit.client.1.smithi110.stdout:6/985: creat d7/d25/d30/f138 x:0 0 0 2024-04-12T13:42:27.636 INFO:tasks.workunit.client.0.smithi060.stdout:2/930: creat d6/dae/d31/d33/f11f x:0 0 0 2024-04-12T13:42:27.637 INFO:tasks.workunit.client.0.smithi060.stdout:9/897: chown d4/d8/f40 13549 1 2024-04-12T13:42:27.638 INFO:tasks.workunit.client.1.smithi110.stdout:5/976: symlink da/d2e/d45/d25/d9d/d7a/db5/df3/d11c/l15a 0 2024-04-12T13:42:27.640 INFO:tasks.workunit.client.1.smithi110.stdout:5/977: chown da/d2e/d45/d25/f43 1 1 2024-04-12T13:42:27.642 INFO:tasks.workunit.client.1.smithi110.stdout:5/978: fdatasync da/d2e/d45/d29/d148/dea/f137 0 2024-04-12T13:42:27.647 INFO:tasks.workunit.client.1.smithi110.stdout:0/958: getdents d1/d27/d31/d67 0 2024-04-12T13:42:27.650 INFO:tasks.workunit.client.1.smithi110.stdout:3/994: creat d5/dc/d20/d2d/d4e/d89/f133 x:0 0 0 2024-04-12T13:42:27.658 INFO:tasks.workunit.client.0.smithi060.stdout:5/930: link d6/dd/d1f/d25/f34 d6/dd/d1f/d25/f130 0 2024-04-12T13:42:27.667 INFO:tasks.workunit.client.0.smithi060.stdout:6/945: dwrite d1/d7/da/dc/f35 [0,4194304] 0 2024-04-12T13:42:27.669 INFO:tasks.workunit.client.0.smithi060.stdout:9/898: dwrite d4/d9/d19/d8c/f107 [0,4194304] 0 2024-04-12T13:42:27.669 INFO:tasks.workunit.client.0.smithi060.stdout:3/954: write d7/d17/d27/d36/f99 [920952,75177] 0 2024-04-12T13:42:27.675 INFO:tasks.workunit.client.0.smithi060.stdout:5/931: symlink d6/dd/d1f/dd3/l131 0 2024-04-12T13:42:27.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/899: chown d4/d33/ca4 20 1 2024-04-12T13:42:27.677 INFO:tasks.workunit.client.0.smithi060.stdout:6/946: readlink d1/d7/da/dc/d24/d30/d52/d5e/d7b/l117 0 2024-04-12T13:42:27.679 INFO:tasks.workunit.client.1.smithi110.stdout:0/959: dread d1/d8/d36/d51/d60/fe9 [0,4194304] 0 2024-04-12T13:42:27.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/891: dwrite d6/d2f/d7d/d11b/df/fc0 [0,4194304] 0 2024-04-12T13:42:27.682 INFO:tasks.workunit.client.1.smithi110.stdout:3/995: write d5/dc/d20/d2d/f3c [189681,80585] 0 2024-04-12T13:42:27.683 INFO:tasks.workunit.client.0.smithi060.stdout:9/900: unlink d4/d33/d65/d7a/f105 0 2024-04-12T13:42:27.684 INFO:tasks.workunit.client.0.smithi060.stdout:3/955: creat d7/d17/d27/d36/db0/dd9/f131 x:0 0 0 2024-04-12T13:42:27.685 INFO:tasks.workunit.client.1.smithi110.stdout:5/979: dwrite da/d2e/d45/d25/d9d/d7a/dae/fe5 [0,4194304] 0 2024-04-12T13:42:27.686 INFO:tasks.workunit.client.1.smithi110.stdout:0/960: chown d1/d8/d8a/dce/ce5 57030 1 2024-04-12T13:42:27.686 INFO:tasks.workunit.client.0.smithi060.stdout:9/901: stat d4/d9/d19/d21/f31 0 2024-04-12T13:42:27.687 INFO:tasks.workunit.client.0.smithi060.stdout:6/947: chown d1/d7/da/dc/d24/d34/d51/d97/dc0/c12b 53 1 2024-04-12T13:42:27.688 INFO:tasks.workunit.client.0.smithi060.stdout:4/892: write d6/d21/d29/f10f [381472,130001] 0 2024-04-12T13:42:27.688 INFO:tasks.workunit.client.1.smithi110.stdout:3/996: fdatasync d5/dc/d20/d2d/d4e/d89/d8c/db6/f12d 0 2024-04-12T13:42:27.688 INFO:tasks.workunit.client.0.smithi060.stdout:5/932: symlink d6/dd/d1f/dd3/df3/d38/l132 0 2024-04-12T13:42:27.695 INFO:tasks.workunit.client.1.smithi110.stdout:0/961: dread d1/d56/f118 [0,4194304] 0 2024-04-12T13:42:27.702 INFO:tasks.workunit.client.0.smithi060.stdout:3/956: chown d7/d17/d19/d96/fc5 2 1 2024-04-12T13:42:27.705 INFO:tasks.workunit.client.1.smithi110.stdout:0/962: creat d1/d56/deb/f158 x:0 0 0 2024-04-12T13:42:27.707 INFO:tasks.workunit.client.1.smithi110.stdout:3/997: dwrite d5/dc/d31/d3b/d32/f3f [0,4194304] 0 2024-04-12T13:42:27.712 INFO:tasks.workunit.client.0.smithi060.stdout:9/902: chown d4/d8/db8/ld2 9787 1 2024-04-12T13:42:27.715 INFO:tasks.workunit.client.1.smithi110.stdout:5/980: dread da/d2e/d45/faa [4194304,4194304] 0 2024-04-12T13:42:27.715 INFO:tasks.workunit.client.1.smithi110.stdout:3/998: symlink d5/dc/da0/l134 0 2024-04-12T13:42:27.716 INFO:tasks.workunit.client.0.smithi060.stdout:4/893: creat d6/d2f/d7d/d11b/d1a/f11d x:0 0 0 2024-04-12T13:42:27.717 INFO:tasks.workunit.client.1.smithi110.stdout:5/981: readlink da/db/d3b/d40/l104 0 2024-04-12T13:42:27.721 INFO:tasks.workunit.client.1.smithi110.stdout:0/963: mkdir d1/d115/d159 0 2024-04-12T13:42:27.722 INFO:tasks.workunit.client.0.smithi060.stdout:5/933: dread d6/dd/d1f/d25/d42/d6b/f76 [0,4194304] 0 2024-04-12T13:42:27.723 INFO:tasks.workunit.client.1.smithi110.stdout:6/986: sync 2024-04-12T13:42:27.723 INFO:tasks.workunit.client.1.smithi110.stdout:0/964: chown d1/d56/deb/f144 860 1 2024-04-12T13:42:27.724 INFO:tasks.workunit.client.0.smithi060.stdout:9/903: truncate d4/d8/f4d 306330 0 2024-04-12T13:42:27.726 INFO:tasks.workunit.client.1.smithi110.stdout:5/982: creat da/d2e/d45/d25/d9d/d79/f15b x:0 0 0 2024-04-12T13:42:27.727 INFO:tasks.workunit.client.0.smithi060.stdout:3/957: rename d7/d17/d19/d96/d107 to d7/d17/d27/d36/d53/da2/d132 0 2024-04-12T13:42:27.727 INFO:tasks.workunit.client.0.smithi060.stdout:6/948: write d1/d7/da/dc/d24/d30/d52/d5e/f98 [1411287,15116] 0 2024-04-12T13:42:27.730 INFO:tasks.workunit.client.1.smithi110.stdout:6/987: truncate d7/d25/d30/d44/da3/fb8 1164077 0 2024-04-12T13:42:27.730 INFO:tasks.workunit.client.1.smithi110.stdout:3/999: dwrite d5/dc/d31/d74/ffd [0,4194304] 0 2024-04-12T13:42:27.732 INFO:tasks.workunit.client.0.smithi060.stdout:4/894: rename d6/d2f/d7d/d11b/d1a/d19/d42 to d6/db7/dbb/dfb/d11e 0 2024-04-12T13:42:27.735 INFO:tasks.workunit.client.0.smithi060.stdout:4/895: chown d6/db7/dbb/dfb/d11e/d7c/lfe 900 1 2024-04-12T13:42:27.741 INFO:tasks.workunit.client.0.smithi060.stdout:4/896: read d6/d2f/d7d/d11b/d4d/f10b [143135,36281] 0 2024-04-12T13:42:27.746 INFO:tasks.workunit.client.0.smithi060.stdout:9/904: dwrite d4/d9/ff2 [0,4194304] 0 2024-04-12T13:42:27.747 INFO:tasks.workunit.client.1.smithi110.stdout:5/983: dwrite da/d2e/d45/d25/d9d/d7a/dae/f129 [0,4194304] 0 2024-04-12T13:42:27.750 INFO:tasks.workunit.client.0.smithi060.stdout:4/897: read d6/d21/f53 [760423,82770] 0 2024-04-12T13:42:27.751 INFO:tasks.workunit.client.0.smithi060.stdout:6/949: rmdir d1/d7/da/dc/d24/d30/d52/d78/d80 39 2024-04-12T13:42:27.752 INFO:tasks.workunit.client.0.smithi060.stdout:5/934: write d6/dd/fcf [362807,51310] 0 2024-04-12T13:42:27.756 INFO:tasks.workunit.client.1.smithi110.stdout:0/965: write d1/f8c [118569,58133] 0 2024-04-12T13:42:27.761 INFO:tasks.workunit.client.1.smithi110.stdout:5/984: fdatasync da/d2e/d45/d29/f78 0 2024-04-12T13:42:27.763 INFO:tasks.workunit.client.0.smithi060.stdout:3/958: creat d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/dc0/f133 x:0 0 0 2024-04-12T13:42:27.772 INFO:tasks.workunit.client.1.smithi110.stdout:0/966: rename d1/d8/d8a/ce2 to d1/d27/d31/d89/c15a 0 2024-04-12T13:42:27.774 INFO:tasks.workunit.client.0.smithi060.stdout:6/950: creat d1/d7/da/dc/d24/d2d/db3/f12f x:0 0 0 2024-04-12T13:42:27.776 INFO:tasks.workunit.client.1.smithi110.stdout:6/988: link d7/d10/d1c/d2b/d3a/dbf/de2/lef d7/d25/d2c/d4c/d77/l139 0 2024-04-12T13:42:27.782 INFO:tasks.workunit.client.0.smithi060.stdout:3/959: unlink d7/f8 0 2024-04-12T13:42:27.785 INFO:tasks.workunit.client.1.smithi110.stdout:5/985: mknod da/d2e/d45/d25/d9d/c15c 0 2024-04-12T13:42:27.787 INFO:tasks.workunit.client.1.smithi110.stdout:5/986: write da/d2e/d45/d25/f10a [350896,128386] 0 2024-04-12T13:42:27.790 INFO:tasks.workunit.client.0.smithi060.stdout:4/898: write d6/db7/dbb/dfb/d11e/d7c/fb9 [4739192,92479] 0 2024-04-12T13:42:27.791 INFO:tasks.workunit.client.1.smithi110.stdout:0/967: mkdir d1/d27/d15b 0 2024-04-12T13:42:27.792 INFO:tasks.workunit.client.0.smithi060.stdout:5/935: symlink d6/dd/d1f/d25/d42/d6b/d11b/l133 0 2024-04-12T13:42:27.796 INFO:tasks.workunit.client.0.smithi060.stdout:9/905: rename d4/c13 to d4/d33/d50/c126 0 2024-04-12T13:42:27.797 INFO:tasks.workunit.client.0.smithi060.stdout:3/960: truncate d7/d17/d27/d36/d53/f89 358488 0 2024-04-12T13:42:27.801 INFO:tasks.workunit.client.0.smithi060.stdout:5/936: unlink d6/l11f 0 2024-04-12T13:42:27.808 INFO:tasks.workunit.client.0.smithi060.stdout:6/951: getdents d1/d7/da/dc/d24/d30/d52/d78 0 2024-04-12T13:42:27.811 INFO:tasks.workunit.client.0.smithi060.stdout:3/961: mknod d7/d17/d19/dc9/d3f/d116/c134 0 2024-04-12T13:42:27.814 INFO:tasks.workunit.client.0.smithi060.stdout:5/937: dread d6/ff7 [0,4194304] 0 2024-04-12T13:42:27.815 INFO:tasks.workunit.client.0.smithi060.stdout:5/938: stat d6/fa0 0 2024-04-12T13:42:27.816 INFO:tasks.workunit.client.1.smithi110.stdout:6/989: dwrite d7/d10/d1c/f6d [0,4194304] 0 2024-04-12T13:42:27.825 INFO:tasks.workunit.client.1.smithi110.stdout:5/987: dwrite da/d2e/d45/d29/d58/f6d [0,4194304] 0 2024-04-12T13:42:27.826 INFO:tasks.workunit.client.1.smithi110.stdout:0/968: dwrite d1/fe3 [0,4194304] 0 2024-04-12T13:42:27.826 INFO:tasks.workunit.client.0.smithi060.stdout:7/896: sync 2024-04-12T13:42:27.826 INFO:tasks.workunit.client.0.smithi060.stdout:0/893: sync 2024-04-12T13:42:27.829 INFO:tasks.workunit.client.0.smithi060.stdout:5/939: symlink d6/d10/db8/dee/dfc/da2/l134 0 2024-04-12T13:42:27.829 INFO:tasks.workunit.client.1.smithi110.stdout:0/969: truncate d1/d27/d6e/fef 764026 0 2024-04-12T13:42:27.830 INFO:tasks.workunit.client.0.smithi060.stdout:0/894: write d7/d9/de/f43 [1853214,31075] 0 2024-04-12T13:42:27.831 INFO:tasks.workunit.client.0.smithi060.stdout:6/952: mkdir d1/d130 0 2024-04-12T13:42:27.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/899: truncate d6/d2f/d7d/d11b/d1a/d57/d63/df4/f4b 2828437 0 2024-04-12T13:42:27.836 INFO:tasks.workunit.client.0.smithi060.stdout:9/906: unlink d4/d33/c45 0 2024-04-12T13:42:27.838 INFO:tasks.workunit.client.0.smithi060.stdout:4/900: write d6/d2f/d7d/d11b/d4d/d69/f111 [28861,26879] 0 2024-04-12T13:42:27.839 INFO:tasks.workunit.client.0.smithi060.stdout:7/897: fdatasync d0/d1b/da4/fba 0 2024-04-12T13:42:27.843 INFO:tasks.workunit.client.1.smithi110.stdout:5/988: fdatasync da/db/d3b/d40/da6/f107 0 2024-04-12T13:42:27.845 INFO:tasks.workunit.client.0.smithi060.stdout:0/895: creat d7/d9/d14/d35/d44/d8c/d8d/d10b/f133 x:0 0 0 2024-04-12T13:42:27.846 INFO:tasks.workunit.client.1.smithi110.stdout:5/989: chown da/d2e/d45/d29/d58/f6d 3377 1 2024-04-12T13:42:27.847 INFO:tasks.workunit.client.0.smithi060.stdout:9/907: fdatasync d4/d9/f3e 0 2024-04-12T13:42:27.848 INFO:tasks.workunit.client.1.smithi110.stdout:0/970: dwrite d1/d48/db2/d4a/f73 [0,4194304] 0 2024-04-12T13:42:27.849 INFO:tasks.workunit.client.0.smithi060.stdout:7/898: mkdir d0/d1b/da4/d120 0 2024-04-12T13:42:27.850 INFO:tasks.workunit.client.1.smithi110.stdout:5/990: fdatasync da/d2e/d45/d29/d58/f141 0 2024-04-12T13:42:27.851 INFO:tasks.workunit.client.0.smithi060.stdout:6/953: creat d1/d7/da/d20/da8/df0/f131 x:0 0 0 2024-04-12T13:42:27.853 INFO:tasks.workunit.client.0.smithi060.stdout:0/896: unlink d7/d9/d14/d4a/f83 0 2024-04-12T13:42:27.854 INFO:tasks.workunit.client.1.smithi110.stdout:0/971: creat d1/d8/d8a/dc8/d138/f15c x:0 0 0 2024-04-12T13:42:27.855 INFO:tasks.workunit.client.0.smithi060.stdout:4/901: creat d6/d2f/d7d/d11b/d109/f11f x:0 0 0 2024-04-12T13:42:27.856 INFO:tasks.workunit.client.1.smithi110.stdout:5/991: fdatasync da/d2e/d45/d25/d9d/d7a/db5/d8f/de4/f70 0 2024-04-12T13:42:27.857 INFO:tasks.workunit.client.0.smithi060.stdout:0/897: readlink d7/d9/d14/d4a/l5a 0 2024-04-12T13:42:27.860 INFO:tasks.workunit.client.1.smithi110.stdout:0/972: truncate d1/d8/d8a/f9e 374561 0 2024-04-12T13:42:27.860 INFO:tasks.workunit.client.0.smithi060.stdout:9/908: fdatasync d4/d8/f2e 0 2024-04-12T13:42:27.860 INFO:tasks.workunit.client.0.smithi060.stdout:5/940: dread d6/dd/d1f/d25/d53/d87/f3a [0,4194304] 0 2024-04-12T13:42:27.860 INFO:tasks.workunit.client.1.smithi110.stdout:5/992: mknod da/d2e/d45/ddc/c15d 0 2024-04-12T13:42:27.863 INFO:tasks.workunit.client.1.smithi110.stdout:5/993: write da/d2e/d45/d25/d9d/d79/d88/dd3/f158 [851527,118460] 0 2024-04-12T13:42:27.866 INFO:tasks.workunit.client.0.smithi060.stdout:5/941: chown d6/d10/db8/dee/dfc/d3d/l120 0 1 2024-04-12T13:42:27.869 INFO:tasks.workunit.client.0.smithi060.stdout:7/899: getdents d0/d78 0 2024-04-12T13:42:27.870 INFO:tasks.workunit.client.0.smithi060.stdout:4/902: truncate d6/d2f/d7d/d11b/d1a/d57/d63/fec 205445 0 2024-04-12T13:42:27.871 INFO:tasks.workunit.client.0.smithi060.stdout:9/909: symlink d4/d8/df1/d11c/l127 0 2024-04-12T13:42:27.872 INFO:tasks.workunit.client.1.smithi110.stdout:5/994: truncate da/d2e/d45/d25/d9d/d7a/db5/f135 2668233 0 2024-04-12T13:42:27.873 INFO:tasks.workunit.client.0.smithi060.stdout:0/898: truncate d7/d9/d14/d35/d44/d8c/d8d/de9/ffe 3829359 0 2024-04-12T13:42:27.874 INFO:tasks.workunit.client.0.smithi060.stdout:5/942: chown d6/dd/d1f/d25/d53/d87/d7e/dca/c126 4265507 1 2024-04-12T13:42:27.878 INFO:tasks.workunit.client.0.smithi060.stdout:9/910: mknod d4/d8/d7c/dfe/c128 0 2024-04-12T13:42:27.879 INFO:tasks.workunit.client.0.smithi060.stdout:7/900: unlink d0/d7/d43/d63/d6f/lc6 0 2024-04-12T13:42:27.881 INFO:tasks.workunit.client.0.smithi060.stdout:7/901: readlink d0/l35 0 2024-04-12T13:42:27.882 INFO:tasks.workunit.client.0.smithi060.stdout:0/899: dread - d7/d9/d14/d35/d44/d8c/d8d/d10b/f114 zero size 2024-04-12T13:42:27.883 INFO:tasks.workunit.client.0.smithi060.stdout:6/954: dwrite d1/d7/da/dc/d24/d30/d52/d78/d80/d93/ff2 [0,4194304] 0 2024-04-12T13:42:27.888 INFO:tasks.workunit.client.0.smithi060.stdout:9/911: creat d4/d8/d7c/d10e/f129 x:0 0 0 2024-04-12T13:42:27.889 INFO:tasks.workunit.client.0.smithi060.stdout:4/903: link d6/d2f/d7d/d11b/d4d/cd5 d6/d2f/d7d/d11b/d1a/d57/d63/df4/dc8/c120 0 2024-04-12T13:42:27.891 INFO:tasks.workunit.client.0.smithi060.stdout:7/902: creat d0/d7/d43/d4d/dde/f121 x:0 0 0 2024-04-12T13:42:27.892 INFO:tasks.workunit.client.0.smithi060.stdout:7/903: chown d0/l5c 670078240 1 2024-04-12T13:42:27.895 INFO:tasks.workunit.client.0.smithi060.stdout:0/900: creat d7/d9/d14/d35/d44/d8c/d8d/d10b/f134 x:0 0 0 2024-04-12T13:42:27.897 INFO:tasks.workunit.client.0.smithi060.stdout:9/912: mknod d4/d8/df1/d11c/c12a 0 2024-04-12T13:42:27.897 INFO:tasks.workunit.client.0.smithi060.stdout:4/904: truncate d6/d2f/d7d/d11b/d1a/d19/dad/fea 16866 0 2024-04-12T13:42:27.898 INFO:tasks.workunit.client.0.smithi060.stdout:7/904: write d0/d7/d92/f102 [5488395,120697] 0 2024-04-12T13:42:27.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/913: readlink d4/d33/d108/l112 0 2024-04-12T13:42:27.901 INFO:tasks.workunit.client.0.smithi060.stdout:7/905: chown d0/c14 841027 1 2024-04-12T13:42:27.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:27 smithi060 ceph-mon[29097]: pgmap v38: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 154 MiB/s wr, 373 op/s 2024-04-12T13:42:27.907 INFO:tasks.workunit.client.0.smithi060.stdout:9/914: mkdir d4/d8/dad/dd9/d12b 0 2024-04-12T13:42:27.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/915: getdents d4/d8/dad/dd9/d12b 0 2024-04-12T13:42:27.916 INFO:tasks.workunit.client.0.smithi060.stdout:0/901: dwrite d7/d9/d14/d35/d44/d49/d67/f76 [4194304,4194304] 0 2024-04-12T13:42:27.916 INFO:tasks.workunit.client.0.smithi060.stdout:9/916: truncate d4/d8/d7c/fa7 162093 0 2024-04-12T13:42:27.918 INFO:tasks.workunit.client.0.smithi060.stdout:4/905: dwrite d6/d2f/d7d/d11b/df/f93 [0,4194304] 0 2024-04-12T13:42:27.926 INFO:tasks.workunit.client.0.smithi060.stdout:9/917: rename d4/f2d to d4/d9/d19/d125/f12c 0 2024-04-12T13:42:27.930 INFO:tasks.workunit.client.0.smithi060.stdout:4/906: getdents d6 0 2024-04-12T13:42:27.943 INFO:tasks.workunit.client.0.smithi060.stdout:8/885: sync 2024-04-12T13:42:27.943 INFO:tasks.workunit.client.0.smithi060.stdout:2/931: sync 2024-04-12T13:42:27.944 INFO:tasks.workunit.client.0.smithi060.stdout:4/907: mknod d6/d2f/d7d/d11b/df/c121 0 2024-04-12T13:42:27.954 INFO:tasks.workunit.client.0.smithi060.stdout:4/908: getdents d6/db7/dc2 0 2024-04-12T13:42:27.957 INFO:tasks.workunit.client.0.smithi060.stdout:8/886: rename d9/d1b/d84/da0/d80/d109/d7b/cb5 to d9/d1b/d84/da0/c136 0 2024-04-12T13:42:27.967 INFO:tasks.workunit.client.0.smithi060.stdout:8/887: read - d9/d1b/d2b/d82/d8a/d103/f106 zero size 2024-04-12T13:42:27.969 INFO:tasks.workunit.client.0.smithi060.stdout:4/909: link d6/l2c d6/d2f/d7d/d11b/d1a/d56/d8d/l122 0 2024-04-12T13:42:27.974 INFO:tasks.workunit.client.0.smithi060.stdout:8/888: mknod d9/d1b/d84/da0/d80/d109/c137 0 2024-04-12T13:42:27.977 INFO:tasks.workunit.client.0.smithi060.stdout:4/910: creat d6/db7/f123 x:0 0 0 2024-04-12T13:42:27.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.977+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1154000bf0 con 0x7f115806bd10 2024-04-12T13:42:27.980 INFO:tasks.workunit.client.0.smithi060.stdout:8/889: chown d9/f1f 241606966 1 2024-04-12T13:42:27.982 INFO:tasks.workunit.client.0.smithi060.stdout:4/911: creat d6/d2f/d7d/d11b/d109/f124 x:0 0 0 2024-04-12T13:42:27.983 INFO:tasks.workunit.client.0.smithi060.stdout:8/890: rmdir d9/d1d/dfe 39 2024-04-12T13:42:27.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.981+0000 7f116aa00700 1 -- 172.21.15.60:0/3076804827 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f1154000bf0 con 0x7f115806bd10 2024-04-12T13:42:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.983+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 msgr2=0x7f115806e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.983+0000 7f1179a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 0x7f115806e1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1164009fd0 tx=0x7f1164009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.983+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 msgr2=0x7f1174118300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.983+0000 7f1179a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f116000b790 tx=0x7f1160009250 comp rx=0 tx=0).stop 2024-04-12T13:42:27.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 shutdown_connections 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f115806bd10 0x7f115806e1c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1174066ad0 0x7f1174118300 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f116000b790 tx=0x7f1160009250 comp rx=0 tx=0).stop 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 --2- 172.21.15.60:0/3076804827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f117406ecf0 0x7f1174118840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 >> 172.21.15.60:0/3076804827 conn(0x7f117406a390 msgr2=0x7f117406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 shutdown_connections 2024-04-12T13:42:27.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:27.984+0000 7f1179a00700 1 -- 172.21.15.60:0/3076804827 wait complete. 2024-04-12T13:42:27.988 INFO:tasks.workunit.client.0.smithi060.stdout:4/912: dread - d6/d2f/d7d/d11b/d1a/d19/d7a/fe9 zero size 2024-04-12T13:42:27.989 INFO:tasks.workunit.client.0.smithi060.stdout:8/891: unlink d9/d1b/d2b/d82/d8a/d116/d11a/c11b 0 2024-04-12T13:42:27.992 INFO:tasks.workunit.client.0.smithi060.stdout:4/913: creat d6/db7/dc2/f125 x:0 0 0 2024-04-12T13:42:27.992 INFO:tasks.workunit.client.1.smithi110.stdout:6/990: dwrite d7/d25/d30/d44/fe9 [0,4194304] 0 2024-04-12T13:42:27.994 INFO:tasks.workunit.client.0.smithi060.stdout:8/892: unlink d9/d1b/d2b/fb4 0 2024-04-12T13:42:27.996 INFO:tasks.workunit.client.0.smithi060.stdout:4/914: chown d6/db7/dbb/dfb/d11e/d7c/f11c 0 1 2024-04-12T13:42:27.997 INFO:tasks.workunit.client.1.smithi110.stdout:6/991: rmdir d7/d25/d2c/d4c/d77 39 2024-04-12T13:42:28.000 INFO:tasks.workunit.client.0.smithi060.stdout:4/915: dread d6/d2f/d7d/d11b/fc1 [0,4194304] 0 2024-04-12T13:42:28.006 INFO:tasks.workunit.client.0.smithi060.stdout:8/893: dread d9/d1b/d84/da0/d80/d109/fa5 [0,4194304] 0 2024-04-12T13:42:28.007 INFO:tasks.workunit.client.1.smithi110.stdout:6/992: fsync d7/f39 0 2024-04-12T13:42:28.007 INFO:tasks.workunit.client.0.smithi060.stdout:4/916: symlink d6/d2f/d7d/d11b/d1a/d19/l126 0 2024-04-12T13:42:28.015 INFO:tasks.workunit.client.0.smithi060.stdout:5/943: write d6/dd/d1f/dd3/df3/d4c/f85 [849840,15401] 0 2024-04-12T13:42:28.018 INFO:tasks.workunit.client.0.smithi060.stdout:4/917: creat d6/db7/dbb/dfb/d11e/d7c/f127 x:0 0 0 2024-04-12T13:42:28.018 INFO:tasks.workunit.client.1.smithi110.stdout:6/993: chown d7/d25/d30/d44/da3/fb8 231 1 2024-04-12T13:42:28.020 INFO:tasks.workunit.client.0.smithi060.stdout:5/944: creat d6/dd/d1f/d25/d53/d87/f135 x:0 0 0 2024-04-12T13:42:28.021 INFO:tasks.workunit.client.0.smithi060.stdout:6/955: write d1/d7/da/dc/f7c [5207235,96463] 0 2024-04-12T13:42:28.025 INFO:tasks.workunit.client.0.smithi060.stdout:7/906: write d0/d3d/d74/d9b/fbc [30204,85126] 0 2024-04-12T13:42:28.027 INFO:tasks.workunit.client.1.smithi110.stdout:0/973: dwrite d1/d48/db2/d4a/fd3 [0,4194304] 0 2024-04-12T13:42:28.030 INFO:tasks.workunit.client.0.smithi060.stdout:6/956: dread - d1/d7/da/dc/ff5 zero size 2024-04-12T13:42:28.030 INFO:tasks.workunit.client.1.smithi110.stdout:5/995: dwrite da/d2e/d45/d25/d9d/d79/d88/f95 [0,4194304] 0 2024-04-12T13:42:28.039 INFO:tasks.workunit.client.0.smithi060.stdout:7/907: truncate d0/d7/d43/d4d/dde/f121 334146 0 2024-04-12T13:42:28.043 INFO:tasks.workunit.client.0.smithi060.stdout:5/945: truncate d6/d10/db8/dee/dfc/da2/fbf 699169 0 2024-04-12T13:42:28.043 INFO:tasks.workunit.client.1.smithi110.stdout:5/996: creat da/db/d3b/d40/f15e x:0 0 0 2024-04-12T13:42:28.047 INFO:tasks.workunit.client.0.smithi060.stdout:0/902: dwrite d7/d9/d14/f85 [0,4194304] 0 2024-04-12T13:42:28.048 INFO:tasks.workunit.client.1.smithi110.stdout:0/974: symlink d1/d48/d108/l15d 0 2024-04-12T13:42:28.049 INFO:tasks.workunit.client.0.smithi060.stdout:5/946: fdatasync d6/dd/d1f/dd3/df3/d4c/da8/f12a 0 2024-04-12T13:42:28.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/918: dread d6/f55 [0,4194304] 0 2024-04-12T13:42:28.062 INFO:tasks.workunit.client.0.smithi060.stdout:0/903: dread - d7/d9/d14/d35/d44/dd9/ff9 zero size 2024-04-12T13:42:28.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/932: write d6/f25 [109751,126007] 0 2024-04-12T13:42:28.066 INFO:tasks.workunit.client.0.smithi060.stdout:5/947: readlink d6/dd/lc2 0 2024-04-12T13:42:28.075 INFO:tasks.workunit.client.1.smithi110.stdout:0/975: rename d1/d27/d31/d67/dcb to d1/d8/d36/d15e 0 2024-04-12T13:42:28.077 INFO:tasks.workunit.client.0.smithi060.stdout:6/957: dwrite d1/d7/da/dc/d24/d2d/f3d [8388608,4194304] 0 2024-04-12T13:42:28.080 INFO:tasks.workunit.client.0.smithi060.stdout:0/904: read d7/d9/d14/d35/d44/d49/dcf/dd0/dd6/f118 [631618,69093] 0 2024-04-12T13:42:28.083 INFO:tasks.workunit.client.1.smithi110.stdout:5/997: dread da/d2e/d45/d25/d9d/d79/d88/dd3/fdb [0,4194304] 0 2024-04-12T13:42:28.086 INFO:tasks.workunit.client.1.smithi110.stdout:5/998: stat da/d2e/d45/d25/d9d/d7a/db5/df3/d11c/l15a 0 2024-04-12T13:42:28.086 INFO:tasks.workunit.client.0.smithi060.stdout:2/933: fsync d6/d64/d99/df0/daa/ddf/ff3 0 2024-04-12T13:42:28.087 INFO:tasks.workunit.client.0.smithi060.stdout:6/958: stat d1/d7/da/dc/d7a/de1/d113/d94/fc5 0 2024-04-12T13:42:28.089 INFO:tasks.workunit.client.1.smithi110.stdout:5/999: stat da/d2e/d45/d25/d9d/d79/d88/d130 0 2024-04-12T13:42:28.095 INFO:tasks.workunit.client.0.smithi060.stdout:4/919: dwrite d6/db7/dbb/dfb/d11e/d7c/f127 [0,4194304] 0 2024-04-12T13:42:28.095 INFO:tasks.workunit.client.0.smithi060.stdout:6/959: fsync d1/d7/da/ff 0 2024-04-12T13:42:28.101 INFO:tasks.workunit.client.0.smithi060.stdout:4/920: fdatasync d6/d2f/d7d/d11b/d1a/d57/d63/df4/f8e 0 2024-04-12T13:42:28.101 INFO:tasks.workunit.client.0.smithi060.stdout:2/934: symlink d6/d64/d99/df0/d11b/l120 0 2024-04-12T13:42:28.103 INFO:tasks.workunit.client.0.smithi060.stdout:6/960: creat d1/d7/da/dc/d24/d2d/db3/f132 x:0 0 0 2024-04-12T13:42:28.107 INFO:tasks.workunit.client.0.smithi060.stdout:8/894: write d9/d1b/d37/d4d/d63/d66/dd9/dfc/f4b [4273105,125253] 0 2024-04-12T13:42:28.109 INFO:tasks.workunit.client.0.smithi060.stdout:2/935: mkdir d6/dae/d5b/d6d/de1/d121 0 2024-04-12T13:42:28.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/961: truncate d1/d7/da/dc/d24/d30/d52/fa4 3514294 0 2024-04-12T13:42:28.119 INFO:tasks.workunit.client.0.smithi060.stdout:2/936: dread d6/d64/d99/df0/daa/ddf/ff3 [0,4194304] 0 2024-04-12T13:42:28.119 INFO:tasks.workunit.client.0.smithi060.stdout:8/895: symlink d9/d1d/dfe/l138 0 2024-04-12T13:42:28.120 INFO:tasks.workunit.client.0.smithi060.stdout:7/908: write d0/d3d/d74/f7e [806742,68419] 0 2024-04-12T13:42:28.123 INFO:tasks.workunit.client.1.smithi110.stdout:0/976: write d1/d8/d36/fb6 [532176,70063] 0 2024-04-12T13:42:28.125 INFO:tasks.workunit.client.1.smithi110.stdout:6/994: dwrite d7/d25/d2c/d4c/d77/d103/f136 [4194304,4194304] 0 2024-04-12T13:42:28.126 INFO:tasks.workunit.client.1.smithi110.stdout:0/977: dread - d1/d8/d8a/f154 zero size 2024-04-12T13:42:28.129 INFO:tasks.workunit.client.0.smithi060.stdout:7/909: stat d0/d7/d43/d4d/dde/ce0 0 2024-04-12T13:42:28.132 INFO:tasks.workunit.client.0.smithi060.stdout:7/910: write d0/d78/f10a [969780,90040] 0 2024-04-12T13:42:28.133 INFO:tasks.workunit.client.0.smithi060.stdout:0/905: truncate d7/fa3 718035 0 2024-04-12T13:42:28.134 INFO:tasks.workunit.client.0.smithi060.stdout:2/937: mkdir d6/dae/d5b/d6d/d122 0 2024-04-12T13:42:28.136 INFO:tasks.workunit.client.0.smithi060.stdout:9/918: dwrite d4/d8/df1/d67/f8f [0,4194304] 0 2024-04-12T13:42:28.141 INFO:tasks.workunit.client.0.smithi060.stdout:6/962: unlink d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1/c107 0 2024-04-12T13:42:28.144 INFO:tasks.workunit.client.1.smithi110.stdout:0/978: dread d1/fe3 [0,4194304] 0 2024-04-12T13:42:28.149 INFO:tasks.workunit.client.1.smithi110.stdout:6/995: dwrite d7/d10/d1c/d2b/d48/d54/ff1 [0,4194304] 0 2024-04-12T13:42:28.151 INFO:tasks.workunit.client.0.smithi060.stdout:4/921: dread d6/d21/d88/fd6 [0,4194304] 0 2024-04-12T13:42:28.162 INFO:tasks.workunit.client.1.smithi110.stdout:0/979: unlink d1/d56/deb/l12c 0 2024-04-12T13:42:28.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/906: rename d7/d9/d14/d35/d44/d7d/fc5 to d7/d9/d14/d35/d44/dd9/dd8/f135 0 2024-04-12T13:42:28.170 INFO:tasks.workunit.client.0.smithi060.stdout:6/963: dread d1/d7/da/dc/d24/d30/dd8/fe2 [4194304,4194304] 0 2024-04-12T13:42:28.170 INFO:tasks.workunit.client.0.smithi060.stdout:7/911: dwrite d0/d7/d43/d4d/dde/f121 [0,4194304] 0 2024-04-12T13:42:28.171 INFO:tasks.workunit.client.1.smithi110.stdout:6/996: dwrite d7/d25/d2c/d4c/d77/db9/fdd [4194304,4194304] 0 2024-04-12T13:42:28.174 INFO:tasks.workunit.client.1.smithi110.stdout:6/997: chown d7/d10/d1c/d7f/fdf 16 1 2024-04-12T13:42:28.188 INFO:tasks.workunit.client.0.smithi060.stdout:4/922: truncate d6/d2f/d7d/d11b/d1a/d57/d63/d68/feb 52751 0 2024-04-12T13:42:28.190 INFO:tasks.workunit.client.0.smithi060.stdout:9/919: creat d4/d9/d19/d21/dbf/dce/f12d x:0 0 0 2024-04-12T13:42:28.193 INFO:tasks.workunit.client.1.smithi110.stdout:6/998: link d7/d10/d1c/d7f/d116/dcc/d114/f115 d7/d10/d1c/d2b/d48/d125/f13a 0 2024-04-12T13:42:28.197 INFO:tasks.workunit.client.0.smithi060.stdout:0/907: mknod d7/ddf/c136 0 2024-04-12T13:42:28.200 INFO:tasks.workunit.client.1.smithi110.stdout:6/999: rename d7/lb to d7/da4/df8/d129/l13b 0 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 -- 172.21.15.60:0/2877498536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ff070 msgr2=0x7f993c0ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 --2- 172.21.15.60:0/2877498536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ff070 0x7f993c0ff480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f992c004940 tx=0x7f992c009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 -- 172.21.15.60:0/2877498536 shutdown_connections 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 --2- 172.21.15.60:0/2877498536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c100320 0x7f993c100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 --2- 172.21.15.60:0/2877498536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c0ff070 0x7f993c0ff480 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.199+0000 7f9941800700 1 -- 172.21.15.60:0/2877498536 >> 172.21.15.60:0/2877498536 conn(0x7f993c0fa950 msgr2=0x7f993c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:28.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.200+0000 7f9941800700 1 -- 172.21.15.60:0/2877498536 shutdown_connections 2024-04-12T13:42:28.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.200+0000 7f9941800700 1 -- 172.21.15.60:0/2877498536 wait complete. 2024-04-12T13:42:28.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.201+0000 7f9941800700 1 Processor -- start 2024-04-12T13:42:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.202+0000 7f9941800700 1 -- start start 2024-04-12T13:42:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.202+0000 7f9941800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c0ff070 0x7f993c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.202+0000 7f9941800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.202+0000 7f9941800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c06ffb0 con 0x7f993c100320 2024-04-12T13:42:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.202+0000 7f9941800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c06edf0 con 0x7f993c0ff070 2024-04-12T13:42:28.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.204+0000 7f993a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.204+0000 7f993a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57982/0 (socket says 172.21.15.60:57982) 2024-04-12T13:42:28.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.204+0000 7f993a000700 1 -- 172.21.15.60:0/307520641 learned_addr learned my addr 172.21.15.60:0/307520641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.204+0000 7f993aa00700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c0ff070 0x7f993c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.205+0000 7f993a000700 1 -- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c0ff070 msgr2=0x7f993c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.205+0000 7f993a000700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c0ff070 0x7f993c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.205+0000 7f993a000700 1 -- 172.21.15.60:0/307520641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c005040 con 0x7f993c100320 2024-04-12T13:42:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.206+0000 7f993a000700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f992800eb40 tx=0x7f992800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.206+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9928007cc0 con 0x7f993c100320 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.206+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c06f070 con 0x7f993c100320 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.207+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c11e1a0 con 0x7f993c100320 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.207+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f992800f040 con 0x7f993c100320 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.207+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992800c990 con 0x7f993c100320 2024-04-12T13:42:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.209+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0052e0 con 0x7f993c100320 2024-04-12T13:42:28.212 INFO:tasks.workunit.client.1.smithi110.stdout:0/980: dwrite d1/d5e/f9f [0,4194304] 0 2024-04-12T13:42:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.210+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f992800caf0 con 0x7f993c100320 2024-04-12T13:42:28.214 INFO:tasks.workunit.client.1.smithi110.stdout:0/981: write d1/d5e/fd1 [1072855,1392] 0 2024-04-12T13:42:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.211+0000 7f9932a00700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 0x7f992006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.211+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f992808a470 con 0x7f993c100320 2024-04-12T13:42:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.211+0000 7f993aa00700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 0x7f992006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.212+0000 7f993aa00700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 0x7f992006e1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f992c013870 tx=0x7f992c009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:28.217 INFO:tasks.workunit.client.0.smithi060.stdout:2/938: dwrite d6/d64/d99/df0/daa/db0/f52 [4194304,4194304] 0 2024-04-12T13:42:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.218+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f99280508f0 con 0x7f993c100320 2024-04-12T13:42:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:27 smithi110 ceph-mon[36055]: pgmap v38: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 73 MiB/s rd, 154 MiB/s wr, 373 op/s 2024-04-12T13:42:28.228 INFO:tasks.workunit.client.0.smithi060.stdout:7/912: dwrite d0/d1b/f48 [0,4194304] 0 2024-04-12T13:42:28.232 INFO:tasks.workunit.client.0.smithi060.stdout:6/964: write d1/d7/da/dc/d24/d34/d51/d97/fe3 [134070,111583] 0 2024-04-12T13:42:28.239 INFO:tasks.workunit.client.0.smithi060.stdout:9/920: mknod d4/d8/df1/d11c/c12e 0 2024-04-12T13:42:28.240 INFO:tasks.workunit.client.1.smithi110.stdout:0/982: link d1/d27/d31/d67/d10b/c151 d1/d8/d8a/c15f 0 2024-04-12T13:42:28.241 INFO:tasks.workunit.client.0.smithi060.stdout:8/896: getdents d9/d1b/d37/d4d/d63/d66/db3/da4 0 2024-04-12T13:42:28.244 INFO:tasks.workunit.client.0.smithi060.stdout:9/921: chown d4/d9/d19/db1/cba 694 1 2024-04-12T13:42:28.255 INFO:tasks.workunit.client.0.smithi060.stdout:7/913: creat d0/d7/d43/d63/d90/f122 x:0 0 0 2024-04-12T13:42:28.258 INFO:tasks.workunit.client.0.smithi060.stdout:0/908: link d7/d41/f7f d7/d9/de/d80/dc8/f137 0 2024-04-12T13:42:28.265 INFO:tasks.workunit.client.0.smithi060.stdout:7/914: symlink d0/d1b/d8c/db6/l123 0 2024-04-12T13:42:28.274 INFO:tasks.workunit.client.0.smithi060.stdout:9/922: symlink d4/d33/d65/d7a/l12f 0 2024-04-12T13:42:28.274 INFO:tasks.workunit.client.0.smithi060.stdout:7/915: read d0/d7/d43/d4d/dde/f121 [1314812,891] 0 2024-04-12T13:42:28.274 INFO:tasks.workunit.client.1.smithi110.stdout:0/983: dwrite d1/d27/ff2 [0,4194304] 0 2024-04-12T13:42:28.275 INFO:tasks.workunit.client.0.smithi060.stdout:8/897: write d9/d1b/d84/da0/d80/fd3 [843991,73988] 0 2024-04-12T13:42:28.277 INFO:tasks.workunit.client.0.smithi060.stdout:4/923: dwrite d6/d2f/d7d/d11b/d1a/d56/d8d/fab [0,4194304] 0 2024-04-12T13:42:28.280 INFO:tasks.workunit.client.0.smithi060.stdout:9/923: chown d4/d8/df1/d67/c30 15916 1 2024-04-12T13:42:28.282 INFO:tasks.workunit.client.0.smithi060.stdout:6/965: dread d1/d7/da/fc4 [0,4194304] 0 2024-04-12T13:42:28.286 INFO:tasks.workunit.client.0.smithi060.stdout:2/939: dwrite d6/dae/d31/d33/f39 [0,4194304] 0 2024-04-12T13:42:28.286 INFO:tasks.workunit.client.0.smithi060.stdout:7/916: creat d0/d7/d43/d63/d6f/f124 x:0 0 0 2024-04-12T13:42:28.288 INFO:tasks.workunit.client.0.smithi060.stdout:4/924: truncate d6/db7/dc2/f125 730993 0 2024-04-12T13:42:28.288 INFO:tasks.workunit.client.0.smithi060.stdout:9/924: write d4/d8/d7c/dee/f116 [351699,16530] 0 2024-04-12T13:42:28.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/966: chown d1/d7/da/dc/d7a/de1/d113/f87 4 1 2024-04-12T13:42:28.293 INFO:tasks.workunit.client.0.smithi060.stdout:3/962: sync 2024-04-12T13:42:28.293 INFO:tasks.workunit.client.0.smithi060.stdout:5/948: sync 2024-04-12T13:42:28.294 INFO:tasks.workunit.client.0.smithi060.stdout:9/925: chown d4/d9/d19/d8c/fda 14 1 2024-04-12T13:42:28.305 INFO:tasks.workunit.client.0.smithi060.stdout:0/909: dwrite d7/d9/d14/d35/d44/d8c/d8d/d10b/fa9 [0,4194304] 0 2024-04-12T13:42:28.308 INFO:tasks.workunit.client.0.smithi060.stdout:7/917: creat d0/d7/da9/dc9/db1/f125 x:0 0 0 2024-04-12T13:42:28.309 INFO:tasks.workunit.client.0.smithi060.stdout:3/963: creat d7/d17/d27/d36/d53/da2/dbc/f135 x:0 0 0 2024-04-12T13:42:28.312 INFO:tasks.workunit.client.1.smithi110.stdout:0/984: dread d1/d8/d36/d51/fbf [0,4194304] 0 2024-04-12T13:42:28.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/940: creat d6/f123 x:0 0 0 2024-04-12T13:42:28.315 INFO:tasks.workunit.client.1.smithi110.stdout:0/985: chown d1/d8/d8a 511 1 2024-04-12T13:42:28.316 INFO:tasks.workunit.client.0.smithi060.stdout:5/949: chown d6/dd/d1f/d25/d53/d8d/fe3 283362 1 2024-04-12T13:42:28.317 INFO:tasks.workunit.client.0.smithi060.stdout:0/910: mknod d7/d9/de/d80/d8b/c138 0 2024-04-12T13:42:28.323 INFO:tasks.workunit.client.0.smithi060.stdout:4/925: truncate d6/d2f/d7d/d11b/d1a/dde/ff9 909882 0 2024-04-12T13:42:28.324 INFO:tasks.workunit.client.0.smithi060.stdout:6/967: symlink d1/d7/da/dc/d24/d2d/db0/l133 0 2024-04-12T13:42:28.325 INFO:tasks.workunit.client.1.smithi110.stdout:0/986: mknod d1/c160 0 2024-04-12T13:42:28.327 INFO:tasks.workunit.client.0.smithi060.stdout:9/926: truncate d4/d9/d19/d21/f27 1303953 0 2024-04-12T13:42:28.327 INFO:tasks.workunit.client.0.smithi060.stdout:3/964: rmdir d7/d17/d27/d36/d53/da2 39 2024-04-12T13:42:28.327 INFO:tasks.workunit.client.1.smithi110.stdout:0/987: chown d1/d3c/f5f 679135 1 2024-04-12T13:42:28.331 INFO:tasks.workunit.client.1.smithi110.stdout:0/988: write d1/d8/d36/d65/fdc [724104,123118] 0 2024-04-12T13:42:28.331 INFO:tasks.workunit.client.0.smithi060.stdout:3/965: readlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/l76 0 2024-04-12T13:42:28.331 INFO:tasks.workunit.client.0.smithi060.stdout:5/950: symlink d6/d10/db8/l136 0 2024-04-12T13:42:28.333 INFO:tasks.workunit.client.0.smithi060.stdout:9/927: write d4/d9/d19/d8c/d92/fcb [2302665,129698] 0 2024-04-12T13:42:28.334 INFO:tasks.workunit.client.0.smithi060.stdout:2/941: symlink d6/d64/d99/de9/l124 0 2024-04-12T13:42:28.335 INFO:tasks.workunit.client.0.smithi060.stdout:3/966: chown d7/f9f 0 1 2024-04-12T13:42:28.336 INFO:tasks.workunit.client.0.smithi060.stdout:8/898: link d9/d1b/d84/da0/d80/d109/d7b/cdd d9/d1b/d37/d4d/d63/d66/db3/da4/c139 0 2024-04-12T13:42:28.339 INFO:tasks.workunit.client.0.smithi060.stdout:6/968: mkdir d1/d7/da/dc/d24/d34/d51/d97/dc0/d134 0 2024-04-12T13:42:28.342 INFO:tasks.workunit.client.1.smithi110.stdout:0/989: rename d1/d8/d8a/dce to d1/d56/d161 0 2024-04-12T13:42:28.345 INFO:tasks.workunit.client.0.smithi060.stdout:4/926: dwrite d6/d2f/d7d/d11b/d1a/d19/d7a/da8/fba [0,4194304] 0 2024-04-12T13:42:28.347 INFO:tasks.workunit.client.0.smithi060.stdout:2/942: creat d6/d56/d55/f125 x:0 0 0 2024-04-12T13:42:28.349 INFO:tasks.workunit.client.0.smithi060.stdout:3/967: read d7/d17/d27/d36/d53/da2/dbc/f101 [147026,9784] 0 2024-04-12T13:42:28.350 INFO:tasks.workunit.client.1.smithi110.stdout:0/990: creat d1/d8/d36/d65/f162 x:0 0 0 2024-04-12T13:42:28.352 INFO:tasks.workunit.client.0.smithi060.stdout:8/899: unlink d9/d1b/d2b/cae 0 2024-04-12T13:42:28.356 INFO:tasks.workunit.client.0.smithi060.stdout:6/969: creat d1/d7/da/dc/d24/d30/dd8/f135 x:0 0 0 2024-04-12T13:42:28.358 INFO:tasks.workunit.client.0.smithi060.stdout:7/918: link d0/d7/d43/d63/l66 d0/d7/da9/l126 0 2024-04-12T13:42:28.360 INFO:tasks.workunit.client.1.smithi110.stdout:0/991: mkdir d1/d3c/dd8/df4/d163 0 2024-04-12T13:42:28.362 INFO:tasks.workunit.client.1.smithi110.stdout:0/992: stat d1/d3c/d6b/c85 0 2024-04-12T13:42:28.365 INFO:tasks.workunit.client.1.smithi110.stdout:0/993: stat d1/d8/d36/d51/d60/l42 0 2024-04-12T13:42:28.368 INFO:tasks.workunit.client.0.smithi060.stdout:2/943: fsync d6/d64/d99/df0/f95 0 2024-04-12T13:42:28.375 INFO:tasks.workunit.client.0.smithi060.stdout:9/928: mknod d4/d8/dad/dd9/d12b/c130 0 2024-04-12T13:42:28.376 INFO:tasks.workunit.client.0.smithi060.stdout:7/919: dwrite d0/d1b/da4/feb [0,4194304] 0 2024-04-12T13:42:28.376 INFO:tasks.workunit.client.0.smithi060.stdout:8/900: rmdir d9/d1b/d84/da0/d114 39 2024-04-12T13:42:28.381 INFO:tasks.workunit.client.0.smithi060.stdout:9/929: write d4/d8/df1/d67/fa9 [1607627,16278] 0 2024-04-12T13:42:28.385 INFO:tasks.workunit.client.0.smithi060.stdout:6/970: rename d1/d7/da/d20/da8/df0 to d1/d130/d136 0 2024-04-12T13:42:28.389 INFO:tasks.workunit.client.0.smithi060.stdout:6/971: dread - d1/d7/da/dc/d24/d34/d51/fcd zero size 2024-04-12T13:42:28.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/944: dread - d6/f77 zero size 2024-04-12T13:42:28.401 INFO:tasks.workunit.client.0.smithi060.stdout:3/968: dread d7/d17/d27/d36/d53/f94 [0,4194304] 0 2024-04-12T13:42:28.403 INFO:tasks.workunit.client.1.smithi110.stdout:0/994: write d1/d8/d36/d51/ff3 [849124,83888] 0 2024-04-12T13:42:28.404 INFO:tasks.workunit.client.0.smithi060.stdout:3/969: truncate d7/d17/d19/f48 4886193 0 2024-04-12T13:42:28.406 INFO:tasks.workunit.client.0.smithi060.stdout:8/901: dread d9/d1b/d37/d4d/f97 [0,4194304] 0 2024-04-12T13:42:28.410 INFO:tasks.workunit.client.1.smithi110.stdout:0/995: write d1/d8/d8a/dc8/d138/f13c [657252,24775] 0 2024-04-12T13:42:28.411 INFO:tasks.workunit.client.0.smithi060.stdout:5/951: getdents d6/dd/d1f/dd3/de7/df8 0 2024-04-12T13:42:28.415 INFO:tasks.workunit.client.0.smithi060.stdout:2/945: dread d6/d56/d43/f5e [0,4194304] 0 2024-04-12T13:42:28.415 INFO:tasks.workunit.client.0.smithi060.stdout:5/952: chown d6/d89/cd8 79390 1 2024-04-12T13:42:28.415 INFO:tasks.workunit.client.0.smithi060.stdout:4/927: link d6/d2f/d7d/d11b/d1a/d19/dad/fea d6/d2f/d7d/d11b/d1a/d19/d7a/f128 0 2024-04-12T13:42:28.419 INFO:tasks.workunit.client.0.smithi060.stdout:5/953: chown d6/dd/lc2 250766 1 2024-04-12T13:42:28.420 INFO:tasks.workunit.client.0.smithi060.stdout:3/970: creat d7/d17/d27/d36/db0/dc4/ded/f136 x:0 0 0 2024-04-12T13:42:28.421 INFO:tasks.workunit.client.0.smithi060.stdout:5/954: stat d6/dd/l9a 0 2024-04-12T13:42:28.421 INFO:tasks.workunit.client.0.smithi060.stdout:9/930: link d4/d8/df1/d67/c30 d4/d9/d19/d21/dbb/c131 0 2024-04-12T13:42:28.422 INFO:tasks.workunit.client.0.smithi060.stdout:4/928: chown d6/d2f/d7d/d11b/d1a/l9f 929311 1 2024-04-12T13:42:28.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/920: dwrite d0/d7/fbd [0,4194304] 0 2024-04-12T13:42:28.433 INFO:tasks.workunit.client.0.smithi060.stdout:5/955: write d6/dd/fd1 [2880360,104192] 0 2024-04-12T13:42:28.439 INFO:tasks.workunit.client.0.smithi060.stdout:3/971: mknod d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/c137 0 2024-04-12T13:42:28.442 INFO:tasks.workunit.client.0.smithi060.stdout:6/972: dwrite d1/d7/da/dc/d24/d2d/f55 [0,4194304] 0 2024-04-12T13:42:28.447 INFO:tasks.workunit.client.0.smithi060.stdout:8/902: write d9/d1b/d2b/fbe [542706,34888] 0 2024-04-12T13:42:28.447 INFO:tasks.workunit.client.0.smithi060.stdout:4/929: creat d6/d2f/d7d/d11b/d1a/d57/d63/d68/d76/f129 x:0 0 0 2024-04-12T13:42:28.448 INFO:tasks.workunit.client.0.smithi060.stdout:5/956: creat d6/dd/d1f/dd3/de7/df8/f137 x:0 0 0 2024-04-12T13:42:28.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/972: rmdir d7/d17/d27/da7/dbe/dce/de6 39 2024-04-12T13:42:28.450 INFO:tasks.workunit.client.1.smithi110.stdout:0/996: write d1/d8/d36/f44 [5240362,38105] 0 2024-04-12T13:42:28.457 INFO:tasks.workunit.client.0.smithi060.stdout:6/973: unlink d1/fb6 0 2024-04-12T13:42:28.461 INFO:tasks.workunit.client.0.smithi060.stdout:9/931: truncate d4/d9/ff2 277722 0 2024-04-12T13:42:28.461 INFO:tasks.workunit.client.0.smithi060.stdout:3/973: truncate d7/d17/d27/fa5 3558601 0 2024-04-12T13:42:28.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/921: dwrite d0/fd8 [4194304,4194304] 0 2024-04-12T13:42:28.465 INFO:tasks.workunit.client.0.smithi060.stdout:8/903: fdatasync d9/d1b/d84/f11f 0 2024-04-12T13:42:28.470 INFO:tasks.workunit.client.1.smithi110.stdout:0/997: getdents d1/d27 0 2024-04-12T13:42:28.475 INFO:tasks.workunit.client.0.smithi060.stdout:5/957: getdents d6/d10 0 2024-04-12T13:42:28.477 INFO:tasks.workunit.client.1.smithi110.stdout:0/998: write d1/d56/f118 [1906051,42590] 0 2024-04-12T13:42:28.477 INFO:tasks.workunit.client.0.smithi060.stdout:4/930: dread d6/d2f/d7d/d11b/d1a/d57/d63/fec [0,4194304] 0 2024-04-12T13:42:28.479 INFO:tasks.workunit.client.0.smithi060.stdout:9/932: rmdir d4/d9 39 2024-04-12T13:42:28.481 INFO:tasks.workunit.client.1.smithi110.stdout:0/999: chown d1/d27/d6e/lc4 1 1 2024-04-12T13:42:28.484 INFO:tasks.workunit.client.0.smithi060.stdout:2/946: dread d6/d56/f54 [0,4194304] 0 2024-04-12T13:42:28.486 INFO:tasks.workunit.client.0.smithi060.stdout:7/922: truncate d0/fb0 1799980 0 2024-04-12T13:42:28.489 INFO:tasks.workunit.client.0.smithi060.stdout:6/974: rename d1/d7/da/dc/d24/d34/d51/cf4 to d1/d7/da/dc/d24/d30/d52/d5e/d7b/c137 0 2024-04-12T13:42:28.489 INFO:tasks.workunit.client.0.smithi060.stdout:8/904: write d9/d1d/f33 [4546734,62915] 0 2024-04-12T13:42:28.490 INFO:tasks.workunit.client.1.smithi110.stderr:+ rm -rf -- ./tmp.XI49Bfav7C 2024-04-12T13:42:28.493 INFO:tasks.workunit.client.0.smithi060.stdout:6/975: read - d1/d7/da/dc/d24/d2d/db3/f132 zero size 2024-04-12T13:42:28.493 INFO:tasks.workunit.client.0.smithi060.stdout:5/958: mkdir d6/dd/d1f/dc6/d138 0 2024-04-12T13:42:28.496 INFO:tasks.workunit.client.0.smithi060.stdout:6/976: write d1/d7/da/dc/d24/d34/d51/d97/da9/f124 [316906,120335] 0 2024-04-12T13:42:28.503 INFO:tasks.workunit.client.0.smithi060.stdout:7/923: symlink d0/d3d/d74/l127 0 2024-04-12T13:42:28.504 INFO:tasks.workunit.client.0.smithi060.stdout:8/905: fsync d9/d1b/d37/d4d/d63/d66/db3/d65/f67 0 2024-04-12T13:42:28.512 INFO:tasks.workunit.client.0.smithi060.stdout:3/974: fsync d7/d17/d102/f12b 0 2024-04-12T13:42:28.515 INFO:tasks.workunit.client.0.smithi060.stdout:6/977: rmdir d1/d7/da/dc/d24/d30/d52/d5e/d7b/dc1 39 2024-04-12T13:42:28.521 INFO:tasks.workunit.client.0.smithi060.stdout:7/924: creat d0/d1b/f128 x:0 0 0 2024-04-12T13:42:28.528 INFO:tasks.workunit.client.0.smithi060.stdout:4/931: link d6/d2f/d7d/d11b/d4d/f9b d6/db7/dbb/dfb/d11e/dd9/f12a 0 2024-04-12T13:42:28.530 INFO:tasks.workunit.client.0.smithi060.stdout:6/978: mkdir d1/d7/da/dc/d24/d30/d52/d78/d80/d138 0 2024-04-12T13:42:28.531 INFO:tasks.workunit.client.0.smithi060.stdout:3/975: read - d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/fa0 zero size 2024-04-12T13:42:28.538 INFO:tasks.workunit.client.0.smithi060.stdout:8/906: dread f1 [0,4194304] 0 2024-04-12T13:42:28.538 INFO:tasks.workunit.client.0.smithi060.stdout:4/932: mkdir d6/d21/d12b 0 2024-04-12T13:42:28.538 INFO:tasks.workunit.client.0.smithi060.stdout:2/947: dwrite d6/f10d [0,4194304] 0 2024-04-12T13:42:28.541 INFO:tasks.workunit.client.0.smithi060.stdout:6/979: write d1/d7/da/dc/f35 [532914,31849] 0 2024-04-12T13:42:28.543 INFO:tasks.workunit.client.0.smithi060.stdout:5/959: dwrite d6/f99 [0,4194304] 0 2024-04-12T13:42:28.544 INFO:tasks.workunit.client.0.smithi060.stdout:3/976: mknod d7/d17/d27/da7/dbe/dce/de6/c138 0 2024-04-12T13:42:28.546 INFO:tasks.workunit.client.0.smithi060.stdout:4/933: write d6/db7/dc2/f125 [970987,121893] 0 2024-04-12T13:42:28.551 INFO:tasks.workunit.client.0.smithi060.stdout:2/948: chown d6/d56/d58/da0/f5f 7 1 2024-04-12T13:42:28.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/977: stat d7/d17/d27/d36/d53/da2/d10e/l122 0 2024-04-12T13:42:28.557 INFO:tasks.workunit.client.0.smithi060.stdout:6/980: mkdir d1/d7/da/dc/d24/d122/d139 0 2024-04-12T13:42:28.559 INFO:tasks.workunit.client.0.smithi060.stdout:9/933: dwrite d4/d33/fdb [0,4194304] 0 2024-04-12T13:42:28.563 INFO:tasks.workunit.client.0.smithi060.stdout:8/907: write f1 [619070,97547] 0 2024-04-12T13:42:28.565 INFO:tasks.workunit.client.0.smithi060.stdout:2/949: dread - d6/dae/d31/d87/fd9 zero size 2024-04-12T13:42:28.566 INFO:tasks.workunit.client.0.smithi060.stdout:5/960: mkdir d6/dd/d27/d139 0 2024-04-12T13:42:28.576 INFO:tasks.workunit.client.0.smithi060.stdout:4/934: symlink d6/d2f/d7d/d11b/d1a/d57/d63/l12c 0 2024-04-12T13:42:28.577 INFO:tasks.workunit.client.0.smithi060.stdout:3/978: write d7/d17/d27/d36/d53/f94 [2587052,44149] 0 2024-04-12T13:42:28.578 INFO:tasks.workunit.client.0.smithi060.stdout:8/908: readlink d9/d1d/l72 0 2024-04-12T13:42:28.579 INFO:tasks.workunit.client.0.smithi060.stdout:6/981: creat d1/d7/da/dc/d7a/de1/dfe/f13a x:0 0 0 2024-04-12T13:42:28.582 INFO:tasks.workunit.client.0.smithi060.stdout:8/909: chown d9/d1d/d5e/d90/fff 16400668 1 2024-04-12T13:42:28.583 INFO:tasks.workunit.client.0.smithi060.stdout:3/979: chown d7/d17/d27/d36/db0/lb8 507818421 1 2024-04-12T13:42:28.587 INFO:tasks.workunit.client.0.smithi060.stdout:8/910: fdatasync d9/d1b/d2b/d82/d8a/d116/f130 0 2024-04-12T13:42:28.591 INFO:tasks.workunit.client.0.smithi060.stdout:2/950: write d6/f9b [3926438,34081] 0 2024-04-12T13:42:28.592 INFO:tasks.workunit.client.0.smithi060.stdout:5/961: creat d6/dd/d27/f13a x:0 0 0 2024-04-12T13:42:28.593 INFO:tasks.workunit.client.0.smithi060.stdout:9/934: link d4/d9/d19/lb9 d4/d9/d19/daf/d101/de8/d100/l132 0 2024-04-12T13:42:28.594 INFO:tasks.workunit.client.0.smithi060.stdout:3/980: creat d7/d17/d19/dc9/df3/f139 x:0 0 0 2024-04-12T13:42:28.596 INFO:tasks.workunit.client.0.smithi060.stdout:6/982: mknod d1/d7/da/dc/d24/d30/d52/d5e/c13b 0 2024-04-12T13:42:28.605 INFO:tasks.workunit.client.0.smithi060.stdout:5/962: rename d6/dd/d1f/d25/d42 to d6/dd/d1f/dd3/df3/d4c/d13b 0 2024-04-12T13:42:28.608 INFO:tasks.workunit.client.0.smithi060.stdout:4/935: dwrite d6/d2f/d7d/d11b/d1a/d19/d7a/f97 [0,4194304] 0 2024-04-12T13:42:28.609 INFO:tasks.workunit.client.0.smithi060.stdout:2/951: write d6/d64/d99/df0/d2b/d60/fd2 [811647,113658] 0 2024-04-12T13:42:28.612 INFO:tasks.workunit.client.0.smithi060.stdout:9/935: creat d4/d33/d65/de7/f133 x:0 0 0 2024-04-12T13:42:28.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/936: mkdir d4/d33/d65/de7/d134 0 2024-04-12T13:42:28.620 INFO:tasks.workunit.client.0.smithi060.stdout:6/983: creat d1/d7/da/dc/d24/d30/d52/d5e/f13c x:0 0 0 2024-04-12T13:42:28.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/952: mknod d6/d64/d99/df0/dc4/c126 0 2024-04-12T13:42:28.623 INFO:tasks.workunit.client.0.smithi060.stdout:5/963: truncate f2 5911545 0 2024-04-12T13:42:28.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.622+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f991c000bf0 con 0x7f992006bd40 2024-04-12T13:42:28.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/936: creat d6/d2f/d7d/d11b/f12d x:0 0 0 2024-04-12T13:42:28.629 INFO:tasks.workunit.client.0.smithi060.stdout:8/911: dwrite d9/d1b/d37/d4d/d63/fa9 [0,4194304] 0 2024-04-12T13:42:28.631 INFO:tasks.workunit.client.0.smithi060.stdout:9/937: rmdir d4/d9/d19/daf/d101/de8/d100 39 2024-04-12T13:42:28.634 INFO:tasks.workunit.client.0.smithi060.stdout:4/937: write d6/d2f/d7d/fb6 [3282252,112161] 0 2024-04-12T13:42:28.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.660+0000 7f9932a00700 1 -- 172.21.15.60:0/307520641 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f991c000bf0 con 0x7f992006bd40 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 starting - - - - 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (11m) 53s ago 11m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (10m) 60s ago 10m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (9m) 53s ago 10m 75.3M - 9.4.7 954c08fa6188 0008577f70d0 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (4m) 53s ago 4m 12.0M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:42:28.663 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (4m) 53s ago 4m 140M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (4m) 59s ago 4m 11.9M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (3m) 59s ago 3m 12.0M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (13m) 53s ago 13m 327M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (92s) 60s ago 10m 487M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (13m) 53s ago 13m 46.7M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (9m) 59s ago 9m 38.8M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 starting - - - - 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (10m) 60s ago 10m 8162k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (8m) 53s ago 8m 101M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (8m) 53s ago 8m 112M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (7m) 53s ago 7m 95.2M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (7m) 59s ago 7m 119M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (6m) 59s ago 6m 109M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (5m) 59s ago 5m 106M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:42:28.664 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (9m) 53s ago 10m 50.6M - 2.43.0 a07b618ecd1d 2d55c18f1b29 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 msgr2=0x7f992006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 0x7f992006e1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f992c013870 tx=0x7f992c009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 msgr2=0x7f993c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f992800eb40 tx=0x7f992800b040 comp rx=0 tx=0).stop 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 shutdown_connections 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f992006bd40 0x7f992006e1f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f993c0ff070 0x7f993c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 --2- 172.21.15.60:0/307520641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f993c100320 0x7f993c06e8b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 >> 172.21.15.60:0/307520641 conn(0x7f993c0fa950 msgr2=0x7f993c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:28.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 shutdown_connections 2024-04-12T13:42:28.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.663+0000 7f9941800700 1 -- 172.21.15.60:0/307520641 wait complete. 2024-04-12T13:42:28.676 INFO:tasks.workunit.client.0.smithi060.stdout:6/984: creat d1/d7/da/dc/d24/d30/d52/d78/d103/f13d x:0 0 0 2024-04-12T13:42:28.679 INFO:tasks.workunit.client.0.smithi060.stdout:8/912: creat d9/d1b/d84/da0/d80/d109/dbd/f13a x:0 0 0 2024-04-12T13:42:28.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/938: mknod d6/d2f/dbe/c12e 0 2024-04-12T13:42:28.680 INFO:tasks.workunit.client.0.smithi060.stdout:9/938: mknod d4/d9/d19/d8c/d92/dff/c135 0 2024-04-12T13:42:28.685 INFO:tasks.workunit.client.0.smithi060.stdout:9/939: dread - d4/d8/df1/d67/f7e zero size 2024-04-12T13:42:28.689 INFO:tasks.workunit.client.0.smithi060.stdout:5/964: dwrite f2 [0,4194304] 0 2024-04-12T13:42:28.690 INFO:tasks.workunit.client.0.smithi060.stdout:4/939: creat d6/d2f/d7d/d11b/d1a/d56/f12f x:0 0 0 2024-04-12T13:42:28.692 INFO:tasks.workunit.client.0.smithi060.stdout:3/981: dread d7/d17/d19/d96/fc3 [0,4194304] 0 2024-04-12T13:42:28.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/940: write d4/d8/d7c/fde [441607,79827] 0 2024-04-12T13:42:28.698 INFO:tasks.workunit.client.0.smithi060.stdout:9/941: write d4/d33/d50/dd0/f11b [1038084,30338] 0 2024-04-12T13:42:28.709 INFO:tasks.workunit.client.0.smithi060.stdout:4/940: dread d6/d2f/d7d/d11b/df/fc0 [0,4194304] 0 2024-04-12T13:42:28.714 INFO:tasks.workunit.client.0.smithi060.stdout:4/941: dread - d6/d2f/d7d/d11b/d1a/d57/d63/d68/d76/f129 zero size 2024-04-12T13:42:28.715 INFO:tasks.workunit.client.0.smithi060.stdout:8/913: rename d9/d1d/f33 to d9/d1b/d2b/d82/d8a/f13b 0 2024-04-12T13:42:28.719 INFO:tasks.workunit.client.0.smithi060.stdout:5/965: write d6/dd/d1f/dd3/df3/d38/f40 [5211406,54913] 0 2024-04-12T13:42:28.723 INFO:tasks.workunit.client.0.smithi060.stdout:3/982: symlink d7/d17/d19/l13a 0 2024-04-12T13:42:28.724 INFO:tasks.workunit.client.0.smithi060.stdout:6/985: dwrite d1/d7/da/dc/d24/d34/d51/d97/f9d [0,4194304] 0 2024-04-12T13:42:28.738 INFO:tasks.workunit.client.0.smithi060.stdout:9/942: mkdir d4/d33/d115/d136 0 2024-04-12T13:42:28.744 INFO:tasks.workunit.client.0.smithi060.stdout:6/986: truncate d1/d7/da/dc/d24/d30/d52/d78/fff 47610 0 2024-04-12T13:42:28.745 INFO:tasks.workunit.client.0.smithi060.stdout:8/914: write d9/d1b/d37/d4d/d63/d66/db3/d65/f67 [1354140,37749] 0 2024-04-12T13:42:28.752 INFO:tasks.workunit.client.0.smithi060.stdout:4/942: dread d6/d2f/d7d/d11b/d1a/fcd [0,4194304] 0 2024-04-12T13:42:28.757 INFO:tasks.workunit.client.0.smithi060.stdout:6/987: mknod d1/d7/da/dc/d24/d30/d52/d78/d80/de6/c13e 0 2024-04-12T13:42:28.761 INFO:tasks.workunit.client.0.smithi060.stdout:9/943: write d4/d33/d50/f6c [83548,65023] 0 2024-04-12T13:42:28.762 INFO:tasks.workunit.client.0.smithi060.stdout:8/915: write d9/d1b/d37/d4d/f108 [1407782,12567] 0 2024-04-12T13:42:28.767 INFO:tasks.workunit.client.0.smithi060.stdout:4/943: mknod d6/d2f/d7d/d11b/d1a/d57/d63/df4/d85/c130 0 2024-04-12T13:42:28.771 INFO:tasks.workunit.client.0.smithi060.stdout:3/983: dwrite d7/d17/d19/f23 [0,4194304] 0 2024-04-12T13:42:28.772 INFO:tasks.workunit.client.0.smithi060.stdout:5/966: dwrite d6/dd/d1f/dd3/df3/d4c/fcd [0,4194304] 0 2024-04-12T13:42:28.772 INFO:tasks.workunit.client.0.smithi060.stdout:8/916: mkdir d9/d1b/d13c 0 2024-04-12T13:42:28.782 INFO:tasks.workunit.client.0.smithi060.stdout:4/944: creat d6/d2f/d7d/d11b/d1a/d57/d63/d68/d94/f131 x:0 0 0 2024-04-12T13:42:28.784 INFO:tasks.workunit.client.0.smithi060.stdout:0/911: sync 2024-04-12T13:42:28.785 INFO:tasks.workunit.client.0.smithi060.stdout:3/984: fdatasync d7/d17/d27/d36/db0/dc4/de9/ffb 0 2024-04-12T13:42:28.789 INFO:tasks.workunit.client.0.smithi060.stdout:6/988: truncate d1/d7/da/dc/d24/d30/d52/d78/dc7/fef 63094 0 2024-04-12T13:42:28.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/967: dread d6/d10/db8/dee/dfc/da2/fbf [0,4194304] 0 2024-04-12T13:42:28.800 INFO:tasks.workunit.client.0.smithi060.stdout:4/945: unlink d6/d2f/d7d/d11b/d1a/d19/f1b 0 2024-04-12T13:42:28.800 INFO:tasks.workunit.client.0.smithi060.stdout:5/968: chown d6/dd/d1f/dd3/d5f 50340323 1 2024-04-12T13:42:28.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/985: read d7/d17/d27/d36/d53/da2/ff6 [304244,96197] 0 2024-04-12T13:42:28.808 INFO:tasks.workunit.client.0.smithi060.stdout:9/944: dread d4/d8/d32/f78 [0,4194304] 0 2024-04-12T13:42:28.814 INFO:tasks.workunit.client.0.smithi060.stdout:4/946: rename d6/db7/dbb/fcb to d6/d2f/d7d/d11b/d1a/d57/d63/d68/f132 0 2024-04-12T13:42:28.828 INFO:tasks.workunit.client.0.smithi060.stdout:8/917: dwrite d9/d1b/d37/d4d/d63/f85 [0,4194304] 0 2024-04-12T13:42:28.836 INFO:tasks.workunit.client.0.smithi060.stdout:3/986: write d7/d17/f1a [1694700,42011] 0 2024-04-12T13:42:28.846 INFO:tasks.workunit.client.0.smithi060.stdout:0/912: dwrite d7/d9/f23 [0,4194304] 0 2024-04-12T13:42:28.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/918: mknod d9/d1b/d84/da0/d80/d109/dbd/c13d 0 2024-04-12T13:42:28.848 INFO:tasks.workunit.client.0.smithi060.stdout:4/947: rename d6/d2f/d7d/d11b/d1a/d57/d63/df4/dc8/c120 to d6/d21/d12b/c133 0 2024-04-12T13:42:28.853 INFO:tasks.workunit.client.0.smithi060.stdout:0/913: chown d7/d9/d14/d35/d44/d8c 0 1 2024-04-12T13:42:28.853 INFO:tasks.workunit.client.0.smithi060.stdout:9/945: dwrite d4/d9/d19/d21/fd6 [0,4194304] 0 2024-04-12T13:42:28.854 INFO:tasks.workunit.client.0.smithi060.stdout:3/987: creat d7/d17/d19/dc9/d3f/f13b x:0 0 0 2024-04-12T13:42:28.855 INFO:tasks.workunit.client.0.smithi060.stdout:0/914: write d7/d9/f92 [668771,32525] 0 2024-04-12T13:42:28.857 INFO:tasks.workunit.client.0.smithi060.stdout:4/948: creat d6/d2f/d7d/d11b/d1a/d19/d7a/f134 x:0 0 0 2024-04-12T13:42:28.857 INFO:tasks.workunit.client.0.smithi060.stdout:8/919: mkdir d9/dc9/d13e 0 2024-04-12T13:42:28.860 INFO:tasks.workunit.client.0.smithi060.stdout:5/969: dread d6/dd/d1f/dd3/df3/d4c/da8/f128 [0,4194304] 0 2024-04-12T13:42:28.861 INFO:tasks.workunit.client.0.smithi060.stdout:4/949: write d6/d2f/d7d/d11b/d109/f124 [567197,105646] 0 2024-04-12T13:42:28.862 INFO:tasks.workunit.client.0.smithi060.stdout:3/988: readlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d6d/l76 0 2024-04-12T13:42:28.871 INFO:tasks.workunit.client.0.smithi060.stdout:5/970: truncate d6/dd/faa 507469 0 2024-04-12T13:42:28.871 INFO:tasks.workunit.client.0.smithi060.stdout:4/950: mknod d6/d2f/d7d/d11b/d1a/d19/dad/c135 0 2024-04-12T13:42:28.872 INFO:tasks.workunit.client.0.smithi060.stdout:0/915: symlink d7/d9/d14/d35/d44/d7d/de8/d12f/l139 0 2024-04-12T13:42:28.874 INFO:tasks.workunit.client.0.smithi060.stdout:4/951: dread - d6/db7/f123 zero size 2024-04-12T13:42:28.876 INFO:tasks.workunit.client.0.smithi060.stdout:0/916: chown d7/d9/de/d80/dc8/fe2 243 1 2024-04-12T13:42:28.878 INFO:tasks.workunit.client.0.smithi060.stdout:5/971: mkdir d6/dd/d1f/d25/d53/d8d/d13c 0 2024-04-12T13:42:28.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 -- 172.21.15.60:0/2535462768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c103400 msgr2=0x7f857c103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 --2- 172.21.15.60:0/2535462768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c103400 0x7f857c103810 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f856c004940 tx=0x7f856c009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:28.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 -- 172.21.15.60:0/2535462768 shutdown_connections 2024-04-12T13:42:28.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 --2- 172.21.15.60:0/2535462768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 --2- 172.21.15.60:0/2535462768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c103400 0x7f857c103810 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f856c004940 tx=0x7f856c009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 -- 172.21.15.60:0/2535462768 >> 172.21.15.60:0/2535462768 conn(0x7f857c066d10 msgr2=0x7f857c067130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 -- 172.21.15.60:0/2535462768 shutdown_connections 2024-04-12T13:42:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.880+0000 7f8583000700 1 -- 172.21.15.60:0/2535462768 wait complete. 2024-04-12T13:42:28.885 INFO:tasks.workunit.client.0.smithi060.stdout:3/989: creat d7/d17/d19/dc9/d3f/d5c/d103/f13c x:0 0 0 2024-04-12T13:42:28.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.883+0000 7f8583000700 1 Processor -- start 2024-04-12T13:42:28.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.883+0000 7f8583000700 1 -- start start 2024-04-12T13:42:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.885+0000 7f8583000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.885+0000 7f8583000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 0x7f857c07dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.885+0000 7f8583000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c122360 con 0x7f857c07d930 2024-04-12T13:42:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.885+0000 7f8583000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1224a0 con 0x7f857c1046b0 2024-04-12T13:42:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.886+0000 7f857be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.886+0000 7f857be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c07d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:44904/0 (socket says 172.21.15.60:44904) 2024-04-12T13:42:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.886+0000 7f857be00700 1 -- 172.21.15.60:0/3663026205 learned_addr learned my addr 172.21.15.60:0/3663026205 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.886+0000 7f857b400700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 0x7f857c07dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.887+0000 7f857b400700 1 -- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 msgr2=0x7f857c07d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.887+0000 7f857b400700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c07d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.887+0000 7f857b400700 1 -- 172.21.15.60:0/3663026205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c005040 con 0x7f857c07d930 2024-04-12T13:42:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.888+0000 7f857b400700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 0x7f857c07dda0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8568002820 tx=0x7f8568004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:28.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.888+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8568007cc0 con 0x7f857c07d930 2024-04-12T13:42:28.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.889+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c1225e0 con 0x7f857c07d930 2024-04-12T13:42:28.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.889+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c122ba0 con 0x7f857c07d930 2024-04-12T13:42:28.892 INFO:tasks.workunit.client.0.smithi060.stdout:4/952: symlink d6/d2f/d7d/d11b/d1a/d19/d7a/l136 0 2024-04-12T13:42:28.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.890+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f856800f040 con 0x7f857c07d930 2024-04-12T13:42:28.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.890+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c05f5f0 con 0x7f857c07d930 2024-04-12T13:42:28.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.890+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856801c790 con 0x7f857c07d930 2024-04-12T13:42:28.896 INFO:tasks.workunit.client.0.smithi060.stdout:3/990: mknod d7/d17/d27/c13d 0 2024-04-12T13:42:28.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.894+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f8568009760 con 0x7f857c07d930 2024-04-12T13:42:28.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.896+0000 7f8573e00700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 0x7f856006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:28.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.896+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f856808b200 con 0x7f857c07d930 2024-04-12T13:42:28.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.896+0000 7f857be00700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 0x7f856006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:28.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.897+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f8568054770 con 0x7f857c07d930 2024-04-12T13:42:28.900 INFO:tasks.workunit.client.0.smithi060.stdout:3/991: write d7/d17/d27/d36/d53/f71 [1638139,44] 0 2024-04-12T13:42:28.900 INFO:tasks.workunit.client.0.smithi060.stdout:5/972: rename d6/dd/d1f/d25/d53/d87/d7e/dca/ded/ffa to d6/dd/d1f/dd3/df3/d4c/d13b/d52/f13d 0 2024-04-12T13:42:28.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:28.899+0000 7f857be00700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 0x7f856006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f856c004890 tx=0x7f856c009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:28.905 INFO:tasks.workunit.client.0.smithi060.stdout:4/953: rmdir d6/db7 39 2024-04-12T13:42:28.905 INFO:tasks.workunit.client.0.smithi060.stdout:3/992: dread - d7/d17/d27/d36/db0/dd9/fe8 zero size 2024-04-12T13:42:28.908 INFO:tasks.workunit.client.0.smithi060.stdout:5/973: creat d6/dd/d1f/dd3/f13e x:0 0 0 2024-04-12T13:42:28.913 INFO:tasks.workunit.client.0.smithi060.stdout:5/974: mknod d6/dd/d1f/dd3/df3/d4c/d13b/d52/dc8/c13f 0 2024-04-12T13:42:28.917 INFO:tasks.workunit.client.0.smithi060.stdout:9/946: write d4/d9/d19/d21/dbf/fdc [457590,54671] 0 2024-04-12T13:42:28.919 INFO:tasks.workunit.client.0.smithi060.stdout:8/920: write d9/d1b/d84/da0/d80/d109/f86 [3108456,124485] 0 2024-04-12T13:42:28.925 INFO:tasks.workunit.client.0.smithi060.stdout:9/947: unlink d4/d33/d50/l56 0 2024-04-12T13:42:28.926 INFO:tasks.workunit.client.0.smithi060.stdout:8/921: write d9/d1b/d2b/fbe [935959,46506] 0 2024-04-12T13:42:28.933 INFO:tasks.workunit.client.0.smithi060.stdout:8/922: write d9/d1b/d84/da0/d80/fd3 [861178,81850] 0 2024-04-12T13:42:28.936 INFO:tasks.workunit.client.0.smithi060.stdout:5/975: write d6/dd/d1f/d25/f34 [3365266,52435] 0 2024-04-12T13:42:28.940 INFO:tasks.workunit.client.0.smithi060.stdout:3/993: dread d7/d17/d19/dc9/d3f/d5c/d103/f77 [0,4194304] 0 2024-04-12T13:42:28.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/948: write d4/d8/df1/fdd [1008352,98211] 0 2024-04-12T13:42:28.946 INFO:tasks.workunit.client.0.smithi060.stdout:9/949: fdatasync d4/d9/ff7 0 2024-04-12T13:42:28.947 INFO:tasks.workunit.client.0.smithi060.stdout:5/976: rmdir d6/dd/d1f/dd3/df3/d38 39 2024-04-12T13:42:28.960 INFO:tasks.workunit.client.0.smithi060.stdout:3/994: write d7/d17/d19/dc9/fef [107710,108524] 0 2024-04-12T13:42:28.964 INFO:tasks.workunit.client.0.smithi060.stdout:8/923: dwrite d9/d1b/d84/da0/f11c [0,4194304] 0 2024-04-12T13:42:28.966 INFO:tasks.workunit.client.0.smithi060.stdout:3/995: truncate d7/d17/d27/d36/db0/dd9/f131 350307 0 2024-04-12T13:42:28.967 INFO:tasks.workunit.client.0.smithi060.stdout:9/950: fsync d4/d9/ff2 0 2024-04-12T13:42:28.967 INFO:tasks.workunit.client.0.smithi060.stdout:7/925: sync 2024-04-12T13:42:28.972 INFO:tasks.workunit.client.0.smithi060.stdout:9/951: stat d4/d9/d19/d21/fc7 0 2024-04-12T13:42:28.974 INFO:tasks.workunit.client.0.smithi060.stdout:3/996: mkdir d7/d17/d27/d36/db0/d13e 0 2024-04-12T13:42:28.984 INFO:tasks.workunit.client.0.smithi060.stdout:3/997: symlink d7/d17/d19/dc9/d3f/d5c/d103/d63/d9b/l13f 0 2024-04-12T13:42:28.989 INFO:tasks.workunit.client.0.smithi060.stdout:7/926: dread d0/d78/f97 [0,4194304] 0 2024-04-12T13:42:28.992 INFO:tasks.workunit.client.0.smithi060.stdout:3/998: symlink d7/d17/d27/da7/dbe/dce/de6/dea/l140 0 2024-04-12T13:42:28.995 INFO:tasks.workunit.client.0.smithi060.stdout:3/999: chown d7/d17/d27/d36/d53/da2/d10a/f12a 311163 1 2024-04-12T13:42:29.004 INFO:tasks.workunit.client.0.smithi060.stdout:7/927: dwrite d0/d78/f10a [0,4194304] 0 2024-04-12T13:42:29.032 INFO:tasks.workunit.client.0.smithi060.stdout:7/928: dwrite d0/d7/d43/d63/d90/fb9 [0,4194304] 0 2024-04-12T13:42:29.054 INFO:tasks.workunit.client.0.smithi060.stdout:7/929: dwrite d0/d7/d43/d63/f9f [0,4194304] 0 2024-04-12T13:42:29.058 INFO:tasks.workunit.client.0.smithi060.stdout:7/930: rename d0/d7/d43/fce to d0/d1b/f129 0 2024-04-12T13:42:29.074 INFO:tasks.workunit.client.0.smithi060.stdout:7/931: dwrite d0/d7/d43/d4d/f110 [0,4194304] 0 2024-04-12T13:42:29.077 INFO:tasks.workunit.client.0.smithi060.stdout:7/932: write d0/d1b/f37 [1442659,25937] 0 2024-04-12T13:42:29.080 INFO:tasks.workunit.client.0.smithi060.stdout:7/933: chown d0/d7/d43/d63/d90/de7 6049 1 2024-04-12T13:42:29.105 INFO:tasks.workunit.client.0.smithi060.stdout:7/934: dwrite d0/fad [0,4194304] 0 2024-04-12T13:42:29.111 INFO:tasks.workunit.client.0.smithi060.stdout:7/935: mknod d0/d3d/d74/c12a 0 2024-04-12T13:42:29.114 INFO:tasks.workunit.client.0.smithi060.stdout:7/936: chown d0/d1b/da4/c107 448463 1 2024-04-12T13:42:29.118 INFO:tasks.workunit.client.0.smithi060.stdout:7/937: rmdir d0/d3d/dd7 39 2024-04-12T13:42:29.123 INFO:tasks.workunit.client.0.smithi060.stdout:7/938: rename d0/d1b/fa2 to d0/d3d/dcf/d10b/f12b 0 2024-04-12T13:42:29.153 INFO:tasks.workunit.client.0.smithi060.stdout:7/939: dread d0/d7/f87 [0,4194304] 0 2024-04-12T13:42:29.157 INFO:tasks.workunit.client.0.smithi060.stdout:7/940: creat d0/d7/f12c x:0 0 0 2024-04-12T13:42:29.159 INFO:tasks.workunit.client.0.smithi060.stdout:7/941: truncate d0/f47 1444788 0 2024-04-12T13:42:29.161 INFO:tasks.workunit.client.0.smithi060.stdout:7/942: creat d0/d3d/d74/f12d x:0 0 0 2024-04-12T13:42:29.166 INFO:tasks.workunit.client.0.smithi060.stdout:7/943: truncate d0/d1b/f5b 4612567 0 2024-04-12T13:42:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:28 smithi060 ceph-mon[29097]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:28 smithi060 ceph-mon[29097]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:29.180 INFO:tasks.workunit.client.0.smithi060.stdout:2/953: sync 2024-04-12T13:42:29.190 INFO:tasks.workunit.client.0.smithi060.stdout:7/944: dwrite d0/d7/da9/f118 [0,4194304] 0 2024-04-12T13:42:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:28 smithi110 ceph-mon[36055]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:28 smithi110 ceph-mon[36055]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:29.236 INFO:tasks.workunit.client.0.smithi060.stdout:2/954: mknod d6/d56/d58/da0/c127 0 2024-04-12T13:42:29.238 INFO:tasks.workunit.client.0.smithi060.stdout:2/955: readlink d6/d64/d99/df0/d2b/d60/l69 0 2024-04-12T13:42:29.238 INFO:tasks.workunit.client.0.smithi060.stdout:7/945: creat d0/d3d/d74/f12e x:0 0 0 2024-04-12T13:42:29.240 INFO:tasks.workunit.client.0.smithi060.stdout:7/946: dread - d0/d7/da9/dc9/db1/f125 zero size 2024-04-12T13:42:29.245 INFO:tasks.workunit.client.0.smithi060.stdout:7/947: unlink d0/d7/d43/d63/d6f/fe9 0 2024-04-12T13:42:29.247 INFO:tasks.workunit.client.0.smithi060.stdout:2/956: getdents d6/d64/d99/df0/d11b 0 2024-04-12T13:42:29.252 INFO:tasks.workunit.client.0.smithi060.stdout:7/948: rename d0/d3d/d74/d9b/da1/fd1 to d0/d3d/d74/d9b/f12f 0 2024-04-12T13:42:29.253 INFO:tasks.workunit.client.0.smithi060.stdout:2/957: mknod d6/d64/d99/df0/c128 0 2024-04-12T13:42:29.257 INFO:tasks.workunit.client.0.smithi060.stdout:7/949: unlink d0/d3d/d74/c112 0 2024-04-12T13:42:29.265 INFO:tasks.workunit.client.0.smithi060.stdout:7/950: link d0/d7/fbd d0/d3d/d74/d9b/f130 0 2024-04-12T13:42:29.269 INFO:tasks.workunit.client.0.smithi060.stdout:7/951: mknod d0/d3d/dcf/c131 0 2024-04-12T13:42:29.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/952: stat d0/d3d/f7c 0 2024-04-12T13:42:29.276 INFO:tasks.workunit.client.0.smithi060.stdout:2/958: dread d6/dae/d31/f41 [0,4194304] 0 2024-04-12T13:42:29.276 INFO:tasks.workunit.client.0.smithi060.stdout:7/953: mknod d0/d7/d43/d63/d6f/c132 0 2024-04-12T13:42:29.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/959: chown d6/d64/d99/df0/d4b/c53 947234 1 2024-04-12T13:42:29.280 INFO:tasks.workunit.client.0.smithi060.stdout:7/954: mkdir d0/d7/d92/d133 0 2024-04-12T13:42:29.281 INFO:tasks.workunit.client.0.smithi060.stdout:7/955: chown d0/d1b/l25 1376 1 2024-04-12T13:42:29.283 INFO:tasks.workunit.client.0.smithi060.stdout:2/960: creat d6/d64/d99/df0/d4b/f129 x:0 0 0 2024-04-12T13:42:29.288 INFO:tasks.workunit.client.0.smithi060.stdout:2/961: rmdir d6/dae/d5b/d6d/de1 39 2024-04-12T13:42:29.292 INFO:tasks.workunit.client.0.smithi060.stdout:2/962: fsync d6/d56/d86/f103 0 2024-04-12T13:42:29.293 INFO:tasks.workunit.client.0.smithi060.stdout:7/956: getdents d0/df3 0 2024-04-12T13:42:29.299 INFO:tasks.workunit.client.0.smithi060.stdout:2/963: rename d6/d64/d99/df0/d2b/d60/lb1 to d6/d64/d99/df0/d16/d36/l12a 0 2024-04-12T13:42:29.323 INFO:tasks.workunit.client.0.smithi060.stdout:7/957: dwrite d0/d3d/f40 [0,4194304] 0 2024-04-12T13:42:29.325 INFO:tasks.workunit.client.0.smithi060.stdout:0/917: sync 2024-04-12T13:42:29.325 INFO:tasks.workunit.client.0.smithi060.stdout:6/989: sync 2024-04-12T13:42:29.329 INFO:tasks.workunit.client.0.smithi060.stdout:2/964: dwrite d6/dae/f67 [0,4194304] 0 2024-04-12T13:42:29.348 INFO:tasks.workunit.client.0.smithi060.stdout:6/990: creat d1/d7/da/dc/d24/d30/d52/d5e/f13f x:0 0 0 2024-04-12T13:42:29.356 INFO:tasks.workunit.client.0.smithi060.stdout:6/991: getdents d1/d7/da/dc/d24/d30/d52/d78/d80/d138 0 2024-04-12T13:42:29.365 INFO:tasks.workunit.client.0.smithi060.stdout:2/965: write d6/d56/d43/f5e [884195,56458] 0 2024-04-12T13:42:29.365 INFO:tasks.workunit.client.0.smithi060.stdout:7/958: dread d0/f21 [0,4194304] 0 2024-04-12T13:42:29.368 INFO:tasks.workunit.client.0.smithi060.stdout:0/918: write d7/d9/d14/d35/d44/d7d/fac [430340,105689] 0 2024-04-12T13:42:29.373 INFO:tasks.workunit.client.0.smithi060.stdout:2/966: symlink d6/dae/d5b/d6d/de1/df8/l12b 0 2024-04-12T13:42:29.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/959: symlink d0/d3d/l134 0 2024-04-12T13:42:29.380 INFO:tasks.workunit.client.0.smithi060.stdout:6/992: truncate d1/d7/da/fbf 1250001 0 2024-04-12T13:42:29.380 INFO:tasks.workunit.client.0.smithi060.stdout:2/967: chown d6/dae/d31/d33/l3a 1208 1 2024-04-12T13:42:29.384 INFO:tasks.workunit.client.0.smithi060.stdout:7/960: mknod d0/d1b/da4/d120/c135 0 2024-04-12T13:42:29.387 INFO:tasks.workunit.client.0.smithi060.stdout:2/968: write d6/d64/d99/df0/d81/dbd/f59 [492733,104833] 0 2024-04-12T13:42:29.398 INFO:tasks.workunit.client.0.smithi060.stdout:6/993: dread d1/d7/da/dc/d7a/de1/d113/f87 [0,4194304] 0 2024-04-12T13:42:29.402 INFO:tasks.workunit.client.0.smithi060.stdout:6/994: chown d1/d7/da/d20/l2e 6 1 2024-04-12T13:42:29.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/919: dwrite d7/d9/de/d80/d8b/f120 [0,4194304] 0 2024-04-12T13:42:29.408 INFO:tasks.workunit.client.0.smithi060.stdout:6/995: write d1/d7/da/d20/f4e [2300558,87896] 0 2024-04-12T13:42:29.411 INFO:tasks.workunit.client.0.smithi060.stdout:2/969: write d6/dae/d31/d33/fa5 [1174883,21702] 0 2024-04-12T13:42:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.417+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f857c04bed0 con 0x7f857c07d930 2024-04-12T13:42:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.418+0000 7f8573e00700 1 -- 172.21.15.60:0/3663026205 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8568057e30 con 0x7f857c07d930 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:42:29.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 13, 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:42:29.424 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:42:29.425 INFO:tasks.workunit.client.0.smithi060.stdout:8/924: sync 2024-04-12T13:42:29.425 INFO:tasks.workunit.client.0.smithi060.stdout:9/952: sync 2024-04-12T13:42:29.425 INFO:tasks.workunit.client.0.smithi060.stdout:4/954: sync 2024-04-12T13:42:29.425 INFO:tasks.workunit.client.0.smithi060.stdout:5/977: sync 2024-04-12T13:42:29.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 msgr2=0x7f856006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:29.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 0x7f856006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f856c004890 tx=0x7f856c009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:29.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 msgr2=0x7f857c07dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:29.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 0x7f857c07dda0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8568002820 tx=0x7f8568004570 comp rx=0 tx=0).stop 2024-04-12T13:42:29.427 INFO:tasks.workunit.client.0.smithi060.stdout:2/970: creat d6/d64/d99/df0/daa/db0/def/f12c x:0 0 0 2024-04-12T13:42:29.427 INFO:tasks.workunit.client.0.smithi060.stdout:8/925: chown d9/d1d/d5e 5514 1 2024-04-12T13:42:29.427 INFO:tasks.workunit.client.0.smithi060.stdout:0/920: creat d7/d41/dbc/f13a x:0 0 0 2024-04-12T13:42:29.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/961: dwrite d0/f64 [0,4194304] 0 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 shutdown_connections 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f856006bcf0 0x7f856006e1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f857c1046b0 0x7f857c07d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 --2- 172.21.15.60:0/3663026205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f857c07d930 0x7f857c07dda0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8568002820 tx=0x7f8568004570 comp rx=0 tx=0).stop 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.422+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 >> 172.21.15.60:0/3663026205 conn(0x7f857c066d10 msgr2=0x7f857c0752a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.424+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 shutdown_connections 2024-04-12T13:42:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.425+0000 7f8583000700 1 -- 172.21.15.60:0/3663026205 wait complete. 2024-04-12T13:42:29.431 INFO:tasks.workunit.client.0.smithi060.stdout:6/996: write d1/d7/da/dc/d24/d30/f115 [77332,57498] 0 2024-04-12T13:42:29.440 INFO:tasks.workunit.client.0.smithi060.stdout:9/953: creat d4/d33/d115/f137 x:0 0 0 2024-04-12T13:42:29.444 INFO:tasks.workunit.client.0.smithi060.stdout:0/921: mknod d7/d9/d14/d35/d44/d8c/d8d/d10b/c13b 0 2024-04-12T13:42:29.446 INFO:tasks.workunit.client.0.smithi060.stdout:8/926: symlink d9/d1b/d2b/l13f 0 2024-04-12T13:42:29.447 INFO:tasks.workunit.client.0.smithi060.stdout:7/962: truncate d0/d7/d43/d63/d90/f122 360638 0 2024-04-12T13:42:29.449 INFO:tasks.workunit.client.0.smithi060.stdout:9/954: fdatasync d4/d9/d19/d21/f31 0 2024-04-12T13:42:29.452 INFO:tasks.workunit.client.0.smithi060.stdout:6/997: truncate d1/d7/da/dc/d7a/de1/dfe/f13a 790682 0 2024-04-12T13:42:29.455 INFO:tasks.workunit.client.0.smithi060.stdout:2/971: write d6/f9 [798000,33463] 0 2024-04-12T13:42:29.461 INFO:tasks.workunit.client.0.smithi060.stdout:7/963: mkdir d0/d7/da9/dc9/d136 0 2024-04-12T13:42:29.466 INFO:tasks.workunit.client.0.smithi060.stdout:9/955: mkdir d4/d8/dad/dd9/d12b/d138 0 2024-04-12T13:42:29.466 INFO:tasks.workunit.client.0.smithi060.stdout:6/998: write d1/d7/da/dc/d24/d2d/db0/db2/fe9 [883678,59904] 0 2024-04-12T13:42:29.472 INFO:tasks.workunit.client.0.smithi060.stdout:0/922: mkdir d7/d9/d14/d35/d44/d8c/d8d/de9/d13c 0 2024-04-12T13:42:29.472 INFO:tasks.workunit.client.0.smithi060.stdout:5/978: dwrite f2 [4194304,4194304] 0 2024-04-12T13:42:29.474 INFO:tasks.workunit.client.0.smithi060.stdout:8/927: write d9/d1b/d2b/d82/d8a/dce/fc4 [793869,109419] 0 2024-04-12T13:42:29.483 INFO:tasks.workunit.client.0.smithi060.stdout:5/979: write d6/dd/d1f/d25/d53/d87/f60 [1209651,4948] 0 2024-04-12T13:42:29.499 INFO:tasks.workunit.client.0.smithi060.stdout:4/955: dread d6/d7/f8c [0,4194304] 0 2024-04-12T13:42:29.514 INFO:tasks.workunit.client.0.smithi060.stdout:9/956: dread d4/d9/d19/d8c/f107 [0,4194304] 0 2024-04-12T13:42:29.612 INFO:tasks.workunit.client.0.smithi060.stdout:2/972: read d6/d64/d99/df0/d4b/fe5 [751633,86928] 0 2024-04-12T13:42:29.620 INFO:tasks.workunit.client.0.smithi060.stdout:0/923: dread d7/fa3 [0,4194304] 0 2024-04-12T13:42:29.620 INFO:tasks.workunit.client.0.smithi060.stdout:6/999: rename d1/d7/da/dc/d24/d30/dd8/f135 to d1/d7/da/dc/d24/d8b/f140 0 2024-04-12T13:42:29.622 INFO:tasks.workunit.client.0.smithi060.stdout:5/980: mknod d6/d10/db8/dee/dfc/d3d/c140 0 2024-04-12T13:42:29.628 INFO:tasks.workunit.client.0.smithi060.stdout:4/956: readlink d6/la6 0 2024-04-12T13:42:29.633 INFO:tasks.workunit.client.0.smithi060.stdout:9/957: read d4/fa1 [1056412,8276] 0 2024-04-12T13:42:29.637 INFO:tasks.workunit.client.0.smithi060.stdout:8/928: dread d9/d1b/d84/da0/d114/f11e [0,4194304] 0 2024-04-12T13:42:29.648 INFO:tasks.workunit.client.0.smithi060.stdout:8/929: dread d9/d1b/d84/da0/d80/d109/d7b/f9e [0,4194304] 0 2024-04-12T13:42:29.648 INFO:tasks.workunit.client.0.smithi060.stdout:5/981: unlink d6/dd/d1f/dd3/de7/df8/f105 0 2024-04-12T13:42:29.651 INFO:tasks.workunit.client.0.smithi060.stdout:8/930: chown d9/d1b/d37/d48 37508947 1 2024-04-12T13:42:29.653 INFO:tasks.workunit.client.0.smithi060.stdout:9/958: mkdir d4/d8/d32/d139 0 2024-04-12T13:42:29.659 INFO:tasks.workunit.client.0.smithi060.stdout:7/964: getdents d0/d7/d92 0 2024-04-12T13:42:29.660 INFO:tasks.workunit.client.0.smithi060.stdout:7/965: chown d0/d3d/d74/cd5 298 1 2024-04-12T13:42:29.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.658+0000 7f2472a00700 1 -- 172.21.15.60:0/2214859945 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464013b70 con 0x7f2474104fc0 2024-04-12T13:42:29.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.658+0000 7f247b200700 1 -- 172.21.15.60:0/2214859945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 msgr2=0x7f24741073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:29.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.658+0000 7f247b200700 1 --2- 172.21.15.60:0/2214859945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f24741073a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2464004940 tx=0x7f2464009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:29.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.658+0000 7f247b200700 1 -- 172.21.15.60:0/2214859945 shutdown_connections 2024-04-12T13:42:29.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.659+0000 7f247b200700 1 --2- 172.21.15.60:0/2214859945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:29.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.659+0000 7f247b200700 1 --2- 172.21.15.60:0/2214859945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f24741073a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:29.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.659+0000 7f247b200700 1 -- 172.21.15.60:0/2214859945 >> 172.21.15.60:0/2214859945 conn(0x7f2474069df0 msgr2=0x7f247406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:29.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.659+0000 7f247b200700 1 -- 172.21.15.60:0/2214859945 shutdown_connections 2024-04-12T13:42:29.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.659+0000 7f247b200700 1 -- 172.21.15.60:0/2214859945 wait complete. 2024-04-12T13:42:29.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.660+0000 7f247b200700 1 Processor -- start 2024-04-12T13:42:29.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.660+0000 7f247b200700 1 -- start start 2024-04-12T13:42:29.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.661+0000 7f247b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:29.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.661+0000 7f247b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:29.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f2473e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:29.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f2473400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:29.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f2473e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:49072/0 (socket says 172.21.15.60:49072) 2024-04-12T13:42:29.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f247b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474114a00 con 0x7f24741078e0 2024-04-12T13:42:29.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f247b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474114b70 con 0x7f2474104fc0 2024-04-12T13:42:29.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f2473400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57314/0 (socket says 172.21.15.60:57314) 2024-04-12T13:42:29.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.662+0000 7f2473400700 1 -- 172.21.15.60:0/3967235369 learned_addr learned my addr 172.21.15.60:0/3967235369 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:29.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.663+0000 7f2473e00700 1 -- 172.21.15.60:0/3967235369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 msgr2=0x7f2474114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:29.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.663+0000 7f2473e00700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:29.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.663+0000 7f2473e00700 1 -- 172.21.15.60:0/3967235369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460005040 con 0x7f2474104fc0 2024-04-12T13:42:29.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.663+0000 7f2473400700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:42:29.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.664+0000 7f2473e00700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2464009fd0 tx=0x7f2464009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:29.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.664+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464021070 con 0x7f2474104fc0 2024-04-12T13:42:29.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.664+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464005040 con 0x7f2474104fc0 2024-04-12T13:42:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.664+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2474117910 con 0x7f2474104fc0 2024-04-12T13:42:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.665+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f246401c400 con 0x7f2474104fc0 2024-04-12T13:42:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.665+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f246400e070 con 0x7f2474104fc0 2024-04-12T13:42:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.667+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247410d860 con 0x7f2474104fc0 2024-04-12T13:42:29.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.668+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f24640126d0 con 0x7f2474104fc0 2024-04-12T13:42:29.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.669+0000 7f246be00700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 0x7f245806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:29.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.669+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f246408bbd0 con 0x7f2474104fc0 2024-04-12T13:42:29.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.670+0000 7f2473400700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 0x7f245806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:29.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.670+0000 7f2473400700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 0x7f245806e1b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2460007fd0 tx=0x7f246000b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:29.674 INFO:tasks.workunit.client.0.smithi060.stdout:2/973: getdents d6/d64/d99/de9 0 2024-04-12T13:42:29.677 INFO:tasks.workunit.client.0.smithi060.stdout:9/959: mkdir d4/d13a 0 2024-04-12T13:42:29.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:29.676+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f2464058d90 con 0x7f2474104fc0 2024-04-12T13:42:29.690 INFO:tasks.workunit.client.0.smithi060.stdout:8/931: mkdir d9/d1d/d5e/d140 0 2024-04-12T13:42:29.692 INFO:tasks.workunit.client.0.smithi060.stdout:9/960: getdents d4/d33/d65/d7a 0 2024-04-12T13:42:29.702 INFO:tasks.workunit.client.0.smithi060.stdout:9/961: write d4/d9/ff7 [529932,17840] 0 2024-04-12T13:42:29.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/962: dwrite d4/d33/fdb [0,4194304] 0 2024-04-12T13:42:29.735 INFO:tasks.workunit.client.0.smithi060.stdout:9/963: chown d4/d9/d19/d21/dbb/lbc 78 1 2024-04-12T13:42:29.744 INFO:tasks.workunit.client.0.smithi060.stdout:8/932: dread d9/d1b/d2b/f55 [0,4194304] 0 2024-04-12T13:42:29.752 INFO:tasks.workunit.client.0.smithi060.stdout:8/933: creat d9/d1b/d37/d4d/d63/d66/dd9/dfc/f141 x:0 0 0 2024-04-12T13:42:29.753 INFO:tasks.workunit.client.0.smithi060.stdout:9/964: truncate d4/d33/d65/fc9 1100237 0 2024-04-12T13:42:29.761 INFO:tasks.workunit.client.0.smithi060.stdout:5/982: rename d6/dd/d1f/d25/l4b to d6/dd/d27/d7d/l141 0 2024-04-12T13:42:29.764 INFO:tasks.workunit.client.0.smithi060.stdout:8/934: creat d9/d1b/d2b/d81/f142 x:0 0 0 2024-04-12T13:42:29.768 INFO:tasks.workunit.client.0.smithi060.stdout:7/966: rename d0/d7/f9d to d0/d7/d43/d63/d90/f137 0 2024-04-12T13:42:29.778 INFO:tasks.workunit.client.0.smithi060.stdout:8/935: symlink d9/dc9/d120/l143 0 2024-04-12T13:42:29.781 INFO:tasks.workunit.client.0.smithi060.stdout:8/936: stat d9/d1b/d37/d4d/d63/d66/d8b/cad 0 2024-04-12T13:42:29.784 INFO:tasks.workunit.client.0.smithi060.stdout:7/967: creat d0/d7/da9/dc9/db1/f138 x:0 0 0 2024-04-12T13:42:29.790 INFO:tasks.workunit.client.0.smithi060.stdout:7/968: symlink d0/d1b/d8c/l139 0 2024-04-12T13:42:29.795 INFO:tasks.workunit.client.0.smithi060.stdout:7/969: mknod d0/d7/c13a 0 2024-04-12T13:42:29.800 INFO:tasks.workunit.client.0.smithi060.stdout:7/970: creat d0/d3d/d74/d9b/f13b x:0 0 0 2024-04-12T13:42:29.802 INFO:tasks.workunit.client.0.smithi060.stdout:7/971: chown d0/l35 682911879 1 2024-04-12T13:42:29.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/972: stat d0/d7/f87 0 2024-04-12T13:42:29.807 INFO:tasks.workunit.client.0.smithi060.stdout:0/924: write d7/d9/f2b [165721,86846] 0 2024-04-12T13:42:29.810 INFO:tasks.workunit.client.0.smithi060.stdout:0/925: stat d7/d9/d14/d35/d44/d49/d67/da5/lc2 0 2024-04-12T13:42:29.812 INFO:tasks.workunit.client.0.smithi060.stdout:0/926: stat d7/d9/d14/d35/fb7 0 2024-04-12T13:42:29.818 INFO:tasks.workunit.client.0.smithi060.stdout:0/927: creat d7/d9/d14/d4a/f13d x:0 0 0 2024-04-12T13:42:29.822 INFO:tasks.workunit.client.0.smithi060.stdout:4/957: dwrite d6/d21/f5d [0,4194304] 0 2024-04-12T13:42:29.846 INFO:tasks.workunit.client.0.smithi060.stdout:9/965: truncate d4/d9/d19/d8c/d92/fcb 295011 0 2024-04-12T13:42:29.849 INFO:tasks.workunit.client.0.smithi060.stdout:4/958: symlink d6/d2f/l137 0 2024-04-12T13:42:29.851 INFO:tasks.workunit.client.0.smithi060.stdout:9/966: mkdir d4/d9/d19/d21/dbb/d13b 0 2024-04-12T13:42:29.854 INFO:tasks.workunit.client.0.smithi060.stdout:5/983: dwrite d6/dd/d1f/d25/d53/d87/f9d [0,4194304] 0 2024-04-12T13:42:29.857 INFO:tasks.workunit.client.0.smithi060.stdout:9/967: unlink d4/d9/d19/f75 0 2024-04-12T13:42:29.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/984: chown d6/dd/d1f/dd3/df3/d4c 0 1 2024-04-12T13:42:29.859 INFO:tasks.workunit.client.0.smithi060.stdout:4/959: getdents d6/d21/d29 0 2024-04-12T13:42:29.869 INFO:tasks.workunit.client.0.smithi060.stdout:8/937: dwrite d9/d1b/d37/d4d/d63/f89 [4194304,4194304] 0 2024-04-12T13:42:29.870 INFO:tasks.workunit.client.0.smithi060.stdout:9/968: rmdir d4/d9/d19/d21/dbb 39 2024-04-12T13:42:29.873 INFO:tasks.workunit.client.0.smithi060.stdout:5/985: fsync d6/dd/d1f/dd3/df3/f36 0 2024-04-12T13:42:29.879 INFO:tasks.workunit.client.0.smithi060.stdout:0/928: dwrite d7/d9/d14/d35/d44/d8c/d8d/de5/f103 [0,4194304] 0 2024-04-12T13:42:29.882 INFO:tasks.workunit.client.0.smithi060.stdout:9/969: stat d4/d8/d7c/ca5 0 2024-04-12T13:42:29.884 INFO:tasks.workunit.client.0.smithi060.stdout:8/938: chown d9/d1b/d37/d4d/d63/lf3 583076 1 2024-04-12T13:42:29.890 INFO:tasks.workunit.client.0.smithi060.stdout:7/973: dwrite d0/d7/d92/ff7 [0,4194304] 0 2024-04-12T13:42:29.895 INFO:tasks.workunit.client.0.smithi060.stdout:0/929: creat d7/d9/d14/d35/d44/dd9/f13e x:0 0 0 2024-04-12T13:42:29.896 INFO:tasks.workunit.client.0.smithi060.stdout:9/970: dread - d4/d33/d65/d7a/f9f zero size 2024-04-12T13:42:29.896 INFO:tasks.workunit.client.0.smithi060.stdout:8/939: unlink d9/d1b/d2b/fe0 0 2024-04-12T13:42:29.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/971: fdatasync d4/d8/df1/d67/f103 0 2024-04-12T13:42:29.901 INFO:tasks.workunit.client.0.smithi060.stdout:0/930: write d7/d9/de/d80/f105 [1135035,21363] 0 2024-04-12T13:42:29.902 INFO:tasks.workunit.client.0.smithi060.stdout:9/972: rename d4/d33 to d4/d33/d65/de7/d13c 22 2024-04-12T13:42:29.907 INFO:tasks.workunit.client.0.smithi060.stdout:7/974: creat d0/d7/f13c x:0 0 0 2024-04-12T13:42:29.908 INFO:tasks.workunit.client.0.smithi060.stdout:0/931: creat d7/d9/de/d7c/f13f x:0 0 0 2024-04-12T13:42:29.912 INFO:tasks.workunit.client.0.smithi060.stdout:9/973: rename d4/d9/d19/d8c/d92/lc4 to d4/d9/d19/d8c/d92/dff/l13d 0 2024-04-12T13:42:29.914 INFO:tasks.workunit.client.0.smithi060.stdout:7/975: symlink d0/d111/l13d 0 2024-04-12T13:42:29.917 INFO:tasks.workunit.client.0.smithi060.stdout:5/986: dread d6/dd/d1f/d25/d53/d87/f4f [0,4194304] 0 2024-04-12T13:42:29.920 INFO:tasks.workunit.client.0.smithi060.stdout:0/932: dread d7/d9/d14/d35/d44/d49/d74/ff2 [0,4194304] 0 2024-04-12T13:42:29.926 INFO:tasks.workunit.client.0.smithi060.stdout:4/960: write d6/db7/dbb/dfb/d11e/dd9/f12a [1350488,98833] 0 2024-04-12T13:42:29.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:29 smithi060 ceph-mon[29097]: pgmap v39: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 217 MiB/s wr, 534 op/s 2024-04-12T13:42:29.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:29 smithi060 ceph-mon[29097]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:29.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:29 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3663026205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:42:29.930 INFO:tasks.workunit.client.0.smithi060.stdout:4/961: write d6/d2f/d51/f71 [3644064,47517] 0 2024-04-12T13:42:29.931 INFO:tasks.workunit.client.0.smithi060.stdout:5/987: symlink d6/dd/d1f/dd3/df3/d4c/d13b/d52/l142 0 2024-04-12T13:42:29.935 INFO:tasks.workunit.client.0.smithi060.stdout:4/962: stat d6/d2f/d7d/d11b/d1a/d57/d63/c118 0 2024-04-12T13:42:29.943 INFO:tasks.workunit.client.0.smithi060.stdout:0/933: getdents d7/d9/de/d80/d8b 0 2024-04-12T13:42:29.944 INFO:tasks.workunit.client.0.smithi060.stdout:7/976: dwrite d0/d3d/d74/d9b/da1/ffc [0,4194304] 0 2024-04-12T13:42:29.949 INFO:tasks.workunit.client.0.smithi060.stdout:8/940: dwrite d9/d1d/d5e/f87 [0,4194304] 0 2024-04-12T13:42:29.950 INFO:tasks.workunit.client.0.smithi060.stdout:9/974: truncate d4/d9/fb0 1211606 0 2024-04-12T13:42:29.962 INFO:tasks.workunit.client.0.smithi060.stdout:0/934: creat d7/ddf/f140 x:0 0 0 2024-04-12T13:42:29.973 INFO:tasks.workunit.client.0.smithi060.stdout:5/988: rmdir d6/d127 0 2024-04-12T13:42:29.977 INFO:tasks.workunit.client.0.smithi060.stdout:0/935: creat d7/d9/d14/d35/d44/d8c/d8d/d10b/f141 x:0 0 0 2024-04-12T13:42:29.981 INFO:tasks.workunit.client.0.smithi060.stdout:7/977: write d0/d1b/f5f [778126,672] 0 2024-04-12T13:42:29.984 INFO:tasks.workunit.client.0.smithi060.stdout:7/978: chown d0/d3d/c6e 48381 1 2024-04-12T13:42:29.987 INFO:tasks.workunit.client.0.smithi060.stdout:8/941: symlink d9/dc9/d13e/l144 0 2024-04-12T13:42:29.989 INFO:tasks.workunit.client.0.smithi060.stdout:5/989: mkdir d6/d89/d143 0 2024-04-12T13:42:29.992 INFO:tasks.workunit.client.0.smithi060.stdout:9/975: creat d4/d9/d19/d21/dbb/d13b/f13e x:0 0 0 2024-04-12T13:42:29.995 INFO:tasks.workunit.client.0.smithi060.stdout:4/963: getdents d6/d2f/d7d/d11b/d1a/d57 0 2024-04-12T13:42:29.995 INFO:tasks.workunit.client.0.smithi060.stdout:7/979: mkdir d0/d3d/d74/d9b/da1/d13e 0 2024-04-12T13:42:30.001 INFO:tasks.workunit.client.0.smithi060.stdout:0/936: dwrite d7/d9/de/d7c/f13f [0,4194304] 0 2024-04-12T13:42:30.001 INFO:tasks.workunit.client.0.smithi060.stdout:9/976: rmdir d4/d8/d7c/d10e 39 2024-04-12T13:42:30.006 INFO:tasks.workunit.client.0.smithi060.stdout:7/980: creat d0/d1b/d8c/db6/f13f x:0 0 0 2024-04-12T13:42:30.007 INFO:tasks.workunit.client.0.smithi060.stdout:8/942: dwrite d9/d1b/d2b/d82/f8e [0,4194304] 0 2024-04-12T13:42:30.013 INFO:tasks.workunit.client.0.smithi060.stdout:5/990: rename d6/dd/d1f/d25/d53/d87/d7e to d6/dd/d1f/dd3/df3/d38/d10d/d144 0 2024-04-12T13:42:30.022 INFO:tasks.workunit.client.0.smithi060.stdout:9/977: symlink d4/d8/d7c/d10e/l13f 0 2024-04-12T13:42:30.028 INFO:tasks.workunit.client.0.smithi060.stdout:4/964: rename d6/d2f/d7d/d11b/d1a/f50 to d6/db7/dbb/dfb/d11e/d7c/f138 0 2024-04-12T13:42:30.032 INFO:tasks.workunit.client.0.smithi060.stdout:5/991: mknod d6/dd/d1f/dc6/c145 0 2024-04-12T13:42:30.035 INFO:tasks.workunit.client.0.smithi060.stdout:9/978: mkdir d4/d9/d19/d21/dbf/dce/d140 0 2024-04-12T13:42:30.040 INFO:tasks.workunit.client.0.smithi060.stdout:4/965: rename d6/d2f/d7d/d11b/d1a/d19 to d6/d2f/d7d/d11b/d1a/d56/d8d/d139 0 2024-04-12T13:42:30.046 INFO:tasks.workunit.client.0.smithi060.stdout:0/937: getdents d7/d9/d14/d35/d44/d49/d67 0 2024-04-12T13:42:30.049 INFO:tasks.workunit.client.0.smithi060.stdout:5/992: truncate d6/dd/d1f/d25/d103/f108 175193 0 2024-04-12T13:42:30.051 INFO:tasks.workunit.client.0.smithi060.stdout:8/943: write d9/f1f [4018837,129424] 0 2024-04-12T13:42:30.053 INFO:tasks.workunit.client.0.smithi060.stdout:7/981: dread d0/d7/f10 [0,4194304] 0 2024-04-12T13:42:30.058 INFO:tasks.workunit.client.0.smithi060.stdout:9/979: rename d4/d8/df1/c80 to d4/d9/d19/d21/c141 0 2024-04-12T13:42:30.058 INFO:tasks.workunit.client.0.smithi060.stdout:0/938: symlink d7/d33/l142 0 2024-04-12T13:42:30.058 INFO:tasks.workunit.client.0.smithi060.stdout:9/980: fsync d4/d33/d65/d7a/fc0 0 2024-04-12T13:42:30.062 INFO:tasks.workunit.client.0.smithi060.stdout:8/944: symlink d9/d1b/d37/d4d/d63/l145 0 2024-04-12T13:42:30.067 INFO:tasks.workunit.client.0.smithi060.stdout:4/966: link d6/d2f/d7d/d11b/d1a/d57/d63/df4/c40 d6/d21/d88/c13a 0 2024-04-12T13:42:30.076 INFO:tasks.workunit.client.0.smithi060.stdout:8/945: rename d9/d1d/d5e/ded/ffd to d9/d1b/d84/da0/f146 0 2024-04-12T13:42:30.078 INFO:tasks.workunit.client.0.smithi060.stdout:4/967: fdatasync d6/d2f/d7d/d11b/df/fc0 0 2024-04-12T13:42:30.079 INFO:tasks.workunit.client.0.smithi060.stdout:5/993: fsync d6/dd/d1f/d25/d103/f108 0 2024-04-12T13:42:30.080 INFO:tasks.workunit.client.0.smithi060.stdout:7/982: dwrite d0/d7/d43/d63/d6f/f124 [0,4194304] 0 2024-04-12T13:42:30.083 INFO:tasks.workunit.client.0.smithi060.stdout:4/968: chown d6/d7/f8c 5 1 2024-04-12T13:42:30.083 INFO:tasks.workunit.client.0.smithi060.stdout:5/994: rmdir d6/dd/d1f/d25 39 2024-04-12T13:42:30.089 INFO:tasks.workunit.client.0.smithi060.stdout:4/969: read d6/db7/dbb/dfb/d11e/fe0 [4574514,90611] 0 2024-04-12T13:42:30.090 INFO:tasks.workunit.client.0.smithi060.stdout:7/983: read d0/d1b/f5f [2684707,7121] 0 2024-04-12T13:42:30.092 INFO:tasks.workunit.client.0.smithi060.stdout:5/995: rmdir d6/d89 39 2024-04-12T13:42:30.094 INFO:tasks.workunit.client.0.smithi060.stdout:4/970: stat d6/d2f/d7d/d11b/d1a/l9f 0 2024-04-12T13:42:30.097 INFO:tasks.workunit.client.0.smithi060.stdout:7/984: read d0/d3d/d74/fe3 [3093560,669] 0 2024-04-12T13:42:30.098 INFO:tasks.workunit.client.0.smithi060.stdout:9/981: dread d4/d8/f3b [0,4194304] 0 2024-04-12T13:42:30.099 INFO:tasks.workunit.client.0.smithi060.stdout:5/996: write d6/dd/d27/f13a [814199,130745] 0 2024-04-12T13:42:30.099 INFO:tasks.workunit.client.0.smithi060.stdout:8/946: creat d9/d1b/d37/f147 x:0 0 0 2024-04-12T13:42:30.103 INFO:tasks.workunit.client.0.smithi060.stdout:8/947: fdatasync f1 0 2024-04-12T13:42:30.106 INFO:tasks.workunit.client.0.smithi060.stdout:0/939: dwrite d7/d9/d14/d35/d44/d8c/d8d/de9/ffe [0,4194304] 0 2024-04-12T13:42:30.110 INFO:tasks.workunit.client.0.smithi060.stdout:9/982: unlink d4/d9/d19/d21/dbb/lfb 0 2024-04-12T13:42:30.112 INFO:tasks.workunit.client.0.smithi060.stdout:0/940: read d7/d9/f92 [1420922,8888] 0 2024-04-12T13:42:30.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.109+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2474118030 con 0x7f2474104fc0 2024-04-12T13:42:30.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.110+0000 7f246be00700 1 -- 172.21.15.60:0/3967235369 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f2464058920 con 0x7f2474104fc0 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:42:30.113 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:42:30.114 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:42:30.115 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:42:30.116 INFO:tasks.workunit.client.0.smithi060.stdout:9/983: write d4/d33/d50/f6c [3442785,129056] 0 2024-04-12T13:42:30.121 INFO:tasks.workunit.client.0.smithi060.stdout:9/984: stat d4/d9/d19/d21/dbf/dce/f12d 0 2024-04-12T13:42:30.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.120+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 msgr2=0x7f245806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.120+0000 7f247b200700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 0x7f245806e1b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2460007fd0 tx=0x7f246000b040 comp rx=0 tx=0).stop 2024-04-12T13:42:30.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.120+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 msgr2=0x7f2474113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.120+0000 7f247b200700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2464009fd0 tx=0x7f2464009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:30.123 INFO:tasks.workunit.client.0.smithi060.stdout:5/997: truncate d6/dd/d1f/d25/fba 3844372 0 2024-04-12T13:42:30.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 shutdown_connections 2024-04-12T13:42:30.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f245806bd00 0x7f245806e1b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2474104fc0 0x7f2474113ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 --2- 172.21.15.60:0/3967235369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24741078e0 0x7f2474114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 >> 172.21.15.60:0/3967235369 conn(0x7f2474069df0 msgr2=0x7f247406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:30.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 shutdown_connections 2024-04-12T13:42:30.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.121+0000 7f247b200700 1 -- 172.21.15.60:0/3967235369 wait complete. 2024-04-12T13:42:30.125 INFO:tasks.workunit.client.0.smithi060.stdout:0/941: truncate d7/d9/d4c/d93/ffb 107056 0 2024-04-12T13:42:30.129 INFO:tasks.workunit.client.0.smithi060.stdout:8/948: getdents d9/d1b/d37/d4d/d63/d66/d111 0 2024-04-12T13:42:30.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/971: dwrite d6/db7/dbb/dfb/d11e/d7c/fdd [0,4194304] 0 2024-04-12T13:42:30.131 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:42:30.131 INFO:tasks.workunit.client.0.smithi060.stdout:9/985: unlink d4/d33/d65/ffa 0 2024-04-12T13:42:30.135 INFO:tasks.workunit.client.0.smithi060.stdout:7/985: dwrite d0/d3d/f8b [0,4194304] 0 2024-04-12T13:42:30.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/942: dread - d7/d9/d14/d35/d44/d8c/d8d/d10b/f114 zero size 2024-04-12T13:42:30.139 INFO:tasks.workunit.client.0.smithi060.stdout:5/998: unlink d6/dd/d1f/d25/f34 0 2024-04-12T13:42:30.139 INFO:tasks.workunit.client.0.smithi060.stdout:8/949: symlink d9/l148 0 2024-04-12T13:42:30.141 INFO:tasks.workunit.client.0.smithi060.stdout:5/999: stat d6/dd/d1f/dd3/df3/ffd 0 2024-04-12T13:42:30.141 INFO:tasks.workunit.client.0.smithi060.stdout:8/950: readlink d9/d1b/d3c/d8d/l9a 0 2024-04-12T13:42:30.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/972: creat d6/db7/dbb/dfb/f13b x:0 0 0 2024-04-12T13:42:30.145 INFO:tasks.workunit.client.0.smithi060.stdout:8/951: fsync d9/d1b/d37/d4d/d63/d66/dd9/f126 0 2024-04-12T13:42:30.148 INFO:tasks.workunit.client.0.smithi060.stdout:0/943: unlink d7/d9/d14/f132 0 2024-04-12T13:42:30.153 INFO:tasks.workunit.client.0.smithi060.stdout:4/973: creat d6/d2f/d7d/d11b/d1a/d57/dc7/f13c x:0 0 0 2024-04-12T13:42:30.157 INFO:tasks.workunit.client.0.smithi060.stdout:8/952: rename d9/d1b/d84/da0/f11c to d9/d1b/d84/da0/d114/f149 0 2024-04-12T13:42:30.166 INFO:tasks.workunit.client.0.smithi060.stdout:9/986: write d4/d9/fa0 [17819,82164] 0 2024-04-12T13:42:30.166 INFO:tasks.workunit.client.0.smithi060.stdout:7/986: dread d0/d78/f95 [0,4194304] 0 2024-04-12T13:42:30.170 INFO:tasks.workunit.client.0.smithi060.stdout:0/944: creat d7/d9/d14/d35/d44/d7d/de8/d104/f143 x:0 0 0 2024-04-12T13:42:30.171 INFO:tasks.workunit.client.0.smithi060.stdout:7/987: write d0/d7/d43/d4d/f110 [2945763,25706] 0 2024-04-12T13:42:30.175 INFO:tasks.workunit.client.0.smithi060.stdout:0/945: fsync d7/d9/d14/d35/d44/d8c/d8d/d10b/f141 0 2024-04-12T13:42:30.183 INFO:tasks.workunit.client.0.smithi060.stdout:8/953: dwrite d9/d1b/d84/f132 [0,4194304] 0 2024-04-12T13:42:30.190 INFO:tasks.workunit.client.0.smithi060.stdout:0/946: creat d7/d33/d12a/f144 x:0 0 0 2024-04-12T13:42:30.195 INFO:tasks.workunit.client.0.smithi060.stdout:9/987: write d4/d9/d19/d8c/d92/fe4 [203918,51893] 0 2024-04-12T13:42:30.196 INFO:tasks.workunit.client.0.smithi060.stdout:7/988: symlink d0/d7/d92/d133/l140 0 2024-04-12T13:42:30.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/974: dwrite d6/d2f/d7d/d11b/f91 [0,4194304] 0 2024-04-12T13:42:30.200 INFO:tasks.workunit.client.0.smithi060.stdout:9/988: chown d4/d8/d7c/dfe 390636 1 2024-04-12T13:42:30.217 INFO:tasks.workunit.client.0.smithi060.stdout:8/954: dwrite d9/d1b/fc0 [0,4194304] 0 2024-04-12T13:42:30.217 INFO:tasks.workunit.client.0.smithi060.stdout:2/974: sync 2024-04-12T13:42:30.220 INFO:tasks.workunit.client.0.smithi060.stdout:2/975: chown d6/d56/d55/c8c 3721864 1 2024-04-12T13:42:30.220 INFO:tasks.workunit.client.0.smithi060.stdout:8/955: write d9/d1d/d5e/f93 [3594508,63633] 0 2024-04-12T13:42:30.225 INFO:tasks.workunit.client.0.smithi060.stdout:9/989: mknod d4/d8/d32/c142 0 2024-04-12T13:42:30.227 INFO:tasks.workunit.client.0.smithi060.stdout:7/989: unlink d0/d7/d43/d63/d90/lb3 0 2024-04-12T13:42:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:29 smithi110 ceph-mon[36055]: pgmap v39: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 217 MiB/s wr, 534 op/s 2024-04-12T13:42:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:29 smithi110 ceph-mon[36055]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:29 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3663026205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:42:30.229 INFO:tasks.workunit.client.0.smithi060.stdout:4/975: fsync d6/d2f/d7d/d11b/d1a/d56/d8d/d139/d7a/d9d/ff6 0 2024-04-12T13:42:30.233 INFO:tasks.workunit.client.0.smithi060.stdout:8/956: write d9/d1b/d84/fb9 [2919396,29390] 0 2024-04-12T13:42:30.234 INFO:tasks.workunit.client.0.smithi060.stdout:2/976: mknod d6/d64/d99/df0/daa/ddf/c12d 0 2024-04-12T13:42:30.239 INFO:tasks.workunit.client.0.smithi060.stdout:2/977: write d6/f10d [1968002,106188] 0 2024-04-12T13:42:30.240 INFO:tasks.workunit.client.0.smithi060.stdout:2/978: chown d6/ldd 3640367 1 2024-04-12T13:42:30.246 INFO:tasks.workunit.client.0.smithi060.stdout:4/976: rename d6/d2f/d7d/d11b/df/l3f to d6/db7/dbb/dfb/d11e/l13d 0 2024-04-12T13:42:30.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/947: link d7/d9/d14/d35/d44/d8c/d8d/d10b/c13b d7/d9/d14/d122/c145 0 2024-04-12T13:42:30.249 INFO:tasks.workunit.client.0.smithi060.stdout:4/977: write d6/d2f/d7d/d11b/d1a/d57/d63/df4/d85/f11a [547772,115827] 0 2024-04-12T13:42:30.250 INFO:tasks.workunit.client.0.smithi060.stdout:0/948: chown d7/d9/de/d7c/f13f 5 1 2024-04-12T13:42:30.253 INFO:tasks.workunit.client.0.smithi060.stdout:4/978: chown d6/d2f/d7d/d11b/d1a/d57/d63/d68/d76 48 1 2024-04-12T13:42:30.254 INFO:tasks.workunit.client.0.smithi060.stdout:7/990: mknod d0/d3d/dd7/c141 0 2024-04-12T13:42:30.262 INFO:tasks.workunit.client.0.smithi060.stdout:7/991: mknod d0/d7/d92/c142 0 2024-04-12T13:42:30.263 INFO:tasks.workunit.client.0.smithi060.stdout:0/949: fsync d7/d9/d14/d35/d44/d8c/d8d/de5/f11e 0 2024-04-12T13:42:30.265 INFO:tasks.workunit.client.0.smithi060.stdout:2/979: link d6/d64/d99/de9/l124 d6/d64/d99/df0/daa/db0/def/l12e 0 2024-04-12T13:42:30.265 INFO:tasks.workunit.client.0.smithi060.stdout:0/950: stat d7/d9/d14/d35/d44/l116 0 2024-04-12T13:42:30.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/992: creat d0/d7/d43/d63/d90/de7/f143 x:0 0 0 2024-04-12T13:42:30.279 INFO:tasks.workunit.client.0.smithi060.stdout:9/990: dwrite d4/d9/fc [0,4194304] 0 2024-04-12T13:42:30.282 INFO:tasks.workunit.client.0.smithi060.stdout:7/993: truncate d0/d3d/d74/fe3 3222811 0 2024-04-12T13:42:30.284 INFO:tasks.workunit.client.0.smithi060.stdout:4/979: write d6/d2f/d7d/d11b/df/f18 [3049226,3958] 0 2024-04-12T13:42:30.286 INFO:tasks.workunit.client.0.smithi060.stdout:7/994: dread - d0/d1b/d8c/db6/f13f zero size 2024-04-12T13:42:30.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/957: dwrite d9/d1b/d84/da0/f24 [8388608,4194304] 0 2024-04-12T13:42:30.294 INFO:tasks.workunit.client.0.smithi060.stdout:4/980: readlink d6/d2f/d7d/d11b/d1a/d57/dc7/ld4 0 2024-04-12T13:42:30.302 INFO:tasks.workunit.client.0.smithi060.stdout:4/981: stat d6/d2f/d7d/d11b/d1a/d56/d8d/d139/f1f 0 2024-04-12T13:42:30.305 INFO:tasks.workunit.client.0.smithi060.stdout:9/991: getdents d4/d8/dad/dd9 0 2024-04-12T13:42:30.310 INFO:tasks.workunit.client.0.smithi060.stdout:8/958: getdents d9/dc9/d120 0 2024-04-12T13:42:30.313 INFO:tasks.workunit.client.0.smithi060.stdout:2/980: dwrite d6/dae/d31/d33/f6a [0,4194304] 0 2024-04-12T13:42:30.324 INFO:tasks.workunit.client.0.smithi060.stdout:9/992: chown d4/d9/d19/d21/c10c 61 1 2024-04-12T13:42:30.324 INFO:tasks.workunit.client.0.smithi060.stdout:2/981: unlink d6/dae/d31/d87/cd6 0 2024-04-12T13:42:30.328 INFO:tasks.workunit.client.0.smithi060.stdout:4/982: link d6/l2c d6/db7/dc2/l13e 0 2024-04-12T13:42:30.331 INFO:tasks.workunit.client.0.smithi060.stdout:0/951: dwrite d7/d9/d14/d35/d44/d49/dcf/d11d/f128 [0,4194304] 0 2024-04-12T13:42:30.336 INFO:tasks.workunit.client.0.smithi060.stdout:4/983: mkdir d6/d2f/d7d/d11b/d1a/d56/d8d/d106/d13f 0 2024-04-12T13:42:30.338 INFO:tasks.workunit.client.0.smithi060.stdout:0/952: creat d7/d9/de/d80/dc8/f146 x:0 0 0 2024-04-12T13:42:30.341 INFO:tasks.workunit.client.0.smithi060.stdout:4/984: read d6/d21/f27 [3546586,110342] 0 2024-04-12T13:42:30.346 INFO:tasks.workunit.client.0.smithi060.stdout:0/953: read d7/d9/f1e [1998,115608] 0 2024-04-12T13:42:30.347 INFO:tasks.workunit.client.0.smithi060.stdout:4/985: creat d6/d21/d88/f140 x:0 0 0 2024-04-12T13:42:30.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/995: dread d0/d7/d43/d63/f67 [0,4194304] 0 2024-04-12T13:42:30.352 INFO:tasks.workunit.client.0.smithi060.stdout:0/954: mkdir d7/d9/d14/d35/d44/dd9/dd8/d147 0 2024-04-12T13:42:30.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 -- 172.21.15.60:0/960191839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d00ff000 msgr2=0x7ff4d00ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 --2- 172.21.15.60:0/960191839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d00ff000 0x7ff4d00ff410 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0004940 tx=0x7ff4c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:30.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 -- 172.21.15.60:0/960191839 shutdown_connections 2024-04-12T13:42:30.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 --2- 172.21.15.60:0/960191839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d01002b0 0x7ff4d0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 --2- 172.21.15.60:0/960191839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d00ff000 0x7ff4d00ff410 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 -- 172.21.15.60:0/960191839 >> 172.21.15.60:0/960191839 conn(0x7ff4d00fa950 msgr2=0x7ff4d00fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 -- 172.21.15.60:0/960191839 shutdown_connections 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.356+0000 7ff4d6600700 1 -- 172.21.15.60:0/960191839 wait complete. 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 Processor -- start 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 -- start start 2024-04-12T13:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 0x7ff4d010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 0x7ff4d0110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0110780 con 0x7ff4d01002b0 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.357+0000 7ff4d6600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0110fd0 con 0x7ff4d00ff000 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 0x7ff4d0110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cf400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 0x7ff4d010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cf400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 0x7ff4d010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:49090/0 (socket says 172.21.15.60:49090) 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cf400700 1 -- 172.21.15.60:0/2932229650 learned_addr learned my addr 172.21.15.60:0/2932229650 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cea00700 1 -- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 msgr2=0x7ff4d010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cea00700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 0x7ff4d010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.358+0000 7ff4cea00700 1 -- 172.21.15.60:0/2932229650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0005040 con 0x7ff4d01002b0 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4cea00700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 0x7ff4d0110180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc002870 tx=0x7ff4bc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc007cc0 con 0x7ff4d01002b0 2024-04-12T13:42:30.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4bc00f040 con 0x7ff4d01002b0 2024-04-12T13:42:30.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4bc0139a0 con 0x7ff4d01002b0 2024-04-12T13:42:30.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d01112b0 con 0x7ff4d01002b0 2024-04-12T13:42:30.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.359+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d01117f0 con 0x7ff4d01002b0 2024-04-12T13:42:30.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.361+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d005f5f0 con 0x7ff4d01002b0 2024-04-12T13:42:30.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.362+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7ff4bc01c400 con 0x7ff4d01002b0 2024-04-12T13:42:30.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.362+0000 7ff4c7400700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 0x7ff4b406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.362+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff4bc08a110 con 0x7ff4d01002b0 2024-04-12T13:42:30.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.363+0000 7ff4cf400700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 0x7ff4b406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.364+0000 7ff4cf400700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 0x7ff4b406e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000b020 tx=0x7ff4c0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:30.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.367+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7ff4bc04f8f0 con 0x7ff4d01002b0 2024-04-12T13:42:30.600 INFO:tasks.workunit.client.0.smithi060.stdout:7/996: chown d0/d7/da9/dc9/db1/f11a 39022415 1 2024-04-12T13:42:30.600 INFO:tasks.workunit.client.0.smithi060.stdout:2/982: write d6/d64/d99/df0/d16/d36/fa7 [4749028,100384] 0 2024-04-12T13:42:30.624 INFO:tasks.workunit.client.0.smithi060.stdout:0/955: write d7/d9/d14/d35/d44/dd9/dd8/f135 [2164856,3389] 0 2024-04-12T13:42:30.635 INFO:tasks.workunit.client.0.smithi060.stdout:4/986: dwrite d6/d2f/d7d/d11b/d1a/d57/d63/d68/d94/fbf [0,4194304] 0 2024-04-12T13:42:30.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.635+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4d0111b40 con 0x7ff4b406bcf0 2024-04-12T13:42:30.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.638+0000 7ff4c7400700 1 -- 172.21.15.60:0/2932229650 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff4d0111b40 con 0x7ff4b406bcf0 2024-04-12T13:42:30.641 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/21 daemons upgraded", 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:42:30.642 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:42:30.644 INFO:tasks.workunit.client.0.smithi060.stdout:4/987: mknod d6/d2f/d7d/d11b/d1a/d57/d63/d68/c141 0 2024-04-12T13:42:30.645 INFO:tasks.workunit.client.0.smithi060.stdout:0/956: dread d7/d41/dbc/faf [0,4194304] 0 2024-04-12T13:42:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.643+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 msgr2=0x7ff4b406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.643+0000 7ff4d6600700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 0x7ff4b406e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000b020 tx=0x7ff4c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.643+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 msgr2=0x7ff4d0110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.643+0000 7ff4d6600700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 0x7ff4d0110180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc002870 tx=0x7ff4bc004570 comp rx=0 tx=0).stop 2024-04-12T13:42:30.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 shutdown_connections 2024-04-12T13:42:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7ff4b406bcf0 0x7ff4b406e1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d00ff000 0x7ff4d010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 --2- 172.21.15.60:0/2932229650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4d01002b0 0x7ff4d0110180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 >> 172.21.15.60:0/2932229650 conn(0x7ff4d00fa950 msgr2=0x7ff4d00fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:30.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.644+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 shutdown_connections 2024-04-12T13:42:30.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.645+0000 7ff4d6600700 1 -- 172.21.15.60:0/2932229650 wait complete. 2024-04-12T13:42:30.648 INFO:tasks.workunit.client.0.smithi060.stdout:7/997: dread d0/d1b/da4/fba [0,4194304] 0 2024-04-12T13:42:30.650 INFO:tasks.workunit.client.0.smithi060.stdout:2/983: dwrite d6/d64/d99/df0/daa/ddf/ff3 [0,4194304] 0 2024-04-12T13:42:30.650 INFO:tasks.workunit.client.0.smithi060.stdout:0/957: fdatasync d7/d9/f48 0 2024-04-12T13:42:30.653 INFO:tasks.workunit.client.0.smithi060.stdout:4/988: dread - d6/d2f/d7d/d11b/d1a/d56/ff5 zero size 2024-04-12T13:42:30.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/984: truncate d6/d56/f54 136141 0 2024-04-12T13:42:30.674 INFO:tasks.workunit.client.0.smithi060.stdout:4/989: link d6/d2f/lc6 d6/d21/l142 0 2024-04-12T13:42:30.675 INFO:tasks.workunit.client.0.smithi060.stdout:0/958: link d7/d9/d4c/f55 d7/d9/d14/d35/d44/d7d/de8/d104/f148 0 2024-04-12T13:42:30.677 INFO:tasks.workunit.client.0.smithi060.stdout:2/985: rmdir d6/dae/d5b/d6d/d122 0 2024-04-12T13:42:30.680 INFO:tasks.workunit.client.0.smithi060.stdout:2/986: symlink d6/dae/d31/l12f 0 2024-04-12T13:42:30.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/990: fsync d6/d2f/d7d/d11b/d1a/d56/d8d/d139/d7a/d9d/ff6 0 2024-04-12T13:42:30.683 INFO:tasks.workunit.client.0.smithi060.stdout:4/991: chown d6/db7/dbb/cda 460202 1 2024-04-12T13:42:30.686 INFO:tasks.workunit.client.0.smithi060.stdout:2/987: truncate d6/d64/d99/df0/daa/db0/def/f12c 245100 0 2024-04-12T13:42:30.687 INFO:tasks.workunit.client.0.smithi060.stdout:4/992: write d6/d2f/d7d/d11b/d1a/d56/d8d/d139/d7a/f134 [808150,117712] 0 2024-04-12T13:42:30.690 INFO:tasks.workunit.client.0.smithi060.stdout:2/988: mknod d6/d64/d10f/c130 0 2024-04-12T13:42:30.696 INFO:tasks.workunit.client.0.smithi060.stdout:0/959: write d7/d9/d14/d35/d44/d49/d74/fd1 [478976,121410] 0 2024-04-12T13:42:30.697 INFO:tasks.workunit.client.0.smithi060.stdout:0/960: stat d7/d33/ca7 0 2024-04-12T13:42:30.698 INFO:tasks.workunit.client.0.smithi060.stdout:2/989: getdents d6/dae/d5b/d6d/de1 0 2024-04-12T13:42:30.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/961: stat d7 0 2024-04-12T13:42:30.702 INFO:tasks.workunit.client.0.smithi060.stdout:2/990: symlink d6/d64/d99/df0/daa/ddf/l131 0 2024-04-12T13:42:30.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/991: stat d6/d64/d99/df0/d81/dbd/f63 0 2024-04-12T13:42:30.704 INFO:tasks.workunit.client.0.smithi060.stdout:4/993: truncate d6/d7/f8c 4383011 0 2024-04-12T13:42:30.705 INFO:tasks.workunit.client.0.smithi060.stdout:2/992: chown d6/d64/d99/df0/d2b/f101 6 1 2024-04-12T13:42:30.706 INFO:tasks.workunit.client.0.smithi060.stdout:0/962: symlink d7/d9/de/d80/dc8/l149 0 2024-04-12T13:42:30.713 INFO:tasks.workunit.client.0.smithi060.stdout:2/993: getdents d6/d64/d99/df0/daa 0 2024-04-12T13:42:30.718 INFO:tasks.workunit.client.0.smithi060.stdout:0/963: dread d7/d9/de/d80/f105 [0,4194304] 0 2024-04-12T13:42:30.718 INFO:tasks.workunit.client.0.smithi060.stdout:2/994: creat d6/dae/d5b/d6d/de1/d121/f132 x:0 0 0 2024-04-12T13:42:30.728 INFO:tasks.workunit.client.0.smithi060.stdout:4/994: truncate d6/db7/dbb/dfb/d11e/d7c/fdd 1998180 0 2024-04-12T13:42:30.733 INFO:tasks.workunit.client.0.smithi060.stdout:0/964: dwrite d7/d9/d14/d35/d44/d8c/d8d/d10b/f133 [0,4194304] 0 2024-04-12T13:42:30.733 INFO:tasks.workunit.client.0.smithi060.stdout:2/995: write d6/d56/d43/f72 [4447913,113917] 0 2024-04-12T13:42:30.734 INFO:tasks.workunit.client.0.smithi060.stdout:4/995: mkdir d6/d2f/d7d/d11b/d1a/d56/d8d/d139/dad/d143 0 2024-04-12T13:42:30.744 INFO:tasks.workunit.client.0.smithi060.stdout:4/996: getdents d6/d2f/d7d/d11b/d1a/dde/dff 0 2024-04-12T13:42:30.750 INFO:tasks.workunit.client.0.smithi060.stdout:2/996: write d6/d56/d86/fd4 [794881,36445] 0 2024-04-12T13:42:30.754 INFO:tasks.workunit.client.0.smithi060.stdout:0/965: dwrite d7/d9/d14/d35/d44/d7d/de8/d104/f143 [0,4194304] 0 2024-04-12T13:42:30.758 INFO:tasks.workunit.client.0.smithi060.stdout:2/997: rename d6/d64/d99/df0/d2b/f9a to d6/dae/d31/f133 0 2024-04-12T13:42:30.759 INFO:tasks.workunit.client.0.smithi060.stdout:0/966: symlink d7/d9/d14/d35/d44/l14a 0 2024-04-12T13:42:30.762 INFO:tasks.workunit.client.0.smithi060.stdout:0/967: write d7/d9/de/d80/d8b/f120 [3384514,114054] 0 2024-04-12T13:42:30.771 INFO:tasks.workunit.client.0.smithi060.stdout:2/998: rename d6/d64/d99/df0/d81/dbd/f63 to d6/d64/d10f/f134 0 2024-04-12T13:42:30.774 INFO:tasks.workunit.client.0.smithi060.stdout:4/997: truncate d6/d2f/d7d/d11b/d1a/d56/d8d/d139/d7a/f97 3345093 0 2024-04-12T13:42:30.776 INFO:tasks.workunit.client.0.smithi060.stdout:0/968: rename d7/d9/d14/d4a/l5a to d7/d9/de/d7c/l14b 0 2024-04-12T13:42:30.778 INFO:tasks.workunit.client.0.smithi060.stdout:2/999: truncate d6/dae/d31/fab 145730 0 2024-04-12T13:42:30.780 INFO:tasks.workunit.client.0.smithi060.stdout:4/998: dread d6/d2f/d7d/d11b/d1a/d57/d63/fec [0,4194304] 0 2024-04-12T13:42:30.780 INFO:tasks.workunit.client.0.smithi060.stdout:0/969: creat d7/d9/de/d80/dc8/f14c x:0 0 0 2024-04-12T13:42:30.783 INFO:tasks.workunit.client.0.smithi060.stdout:0/970: fdatasync d7/d9/d14/d35/d44/dd9/f13e 0 2024-04-12T13:42:30.787 INFO:tasks.workunit.client.0.smithi060.stdout:9/993: sync 2024-04-12T13:42:30.787 INFO:tasks.workunit.client.0.smithi060.stdout:8/959: sync 2024-04-12T13:42:30.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/960: rename d9/d1b/d84/da0/f24 to d9/d1b/d37/d4d/d63/f14a 0 2024-04-12T13:42:30.798 INFO:tasks.workunit.client.0.smithi060.stdout:4/999: dwrite d6/d2f/d7d/d11b/d1a/d57/d63/fb2 [0,4194304] 0 2024-04-12T13:42:30.811 INFO:tasks.workunit.client.0.smithi060.stdout:0/971: dwrite d7/d9/d14/f6f [0,4194304] 0 2024-04-12T13:42:30.814 INFO:tasks.workunit.client.0.smithi060.stdout:8/961: dread d9/d1b/d84/f132 [0,4194304] 0 2024-04-12T13:42:30.816 INFO:tasks.workunit.client.0.smithi060.stdout:9/994: write d4/d33/d50/f74 [303991,96950] 0 2024-04-12T13:42:30.819 INFO:tasks.workunit.client.0.smithi060.stdout:8/962: fdatasync d9/d1b/d37/d4d/d63/d66/dd9/f12d 0 2024-04-12T13:42:30.826 INFO:tasks.workunit.client.0.smithi060.stdout:9/995: dread d4/d33/d50/dd0/d104/f122 [0,4194304] 0 2024-04-12T13:42:30.828 INFO:tasks.workunit.client.0.smithi060.stdout:9/996: stat d4/d9/d19/d21/f111 0 2024-04-12T13:42:30.836 INFO:tasks.workunit.client.0.smithi060.stdout:0/972: link d7/d9/d14/d35/d44/d7d/de8/d104/f143 d7/d9/d14/d35/d44/d49/f14d 0 2024-04-12T13:42:30.840 INFO:tasks.workunit.client.0.smithi060.stdout:0/973: mkdir d7/d9/de/d14e 0 2024-04-12T13:42:30.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/963: dwrite d9/d1b/d2b/f10e [0,4194304] 0 2024-04-12T13:42:30.851 INFO:tasks.workunit.client.0.smithi060.stdout:8/964: stat d9/dc9/d120 0 2024-04-12T13:42:30.857 INFO:tasks.workunit.client.0.smithi060.stdout:0/974: link d7/d41/dbc/f13a d7/d9/d14/d35/d44/d7d/f14f 0 2024-04-12T13:42:30.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/997: dwrite d4/d9/f3e [0,4194304] 0 2024-04-12T13:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 -- 172.21.15.60:0/3226608027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94640ff000 msgr2=0x7f94640ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 --2- 172.21.15.60:0/3226608027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94640ff000 0x7f94640ff410 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9454004880 tx=0x7f9454009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 -- 172.21.15.60:0/3226608027 shutdown_connections 2024-04-12T13:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 --2- 172.21.15.60:0/3226608027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94641002b0 0x7f9464100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 --2- 172.21.15.60:0/3226608027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94640ff000 0x7f94640ff410 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9454004880 tx=0x7f9454009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 -- 172.21.15.60:0/3226608027 >> 172.21.15.60:0/3226608027 conn(0x7f94640fa950 msgr2=0x7f94640fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 -- 172.21.15.60:0/3226608027 shutdown_connections 2024-04-12T13:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.867+0000 7f9468e00700 1 -- 172.21.15.60:0/3226608027 wait complete. 2024-04-12T13:42:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.869+0000 7f9468e00700 1 Processor -- start 2024-04-12T13:42:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.869+0000 7f9468e00700 1 -- start start 2024-04-12T13:42:30.872 INFO:tasks.workunit.client.0.smithi060.stdout:9/998: rename d4/d9/fa0 to d4/d8/db8/f143 0 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9468e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 0x7f94640727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9468e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9468e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640731b0 con 0x7f94641002b0 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9468e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464073320 con 0x7f9464072cf0 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9461400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9461400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:49114/0 (socket says 172.21.15.60:49114) 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.870+0000 7f9461400700 1 -- 172.21.15.60:0/3350324658 learned_addr learned my addr 172.21.15.60:0/3350324658 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.871+0000 7f9461e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 0x7f94640727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.871+0000 7f9461400700 1 -- 172.21.15.60:0/3350324658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 msgr2=0x7f94640727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.871+0000 7f9461400700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 0x7f94640727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.871+0000 7f9461400700 1 -- 172.21.15.60:0/3350324658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454005040 con 0x7f9464072cf0 2024-04-12T13:42:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.871+0000 7f9461e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 0x7f94640727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:42:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.872+0000 7f9461400700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94500041d0 tx=0x7f945000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.872+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9450007cc0 con 0x7f9464072cf0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.872+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464074190 con 0x7f9464072cf0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.873+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f945000f040 con 0x7f9464072cf0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.873+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640746d0 con 0x7f9464072cf0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.873+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f945000cb50 con 0x7f9464072cf0 2024-04-12T13:42:30.876 INFO:tasks.workunit.client.0.smithi060.stdout:0/975: link d7/d9/d14/d35/f6b d7/d9/d14/f150 0 2024-04-12T13:42:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.874+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946405f5f0 con 0x7f9464072cf0 2024-04-12T13:42:30.877 INFO:tasks.workunit.client.0.smithi060.stdout:8/965: dwrite d9/d1b/d84/da0/d114/f149 [0,4194304] 0 2024-04-12T13:42:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.876+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f94500090d0 con 0x7f9464072cf0 2024-04-12T13:42:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.877+0000 7f945a000700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 0x7f944806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:42:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.877+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f945008a7d0 con 0x7f9464072cf0 2024-04-12T13:42:30.880 INFO:tasks.workunit.client.0.smithi060.stdout:0/976: write d7/d9/d14/d35/d44/d8c/d8d/de9/ffe [5066153,17301] 0 2024-04-12T13:42:30.881 INFO:tasks.workunit.client.0.smithi060.stdout:8/966: chown d9/d1b/d37/l4a 16181 1 2024-04-12T13:42:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.878+0000 7f9461e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 0x7f944806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:42:30.881 INFO:tasks.workunit.client.0.smithi060.stdout:9/999: rmdir d4/d33/d50 39 2024-04-12T13:42:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.881+0000 7f9461e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 0x7f944806e1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9454009040 tx=0x7f9454009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:42:30.883 INFO:tasks.workunit.client.0.smithi060.stdout:0/977: chown d7/d9/d14/d35/d44/d7d/de8/d104/f143 281 1 2024-04-12T13:42:30.885 INFO:tasks.workunit.client.0.smithi060.stdout:8/967: chown d9/d1b/d37/d4d/d63/d66/dd9/dfc/f99 656461487 1 2024-04-12T13:42:30.885 INFO:tasks.workunit.client.0.smithi060.stdout:0/978: dread - d7/d9/d14/d35/d44/d8c/d8d/de5/f12e zero size 2024-04-12T13:42:30.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/968: mknod d9/d1b/d2b/d82/d8a/d116/d11a/c14b 0 2024-04-12T13:42:30.895 INFO:tasks.workunit.client.0.smithi060.stdout:8/969: mknod d9/d1b/d37/d4d/d63/c14c 0 2024-04-12T13:42:30.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:30.895+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f94500508f0 con 0x7f9464072cf0 2024-04-12T13:42:30.898 INFO:tasks.workunit.client.0.smithi060.stdout:0/979: getdents d7/d9 0 2024-04-12T13:42:30.904 INFO:tasks.workunit.client.0.smithi060.stdout:0/980: mkdir d7/d9/d14/d35/d44/d8c/d106/d151 0 2024-04-12T13:42:30.914 INFO:tasks.workunit.client.0.smithi060.stdout:8/970: dwrite d9/d1b/d2b/d82/d8a/d116/f130 [0,4194304] 0 2024-04-12T13:42:30.918 INFO:tasks.workunit.client.0.smithi060.stdout:0/981: rename d7/d9/de/d80/dc8/d10d/l117 to d7/d9/d14/d35/d44/d8c/d8d/de9/l152 0 2024-04-12T13:42:30.921 INFO:tasks.workunit.client.0.smithi060.stdout:0/982: chown d7/d9/d14/d35/d44/d49/d74 180194 1 2024-04-12T13:42:30.928 INFO:tasks.workunit.client.0.smithi060.stdout:0/983: creat d7/d9/de/d63/f153 x:0 0 0 2024-04-12T13:42:30.929 INFO:tasks.workunit.client.0.smithi060.stdout:8/971: dread d9/d1b/d84/da0/d80/d109/d7b/f9e [0,4194304] 0 2024-04-12T13:42:30.932 INFO:tasks.workunit.client.0.smithi060.stdout:0/984: creat d7/d33/f154 x:0 0 0 2024-04-12T13:42:30.934 INFO:tasks.workunit.client.0.smithi060.stdout:8/972: mkdir d9/d1b/d2b/d82/d8a/dce/de3/d14d 0 2024-04-12T13:42:30.936 INFO:tasks.workunit.client.0.smithi060.stdout:0/985: fdatasync d7/d9/d14/d35/d44/d8c/d8d/de5/f103 0 2024-04-12T13:42:30.938 INFO:tasks.workunit.client.0.smithi060.stdout:8/973: creat d9/d1b/d3c/d8d/f14e x:0 0 0 2024-04-12T13:42:30.940 INFO:tasks.workunit.client.0.smithi060.stdout:0/986: symlink d7/d9/l155 0 2024-04-12T13:42:30.943 INFO:tasks.workunit.client.0.smithi060.stdout:7/998: sync 2024-04-12T13:42:30.955 INFO:tasks.workunit.client.0.smithi060.stdout:8/974: truncate d9/d1b/d37/d4d/d63/f14a 5438610 0 2024-04-12T13:42:30.956 INFO:tasks.workunit.client.0.smithi060.stdout:8/975: stat d9/dc9/d13e/l144 0 2024-04-12T13:42:30.959 INFO:tasks.workunit.client.0.smithi060.stdout:0/987: rmdir d7/d9/d14/d35/d44/d7d 39 2024-04-12T13:42:30.971 INFO:tasks.workunit.client.0.smithi060.stdout:8/976: creat d9/d1b/d37/d4d/d63/d66/d8b/d102/f14f x:0 0 0 2024-04-12T13:42:30.978 INFO:tasks.workunit.client.0.smithi060.stdout:7/999: dwrite d0/d7/f24 [0,4194304] 0 2024-04-12T13:42:30.992 INFO:tasks.workunit.client.0.smithi060.stdout:0/988: dwrite d7/d9/d14/d35/d44/d8c/d8d/d10b/f45 [4194304,4194304] 0 2024-04-12T13:42:31.004 INFO:tasks.workunit.client.0.smithi060.stdout:8/977: dread d9/dc9/ff1 [0,4194304] 0 2024-04-12T13:42:31.014 INFO:tasks.workunit.client.0.smithi060.stdout:8/978: mknod d9/d1b/d37/d4d/d63/d66/db3/d65/c150 0 2024-04-12T13:42:31.023 INFO:tasks.workunit.client.0.smithi060.stdout:8/979: symlink d9/d1b/d37/d4d/d63/l151 0 2024-04-12T13:42:31.040 INFO:tasks.workunit.client.0.smithi060.stdout:0/989: dread d7/d41/f61 [0,4194304] 0 2024-04-12T13:42:31.043 INFO:tasks.workunit.client.0.smithi060.stdout:0/990: chown d7/d33/d5b/cb3 34767697 1 2024-04-12T13:42:31.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/991: fsync d7/d9/d14/d4a/f5f 0 2024-04-12T13:42:31.051 INFO:tasks.workunit.client.0.smithi060.stdout:0/992: creat d7/d9/d14/d35/d44/d49/dcf/dd0/f156 x:0 0 0 2024-04-12T13:42:31.053 INFO:tasks.workunit.client.0.smithi060.stdout:0/993: dread - d7/d9/d14/d35/d44/dd9/f13e zero size 2024-04-12T13:42:31.055 INFO:tasks.workunit.client.0.smithi060.stdout:0/994: readlink d7/d41/lad 0 2024-04-12T13:42:31.075 INFO:tasks.workunit.client.0.smithi060.stdout:8/980: dwrite d9/d1b/d84/da0/d80/ff4 [0,4194304] 0 2024-04-12T13:42:31.079 INFO:tasks.workunit.client.0.smithi060.stdout:0/995: getdents d7/d9/d14/d35/d44/d49/dcf/dd0 0 2024-04-12T13:42:31.084 INFO:tasks.workunit.client.0.smithi060.stdout:0/996: creat d7/d33/d12a/f157 x:0 0 0 2024-04-12T13:42:31.101 INFO:tasks.workunit.client.0.smithi060.stdout:0/997: rename d7/d9/d14/d35/d44/d8c/d8d/d10b/l71 to d7/d9/l158 0 2024-04-12T13:42:31.109 INFO:tasks.workunit.client.0.smithi060.stdout:8/981: dwrite d9/d1b/d37/d4d/d63/d66/db3/fda [4194304,4194304] 0 2024-04-12T13:42:31.113 INFO:tasks.workunit.client.0.smithi060.stdout:0/998: creat d7/d9/d4c/d93/f159 x:0 0 0 2024-04-12T13:42:31.121 INFO:tasks.workunit.client.0.smithi060.stdout:8/982: dread d9/d1b/d2b/fbe [0,4194304] 0 2024-04-12T13:42:31.124 INFO:tasks.workunit.client.0.smithi060.stdout:8/983: stat d9/d1b/d84/fb9 0 2024-04-12T13:42:31.124 INFO:tasks.workunit.client.0.smithi060.stdout:0/999: mknod d7/d9/d14/d35/d44/dd9/dd8/c15a 0 2024-04-12T13:42:31.129 INFO:tasks.workunit.client.0.smithi060.stdout:8/984: write d9/d1b/d37/d4d/d63/d66/dd9/f12d [936261,115544] 0 2024-04-12T13:42:31.138 INFO:tasks.workunit.client.0.smithi060.stdout:8/985: getdents d9/d1b/d37 0 2024-04-12T13:42:31.150 INFO:tasks.workunit.client.0.smithi060.stdout:8/986: write d9/d1d/d5e/fe4 [1280192,92400] 0 2024-04-12T13:42:31.152 INFO:tasks.workunit.client.0.smithi060.stdout:8/987: read d9/d1b/d84/da0/d80/d109/fa5 [386621,116680] 0 2024-04-12T13:42:31.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:30 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3967235369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:42:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:30 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3967235369' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:42:31.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.378+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9464074940 con 0x7f9464072cf0 2024-04-12T13:42:31.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.379+0000 7f945a000700 1 -- 172.21.15.60:0/3350324658 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9450053df0 con 0x7f9464072cf0 2024-04-12T13:42:31.381 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.381+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 msgr2=0x7f944806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.381+0000 7f9468e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 0x7f944806e1f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9454009040 tx=0x7f9454009e30 comp rx=0 tx=0).stop 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.381+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 msgr2=0x7f9464073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.381+0000 7f9468e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94500041d0 tx=0x7f945000b040 comp rx=0 tx=0).stop 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 shutdown_connections 2024-04-12T13:42:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f944806bd40 0x7f944806e1f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:31.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641002b0 0x7f94640727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:31.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 --2- 172.21.15.60:0/3350324658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464072cf0 0x7f9464073b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:42:31.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 >> 172.21.15.60:0/3350324658 conn(0x7f94640fa950 msgr2=0x7f94640fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:42:31.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 shutdown_connections 2024-04-12T13:42:31.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:42:31.382+0000 7f9468e00700 1 -- 172.21.15.60:0/3350324658 wait complete. 2024-04-12T13:42:31.643 INFO:tasks.workunit.client.0.smithi060.stdout:8/988: sync 2024-04-12T13:42:31.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/989: sync 2024-04-12T13:42:31.927 INFO:tasks.workunit.client.0.smithi060.stdout:8/990: rename d9/d1b/d3c/d8d to d9/d1b/d84/d152 0 2024-04-12T13:42:31.948 INFO:tasks.workunit.client.0.smithi060.stdout:8/991: rename d9/d1d/d5e/ded/d122 to d9/d1b/d84/da0/d80/d109/d7b/db1/d153 0 2024-04-12T13:42:31.971 INFO:tasks.workunit.client.0.smithi060.stdout:8/992: link d9/d1b/d84/da0/d80/d109/dbd/c13d d9/d1b/d37/d4d/d63/d66/dd9/dfc/c154 0 2024-04-12T13:42:31.987 INFO:tasks.workunit.client.0.smithi060.stdout:8/993: creat d9/d1b/f155 x:0 0 0 2024-04-12T13:42:32.001 INFO:tasks.workunit.client.0.smithi060.stdout:8/994: truncate d9/d1d/d5e/fde 1790447 0 2024-04-12T13:42:32.171 INFO:tasks.workunit.client.0.smithi060.stdout:8/995: sync 2024-04-12T13:42:32.184 INFO:tasks.workunit.client.0.smithi060.stdout:8/996: creat d9/d1b/d2b/d82/f156 x:0 0 0 2024-04-12T13:42:32.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/997: truncate d9/d1b/d2b/f55 741932 0 2024-04-12T13:42:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:31 smithi110 ceph-mon[36055]: pgmap v40: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 59 MiB/s rd, 132 MiB/s wr, 333 op/s 2024-04-12T13:42:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:31 smithi110 ceph-mon[36055]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:31 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3350324658' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:42:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:31 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:32.279 INFO:tasks.workunit.client.0.smithi060.stdout:8/998: creat d9/d1b/d37/d4d/d63/f157 x:0 0 0 2024-04-12T13:42:32.282 INFO:tasks.workunit.client.0.smithi060.stdout:8/999: dread - d9/d1b/f155 zero size 2024-04-12T13:42:32.296 INFO:tasks.workunit.client.0.smithi060.stderr:+ rm -rf -- ./tmp.ipk6qCJ9YZ 2024-04-12T13:42:32.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:31 smithi060 ceph-mon[29097]: pgmap v40: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 59 MiB/s rd, 132 MiB/s wr, 333 op/s 2024-04-12T13:42:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:31 smithi060 ceph-mon[29097]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:42:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:31 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3350324658' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:42:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:31 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:33 smithi110 ceph-mon[36055]: pgmap v41: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 144 MiB/s wr, 385 op/s 2024-04-12T13:42:34.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:33 smithi060 ceph-mon[29097]: pgmap v41: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 144 MiB/s wr, 385 op/s 2024-04-12T13:42:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:35 smithi110 ceph-mon[36055]: pgmap v42: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 67 MiB/s rd, 159 MiB/s wr, 402 op/s 2024-04-12T13:42:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:35 smithi060 ceph-mon[29097]: pgmap v42: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 67 MiB/s rd, 159 MiB/s wr, 402 op/s 2024-04-12T13:42:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:37 smithi060 ceph-mon[29097]: pgmap v43: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 40 MiB/s rd, 99 MiB/s wr, 261 op/s 2024-04-12T13:42:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:37 smithi110 ceph-mon[36055]: pgmap v43: 65 pgs: 65 active+clean; 4.2 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 40 MiB/s rd, 99 MiB/s wr, 261 op/s 2024-04-12T13:42:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:39 smithi110 ceph-mon[36055]: pgmap v44: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 320 op/s 2024-04-12T13:42:40.276 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:39 smithi060 ceph-mon[29097]: pgmap v44: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 40 MiB/s rd, 100 MiB/s wr, 320 op/s 2024-04-12T13:42:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:41 smithi110 ceph-mon[36055]: pgmap v45: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 158 op/s 2024-04-12T13:42:42.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:41 smithi060 ceph-mon[29097]: pgmap v45: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 158 op/s 2024-04-12T13:42:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:43 smithi110 ceph-mon[36055]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 177 op/s 2024-04-12T13:42:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:43 smithi060 ceph-mon[29097]: pgmap v46: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 177 op/s 2024-04-12T13:42:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:45 smithi110 ceph-mon[36055]: pgmap v47: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 8.3 MiB/s rd, 25 MiB/s wr, 162 op/s 2024-04-12T13:42:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:45 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:45 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:46.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:45 smithi060 ceph-mon[29097]: pgmap v47: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 8.3 MiB/s rd, 25 MiB/s wr, 162 op/s 2024-04-12T13:42:46.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:45 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:46.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:45 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:42:47.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:46 smithi060 ceph-mon[29097]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:42:47.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:46 smithi060 ceph-mon[29097]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:42:47.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:46 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:46 smithi110 ceph-mon[36055]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:42:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:46 smithi110 ceph-mon[36055]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:42:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:46 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:42:48.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:47 smithi060 ceph-mon[29097]: pgmap v48: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 13 KiB/s rd, 840 KiB/s wr, 114 op/s 2024-04-12T13:42:48.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:48 smithi060 ceph-mon[29097]: mgrmap e25: smithi110.ezwdax(active, since 90s), standbys: smithi060.bpzacg 2024-04-12T13:42:48.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:47 smithi110 ceph-mon[36055]: pgmap v48: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 13 KiB/s rd, 840 KiB/s wr, 114 op/s 2024-04-12T13:42:48.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:47 smithi110 ceph-mon[36055]: mgrmap e25: smithi110.ezwdax(active, since 90s), standbys: smithi060.bpzacg 2024-04-12T13:42:50.341 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:49 smithi060 ceph-mon[29097]: pgmap v49: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 169 op/s 2024-04-12T13:42:50.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:49 smithi110 ceph-mon[36055]: pgmap v49: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 169 op/s 2024-04-12T13:42:52.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:51 smithi060 ceph-mon[29097]: pgmap v50: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 16 KiB/s rd, 763 KiB/s wr, 110 op/s 2024-04-12T13:42:52.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:51 smithi110 ceph-mon[36055]: pgmap v50: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 16 KiB/s rd, 763 KiB/s wr, 110 op/s 2024-04-12T13:42:54.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:53 smithi060 ceph-mon[29097]: pgmap v51: 65 pgs: 65 active+clean; 1.8 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 781 KiB/s wr, 130 op/s 2024-04-12T13:42:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:53 smithi110 ceph-mon[36055]: pgmap v51: 65 pgs: 65 active+clean; 1.8 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 781 KiB/s wr, 130 op/s 2024-04-12T13:42:56.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:56 smithi060 ceph-mon[29097]: pgmap v52: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 136 op/s 2024-04-12T13:42:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:56 smithi110 ceph-mon[36055]: pgmap v52: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 1.0 MiB/s wr, 136 op/s 2024-04-12T13:42:57.346 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T13:42:57.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T13:42:58.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:42:58 smithi060 ceph-mon[29097]: pgmap v53: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 713 KiB/s wr, 100 op/s 2024-04-12T13:42:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:42:58 smithi110 ceph-mon[36055]: pgmap v53: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 713 KiB/s wr, 100 op/s 2024-04-12T13:43:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:00 smithi060 ceph-mon[29097]: pgmap v54: 65 pgs: 65 active+clean; 871 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-04-12T13:43:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:00 smithi110 ceph-mon[36055]: pgmap v54: 65 pgs: 65 active+clean; 871 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-04-12T13:43:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:01 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:01 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:01 smithi060 ceph-mon[29097]: Reconfiguring node-exporter.smithi110 (dependencies changed)... 2024-04-12T13:43:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:01 smithi060 ceph-mon[29097]: Reconfiguring daemon node-exporter.smithi110 on smithi110 2024-04-12T13:43:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:01 smithi060 ceph-mon[29097]: pgmap v55: 65 pgs: 65 active+clean; 871 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 15 KiB/s rd, 668 KiB/s wr, 90 op/s 2024-04-12T13:43:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:01 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:01 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:01 smithi110 ceph-mon[36055]: Reconfiguring node-exporter.smithi110 (dependencies changed)... 2024-04-12T13:43:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:01 smithi110 ceph-mon[36055]: Reconfiguring daemon node-exporter.smithi110 on smithi110 2024-04-12T13:43:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:01 smithi110 ceph-mon[36055]: pgmap v55: 65 pgs: 65 active+clean; 871 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 15 KiB/s rd, 668 KiB/s wr, 90 op/s 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 -- 172.21.15.60:0/241988956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 msgr2=0x7f14400fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 --2- 172.21.15.60:0/241988956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f14400fd320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1430004940 tx=0x7f1430009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 -- 172.21.15.60:0/241988956 shutdown_connections 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 --2- 172.21.15.60:0/241988956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 0x7f14400fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 --2- 172.21.15.60:0/241988956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f14400fd320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 -- 172.21.15.60:0/241988956 >> 172.21.15.60:0/241988956 conn(0x7f14400f8530 msgr2=0x7f14400fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 -- 172.21.15.60:0/241988956 shutdown_connections 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.573+0000 7f1444e00700 1 -- 172.21.15.60:0/241988956 wait complete. 2024-04-12T13:43:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.574+0000 7f1444e00700 1 Processor -- start 2024-04-12T13:43:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.574+0000 7f1444e00700 1 -- start start 2024-04-12T13:43:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f1444e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f1444e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 0x7f1440110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f1444e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440110870 con 0x7f14400fcef0 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f1444e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440110fb0 con 0x7f14400fe0e0 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f143de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f143de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59986/0 (socket says 172.21.15.60:59986) 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.575+0000 7f143de00700 1 -- 172.21.15.60:0/570311152 learned_addr learned my addr 172.21.15.60:0/570311152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.576+0000 7f143d400700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 0x7f1440110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.576+0000 7f143de00700 1 -- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 msgr2=0x7f1440110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.576+0000 7f143de00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 0x7f1440110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.576+0000 7f143de00700 1 -- 172.21.15.60:0/570311152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430005040 con 0x7f14400fcef0 2024-04-12T13:43:01.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f143de00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f143000b970 tx=0x7f1430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:01.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143000e040 con 0x7f14400fcef0 2024-04-12T13:43:01.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f143000bbf0 con 0x7f14400fcef0 2024-04-12T13:43:01.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1440111230 con 0x7f14400fcef0 2024-04-12T13:43:01.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143001c3f0 con 0x7f14400fcef0 2024-04-12T13:43:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.577+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401117f0 con 0x7f14400fcef0 2024-04-12T13:43:01.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.579+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440101a70 con 0x7f14400fcef0 2024-04-12T13:43:01.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.580+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f143000bd60 con 0x7f14400fcef0 2024-04-12T13:43:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.581+0000 7f1436000700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 0x7f142406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:01.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.581+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f143008ba10 con 0x7f14400fcef0 2024-04-12T13:43:01.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.582+0000 7f143d400700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 0x7f142406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:01.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.583+0000 7f143d400700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 0x7f142406e090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f142c007fd0 tx=0x7f142c009040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:01.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.587+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f1430058ec0 con 0x7f14400fcef0 2024-04-12T13:43:01.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.904+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1440105b10 con 0x7f142406bbe0 2024-04-12T13:43:01.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.908+0000 7f1436000700 1 -- 172.21.15.60:0/570311152 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f1440105b10 con 0x7f142406bbe0 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 msgr2=0x7f142406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 0x7f142406e090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f142c007fd0 tx=0x7f142c009040 comp rx=0 tx=0).stop 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 msgr2=0x7f144010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f143000b970 tx=0x7f1430009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 shutdown_connections 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f142406bbe0 0x7f142406e090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14400fcef0 0x7f144010fd30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 --2- 172.21.15.60:0/570311152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14400fe0e0 0x7f1440110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 >> 172.21.15.60:0/570311152 conn(0x7f14400f8530 msgr2=0x7f14400f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.911+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 shutdown_connections 2024-04-12T13:43:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:01.912+0000 7f1444e00700 1 -- 172.21.15.60:0/570311152 wait complete. 2024-04-12T13:43:01.931 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:43:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.121+0000 7fcaed600700 1 -- 172.21.15.60:0/3235312671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcadc013bf0 con 0x7fcaf00708f0 2024-04-12T13:43:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.121+0000 7fcaf5600700 1 -- 172.21.15.60:0/3235312671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00708f0 msgr2=0x7fcaf0070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.121+0000 7fcaf5600700 1 --2- 172.21.15.60:0/3235312671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00708f0 0x7fcaf0070d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcadc004880 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.122+0000 7fcaf5600700 1 -- 172.21.15.60:0/3235312671 shutdown_connections 2024-04-12T13:43:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.122+0000 7fcaf5600700 1 --2- 172.21.15.60:0/3235312671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00708f0 0x7fcaf0070d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.122+0000 7fcaf5600700 1 --2- 172.21.15.60:0/3235312671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf0071ea0 0x7fcaf00703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.122+0000 7fcaf5600700 1 -- 172.21.15.60:0/3235312671 >> 172.21.15.60:0/3235312671 conn(0x7fcaf00f8530 msgr2=0x7fcaf00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.123+0000 7fcaf5600700 1 -- 172.21.15.60:0/3235312671 shutdown_connections 2024-04-12T13:43:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.123+0000 7fcaf5600700 1 -- 172.21.15.60:0/3235312671 wait complete. 2024-04-12T13:43:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.125+0000 7fcaf5600700 1 Processor -- start 2024-04-12T13:43:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.125+0000 7fcaf5600700 1 -- start start 2024-04-12T13:43:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.125+0000 7fcaf5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 0x7fcaf0114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.126+0000 7fcaf5600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 0x7fcaf0114550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.126+0000 7fcaf5600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0114b50 con 0x7fcaf0071ea0 2024-04-12T13:43:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.126+0000 7fcaf5600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01153a0 con 0x7fcaf00708f0 2024-04-12T13:43:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.127+0000 7fcaeea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 0x7fcaf0114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.127+0000 7fcaeea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 0x7fcaf0114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39366/0 (socket says 172.21.15.60:39366) 2024-04-12T13:43:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.127+0000 7fcaeea00700 1 -- 172.21.15.60:0/1897068329 learned_addr learned my addr 172.21.15.60:0/1897068329 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.128+0000 7fcaee000700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 0x7fcaf0114550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.128+0000 7fcaee000700 1 -- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 msgr2=0x7fcaf0114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.128+0000 7fcaee000700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 0x7fcaf0114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.129+0000 7fcaee000700 1 -- 172.21.15.60:0/1897068329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc005040 con 0x7fcaf0071ea0 2024-04-12T13:43:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.129+0000 7fcaee000700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 0x7fcaf0114550 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0137c0 tx=0x7fcadc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.130+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcadc00e030 con 0x7fcaf0071ea0 2024-04-12T13:43:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.130+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf0115620 con 0x7fcaf0071ea0 2024-04-12T13:43:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.130+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0115b60 con 0x7fcaf0071ea0 2024-04-12T13:43:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.130+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcadc013e60 con 0x7fcaf0071ea0 2024-04-12T13:43:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.130+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcadc01ce20 con 0x7fcaf0071ea0 2024-04-12T13:43:02.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.135+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad00052e0 con 0x7fcaf0071ea0 2024-04-12T13:43:02.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.137+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7fcadc013990 con 0x7fcaf0071ea0 2024-04-12T13:43:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.140+0000 7fcae6a00700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 0x7fcad406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.140+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcadc08bad0 con 0x7fcaf0071ea0 2024-04-12T13:43:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.141+0000 7fcaeea00700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 0x7fcad406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.142+0000 7fcaeea00700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 0x7fcad406e150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004550 tx=0x7fcae800b040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:02.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.147+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fcadc058f30 con 0x7fcaf0071ea0 2024-04-12T13:43:02.268 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T13:43:02.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-12T13:43:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.473+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcad0000bf0 con 0x7fcad406bca0 2024-04-12T13:43:02.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:02 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:02.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:02 smithi060 ceph-mon[29097]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:02 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:02 smithi110 ceph-mon[36055]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.476+0000 7fcae6a00700 1 -- 172.21.15.60:0/1897068329 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcad0000bf0 con 0x7fcad406bca0 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 msgr2=0x7fcad406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 0x7fcad406e150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004550 tx=0x7fcae800b040 comp rx=0 tx=0).stop 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 msgr2=0x7fcaf0114550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 0x7fcaf0114550 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0137c0 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 shutdown_connections 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fcad406bca0 0x7fcad406e150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf00708f0 0x7fcaf0114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 --2- 172.21.15.60:0/1897068329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf0071ea0 0x7fcaf0114550 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.480+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 >> 172.21.15.60:0/1897068329 conn(0x7fcaf00f8530 msgr2=0x7fcaf00f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.481+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 shutdown_connections 2024-04-12T13:43:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.481+0000 7fcaf5600700 1 -- 172.21.15.60:0/1897068329 wait complete. 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 -- 172.21.15.60:0/1465723974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fbd40 msgr2=0x7fab640fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 --2- 172.21.15.60:0/1465723974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fbd40 0x7fab640fc150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab58004940 tx=0x7fab58009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 -- 172.21.15.60:0/1465723974 shutdown_connections 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 --2- 172.21.15.60:0/1465723974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fcff0 0x7fab640fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 --2- 172.21.15.60:0/1465723974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fbd40 0x7fab640fc150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.661+0000 7fab6c200700 1 -- 172.21.15.60:0/1465723974 >> 172.21.15.60:0/1465723974 conn(0x7fab640f74c0 msgr2=0x7fab640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.662+0000 7fab6c200700 1 -- 172.21.15.60:0/1465723974 shutdown_connections 2024-04-12T13:43:02.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.662+0000 7fab6c200700 1 -- 172.21.15.60:0/1465723974 wait complete. 2024-04-12T13:43:02.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.663+0000 7fab6c200700 1 Processor -- start 2024-04-12T13:43:02.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab6c200700 1 -- start start 2024-04-12T13:43:02.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab6c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab6c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 0x7fab64103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab6c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64104100 con 0x7fab640fcff0 2024-04-12T13:43:02.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab6c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64104270 con 0x7fab640fbd40 2024-04-12T13:43:02.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab69800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab69800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39372/0 (socket says 172.21.15.60:39372) 2024-04-12T13:43:02.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.664+0000 7fab69800700 1 -- 172.21.15.60:0/2912929587 learned_addr learned my addr 172.21.15.60:0/2912929587 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:02.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab68e00700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 0x7fab64103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab69800700 1 -- 172.21.15.60:0/2912929587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 msgr2=0x7fab64103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab69800700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 0x7fab64103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab69800700 1 -- 172.21.15.60:0/2912929587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58005040 con 0x7fab640fbd40 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab68e00700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 0x7fab64103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.665+0000 7fab69800700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab58009150 tx=0x7fab58009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.666+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5800e040 con 0x7fab640fbd40 2024-04-12T13:43:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.666+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab5800bcc0 con 0x7fab640fbd40 2024-04-12T13:43:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.666+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5801c630 con 0x7fab640fbd40 2024-04-12T13:43:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.666+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab641044f0 con 0x7fab640fbd40 2024-04-12T13:43:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.666+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab64115a30 con 0x7fab640fbd40 2024-04-12T13:43:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.667+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6405f5f0 con 0x7fab640fbd40 2024-04-12T13:43:02.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.669+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7fab5801c850 con 0x7fab640fbd40 2024-04-12T13:43:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.670+0000 7fab61600700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 0x7fab4c06e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.670+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fab5808b6a0 con 0x7fab640fbd40 2024-04-12T13:43:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.670+0000 7fab68e00700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 0x7fab4c06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:02.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.671+0000 7fab68e00700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 0x7fab4c06e080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab500095c0 tx=0x7fab50007f20 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:02.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.675+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fab58054fd0 con 0x7fab640fbd40 2024-04-12T13:43:02.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.965+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab64101300 con 0x7fab4c06bbd0 2024-04-12T13:43:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.978+0000 7fab61600700 1 -- 172.21.15.60:0/2912929587 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fab64101300 con 0x7fab4c06bbd0 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 starting - - - - 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (12m) 87s ago 12m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (10m) 94s ago 10m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 starting - - - - 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (4m) 87s ago 4m 12.0M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (4m) 87s ago 4m 140M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (4m) 94s ago 4m 11.9M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (4m) 94s ago 4m 12.0M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:43:02.981 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:9283 running (13m) 87s ago 13m 327M - 17.2.7-845-g730340d7 036a68d49952 7f806ee19bb3 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (2m) 94s ago 10m 487M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (13m) 87s ago 13m 46.7M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (10m) 94s ago 10m 38.8M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 starting - - - - 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (10m) 94s ago 10m 8162k - 1.5.0 0da6a335fe13 f517a68d5c0d 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (9m) 87s ago 9m 101M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (8m) 87s ago 8m 112M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (8m) 87s ago 8m 95.2M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (7m) 94s ago 7m 119M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (7m) 94s ago 7m 109M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (6m) 94s ago 6m 106M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:43:02.982 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 starting - - - - 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 msgr2=0x7fab4c06e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 0x7fab4c06e080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab500095c0 tx=0x7fab50007f20 comp rx=0 tx=0).stop 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 msgr2=0x7fab64105680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab58009150 tx=0x7fab58009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 shutdown_connections 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fab4c06bbd0 0x7fab4c06e080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab640fbd40 0x7fab64105680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 --2- 172.21.15.60:0/2912929587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab640fcff0 0x7fab64103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 >> 172.21.15.60:0/2912929587 conn(0x7fab640f74c0 msgr2=0x7fab640f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.981+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 shutdown_connections 2024-04-12T13:43:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:02.982+0000 7fab6c200700 1 -- 172.21.15.60:0/2912929587 wait complete. 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.202+0000 7f7bd6200700 1 -- 172.21.15.60:0/2384806819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 msgr2=0x7f7bd00675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 --2- 172.21.15.60:0/2384806819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd00675b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0004940 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 -- 172.21.15.60:0/2384806819 shutdown_connections 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 --2- 172.21.15.60:0/2384806819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd0067f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 --2- 172.21.15.60:0/2384806819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd00675b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 -- 172.21.15.60:0/2384806819 >> 172.21.15.60:0/2384806819 conn(0x7f7bd006bf70 msgr2=0x7f7bd006e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:03.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 -- 172.21.15.60:0/2384806819 shutdown_connections 2024-04-12T13:43:03.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.203+0000 7f7bd6200700 1 -- 172.21.15.60:0/2384806819 wait complete. 2024-04-12T13:43:03.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.204+0000 7f7bd6200700 1 Processor -- start 2024-04-12T13:43:03.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.205+0000 7f7bd6200700 1 -- start start 2024-04-12T13:43:03.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.205+0000 7f7bd6200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.205+0000 7f7bd6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd011cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.205+0000 7f7bd6200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd011d2a0 con 0x7f7bd0067af0 2024-04-12T13:43:03.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.205+0000 7f7bd6200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd011d410 con 0x7f7bd00690a0 2024-04-12T13:43:03.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.206+0000 7f7bcf400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.206+0000 7f7bcf400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60018/0 (socket says 172.21.15.60:60018) 2024-04-12T13:43:03.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.206+0000 7f7bcf400700 1 -- 172.21.15.60:0/3385704083 learned_addr learned my addr 172.21.15.60:0/3385704083 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:03.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.206+0000 7f7bcea00700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd011cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.208+0000 7f7bcea00700 1 -- 172.21.15.60:0/3385704083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 msgr2=0x7f7bd011c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.209+0000 7f7bcea00700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.209+0000 7f7bcea00700 1 -- 172.21.15.60:0/3385704083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bd00690a0 2024-04-12T13:43:03.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.209+0000 7f7bcf400700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:43:03.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.210+0000 7f7bcea00700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd011cca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009fd0 tx=0x7f7bbc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:03.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.210+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bbc004e90 con 0x7f7bd00690a0 2024-04-12T13:43:03.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.210+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bbc00f040 con 0x7f7bd00690a0 2024-04-12T13:43:03.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.210+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bbc00ca50 con 0x7f7bd00690a0 2024-04-12T13:43:03.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.210+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0121e10 con 0x7f7bd00690a0 2024-04-12T13:43:03.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.211+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd01223a0 con 0x7f7bd00690a0 2024-04-12T13:43:03.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.214+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd004c710 con 0x7f7bd00690a0 2024-04-12T13:43:03.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.214+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f7bbc00cbb0 con 0x7f7bd00690a0 2024-04-12T13:43:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.216+0000 7f7bc7400700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 0x7f7bb406e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.216+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7bbc08a1f0 con 0x7f7bd00690a0 2024-04-12T13:43:03.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.218+0000 7f7bcf400700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 0x7f7bb406e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.221+0000 7f7bcf400700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 0x7f7bb406e140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b0d0 tx=0x7f7bc0009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:03.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.222+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f7bbc0508f0 con 0x7f7bd00690a0 2024-04-12T13:43:03.488 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:03 smithi110 ceph-mon[36055]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:03.489 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:03 smithi110 ceph-mon[36055]: pgmap v56: 65 pgs: 65 active+clean; 568 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 933 KiB/s wr, 127 op/s 2024-04-12T13:43:03.489 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:03 smithi110 ceph-mon[36055]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:03.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.645+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bd01146e0 con 0x7f7bd00690a0 2024-04-12T13:43:03.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:03 smithi060 ceph-mon[29097]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:03.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:03 smithi060 ceph-mon[29097]: pgmap v56: 65 pgs: 65 active+clean; 568 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 21 KiB/s rd, 933 KiB/s wr, 127 op/s 2024-04-12T13:43:03.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:03 smithi060 ceph-mon[29097]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:03.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.646+0000 7f7bc7400700 1 -- 172.21.15.60:0/3385704083 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f7bbc057ac0 con 0x7f7bd00690a0 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 13, 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:43:03.650 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 msgr2=0x7f7bb406e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 0x7f7bb406e140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b0d0 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 msgr2=0x7f7bd011cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd011cca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009fd0 tx=0x7f7bbc00b040 comp rx=0 tx=0).stop 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 shutdown_connections 2024-04-12T13:43:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f7bb406bc90 0x7f7bb406e140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bd0067af0 0x7f7bd011c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 --2- 172.21.15.60:0/3385704083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bd00690a0 0x7f7bd011cca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 >> 172.21.15.60:0/3385704083 conn(0x7f7bd006bf70 msgr2=0x7f7bd006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 shutdown_connections 2024-04-12T13:43:03.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.650+0000 7f7bd6200700 1 -- 172.21.15.60:0/3385704083 wait complete. 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 -- 172.21.15.60:0/1151347009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44740fffd0 msgr2=0x7f44741023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 --2- 172.21.15.60:0/1151347009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44740fffd0 0x7f44741023b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4460004940 tx=0x7f4460009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 -- 172.21.15.60:0/1151347009 shutdown_connections 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 --2- 172.21.15.60:0/1151347009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44740fffd0 0x7f44741023b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 --2- 172.21.15.60:0/1151347009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4474066290 0x7f44740ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.826+0000 7f4479600700 1 -- 172.21.15.60:0/1151347009 >> 172.21.15.60:0/1151347009 conn(0x7f44740f74c0 msgr2=0x7f44740f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.827+0000 7f4479600700 1 -- 172.21.15.60:0/1151347009 shutdown_connections 2024-04-12T13:43:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.827+0000 7f4479600700 1 -- 172.21.15.60:0/1151347009 wait complete. 2024-04-12T13:43:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.828+0000 7f4479600700 1 Processor -- start 2024-04-12T13:43:03.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4479600700 1 -- start start 2024-04-12T13:43:03.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4479600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4479600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740fffd0 0x7f447410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4479600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447410e650 con 0x7f4474066290 2024-04-12T13:43:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4479600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447410edf0 con 0x7f44740fffd0 2024-04-12T13:43:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.829+0000 7f4472a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60026/0 (socket says 172.21.15.60:60026) 2024-04-12T13:43:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 -- 172.21.15.60:0/247515342 learned_addr learned my addr 172.21.15.60:0/247515342 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472000700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740fffd0 0x7f447410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 -- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740fffd0 msgr2=0x7f447410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740fffd0 0x7f447410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 -- 172.21.15.60:0/247515342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4460005040 con 0x7f4474066290 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.830+0000 7f4472a00700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4464009ea0 tx=0x7f4464009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.831+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4464010a20 con 0x7f4474066290 2024-04-12T13:43:03.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.831+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4464010b80 con 0x7f4474066290 2024-04-12T13:43:03.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.831+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447410f0d0 con 0x7f4474066290 2024-04-12T13:43:03.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.831+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447410f690 con 0x7f4474066290 2024-04-12T13:43:03.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.832+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4464017640 con 0x7f4474066290 2024-04-12T13:43:03.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.833+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447405f5f0 con 0x7f4474066290 2024-04-12T13:43:03.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.834+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f4464016070 con 0x7f4474066290 2024-04-12T13:43:03.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.835+0000 7f446aa00700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 0x7f445806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:03.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.836+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f446408e470 con 0x7f4474066290 2024-04-12T13:43:03.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.836+0000 7f4472000700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 0x7f445806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:03.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.838+0000 7f4472000700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 0x7f445806e0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f446000b3b0 tx=0x7f4460009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:03.842+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f446405b4a0 con 0x7f4474066290 2024-04-12T13:43:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.266+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f447410f9a0 con 0x7f4474066290 2024-04-12T13:43:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.267+0000 7f446aa00700 1 -- 172.21.15.60:0/247515342 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7f446405b2c0 con 0x7f4474066290 2024-04-12T13:43:04.272 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:43:04.272 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:43:04.272 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:43:04.272 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:43:04.273 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:43:04.274 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:04.275 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.272+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 msgr2=0x7f445806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.272+0000 7f4479600700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 0x7f445806e0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f446000b3b0 tx=0x7f4460009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.272+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 msgr2=0x7f447410da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.272+0000 7f4479600700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4464009ea0 tx=0x7f4464009220 comp rx=0 tx=0).stop 2024-04-12T13:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 shutdown_connections 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f445806bc30 0x7f445806e0e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4474066290 0x7f447410da80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 --2- 172.21.15.60:0/247515342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44740fffd0 0x7f447410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 >> 172.21.15.60:0/247515342 conn(0x7f44740f74c0 msgr2=0x7f44740f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 shutdown_connections 2024-04-12T13:43:04.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.275+0000 7f4479600700 1 -- 172.21.15.60:0/247515342 wait complete. 2024-04-12T13:43:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:43:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 -- 172.21.15.60:0/2766366085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f80709a0 msgr2=0x7f66f8070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 --2- 172.21.15.60:0/2766366085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f80709a0 0x7f66f8070e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f66e4004940 tx=0x7f66e4009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 -- 172.21.15.60:0/2766366085 shutdown_connections 2024-04-12T13:43:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 --2- 172.21.15.60:0/2766366085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f80709a0 0x7f66f8070e10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 --2- 172.21.15.60:0/2766366085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f8071f50 0x7f66f8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 -- 172.21.15.60:0/2766366085 >> 172.21.15.60:0/2766366085 conn(0x7f66f80f8530 msgr2=0x7f66f80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 -- 172.21.15.60:0/2766366085 shutdown_connections 2024-04-12T13:43:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.462+0000 7f66ff200700 1 -- 172.21.15.60:0/2766366085 wait complete. 2024-04-12T13:43:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.463+0000 7f66ff200700 1 Processor -- start 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.463+0000 7f66ff200700 1 -- start start 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66ff200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 0x7f66f811cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66ff200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66ff200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f811db90 con 0x7f66f8071f50 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66ff200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f811dcd0 con 0x7f66f80709a0 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66f7400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66f7400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60044/0 (socket says 172.21.15.60:60044) 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66f7400700 1 -- 172.21.15.60:0/4173454913 learned_addr learned my addr 172.21.15.60:0/4173454913 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.464+0000 7f66f7e00700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 0x7f66f811cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66f7400700 1 -- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 msgr2=0x7f66f811cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66f7400700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 0x7f66f811cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66f7400700 1 -- 172.21.15.60:0/4173454913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4005040 con 0x7f66f8071f50 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66f7e00700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 0x7f66f811cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66f7400700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.465+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66e400e070 con 0x7f66f8071f50 2024-04-12T13:43:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.466+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66e4009430 con 0x7f66f8071f50 2024-04-12T13:43:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.466+0000 7f66ff200700 1 -- 172.21.15.60:0/4173454913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f811df50 con 0x7f66f8071f50 2024-04-12T13:43:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.466+0000 7f66ff200700 1 -- 172.21.15.60:0/4173454913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f811e430 con 0x7f66f8071f50 2024-04-12T13:43:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.466+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66e401c400 con 0x7f66f8071f50 2024-04-12T13:43:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.467+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f805f5f0 con 0x7f66f8071f50 2024-04-12T13:43:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.469+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7f66e400bbf0 con 0x7f66f8071f50 2024-04-12T13:43:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.470+0000 7f66efe00700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 0x7f66dc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.470+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f66e408c1a0 con 0x7f66f8071f50 2024-04-12T13:43:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.471+0000 7f66f7e00700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 0x7f66dc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.472+0000 7f66f7e00700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 0x7f66dc06e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66e8006fd0 tx=0x7f66e8008040 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.475+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f66e4059460 con 0x7f66f8071f50 2024-04-12T13:43:04.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/3385704083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:43:04.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:04.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:04.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:43:04.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: Upgrade: Need to upgrade myself (mgr.smithi110.ezwdax) 2024-04-12T13:43:04.674 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:04 smithi060 ceph-mon[29097]: Upgrade: Need to upgrade myself (mgr.smithi110.ezwdax) 2024-04-12T13:43:04.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/3385704083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: Upgrade: Need to upgrade myself (mgr.smithi110.ezwdax) 2024-04-12T13:43:04.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:04 smithi110 ceph-mon[36055]: Upgrade: Need to upgrade myself (mgr.smithi110.ezwdax) 2024-04-12T13:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.827+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 --> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66f804bed0 con 0x7f66dc06bbe0 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:43:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/21 daemons upgraded", 2024-04-12T13:43:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mgr daemons", 2024-04-12T13:43:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:43:04.833 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:43:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.831+0000 7f66efe00700 1 -- 172.21.15.60:0/4173454913 <== mgr.24423 v2:172.21.15.110:6828/673177696 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f66f804bed0 con 0x7f66dc06bbe0 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 msgr2=0x7f66dc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 0x7f66dc06e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66e8006fd0 tx=0x7f66e8008040 comp rx=0 tx=0).stop 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 msgr2=0x7f66f811d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 shutdown_connections 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7f66dc06bbe0 0x7f66dc06e090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66f80709a0 0x7f66f811cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.834+0000 7f66ed600700 1 --2- 172.21.15.60:0/4173454913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8071f50 0x7f66f811d160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.835+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 >> 172.21.15.60:0/4173454913 conn(0x7f66f80f8530 msgr2=0x7f66f80f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.835+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 shutdown_connections 2024-04-12T13:43:04.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:04.835+0000 7f66ed600700 1 -- 172.21.15.60:0/4173454913 wait complete. 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 -- 172.21.15.60:0/1420808835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 msgr2=0x7fe64c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 --2- 172.21.15.60:0/1420808835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c070e10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe634004940 tx=0x7fe634009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 -- 172.21.15.60:0/1420808835 shutdown_connections 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 --2- 172.21.15.60:0/1420808835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c070e10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 --2- 172.21.15.60:0/1420808835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 0x7fe64c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 -- 172.21.15.60:0/1420808835 >> 172.21.15.60:0/1420808835 conn(0x7fe64c0f8530 msgr2=0x7fe64c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 -- 172.21.15.60:0/1420808835 shutdown_connections 2024-04-12T13:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.018+0000 7fe652e00700 1 -- 172.21.15.60:0/1420808835 wait complete. 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.019+0000 7fe652e00700 1 Processor -- start 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.019+0000 7fe652e00700 1 -- start start 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe652e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe652e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 0x7fe64c110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe652e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c110820 con 0x7fe64c0709a0 2024-04-12T13:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe652e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c110fa0 con 0x7fe64c071f50 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe64be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe64be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60066/0 (socket says 172.21.15.60:60066) 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.020+0000 7fe64be00700 1 -- 172.21.15.60:0/1701063636 learned_addr learned my addr 172.21.15.60:0/1701063636 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe643e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 0x7fe64c110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe64be00700 1 -- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 msgr2=0x7fe64c110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe64be00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 0x7fe64c110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe64be00700 1 -- 172.21.15.60:0/1701063636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634005040 con 0x7fe64c0709a0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe64be00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00b790 tx=0x7fe63c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe63c00f6f0 con 0x7fe64c0709a0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.021+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c111280 con 0x7fe64c0709a0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.022+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c111840 con 0x7fe64c0709a0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.022+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe63c00fd20 con 0x7fe64c0709a0 2024-04-12T13:43:05.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.022+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe63c0103a0 con 0x7fe64c0709a0 2024-04-12T13:43:05.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.023+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6280052e0 con 0x7fe64c0709a0 2024-04-12T13:43:05.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.024+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 89550+0+0 (secure 0 0 0) 0x7fe63c00f850 con 0x7fe64c0709a0 2024-04-12T13:43:05.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.026+0000 7fe648c00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 0x7fe63006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:05.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.026+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe63c08a4e0 con 0x7fe64c0709a0 2024-04-12T13:43:05.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.026+0000 7fe643e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 0x7fe63006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:05.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.028+0000 7fe643e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 0x7fe63006e090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe63400b970 tx=0x7fe634009e30 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:05.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.032+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fe63c057840 con 0x7fe64c0709a0 2024-04-12T13:43:05.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:05 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/247515342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:43:05.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:05 smithi060 ceph-mon[29097]: pgmap v57: 65 pgs: 65 active+clean; 476 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 13 KiB/s rd, 916 KiB/s wr, 113 op/s 2024-04-12T13:43:05.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:05 smithi060 ceph-mon[29097]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:05.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.504+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe628005590 con 0x7fe64c0709a0 2024-04-12T13:43:05.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.505+0000 7fe648c00700 1 -- 172.21.15.60:0/1701063636 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe63c0573d0 con 0x7fe64c0709a0 2024-04-12T13:43:05.506 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:43:05.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.509+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 msgr2=0x7fe63006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.509+0000 7fe652e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 0x7fe63006e090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe63400b970 tx=0x7fe634009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.509+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 msgr2=0x7fe64c10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.509+0000 7fe652e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00b790 tx=0x7fe63c009220 comp rx=0 tx=0).stop 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 shutdown_connections 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe63006bbe0 0x7fe63006e090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe64c0709a0 0x7fe64c10fc50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 --2- 172.21.15.60:0/1701063636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe64c071f50 0x7fe64c110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:05.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 >> 172.21.15.60:0/1701063636 conn(0x7fe64c0f8530 msgr2=0x7fe64c102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:05.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 shutdown_connections 2024-04-12T13:43:05.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:05.510+0000 7fe652e00700 1 -- 172.21.15.60:0/1701063636 wait complete. 2024-04-12T13:43:05.532 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:05 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/247515342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:43:05.533 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:05 smithi110 ceph-mon[36055]: pgmap v57: 65 pgs: 65 active+clean; 476 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 13 KiB/s rd, 916 KiB/s wr, 113 op/s 2024-04-12T13:43:05.533 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:05 smithi110 ceph-mon[36055]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:06.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:06 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1701063636' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:43:06.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:06 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1701063636' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:43:07.396 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:07 smithi060 ceph-mon[29097]: pgmap v58: 65 pgs: 65 active+clean; 476 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 13 KiB/s rd, 605 KiB/s wr, 88 op/s 2024-04-12T13:43:07.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:07 smithi110 ceph-mon[36055]: pgmap v58: 65 pgs: 65 active+clean; 476 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 13 KiB/s rd, 605 KiB/s wr, 88 op/s 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: Upgrade: Updating mgr.smithi060.bpzacg 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: pgmap v59: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 975 KiB/s wr, 186 op/s 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:43:09.782 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:09 smithi060 ceph-mon[29097]: Deploying daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:43:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: Upgrade: Updating mgr.smithi060.bpzacg 2024-04-12T13:43:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:09.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:43:09.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:43:09.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: pgmap v59: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 975 KiB/s wr, 186 op/s 2024-04-12T13:43:09.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:43:09.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:09 smithi110 ceph-mon[36055]: Deploying daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:43:11.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:11 smithi060 ceph-mon[29097]: pgmap v60: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 635 KiB/s wr, 141 op/s 2024-04-12T13:43:11.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:11 smithi110 ceph-mon[36055]: pgmap v60: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 635 KiB/s wr, 141 op/s 2024-04-12T13:43:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:13 smithi060 ceph-mon[29097]: pgmap v61: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-04-12T13:43:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:13 smithi110 ceph-mon[36055]: pgmap v61: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 220 op/s 2024-04-12T13:43:15.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:15 smithi060 ceph-mon[29097]: pgmap v62: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 769 KiB/s wr, 205 op/s 2024-04-12T13:43:15.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:15 smithi110 ceph-mon[36055]: pgmap v62: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 769 KiB/s wr, 205 op/s 2024-04-12T13:43:17.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:17 smithi060 ceph-mon[29097]: pgmap v63: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 769 KiB/s wr, 200 op/s 2024-04-12T13:43:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:17 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:17.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:17 smithi110 ceph-mon[36055]: pgmap v63: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 769 KiB/s wr, 200 op/s 2024-04-12T13:43:17.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:17 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:18.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:18 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:18 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:18 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:18 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:18 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:18 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:19.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:18 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:19.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:18 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:19.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:18 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:19.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:18 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:20.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:19 smithi060 ceph-mon[29097]: pgmap v64: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-04-12T13:43:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:19 smithi110 ceph-mon[36055]: pgmap v64: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-04-12T13:43:22.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:21 smithi060 ceph-mon[29097]: pgmap v65: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 785 KiB/s wr, 197 op/s 2024-04-12T13:43:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:21 smithi110 ceph-mon[36055]: pgmap v65: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 785 KiB/s wr, 197 op/s 2024-04-12T13:43:24.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:23 smithi060 ceph-mon[29097]: pgmap v66: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-12T13:43:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:23 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:23 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:23 smithi110 ceph-mon[36055]: pgmap v66: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-12T13:43:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:23 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:23 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:26.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:25 smithi060 ceph-mon[29097]: pgmap v67: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 857 KiB/s wr, 225 op/s 2024-04-12T13:43:26.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:25 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:26.027 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:25 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:25 smithi110 ceph-mon[36055]: pgmap v67: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 857 KiB/s wr, 225 op/s 2024-04-12T13:43:26.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:25 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:26.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:25 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:28.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:27 smithi060 ceph-mon[29097]: pgmap v68: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 856 KiB/s wr, 202 op/s 2024-04-12T13:43:28.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:27 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:28.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:27 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:27 smithi110 ceph-mon[36055]: pgmap v68: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 856 KiB/s wr, 202 op/s 2024-04-12T13:43:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:27 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:28.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:27 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:29 smithi060 ceph-mon[29097]: pgmap v69: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-12T13:43:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:29 smithi110 ceph-mon[36055]: pgmap v69: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: Standby manager daemon smithi060.bpzacg restarted 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: Standby manager daemon smithi060.bpzacg started 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/crt"}]: dispatch 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/key"}]: dispatch 2024-04-12T13:43:31.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:30 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:43:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: Standby manager daemon smithi060.bpzacg restarted 2024-04-12T13:43:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: Standby manager daemon smithi060.bpzacg started 2024-04-12T13:43:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/crt"}]: dispatch 2024-04-12T13:43:31.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:43:31.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.bpzacg/key"}]: dispatch 2024-04-12T13:43:31.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:30 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:43:32.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:31 smithi060 ceph-mon[29097]: pgmap v70: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 878 KiB/s wr, 227 op/s 2024-04-12T13:43:32.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:31 smithi060 ceph-mon[29097]: mgrmap e26: smithi110.ezwdax(active, since 2m), standbys: smithi060.bpzacg 2024-04-12T13:43:32.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:31 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:31 smithi110 ceph-mon[36055]: pgmap v70: 65 pgs: 65 active+clean; 291 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 878 KiB/s wr, 227 op/s 2024-04-12T13:43:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:31 smithi110 ceph-mon[36055]: mgrmap e26: smithi110.ezwdax(active, since 2m), standbys: smithi060.bpzacg 2024-04-12T13:43:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:31 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:33 smithi060 ceph-mon[29097]: pgmap v71: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 323 op/s 2024-04-12T13:43:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:33 smithi110 ceph-mon[36055]: pgmap v71: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 323 op/s 2024-04-12T13:43:35.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.730+0000 7fe07e400700 1 -- 172.21.15.60:0/2763541063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0781046d0 msgr2=0x7fe078104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.730+0000 7fe07e400700 1 --2- 172.21.15.60:0/2763541063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0781046d0 0x7fe078104b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe064004940 tx=0x7fe064009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 -- 172.21.15.60:0/2763541063 shutdown_connections 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 --2- 172.21.15.60:0/2763541063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0781046d0 0x7fe078104b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 --2- 172.21.15.60:0/2763541063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe078103420 0x7fe078103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 -- 172.21.15.60:0/2763541063 >> 172.21.15.60:0/2763541063 conn(0x7fe078072640 msgr2=0x7fe078074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 -- 172.21.15.60:0/2763541063 shutdown_connections 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.731+0000 7fe07e400700 1 -- 172.21.15.60:0/2763541063 wait complete. 2024-04-12T13:43:35.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.732+0000 7fe07e400700 1 Processor -- start 2024-04-12T13:43:35.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.732+0000 7fe07e400700 1 -- start start 2024-04-12T13:43:35.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe07e400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 0x7fe078113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:35.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe07e400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 0x7fe078114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:35.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe07e400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078114a40 con 0x7fe0781046d0 2024-04-12T13:43:35.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe07e400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078114bb0 con 0x7fe078103420 2024-04-12T13:43:35.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe077400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 0x7fe078113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:35.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe077400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 0x7fe078113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:58324/0 (socket says 172.21.15.60:58324) 2024-04-12T13:43:35.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.733+0000 7fe077400700 1 -- 172.21.15.60:0/4285649537 learned_addr learned my addr 172.21.15.60:0/4285649537 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:35.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.734+0000 7fe076a00700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 0x7fe078114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.735+0000 7fe076a00700 1 -- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 msgr2=0x7fe078113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.735+0000 7fe076a00700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 0x7fe078113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.735+0000 7fe076a00700 1 -- 172.21.15.60:0/4285649537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064005040 con 0x7fe0781046d0 2024-04-12T13:43:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.736+0000 7fe076a00700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 0x7fe078114440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe06400b970 tx=0x7fe064009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.737+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06400e040 con 0x7fe0781046d0 2024-04-12T13:43:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.737+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe064004290 con 0x7fe0781046d0 2024-04-12T13:43:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.737+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06401c630 con 0x7fe0781046d0 2024-04-12T13:43:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.737+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0781195b0 con 0x7fe0781046d0 2024-04-12T13:43:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.737+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe078119b70 con 0x7fe0781046d0 2024-04-12T13:43:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.739+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07804c710 con 0x7fe0781046d0 2024-04-12T13:43:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.741+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 92469+0+0 (secure 0 0 0) 0x7fe06400bbf0 con 0x7fe0781046d0 2024-04-12T13:43:35.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.744+0000 7fe06f400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 0x7fe05c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.744+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe06408ef20 con 0x7fe0781046d0 2024-04-12T13:43:35.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.747+0000 7fe077400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 0x7fe05c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.751+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fe06405c320 con 0x7fe0781046d0 2024-04-12T13:43:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.751+0000 7fe077400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 0x7fe05c070a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe068004b40 tx=0x7fe068007b40 comp rx=0 tx=0).ready entity=mgr.24423 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.864+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 27) v1 ==== 46089+0+0 (secure 0 0 0) 0x7fe064058bc0 con 0x7fe0781046d0 2024-04-12T13:43:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.864+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 msgr2=0x7fe05c070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:35.864+0000 7fe06f400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 0x7fe05c070a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe068004b40 tx=0x7fe068007b40 comp rx=0 tx=0).stop 2024-04-12T13:43:36.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: pgmap v72: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 917 KiB/s wr, 266 op/s 2024-04-12T13:43:36.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.020 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr fail", "who": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd='[{"prefix": "mgr fail", "who": "smithi110.ezwdax"}]': finished 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: mgrmap e27: smithi060.bpzacg(active, starting, since 0.0100285s) 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:43:36.021 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:43:36.022 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:35 smithi060 ceph-mon[29097]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:43:36.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: pgmap v72: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 917 KiB/s wr, 266 op/s 2024-04-12T13:43:36.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "mgr fail", "who": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.24423 172.21.15.110:0/775839493' entity='mgr.smithi110.ezwdax' cmd='[{"prefix": "mgr fail", "who": "smithi110.ezwdax"}]': finished 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: mgrmap e27: smithi060.bpzacg(active, starting, since 0.0100285s) 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:43:36.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:43:36.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:35 smithi110 ceph-mon[36055]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:43:36.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.871+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 28) v1 ==== 46510+0+0 (secure 0 0 0) 0x7fe0640731e0 con 0x7fe0781046d0 2024-04-12T13:43:36.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.872+0000 7fe06f400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 0x7fe05c036190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:36.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.872+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe05c032c50 con 0x7fe05c005ce0 2024-04-12T13:43:36.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.881+0000 7fe077400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 0x7fe05c036190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:36.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.883+0000 7fe077400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 0x7fe05c036190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe068004fd0 tx=0x7fe068007b40 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:36.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.886+0000 7fe06f400700 1 -- 172.21.15.60:0/4285649537 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe05c032c50 con 0x7fe05c005ce0 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 msgr2=0x7fe05c036190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 0x7fe05c036190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe068004fd0 tx=0x7fe068007b40 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 msgr2=0x7fe078114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 0x7fe078114440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe06400b970 tx=0x7fe064009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 shutdown_connections 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fe05c005ce0 0x7fe05c036190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:6828/673177696,v1:172.21.15.110:6829/673177696] conn(0x7fe05c06e5c0 0x7fe05c070a70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe078103420 0x7fe078113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 --2- 172.21.15.60:0/4285649537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0781046d0 0x7fe078114440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.891+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 >> 172.21.15.60:0/4285649537 conn(0x7fe078072640 msgr2=0x7fe078073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:36.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.892+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 shutdown_connections 2024-04-12T13:43:36.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:36.892+0000 7fe07e400700 1 -- 172.21.15.60:0/4285649537 wait complete. 2024-04-12T13:43:36.913 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 -- 172.21.15.60:0/1619043118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 msgr2=0x7f9e50070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 --2- 172.21.15.60:0/1619043118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50070350 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9e40004940 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 -- 172.21.15.60:0/1619043118 shutdown_connections 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 --2- 172.21.15.60:0/1619043118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 --2- 172.21.15.60:0/1619043118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50070350 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 -- 172.21.15.60:0/1619043118 >> 172.21.15.60:0/1619043118 conn(0x7f9e500f8540 msgr2=0x7f9e500fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 -- 172.21.15.60:0/1619043118 shutdown_connections 2024-04-12T13:43:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.077+0000 7f9e55c00700 1 -- 172.21.15.60:0/1619043118 wait complete. 2024-04-12T13:43:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.078+0000 7f9e55c00700 1 Processor -- start 2024-04-12T13:43:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.078+0000 7f9e55c00700 1 -- start start 2024-04-12T13:43:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e55c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e55c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50114b20 con 0x7f9e50071e50 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e55c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50115370 con 0x7f9e50070890 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e4ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e4e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e4ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:58416/0 (socket says 172.21.15.60:58416) 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.079+0000 7f9e4ea00700 1 -- 172.21.15.60:0/671798505 learned_addr learned my addr 172.21.15.60:0/671798505 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.080+0000 7f9e4e000700 1 -- 172.21.15.60:0/671798505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 msgr2=0x7f9e50113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.080+0000 7f9e4e000700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.080+0000 7f9e4e000700 1 -- 172.21.15.60:0/671798505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40005040 con 0x7f9e50071e50 2024-04-12T13:43:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.080+0000 7f9e4e000700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50114520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.081+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c004e90 con 0x7f9e50071e50 2024-04-12T13:43:37.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.081+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e3c00f040 con 0x7f9e50071e50 2024-04-12T13:43:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.081+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c00ca50 con 0x7f9e50071e50 2024-04-12T13:43:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.081+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e501155f0 con 0x7f9e50071e50 2024-04-12T13:43:37.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.081+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50115b30 con 0x7f9e50071e50 2024-04-12T13:43:37.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.083+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e501011d0 con 0x7f9e50071e50 2024-04-12T13:43:37.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.083+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 28) v1 ==== 46510+0+0 (secure 0 0 0) 0x7f9e3c007cc0 con 0x7f9e50071e50 2024-04-12T13:43:37.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.083+0000 7f9e46a00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 0x7f9e3403b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.084+0000 7f9e4ea00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 0x7f9e3403b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.084+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f9e3c010220 con 0x7f9e50071e50 2024-04-12T13:43:37.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.085+0000 7f9e4ea00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 0x7f9e3403b8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b0d0 tx=0x7f9e40009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:37.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.098+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f9e3c00cbb0 con 0x7f9e50071e50 2024-04-12T13:43:37.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:43:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:43:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:43:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:36 smithi060 ceph-mon[29097]: mgrmap e28: smithi060.bpzacg(active, since 1.01477s) 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:43:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:36 smithi110 ceph-mon[36055]: mgrmap e28: smithi060.bpzacg(active, since 1.01477s) 2024-04-12T13:43:37.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.430+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e50115da0 con 0x7f9e340393f0 2024-04-12T13:43:37.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.432+0000 7f9e46a00700 1 -- 172.21.15.60:0/671798505 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9e50115da0 con 0x7f9e340393f0 2024-04-12T13:43:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 msgr2=0x7f9e3403b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 0x7f9e3403b8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000b0d0 tx=0x7f9e40009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 msgr2=0x7f9e50114520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50114520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00b040 comp rx=0 tx=0).stop 2024-04-12T13:43:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 shutdown_connections 2024-04-12T13:43:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f9e340393f0 0x7f9e3403b8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e50070890 0x7f9e50113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 --2- 172.21.15.60:0/671798505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e50071e50 0x7f9e50114520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.435+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 >> 172.21.15.60:0/671798505 conn(0x7f9e500f8540 msgr2=0x7f9e500f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:37.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.436+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 shutdown_connections 2024-04-12T13:43:37.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.436+0000 7f9e55c00700 1 -- 172.21.15.60:0/671798505 wait complete. 2024-04-12T13:43:37.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1957020419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540709a0 msgr2=0x7f7a54070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1957020419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540709a0 0x7f7a54070e10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c004ba0 tx=0x7f7a4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:37.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1957020419 shutdown_connections 2024-04-12T13:43:37.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1957020419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a540709a0 0x7f7a54070e10 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c004ba0 tx=0x7f7a4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:37.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1957020419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a54071f50 0x7f7a54070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.654+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1957020419 >> 172.21.15.60:0/1957020419 conn(0x7f7a540f8530 msgr2=0x7f7a540fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:37.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.655+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1957020419 shutdown_connections 2024-04-12T13:43:37.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.655+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1957020419 wait complete. 2024-04-12T13:43:37.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.656+0000 7f7a5ae00700 1 Processor -- start 2024-04-12T13:43:37.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.656+0000 7f7a5ae00700 1 -- start start 2024-04-12T13:43:37.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.657+0000 7f7a5ae00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.657+0000 7f7a5ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a5410be20 0x7f7a5410ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.658+0000 7f7a5ae00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5410c2e0 con 0x7f7a54071f50 2024-04-12T13:43:37.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.658+0000 7f7a5ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5410c450 con 0x7f7a5410be20 2024-04-12T13:43:37.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.658+0000 7f7a53e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.658+0000 7f7a53e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37630/0 (socket says 172.21.15.60:37630) 2024-04-12T13:43:37.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.658+0000 7f7a53e00700 1 -- 172.21.15.60:0/1422234229 learned_addr learned my addr 172.21.15.60:0/1422234229 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:37.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.659+0000 7f7a53400700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a5410be20 0x7f7a5410ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.659+0000 7f7a53e00700 1 -- 172.21.15.60:0/1422234229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a5410be20 msgr2=0x7f7a5410ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:37.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.659+0000 7f7a53e00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a5410be20 0x7f7a5410ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:37.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.659+0000 7f7a53e00700 1 -- 172.21.15.60:0/1422234229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c005040 con 0x7f7a54071f50 2024-04-12T13:43:37.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.660+0000 7f7a53e00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c001ce0 tx=0x7f7a3c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.662+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3c007b30 con 0x7f7a54071f50 2024-04-12T13:43:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.662+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a3c00f040 con 0x7f7a54071f50 2024-04-12T13:43:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.662+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3c0096d0 con 0x7f7a54071f50 2024-04-12T13:43:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.662+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5410d320 con 0x7f7a54071f50 2024-04-12T13:43:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.663+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5410d860 con 0x7f7a54071f50 2024-04-12T13:43:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.664+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 28) v1 ==== 46510+0+0 (secure 0 0 0) 0x7f7a3c007c90 con 0x7f7a54071f50 2024-04-12T13:43:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.665+0000 7f7a4be00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 0x7f7a3403b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.665+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a540fe010 con 0x7f7a54071f50 2024-04-12T13:43:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.666+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f7a3c04cc30 con 0x7f7a54071f50 2024-04-12T13:43:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.667+0000 7f7a53400700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 0x7f7a3403b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.670+0000 7f7a53400700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 0x7f7a3403b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c000c00 tx=0x7f7a4c009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:37.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:37.685+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f7a3c01c3b0 con 0x7f7a54071f50 2024-04-12T13:43:38.028 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:37 smithi110 ceph-mon[36055]: [12/Apr/2024:13:43:37] ENGINE Bus STARTING 2024-04-12T13:43:38.028 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:37 smithi110 ceph-mon[36055]: [12/Apr/2024:13:43:37] ENGINE Serving on http://172.21.15.60:8765 2024-04-12T13:43:38.028 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:37 smithi110 ceph-mon[36055]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:43:38.028 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:37 smithi110 ceph-mon[36055]: Cluster is now healthy 2024-04-12T13:43:38.063 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:37 smithi060 ceph-mon[29097]: [12/Apr/2024:13:43:37] ENGINE Bus STARTING 2024-04-12T13:43:38.064 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:37 smithi060 ceph-mon[29097]: [12/Apr/2024:13:43:37] ENGINE Serving on http://172.21.15.60:8765 2024-04-12T13:43:38.064 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:37 smithi060 ceph-mon[29097]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:43:38.064 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:37 smithi060 ceph-mon[29097]: Cluster is now healthy 2024-04-12T13:43:38.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.087+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5405e400 con 0x7f7a34039430 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.103+0000 7f7a4be00700 1 -- 172.21.15.60:0/1422234229 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7a5405e400 con 0x7f7a34039430 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (88s) 12s ago 12m 14.9M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (12m) 12s ago 12m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (11m) 14s ago 11m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 unknown 12s ago 12m - - 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (5m) 12s ago 5m 12.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (5m) 12s ago 5m 210M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:43:38.106 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (5m) 14s ago 5m 12.4M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (5m) 14s ago 5m 12.5M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (20s) 12s ago 14m 63.7M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (2m) 14s ago 11m 506M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (14m) 12s ago 14m 50.7M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (11m) 14s ago 11m 40.1M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (114s) 12s ago 12m 7721k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (34s) 14s ago 11m 7071k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (10m) 12s ago 10m 195M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (9m) 12s ago 9m 207M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (8m) 12s ago 8m 177M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (8m) 14s ago 8m 242M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (7m) 14s ago 7m 220M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (7m) 14s ago 7m 192M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:43:38.107 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (44s) 12s ago 11m 42.1M - 2.43.0 a07b618ecd1d af71ee9fad28 2024-04-12T13:43:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 msgr2=0x7f7a3403b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 0x7f7a3403b8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c000c00 tx=0x7f7a4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 msgr2=0x7f7a5410b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c001ce0 tx=0x7f7a3c009e60 comp rx=0 tx=0).stop 2024-04-12T13:43:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 shutdown_connections 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f7a34039430 0x7f7a3403b8e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a54071f50 0x7f7a5410b8e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 --2- 172.21.15.60:0/1422234229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a5410be20 0x7f7a5410ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 >> 172.21.15.60:0/1422234229 conn(0x7f7a540f8530 msgr2=0x7f7a540f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 shutdown_connections 2024-04-12T13:43:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.107+0000 7f7a5ae00700 1 -- 172.21.15.60:0/1422234229 wait complete. 2024-04-12T13:43:38.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 -- 172.21.15.60:0/89415955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 msgr2=0x7fd6381047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 --2- 172.21.15.60:0/89415955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd6381047b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd624004940 tx=0x7fd624009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:38.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 -- 172.21.15.60:0/89415955 shutdown_connections 2024-04-12T13:43:38.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 --2- 172.21.15.60:0/89415955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd6381047b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 --2- 172.21.15.60:0/89415955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 0x7fd638101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.286+0000 7fd63d800700 1 -- 172.21.15.60:0/89415955 >> 172.21.15.60:0/89415955 conn(0x7fd6380f74c0 msgr2=0x7fd6380f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:38.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.287+0000 7fd63d800700 1 -- 172.21.15.60:0/89415955 shutdown_connections 2024-04-12T13:43:38.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.287+0000 7fd63d800700 1 -- 172.21.15.60:0/89415955 wait complete. 2024-04-12T13:43:38.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 Processor -- start 2024-04-12T13:43:38.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 -- start start 2024-04-12T13:43:38.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 0x7fd638114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd638114b70 con 0x7fd6381023d0 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.288+0000 7fd63d800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381153c0 con 0x7fd638066290 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37660/0 (socket says 172.21.15.60:37660) 2024-04-12T13:43:38.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 -- 172.21.15.60:0/2095817229 learned_addr learned my addr 172.21.15.60:0/2095817229 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636a00700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 0x7fd638114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 -- 172.21.15.60:0/2095817229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 msgr2=0x7fd638114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 0x7fd638114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.289+0000 7fd636000700 1 -- 172.21.15.60:0/2095817229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624005040 con 0x7fd6381023d0 2024-04-12T13:43:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd636000700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b3b0 tx=0x7fd624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:38.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62400e040 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd624004290 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62401c3f0 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd638115640 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.290+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd638115b80 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.292+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63805f5f0 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.292+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 28) v1 ==== 46510+0+0 (secure 0 0 0) 0x7fd62400bbf0 con 0x7fd6381023d0 2024-04-12T13:43:38.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.293+0000 7fd62ea00700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 0x7fd61c03b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:38.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.293+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd62404e590 con 0x7fd6381023d0 2024-04-12T13:43:38.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.293+0000 7fd636a00700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 0x7fd61c03b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:38.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.294+0000 7fd636a00700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 0x7fd61c03b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd638065fd0 tx=0x7fd62800b040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.299+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fd624023300 con 0x7fd6381023d0 2024-04-12T13:43:38.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.785+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd6381157d0 con 0x7fd6381023d0 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:43:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 12, 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:43:38.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.788+0000 7fd62ea00700 1 -- 172.21.15.60:0/2095817229 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fd6381157d0 con 0x7fd6381023d0 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 msgr2=0x7fd61c03b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 0x7fd61c03b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd638065fd0 tx=0x7fd62800b040 comp rx=0 tx=0).stop 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 msgr2=0x7fd638114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b3b0 tx=0x7fd624009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 shutdown_connections 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd61c0393e0 0x7fd61c03b890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd638066290 0x7fd638114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 --2- 172.21.15.60:0/2095817229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6381023d0 0x7fd638114570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:38.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.792+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 >> 172.21.15.60:0/2095817229 conn(0x7fd6380f74c0 msgr2=0x7fd6380f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:38.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.793+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 shutdown_connections 2024-04-12T13:43:38.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:38.793+0000 7fd63d800700 1 -- 172.21.15.60:0/2095817229 wait complete. 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.009+0000 7fd067a00700 1 -- 172.21.15.60:0/2168544717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fe0e0 msgr2=0x7fd0600fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.009+0000 7fd067a00700 1 --2- 172.21.15.60:0/2168544717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fe0e0 0x7fd0600fe550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd04c004940 tx=0x7fd04c009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 -- 172.21.15.60:0/2168544717 shutdown_connections 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 --2- 172.21.15.60:0/2168544717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fe0e0 0x7fd0600fe550 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 --2- 172.21.15.60:0/2168544717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fcef0 0x7fd0600fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 -- 172.21.15.60:0/2168544717 >> 172.21.15.60:0/2168544717 conn(0x7fd0600f8530 msgr2=0x7fd0600fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:39.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 -- 172.21.15.60:0/2168544717 shutdown_connections 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 -- 172.21.15.60:0/2168544717 wait complete. 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.010+0000 7fd067a00700 1 Processor -- start 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd067a00700 1 -- start start 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd067a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 0x7fd06010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd067a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 0x7fd060110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd067a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060110730 con 0x7fd0600fcef0 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd067a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060110f80 con 0x7fd0600fe0e0 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd065000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 0x7fd06010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.011+0000 7fd05fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 0x7fd060110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd065000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 0x7fd06010fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37668/0 (socket says 172.21.15.60:37668) 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd065000700 1 -- 172.21.15.60:0/2205613734 learned_addr learned my addr 172.21.15.60:0/2205613734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:39.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd05fe00700 1 -- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 msgr2=0x7fd06010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd05fe00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 0x7fd06010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd05fe00700 1 -- 172.21.15.60:0/2205613734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c005040 con 0x7fd0600fe0e0 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.012+0000 7fd05fe00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 0x7fd060110130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009fd0 tx=0x7fd04c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.013+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04c00e070 con 0x7fd0600fe0e0 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.013+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd060111200 con 0x7fd0600fe0e0 2024-04-12T13:43:39.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.013+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd04c01c400 con 0x7fd0600fe0e0 2024-04-12T13:43:39.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.013+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04c00b650 con 0x7fd0600fe0e0 2024-04-12T13:43:39.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.013+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0601116e0 con 0x7fd0600fe0e0 2024-04-12T13:43:39.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.014+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd060101a70 con 0x7fd0600fe0e0 2024-04-12T13:43:39.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.014+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 29) v1 ==== 46566+0+0 (secure 0 0 0) 0x7fd04c013af0 con 0x7fd0600fe0e0 2024-04-12T13:43:39.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.015+0000 7fd05cc00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 0x7fd04803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.015+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd04c04ea50 con 0x7fd0600fe0e0 2024-04-12T13:43:39.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.015+0000 7fd065000700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 0x7fd04803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:39.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.016+0000 7fd065000700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 0x7fd04803b930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd054004ba0 tx=0x7fd05400b040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:39.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.022+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fd04c026460 con 0x7fd0600fe0e0 2024-04-12T13:43:39.060 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:38 smithi110 ceph-mon[36055]: [12/Apr/2024:13:43:37] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:43:39.061 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:38 smithi110 ceph-mon[36055]: [12/Apr/2024:13:43:37] ENGINE Bus STARTED 2024-04-12T13:43:39.061 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:38 smithi110 ceph-mon[36055]: pgmap v4: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:43:39.061 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:38 smithi110 ceph-mon[36055]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:39.061 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:38 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2095817229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:43:39.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:38 smithi060 ceph-mon[29097]: [12/Apr/2024:13:43:37] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:43:39.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:38 smithi060 ceph-mon[29097]: [12/Apr/2024:13:43:37] ENGINE Bus STARTED 2024-04-12T13:43:39.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:38 smithi060 ceph-mon[29097]: pgmap v4: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:43:39.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:38 smithi060 ceph-mon[29097]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:39.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:38 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2095817229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:43:39.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.385+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd06005f5f0 con 0x7fd0600fe0e0 2024-04-12T13:43:39.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.385+0000 7fd05cc00700 1 -- 172.21.15.60:0/2205613734 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7fd04c011370 con 0x7fd0600fe0e0 2024-04-12T13:43:39.388 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:43:39.389 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:43:39.390 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:39.391 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 msgr2=0x7fd04803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 0x7fd04803b930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd054004ba0 tx=0x7fd05400b040 comp rx=0 tx=0).stop 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 msgr2=0x7fd060110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 0x7fd060110130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009fd0 tx=0x7fd04c009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 shutdown_connections 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd048039480 0x7fd04803b930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0600fcef0 0x7fd06010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 --2- 172.21.15.60:0/2205613734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0600fe0e0 0x7fd060110130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.389+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 >> 172.21.15.60:0/2205613734 conn(0x7fd0600f8530 msgr2=0x7fd0600f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:39.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.390+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 shutdown_connections 2024-04-12T13:43:39.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.390+0000 7fd067a00700 1 -- 172.21.15.60:0/2205613734 wait complete. 2024-04-12T13:43:39.394 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 -- 172.21.15.60:0/3285586782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 msgr2=0x7fec4c104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 --2- 172.21.15.60:0/3285586782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 0x7fec4c104b20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec38004940 tx=0x7fec38009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 -- 172.21.15.60:0/3285586782 shutdown_connections 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 --2- 172.21.15.60:0/3285586782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 0x7fec4c104b20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 --2- 172.21.15.60:0/3285586782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.566+0000 7fec54000700 1 -- 172.21.15.60:0/3285586782 >> 172.21.15.60:0/3285586782 conn(0x7fec4c0725e0 msgr2=0x7fec4c074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.567+0000 7fec54000700 1 -- 172.21.15.60:0/3285586782 shutdown_connections 2024-04-12T13:43:39.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.567+0000 7fec54000700 1 -- 172.21.15.60:0/3285586782 wait complete. 2024-04-12T13:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 Processor -- start 2024-04-12T13:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 -- start start 2024-04-12T13:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 0x7fec4c114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c114a50 con 0x7fec4c1046b0 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.568+0000 7fec54000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c114bc0 con 0x7fec4c103400 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.569+0000 7fec51600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.569+0000 7fec51600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:34396/0 (socket says 172.21.15.60:34396) 2024-04-12T13:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.569+0000 7fec51600700 1 -- 172.21.15.60:0/2030635909 learned_addr learned my addr 172.21.15.60:0/2030635909 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.570+0000 7fec51600700 1 -- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 msgr2=0x7fec4c114450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.570+0000 7fec51600700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 0x7fec4c114450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:39.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.570+0000 7fec51600700 1 -- 172.21.15.60:0/2030635909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38005040 con 0x7fec4c103400 2024-04-12T13:43:39.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.570+0000 7fec51600700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c8c0 tx=0x7fec400044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:39.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.571+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4000a980 con 0x7fec4c103400 2024-04-12T13:43:39.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.572+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec4000ce60 con 0x7fec4c103400 2024-04-12T13:43:39.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.572+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec400115e0 con 0x7fec4c103400 2024-04-12T13:43:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.572+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c119620 con 0x7fec4c103400 2024-04-12T13:43:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.572+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c119b90 con 0x7fec4c103400 2024-04-12T13:43:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.573+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c04c710 con 0x7fec4c103400 2024-04-12T13:43:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.574+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 29) v1 ==== 46566+0+0 (secure 0 0 0) 0x7fec40012400 con 0x7fec4c103400 2024-04-12T13:43:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.574+0000 7fec49600700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 0x7fec3403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.574+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fec4004d390 con 0x7fec4c103400 2024-04-12T13:43:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.575+0000 7fec50c00700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 0x7fec3403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.575+0000 7fec50c00700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 0x7fec3403b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b970 tx=0x7fec38009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:39.590+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fec40012870 con 0x7fec4c103400 2024-04-12T13:43:40.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.008+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec4c108990 con 0x7fec34039480 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:43:40.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:43:40.016 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/21 daemons upgraded", 2024-04-12T13:43:40.016 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:43:40.016 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:43:40.016 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:43:40.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.012+0000 7fec49600700 1 -- 172.21.15.60:0/2030635909 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fec4c108990 con 0x7fec34039480 2024-04-12T13:43:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 msgr2=0x7fec3403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 0x7fec3403b930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec3800b970 tx=0x7fec38009e30 comp rx=0 tx=0).stop 2024-04-12T13:43:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 msgr2=0x7fec4c113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c8c0 tx=0x7fec400044c0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 shutdown_connections 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fec34039480 0x7fec3403b930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c103400 0x7fec4c113f10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.017+0000 7fec54000700 1 --2- 172.21.15.60:0/2030635909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec4c1046b0 0x7fec4c114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.018+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 >> 172.21.15.60:0/2030635909 conn(0x7fec4c0725e0 msgr2=0x7fec4c073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.018+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 shutdown_connections 2024-04-12T13:43:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.018+0000 7fec54000700 1 -- 172.21.15.60:0/2030635909 wait complete. 2024-04-12T13:43:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:39 smithi110 ceph-mon[36055]: mgrmap e29: smithi060.bpzacg(active, since 3s) 2024-04-12T13:43:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:39 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2205613734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:43:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.268+0000 7f672b600700 1 -- 172.21.15.60:0/1126742039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 msgr2=0x7f67240ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.268+0000 7f672b600700 1 --2- 172.21.15.60:0/1126742039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f67240ff430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6718009ce0 tx=0x7f6718004d10 comp rx=0 tx=0).stop 2024-04-12T13:43:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.269+0000 7f672b600700 1 -- 172.21.15.60:0/1126742039 shutdown_connections 2024-04-12T13:43:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.269+0000 7f672b600700 1 --2- 172.21.15.60:0/1126742039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f6724100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.269+0000 7f672b600700 1 --2- 172.21.15.60:0/1126742039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f67240ff430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.269+0000 7f672b600700 1 -- 172.21.15.60:0/1126742039 >> 172.21.15.60:0/1126742039 conn(0x7f67240fa950 msgr2=0x7f67240fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:40.272 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:39 smithi060 ceph-mon[29097]: mgrmap e29: smithi060.bpzacg(active, since 3s) 2024-04-12T13:43:40.272 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:39 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2205613734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:43:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.270+0000 7f672b600700 1 -- 172.21.15.60:0/1126742039 shutdown_connections 2024-04-12T13:43:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.270+0000 7f672b600700 1 -- 172.21.15.60:0/1126742039 wait complete. 2024-04-12T13:43:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.271+0000 7f672b600700 1 Processor -- start 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.271+0000 7f672b600700 1 -- start start 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f672b600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f672410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f672b600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f67241100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f672b600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724110760 con 0x7f67240ff020 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f672b600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724115100 con 0x7f67241002d0 2024-04-12T13:43:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f6723e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f67241100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f6723e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f67241100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:34422/0 (socket says 172.21.15.60:34422) 2024-04-12T13:43:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.272+0000 7f6723e00700 1 -- 172.21.15.60:0/1355614274 learned_addr learned my addr 172.21.15.60:0/1355614274 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:43:40.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.274+0000 7f6728c00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f672410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.274+0000 7f6728c00700 1 -- 172.21.15.60:0/1355614274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 msgr2=0x7f67241100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.274+0000 7f6728c00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f67241100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.274+0000 7f6728c00700 1 -- 172.21.15.60:0/1355614274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009940 con 0x7f67240ff020 2024-04-12T13:43:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.276+0000 7f6728c00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f672410fb90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6718004a30 tx=0x7f6718004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.276+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f671800e050 con 0x7f67240ff020 2024-04-12T13:43:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.276+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f671801d910 con 0x7f67240ff020 2024-04-12T13:43:40.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.276+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67180128c0 con 0x7f67240ff020 2024-04-12T13:43:40.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.277+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724067aa0 con 0x7f67240ff020 2024-04-12T13:43:40.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.277+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6724068010 con 0x7f67240ff020 2024-04-12T13:43:40.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.279+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672404c710 con 0x7f67240ff020 2024-04-12T13:43:40.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.280+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 29) v1 ==== 46566+0+0 (secure 0 0 0) 0x7f6718019040 con 0x7f67240ff020 2024-04-12T13:43:40.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.281+0000 7f6720c00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 0x7f670c03b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:43:40.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.281+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f671801ac20 con 0x7f67240ff020 2024-04-12T13:43:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.283+0000 7f6723e00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 0x7f670c03b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:43:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.285+0000 7f6723e00700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 0x7f670c03b970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6710009b30 tx=0x7f6710008040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:43:40.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.293+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f6718012a20 con 0x7f67240ff020 2024-04-12T13:43:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.737+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f67240681a0 con 0x7f67240ff020 2024-04-12T13:43:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.738+0000 7f6720c00700 1 -- 172.21.15.60:0/1355614274 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6718017070 con 0x7f67240ff020 2024-04-12T13:43:40.741 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:43:40.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 msgr2=0x7f670c03b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 0x7f670c03b970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6710009b30 tx=0x7f6710008040 comp rx=0 tx=0).stop 2024-04-12T13:43:40.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 msgr2=0x7f672410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:43:40.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f672410fb90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6718004a30 tx=0x7f6718004d10 comp rx=0 tx=0).stop 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 shutdown_connections 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f670c0394c0 0x7f670c03b970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67240ff020 0x7f672410fb90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 --2- 172.21.15.60:0/1355614274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67241002d0 0x7f67241100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 >> 172.21.15.60:0/1355614274 conn(0x7f67240fa950 msgr2=0x7f67240fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 shutdown_connections 2024-04-12T13:43:40.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:43:40.741+0000 7f672b600700 1 -- 172.21.15.60:0/1355614274 wait complete. 2024-04-12T13:43:41.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:40 smithi060 ceph-mon[29097]: pgmap v5: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:43:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:40 smithi060 ceph-mon[29097]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:40 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/1355614274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:43:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:40 smithi110 ceph-mon[36055]: pgmap v5: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:43:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:40 smithi110 ceph-mon[36055]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:43:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:40 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1355614274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:43:42.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:42 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:42.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:42 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:42.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:42 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:42.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:42 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:43 smithi060 ceph-mon[29097]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69 KiB/s rd, 370 KiB/s wr, 569 op/s 2024-04-12T13:43:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:43 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:43 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:43 smithi110 ceph-mon[36055]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 69 KiB/s rd, 370 KiB/s wr, 569 op/s 2024-04-12T13:43:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:43 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:43 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:45.354 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:45 smithi110 ceph-mon[36055]: pgmap v7: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 860 KiB/s wr, 608 op/s 2024-04-12T13:43:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:45 smithi060 ceph-mon[29097]: pgmap v7: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 860 KiB/s wr, 608 op/s 2024-04-12T13:43:47.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: pgmap v8: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 669 KiB/s wr, 473 op/s 2024-04-12T13:43:47.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:43:47.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:43:47.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:43:47.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:43:47.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:47 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:43:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: pgmap v8: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 669 KiB/s wr, 473 op/s 2024-04-12T13:43:47.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:43:47.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:43:47.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:43:47.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:43:47.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:47 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/3453580294' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:43:48.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:48 smithi060 ceph-mon[29097]: mgrmap e30: smithi060.bpzacg(active, since 11s), standbys: smithi110.ezwdax 2024-04-12T13:43:48.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:48 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:43:48.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:48 smithi110 ceph-mon[36055]: mgrmap e30: smithi060.bpzacg(active, since 11s), standbys: smithi110.ezwdax 2024-04-12T13:43:48.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:48 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:43:49.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:49 smithi060 ceph-mon[29097]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 980 KiB/s wr, 788 op/s 2024-04-12T13:43:49.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:49 smithi110 ceph-mon[36055]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 980 KiB/s wr, 788 op/s 2024-04-12T13:43:51.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:51 smithi060 ceph-mon[29097]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 898 KiB/s wr, 722 op/s 2024-04-12T13:43:51.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:51 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:51 smithi110 ceph-mon[36055]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 898 KiB/s wr, 722 op/s 2024-04-12T13:43:51.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:51 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:43:53.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:53 smithi060 ceph-mon[29097]: pgmap v11: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.2 MiB/s wr, 823 op/s 2024-04-12T13:43:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:53 smithi110 ceph-mon[36055]: pgmap v11: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.2 MiB/s wr, 823 op/s 2024-04-12T13:43:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:55 smithi110 ceph-mon[36055]: pgmap v12: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 630 op/s 2024-04-12T13:43:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:55 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:55 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:55.927 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:55 smithi060 ceph-mon[29097]: pgmap v12: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 630 op/s 2024-04-12T13:43:55.927 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:55 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:55.927 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:55 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:57.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:57 smithi060 ceph-mon[29097]: pgmap v13: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 815 KiB/s wr, 512 op/s 2024-04-12T13:43:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:57 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:57 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:57 smithi110 ceph-mon[36055]: pgmap v13: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 815 KiB/s wr, 512 op/s 2024-04-12T13:43:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:57 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:57 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:43:59.641 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:43:59 smithi060 ceph-mon[29097]: pgmap v14: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 686 op/s 2024-04-12T13:43:59.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:43:59 smithi110 ceph-mon[36055]: pgmap v14: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 686 op/s 2024-04-12T13:44:01.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:01 smithi060 ceph-mon[29097]: pgmap v15: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 860 KiB/s wr, 318 op/s 2024-04-12T13:44:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:01 smithi110 ceph-mon[36055]: pgmap v15: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 860 KiB/s wr, 318 op/s 2024-04-12T13:44:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:03 smithi060 ceph-mon[29097]: pgmap v16: 65 pgs: 65 active+clean; 261 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 408 op/s 2024-04-12T13:44:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:03 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:03 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:03 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:03 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:44:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:03 smithi110 ceph-mon[36055]: pgmap v16: 65 pgs: 65 active+clean; 261 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 408 op/s 2024-04-12T13:44:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:44:04.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:04 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:44:04.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:04 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:44:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:04 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:44:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:04 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:44:05.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:05 smithi060 ceph-mon[29097]: pgmap v17: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 910 KiB/s wr, 342 op/s 2024-04-12T13:44:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:05 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:44:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:05 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:44:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:05 smithi110 ceph-mon[36055]: pgmap v17: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 910 KiB/s wr, 342 op/s 2024-04-12T13:44:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:05 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:44:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:05 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:06 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:44:06.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:06.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:06 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:07.897 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:07 smithi060 ceph-mon[29097]: pgmap v18: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 860 KiB/s wr, 298 op/s 2024-04-12T13:44:07.898 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:07 smithi060 ceph-mon[29097]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 981 KiB/s wr, 340 op/s 2024-04-12T13:44:07.898 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:07 smithi060 ceph-mon[29097]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:44:07.898 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:07 smithi060 ceph-mon[29097]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:44:07.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:07 smithi110 ceph-mon[36055]: pgmap v18: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 860 KiB/s wr, 298 op/s 2024-04-12T13:44:07.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:07 smithi110 ceph-mon[36055]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 981 KiB/s wr, 340 op/s 2024-04-12T13:44:07.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:07 smithi110 ceph-mon[36055]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:44:07.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:07 smithi110 ceph-mon[36055]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-04-12T13:44:08.911 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:08 smithi060 ceph-mon[29097]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:44:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:08 smithi110 ceph-mon[36055]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-04-12T13:44:09.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:09 smithi060 ceph-mon[29097]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 934 KiB/s wr, 280 op/s 2024-04-12T13:44:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:09 smithi110 ceph-mon[36055]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 934 KiB/s wr, 280 op/s 2024-04-12T13:44:10.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 -- 172.21.15.60:0/1563870294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c0ff000 msgr2=0x7f6c0c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:10.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 --2- 172.21.15.60:0/1563870294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c0ff410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc004940 tx=0x7f6bfc009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 -- 172.21.15.60:0/1563870294 shutdown_connections 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 --2- 172.21.15.60:0/1563870294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 --2- 172.21.15.60:0/1563870294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c0ff410 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 -- 172.21.15.60:0/1563870294 >> 172.21.15.60:0/1563870294 conn(0x7f6c0c0fa950 msgr2=0x7f6c0c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 -- 172.21.15.60:0/1563870294 shutdown_connections 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.950+0000 7f6c10c00700 1 -- 172.21.15.60:0/1563870294 wait complete. 2024-04-12T13:44:10.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.951+0000 7f6c10c00700 1 Processor -- start 2024-04-12T13:44:10.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c10c00700 1 -- start start 2024-04-12T13:44:10.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c10c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:10.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c10c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:10.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c10c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c110770 con 0x7f6c0c1002b0 2024-04-12T13:44:10.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c10c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c110fc0 con 0x7f6c0c0ff000 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c09400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.952+0000 7f6c09400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58362/0 (socket says 172.21.15.60:58362) 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09400700 1 -- 172.21.15.60:0/2319011937 learned_addr learned my addr 172.21.15.60:0/2319011937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09e00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09400700 1 -- 172.21.15.60:0/2319011937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c0ff000 msgr2=0x7f6c0c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:10.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09400700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09400700 1 -- 172.21.15.60:0/2319011937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc005040 con 0x7f6c0c1002b0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.953+0000 7f6c09400700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c8c0 tx=0x7f6bf80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.954+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf800a980 con 0x7f6c0c1002b0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.954+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bf800ce60 con 0x7f6c0c1002b0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.954+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf80115e0 con 0x7f6c0c1002b0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.954+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c1112a0 con 0x7f6c0c1002b0 2024-04-12T13:44:10.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.954+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c1117e0 con 0x7f6c0c1002b0 2024-04-12T13:44:10.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.956+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c05f5f0 con 0x7f6c0c1002b0 2024-04-12T13:44:10.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.958+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f6bf8012400 con 0x7f6c0c1002b0 2024-04-12T13:44:10.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.959+0000 7f6c02000700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 0x7f6bf0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:10.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.960+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f6bf808e0a0 con 0x7f6c0c1002b0 2024-04-12T13:44:10.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.960+0000 7f6c09e00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 0x7f6bf0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:10.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.961+0000 7f6c09e00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 0x7f6bf0070ba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc004f90 tx=0x7f6bfc009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:10.966+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f6bf805b1d0 con 0x7f6c0c1002b0 2024-04-12T13:44:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.346+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c0c111c30 con 0x7f6bf006e6f0 2024-04-12T13:44:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.348+0000 7f6c02000700 1 -- 172.21.15.60:0/2319011937 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f6c0c111c30 con 0x7f6bf006e6f0 2024-04-12T13:44:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 msgr2=0x7f6bf0070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 0x7f6bf0070ba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc004f90 tx=0x7f6bfc009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 msgr2=0x7f6c0c110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c8c0 tx=0x7f6bf80044c0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 shutdown_connections 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bf006e6f0 0x7f6bf0070ba0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c0c0ff000 0x7f6c0c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 --2- 172.21.15.60:0/2319011937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c0c1002b0 0x7f6c0c110170 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 >> 172.21.15.60:0/2319011937 conn(0x7f6c0c0fa950 msgr2=0x7f6c0c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 shutdown_connections 2024-04-12T13:44:11.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.352+0000 7f6c10c00700 1 -- 172.21.15.60:0/2319011937 wait complete. 2024-04-12T13:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:44:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 -- 172.21.15.60:0/3737946453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fcef0 msgr2=0x7f38fc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 --2- 172.21.15.60:0/3737946453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fcef0 0x7f38fc0fd320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f38f0004940 tx=0x7f38f0009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 -- 172.21.15.60:0/3737946453 shutdown_connections 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 --2- 172.21.15.60:0/3737946453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 --2- 172.21.15.60:0/3737946453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fcef0 0x7f38fc0fd320 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 -- 172.21.15.60:0/3737946453 >> 172.21.15.60:0/3737946453 conn(0x7f38fc0f8530 msgr2=0x7f38fc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 -- 172.21.15.60:0/3737946453 shutdown_connections 2024-04-12T13:44:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.555+0000 7f3903c00700 1 -- 172.21.15.60:0/3737946453 wait complete. 2024-04-12T13:44:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 Processor -- start 2024-04-12T13:44:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 -- start start 2024-04-12T13:44:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fcef0 0x7f38fc10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc110870 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.556+0000 7f3903c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc110fb0 con 0x7f38fc0fcef0 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58392/0 (socket says 172.21.15.60:58392) 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 -- 172.21.15.60:0/882172119 learned_addr learned my addr 172.21.15.60:0/882172119 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f3901200700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fcef0 0x7f38fc10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 -- 172.21.15.60:0/882172119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fcef0 msgr2=0x7f38fc10fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fcef0 0x7f38fc10fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.557+0000 7f38fbe00700 1 -- 172.21.15.60:0/882172119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f38fbe00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f38e8002a50 tx=0x7f38e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e8007cc0 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38e800f040 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e8009640 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc111290 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.558+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc111850 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.560+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc101a70 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.561+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f38e80097a0 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.563+0000 7f38f8c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 0x7f38e4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:11.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.563+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f38e808de20 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.563+0000 7f3901200700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 0x7f38e4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.565+0000 7f3901200700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 0x7f38e4070ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f38f000b970 tx=0x7f38f0009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:11.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.569+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f38e805ae60 con 0x7f38fc0fe0e0 2024-04-12T13:44:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.913+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38fc111ac0 con 0x7f38e406e620 2024-04-12T13:44:11.916 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:11 smithi060 ceph-mon[29097]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 934 KiB/s wr, 280 op/s 2024-04-12T13:44:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.916+0000 7f38f8c00700 1 -- 172.21.15.60:0/882172119 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f38fc111ac0 con 0x7f38e406e620 2024-04-12T13:44:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.919+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 msgr2=0x7f38e4070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.919+0000 7f3903c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 0x7f38e4070ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f38f000b970 tx=0x7f38f0009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.919+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 msgr2=0x7f38fc110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.919+0000 7f3903c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f38e8002a50 tx=0x7f38e80046b0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 shutdown_connections 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f38e406e620 0x7f38e4070ad0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38fc0fcef0 0x7f38fc10fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 --2- 172.21.15.60:0/882172119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc0fe0e0 0x7f38fc110270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 >> 172.21.15.60:0/882172119 conn(0x7f38fc0f8530 msgr2=0x7f38fc0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 shutdown_connections 2024-04-12T13:44:11.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:11.920+0000 7f3903c00700 1 -- 172.21.15.60:0/882172119 wait complete. 2024-04-12T13:44:11.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:11 smithi110 ceph-mon[36055]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 934 KiB/s wr, 280 op/s 2024-04-12T13:44:12.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 -- 172.21.15.60:0/2742205003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 msgr2=0x7f12040ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 --2- 172.21.15.60:0/2742205003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f12040ff410 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f11f4004940 tx=0x7f11f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:12.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 -- 172.21.15.60:0/2742205003 shutdown_connections 2024-04-12T13:44:12.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 --2- 172.21.15.60:0/2742205003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f1204100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 --2- 172.21.15.60:0/2742205003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f12040ff410 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 -- 172.21.15.60:0/2742205003 >> 172.21.15.60:0/2742205003 conn(0x7f12040fa950 msgr2=0x7f12040fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 -- 172.21.15.60:0/2742205003 shutdown_connections 2024-04-12T13:44:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.097+0000 7f120ae00700 1 -- 172.21.15.60:0/2742205003 wait complete. 2024-04-12T13:44:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 Processor -- start 2024-04-12T13:44:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 -- start start 2024-04-12T13:44:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f12041101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1204110840 con 0x7f12040ff000 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.099+0000 7f120ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1204110fe0 con 0x7f12041002b0 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58404/0 (socket says 172.21.15.60:58404) 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 -- 172.21.15.60:0/874880304 learned_addr learned my addr 172.21.15.60:0/874880304 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 -- 172.21.15.60:0/874880304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 msgr2=0x7f12041101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203400700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f12041101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f12041101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203e00700 1 -- 172.21.15.60:0/874880304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4005040 con 0x7f12040ff000 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.100+0000 7f1203400700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f12041101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f1203e00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11f400b3b0 tx=0x7f11f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f400e040 con 0x7f12040ff000 2024-04-12T13:44:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11f4004290 con 0x7f12040ff000 2024-04-12T13:44:12.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1204111260 con 0x7f12040ff000 2024-04-12T13:44:12.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1204111820 con 0x7f12040ff000 2024-04-12T13:44:12.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.101+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11f401c630 con 0x7f12040ff000 2024-04-12T13:44:12.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.103+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120405f5f0 con 0x7f12040ff000 2024-04-12T13:44:12.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.104+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f11f4013420 con 0x7f12040ff000 2024-04-12T13:44:12.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.105+0000 7f11fbe00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 0x7f11e8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.106+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f11f408f5c0 con 0x7f12040ff000 2024-04-12T13:44:12.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.106+0000 7f1203400700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 0x7f11e8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.107+0000 7f1203400700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 0x7f11e8070b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006fd0 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.111+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f11f405c560 con 0x7f12040ff000 2024-04-12T13:44:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.506+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1204111b50 con 0x7f11e806e670 2024-04-12T13:44:12.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.556+0000 7f11fbe00700 1 -- 172.21.15.60:0/874880304 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1204111b50 con 0x7f11e806e670 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (2m) 18s ago 13m 14.9M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (13m) 18s ago 13m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (11m) 31s ago 11m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 unknown 18s ago 12m - - 2024-04-12T13:44:12.559 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (5m) 18s ago 5m 12.7M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (5m) 18s ago 5m 200M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (5m) 31s ago 5m 12.6M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (5m) 31s ago 5m 12.7M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (55s) 18s ago 14m 475M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283 running (3m) 31s ago 11m 78.8M - 19.0.0-2778-ga971fd5f b96c509eef84 a45853779eeb 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (14m) 18s ago 15m 52.9M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (11m) 31s ago 11m 41.7M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (2m) 18s ago 13m 7746k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (69s) 31s ago 11m 7163k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (10m) 18s ago 10m 202M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (10m) 18s ago 10m 217M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (9m) 18s ago 9m 181M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (8m) 31s ago 8m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (8m) 31s ago 8m 226M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:44:12.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (7m) 31s ago 7m 199M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:44:12.561 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (78s) 18s ago 12m 43.8M - 2.43.0 a07b618ecd1d af71ee9fad28 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.560+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 msgr2=0x7f11e8070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.560+0000 7f120ae00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 0x7f11e8070b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006fd0 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.560+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 msgr2=0x7f120410fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.560+0000 7f120ae00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11f400b3b0 tx=0x7f11f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 shutdown_connections 2024-04-12T13:44:12.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f11e806e670 0x7f11e8070b20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12040ff000 0x7f120410fc70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 --2- 172.21.15.60:0/874880304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12041002b0 0x7f12041101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 >> 172.21.15.60:0/874880304 conn(0x7f12040fa950 msgr2=0x7f12040fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 shutdown_connections 2024-04-12T13:44:12.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.561+0000 7f120ae00700 1 -- 172.21.15.60:0/874880304 wait complete. 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 -- 172.21.15.60:0/1692617901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 msgr2=0x7fa7640fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 --2- 172.21.15.60:0/1692617901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa7640fd250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa754004940 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 -- 172.21.15.60:0/1692617901 shutdown_connections 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 --2- 172.21.15.60:0/1692617901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 0x7fa7640fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 --2- 172.21.15.60:0/1692617901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa7640fd250 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.761+0000 7fa76a800700 1 -- 172.21.15.60:0/1692617901 >> 172.21.15.60:0/1692617901 conn(0x7fa7640f8530 msgr2=0x7fa7640fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.762+0000 7fa76a800700 1 -- 172.21.15.60:0/1692617901 shutdown_connections 2024-04-12T13:44:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.762+0000 7fa76a800700 1 -- 172.21.15.60:0/1692617901 wait complete. 2024-04-12T13:44:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 Processor -- start 2024-04-12T13:44:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 -- start start 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 0x7fa76410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410e5b0 con 0x7fa7640fce40 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.763+0000 7fa76a800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410ee00 con 0x7fa7640fe040 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58434/0 (socket says 172.21.15.60:58434) 2024-04-12T13:44:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 -- 172.21.15.60:0/223565991 learned_addr learned my addr 172.21.15.60:0/223565991 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa762a00700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 0x7fa76410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 -- 172.21.15.60:0/223565991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 msgr2=0x7fa76410dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 0x7fa76410dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 -- 172.21.15.60:0/223565991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754005040 con 0x7fa7640fce40 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.764+0000 7fa763400700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa75400b970 tx=0x7fa754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.765+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75400e040 con 0x7fa7640fce40 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.765+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa754004290 con 0x7fa7640fce40 2024-04-12T13:44:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.765+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75401c630 con 0x7fa7640fce40 2024-04-12T13:44:12.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.765+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76410f080 con 0x7fa7640fce40 2024-04-12T13:44:12.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.765+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76410f5c0 con 0x7fa7640fce40 2024-04-12T13:44:12.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.766+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76405f5f0 con 0x7fa7640fce40 2024-04-12T13:44:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.767+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fa754013420 con 0x7fa7640fce40 2024-04-12T13:44:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.769+0000 7fa75b400700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 0x7fa748070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.769+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa75408f480 con 0x7fa7640fce40 2024-04-12T13:44:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.769+0000 7fa762a00700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 0x7fa748070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.770+0000 7fa762a00700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 0x7fa748070ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa750004c40 tx=0x7fa750009040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:12.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:12.775+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fa75405c4a0 con 0x7fa7640fce40 2024-04-12T13:44:12.912 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:12 smithi060 ceph-mon[29097]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:12.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:12 smithi110 ceph-mon[36055]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:13.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.220+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7641058d0 con 0x7fa7640fce40 2024-04-12T13:44:13.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.221+0000 7fa75b400700 1 -- 172.21.15.60:0/223565991 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa754013e60 con 0x7fa7640fce40 2024-04-12T13:44:13.223 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:44:13.223 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 12, 2024-04-12T13:44:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:44:13.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:44:13.225 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:44:13.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.224+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 msgr2=0x7fa748070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.224+0000 7fa76a800700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 0x7fa748070ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa750004c40 tx=0x7fa750009040 comp rx=0 tx=0).stop 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.224+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 msgr2=0x7fa76410da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.224+0000 7fa76a800700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa75400b970 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 shutdown_connections 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa74806e620 0x7fa748070ad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7640fce40 0x7fa76410da70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 --2- 172.21.15.60:0/223565991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7640fe040 0x7fa76410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 >> 172.21.15.60:0/223565991 conn(0x7fa7640f8530 msgr2=0x7fa7640f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:13.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 shutdown_connections 2024-04-12T13:44:13.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.225+0000 7fa76a800700 1 -- 172.21.15.60:0/223565991 wait complete. 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 -- 172.21.15.60:0/253004618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fcff0 msgr2=0x7fd4800fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 --2- 172.21.15.60:0/253004618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fcff0 0x7fd4800fd460 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd46c004940 tx=0x7fd46c009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 -- 172.21.15.60:0/253004618 shutdown_connections 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 --2- 172.21.15.60:0/253004618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fcff0 0x7fd4800fd460 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 --2- 172.21.15.60:0/253004618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fbd40 0x7fd4800fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 -- 172.21.15.60:0/253004618 >> 172.21.15.60:0/253004618 conn(0x7fd4800f74c0 msgr2=0x7fd4800f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.451+0000 7fd488600700 1 -- 172.21.15.60:0/253004618 shutdown_connections 2024-04-12T13:44:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.452+0000 7fd488600700 1 -- 172.21.15.60:0/253004618 wait complete. 2024-04-12T13:44:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.453+0000 7fd488600700 1 Processor -- start 2024-04-12T13:44:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.453+0000 7fd488600700 1 -- start start 2024-04-12T13:44:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.453+0000 7fd488600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd488600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fcff0 0x7fd4801100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd488600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4801106f0 con 0x7fd4800fbd40 2024-04-12T13:44:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd488600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480110ed0 con 0x7fd4800fcff0 2024-04-12T13:44:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd485c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd485c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58452/0 (socket says 172.21.15.60:58452) 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd485c00700 1 -- 172.21.15.60:0/2410968494 learned_addr learned my addr 172.21.15.60:0/2410968494 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd485200700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fcff0 0x7fd4801100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.454+0000 7fd485c00700 1 -- 172.21.15.60:0/2410968494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fcff0 msgr2=0x7fd4801100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd485c00700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fcff0 0x7fd4801100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd485c00700 1 -- 172.21.15.60:0/2410968494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c005040 con 0x7fd4800fbd40 2024-04-12T13:44:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd485c00700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd47400eb40 tx=0x7fd47400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd474007cc0 con 0x7fd4800fbd40 2024-04-12T13:44:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd47400f040 con 0x7fd4800fbd40 2024-04-12T13:44:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.455+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480111150 con 0x7fd4800fbd40 2024-04-12T13:44:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.456+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd47400ca10 con 0x7fd4800fbd40 2024-04-12T13:44:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.456+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480111690 con 0x7fd4800fbd40 2024-04-12T13:44:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.457+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd480100980 con 0x7fd4800fbd40 2024-04-12T13:44:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.458+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fd474039bb0 con 0x7fd4800fbd40 2024-04-12T13:44:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.459+0000 7fd47d600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 0x7fd468070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.459+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd47408dcb0 con 0x7fd4800fbd40 2024-04-12T13:44:13.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.460+0000 7fd485200700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 0x7fd468070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:13.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.461+0000 7fd485200700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 0x7fd468070ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009fd0 tx=0x7fd46c009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.464+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fd47405ad80 con 0x7fd4800fbd40 2024-04-12T13:44:13.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.818+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4801059d0 con 0x7fd4800fbd40 2024-04-12T13:44:13.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.819+0000 7fd47d600700 1 -- 172.21.15.60:0/2410968494 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7fd474019730 con 0x7fd4800fbd40 2024-04-12T13:44:13.821 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:44:13.822 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:44:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 msgr2=0x7fd468070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 0x7fd468070ba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009fd0 tx=0x7fd46c009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 msgr2=0x7fd48010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd47400eb40 tx=0x7fd47400b040 comp rx=0 tx=0).stop 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 shutdown_connections 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd46806e6f0 0x7fd468070ba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4800fbd40 0x7fd48010fbb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 --2- 172.21.15.60:0/2410968494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4800fcff0 0x7fd4801100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.822+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 >> 172.21.15.60:0/2410968494 conn(0x7fd4800f74c0 msgr2=0x7fd4800f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.823+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 shutdown_connections 2024-04-12T13:44:13.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.823+0000 7fd488600700 1 -- 172.21.15.60:0/2410968494 wait complete. 2024-04-12T13:44:13.827 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:44:13.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:13 smithi110 ceph-mon[36055]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:13.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:13 smithi110 ceph-mon[36055]: pgmap v22: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 300 op/s 2024-04-12T13:44:13.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:13 smithi110 ceph-mon[36055]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:13.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:13 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/223565991' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:44:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:13 smithi060 ceph-mon[29097]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:13 smithi060 ceph-mon[29097]: pgmap v22: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 300 op/s 2024-04-12T13:44:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:13 smithi060 ceph-mon[29097]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:13 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/223565991' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:44:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 -- 172.21.15.60:0/960722195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0662f0 msgr2=0x7f8a5c0ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 --2- 172.21.15.60:0/960722195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c0ffa30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004940 tx=0x7f8a54009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 -- 172.21.15.60:0/960722195 shutdown_connections 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 --2- 172.21.15.60:0/960722195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 --2- 172.21.15.60:0/960722195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c0ffa30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 -- 172.21.15.60:0/960722195 >> 172.21.15.60:0/960722195 conn(0x7f8a5c0f74c0 msgr2=0x7f8a5c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 -- 172.21.15.60:0/960722195 shutdown_connections 2024-04-12T13:44:13.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.989+0000 7f8a61200700 1 -- 172.21.15.60:0/960722195 wait complete. 2024-04-12T13:44:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.990+0000 7f8a61200700 1 Processor -- start 2024-04-12T13:44:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.990+0000 7f8a61200700 1 -- start start 2024-04-12T13:44:13.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a61200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a61200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a61200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c110f60 con 0x7f8a5c0fff70 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a61200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c1110d0 con 0x7f8a5c0662f0 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a59400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a59400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58462/0 (socket says 172.21.15.60:58462) 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a59400700 1 -- 172.21.15.60:0/245715152 learned_addr learned my addr 172.21.15.60:0/245715152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.991+0000 7f8a59e00700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:13.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a59400700 1 -- 172.21.15.60:0/245715152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0662f0 msgr2=0x7f8a5c10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a59400700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a59400700 1 -- 172.21.15.60:0/245715152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54005040 con 0x7f8a5c0fff70 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a59400700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00bbb0 tx=0x7f8a4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a4c0092e0 con 0x7f8a5c0fff70 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a4c00cbd0 con 0x7f8a5c0fff70 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a4c007400 con 0x7f8a5c0fff70 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.992+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c1113b0 con 0x7f8a5c0fff70 2024-04-12T13:44:13.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.993+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c111920 con 0x7f8a5c0fff70 2024-04-12T13:44:13.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.994+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c05f5f0 con 0x7f8a5c0fff70 2024-04-12T13:44:13.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.995+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f8a4c012070 con 0x7f8a5c0fff70 2024-04-12T13:44:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.997+0000 7f8a52000700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 0x7f8a40070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.997+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f8a4c08dd80 con 0x7f8a5c0fff70 2024-04-12T13:44:13.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.997+0000 7f8a59e00700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 0x7f8a40070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:14.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:13.998+0000 7f8a59e00700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 0x7f8a40070ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400b3b0 tx=0x7f8a54009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:14.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.002+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f8a4c05adb0 con 0x7f8a5c0fff70 2024-04-12T13:44:14.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.320+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a5c111c00 con 0x7f8a4006e620 2024-04-12T13:44:14.326 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:44:14.326 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:44:14.326 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:44:14.326 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:44:14.326 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/21 daemons upgraded", 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:44:14.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.323+0000 7f8a52000700 1 -- 172.21.15.60:0/245715152 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8a5c111c00 con 0x7f8a4006e620 2024-04-12T13:44:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.328+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 msgr2=0x7f8a40070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.328+0000 7f8a61200700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 0x7f8a40070ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400b3b0 tx=0x7f8a54009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.328+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 msgr2=0x7f8a5c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.328+0000 7f8a61200700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00bbb0 tx=0x7f8a4c009840 comp rx=0 tx=0).stop 2024-04-12T13:44:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.329+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 shutdown_connections 2024-04-12T13:44:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.329+0000 7f8a61200700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f8a4006e620 0x7f8a40070ad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.329+0000 7f8a61200700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a5c0662f0 0x7f8a5c10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.329+0000 7f8a61200700 1 --2- 172.21.15.60:0/245715152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a5c0fff70 0x7f8a5c110250 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.329+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 >> 172.21.15.60:0/245715152 conn(0x7f8a5c0f74c0 msgr2=0x7f8a5c0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.330+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 shutdown_connections 2024-04-12T13:44:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.330+0000 7f8a61200700 1 -- 172.21.15.60:0/245715152 wait complete. 2024-04-12T13:44:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 -- 172.21.15.60:0/2031539407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 msgr2=0x7f805c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 --2- 172.21.15.60:0/2031539407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c104780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8048004940 tx=0x7f8048009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 -- 172.21.15.60:0/2031539407 shutdown_connections 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 --2- 172.21.15.60:0/2031539407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c104780 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 --2- 172.21.15.60:0/2031539407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 0x7f805c101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 -- 172.21.15.60:0/2031539407 >> 172.21.15.60:0/2031539407 conn(0x7f805c0f7450 msgr2=0x7f805c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 -- 172.21.15.60:0/2031539407 shutdown_connections 2024-04-12T13:44:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.530+0000 7f8062c00700 1 -- 172.21.15.60:0/2031539407 wait complete. 2024-04-12T13:44:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.531+0000 7f8062c00700 1 Processor -- start 2024-04-12T13:44:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.531+0000 7f8062c00700 1 -- start start 2024-04-12T13:44:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f8062c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 0x7f805c10fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f8062c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f8062c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c1107c0 con 0x7f805c1023a0 2024-04-12T13:44:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f8062c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c110fc0 con 0x7f805c066b00 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f805b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f805b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58484/0 (socket says 172.21.15.60:58484) 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f805b400700 1 -- 172.21.15.60:0/783279734 learned_addr learned my addr 172.21.15.60:0/783279734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.532+0000 7f805be00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 0x7f805c10fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f805b400700 1 -- 172.21.15.60:0/783279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 msgr2=0x7f805c10fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f805b400700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 0x7f805c10fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f805b400700 1 -- 172.21.15.60:0/783279734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048005040 con 0x7f805c1023a0 2024-04-12T13:44:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f805b400700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f804800b0d0 tx=0x7f8048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f804800e070 con 0x7f805c1023a0 2024-04-12T13:44:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f804801d460 con 0x7f805c1023a0 2024-04-12T13:44:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c111240 con 0x7f805c1023a0 2024-04-12T13:44:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.533+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f804801c5c0 con 0x7f805c1023a0 2024-04-12T13:44:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.534+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c111780 con 0x7f805c1023a0 2024-04-12T13:44:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.535+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c05f5f0 con 0x7f805c1023a0 2024-04-12T13:44:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.536+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f804801d5d0 con 0x7f805c1023a0 2024-04-12T13:44:14.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.537+0000 7f8053e00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 0x7f8040070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:14.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.537+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f804808eff0 con 0x7f805c1023a0 2024-04-12T13:44:14.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.538+0000 7f805be00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 0x7f8040070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.539+0000 7f805be00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 0x7f8040070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f804c009b80 tx=0x7f804c00b040 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:14.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.542+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f804805c0a0 con 0x7f805c1023a0 2024-04-12T13:44:14.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:14 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/2410968494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:44:14.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.961+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f805c04bed0 con 0x7f805c1023a0 2024-04-12T13:44:14.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.962+0000 7f8053e00700 1 -- 172.21.15.60:0/783279734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+157 (secure 0 0 0) 0x7f80480220b0 con 0x7f805c1023a0 2024-04-12T13:44:14.964 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:44:14.964 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:44:14.964 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in unknown state 2024-04-12T13:44:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 msgr2=0x7f8040070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 0x7f8040070ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f804c009b80 tx=0x7f804c00b040 comp rx=0 tx=0).stop 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 msgr2=0x7f805c1101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f804800b0d0 tx=0x7f8048009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 shutdown_connections 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f804006e620 0x7f8040070ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c066b00 0x7f805c10fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 --2- 172.21.15.60:0/783279734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f805c1023a0 0x7f805c1101c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.965+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 >> 172.21.15.60:0/783279734 conn(0x7f805c0f7450 msgr2=0x7f805c0f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.966+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 shutdown_connections 2024-04-12T13:44:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:14.966+0000 7f8062c00700 1 -- 172.21.15.60:0/783279734 wait complete. 2024-04-12T13:44:14.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:14 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2410968494' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:44:15.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:15 smithi060 ceph-mon[29097]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:15 smithi060 ceph-mon[29097]: pgmap v23: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 259 op/s 2024-04-12T13:44:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:15 smithi060 ceph-mon[29097]: from='client.? 172.21.15.60:0/783279734' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:44:15.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:15 smithi110 ceph-mon[36055]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:44:15.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:15 smithi110 ceph-mon[36055]: pgmap v23: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 259 op/s 2024-04-12T13:44:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:15 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/783279734' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:44:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:17 smithi060 ceph-mon[29097]: pgmap v24: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 259 op/s 2024-04-12T13:44:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:17 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:17 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:17 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:44:17.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:17 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:17.934 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:17 smithi110 ceph-mon[36055]: pgmap v24: 65 pgs: 65 active+clean; 247 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 859 KiB/s wr, 259 op/s 2024-04-12T13:44:17.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:17 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:17.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:17 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:17.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:17 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:44:17.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:17 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:18.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:18 smithi060 ceph-mon[29097]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:44:18.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:18 smithi110 ceph-mon[36055]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:44:19.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:19 smithi060 ceph-mon[29097]: pgmap v25: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 337 op/s 2024-04-12T13:44:19.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:19 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:44:19.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:19 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:44:19.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:19 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:19.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:19 smithi110 ceph-mon[36055]: pgmap v25: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 337 op/s 2024-04-12T13:44:19.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:19 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:44:19.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:19 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:44:19.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:19 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:20.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:20 smithi110 ceph-mon[36055]: Upgrade: Updating mgr.smithi110.ezwdax 2024-04-12T13:44:20.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:20 smithi110 ceph-mon[36055]: Deploying daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:44:20.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:20 smithi060 ceph-mon[29097]: Upgrade: Updating mgr.smithi110.ezwdax 2024-04-12T13:44:20.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:20 smithi060 ceph-mon[29097]: Deploying daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:44:21.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:21 smithi060 ceph-mon[29097]: pgmap v26: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 723 KiB/s wr, 216 op/s 2024-04-12T13:44:21.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:21 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:21.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:21 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:21 smithi110 ceph-mon[36055]: pgmap v26: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 723 KiB/s wr, 216 op/s 2024-04-12T13:44:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:21 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:21.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:21 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:23.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:23 smithi060 ceph-mon[29097]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 322 op/s 2024-04-12T13:44:23.930 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:23 smithi110 ceph-mon[36055]: pgmap v27: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 322 op/s 2024-04-12T13:44:25.912 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:25 smithi110 ceph-mon[36055]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 739 KiB/s wr, 216 op/s 2024-04-12T13:44:25.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:25 smithi060 ceph-mon[29097]: pgmap v28: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 739 KiB/s wr, 216 op/s 2024-04-12T13:44:27.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:27 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:27.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:27 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:27.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:27 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:27.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:27 smithi110 ceph-mon[36055]: pgmap v29: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 739 KiB/s wr, 216 op/s 2024-04-12T13:44:27.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:27 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:27 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:27 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:27 smithi060 ceph-mon[29097]: pgmap v29: 65 pgs: 65 active+clean; 239 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 739 KiB/s wr, 216 op/s 2024-04-12T13:44:29.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:29 smithi060 ceph-mon[29097]: pgmap v30: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 312 op/s 2024-04-12T13:44:29.712 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:29 smithi110 ceph-mon[36055]: pgmap v30: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 312 op/s 2024-04-12T13:44:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:31 smithi060 ceph-mon[29097]: pgmap v31: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 729 KiB/s wr, 203 op/s 2024-04-12T13:44:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:31 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:31 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:31.721 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:31 smithi110 ceph-mon[36055]: pgmap v31: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 729 KiB/s wr, 203 op/s 2024-04-12T13:44:31.722 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:31 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:31.722 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:31 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:33.400 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-12T13:44:33.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-12T13:44:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:33 smithi060 ceph-mon[29097]: pgmap v32: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 307 op/s 2024-04-12T13:44:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:33 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:33 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:33 smithi110 ceph-mon[36055]: pgmap v32: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 307 op/s 2024-04-12T13:44:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:33 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:33 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:34.934 DEBUG:teuthology.parallel:result is None 2024-04-12T13:44:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:35 smithi110 ceph-mon[36055]: pgmap v33: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 758 KiB/s wr, 200 op/s 2024-04-12T13:44:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:35 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:35.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:35 smithi060 ceph-mon[29097]: pgmap v33: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 758 KiB/s wr, 200 op/s 2024-04-12T13:44:35.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:35.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:35 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:36.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:36 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:36.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:36 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:44:37.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: pgmap v34: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 758 KiB/s wr, 200 op/s 2024-04-12T13:44:37.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:44:37.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:44:37.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:44:37.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:44:37.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:44:37.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:37 smithi060 ceph-mon[29097]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:44:37.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: pgmap v34: 65 pgs: 65 active+clean; 225 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 758 KiB/s wr, 200 op/s 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:44:37.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:37 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/2663825128' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:44:38.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:38 smithi060 ceph-mon[29097]: mgrmap e31: smithi060.bpzacg(active, since 61s), standbys: smithi110.ezwdax 2024-04-12T13:44:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:38 smithi110 ceph-mon[36055]: mgrmap e31: smithi060.bpzacg(active, since 61s), standbys: smithi110.ezwdax 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: pgmap v35: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: pgmap v36: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 786 KiB/s wr, 246 op/s 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.bpzacg"}]: dispatch 2024-04-12T13:44:39.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.bpzacg"}]': finished 2024-04-12T13:44:39.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.ezwdax"}]: dispatch 2024-04-12T13:44:39.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.ezwdax"}]': finished 2024-04-12T13:44:39.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:39 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: pgmap v35: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: pgmap v36: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 786 KiB/s wr, 246 op/s 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:44:39.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.bpzacg"}]: dispatch 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.bpzacg"}]': finished 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.ezwdax"}]: dispatch 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.ezwdax"}]': finished 2024-04-12T13:44:39.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:39 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T13:44:40.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:40 smithi060 ceph-mon[29097]: Upgrade: Setting container_image for all mgr 2024-04-12T13:44:40.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:40 smithi060 ceph-mon[29097]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:44:40.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:40 smithi060 ceph-mon[29097]: Cluster is now healthy 2024-04-12T13:44:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:40 smithi110 ceph-mon[36055]: Upgrade: Setting container_image for all mgr 2024-04-12T13:44:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:40 smithi110 ceph-mon[36055]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:44:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:40 smithi110 ceph-mon[36055]: Cluster is now healthy 2024-04-12T13:44:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:41 smithi060 ceph-mon[29097]: pgmap v37: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 786 KiB/s wr, 246 op/s 2024-04-12T13:44:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:41 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:41 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:44:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:41 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:44:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:41 smithi060 ceph-mon[29097]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:41.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:41 smithi110 ceph-mon[36055]: pgmap v37: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 786 KiB/s wr, 246 op/s 2024-04-12T13:44:41.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:41 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' 2024-04-12T13:44:41.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:41 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:44:41.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:41 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:44:41.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:41 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:44:42.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:42 smithi110 ceph-mon[36055]: Upgrade: Updating mon.smithi060 2024-04-12T13:44:42.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:42 smithi110 ceph-mon[36055]: Deploying daemon mon.smithi060 on smithi060 2024-04-12T13:44:43.170 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:42 smithi060 ceph-mon[29097]: Upgrade: Updating mon.smithi060 2024-04-12T13:44:43.170 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:42 smithi060 ceph-mon[29097]: Deploying daemon mon.smithi060 on smithi060 2024-04-12T13:44:43.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:43 smithi110 ceph-mon[36055]: pgmap v38: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:44:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:43 smithi060 ceph-mon[29097]: pgmap v38: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:44:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 -- 172.21.15.60:0/2617817209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fe0e0 msgr2=0x7f89bc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 --2- 172.21.15.60:0/2617817209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc0fe550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f89a8004940 tx=0x7f89a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 -- 172.21.15.60:0/2617817209 shutdown_connections 2024-04-12T13:44:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 --2- 172.21.15.60:0/2617817209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc0fe550 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 --2- 172.21.15.60:0/2617817209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fcef0 0x7f89bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 -- 172.21.15.60:0/2617817209 >> 172.21.15.60:0/2617817209 conn(0x7f89bc0f8530 msgr2=0x7f89bc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 -- 172.21.15.60:0/2617817209 shutdown_connections 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.176+0000 7f89c3800700 1 -- 172.21.15.60:0/2617817209 wait complete. 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.177+0000 7f89c3800700 1 Processor -- start 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c3800700 1 -- start start 2024-04-12T13:44:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c3800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c3800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c3800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc110780 con 0x7f89bc0fcef0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c3800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc110fd0 con 0x7f89bc0fe0e0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.178+0000 7f89c0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89c0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55564/0 (socket says 172.21.15.60:55564) 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89c0e00700 1 -- 172.21.15.60:0/2931122734 learned_addr learned my addr 172.21.15.60:0/2931122734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89bbe00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89c0e00700 1 -- 172.21.15.60:0/2931122734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 msgr2=0x7f89bc110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89c0e00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89c0e00700 1 -- 172.21.15.60:0/2931122734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8005040 con 0x7f89bc0fcef0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.179+0000 7f89bbe00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89c0e00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f89b000c8e0 tx=0x7f89b00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:45.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b000a940 con 0x7f89bc0fcef0 2024-04-12T13:44:45.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89b000ce80 con 0x7f89bc0fcef0 2024-04-12T13:44:45.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc1112b0 con 0x7f89bc0fcef0 2024-04-12T13:44:45.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b00113a0 con 0x7f89bc0fcef0 2024-04-12T13:44:45.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.180+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc1117f0 con 0x7f89bc0fcef0 2024-04-12T13:44:45.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.182+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc101a70 con 0x7f89bc0fcef0 2024-04-12T13:44:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.184+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f89b0012400 con 0x7f89bc0fcef0 2024-04-12T13:44:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.185+0000 7f89b8c00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 0x7f89a4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.185+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f89b008e060 con 0x7f89bc0fcef0 2024-04-12T13:44:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.186+0000 7f89bbe00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 0x7f89a4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.187+0000 7f89bbe00700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 0x7f89a4070ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89a800b3b0 tx=0x7f89a8009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:45.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.191+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f89b005b190 con 0x7f89bc0fcef0 2024-04-12T13:44:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:45 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:44:45.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.484+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89bc111b20 con 0x7f89a406e620 2024-04-12T13:44:45.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.486+0000 7f89b8c00700 1 -- 172.21.15.60:0/2931122734 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f89bc111b20 con 0x7f89a406e620 2024-04-12T13:44:45.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 msgr2=0x7f89a4070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 0x7f89a4070ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89a800b3b0 tx=0x7f89a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 msgr2=0x7f89bc10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f89b000c8e0 tx=0x7f89b00044c0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 shutdown_connections 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f89a406e620 0x7f89a4070ad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc0fcef0 0x7f89bc10fc40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 --2- 172.21.15.60:0/2931122734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89bc0fe0e0 0x7f89bc110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 >> 172.21.15.60:0/2931122734 conn(0x7f89bc0f8530 msgr2=0x7f89bc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 shutdown_connections 2024-04-12T13:44:45.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.490+0000 7f89c3800700 1 -- 172.21.15.60:0/2931122734 wait complete. 2024-04-12T13:44:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 -- 172.21.15.60:0/1210527124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb006ee10 msgr2=0x7f0eb006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 --2- 172.21.15.60:0/1210527124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb006ee10 0x7f0eb006f280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c004940 tx=0x7f0e9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 -- 172.21.15.60:0/1210527124 shutdown_connections 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 --2- 172.21.15.60:0/1210527124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb006ee10 0x7f0eb006f280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 --2- 172.21.15.60:0/1210527124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb0065f10 0x7f0eb006e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.681+0000 7f0eb7000700 1 -- 172.21.15.60:0/1210527124 >> 172.21.15.60:0/1210527124 conn(0x7f0eb006a680 msgr2=0x7f0eb006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:45.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.682+0000 7f0eb7000700 1 -- 172.21.15.60:0/1210527124 shutdown_connections 2024-04-12T13:44:45.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.682+0000 7f0eb7000700 1 -- 172.21.15.60:0/1210527124 wait complete. 2024-04-12T13:44:45.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.683+0000 7f0eb7000700 1 Processor -- start 2024-04-12T13:44:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.685+0000 7f0eb7000700 1 -- start start 2024-04-12T13:44:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.685+0000 7f0eb7000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.685+0000 7f0eb7000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0eb0116660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.685+0000 7f0eb7000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0116c60 con 0x7f0eb0065f10 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.685+0000 7f0eb7000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0116dd0 con 0x7f0eb006ee10 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.686+0000 7f0eafe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.686+0000 7f0eafe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55572/0 (socket says 172.21.15.60:55572) 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.686+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 learned_addr learned my addr 172.21.15.60:0/2671874235 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.687+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 msgr2=0x7f0eb0116660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.687+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0eb0116660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.687+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c005040 con 0x7f0eb0065f10 2024-04-12T13:44:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.688+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0002a50 tx=0x7f0ea00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.688+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ea0007cc0 con 0x7f0eb0065f10 2024-04-12T13:44:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.689+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb011b830 con 0x7f0eb0065f10 2024-04-12T13:44:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.689+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb011bdf0 con 0x7f0eb0065f10 2024-04-12T13:44:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.689+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ea000f040 con 0x7f0eb0065f10 2024-04-12T13:44:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.689+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ea0009640 con 0x7f0eb0065f10 2024-04-12T13:44:45.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.691+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e900052e0 con 0x7f0eb0065f10 2024-04-12T13:44:45.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.692+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f0ea000dd80 con 0x7f0eb0065f10 2024-04-12T13:44:45.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.694+0000 7f0ea7e00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 0x7f0e94070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.694+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0ea008d600 con 0x7f0eb0065f10 2024-04-12T13:44:45.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.695+0000 7f0eaf400700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 0x7f0e94070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.697+0000 7f0eaf400700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 0x7f0e94070ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c004f90 tx=0x7f0e9c009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.703+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f0ea005a5b0 con 0x7f0eb0065f10 2024-04-12T13:44:45.754 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:45 smithi060 ceph-mon[29097]: pgmap v39: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:44:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 msgr2=0x7f0eb0116120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T13:44:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 msgr2=0x7f0eb0116120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T13:44:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0002a50 tx=0x7f0ea00046b0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T13:44:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0002a50 tx=0x7f0ea00046b0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 msgr2=0x7f0eb0116120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-12T13:44:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0ea7e00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0eb0065f10 0x7f0eb0116120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.756+0000 7f0ea7e00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0e940781f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.757+0000 7f0ea7e00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 0x7f0e9407ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.757+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9407b790 con 0x7f0e940788f0 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.757+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9407fce0 con 0x7f0eb006ee10 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.757+0000 7f0eb5000700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 msgr2=0x7f0e9407ad70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.757+0000 7f0eb5000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 0x7f0e9407ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.758+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0e940781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.758+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 msgr2=0x7f0e9407ad70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:45.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.758+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 0x7f0e9407ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:45.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.758+0000 7f0eafe00700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=3+}) v3 -- 0x7f0e9407fe70 con 0x7f0eb006ee10 2024-04-12T13:44:45.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.759+0000 7f0eafe00700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0e940781f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ea008b780 tx=0x7f0ea00046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:45.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.760+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ea00610c0 con 0x7f0eb006ee10 2024-04-12T13:44:45.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.761+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ea00633c0 con 0x7f0eb006ee10 2024-04-12T13:44:45.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:45.762+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f0ea008b970 con 0x7f0eb006ee10 2024-04-12T13:44:45.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:44:45 smithi110 ceph-mon[36055]: pgmap v39: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:44:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.048+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e90000bf0 con 0x7f0e9406e630 2024-04-12T13:44:46.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[29092]: 2024-04-12T13:44:45.751+0000 7f6d7b600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:44:46.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[29092]: 2024-04-12T13:44:45.751+0000 7f6d7b600700 -1 mon.smithi060@0(leader) e2 *** Got Signal Terminated *** 2024-04-12T13:44:46.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:45 smithi060 podman[94030]: 2024-04-12 13:44:45.823939149 +0000 UTC m=+0.221950634 container died a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-64502-quincy-2-730340d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:44:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.050+0000 7f0ea7e00700 1 -- 172.21.15.60:0/2671874235 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0e90000bf0 con 0x7f0e9406e630 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 msgr2=0x7f0e94070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 0x7f0e94070ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c004f90 tx=0x7f0e9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 msgr2=0x7f0e940781f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0e940781f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ea008b780 tx=0x7f0ea00046b0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 shutdown_connections 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f0e9406e630 0x7f0e94070ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e940788f0 0x7f0e9407ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 --2- 172.21.15.60:0/2671874235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb006ee10 0x7f0e940781f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 >> 172.21.15.60:0/2671874235 conn(0x7f0eb006a680 msgr2=0x7f0eb006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 shutdown_connections 2024-04-12T13:44:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.053+0000 7f0eb7000700 1 -- 172.21.15.60:0/2671874235 wait complete. 2024-04-12T13:44:46.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 -- 172.21.15.60:0/3484528811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440fff70 msgr2=0x7fd244102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 --2- 172.21.15.60:0/3484528811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440fff70 0x7fd244102390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd230004940 tx=0x7fd230009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:46.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 -- 172.21.15.60:0/3484528811 shutdown_connections 2024-04-12T13:44:46.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 --2- 172.21.15.60:0/3484528811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440fff70 0x7fd244102390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 --2- 172.21.15.60:0/3484528811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440662f0 0x7fd2440ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 -- 172.21.15.60:0/3484528811 >> 172.21.15.60:0/3484528811 conn(0x7fd2440f74c0 msgr2=0x7fd2440f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:46.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.220+0000 7fd24ae00700 1 -- 172.21.15.60:0/3484528811 shutdown_connections 2024-04-12T13:44:46.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.221+0000 7fd24ae00700 1 -- 172.21.15.60:0/3484528811 wait complete. 2024-04-12T13:44:46.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.222+0000 7fd24ae00700 1 Processor -- start 2024-04-12T13:44:46.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.222+0000 7fd24ae00700 1 -- start start 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.222+0000 7fd24ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd24ae00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 0x7fd24410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd24ae00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24410e680 con 0x7fd2440fff70 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd24ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24410ee70 con 0x7fd2440662f0 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd243400700 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 msgr2=0x7fd24410dff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:46.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd243400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 0x7fd24410dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd243e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd243e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39876/0 (socket says 172.21.15.60:39876) 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.223+0000 7fd243e00700 1 -- 172.21.15.60:0/985998056 learned_addr learned my addr 172.21.15.60:0/985998056 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.224+0000 7fd243e00700 1 -- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 msgr2=0x7fd24410dff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.224+0000 7fd243e00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 0x7fd24410dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.224+0000 7fd243e00700 1 -- 172.21.15.60:0/985998056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230005040 con 0x7fd2440662f0 2024-04-12T13:44:46.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.224+0000 7fd243e00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b790 tx=0x7fd234009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:46.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.225+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd234010790 con 0x7fd2440662f0 2024-04-12T13:44:46.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.225+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24410f150 con 0x7fd2440662f0 2024-04-12T13:44:46.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.225+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24410f710 con 0x7fd2440662f0 2024-04-12T13:44:46.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.225+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd234010dc0 con 0x7fd2440662f0 2024-04-12T13:44:46.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.225+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd234011440 con 0x7fd2440662f0 2024-04-12T13:44:46.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.226+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24405f5f0 con 0x7fd2440662f0 2024-04-12T13:44:46.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.228+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fd23401b810 con 0x7fd2440662f0 2024-04-12T13:44:46.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.229+0000 7fd23be00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 0x7fd228070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.229+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd23408e430 con 0x7fd2440662f0 2024-04-12T13:44:46.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.229+0000 7fd243400700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 0x7fd228070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:46.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.230+0000 7fd243400700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 0x7fd228070a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd230004890 tx=0x7fd230009e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:46.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.244+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fd23405b4e0 con 0x7fd2440662f0 2024-04-12T13:44:46.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.544+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd24410faf0 con 0x7fd22806e570 2024-04-12T13:44:46.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.562+0000 7fd23be00700 1 -- 172.21.15.60:0/985998056 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd24410faf0 con 0x7fd22806e570 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (2m) 12s ago 13m 15.1M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (13m) 12s ago 13m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (12m) 15s ago 12m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running 12s ago 13m - - 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (6m) 12s ago 6m 13.0M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (6m) 12s ago 6m 170M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (6m) 15s ago 6m 12.9M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (6m) 15s ago 6m 13.1M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:44:46.564 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (89s) 12s ago 15m 497M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (21s) 15s ago 12m 68.7M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (15m) 12s ago 15m 52.6M 2048M 17.2.7-845-g730340d7 036a68d49952 a2fb8b09073e 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (12m) 15s ago 12m 41.4M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (3m) 12s ago 13m 7852k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (103s) 15s ago 12m 7726k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (11m) 12s ago 11m 220M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (10m) 12s ago 10m 239M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (10m) 12s ago 10m 201M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (9m) 15s ago 9m 279M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (8m) 15s ago 8m 248M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (8m) 15s ago 8m 221M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:44:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (30s) 12s ago 12m 43.5M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 msgr2=0x7fd228070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 0x7fd228070a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd230004890 tx=0x7fd230009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 msgr2=0x7fd24410dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b790 tx=0x7fd234009220 comp rx=0 tx=0).stop 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 shutdown_connections 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fd22806e570 0x7fd228070a20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2440662f0 0x7fd24410dab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 --2- 172.21.15.60:0/985998056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2440fff70 0x7fd24410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.565+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 >> 172.21.15.60:0/985998056 conn(0x7fd2440f74c0 msgr2=0x7fd2440f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.566+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 shutdown_connections 2024-04-12T13:44:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.566+0000 7fd24ae00700 1 -- 172.21.15.60:0/985998056 wait complete. 2024-04-12T13:44:46.602 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 podman[94030]: 2024-04-12 13:44:46.323283469 +0000 UTC m=+0.721294997 container cleanup a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0) 2024-04-12T13:44:46.602 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 bash[94030]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060 2024-04-12T13:44:46.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 -- 172.21.15.60:0/1361457379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a0071f50 msgr2=0x7ff6a0070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:46.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/1361457379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a0071f50 0x7ff6a0070460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff690004940 tx=0x7ff690009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:46.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 -- 172.21.15.60:0/1361457379 shutdown_connections 2024-04-12T13:44:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/1361457379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a00709a0 0x7ff6a0070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/1361457379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a0071f50 0x7ff6a0070460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 -- 172.21.15.60:0/1361457379 >> 172.21.15.60:0/1361457379 conn(0x7ff6a00f8530 msgr2=0x7ff6a00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.779+0000 7ff6a4c00700 1 -- 172.21.15.60:0/1361457379 shutdown_connections 2024-04-12T13:44:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.780+0000 7ff6a4c00700 1 -- 172.21.15.60:0/1361457379 wait complete. 2024-04-12T13:44:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 Processor -- start 2024-04-12T13:44:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 -- start start 2024-04-12T13:44:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 0x7ff6a0114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0114cf0 con 0x7ff6a0071f50 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.781+0000 7ff6a4c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a01154e0 con 0x7ff6a00709a0 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69d400700 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 msgr2=0x7ff6a0114660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 0x7ff6a0114660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39886/0 (socket says 172.21.15.60:39886) 2024-04-12T13:44:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 -- 172.21.15.60:0/141607099 learned_addr learned my addr 172.21.15.60:0/141607099 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 -- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 msgr2=0x7ff6a0114660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 0x7ff6a0114660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.782+0000 7ff69de00700 1 -- 172.21.15.60:0/141607099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690005040 con 0x7ff6a00709a0 2024-04-12T13:44:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff69de00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff690000c00 tx=0x7ff690009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:46.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69000e030 con 0x7ff6a00709a0 2024-04-12T13:44:46.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff690013420 con 0x7ff6a00709a0 2024-04-12T13:44:46.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a0115760 con 0x7ff6a00709a0 2024-04-12T13:44:46.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69000bee0 con 0x7ff6a00709a0 2024-04-12T13:44:46.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.783+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a0115d20 con 0x7ff6a00709a0 2024-04-12T13:44:46.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.785+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a005f5f0 con 0x7ff6a00709a0 2024-04-12T13:44:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.786+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7ff690013a20 con 0x7ff6a00709a0 2024-04-12T13:44:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.787+0000 7ff696000700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 0x7ff684070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.787+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7ff69008f7b0 con 0x7ff6a00709a0 2024-04-12T13:44:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.788+0000 7ff69d400700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 0x7ff684070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:46.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.789+0000 7ff69d400700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 0x7ff684070a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006fd0 tx=0x7ff68c006df0 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:46.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:46.792+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7ff69005c800 con 0x7ff6a00709a0 2024-04-12T13:44:46.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 podman[94075]: 2024-04-12 13:44:46.600030455 +0000 UTC m=+0.757246541 container remove a2fb8b09073e797b4ed9ab31fac8e092dd5579230ee8af3fe6e8bd245537f329 (image=quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:44:47.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.218+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6a0107c30 con 0x7ff6a00709a0 2024-04-12T13:44:47.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.220+0000 7ff696000700 1 -- 172.21.15.60:0/141607099 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7ff69005c390 con 0x7ff6a00709a0 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:44:47.222 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 12, 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:44:47.223 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 msgr2=0x7ff684070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 0x7ff684070a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff68c006fd0 tx=0x7ff68c006df0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 msgr2=0x7ff6a0114120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff690000c00 tx=0x7ff690009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 shutdown_connections 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7ff68406e5c0 0x7ff684070a70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6a00709a0 0x7ff6a0114120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 --2- 172.21.15.60:0/141607099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6a0071f50 0x7ff6a0114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 >> 172.21.15.60:0/141607099 conn(0x7ff6a00f8530 msgr2=0x7ff6a00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 shutdown_connections 2024-04-12T13:44:47.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.223+0000 7ff6a4c00700 1 -- 172.21.15.60:0/141607099 wait complete. 2024-04-12T13:44:47.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service: Deactivated successfully. 2024-04-12T13:44:47.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 systemd[1]: Stopped Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:44:47.393 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:46 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service: Consumed 25.365s CPU time. 2024-04-12T13:44:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 -- 172.21.15.60:0/596132577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a4071ea0 msgr2=0x7fa0a40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 --2- 172.21.15.60:0/596132577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a4071ea0 0x7fa0a40703b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa098004940 tx=0x7fa098009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 -- 172.21.15.60:0/596132577 shutdown_connections 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 --2- 172.21.15.60:0/596132577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40708f0 0x7fa0a4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 --2- 172.21.15.60:0/596132577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a4071ea0 0x7fa0a40703b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 -- 172.21.15.60:0/596132577 >> 172.21.15.60:0/596132577 conn(0x7fa0a40f8530 msgr2=0x7fa0a40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 -- 172.21.15.60:0/596132577 shutdown_connections 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.401+0000 7fa0abc00700 1 -- 172.21.15.60:0/596132577 wait complete. 2024-04-12T13:44:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.402+0000 7fa0abc00700 1 Processor -- start 2024-04-12T13:44:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.402+0000 7fa0abc00700 1 -- start start 2024-04-12T13:44:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0abc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0abc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 0x7fa0a4114670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0abc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4114d00 con 0x7fa0a4071ea0 2024-04-12T13:44:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0abc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41154a0 con 0x7fa0a40708f0 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0a3e00700 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 msgr2=0x7fa0a4114670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0a3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 0x7fa0a4114670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.403+0000 7fa0a9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.404+0000 7fa0a9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39910/0 (socket says 172.21.15.60:39910) 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.404+0000 7fa0a9200700 1 -- 172.21.15.60:0/2870253519 learned_addr learned my addr 172.21.15.60:0/2870253519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.404+0000 7fa0a9200700 1 -- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 msgr2=0x7fa0a4114670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.404+0000 7fa0a9200700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 0x7fa0a4114670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.404+0000 7fa0a9200700 1 -- 172.21.15.60:0/2870253519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098005040 con 0x7fa0a40708f0 2024-04-12T13:44:47.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0a9200700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa098000c00 tx=0x7fa098009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:47.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09800e030 con 0x7fa0a40708f0 2024-04-12T13:44:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4115720 con 0x7fa0a40708f0 2024-04-12T13:44:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa098013420 con 0x7fa0a40708f0 2024-04-12T13:44:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa09800bee0 con 0x7fa0a40708f0 2024-04-12T13:44:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.405+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4115ce0 con 0x7fa0a40708f0 2024-04-12T13:44:47.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.407+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a405f5f0 con 0x7fa0a40708f0 2024-04-12T13:44:47.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.409+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fa098013a20 con 0x7fa0a40708f0 2024-04-12T13:44:47.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.410+0000 7fa0a0c00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 0x7fa08c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.410+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa09808fdc0 con 0x7fa0a40708f0 2024-04-12T13:44:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.410+0000 7fa0a3e00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 0x7fa08c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:47.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.411+0000 7fa0a3e00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 0x7fa08c070a70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa090006fd0 tx=0x7fa090006df0 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.422+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7fa09805cd60 con 0x7fa0a40708f0 2024-04-12T13:44:47.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:47 smithi060 systemd[1]: Starting Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.790+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0a410bf90 con 0x7fa0a40708f0 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.791+0000 7fa0a0c00700 1 -- 172.21.15.60:0/2870253519 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1809 (secure 0 0 0) 0x7fa098020070 con 0x7fa0a40708f0 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:47.793 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:44:47.794 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:44:47.795 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:44:47.796 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:44:47.797 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:44:47.797 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:47.798 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:44:47.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:44:47.799 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:47.799 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:47.799 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:47.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 msgr2=0x7fa08c070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 0x7fa08c070a70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa090006fd0 tx=0x7fa090006df0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 msgr2=0x7fa0a4114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa098000c00 tx=0x7fa098009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 shutdown_connections 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7fa08c06e5c0 0x7fa08c070a70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0a40708f0 0x7fa0a4114130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 --2- 172.21.15.60:0/2870253519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a4071ea0 0x7fa0a4114670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.793+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 >> 172.21.15.60:0/2870253519 conn(0x7fa0a40f8530 msgr2=0x7fa0a40f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:47.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.794+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 shutdown_connections 2024-04-12T13:44:47.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.794+0000 7fa0abc00700 1 -- 172.21.15.60:0/2870253519 wait complete. 2024-04-12T13:44:47.803 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:44:47.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2295335031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 msgr2=0x7f6bcc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:47.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2295335031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc0fe550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8004970 tx=0x7f6bb8009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:47.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2295335031 shutdown_connections 2024-04-12T13:44:47.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2295335031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc0fe550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2295335031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 0x7f6bcc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2295335031 >> 172.21.15.60:0/2295335031 conn(0x7f6bcc0f8530 msgr2=0x7f6bcc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2295335031 shutdown_connections 2024-04-12T13:44:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.978+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2295335031 wait complete. 2024-04-12T13:44:47.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.979+0000 7f6bd0a00700 1 Processor -- start 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bd0a00700 1 -- start start 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bd0a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 0x7f6bcc10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bd0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bd0a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc10e680 con 0x7f6bcc0fcef0 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bd0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc10ee20 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bc9e00700 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 msgr2=0x7f6bcc10dab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:47.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.980+0000 7f6bc9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 0x7f6bcc10dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.981+0000 7f6bc9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.981+0000 7f6bc9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39942/0 (socket says 172.21.15.60:39942) 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.981+0000 7f6bc9400700 1 -- 172.21.15.60:0/2385144912 learned_addr learned my addr 172.21.15.60:0/2385144912 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.982+0000 7f6bc9400700 1 -- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 msgr2=0x7f6bcc10dab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.982+0000 7f6bc9400700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 0x7f6bcc10dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:47.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.982+0000 7f6bc9400700 1 -- 172.21.15.60:0/2385144912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8005040 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.982+0000 7f6bc9400700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000c00 tx=0x7f6bb8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:47.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.983+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb800e030 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.983+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc10f0a0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.983+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb80093e0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.983+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb801c400 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.983+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc10f660 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.984+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc05f5f0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.986+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f6bb800bbb0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.987+0000 7f6bc2000700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 0x7f6bb0070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.988+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f6bb808ffd0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:47.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.988+0000 7f6bc9e00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 0x7f6bb0070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:47.989+0000 7f6bc9e00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 0x7f6bb0070a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0fcc30 tx=0x7f6bbc006dc0 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:48.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.002+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f6bb805cff0 con 0x7f6bcc0fe0e0 2024-04-12T13:44:48.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:47 smithi060 podman[94266]: 2024-04-12 13:44:47.667585406 +0000 UTC m=+0.035358021 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:44:48.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:47 smithi060 podman[94266]: 2024-04-12 13:44:47.801283824 +0000 UTC m=+0.169056448 container create d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403) 2024-04-12T13:44:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.295+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 --> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bcc10f9f0 con 0x7f6bb006e5c0 2024-04-12T13:44:48.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.298+0000 7f6bc2000700 1 -- 172.21.15.60:0/2385144912 <== mgr.14748 v2:172.21.15.60:6800/1868456600 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6bcc10f9f0 con 0x7f6bb006e5c0 2024-04-12T13:44:48.299 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/21 daemons upgraded", 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mon daemons", 2024-04-12T13:44:48.300 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:44:48.301 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:44:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 msgr2=0x7f6bb0070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 0x7f6bb0070a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0fcc30 tx=0x7f6bbc006dc0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 msgr2=0x7f6bcc10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8000c00 tx=0x7f6bb8009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 shutdown_connections 2024-04-12T13:44:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f6bb006e5c0 0x7f6bb0070a70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bcc0fcef0 0x7f6bcc10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 --2- 172.21.15.60:0/2385144912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bcc0fe0e0 0x7f6bcc10dff0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 >> 172.21.15.60:0/2385144912 conn(0x7f6bcc0f8530 msgr2=0x7f6bcc0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:48.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 shutdown_connections 2024-04-12T13:44:48.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.301+0000 7f6bd0a00700 1 -- 172.21.15.60:0/2385144912 wait complete. 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 -- 172.21.15.60:0/1781695931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 msgr2=0x7f46c40fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 --2- 172.21.15.60:0/1781695931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c40fe350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46b0004940 tx=0x7f46b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 -- 172.21.15.60:0/1781695931 shutdown_connections 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 --2- 172.21.15.60:0/1781695931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c40fe350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 --2- 172.21.15.60:0/1781695931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 0x7f46c40fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 -- 172.21.15.60:0/1781695931 >> 172.21.15.60:0/1781695931 conn(0x7f46c40f83d0 msgr2=0x7f46c40fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 -- 172.21.15.60:0/1781695931 shutdown_connections 2024-04-12T13:44:48.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.455+0000 7f46c9200700 1 -- 172.21.15.60:0/1781695931 wait complete. 2024-04-12T13:44:48.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.456+0000 7f46c9200700 1 Processor -- start 2024-04-12T13:44:48.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.456+0000 7f46c9200700 1 -- start start 2024-04-12T13:44:48.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 0x7f46c410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c9200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c9200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c410e4c0 con 0x7f46c40fcc30 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c9200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c410ecb0 con 0x7f46c40fdee0 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c3400700 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 msgr2=0x7f46c410d8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 0x7f46c410d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.457+0000 7f46c2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.458+0000 7f46c2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39954/0 (socket says 172.21.15.60:39954) 2024-04-12T13:44:48.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.458+0000 7f46c2a00700 1 -- 172.21.15.60:0/1588494726 learned_addr learned my addr 172.21.15.60:0/1588494726 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:44:48.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.458+0000 7f46c2a00700 1 -- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 msgr2=0x7f46c410d8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T13:44:48.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.458+0000 7f46c2a00700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 0x7f46c410d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.458+0000 7f46c2a00700 1 -- 172.21.15.60:0/1588494726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0005040 con 0x7f46c40fdee0 2024-04-12T13:44:48.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46c2a00700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b970 tx=0x7f46b0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:48.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b000e070 con 0x7f46c40fdee0 2024-04-12T13:44:48.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c410ef30 con 0x7f46c40fdee0 2024-04-12T13:44:48.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46b0013420 con 0x7f46c40fdee0 2024-04-12T13:44:48.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b000bee0 con 0x7f46c40fdee0 2024-04-12T13:44:48.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.459+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c410f490 con 0x7f46c40fdee0 2024-04-12T13:44:48.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.460+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c405f5f0 con 0x7f46c40fdee0 2024-04-12T13:44:48.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.462+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f46b0013590 con 0x7f46c40fdee0 2024-04-12T13:44:48.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.463+0000 7f46bb400700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 0x7f46a8070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:44:48.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.463+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f46b0090290 con 0x7f46c40fdee0 2024-04-12T13:44:48.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.464+0000 7f46c3400700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 0x7f46a8070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:44:48.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.464+0000 7f46c3400700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 0x7f46a8070a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006fd0 tx=0x7f46b4006e30 comp rx=0 tx=0).ready entity=mgr.14748 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:44:48.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.480+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186579 (secure 0 0 0) 0x7f46b005d2b0 con 0x7f46c40fdee0 2024-04-12T13:44:48.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.857+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f46c404bed0 con 0x7f46c40fdee0 2024-04-12T13:44:48.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.858+0000 7f46bb400700 1 -- 172.21.15.60:0/1588494726 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f46b005ce40 con 0x7f46c40fdee0 2024-04-12T13:44:48.860 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 msgr2=0x7f46a8070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 0x7f46a8070a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006fd0 tx=0x7f46b4006e30 comp rx=0 tx=0).stop 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 msgr2=0x7f46c410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b970 tx=0x7f46b0009e30 comp rx=0 tx=0).stop 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 shutdown_connections 2024-04-12T13:44:48.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:6800/1868456600,v1:172.21.15.60:6801/1868456600] conn(0x7f46a806e570 0x7f46a8070a20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c40fcc30 0x7f46c410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 --2- 172.21.15.60:0/1588494726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46c40fdee0 0x7f46c410de30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:44:48.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.861+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 >> 172.21.15.60:0/1588494726 conn(0x7f46c40f83d0 msgr2=0x7f46c40f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:44:48.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.862+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 shutdown_connections 2024-04-12T13:44:48.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:44:48.862+0000 7f46c9200700 1 -- 172.21.15.60:0/1588494726 wait complete. 2024-04-12T13:44:52.469 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-12T13:44:52.470 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-12T13:44:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 podman[94266]: 2024-04-12 13:44:52.348407943 +0000 UTC m=+4.716180586 container init d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5) 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 podman[94266]: 2024-04-12 13:44:52.359783522 +0000 UTC m=+4.727556137 container start d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, GIT_CLEAN=True) 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev), process ceph-mon, pid 2 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: pidfile_write: ignore empty --pid-file 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: load: jerasure load: lrc 2024-04-12T13:44:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: RocksDB version: 7.9.2 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Git sha 0 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Compile date 2024-04-06 20:28:24 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: DB SUMMARY 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: DB Session ID: A1O8QM0T2SGE59O0HLU7 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: CURRENT file: CURRENT 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T13:44:52.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1158 Bytes 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 1, files: 000033.sst 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000031.log size: 2592507 ; 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.error_if_exists: 0 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.create_if_missing: 0 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.paranoid_checks: 1 2024-04-12T13:44:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.env: 0x5595683adc60 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.fs: PosixFileSystem 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.info_log: 0x5595726adae0 2024-04-12T13:44:52.686 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T13:44:52.687 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.statistics: (nil) 2024-04-12T13:44:52.687 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.use_fsync: 0 2024-04-12T13:44:52.687 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_log_file_size: 0 2024-04-12T13:44:52.687 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_fallocate: 1 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.use_direct_reads: 0 2024-04-12T13:44:52.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.db_log_dir: 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.wal_dir: 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T13:44:52.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.write_buffer_manager: 0x55957267e1e0 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T13:44:52.690 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.unordered_write: 0 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T13:44:52.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T13:44:52.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T13:44:52.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.row_cache: None 2024-04-12T13:44:52.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.wal_filter: None 2024-04-12T13:44:52.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.two_write_queues: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.wal_compression: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.atomic_flush: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.log_readahead_size: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T13:44:52.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_background_jobs: 2 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_background_compactions: -1 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_subcompactions: 1 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T13:44:52.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_open_files: -1 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T13:44:52.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_background_flushes: -1 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Compression algorithms supported: 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kZSTD supported: 0 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kXpressCompression supported: 0 2024-04-12T13:44:52.696 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kZlibCompression supported: 1 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kSnappyCompression supported: 1 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kLZ4Compression supported: 1 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: kBZip2Compression supported: 0 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T13:44:52.697 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-12T13:44:52.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000015 2024-04-12T13:44:52.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-12T13:44:52.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T13:44:52.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.merge_operator: 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_filter: None 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5595726adcc0) 2024-04-12T13:44:52.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_type: 0 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_index_type: 0 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_shortening: 1 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: checksum: 4 2024-04-12T13:44:52.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: no_block_cache: 0 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache: 0x5595726b1090 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_options: 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: capacity : 536870912 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_shard_bits : 4 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: strict_capacity_limit : 0 2024-04-12T13:44:52.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_compressed: (nil) 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: persistent_cache: (nil) 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size: 4096 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size_deviation: 10 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_restart_interval: 16 2024-04-12T13:44:52.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_block_restart_interval: 1 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_block_size: 4096 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: partition_filters: 0 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: use_delta_encoding: 1 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: filter_policy: bloomfilter 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: whole_key_filtering: 1 2024-04-12T13:44:52.703 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: verify_compression: 0 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: format_version: 5 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_index_compression: 1 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_align: 0 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_auto_readahead_size: 262144 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: prepopulate_block_cache: 0 2024-04-12T13:44:52.704 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: initial_auto_readahead_size: 8192 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression: NoCompression 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.num_levels: 7 2024-04-12T13:44:52.705 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T13:44:52.706 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T13:44:52.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T13:44:52.708 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.arena_block_size: 1048576 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T13:44:52.709 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.inplace_update_support: 0 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T13:44:52.710 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.bloom_locality: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.max_successive_merges: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.ttl: 2592000 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enable_blob_files: false 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.min_blob_size: 0 2024-04-12T13:44:52.711 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.blob_file_starting_level: 0 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12081, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d70d631a-4c68-4249-bd81-f0dff1013972 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929492414222, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-12T13:44:52.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929492428831, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2380069, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12082, "largest_seqno": 13313, "table_properties": {"data_size": 2373867, "index_size": 3749, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 12312, "raw_average_key_size": 22, "raw_value_size": 2362187, "raw_average_value_size": 4366, "num_data_blocks": 171, "num_entries": 541, "num_filter_entries": 541, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712929492, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d70d631a-4c68-4249-bd81-f0dff1013972", "db_session_id": "A1O8QM0T2SGE59O0HLU7", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929492428964, "job": 1, "event": "recovery_finished"} 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi060/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5595727a0000 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: DB pointer 0x55957278a000 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** DB Stats ** 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T13:44:52.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L0 1/0 2.27 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 355.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-12T13:44:52.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Sum 2/0 7.76 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 355.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 355.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 355.4 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.715 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T13:44:52.716 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative compaction: 0.00 GB write, 113.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval compaction: 0.00 GB write, 113.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache BinnedLRUCache@0x5595726b1090#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: starting mon.smithi060 rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???) e2 preinit fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:44:52.717 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).mds e13 new map 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).mds e13 print_map 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: e13 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: legacy client fscid: 1 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Filesystem 'cephfs' (1) 2024-04-12T13:44:52.718 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: fs_name cephfs 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: epoch 13 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: tableserver 0 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: root 0 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: session_timeout 60 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: session_autoclose 300 2024-04-12T13:44:52.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_file_size 1099511627776 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_xattr_size 65536 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: required_client_features {} 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: last_failure 0 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: last_failure_osd_epoch 0 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_mds 1 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: in 0 2024-04-12T13:44:52.720 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: up {0=14444} 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: failed 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: damaged 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: stopped 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_pools [3] 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_pool 2 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: inline_data disabled 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: balancer 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: bal_rank_mask -1 2024-04-12T13:44:52.721 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: standby_count_wanted 1 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: qdb_cluster leader: 0 members: 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Standby daemons: 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:52.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 ceph-mon[94333]: mon.smithi060@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 bash[94266]: d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 2024-04-12T13:44:52.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:44:52 smithi060 systemd[1]: Started Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:44:53.598 DEBUG:teuthology.parallel:result is None 2024-04-12T13:44:53.599 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-12T13:44:53.717 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-12T13:44:53.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-12T13:44:53.858 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-12T13:44:53.859 DEBUG:teuthology.parallel:result is None 2024-04-12T13:45:04.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:04.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:04.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.24627 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v40: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/141607099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2870253519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.24639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v41: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 399 KiB/s wr, 119 op/s 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1588494726' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:04.184 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 9.3 KiB/s rd, 341 KiB/s wr, 101 op/s 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v43: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 504 KiB/s wr, 121 op/s 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v44: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 KiB/s rd, 338 KiB/s wr, 71 op/s 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v45: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 KiB/s rd, 338 KiB/s wr, 71 op/s 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: mon.smithi060 calling monitor election 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 395 KiB/s wr, 123 op/s 2024-04-12T13:45:04.185 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: mon.smithi110 calling monitor election 2024-04-12T13:45:04.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 220 KiB/s wr, 72 op/s 2024-04-12T13:45:04.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 220 KiB/s wr, 72 op/s 2024-04-12T13:45:04.186 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: monmap epoch 2 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: last_changed 2024-04-12T13:32:33.616864+0000 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: created 2024-04-12T13:29:08.011338+0000 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: min_mon_release 17 (quincy) 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: election_strategy: 1 2024-04-12T13:45:04.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: mgrmap e31: smithi060.bpzacg(active, since 87s), standbys: smithi110.ezwdax 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: overall HEALTH_OK 2024-04-12T13:45:04.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: from='mgr.14748 ' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:04.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:03 smithi060 ceph-mon[94333]: mgrmap e32: smithi060.bpzacg(active, since 87s), standbys: smithi110.ezwdax 2024-04-12T13:45:04.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:04.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='mgr.14748 172.21.15.60:0/207357745' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.24627 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v40: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 516 KiB/s wr, 183 op/s 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/141607099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/2870253519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:04.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.24639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v41: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 399 KiB/s wr, 119 op/s 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1588494726' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 9.3 KiB/s rd, 341 KiB/s wr, 101 op/s 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v43: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 504 KiB/s wr, 121 op/s 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v44: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 KiB/s rd, 338 KiB/s wr, 71 op/s 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v45: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 KiB/s rd, 338 KiB/s wr, 71 op/s 2024-04-12T13:45:04.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: mon.smithi060 calling monitor election 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 395 KiB/s wr, 123 op/s 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: mon.smithi110 calling monitor election 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 220 KiB/s wr, 72 op/s 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 220 KiB/s wr, 72 op/s 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:45:04.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: monmap epoch 2 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: last_changed 2024-04-12T13:32:33.616864+0000 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: created 2024-04-12T13:29:08.011338+0000 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: min_mon_release 17 (quincy) 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: election_strategy: 1 2024-04-12T13:45:04.235 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: mgrmap e31: smithi060.bpzacg(active, since 87s), standbys: smithi110.ezwdax 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: overall HEALTH_OK 2024-04-12T13:45:04.236 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: from='mgr.14748 ' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:04.237 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:03 smithi110 ceph-mon[36055]: mgrmap e32: smithi060.bpzacg(active, since 87s), standbys: smithi110.ezwdax 2024-04-12T13:45:04.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:04 smithi060 ceph-mon[94333]: from='mgr.14748 ' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:04 smithi110 ceph-mon[36055]: from='mgr.14748 ' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:12.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:45:12.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:45:12.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:45:12.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:45:12.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:45:12.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:12 smithi060 ceph-mon[94333]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:45:12.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax restarted 2024-04-12T13:45:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: Standby manager daemon smithi110.ezwdax started 2024-04-12T13:45:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/crt"}]: dispatch 2024-04-12T13:45:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T13:45:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.ezwdax/key"}]: dispatch 2024-04-12T13:45:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:12 smithi110 ceph-mon[36055]: from='mgr.? 172.21.15.110:0/712198842' entity='mgr.smithi110.ezwdax' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T13:45:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: mgrmap e33: smithi060.bpzacg(active, since 96s), standbys: smithi110.ezwdax 2024-04-12T13:45:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: Active manager daemon smithi060.bpzacg restarted 2024-04-12T13:45:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:45:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: mgrmap e34: smithi060.bpzacg(active, starting, since 0.0181271s), standbys: smithi110.ezwdax 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:45:13.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:13.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:45:13.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:13 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: mgrmap e33: smithi060.bpzacg(active, since 96s), standbys: smithi110.ezwdax 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: Active manager daemon smithi060.bpzacg restarted 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: Activating manager daemon smithi060.bpzacg 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: mgrmap e34: smithi060.bpzacg(active, starting, since 0.0181271s), standbys: smithi110.ezwdax 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi060.bpzacg", "id": "smithi060.bpzacg"}]: dispatch 2024-04-12T13:45:14.131 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr metadata", "who": "smithi110.ezwdax", "id": "smithi110.ezwdax"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: Manager daemon smithi060.bpzacg is now available 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/mirror_snapshot_schedule"}]: dispatch 2024-04-12T13:45:14.132 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.bpzacg/trash_purge_schedule"}]: dispatch 2024-04-12T13:45:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:15 smithi110 ceph-mon[36055]: mgrmap e35: smithi060.bpzacg(active, since 1.02837s), standbys: smithi110.ezwdax 2024-04-12T13:45:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:15 smithi110 ceph-mon[36055]: [12/Apr/2024:13:45:14] ENGINE Bus STARTING 2024-04-12T13:45:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:15 smithi110 ceph-mon[36055]: [12/Apr/2024:13:45:14] ENGINE Serving on http://172.21.15.60:8765 2024-04-12T13:45:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:15 smithi110 ceph-mon[36055]: [12/Apr/2024:13:45:14] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:45:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:15 smithi110 ceph-mon[36055]: [12/Apr/2024:13:45:14] ENGINE Bus STARTED 2024-04-12T13:45:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:15 smithi060 ceph-mon[94333]: mgrmap e35: smithi060.bpzacg(active, since 1.02837s), standbys: smithi110.ezwdax 2024-04-12T13:45:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:15 smithi060 ceph-mon[94333]: [12/Apr/2024:13:45:14] ENGINE Bus STARTING 2024-04-12T13:45:15.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:15 smithi060 ceph-mon[94333]: [12/Apr/2024:13:45:14] ENGINE Serving on http://172.21.15.60:8765 2024-04-12T13:45:15.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:15 smithi060 ceph-mon[94333]: [12/Apr/2024:13:45:14] ENGINE Serving on https://172.21.15.60:7150 2024-04-12T13:45:15.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:15 smithi060 ceph-mon[94333]: [12/Apr/2024:13:45:14] ENGINE Bus STARTED 2024-04-12T13:45:16.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:16 smithi060 ceph-mon[94333]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:16.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:16 smithi060 ceph-mon[94333]: mgrmap e36: smithi060.bpzacg(active, since 2s), standbys: smithi110.ezwdax 2024-04-12T13:45:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:16 smithi110 ceph-mon[36055]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:16 smithi110 ceph-mon[36055]: mgrmap e36: smithi060.bpzacg(active, since 2s), standbys: smithi110.ezwdax 2024-04-12T13:45:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:18 smithi060 ceph-mon[94333]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:18 smithi060 ceph-mon[94333]: mgrmap e37: smithi060.bpzacg(active, since 4s), standbys: smithi110.ezwdax 2024-04-12T13:45:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:18 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:18 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:18 smithi110 ceph-mon[36055]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:18 smithi110 ceph-mon[36055]: mgrmap e37: smithi060.bpzacg(active, since 4s), standbys: smithi110.ezwdax 2024-04-12T13:45:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:18 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:18 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 -- 172.21.15.60:0/2356857857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c103420 msgr2=0x7f488c103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 --2- 172.21.15.60:0/2356857857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c103420 0x7f488c103830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f487c004940 tx=0x7f487c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 -- 172.21.15.60:0/2356857857 shutdown_connections 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 --2- 172.21.15.60:0/2356857857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c1046d0 0x7f488c104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 --2- 172.21.15.60:0/2356857857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c103420 0x7f488c103830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.025+0000 7f4892600700 1 -- 172.21.15.60:0/2356857857 >> 172.21.15.60:0/2356857857 conn(0x7f488c072640 msgr2=0x7f488c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.026+0000 7f4892600700 1 -- 172.21.15.60:0/2356857857 shutdown_connections 2024-04-12T13:45:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.026+0000 7f4892600700 1 -- 172.21.15.60:0/2356857857 wait complete. 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.026+0000 7f4892600700 1 Processor -- start 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f4892600700 1 -- start start 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f4892600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c103420 0x7f488c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f4892600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f4892600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c114aa0 con 0x7f488c1046d0 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f4892600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c114c10 con 0x7f488c103420 2024-04-12T13:45:19.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f488aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f488aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59188/0 (socket says 172.21.15.60:59188) 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.027+0000 7f488aa00700 1 -- 172.21.15.60:0/1777914690 learned_addr learned my addr 172.21.15.60:0/1777914690 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.028+0000 7f488b400700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c103420 0x7f488c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.028+0000 7f488aa00700 1 -- 172.21.15.60:0/1777914690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c103420 msgr2=0x7f488c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.028+0000 7f488aa00700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c103420 0x7f488c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.028+0000 7f488aa00700 1 -- 172.21.15.60:0/1777914690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c005040 con 0x7f488c1046d0 2024-04-12T13:45:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.028+0000 7f488aa00700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f487800c8c0 tx=0x7f48780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.029+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487800a760 con 0x7f488c1046d0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.029+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f487800ad90 con 0x7f488c1046d0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.029+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48780113a0 con 0x7f488c1046d0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.029+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c119670 con 0x7f488c1046d0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.029+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c119c30 con 0x7f488c1046d0 2024-04-12T13:45:19.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.030+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c04c710 con 0x7f488c1046d0 2024-04-12T13:45:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.031+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4878012400 con 0x7f488c1046d0 2024-04-12T13:45:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.032+0000 7f4883400700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 0x7f48700711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.032+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f487808e960 con 0x7f488c1046d0 2024-04-12T13:45:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.032+0000 7f488b400700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 0x7f48700711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.033+0000 7f488b400700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 0x7f48700711e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f487c009fd0 tx=0x7f487c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.038+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f487805b230 con 0x7f488c1046d0 2024-04-12T13:45:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.311+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f488c108a60 con 0x7f487006ed30 2024-04-12T13:45:19.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.314+0000 7f4883400700 1 -- 172.21.15.60:0/1777914690 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f488c108a60 con 0x7f487006ed30 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 msgr2=0x7f48700711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 0x7f48700711e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f487c009fd0 tx=0x7f487c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 msgr2=0x7f488c1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f487800c8c0 tx=0x7f48780044c0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 shutdown_connections 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f487006ed30 0x7f48700711e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c103420 0x7f488c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 --2- 172.21.15.60:0/1777914690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c1046d0 0x7f488c1144a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.317+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 >> 172.21.15.60:0/1777914690 conn(0x7f488c072640 msgr2=0x7f488c073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.318+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 shutdown_connections 2024-04-12T13:45:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.318+0000 7f4892600700 1 -- 172.21.15.60:0/1777914690 wait complete. 2024-04-12T13:45:19.337 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 -- 172.21.15.60:0/2109879472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 msgr2=0x7f1cf8104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 --2- 172.21.15.60:0/2109879472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8104b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4004940 tx=0x7f1ce4009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 -- 172.21.15.60:0/2109879472 shutdown_connections 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 --2- 172.21.15.60:0/2109879472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8104b40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 --2- 172.21.15.60:0/2109879472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 0x7f1cf8103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 -- 172.21.15.60:0/2109879472 >> 172.21.15.60:0/2109879472 conn(0x7f1cf8072640 msgr2=0x7f1cf8074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 -- 172.21.15.60:0/2109879472 shutdown_connections 2024-04-12T13:45:19.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.475+0000 7f1cff800700 1 -- 172.21.15.60:0/2109879472 wait complete. 2024-04-12T13:45:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.476+0000 7f1cff800700 1 Processor -- start 2024-04-12T13:45:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.476+0000 7f1cff800700 1 -- start start 2024-04-12T13:45:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cff800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 0x7f1cf8113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cff800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cff800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8114a30 con 0x7f1cf81046d0 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cff800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8114ba0 con 0x7f1cf8103420 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cf7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cfce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 0x7f1cf8113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cf7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33170/0 (socket says 172.21.15.60:33170) 2024-04-12T13:45:19.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.477+0000 7f1cf7e00700 1 -- 172.21.15.60:0/3698044039 learned_addr learned my addr 172.21.15.60:0/3698044039 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf7e00700 1 -- 172.21.15.60:0/3698044039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 msgr2=0x7f1cf8113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf7e00700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 0x7f1cf8113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf7e00700 1 -- 172.21.15.60:0/3698044039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4005040 con 0x7f1cf81046d0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf7e00700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b0d0 tx=0x7f1ce4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ce400e070 con 0x7f1cf81046d0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ce400b410 con 0x7f1cf81046d0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ce40125e0 con 0x7f1cf81046d0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf81195a0 con 0x7f1cf81046d0 2024-04-12T13:45:19.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.478+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf8119b10 con 0x7f1cf81046d0 2024-04-12T13:45:19.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.479+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf804c710 con 0x7f1cf81046d0 2024-04-12T13:45:19.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.481+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f1ce400b580 con 0x7f1cf81046d0 2024-04-12T13:45:19.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.482+0000 7f1cf4c00700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 0x7f1ce00711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.482+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1ce408f880 con 0x7f1cf81046d0 2024-04-12T13:45:19.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.482+0000 7f1cfce00700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 0x7f1ce00711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.483+0000 7f1cfce00700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 0x7f1ce00711e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009b80 tx=0x7f1cec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.487+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1ce405bfc0 con 0x7f1cf81046d0 2024-04-12T13:45:19.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.762+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cf8108970 con 0x7f1ce006ed30 2024-04-12T13:45:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.764+0000 7f1cf4c00700 1 -- 172.21.15.60:0/3698044039 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f1cf8108970 con 0x7f1ce006ed30 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 msgr2=0x7f1ce00711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 0x7f1ce00711e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009b80 tx=0x7f1cec00b040 comp rx=0 tx=0).stop 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 msgr2=0x7f1cf8114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b0d0 tx=0x7f1ce4009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 shutdown_connections 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1ce006ed30 0x7f1ce00711e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8103420 0x7f1cf8113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 --2- 172.21.15.60:0/3698044039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cf81046d0 0x7f1cf8114430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.766+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 >> 172.21.15.60:0/3698044039 conn(0x7f1cf8072640 msgr2=0x7f1cf8073c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.767+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 shutdown_connections 2024-04-12T13:45:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.767+0000 7f1cff800700 1 -- 172.21.15.60:0/3698044039 wait complete. 2024-04-12T13:45:19.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 -- 172.21.15.60:0/639651979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 msgr2=0x7f44a40fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 --2- 172.21.15.60:0/639651979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a40fe070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4490004940 tx=0x7f4490009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:19.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 -- 172.21.15.60:0/639651979 shutdown_connections 2024-04-12T13:45:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 --2- 172.21.15.60:0/639651979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a40fe070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 --2- 172.21.15.60:0/639651979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 0x7f44a40fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 -- 172.21.15.60:0/639651979 >> 172.21.15.60:0/639651979 conn(0x7f44a40f8540 msgr2=0x7f44a40fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.931+0000 7f44a8e00700 1 -- 172.21.15.60:0/639651979 shutdown_connections 2024-04-12T13:45:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.932+0000 7f44a8e00700 1 -- 172.21.15.60:0/639651979 wait complete. 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 Processor -- start 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 -- start start 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 0x7f44a410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4110770 con 0x7f44a40fd710 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a8e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a4110fc0 con 0x7f44a40fcdc0 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.933+0000 7f44a1400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33188/0 (socket says 172.21.15.60:33188) 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 -- 172.21.15.60:0/325029589 learned_addr learned my addr 172.21.15.60:0/325029589 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:19.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 0x7f44a410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 -- 172.21.15.60:0/325029589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 msgr2=0x7f44a410fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 0x7f44a410fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 -- 172.21.15.60:0/325029589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494005040 con 0x7f44a40fd710 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.934+0000 7f44a1400700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f449000b0d0 tx=0x7f4490009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.935+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449000e070 con 0x7f44a40fd710 2024-04-12T13:45:19.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.935+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4490013de0 con 0x7f44a40fd710 2024-04-12T13:45:19.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.935+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4490005040 con 0x7f44a40fd710 2024-04-12T13:45:19.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.935+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f449000be30 con 0x7f44a40fd710 2024-04-12T13:45:19.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.935+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a41115f0 con 0x7f44a40fd710 2024-04-12T13:45:19.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.936+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4101a60 con 0x7f44a40fd710 2024-04-12T13:45:19.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.938+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f449000b680 con 0x7f44a40fd710 2024-04-12T13:45:19.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.939+0000 7f449a000700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 0x7f44880711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:19.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.939+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f449008f7b0 con 0x7f44a40fd710 2024-04-12T13:45:19.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.939+0000 7f44a1e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 0x7f44880711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:19.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.940+0000 7f44a1e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 0x7f44880711d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44a40fdbc0 tx=0x7f449400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:19.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:19.947+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f449005bef0 con 0x7f44a40fd710 2024-04-12T13:45:20.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.227+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44a4111810 con 0x7f448806ed20 2024-04-12T13:45:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.241+0000 7f449a000700 1 -- 172.21.15.60:0/325029589 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f44a4111810 con 0x7f448806ed20 2024-04-12T13:45:20.243 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:45:20.243 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (3m) 0s ago 14m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (14m) 0s ago 14m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (13m) 2s ago 13m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 0s ago 13m - - 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (6m) 0s ago 6m 13.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (7m) 0s ago 7m 136M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (6m) 2s ago 6m 13.3M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (6m) 2s ago 6m 13.4M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (2m) 0s ago 15m 477M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (54s) 2s ago 12m 448M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (32s) 0s ago 16m 32.9M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (12m) 2s ago 12m 50.1M 2048M 17.2.7-845-g730340d7 036a68d49952 0a064e4e9b78 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (3m) 0s ago 14m 8066k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (2m) 2s ago 12m 7503k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:45:20.244 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (11m) 0s ago 11m 228M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (11m) 0s ago 11m 246M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (10m) 0s ago 10m 207M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (10m) 2s ago 10m 284M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (9m) 2s ago 9m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (8m) 2s ago 8m 225M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:45:20.245 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (64s) 0s ago 13m 51.7M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:45:20.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 msgr2=0x7f44880711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 0x7f44880711d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44a40fdbc0 tx=0x7f449400b040 comp rx=0 tx=0).stop 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 msgr2=0x7f44a4110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f449000b0d0 tx=0x7f4490009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 shutdown_connections 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f448806ed20 0x7f44880711d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a40fcdc0 0x7f44a410fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 --2- 172.21.15.60:0/325029589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40fd710 0x7f44a4110170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 >> 172.21.15.60:0/325029589 conn(0x7f44a40f8540 msgr2=0x7f44a40f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:20.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.244+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 shutdown_connections 2024-04-12T13:45:20.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.245+0000 7f44a8e00700 1 -- 172.21.15.60:0/325029589 wait complete. 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 -- 172.21.15.60:0/289535853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 msgr2=0x7ffa54070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 --2- 172.21.15.60:0/289535853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54070350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa44004940 tx=0x7ffa44009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 -- 172.21.15.60:0/289535853 shutdown_connections 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 --2- 172.21.15.60:0/289535853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 0x7ffa54070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 --2- 172.21.15.60:0/289535853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54070350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.400+0000 7ffa59c00700 1 -- 172.21.15.60:0/289535853 >> 172.21.15.60:0/289535853 conn(0x7ffa540f85c0 msgr2=0x7ffa540faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.401+0000 7ffa59c00700 1 -- 172.21.15.60:0/289535853 shutdown_connections 2024-04-12T13:45:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.401+0000 7ffa59c00700 1 -- 172.21.15.60:0/289535853 wait complete. 2024-04-12T13:45:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.401+0000 7ffa59c00700 1 Processor -- start 2024-04-12T13:45:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa59c00700 1 -- start start 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa59c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 0x7ffa5410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa59c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa59c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54110860 con 0x7ffa54071e40 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa59c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54110fa0 con 0x7ffa54070890 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa52000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa52000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33196/0 (socket says 172.21.15.60:33196) 2024-04-12T13:45:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa52000700 1 -- 172.21.15.60:0/1535562849 learned_addr learned my addr 172.21.15.60:0/1535562849 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.402+0000 7ffa52a00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 0x7ffa5410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.403+0000 7ffa52000700 1 -- 172.21.15.60:0/1535562849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 msgr2=0x7ffa5410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.403+0000 7ffa52000700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 0x7ffa5410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.403+0000 7ffa52000700 1 -- 172.21.15.60:0/1535562849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44005040 con 0x7ffa54071e40 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.403+0000 7ffa52000700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c8c0 tx=0x7ffa400044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.404+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4000a760 con 0x7ffa54071e40 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.404+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa4000ad90 con 0x7ffa54071e40 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.404+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa54111280 con 0x7ffa54071e40 2024-04-12T13:45:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.404+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa400113a0 con 0x7ffa54071e40 2024-04-12T13:45:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.404+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa54111840 con 0x7ffa54071e40 2024-04-12T13:45:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.405+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5405f5f0 con 0x7ffa54071e40 2024-04-12T13:45:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.406+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7ffa40012400 con 0x7ffa54071e40 2024-04-12T13:45:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.407+0000 7ffa4aa00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 0x7ffa380711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.407+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa4008e960 con 0x7ffa54071e40 2024-04-12T13:45:20.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.408+0000 7ffa52a00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 0x7ffa380711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.408+0000 7ffa52a00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 0x7ffa380711d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400b3b0 tx=0x7ffa44009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:20.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.412+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ffa4005b230 con 0x7ffa54071e40 2024-04-12T13:45:20.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.743+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa5404bed0 con 0x7ffa54071e40 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.743+0000 7ffa4aa00700 1 -- 172.21.15.60:0/1535562849 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7ffa4005adc0 con 0x7ffa54071e40 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:45:20.746 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 11, 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 3 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:45:20.747 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:45:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.746+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 msgr2=0x7ffa380711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.746+0000 7ffa59c00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 0x7ffa380711d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400b3b0 tx=0x7ffa44009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.746+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 msgr2=0x7ffa54110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.746+0000 7ffa59c00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c8c0 tx=0x7ffa400044c0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 shutdown_connections 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffa3806ed20 0x7ffa380711d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa54070890 0x7ffa5410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 --2- 172.21.15.60:0/1535562849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa54071e40 0x7ffa54110260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 >> 172.21.15.60:0/1535562849 conn(0x7ffa540f85c0 msgr2=0x7ffa540f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 shutdown_connections 2024-04-12T13:45:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.747+0000 7ffa59c00700 1 -- 172.21.15.60:0/1535562849 wait complete. 2024-04-12T13:45:20.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 -- 172.21.15.60:0/2879969832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 msgr2=0x7f39d4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 --2- 172.21.15.60:0/2879969832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4100720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f39c0004940 tx=0x7f39c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 -- 172.21.15.60:0/2879969832 shutdown_connections 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 --2- 172.21.15.60:0/2879969832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4100720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 --2- 172.21.15.60:0/2879969832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 -- 172.21.15.60:0/2879969832 >> 172.21.15.60:0/2879969832 conn(0x7f39d40fa950 msgr2=0x7f39d40fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 -- 172.21.15.60:0/2879969832 shutdown_connections 2024-04-12T13:45:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.898+0000 7f39d9400700 1 -- 172.21.15.60:0/2879969832 wait complete. 2024-04-12T13:45:20.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 Processor -- start 2024-04-12T13:45:20.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 -- start start 2024-04-12T13:45:20.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4110780 con 0x7f39d41002b0 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d9400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4110fd0 con 0x7f39d40ff000 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.900+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33222/0 (socket says 172.21.15.60:33222) 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d1e00700 1 -- 172.21.15.60:0/615691693 learned_addr learned my addr 172.21.15.60:0/615691693 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d2800700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d1e00700 1 -- 172.21.15.60:0/615691693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 msgr2=0x7f39d410fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d1e00700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d410fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d1e00700 1 -- 172.21.15.60:0/615691693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0005040 con 0x7f39d41002b0 2024-04-12T13:45:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.901+0000 7f39d2800700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39d1e00700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b3b0 tx=0x7f39c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c000e040 con 0x7f39d41002b0 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39c0004290 con 0x7f39d41002b0 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c001c630 con 0x7f39d41002b0 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4111250 con 0x7f39d41002b0 2024-04-12T13:45:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.902+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4111790 con 0x7f39d41002b0 2024-04-12T13:45:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.903+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d405f5f0 con 0x7f39d41002b0 2024-04-12T13:45:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.905+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f39c000bbf0 con 0x7f39d41002b0 2024-04-12T13:45:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.906+0000 7f39caa00700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 0x7f39b80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.906+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f39c008fe70 con 0x7f39d41002b0 2024-04-12T13:45:20.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.906+0000 7f39d2800700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 0x7f39b80711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:20.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.907+0000 7f39d2800700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 0x7f39b80711d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39c40041d0 tx=0x7f39c4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:20.912+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f39c005c630 con 0x7f39d41002b0 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:20 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1535562849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:21.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.205+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f39d4107af0 con 0x7f39d41002b0 2024-04-12T13:45:21.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.205+0000 7f39caa00700 1 -- 172.21.15.60:0/615691693 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f39c005c1c0 con 0x7f39d41002b0 2024-04-12T13:45:21.208 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:45:21.208 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:45:21.209 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:21.210 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:45:21.211 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:21.212 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.213 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.214 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:21.214 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:20 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1535562849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:21.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.208+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 msgr2=0x7f39b80711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.208+0000 7f39d9400700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 0x7f39b80711d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39c40041d0 tx=0x7f39c4009040 comp rx=0 tx=0).stop 2024-04-12T13:45:21.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.208+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 msgr2=0x7f39d4110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.208+0000 7f39d9400700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b3b0 tx=0x7f39c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.208+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 shutdown_connections 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f39b806ed20 0x7f39b80711d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39d40ff000 0x7f39d410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 --2- 172.21.15.60:0/615691693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d41002b0 0x7f39d4110180 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 >> 172.21.15.60:0/615691693 conn(0x7f39d40fa950 msgr2=0x7f39d40fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 shutdown_connections 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.209+0000 7f39d9400700 1 -- 172.21.15.60:0/615691693 wait complete. 2024-04-12T13:45:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 -- 172.21.15.60:0/1754634501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3700709a0 msgr2=0x7ff370070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 --2- 172.21.15.60:0/1754634501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3700709a0 0x7ff370070e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff35c004940 tx=0x7ff35c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 -- 172.21.15.60:0/1754634501 shutdown_connections 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 --2- 172.21.15.60:0/1754634501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3700709a0 0x7ff370070e10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 --2- 172.21.15.60:0/1754634501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370071f50 0x7ff370070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 -- 172.21.15.60:0/1754634501 >> 172.21.15.60:0/1754634501 conn(0x7ff3700f8530 msgr2=0x7ff3700fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 -- 172.21.15.60:0/1754634501 shutdown_connections 2024-04-12T13:45:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.372+0000 7ff375600700 1 -- 172.21.15.60:0/1754634501 wait complete. 2024-04-12T13:45:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.373+0000 7ff375600700 1 Processor -- start 2024-04-12T13:45:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff375600700 1 -- start start 2024-04-12T13:45:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff375600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff375600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370114720 0x7ff370115570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff375600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370114be0 con 0x7ff370071f50 2024-04-12T13:45:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff375600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370114d20 con 0x7ff370114720 2024-04-12T13:45:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.374+0000 7ff36ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33238/0 (socket says 172.21.15.60:33238) 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36ea00700 1 -- 172.21.15.60:0/1944354162 learned_addr learned my addr 172.21.15.60:0/1944354162 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36e000700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370114720 0x7ff370115570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36ea00700 1 -- 172.21.15.60:0/1944354162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370114720 msgr2=0x7ff370115570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36ea00700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370114720 0x7ff370115570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.375+0000 7ff36ea00700 1 -- 172.21.15.60:0/1944354162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c005040 con 0x7ff370071f50 2024-04-12T13:45:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff36ea00700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff360002a50 tx=0x7ff360004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff360007cc0 con 0x7ff370071f50 2024-04-12T13:45:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff36000f040 con 0x7ff370071f50 2024-04-12T13:45:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff370115bd0 con 0x7ff370071f50 2024-04-12T13:45:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff36000da40 con 0x7ff370071f50 2024-04-12T13:45:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.376+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff370116160 con 0x7ff370071f50 2024-04-12T13:45:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.377+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37005f5f0 con 0x7ff370071f50 2024-04-12T13:45:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.379+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7ff3600097c0 con 0x7ff370071f50 2024-04-12T13:45:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.381+0000 7ff366a00700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 0x7ff3540711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.381+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff36008ebd0 con 0x7ff370071f50 2024-04-12T13:45:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.381+0000 7ff36e000700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 0x7ff3540711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.382+0000 7ff36e000700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 0x7ff3540711d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00b970 tx=0x7ff35c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:21.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.384+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff36008ee60 con 0x7ff370071f50 2024-04-12T13:45:21.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.646+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3700ffbb0 con 0x7ff35406ed20 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.648+0000 7ff366a00700 1 -- 172.21.15.60:0/1944354162 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff3700ffbb0 con 0x7ff35406ed20 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:45:21.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:45:21.652 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "3/21 daemons upgraded", 2024-04-12T13:45:21.652 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:45:21.652 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:45:21.652 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:45:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.651+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 msgr2=0x7ff3540711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.651+0000 7ff375600700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 0x7ff3540711d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00b970 tx=0x7ff35c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.651+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 msgr2=0x7ff3701141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.651+0000 7ff375600700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff360002a50 tx=0x7ff360004600 comp rx=0 tx=0).stop 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 shutdown_connections 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff35406ed20 0x7ff3540711d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff370071f50 0x7ff3701141e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 --2- 172.21.15.60:0/1944354162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370114720 0x7ff370115570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 >> 172.21.15.60:0/1944354162 conn(0x7ff3700f8530 msgr2=0x7ff3700f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 shutdown_connections 2024-04-12T13:45:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.652+0000 7ff375600700 1 -- 172.21.15.60:0/1944354162 wait complete. 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 -- 172.21.15.60:0/2649415016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8071ea0 msgr2=0x7f53d80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 --2- 172.21.15.60:0/2649415016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8071ea0 0x7f53d80703b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53cc004940 tx=0x7f53cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 -- 172.21.15.60:0/2649415016 shutdown_connections 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 --2- 172.21.15.60:0/2649415016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d80708f0 0x7f53d8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 --2- 172.21.15.60:0/2649415016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8071ea0 0x7f53d80703b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 -- 172.21.15.60:0/2649415016 >> 172.21.15.60:0/2649415016 conn(0x7f53d80f8530 msgr2=0x7f53d80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 -- 172.21.15.60:0/2649415016 shutdown_connections 2024-04-12T13:45:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.807+0000 7f53e0600700 1 -- 172.21.15.60:0/2649415016 wait complete. 2024-04-12T13:45:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.808+0000 7f53e0600700 1 Processor -- start 2024-04-12T13:45:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.809+0000 7f53e0600700 1 -- start start 2024-04-12T13:45:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.809+0000 7f53e0600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.809+0000 7f53e0600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d8071ea0 0x7f53d81101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.809+0000 7f53e0600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81107a0 con 0x7f53d80708f0 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.809+0000 7f53e0600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8110ff0 con 0x7f53d8071ea0 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.810+0000 7f53ddc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.810+0000 7f53ddc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33268/0 (socket says 172.21.15.60:33268) 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.810+0000 7f53ddc00700 1 -- 172.21.15.60:0/1033756914 learned_addr learned my addr 172.21.15.60:0/1033756914 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.810+0000 7f53dd200700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d8071ea0 0x7f53d81101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.810+0000 7f53ddc00700 1 -- 172.21.15.60:0/1033756914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d8071ea0 msgr2=0x7f53d81101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:21.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.811+0000 7f53ddc00700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d8071ea0 0x7f53d81101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:21.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.811+0000 7f53ddc00700 1 -- 172.21.15.60:0/1033756914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc005040 con 0x7f53d80708f0 2024-04-12T13:45:21.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.811+0000 7f53ddc00700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b970 tx=0x7f53cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:21.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.812+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53cc00e040 con 0x7f53d80708f0 2024-04-12T13:45:21.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.812+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53cc00bbf0 con 0x7f53d80708f0 2024-04-12T13:45:21.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.812+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53cc01c3f0 con 0x7f53d80708f0 2024-04-12T13:45:21.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.812+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d8111270 con 0x7f53d80708f0 2024-04-12T13:45:21.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.812+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81117b0 con 0x7f53d80708f0 2024-04-12T13:45:21.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.813+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d805f5f0 con 0x7f53d80708f0 2024-04-12T13:45:21.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.817+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f53cc00bd60 con 0x7f53d80708f0 2024-04-12T13:45:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.818+0000 7f53d5600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 0x7f53c00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.818+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f53cc08ff60 con 0x7f53d80708f0 2024-04-12T13:45:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.819+0000 7f53dd200700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 0x7f53c00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.820+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f53cc05c720 con 0x7f53d80708f0 2024-04-12T13:45:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:21.820+0000 7f53dd200700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 0x7f53c00711d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004f40 tx=0x7f53c400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:22.112 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:21 smithi110 ceph-mon[36055]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:22.112 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:21 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/615691693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:22.140 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:21 smithi060 ceph-mon[94333]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:22.141 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:21 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/615691693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.151+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f53d8107af0 con 0x7f53d80708f0 2024-04-12T13:45:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.152+0000 7f53d5600700 1 -- 172.21.15.60:0/1033756914 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f53cc05c2b0 con 0x7f53d80708f0 2024-04-12T13:45:22.154 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:45:22.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 msgr2=0x7f53c00711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:22.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 0x7f53c00711d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c4004f40 tx=0x7f53c400b040 comp rx=0 tx=0).stop 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 msgr2=0x7f53d810fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b970 tx=0x7f53cc009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 shutdown_connections 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f53c006ed20 0x7f53c00711d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d80708f0 0x7f53d810fc60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 --2- 172.21.15.60:0/1033756914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d8071ea0 0x7f53d81101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 >> 172.21.15.60:0/1033756914 conn(0x7f53d80f8530 msgr2=0x7f53d80f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 shutdown_connections 2024-04-12T13:45:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:22.156+0000 7f53e0600700 1 -- 172.21.15.60:0/1033756914 wait complete. 2024-04-12T13:45:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:22 smithi060 ceph-mon[94333]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-12T13:45:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:22 smithi060 ceph-mon[94333]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:23.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:22 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1033756914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:23.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:23.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:23.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:22 smithi110 ceph-mon[36055]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-12T13:45:23.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:22 smithi110 ceph-mon[36055]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:23.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:22 smithi110 ceph-mon[36055]: from='client.? 172.21.15.60:0/1033756914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:23.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:22 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:23.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:22 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:24 smithi060 ceph-mon[94333]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-12T13:45:25.194 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:24 smithi110 ceph-mon[36055]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-12T13:45:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:45:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:45:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:26 smithi060 ceph-mon[94333]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:45:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:45:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.conf 2024-04-12T13:45:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:26 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-12T13:45:27.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:27 smithi060 ceph-mon[94333]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:45:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:27 smithi060 ceph-mon[94333]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:45:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:27 smithi060 ceph-mon[94333]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:45:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:27 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:45:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:27 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T13:45:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:27 smithi110 ceph-mon[36055]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:45:28.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:28 smithi060 ceph-mon[94333]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:45:28.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:28 smithi060 ceph-mon[94333]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-12T13:45:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:28 smithi060 ceph-mon[94333]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:45:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:28 smithi060 ceph-mon[94333]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:45:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:28 smithi110 ceph-mon[36055]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-04-12T13:45:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:28 smithi110 ceph-mon[36055]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-12T13:45:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:28 smithi110 ceph-mon[36055]: Updating smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:45:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:28 smithi110 ceph-mon[36055]: Updating smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T13:45:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:28 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:29.834 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.834 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.834 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:29.835 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:29 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T13:45:29.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:29.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:29.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:29.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:29.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T13:45:30.865 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:30 smithi110 ceph-mon[36055]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:45:30.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:30 smithi060 ceph-mon[94333]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T13:45:31.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:31 smithi060 ceph-mon[94333]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:31.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:31.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:45:31.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:45:31.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:31.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:31 smithi110 ceph-mon[36055]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T13:45:31.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:31 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:31.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:31 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:45:31.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:31 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:45:31.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:31 smithi110 ceph-mon[36055]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:32 smithi110 ceph-mon[36055]: Upgrade: Updating mon.smithi110 2024-04-12T13:45:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:32 smithi110 ceph-mon[36055]: Deploying daemon mon.smithi110 on smithi110 2024-04-12T13:45:32.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:32 smithi060 ceph-mon[94333]: Upgrade: Updating mon.smithi110 2024-04-12T13:45:32.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:32 smithi060 ceph-mon[94333]: Deploying daemon mon.smithi110 on smithi110 2024-04-12T13:45:33.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:33 smithi060 ceph-mon[94333]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:33.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:33 smithi110 ceph-mon[36055]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:33.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:33 smithi110 systemd[1]: Stopping Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:45:34.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:34 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110[36042]: 2024-04-12T13:45:34.087+0000 7f050fe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi110 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:45:34.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:34 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110[36042]: 2024-04-12T13:45:34.087+0000 7f050fe00700 -1 mon.smithi110@1(peon) e2 *** Got Signal Terminated *** 2024-04-12T13:45:34.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:34 smithi110 podman[81971]: 2024-04-12 13:45:34.304624355 +0000 UTC m=+0.358610417 container died 0a064e4e9b78b61136ac1cf89729b6d6517b0a673fa5a22594be03a5ade7bc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-64502-quincy-2-730340d) 2024-04-12T13:45:34.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:34 smithi110 podman[81971]: 2024-04-12 13:45:34.805562981 +0000 UTC m=+0.859549037 container cleanup 0a064e4e9b78b61136ac1cf89729b6d6517b0a673fa5a22594be03a5ade7bc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, RELEASE=wip-64502-quincy-2-730340d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-12T13:45:34.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:34 smithi110 bash[81971]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110 2024-04-12T13:45:35.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:35 smithi110 podman[81985]: 2024-04-12 13:45:35.265043364 +0000 UTC m=+0.948126324 container remove 0a064e4e9b78b61136ac1cf89729b6d6517b0a673fa5a22594be03a5ade7bc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=wip-64502-quincy-2-730340d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:45:35.905 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:35 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi110.service: Deactivated successfully. 2024-04-12T13:45:35.906 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:35 smithi110 systemd[1]: Stopped Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:45:35.906 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:35 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi110.service: Consumed 15.279s CPU time. 2024-04-12T13:45:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:35 smithi110 systemd[1]: Starting Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:45:36.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 podman[82112]: 2024-04-12 13:45:36.160485492 +0000 UTC m=+0.034904880 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:45:36.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 podman[82112]: 2024-04-12 13:45:36.28315606 +0000 UTC m=+0.157575510 container create ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:45:36.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 podman[82112]: 2024-04-12 13:45:36.503482843 +0000 UTC m=+0.377902269 container init ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-12T13:45:36.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 podman[82112]: 2024-04-12 13:45:36.514087185 +0000 UTC m=+0.388506611 container start ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, ceph=True, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev), process ceph-mon, pid 2 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: pidfile_write: ignore empty --pid-file 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: load: jerasure load: lrc 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: RocksDB version: 7.9.2 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Git sha 0 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Compile date 2024-04-06 20:28:24 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: DB SUMMARY 2024-04-12T13:45:36.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: DB Session ID: 8I3VH104G79A0U3HPQQI 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: CURRENT file: CURRENT 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1083 Bytes 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi110/store.db dir, Total Num: 1, files: 000027.sst 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi110/store.db: 000025.log size: 6858516 ; 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.error_if_exists: 0 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.create_if_missing: 0 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.paranoid_checks: 1 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-12T13:45:36.582 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.env: 0x561841264c60 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.fs: PosixFileSystem 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.info_log: 0x56185de53ae0 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.statistics: (nil) 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.use_fsync: 0 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_log_file_size: 0 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_fallocate: 1 2024-04-12T13:45:36.583 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.use_direct_reads: 0 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.db_log_dir: 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.wal_dir: 2024-04-12T13:45:36.584 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T13:45:36.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T13:45:36.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T13:45:36.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T13:45:36.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.write_buffer_manager: 0x56185de241e0 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T13:45:36.586 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.unordered_write: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.row_cache: None 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.wal_filter: None 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.two_write_queues: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.wal_compression: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.atomic_flush: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T13:45:36.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.log_readahead_size: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_background_jobs: 2 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_background_compactions: -1 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_subcompactions: 1 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T13:45:36.588 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_open_files: -1 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_background_flushes: -1 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Compression algorithms supported: 2024-04-12T13:45:36.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kZSTD supported: 0 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kXpressCompression supported: 0 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kZlibCompression supported: 1 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kSnappyCompression supported: 1 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kLZ4Compression supported: 1 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: kBZip2Compression supported: 0 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000009 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T13:45:36.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.merge_operator: 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_filter: None 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56185de53cc0) 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_type: 0 2024-04-12T13:45:36.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_index_type: 0 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_shortening: 1 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: checksum: 4 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: no_block_cache: 0 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache: 0x56185de57090 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_options: 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: capacity : 536870912 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: num_shard_bits : 4 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: strict_capacity_limit : 0 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_compressed: (nil) 2024-04-12T13:45:36.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: persistent_cache: (nil) 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size: 4096 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size_deviation: 10 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_restart_interval: 16 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_block_restart_interval: 1 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: metadata_block_size: 4096 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: partition_filters: 0 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: use_delta_encoding: 1 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: filter_policy: bloomfilter 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: whole_key_filtering: 1 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: verify_compression: 0 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: format_version: 5 2024-04-12T13:45:36.593 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_index_compression: 1 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_align: 0 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_auto_readahead_size: 262144 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: prepopulate_block_cache: 0 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: initial_auto_readahead_size: 8192 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: num_file_reads_for_auto_readahead: 2 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression: NoCompression 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.num_levels: 7 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T13:45:36.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T13:45:36.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T13:45:36.596 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.arena_block_size: 1048576 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T13:45:36.597 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.inplace_update_support: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.bloom_locality: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.max_successive_merges: 0 2024-04-12T13:45:36.598 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.ttl: 2592000 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enable_blob_files: false 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.min_blob_size: 0 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T13:45:36.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.blob_file_starting_level: 0 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12207, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6216b561-6004-47eb-9b71-bebaa6d36b5d 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929536572125, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-12T13:45:36.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-12T13:45:36.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929536598565, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4159062, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12212, "largest_seqno": 14432, "table_properties": {"data_size": 4149915, "index_size": 5476, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2629, "raw_key_size": 22517, "raw_average_key_size": 21, "raw_value_size": 4129701, "raw_average_value_size": 3944, "num_data_blocks": 249, "num_entries": 1047, "num_filter_entries": 1047, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712929536, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6216b561-6004-47eb-9b71-bebaa6d36b5d", "db_session_id": "8I3VH104G79A0U3HPQQI", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-12T13:45:36.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712929536598746, "job": 1, "event": "recovery_finished"} 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi110/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56185df46000 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: DB pointer 0x56185df30000 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** DB Stats ** 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T13:45:36.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L0 1/0 3.97 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 510.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Sum 2/0 9.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 510.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 510.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 510.7 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative compaction: 0.00 GB write, 123.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:45:36.982 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval compaction: 0.00 GB write, 123.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Block cache BinnedLRUCache@0x56185de57090#2 capacity: 512.00 MB usage: 8.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.78 KB,0.000530481%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: starting mon.smithi110 rank 1 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi110 fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???) e2 preinit fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).mds e13 new map 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).mds e13 print_map 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: e13 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: legacy client fscid: 1 2024-04-12T13:45:36.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Filesystem 'cephfs' (1) 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: fs_name cephfs 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: epoch 13 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: tableserver 0 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: root 0 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: session_timeout 60 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: session_autoclose 300 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_file_size 1099511627776 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_xattr_size 65536 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: required_client_features {} 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: last_failure 0 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: last_failure_osd_epoch 0 2024-04-12T13:45:36.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_mds 1 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: in 0 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: up {0=14444} 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: failed 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: damaged 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: stopped 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_pools [3] 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: metadata_pool 2 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: inline_data disabled 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: balancer 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: bal_rank_mask -1 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: standby_count_wanted 1 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: qdb_cluster leader: 0 members: 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:36.985 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Standby daemons: 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 ceph-mon[82130]: mon.smithi110@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 bash[82112]: ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 2024-04-12T13:45:36.986 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:36 smithi110 systemd[1]: Started Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:45:38.932 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:38.932 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:38.932 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: mgrmap e37: smithi060.bpzacg(active, since 24s), standbys: smithi110.ezwdax 2024-04-12T13:45:38.932 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:45:38.932 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: mon.smithi110 calling monitor election 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: mon.smithi060 calling monitor election 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: monmap epoch 3 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: last_changed 2024-04-12T13:45:37.618906+0000 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: created 2024-04-12T13:29:08.011338+0000 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: min_mon_release 19 (squid) 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: election_strategy: 1 2024-04-12T13:45:38.933 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: mgrmap e37: smithi060.bpzacg(active, since 24s), standbys: smithi110.ezwdax 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:38.934 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: mgrmap e37: smithi060.bpzacg(active, since 24s), standbys: smithi110.ezwdax 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: mon.smithi110 calling monitor election 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: mon.smithi060 calling monitor election 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-04-12T13:45:38.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: mon.smithi060 is new leader, mons smithi060,smithi110 in quorum (ranks 0,1) 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: monmap epoch 3 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: last_changed 2024-04-12T13:45:37.618906+0000 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: created 2024-04-12T13:29:08.011338+0000 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: min_mon_release 19 (squid) 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: election_strategy: 1 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T13:45:38.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: mgrmap e37: smithi060.bpzacg(active, since 24s), standbys: smithi110.ezwdax 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:38.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:45:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:39 smithi110 ceph-mon[82130]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:39 smithi060 ceph-mon[94333]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:41.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:41 smithi060 ceph-mon[94333]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:41.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:41 smithi110 ceph-mon[82130]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:43 smithi060 ceph-mon[94333]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:43 smithi110 ceph-mon[82130]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:44.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:44.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:44.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:44.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:44.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:44.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:44.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:44.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:45.363 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:45 smithi110 ceph-mon[82130]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:45.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:45 smithi060 ceph-mon[94333]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:47.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:47 smithi060 ceph-mon[94333]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:47.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:47 smithi110 ceph-mon[82130]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:49 smithi060 ceph-mon[94333]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:45:49.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:49 smithi110 ceph-mon[82130]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:49.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:49.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:49.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:49.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:45:50.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:50.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:50.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:50.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:45:50.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:45:50.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:50.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:50.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:45:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:45:50.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:51.853 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:51 smithi060 ceph-mon[94333]: Reconfiguring mon.smithi060 (monmap changed)... 2024-04-12T13:45:51.853 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:51 smithi060 ceph-mon[94333]: Reconfiguring daemon mon.smithi060 on smithi060 2024-04-12T13:45:51.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:51 smithi110 ceph-mon[82130]: Reconfiguring mon.smithi060 (monmap changed)... 2024-04-12T13:45:51.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:51 smithi110 ceph-mon[82130]: Reconfiguring daemon mon.smithi060 on smithi060 2024-04-12T13:45:52.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.329+0000 7f1a28600700 1 -- 172.21.15.60:0/3744817461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 msgr2=0x7f1a20070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.329+0000 7f1a28600700 1 --2- 172.21.15.60:0/3744817461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a20070350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a14004940 tx=0x7f1a14009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 -- 172.21.15.60:0/3744817461 shutdown_connections 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 --2- 172.21.15.60:0/3744817461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 0x7f1a20070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 --2- 172.21.15.60:0/3744817461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a20070350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 -- 172.21.15.60:0/3744817461 >> 172.21.15.60:0/3744817461 conn(0x7f1a200f8530 msgr2=0x7f1a200fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 -- 172.21.15.60:0/3744817461 shutdown_connections 2024-04-12T13:45:52.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.330+0000 7f1a28600700 1 -- 172.21.15.60:0/3744817461 wait complete. 2024-04-12T13:45:52.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 Processor -- start 2024-04-12T13:45:52.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 -- start start 2024-04-12T13:45:52.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 0x7f1a2010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201107a0 con 0x7f1a20071e40 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.331+0000 7f1a28600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20110ff0 con 0x7f1a20070890 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55948/0 (socket says 172.21.15.60:55948) 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 -- 172.21.15.60:0/4086113983 learned_addr learned my addr 172.21.15.60:0/4086113983 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25c00700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 0x7f1a2010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 -- 172.21.15.60:0/4086113983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 msgr2=0x7f1a2010fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 0x7f1a2010fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.332+0000 7f1a25200700 1 -- 172.21.15.60:0/4086113983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14005040 con 0x7f1a20071e40 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a25200700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c8c0 tx=0x7f1a0c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0c00a760 con 0x7f1a20071e40 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a0c00ad90 con 0x7f1a20071e40 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0c0113a0 con 0x7f1a20071e40 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a201112d0 con 0x7f1a20071e40 2024-04-12T13:45:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.333+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20111810 con 0x7f1a20071e40 2024-04-12T13:45:52.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.335+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2005f5f0 con 0x7f1a20071e40 2024-04-12T13:45:52.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.336+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f1a0c012400 con 0x7f1a20071e40 2024-04-12T13:45:52.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.337+0000 7f1a1d600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 0x7f1a080711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.337+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1a0c08e950 con 0x7f1a20071e40 2024-04-12T13:45:52.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.338+0000 7f1a25c00700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 0x7f1a080711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.338+0000 7f1a25c00700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 0x7f1a080711d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000c00 tx=0x7f1a14009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:52.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.348+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1a0c05b220 con 0x7f1a20071e40 2024-04-12T13:45:52.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.591+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a20111c60 con 0x7f1a0806ed20 2024-04-12T13:45:52.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.593+0000 7f1a1d600700 1 -- 172.21.15.60:0/4086113983 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1a20111c60 con 0x7f1a0806ed20 2024-04-12T13:45:52.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 msgr2=0x7f1a080711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 0x7f1a080711d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000c00 tx=0x7f1a14009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 msgr2=0x7f1a201101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00c8c0 tx=0x7f1a0c0044c0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 shutdown_connections 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a0806ed20 0x7f1a080711d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a20070890 0x7f1a2010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 --2- 172.21.15.60:0/4086113983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a20071e40 0x7f1a201101a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.596+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 >> 172.21.15.60:0/4086113983 conn(0x7f1a200f8530 msgr2=0x7f1a200f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:52.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.597+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 shutdown_connections 2024-04-12T13:45:52.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.597+0000 7f1a28600700 1 -- 172.21.15.60:0/4086113983 wait complete. 2024-04-12T13:45:52.614 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:45:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 -- 172.21.15.60:0/3894310729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 msgr2=0x7f80a40fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 --2- 172.21.15.60:0/3894310729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a40fe4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8090004940 tx=0x7f8090009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 -- 172.21.15.60:0/3894310729 shutdown_connections 2024-04-12T13:45:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 --2- 172.21.15.60:0/3894310729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a40fe4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 --2- 172.21.15.60:0/3894310729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 0x7f80a40fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.746+0000 7f80aba00700 1 -- 172.21.15.60:0/3894310729 >> 172.21.15.60:0/3894310729 conn(0x7f80a40f8530 msgr2=0x7f80a40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.747+0000 7f80aba00700 1 -- 172.21.15.60:0/3894310729 shutdown_connections 2024-04-12T13:45:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.747+0000 7f80aba00700 1 -- 172.21.15.60:0/3894310729 wait complete. 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 Processor -- start 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 -- start start 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 0x7f80a4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40708c0 con 0x7f80a40fe040 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.748+0000 7f80aba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4070a30 con 0x7f80a40fce40 2024-04-12T13:45:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55972/0 (socket says 172.21.15.60:55972) 2024-04-12T13:45:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 -- 172.21.15.60:0/147697814 learned_addr learned my addr 172.21.15.60:0/147697814 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a9000700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 0x7f80a4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 -- 172.21.15.60:0/147697814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 msgr2=0x7f80a4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 0x7f80a4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.749+0000 7f80a3e00700 1 -- 172.21.15.60:0/147697814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090005040 con 0x7f80a40fe040 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80a3e00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f809000b3b0 tx=0x7f8090009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809000e040 con 0x7f80a40fe040 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8090004290 con 0x7f80a40fe040 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a4070cb0 con 0x7f80a40fe040 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a4115a70 con 0x7f80a40fe040 2024-04-12T13:45:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.750+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809001c630 con 0x7f80a40fe040 2024-04-12T13:45:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.752+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a405f5f0 con 0x7f80a40fe040 2024-04-12T13:45:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.753+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f809000bbf0 con 0x7f80a40fe040 2024-04-12T13:45:52.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.753+0000 7f80a0c00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 0x7f808c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:52.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.754+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f809008fea0 con 0x7f80a40fe040 2024-04-12T13:45:52.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.754+0000 7f80a9000700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 0x7f808c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:52.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.755+0000 7f80a9000700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 0x7f808c0711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fd0 tx=0x7f8098009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:52.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:52.759+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f8090058b50 con 0x7f80a40fe040 2024-04-12T13:45:52.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:52.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:52.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:52.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:45:52.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:45:52.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:52.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:52.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:52.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:52.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.bpzacg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:45:52.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:45:52.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:53.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.027+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80a41023b0 con 0x7f808c06ed20 2024-04-12T13:45:53.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.029+0000 7f80a0c00700 1 -- 172.21.15.60:0/147697814 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f80a41023b0 con 0x7f808c06ed20 2024-04-12T13:45:53.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.031+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 msgr2=0x7f808c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.031+0000 7f80aba00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 0x7f808c0711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fd0 tx=0x7f8098009f00 comp rx=0 tx=0).stop 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 msgr2=0x7f80a4070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f809000b3b0 tx=0x7f8090009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 shutdown_connections 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f808c06ed20 0x7f808c0711d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80a40fce40 0x7f80a4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 --2- 172.21.15.60:0/147697814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a40fe040 0x7f80a4070310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 >> 172.21.15.60:0/147697814 conn(0x7f80a40f8530 msgr2=0x7f80a40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:53.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 shutdown_connections 2024-04-12T13:45:53.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.032+0000 7f80aba00700 1 -- 172.21.15.60:0/147697814 wait complete. 2024-04-12T13:45:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 -- 172.21.15.60:0/2351082937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 msgr2=0x7f3de00ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 --2- 172.21.15.60:0/2351082937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de00ff480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0004940 tx=0x7f3dd0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 -- 172.21.15.60:0/2351082937 shutdown_connections 2024-04-12T13:45:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 --2- 172.21.15.60:0/2351082937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 0x7f3de0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 --2- 172.21.15.60:0/2351082937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de00ff480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.178+0000 7f3de5c00700 1 -- 172.21.15.60:0/2351082937 >> 172.21.15.60:0/2351082937 conn(0x7f3de00fa950 msgr2=0x7f3de00fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.179+0000 7f3de5c00700 1 -- 172.21.15.60:0/2351082937 shutdown_connections 2024-04-12T13:45:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.179+0000 7f3de5c00700 1 -- 172.21.15.60:0/2351082937 wait complete. 2024-04-12T13:45:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 Processor -- start 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 -- start start 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 0x7f3de0110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0110750 con 0x7f3de00ff070 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3de5c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0110fa0 con 0x7f3de0100320 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3ddea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3ddea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55994/0 (socket says 172.21.15.60:55994) 2024-04-12T13:45:53.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.180+0000 7f3ddea00700 1 -- 172.21.15.60:0/1161048851 learned_addr learned my addr 172.21.15.60:0/1161048851 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3dd6000700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 0x7f3de0110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3ddea00700 1 -- 172.21.15.60:0/1161048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 msgr2=0x7f3de0110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3ddea00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 0x7f3de0110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3ddea00700 1 -- 172.21.15.60:0/1161048851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0005040 con 0x7f3de00ff070 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3ddea00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009150 tx=0x7f3dd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:53.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.181+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd000e040 con 0x7f3de00ff070 2024-04-12T13:45:53.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.182+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dd000bbf0 con 0x7f3de00ff070 2024-04-12T13:45:53.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.182+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd001c630 con 0x7f3de00ff070 2024-04-12T13:45:53.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.182+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0111220 con 0x7f3de00ff070 2024-04-12T13:45:53.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.182+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0111760 con 0x7f3de00ff070 2024-04-12T13:45:53.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.183+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de005f5f0 con 0x7f3de00ff070 2024-04-12T13:45:53.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.184+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f3dd000bd60 con 0x7f3de00ff070 2024-04-12T13:45:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.185+0000 7f3dd7400700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 0x7f3dc00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.185+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3dd008fff0 con 0x7f3de00ff070 2024-04-12T13:45:53.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.185+0000 7f3dd6000700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 0x7f3dc00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.186+0000 7f3dd6000700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 0x7f3dc00711d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007fd0 tx=0x7f3dc8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.189+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f3dd005c7b0 con 0x7f3de00ff070 2024-04-12T13:45:53.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.432+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3de0111ab0 con 0x7f3dc006ed20 2024-04-12T13:45:53.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.459+0000 7f3dd7400700 1 -- 172.21.15.60:0/1161048851 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3de0111ab0 con 0x7f3dc006ed20 2024-04-12T13:45:53.462 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (3m) 33s ago 14m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (15m) 33s ago 15m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (13m) 11s ago 13m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 33s ago 14m - - 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (7m) 33s ago 7m 13.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (7m) 33s ago 7m 136M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (7m) 11s ago 7m 13.7M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (7m) 11s ago 7m 13.6M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (2m) 33s ago 16m 477M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (88s) 11s ago 13m 449M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (65s) 33s ago 16m 32.9M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (17s) 11s ago 13m 22.6M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (4m) 33s ago 14m 8066k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:45:53.463 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (2m) 11s ago 13m 7977k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (12m) 33s ago 12m 228M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (11m) 33s ago 11m 246M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (11m) 33s ago 11m 207M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (10m) 11s ago 10m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (9m) 11s ago 9m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (9m) 11s ago 9m 226M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:45:53.464 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (97s) 33s ago 14m 51.7M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:45:53.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 msgr2=0x7f3dc00711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 0x7f3dc00711d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007fd0 tx=0x7f3dc8009040 comp rx=0 tx=0).stop 2024-04-12T13:45:53.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 msgr2=0x7f3de010fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009150 tx=0x7f3dd0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:53.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 shutdown_connections 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3dc006ed20 0x7f3dc00711d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3de00ff070 0x7f3de010fc10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 --2- 172.21.15.60:0/1161048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3de0100320 0x7f3de0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.462+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 >> 172.21.15.60:0/1161048851 conn(0x7f3de00fa950 msgr2=0x7f3de00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.463+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 shutdown_connections 2024-04-12T13:45:53.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.463+0000 7f3de5c00700 1 -- 172.21.15.60:0/1161048851 wait complete. 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 -- 172.21.15.60:0/400807451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c0ff000 msgr2=0x7f8f2c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 --2- 172.21.15.60:0/400807451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c0ff410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f20004940 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 -- 172.21.15.60:0/400807451 shutdown_connections 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 --2- 172.21.15.60:0/400807451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 --2- 172.21.15.60:0/400807451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c0ff410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 -- 172.21.15.60:0/400807451 >> 172.21.15.60:0/400807451 conn(0x7f8f2c0fa790 msgr2=0x7f8f2c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 -- 172.21.15.60:0/400807451 shutdown_connections 2024-04-12T13:45:53.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.615+0000 7f8f33a00700 1 -- 172.21.15.60:0/400807451 wait complete. 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.616+0000 7f8f33a00700 1 Processor -- start 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.616+0000 7f8f33a00700 1 -- start start 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f33a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f33a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f33a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c110700 con 0x7f8f2c1002b0 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f33a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1150a0 con 0x7f8f2c0ff000 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56010/0 (socket says 172.21.15.60:56010) 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 -- 172.21.15.60:0/1025443418 learned_addr learned my addr 172.21.15.60:0/1025443418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f31000700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 -- 172.21.15.60:0/1025443418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 msgr2=0x7f8f2c10fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c10fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f2be00700 1 -- 172.21.15.60:0/1025443418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20005040 con 0x7f8f2c1002b0 2024-04-12T13:45:53.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.617+0000 7f8f31000700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f2be00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b790 tx=0x7f8f18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1800f770 con 0x7f8f2c1002b0 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f1800fda0 con 0x7f8f2c1002b0 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c115300 con 0x7f8f2c1002b0 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1800d310 con 0x7f8f2c1002b0 2024-04-12T13:45:53.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.618+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c115870 con 0x7f8f2c1002b0 2024-04-12T13:45:53.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.619+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c04c710 con 0x7f8f2c1002b0 2024-04-12T13:45:53.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.620+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f8f18010420 con 0x7f8f2c1002b0 2024-04-12T13:45:53.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.621+0000 7f8f28c00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 0x7f8f140711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:53.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.622+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8f1808e960 con 0x7f8f2c1002b0 2024-04-12T13:45:53.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.622+0000 7f8f31000700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 0x7f8f140711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:53.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.623+0000 7f8f31000700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 0x7f8f140711e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000b7a0 tx=0x7f8f20009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.626+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f8f1805b230 con 0x7f8f2c1002b0 2024-04-12T13:45:53.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:53 smithi060 ceph-mon[94333]: Reconfiguring mgr.smithi060.bpzacg (monmap changed)... 2024-04-12T13:45:53.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:53 smithi060 ceph-mon[94333]: Reconfiguring daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:45:53.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:53 smithi060 ceph-mon[94333]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:53.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.951+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f2c107b70 con 0x7f8f2c1002b0 2024-04-12T13:45:53.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.952+0000 7f8f28c00700 1 -- 172.21.15.60:0/1025443418 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f8f1805adc0 con 0x7f8f2c1002b0 2024-04-12T13:45:53.955 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:45:53.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:45:53.955 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:45:53.956 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:45:53.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:53.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:45:53.957 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:45:53.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:45:53.957 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:45:53.958 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 10, 2024-04-12T13:45:53.958 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:45:53.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:45:53.958 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:45:53.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 msgr2=0x7f8f140711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 0x7f8f140711e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000b7a0 tx=0x7f8f20009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 msgr2=0x7f8f2c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b790 tx=0x7f8f18009250 comp rx=0 tx=0).stop 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 shutdown_connections 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8f1406ed30 0x7f8f140711e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f2c0ff000 0x7f8f2c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 --2- 172.21.15.60:0/1025443418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f2c1002b0 0x7f8f2c110070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:53.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.955+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 >> 172.21.15.60:0/1025443418 conn(0x7f8f2c0fa790 msgr2=0x7f8f2c0fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:53.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.956+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 shutdown_connections 2024-04-12T13:45:53.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:53.956+0000 7f8f33a00700 1 -- 172.21.15.60:0/1025443418 wait complete. 2024-04-12T13:45:53.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:53 smithi110 ceph-mon[82130]: Reconfiguring mgr.smithi060.bpzacg (monmap changed)... 2024-04-12T13:45:53.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:53 smithi110 ceph-mon[82130]: Reconfiguring daemon mgr.smithi060.bpzacg on smithi060 2024-04-12T13:45:53.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:53 smithi110 ceph-mon[82130]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 -- 172.21.15.60:0/1676492776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56480fef00 msgr2=0x7f56480ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 --2- 172.21.15.60:0/1676492776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56480fef00 0x7f56480ff310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f563c004940 tx=0x7f563c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 -- 172.21.15.60:0/1676492776 shutdown_connections 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 --2- 172.21.15.60:0/1676492776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5648100070 0x7f56481004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 --2- 172.21.15.60:0/1676492776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56480fef00 0x7f56480ff310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 -- 172.21.15.60:0/1676492776 >> 172.21.15.60:0/1676492776 conn(0x7f56480fa790 msgr2=0x7f56480fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 -- 172.21.15.60:0/1676492776 shutdown_connections 2024-04-12T13:45:54.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.114+0000 7f564e800700 1 -- 172.21.15.60:0/1676492776 wait complete. 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.115+0000 7f564e800700 1 Processor -- start 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.115+0000 7f564e800700 1 -- start start 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480fef00 0x7f564810fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564e800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564e800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648110570 con 0x7f5648100070 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564e800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648110dc0 con 0x7f56480fef00 2024-04-12T13:45:54.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564ca00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564ca00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56036/0 (socket says 172.21.15.60:56036) 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564ca00700 1 -- 172.21.15.60:0/1933400364 learned_addr learned my addr 172.21.15.60:0/1933400364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564d400700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480fef00 0x7f564810fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564ca00700 1 -- 172.21.15.60:0/1933400364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480fef00 msgr2=0x7f564810fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.116+0000 7f564ca00700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480fef00 0x7f564810fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f564ca00700 1 -- 172.21.15.60:0/1933400364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c005040 con 0x7f5648100070 2024-04-12T13:45:54.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f564ca00700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5634002a50 tx=0x7f56340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5634007cc0 con 0x7f5648100070 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f563400f040 con 0x7f5648100070 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56481110a0 con 0x7f5648100070 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5634009640 con 0x7f5648100070 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.117+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481115e0 con 0x7f5648100070 2024-04-12T13:45:54.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.118+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480fe290 con 0x7f5648100070 2024-04-12T13:45:54.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.120+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f56340097a0 con 0x7f5648100070 2024-04-12T13:45:54.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.121+0000 7f5645600700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 0x7f56300711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.121+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f563408e790 con 0x7f5648100070 2024-04-12T13:45:54.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.121+0000 7f564d400700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 0x7f56300711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.122+0000 7f564d400700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 0x7f56300711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f563c000c00 tx=0x7f563c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:54.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.126+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f563405af70 con 0x7f5648100070 2024-04-12T13:45:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.414+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5648111900 con 0x7f5648100070 2024-04-12T13:45:54.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.415+0000 7f5645600700 1 -- 172.21.15.60:0/1933400364 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f563408ce60 con 0x7f5648100070 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:54.419 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:45:54.420 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:45:54.421 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:54.422 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 msgr2=0x7f56300711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 0x7f56300711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f563c000c00 tx=0x7f563c009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 msgr2=0x7f564810ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5634002a50 tx=0x7f56340046b0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 shutdown_connections 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f563006ed30 0x7f56300711e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56480fef00 0x7f564810fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 --2- 172.21.15.60:0/1933400364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648100070 0x7f564810ff70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.418+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 >> 172.21.15.60:0/1933400364 conn(0x7f56480fa790 msgr2=0x7f56480fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.419+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 shutdown_connections 2024-04-12T13:45:54.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.419+0000 7f564e800700 1 -- 172.21.15.60:0/1933400364 wait complete. 2024-04-12T13:45:54.424 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:45:54.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.576+0000 7f270c200700 1 -- 172.21.15.60:0/3791893765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 msgr2=0x7f27041001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.576+0000 7f270c200700 1 --2- 172.21.15.60:0/3791893765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041001e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26f0004940 tx=0x7f26f0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:54.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 -- 172.21.15.60:0/3791893765 shutdown_connections 2024-04-12T13:45:54.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 --2- 172.21.15.60:0/3791893765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041001e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 --2- 172.21.15.60:0/3791893765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 0x7f27040fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 -- 172.21.15.60:0/3791893765 >> 172.21.15.60:0/3791893765 conn(0x7f27040f74c0 msgr2=0x7f27040f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 -- 172.21.15.60:0/3791893765 shutdown_connections 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.577+0000 7f270c200700 1 -- 172.21.15.60:0/3791893765 wait complete. 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 Processor -- start 2024-04-12T13:45:54.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 -- start start 2024-04-12T13:45:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 0x7f2704114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704114ba0 con 0x7f27040fdd60 2024-04-12T13:45:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.578+0000 7f270c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27041153f0 con 0x7f27040662f0 2024-04-12T13:45:54.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56050/0 (socket says 172.21.15.60:56050) 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 -- 172.21.15.60:0/1070586486 learned_addr learned my addr 172.21.15.60:0/1070586486 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2709800700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 0x7f2704114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 -- 172.21.15.60:0/1070586486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 msgr2=0x7f2704114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 0x7f2704114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.579+0000 7f2708e00700 1 -- 172.21.15.60:0/1070586486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0005040 con 0x7f27040fdd60 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f2708e00700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009150 tx=0x7f26f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f000e040 con 0x7f27040fdd60 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26f000bbf0 con 0x7f27040fdd60 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2704115670 con 0x7f27040fdd60 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f001c630 con 0x7f27040fdd60 2024-04-12T13:45:54.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.580+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2704115bb0 con 0x7f27040fdd60 2024-04-12T13:45:54.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.582+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270405f5f0 con 0x7f27040fdd60 2024-04-12T13:45:54.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.583+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f26f000bd60 con 0x7f27040fdd60 2024-04-12T13:45:54.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.584+0000 7f2701600700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 0x7f26ec0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.584+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f26f008ff50 con 0x7f27040fdd60 2024-04-12T13:45:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.585+0000 7f2709800700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 0x7f26ec0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:54.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.585+0000 7f2709800700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 0x7f26ec0711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2704066030 tx=0x7f26f8009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:54.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.590+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f26f005c690 con 0x7f27040fdd60 2024-04-12T13:45:54.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.846+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2704115ee0 con 0x7f26ec06ed20 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1025443418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1933400364' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:45:54.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:54.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.850+0000 7f2701600700 1 -- 172.21.15.60:0/1070586486 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f2704115ee0 con 0x7f26ec06ed20 2024-04-12T13:45:54.852 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:45:54.852 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:45:54.852 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:45:54.852 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "4/21 daemons upgraded", 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mon daemons", 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:45:54.853 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 msgr2=0x7f26ec0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 0x7f26ec0711d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2704066030 tx=0x7f26f8009ee0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 msgr2=0x7f27041145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009150 tx=0x7f26f0009e30 comp rx=0 tx=0).stop 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 shutdown_connections 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f26ec06ed20 0x7f26ec0711d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27040662f0 0x7f2704114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 --2- 172.21.15.60:0/1070586486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27040fdd60 0x7f27041145a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.852+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 >> 172.21.15.60:0/1070586486 conn(0x7f27040f74c0 msgr2=0x7f27040f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.853+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 shutdown_connections 2024-04-12T13:45:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:54.853+0000 7f270c200700 1 -- 172.21.15.60:0/1070586486 wait complete. 2024-04-12T13:45:54.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1025443418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1933400364' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:45:54.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 -- 172.21.15.60:0/2939826636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 msgr2=0x7f17300ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 --2- 172.21.15.60:0/2939826636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f17300ffa30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ce0 tx=0x7f1720004d10 comp rx=0 tx=0).stop 2024-04-12T13:45:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 -- 172.21.15.60:0/2939826636 shutdown_connections 2024-04-12T13:45:55.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 --2- 172.21.15.60:0/2939826636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 --2- 172.21.15.60:0/2939826636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f17300ffa30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 -- 172.21.15.60:0/2939826636 >> 172.21.15.60:0/2939826636 conn(0x7f17300f74c0 msgr2=0x7f17300f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 -- 172.21.15.60:0/2939826636 shutdown_connections 2024-04-12T13:45:55.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.009+0000 7f1735c00700 1 -- 172.21.15.60:0/2939826636 wait complete. 2024-04-12T13:45:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.010+0000 7f1735c00700 1 Processor -- start 2024-04-12T13:45:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.010+0000 7f1735c00700 1 -- start start 2024-04-12T13:45:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f1735c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:55.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f1735c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f1735c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730111100 con 0x7f17300662f0 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f1735c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730111270 con 0x7f17300fff70 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f172ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f172ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56068/0 (socket says 172.21.15.60:56068) 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f172ea00700 1 -- 172.21.15.60:0/2058768392 learned_addr learned my addr 172.21.15.60:0/2058768392 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.011+0000 7f172e000700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f172ea00700 1 -- 172.21.15.60:0/2058768392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 msgr2=0x7f1730110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f172ea00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f172ea00700 1 -- 172.21.15.60:0/2058768392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009940 con 0x7f17300662f0 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f172e000700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f172ea00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1720009380 tx=0x7f1720004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f172000e040 con 0x7f17300662f0 2024-04-12T13:45:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17200128e0 con 0x7f17300662f0 2024-04-12T13:45:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17301114f0 con 0x7f17300662f0 2024-04-12T13:45:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.012+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f172001c9f0 con 0x7f17300662f0 2024-04-12T13:45:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.013+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1730111ab0 con 0x7f17300662f0 2024-04-12T13:45:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.014+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17300f8ff0 con 0x7f17300662f0 2024-04-12T13:45:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.015+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f1720012a50 con 0x7f17300662f0 2024-04-12T13:45:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.016+0000 7f1726a00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 0x7f17140711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:45:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.016+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f17200907c0 con 0x7f17300662f0 2024-04-12T13:45:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.016+0000 7f172e000700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 0x7f17140711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:45:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.017+0000 7f172e000700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 0x7f17140711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f171c007fd0 tx=0x7f171c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:45:55.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.020+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1720059350 con 0x7f17300662f0 2024-04-12T13:45:55.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.344+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1730106110 con 0x7f17300662f0 2024-04-12T13:45:55.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.345+0000 7f1726a00700 1 -- 172.21.15.60:0/2058768392 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f172005ca10 con 0x7f17300662f0 2024-04-12T13:45:55.348 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:45:55.348 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:45:55.348 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:45:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 msgr2=0x7f17140711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 0x7f17140711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f171c007fd0 tx=0x7f171c009040 comp rx=0 tx=0).stop 2024-04-12T13:45:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 msgr2=0x7f173010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:45:55.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1720009380 tx=0x7f1720004d10 comp rx=0 tx=0).stop 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 shutdown_connections 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f171406ed20 0x7f17140711d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17300662f0 0x7f173010fe20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 --2- 172.21.15.60:0/2058768392 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17300fff70 0x7f1730110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 >> 172.21.15.60:0/2058768392 conn(0x7f17300f74c0 msgr2=0x7f17300fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 shutdown_connections 2024-04-12T13:45:55.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:45:55.348+0000 7f1735c00700 1 -- 172.21.15.60:0/2058768392 wait complete. 2024-04-12T13:45:55.893 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:55 smithi060 ceph-mon[94333]: Reconfiguring crash.smithi060 (monmap changed)... 2024-04-12T13:45:55.893 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:55 smithi060 ceph-mon[94333]: Reconfiguring daemon crash.smithi060 on smithi060 2024-04-12T13:45:55.893 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:55 smithi060 ceph-mon[94333]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:55.893 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:55 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2058768392' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:55.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:55 smithi110 ceph-mon[82130]: Reconfiguring crash.smithi060 (monmap changed)... 2024-04-12T13:45:55.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:55 smithi110 ceph-mon[82130]: Reconfiguring daemon crash.smithi060 on smithi060 2024-04-12T13:45:55.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:55 smithi110 ceph-mon[82130]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:45:55.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:55 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2058768392' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:45:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:56 smithi060 ceph-mon[94333]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:56 smithi110 ceph-mon[82130]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: Reconfiguring osd.0 (monmap changed)... 2024-04-12T13:45:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:45:57.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:57.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:57 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.0 on smithi060 2024-04-12T13:45:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:45:57.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: Reconfiguring osd.0 (monmap changed)... 2024-04-12T13:45:57.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:45:57.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:45:57.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:57 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.0 on smithi060 2024-04-12T13:45:58.898 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:58 smithi060 ceph-mon[94333]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:58.898 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:45:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:45:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:58 smithi110 ceph-mon[82130]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:45:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:45:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: Reconfiguring osd.1 (monmap changed)... 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.1 on smithi060 2024-04-12T13:46:00.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:00 smithi110 ceph-mon[82130]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:00.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:00.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:00.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: Reconfiguring osd.1 (monmap changed)... 2024-04-12T13:46:00.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:46:00.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:00.596 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.1 on smithi060 2024-04-12T13:46:00.596 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:00 smithi060 ceph-mon[94333]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: Reconfiguring osd.2 (monmap changed)... 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:03.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:02 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.2 on smithi060 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: Reconfiguring osd.2 (monmap changed)... 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:02 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.2 on smithi060 2024-04-12T13:46:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:04 smithi060 ceph-mon[94333]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:05.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:05.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:04 smithi110 ceph-mon[82130]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:05.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:05.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:05.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:05.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:06.076 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:05 smithi060 ceph-mon[94333]: Reconfiguring mds.cephfs.smithi060.mwwohl (monmap changed)... 2024-04-12T13:46:06.077 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:05 smithi060 ceph-mon[94333]: Reconfiguring daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:46:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:05 smithi110 ceph-mon[82130]: Reconfiguring mds.cephfs.smithi060.mwwohl (monmap changed)... 2024-04-12T13:46:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:05 smithi110 ceph-mon[82130]: Reconfiguring daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:46:07.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:06 smithi060 ceph-mon[94333]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:07.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:06 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:07.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:06 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:07.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:06 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:07.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:06 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:06 smithi110 ceph-mon[82130]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:06 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:06 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:06 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:06 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:07 smithi060 ceph-mon[94333]: Reconfiguring mds.cephfs.smithi060.epmcph (monmap changed)... 2024-04-12T13:46:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:07 smithi060 ceph-mon[94333]: Reconfiguring daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:46:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:07 smithi110 ceph-mon[82130]: Reconfiguring mds.cephfs.smithi060.epmcph (monmap changed)... 2024-04-12T13:46:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:07 smithi110 ceph-mon[82130]: Reconfiguring daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:46:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:08 smithi060 ceph-mon[94333]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:08 smithi110 ceph-mon[82130]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:10.216 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:10.216 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:10.216 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:10.216 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:10 smithi060 ceph-mon[94333]: Reconfiguring crash.smithi110 (monmap changed)... 2024-04-12T13:46:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:10 smithi060 ceph-mon[94333]: Reconfiguring daemon crash.smithi110 on smithi110 2024-04-12T13:46:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:10 smithi060 ceph-mon[94333]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:10 smithi110 ceph-mon[82130]: Reconfiguring crash.smithi110 (monmap changed)... 2024-04-12T13:46:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:10 smithi110 ceph-mon[82130]: Reconfiguring daemon crash.smithi110 on smithi110 2024-04-12T13:46:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:10 smithi110 ceph-mon[82130]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:12.615 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: Reconfiguring mgr.smithi110.ezwdax (monmap changed)... 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: Reconfiguring daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:46:12.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:12 smithi110 ceph-mon[82130]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: Reconfiguring mgr.smithi110.ezwdax (monmap changed)... 2024-04-12T13:46:12.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.ezwdax", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T13:46:12.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T13:46:12.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:12.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: Reconfiguring daemon mgr.smithi110.ezwdax on smithi110 2024-04-12T13:46:12.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:12 smithi060 ceph-mon[94333]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:13.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:46:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:46:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T13:46:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T13:46:14.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:15.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:15 smithi060 ceph-mon[94333]: Reconfiguring mon.smithi110 (monmap changed)... 2024-04-12T13:46:15.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:15 smithi060 ceph-mon[94333]: Reconfiguring daemon mon.smithi110 on smithi110 2024-04-12T13:46:15.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:15 smithi110 ceph-mon[82130]: Reconfiguring mon.smithi110 (monmap changed)... 2024-04-12T13:46:15.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:15 smithi110 ceph-mon[82130]: Reconfiguring daemon mon.smithi110 on smithi110 2024-04-12T13:46:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:16 smithi110 ceph-mon[82130]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:16.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:16.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:46:16.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:16 smithi060 ceph-mon[94333]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:46:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:17.644 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:17 smithi110 ceph-mon[82130]: Reconfiguring osd.3 (monmap changed)... 2024-04-12T13:46:17.644 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:17 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.3 on smithi110 2024-04-12T13:46:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:17 smithi060 ceph-mon[94333]: Reconfiguring osd.3 (monmap changed)... 2024-04-12T13:46:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:17 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.3 on smithi110 2024-04-12T13:46:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:18 smithi110 ceph-mon[82130]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:18.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:18 smithi060 ceph-mon[94333]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:20.117 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:20.117 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:20.117 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: Reconfiguring osd.4 (monmap changed)... 2024-04-12T13:46:20.117 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:46:20.118 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:20.118 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:19 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.4 on smithi110 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: Reconfiguring osd.4 (monmap changed)... 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:19 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.4 on smithi110 2024-04-12T13:46:20.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:20 smithi110 ceph-mon[82130]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:21.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:20 smithi060 ceph-mon[94333]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:22.481 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:22.481 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:22.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: Reconfiguring osd.5 (monmap changed)... 2024-04-12T13:46:22.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:46:22.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:22.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: Reconfiguring daemon osd.5 on smithi110 2024-04-12T13:46:22.482 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:22 smithi110 ceph-mon[82130]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:22.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: Reconfiguring osd.5 (monmap changed)... 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: Reconfiguring daemon osd.5 on smithi110 2024-04-12T13:46:22.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:22 smithi060 ceph-mon[94333]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:24.886 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: Reconfiguring mds.cephfs.smithi110.getdvx (monmap changed)... 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:24.887 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:24 smithi110 ceph-mon[82130]: Reconfiguring daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: Reconfiguring mds.cephfs.smithi110.getdvx (monmap changed)... 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:24 smithi060 ceph-mon[94333]: Reconfiguring daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 -- 172.21.15.60:0/806581126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 msgr2=0x7fb2e40fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/806581126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e40fd250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4004940 tx=0x7fb2d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 -- 172.21.15.60:0/806581126 shutdown_connections 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/806581126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e40fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/806581126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e40fd250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 -- 172.21.15.60:0/806581126 >> 172.21.15.60:0/806581126 conn(0x7fb2e40f8530 msgr2=0x7fb2e40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:25.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 -- 172.21.15.60:0/806581126 shutdown_connections 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.521+0000 7fb2eaa00700 1 -- 172.21.15.60:0/806581126 wait complete. 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.522+0000 7fb2eaa00700 1 Processor -- start 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.522+0000 7fb2eaa00700 1 -- start start 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2eaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2eaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e4110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2eaa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4110f60 con 0x7fb2e40fce40 2024-04-12T13:46:25.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2eaa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41110d0 con 0x7fb2e40fe040 2024-04-12T13:46:25.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50704/0 (socket says 172.21.15.60:50704) 2024-04-12T13:46:25.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2e3e00700 1 -- 172.21.15.60:0/3260838210 learned_addr learned my addr 172.21.15.60:0/3260838210 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.523+0000 7fb2e3e00700 1 -- 172.21.15.60:0/3260838210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 msgr2=0x7fb2e4110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2e3400700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e4110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2e3e00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e4110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2e3e00700 1 -- 172.21.15.60:0/3260838210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4005040 con 0x7fb2e40fce40 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2e3400700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2e3e00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400b970 tx=0x7fb2d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d400e040 con 0x7fb2e40fce40 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2d400bbf0 con 0x7fb2e40fce40 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4111350 con 0x7fb2e40fce40 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d401c630 con 0x7fb2e40fce40 2024-04-12T13:46:25.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.524+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4111910 con 0x7fb2e40fce40 2024-04-12T13:46:25.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.526+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e41019d0 con 0x7fb2e40fce40 2024-04-12T13:46:25.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.527+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fb2d400bd60 con 0x7fb2e40fce40 2024-04-12T13:46:25.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.528+0000 7fb2dbe00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 0x7fb2c80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.528+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb2d408fe00 con 0x7fb2e40fce40 2024-04-12T13:46:25.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.528+0000 7fb2e3400700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 0x7fb2c80711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.529+0000 7fb2e3400700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 0x7fb2c80711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0006fd0 tx=0x7fb2d0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:25.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.533+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fb2d405c5c0 con 0x7fb2e40fce40 2024-04-12T13:46:25.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.771+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e4111d50 con 0x7fb2c806ed20 2024-04-12T13:46:25.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.774+0000 7fb2dbe00700 1 -- 172.21.15.60:0/3260838210 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb2e4111d50 con 0x7fb2c806ed20 2024-04-12T13:46:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 msgr2=0x7fb2c80711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 0x7fb2c80711d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0006fd0 tx=0x7fb2d0008040 comp rx=0 tx=0).stop 2024-04-12T13:46:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 msgr2=0x7fb2e410fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400b970 tx=0x7fb2d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 shutdown_connections 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb2c806ed20 0x7fb2c80711d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2e40fce40 0x7fb2e410fd10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 --2- 172.21.15.60:0/3260838210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40fe040 0x7fb2e4110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.776+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 >> 172.21.15.60:0/3260838210 conn(0x7fb2e40f8530 msgr2=0x7fb2e40f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.777+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 shutdown_connections 2024-04-12T13:46:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.777+0000 7fb2eaa00700 1 -- 172.21.15.60:0/3260838210 wait complete. 2024-04-12T13:46:25.793 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:46:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 -- 172.21.15.60:0/1869668956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 msgr2=0x7efe4c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 --2- 172.21.15.60:0/1869668956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c070460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe40009ce0 tx=0x7efe40004d10 comp rx=0 tx=0).stop 2024-04-12T13:46:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 -- 172.21.15.60:0/1869668956 shutdown_connections 2024-04-12T13:46:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 --2- 172.21.15.60:0/1869668956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 0x7efe4c070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 --2- 172.21.15.60:0/1869668956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c070460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.933+0000 7efe53600700 1 -- 172.21.15.60:0/1869668956 >> 172.21.15.60:0/1869668956 conn(0x7efe4c0f8530 msgr2=0x7efe4c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.934+0000 7efe53600700 1 -- 172.21.15.60:0/1869668956 shutdown_connections 2024-04-12T13:46:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.934+0000 7efe53600700 1 -- 172.21.15.60:0/1869668956 wait complete. 2024-04-12T13:46:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 Processor -- start 2024-04-12T13:46:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 -- start start 2024-04-12T13:46:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 0x7efe4c114250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c114e20 con 0x7efe4c071f50 2024-04-12T13:46:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.935+0000 7efe53600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c115610 con 0x7efe4c0709a0 2024-04-12T13:46:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50724/0 (socket says 172.21.15.60:50724) 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 -- 172.21.15.60:0/2830290875 learned_addr learned my addr 172.21.15.60:0/2830290875 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe50c00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 0x7efe4c114250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 -- 172.21.15.60:0/2830290875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 msgr2=0x7efe4c114250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 0x7efe4c114250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.936+0000 7efe4be00700 1 -- 172.21.15.60:0/2830290875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009940 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe4be00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe3800b790 tx=0x7efe38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3800f770 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe3800fda0 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3800d310 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c1158f0 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.937+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c115eb0 con 0x7efe4c071f50 2024-04-12T13:46:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.938+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c05f5f0 con 0x7efe4c071f50 2024-04-12T13:46:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.940+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7efe38010420 con 0x7efe4c071f50 2024-04-12T13:46:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.940+0000 7efe48c00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 0x7efe340711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.941+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efe3808e960 con 0x7efe4c071f50 2024-04-12T13:46:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.941+0000 7efe50c00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 0x7efe340711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.941+0000 7efe50c00700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 0x7efe340711d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe40015040 tx=0x7efe40004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:25.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:25.945+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7efe3805b230 con 0x7efe4c071f50 2024-04-12T13:46:26.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.193+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe4c116290 con 0x7efe3406ed20 2024-04-12T13:46:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.195+0000 7efe48c00700 1 -- 172.21.15.60:0/2830290875 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efe4c116290 con 0x7efe3406ed20 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 msgr2=0x7efe340711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 0x7efe340711d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe40015040 tx=0x7efe40004d10 comp rx=0 tx=0).stop 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 msgr2=0x7efe4c114790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe3800b790 tx=0x7efe38009250 comp rx=0 tx=0).stop 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 shutdown_connections 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7efe3406ed20 0x7efe340711d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe4c0709a0 0x7efe4c114250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 --2- 172.21.15.60:0/2830290875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe4c071f50 0x7efe4c114790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.198+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 >> 172.21.15.60:0/2830290875 conn(0x7efe4c0f8530 msgr2=0x7efe4c0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:26.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.199+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 shutdown_connections 2024-04-12T13:46:26.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.199+0000 7efe53600700 1 -- 172.21.15.60:0/2830290875 wait complete. 2024-04-12T13:46:26.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 -- 172.21.15.60:0/1161245028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58070870 msgr2=0x7f8b58070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1161245028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58070870 0x7f8b58070ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b44004940 tx=0x7f8b44009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:26.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 -- 172.21.15.60:0/1161245028 shutdown_connections 2024-04-12T13:46:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1161245028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58070870 0x7f8b58070ce0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1161245028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58071e20 0x7f8b58070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 -- 172.21.15.60:0/1161245028 >> 172.21.15.60:0/1161245028 conn(0x7f8b580f8580 msgr2=0x7f8b580fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 -- 172.21.15.60:0/1161245028 shutdown_connections 2024-04-12T13:46:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.352+0000 7f8b5e000700 1 -- 172.21.15.60:0/1161245028 wait complete. 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.353+0000 7f8b5e000700 1 Processor -- start 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b5e000700 1 -- start start 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b5e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b5e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 0x7f8b5810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b5e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581105e0 con 0x7f8b58071e20 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b5e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58110750 con 0x7f8b58070870 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.354+0000 7f8b56a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 0x7f8b5810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b57400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b57400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:39906/0 (socket says 172.21.15.60:39906) 2024-04-12T13:46:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b57400700 1 -- 172.21.15.60:0/1517092390 learned_addr learned my addr 172.21.15.60:0/1517092390 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b56a00700 1 -- 172.21.15.60:0/1517092390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 msgr2=0x7f8b5810faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b56a00700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b56a00700 1 -- 172.21.15.60:0/1517092390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44005040 con 0x7f8b58071e20 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b57400700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.355+0000 7f8b56a00700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 0x7f8b5810ffe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b44004940 tx=0x7f8b44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.356+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4400e030 con 0x7f8b58071e20 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.356+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b44009430 con 0x7f8b58071e20 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.356+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4400b410 con 0x7f8b58071e20 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.356+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b58115150 con 0x7f8b58071e20 2024-04-12T13:46:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.356+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b58115690 con 0x7f8b58071e20 2024-04-12T13:46:26.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.357+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5804c710 con 0x7f8b58071e20 2024-04-12T13:46:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.358+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f8b4401c870 con 0x7f8b58071e20 2024-04-12T13:46:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.359+0000 7f8b4f400700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 0x7f8b3c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.359+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8b44090330 con 0x7f8b58071e20 2024-04-12T13:46:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.359+0000 7f8b57400700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 0x7f8b3c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.360+0000 7f8b57400700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 0x7f8b3c0711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800f6a0 tx=0x7f8b4800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:26.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.363+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f8b4405cbb0 con 0x7f8b58071e20 2024-04-12T13:46:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.598+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b58103e80 con 0x7f8b3c06ed30 2024-04-12T13:46:26.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.630+0000 7f8b4f400700 1 -- 172.21.15.60:0/1517092390 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8b58103e80 con 0x7f8b3c06ed30 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (4m) 66s ago 15m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (15m) 66s ago 15m 6656k - 17.2.7-845-g730340d7 036a68d49952 1e33e6052ce3 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (14m) 44s ago 14m 6660k - 17.2.7-845-g730340d7 036a68d49952 6f30d57b1383 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 66s ago 14m - - 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (8m) 66s ago 7m 13.5M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (8m) 66s ago 8m 136M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (8m) 44s ago 8m 13.7M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:46:26.632 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (7m) 44s ago 7m 13.6M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (3m) 66s ago 17m 477M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (2m) 44s ago 13m 449M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (98s) 66s ago 17m 32.9M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (50s) 44s ago 13m 22.6M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (4m) 66s ago 15m 8066k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (3m) 44s ago 14m 7977k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (12m) 66s ago 12m 228M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (12m) 66s ago 12m 246M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (11m) 66s ago 11m 207M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (11m) 44s ago 11m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (10m) 44s ago 10m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (9m) 44s ago 9m 226M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:46:26.633 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 66s ago 14m 51.7M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:46:26.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 msgr2=0x7f8b3c0711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 0x7f8b3c0711e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800f6a0 tx=0x7f8b4800b040 comp rx=0 tx=0).stop 2024-04-12T13:46:26.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 msgr2=0x7f8b5810ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 0x7f8b5810ffe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b44004940 tx=0x7f8b44009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 shutdown_connections 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b3c06ed30 0x7f8b3c0711e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b58070870 0x7f8b5810faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 --2- 172.21.15.60:0/1517092390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b58071e20 0x7f8b5810ffe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 >> 172.21.15.60:0/1517092390 conn(0x7f8b580f8580 msgr2=0x7f8b580f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 shutdown_connections 2024-04-12T13:46:26.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.634+0000 7f8b5e000700 1 -- 172.21.15.60:0/1517092390 wait complete. 2024-04-12T13:46:26.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.778+0000 7f327ea00700 1 -- 172.21.15.60:0/1286824002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 msgr2=0x7f32781004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.778+0000 7f327ea00700 1 --2- 172.21.15.60:0/1286824002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f32781004e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3264004940 tx=0x7f3264009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 -- 172.21.15.60:0/1286824002 shutdown_connections 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 --2- 172.21.15.60:0/1286824002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f32781004e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 --2- 172.21.15.60:0/1286824002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 0x7f32780ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 -- 172.21.15.60:0/1286824002 >> 172.21.15.60:0/1286824002 conn(0x7f32780fa790 msgr2=0x7f32780fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 -- 172.21.15.60:0/1286824002 shutdown_connections 2024-04-12T13:46:26.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.779+0000 7f327ea00700 1 -- 172.21.15.60:0/1286824002 wait complete. 2024-04-12T13:46:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 Processor -- start 2024-04-12T13:46:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 -- start start 2024-04-12T13:46:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 0x7f327810fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32781105b0 con 0x7f3278100070 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278110e00 con 0x7f32780fef00 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50750/0 (socket says 172.21.15.60:50750) 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.780+0000 7f327cc00700 1 -- 172.21.15.60:0/2307376795 learned_addr learned my addr 172.21.15.60:0/2307376795 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327d600700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 0x7f327810fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327cc00700 1 -- 172.21.15.60:0/2307376795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 msgr2=0x7f327810fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327cc00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 0x7f327810fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327cc00700 1 -- 172.21.15.60:0/2307376795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264005040 con 0x7f3278100070 2024-04-12T13:46:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327cc00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f326400b3b0 tx=0x7f3264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326400e040 con 0x7f3278100070 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3264004290 con 0x7f3278100070 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.781+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3278111080 con 0x7f3278100070 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.782+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326401c630 con 0x7f3278100070 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.782+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32781115c0 con 0x7f3278100070 2024-04-12T13:46:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.783+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780fe290 con 0x7f3278100070 2024-04-12T13:46:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.784+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f326400bbf0 con 0x7f3278100070 2024-04-12T13:46:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.785+0000 7f3275600700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 0x7f32600711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.785+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f326408fdb0 con 0x7f3278100070 2024-04-12T13:46:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.785+0000 7f327d600700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 0x7f32600711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:26.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.786+0000 7f327d600700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 0x7f32600711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f326c007fd0 tx=0x7f326c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:26.789+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f326405c630 con 0x7f3278100070 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:26.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:46:26.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.099+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f327804bed0 con 0x7f3278100070 2024-04-12T13:46:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.100+0000 7f3275600700 1 -- 172.21.15.60:0/2307376795 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f326405c1c0 con 0x7f3278100070 2024-04-12T13:46:27.102 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:46:27.102 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:46:27.103 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:46:27.104 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:46:27.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:46:27.104 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:46:27.104 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:46:27.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:46:27.105 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:46:27.105 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 10, 2024-04-12T13:46:27.105 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:46:27.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:46:27.106 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:46:27.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 msgr2=0x7f32600711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 0x7f32600711e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f326c007fd0 tx=0x7f326c009040 comp rx=0 tx=0).stop 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 msgr2=0x7f327810ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f326400b3b0 tx=0x7f3264009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 shutdown_connections 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f326006ed30 0x7f32600711e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780fef00 0x7f327810fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 --2- 172.21.15.60:0/2307376795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3278100070 0x7f327810ffb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 >> 172.21.15.60:0/2307376795 conn(0x7f32780fa790 msgr2=0x7f32780fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 shutdown_connections 2024-04-12T13:46:27.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.103+0000 7f327ea00700 1 -- 172.21.15.60:0/2307376795 wait complete. 2024-04-12T13:46:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 -- 172.21.15.60:0/552481270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f14066290 msgr2=0x7f4f140ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 --2- 172.21.15.60:0/552481270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f14066290 0x7f4f140ffa90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f08004940 tx=0x7f4f08009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 -- 172.21.15.60:0/552481270 shutdown_connections 2024-04-12T13:46:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 --2- 172.21.15.60:0/552481270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f140fffd0 0x7f4f141023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 --2- 172.21.15.60:0/552481270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f14066290 0x7f4f140ffa90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 -- 172.21.15.60:0/552481270 >> 172.21.15.60:0/552481270 conn(0x7f4f140f74c0 msgr2=0x7f4f140f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.254+0000 7f4f1b400700 1 -- 172.21.15.60:0/552481270 shutdown_connections 2024-04-12T13:46:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.255+0000 7f4f1b400700 1 -- 172.21.15.60:0/552481270 wait complete. 2024-04-12T13:46:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.255+0000 7f4f1b400700 1 Processor -- start 2024-04-12T13:46:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.255+0000 7f4f1b400700 1 -- start start 2024-04-12T13:46:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f1b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f14066290 0x7f4f1410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f1b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f1b400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14110f60 con 0x7f4f140fffd0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f1b400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141110d0 con 0x7f4f14066290 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f13e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f13e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50766/0 (socket says 172.21.15.60:50766) 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.256+0000 7f4f13e00700 1 -- 172.21.15.60:0/434225402 learned_addr learned my addr 172.21.15.60:0/434225402 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f18a00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f14066290 0x7f4f1410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f13e00700 1 -- 172.21.15.60:0/434225402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f14066290 msgr2=0x7f4f1410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f13e00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f14066290 0x7f4f1410fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f13e00700 1 -- 172.21.15.60:0/434225402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08005040 con 0x7f4f140fffd0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f13e00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000b790 tx=0x7f4f00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0000f770 con 0x7f4f140fffd0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f0000fda0 con 0x7f4f140fffd0 2024-04-12T13:46:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0000d310 con 0x7f4f140fffd0 2024-04-12T13:46:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f141113b0 con 0x7f4f140fffd0 2024-04-12T13:46:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.257+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f14111970 con 0x7f4f140fffd0 2024-04-12T13:46:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.258+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1405f5f0 con 0x7f4f140fffd0 2024-04-12T13:46:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.260+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4f00010420 con 0x7f4f140fffd0 2024-04-12T13:46:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.260+0000 7f4f10c00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 0x7f4efc0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.261+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4f0008e960 con 0x7f4f140fffd0 2024-04-12T13:46:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.261+0000 7f4f18a00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 0x7f4efc0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.261+0000 7f4f18a00700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 0x7f4efc0711d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b3b0 tx=0x7f4f08009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:27.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.265+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f4f0005b230 con 0x7f4f140fffd0 2024-04-12T13:46:27.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.537+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f1404bed0 con 0x7f4f140fffd0 2024-04-12T13:46:27.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.538+0000 7f4f10c00700 1 -- 172.21.15.60:0/434225402 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f4f0005adc0 con 0x7f4f140fffd0 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:46:27.540 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:46:27.541 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:46:27.542 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:46:27.543 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 msgr2=0x7f4efc0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 0x7f4efc0711d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800b3b0 tx=0x7f4f08009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 msgr2=0x7f4f14110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000b790 tx=0x7f4f00009250 comp rx=0 tx=0).stop 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 shutdown_connections 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4efc06ed20 0x7f4efc0711d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f14066290 0x7f4f1410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 --2- 172.21.15.60:0/434225402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140fffd0 0x7f4f14110250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 >> 172.21.15.60:0/434225402 conn(0x7f4f140f74c0 msgr2=0x7f4f141003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.541+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 shutdown_connections 2024-04-12T13:46:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.542+0000 7f4f1b400700 1 -- 172.21.15.60:0/434225402 wait complete. 2024-04-12T13:46:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 -- 172.21.15.60:0/1818141361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76380708f0 msgr2=0x7f7638070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 --2- 172.21.15.60:0/1818141361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76380708f0 0x7f7638070d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7624004940 tx=0x7f7624009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 -- 172.21.15.60:0/1818141361 shutdown_connections 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 --2- 172.21.15.60:0/1818141361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76380708f0 0x7f7638070d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 --2- 172.21.15.60:0/1818141361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7638071ea0 0x7f76380703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 -- 172.21.15.60:0/1818141361 >> 172.21.15.60:0/1818141361 conn(0x7f76380f8530 msgr2=0x7f76380fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 -- 172.21.15.60:0/1818141361 shutdown_connections 2024-04-12T13:46:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.696+0000 7f763e200700 1 -- 172.21.15.60:0/1818141361 wait complete. 2024-04-12T13:46:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.697+0000 7f763e200700 1 Processor -- start 2024-04-12T13:46:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.697+0000 7f763e200700 1 -- start start 2024-04-12T13:46:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f763e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76380708f0 0x7f7638114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f763e200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f763e200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638114b90 con 0x7f7638071ea0 2024-04-12T13:46:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f763e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76381153e0 con 0x7f76380708f0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f7636a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f7636a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50776/0 (socket says 172.21.15.60:50776) 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f7636a00700 1 -- 172.21.15.60:0/635755480 learned_addr learned my addr 172.21.15.60:0/635755480 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f7637400700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76380708f0 0x7f7638114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.698+0000 7f7636a00700 1 -- 172.21.15.60:0/635755480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76380708f0 msgr2=0x7f7638114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.699+0000 7f7636a00700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76380708f0 0x7f7638114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.699+0000 7f7636a00700 1 -- 172.21.15.60:0/635755480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624005040 con 0x7f7638071ea0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.699+0000 7f7636a00700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f762400b3b0 tx=0x7f7624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.700+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762400e040 con 0x7f7638071ea0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.700+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7624004290 con 0x7f7638071ea0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.700+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762401c630 con 0x7f7638071ea0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.700+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7638115660 con 0x7f7638071ea0 2024-04-12T13:46:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.700+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7638115ba0 con 0x7f7638071ea0 2024-04-12T13:46:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.701+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763805f5f0 con 0x7f7638071ea0 2024-04-12T13:46:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.702+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f762400bbf0 con 0x7f7638071ea0 2024-04-12T13:46:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.703+0000 7f762f400700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 0x7f761c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.703+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f762408fe70 con 0x7f7638071ea0 2024-04-12T13:46:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.703+0000 7f7637400700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 0x7f761c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.704+0000 7f7637400700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 0x7f761c0711d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7628007fd0 tx=0x7f7628009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.708+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f762405c630 con 0x7f7638071ea0 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: Reconfiguring mds.cephfs.smithi110.zqdflr (monmap changed)... 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: Reconfiguring daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2307376795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:27 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/434225402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:46:27.960 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: Reconfiguring mds.cephfs.smithi110.zqdflr (monmap changed)... 2024-04-12T13:46:27.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: Reconfiguring daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:46:27.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:27.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:27.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2307376795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:27.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:27 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/434225402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:46:27.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.960+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7638115ed0 con 0x7f761c06ed20 2024-04-12T13:46:27.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.962+0000 7f762f400700 1 -- 172.21.15.60:0/635755480 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f7638115ed0 con 0x7f761c06ed20 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "4/21 daemons upgraded", 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mon daemons", 2024-04-12T13:46:27.964 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:46:27.965 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:46:27.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 msgr2=0x7f761c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 0x7f761c0711d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7628007fd0 tx=0x7f7628009040 comp rx=0 tx=0).stop 2024-04-12T13:46:27.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 msgr2=0x7f7638114590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:27.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f762400b3b0 tx=0x7f7624009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 shutdown_connections 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f761c06ed20 0x7f761c0711d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76380708f0 0x7f7638114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 --2- 172.21.15.60:0/635755480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7638071ea0 0x7f7638114590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 >> 172.21.15.60:0/635755480 conn(0x7f76380f8530 msgr2=0x7f76380f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 shutdown_connections 2024-04-12T13:46:27.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:27.965+0000 7f763e200700 1 -- 172.21.15.60:0/635755480 wait complete. 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 -- 172.21.15.60:0/2017760526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16800708f0 msgr2=0x7f1680070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 --2- 172.21.15.60:0/2017760526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16800708f0 0x7f1680070d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f166c004940 tx=0x7f166c009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 -- 172.21.15.60:0/2017760526 shutdown_connections 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 --2- 172.21.15.60:0/2017760526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16800708f0 0x7f1680070d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 --2- 172.21.15.60:0/2017760526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680071ea0 0x7f16800703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 -- 172.21.15.60:0/2017760526 >> 172.21.15.60:0/2017760526 conn(0x7f16800f8580 msgr2=0x7f16800fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:28.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 -- 172.21.15.60:0/2017760526 shutdown_connections 2024-04-12T13:46:28.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.118+0000 7f1686400700 1 -- 172.21.15.60:0/2017760526 wait complete. 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.119+0000 7f1686400700 1 Processor -- start 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.119+0000 7f1686400700 1 -- start start 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f1686400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16800708f0 0x7f1680114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f1686400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f1686400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680114bd0 con 0x7f1680071ea0 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f1686400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680115420 con 0x7f16800708f0 2024-04-12T13:46:28.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f167ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:28.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f167ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50796/0 (socket says 172.21.15.60:50796) 2024-04-12T13:46:28.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f167ea00700 1 -- 172.21.15.60:0/201506450 learned_addr learned my addr 172.21.15.60:0/201506450 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:28.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.120+0000 7f167f400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16800708f0 0x7f1680114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:28.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f167ea00700 1 -- 172.21.15.60:0/201506450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16800708f0 msgr2=0x7f1680114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:28.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f167ea00700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16800708f0 0x7f1680114090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f167ea00700 1 -- 172.21.15.60:0/201506450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c005040 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f167ea00700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f166c00b3b0 tx=0x7f166c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166c00e040 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f166c004290 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166c01c630 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.121+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16801156a0 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.122+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1680115be0 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.122+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168005f5f0 con 0x7f1680071ea0 2024-04-12T13:46:28.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.124+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f166c00bbf0 con 0x7f1680071ea0 2024-04-12T13:46:28.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.125+0000 7f1677400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 0x7f16640711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:28.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.125+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f166c08ff20 con 0x7f1680071ea0 2024-04-12T13:46:28.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.125+0000 7f167f400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 0x7f16640711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:28.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.125+0000 7f167f400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 0x7f16640711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1670009fd0 tx=0x7f1670009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:28.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.129+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f166c05c660 con 0x7f1680071ea0 2024-04-12T13:46:28.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.439+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f168004bed0 con 0x7f1680071ea0 2024-04-12T13:46:28.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.440+0000 7f1677400700 1 -- 172.21.15.60:0/201506450 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f166c05c1f0 con 0x7f1680071ea0 2024-04-12T13:46:28.442 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:46:28.442 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:46:28.442 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:46:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 msgr2=0x7f16640711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 0x7f16640711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1670009fd0 tx=0x7f1670009f00 comp rx=0 tx=0).stop 2024-04-12T13:46:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 msgr2=0x7f16801145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f166c00b3b0 tx=0x7f166c009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:28.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 shutdown_connections 2024-04-12T13:46:28.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f166406ed20 0x7f16640711d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16800708f0 0x7f1680114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 --2- 172.21.15.60:0/201506450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1680071ea0 0x7f16801145d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:28.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.443+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 >> 172.21.15.60:0/201506450 conn(0x7f16800f8580 msgr2=0x7f16800f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:28.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.444+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 shutdown_connections 2024-04-12T13:46:28.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:28.444+0000 7f1686400700 1 -- 172.21.15.60:0/201506450 wait complete. 2024-04-12T13:46:28.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/201506450' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]: dispatch 2024-04-12T13:46:28.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]': finished 2024-04-12T13:46:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/201506450' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:46:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]: dispatch 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]: dispatch 2024-04-12T13:46:29.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]': finished 2024-04-12T13:46:29.713 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:29 smithi060 ceph-mon[94333]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:29.714 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:29 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all mon 2024-04-12T13:46:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:29 smithi110 ceph-mon[82130]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:29 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all mon 2024-04-12T13:46:30.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:30 smithi060 ceph-mon[94333]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:30.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:30 smithi110 ceph-mon[82130]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:31.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:31 smithi060 ceph-mon[94333]: Upgrade: Updating crash.smithi060 (1/2) 2024-04-12T13:46:31.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:31.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:31.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:31.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:31 smithi060 ceph-mon[94333]: Deploying daemon crash.smithi060 on smithi060 2024-04-12T13:46:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:31 smithi110 ceph-mon[82130]: Upgrade: Updating crash.smithi060 (1/2) 2024-04-12T13:46:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:32.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:32.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:32.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:31 smithi110 ceph-mon[82130]: Deploying daemon crash.smithi060 on smithi060 2024-04-12T13:46:32.983 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:32 smithi060 ceph-mon[94333]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:32 smithi110 ceph-mon[82130]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:34 smithi060 ceph-mon[94333]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:34 smithi110 ceph-mon[82130]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:36 smithi060 ceph-mon[94333]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:36 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:36 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:37.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:36 smithi110 ceph-mon[82130]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:37.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:36 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:37.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:36 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:38.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:38 smithi060 ceph-mon[94333]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:38.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:38 smithi110 ceph-mon[82130]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:39.968 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:39 smithi110 ceph-mon[82130]: Upgrade: Updating crash.smithi110 (2/2) 2024-04-12T13:46:39.968 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:39 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:39.968 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:39 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:39.968 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:39 smithi110 ceph-mon[82130]: Deploying daemon crash.smithi110 on smithi110 2024-04-12T13:46:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:39 smithi060 ceph-mon[94333]: Upgrade: Updating crash.smithi110 (2/2) 2024-04-12T13:46:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:39 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T13:46:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:39 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:39 smithi060 ceph-mon[94333]: Deploying daemon crash.smithi110 on smithi110 2024-04-12T13:46:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:40 smithi110 ceph-mon[82130]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:40 smithi060 ceph-mon[94333]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:43.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:42 smithi060 ceph-mon[94333]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:43.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:42 smithi110 ceph-mon[82130]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:43.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:45.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:44 smithi060 ceph-mon[94333]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:45.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:45.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:45.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:46:45.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:44 smithi110 ceph-mon[82130]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:45.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:45.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:45.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:46:46.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:46 smithi110 ceph-mon[82130]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:46.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:46 smithi110 ceph-mon[82130]: mgrmap e38: smithi060.bpzacg(active, since 92s), standbys: smithi110.ezwdax 2024-04-12T13:46:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:46 smithi060 ceph-mon[94333]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:46 smithi060 ceph-mon[94333]: mgrmap e38: smithi060.bpzacg(active, since 92s), standbys: smithi110.ezwdax 2024-04-12T13:46:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:48 smithi060 ceph-mon[94333]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:48 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:48 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:49.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:48 smithi110 ceph-mon[82130]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:49.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:48 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:49.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:48 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:51.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:50 smithi060 ceph-mon[94333]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:51.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:51.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:50 smithi110 ceph-mon[82130]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:51.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:51 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:51 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:51 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.195 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:51 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.195 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:51 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.195 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:51 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:52.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:52 smithi110 ceph-mon[82130]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:53.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:52 smithi060 ceph-mon[94333]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:54.293 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:54.293 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:54.293 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:54 smithi060 ceph-mon[94333]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:54.297 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:54.297 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:54.297 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:54 smithi110 ceph-mon[82130]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:56 smithi110 ceph-mon[82130]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:56.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:56.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:57.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:56 smithi060 ceph-mon[94333]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T13:46:57.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:57.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 -- 172.21.15.60:0/87146402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 msgr2=0x7fb2b4104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 --2- 172.21.15.60:0/87146402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4104b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0004940 tx=0x7fb2a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 -- 172.21.15.60:0/87146402 shutdown_connections 2024-04-12T13:46:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 --2- 172.21.15.60:0/87146402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4104b40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 --2- 172.21.15.60:0/87146402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 0x7fb2b4103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 -- 172.21.15.60:0/87146402 >> 172.21.15.60:0/87146402 conn(0x7fb2b4072640 msgr2=0x7fb2b4074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 -- 172.21.15.60:0/87146402 shutdown_connections 2024-04-12T13:46:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.618+0000 7fb2b9400700 1 -- 172.21.15.60:0/87146402 wait complete. 2024-04-12T13:46:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 Processor -- start 2024-04-12T13:46:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 -- start start 2024-04-12T13:46:58.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 0x7fb2b4113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:58.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4114a90 con 0x7fb2b41046d0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.619+0000 7fb2b9400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4114c00 con 0x7fb2b4103420 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44216/0 (socket says 172.21.15.60:44216) 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 -- 172.21.15.60:0/2922510481 learned_addr learned my addr 172.21.15.60:0/2922510481 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b2800700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 0x7fb2b4113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 -- 172.21.15.60:0/2922510481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 msgr2=0x7fb2b4113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 0x7fb2b4113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 -- 172.21.15.60:0/2922510481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0005040 con 0x7fb2b41046d0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.620+0000 7fb2b1e00700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009150 tx=0x7fb2a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.621+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a000e040 con 0x7fb2b41046d0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.621+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2a000bcc0 con 0x7fb2b41046d0 2024-04-12T13:46:58.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.621+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4119600 con 0x7fb2b41046d0 2024-04-12T13:46:58.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.621+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a001c630 con 0x7fb2b41046d0 2024-04-12T13:46:58.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.621+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4119bc0 con 0x7fb2b41046d0 2024-04-12T13:46:58.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.622+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b404c710 con 0x7fb2b41046d0 2024-04-12T13:46:58.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.624+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb2a0013420 con 0x7fb2b41046d0 2024-04-12T13:46:58.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.624+0000 7fb2aaa00700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 0x7fb2980710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:58.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.625+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb2a008f3b0 con 0x7fb2b41046d0 2024-04-12T13:46:58.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.625+0000 7fb2b2800700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 0x7fb2980710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:58.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.626+0000 7fb2b2800700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 0x7fb2980710b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4007fd0 tx=0x7fb2a4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:58.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.630+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fb2a005be50 con 0x7fb2b41046d0 2024-04-12T13:46:58.814 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:58 smithi060 ceph-mon[94333]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:58.815 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:58.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.885+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2b4108a10 con 0x7fb29806ec00 2024-04-12T13:46:58.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.887+0000 7fb2aaa00700 1 -- 172.21.15.60:0/2922510481 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fb2b4108a10 con 0x7fb29806ec00 2024-04-12T13:46:58.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.890+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 msgr2=0x7fb2980710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:58.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.890+0000 7fb2b9400700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 0x7fb2980710b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4007fd0 tx=0x7fb2a4009040 comp rx=0 tx=0).stop 2024-04-12T13:46:58.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.890+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 msgr2=0x7fb2b4114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.890+0000 7fb2b9400700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009150 tx=0x7fb2a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 shutdown_connections 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb29806ec00 0x7fb2980710b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2b4103420 0x7fb2b4113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 --2- 172.21.15.60:0/2922510481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b41046d0 0x7fb2b4114490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 >> 172.21.15.60:0/2922510481 conn(0x7fb2b4072640 msgr2=0x7fb2b4073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 shutdown_connections 2024-04-12T13:46:58.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:58.891+0000 7fb2b9400700 1 -- 172.21.15.60:0/2922510481 wait complete. 2024-04-12T13:46:58.910 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:46:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:58 smithi110 ceph-mon[82130]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:46:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 -- 172.21.15.60:0/3214365477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fce40 msgr2=0x7f5d7c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 --2- 172.21.15.60:0/3214365477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c0fd250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c004940 tx=0x7f5d6c009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 -- 172.21.15.60:0/3214365477 shutdown_connections 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 --2- 172.21.15.60:0/3214365477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 --2- 172.21.15.60:0/3214365477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c0fd250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 -- 172.21.15.60:0/3214365477 >> 172.21.15.60:0/3214365477 conn(0x7f5d7c0f8530 msgr2=0x7f5d7c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:59.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.052+0000 7f5d81200700 1 -- 172.21.15.60:0/3214365477 shutdown_connections 2024-04-12T13:46:59.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.053+0000 7f5d81200700 1 -- 172.21.15.60:0/3214365477 wait complete. 2024-04-12T13:46:59.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.053+0000 7f5d81200700 1 Processor -- start 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d81200700 1 -- start start 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d81200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d81200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d81200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c110850 con 0x7f5d7c0fe040 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d81200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c110f90 con 0x7f5d7c0fce40 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d79400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d79400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44234/0 (socket says 172.21.15.60:44234) 2024-04-12T13:46:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.054+0000 7f5d79400700 1 -- 172.21.15.60:0/3413464186 learned_addr learned my addr 172.21.15.60:0/3413464186 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d79e00700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d79400700 1 -- 172.21.15.60:0/3413464186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fce40 msgr2=0x7f5d7c10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d79400700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d79400700 1 -- 172.21.15.60:0/3413464186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c005040 con 0x7f5d7c0fe040 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d79400700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d68002a50 tx=0x7f5d680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d68007cc0 con 0x7f5d7c0fe040 2024-04-12T13:46:59.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d6800f040 con 0x7f5d7c0fe040 2024-04-12T13:46:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.055+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d68009640 con 0x7f5d7c0fe040 2024-04-12T13:46:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.056+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c111270 con 0x7f5d7c0fe040 2024-04-12T13:46:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.056+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c111830 con 0x7f5d7c0fe040 2024-04-12T13:46:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.057+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c1019d0 con 0x7f5d7c0fe040 2024-04-12T13:46:59.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.058+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5d680097a0 con 0x7f5d7c0fe040 2024-04-12T13:46:59.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.059+0000 7f5d72000700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 0x7f5d600710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.059+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5d6808e360 con 0x7f5d7c0fe040 2024-04-12T13:46:59.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.060+0000 7f5d79e00700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 0x7f5d600710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.061+0000 7f5d79e00700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 0x7f5d600710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b970 tx=0x7f5d6c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.064+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f5d6805acc0 con 0x7f5d7c0fe040 2024-04-12T13:46:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.323+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d7c111aa0 con 0x7f5d6006ec00 2024-04-12T13:46:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.325+0000 7f5d72000700 1 -- 172.21.15.60:0/3413464186 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5d7c111aa0 con 0x7f5d6006ec00 2024-04-12T13:46:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 msgr2=0x7f5d600710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 0x7f5d600710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b970 tx=0x7f5d6c009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 msgr2=0x7f5d7c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d68002a50 tx=0x7f5d680046b0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 shutdown_connections 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5d6006ec00 0x7f5d600710b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d7c0fce40 0x7f5d7c10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 --2- 172.21.15.60:0/3413464186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7c0fe040 0x7f5d7c110250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.327+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 >> 172.21.15.60:0/3413464186 conn(0x7f5d7c0f8530 msgr2=0x7f5d7c0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.328+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 shutdown_connections 2024-04-12T13:46:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.328+0000 7f5d81200700 1 -- 172.21.15.60:0/3413464186 wait complete. 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 -- 172.21.15.60:0/1858892884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 msgr2=0x7f6cec0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 --2- 172.21.15.60:0/1858892884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec0fe550 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8004940 tx=0x7f6cd8009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 -- 172.21.15.60:0/1858892884 shutdown_connections 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 --2- 172.21.15.60:0/1858892884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec0fe550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 --2- 172.21.15.60:0/1858892884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 0x7f6cec0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 -- 172.21.15.60:0/1858892884 >> 172.21.15.60:0/1858892884 conn(0x7f6cec0f8530 msgr2=0x7f6cec0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 -- 172.21.15.60:0/1858892884 shutdown_connections 2024-04-12T13:46:59.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.481+0000 7f6cf2600700 1 -- 172.21.15.60:0/1858892884 wait complete. 2024-04-12T13:46:59.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.482+0000 7f6cf2600700 1 Processor -- start 2024-04-12T13:46:59.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.482+0000 7f6cf2600700 1 -- start start 2024-04-12T13:46:59.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.482+0000 7f6cf2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 0x7f6cec10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6cf2600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6cf2600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec1107a0 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6cf2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec110ff0 con 0x7f6cec0fcef0 2024-04-12T13:46:59.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6ceaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6ceaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49798/0 (socket says 172.21.15.60:49798) 2024-04-12T13:46:59.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6ceaa00700 1 -- 172.21.15.60:0/2614625875 learned_addr learned my addr 172.21.15.60:0/2614625875 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.483+0000 7f6ceb400700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 0x7f6cec10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ceaa00700 1 -- 172.21.15.60:0/2614625875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 msgr2=0x7f6cec10fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ceaa00700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 0x7f6cec10fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ceaa00700 1 -- 172.21.15.60:0/2614625875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8005040 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ceaa00700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009150 tx=0x7f6cd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd800e040 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cd800bbf0 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec111270 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.484+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd801c630 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.485+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec1117b0 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.486+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec101a70 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.487+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6cd800bd60 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.488+0000 7f6ce3400700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 0x7f6cd00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.488+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6cd808fc30 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.488+0000 7f6ceb400700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 0x7f6cd00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.489+0000 7f6ceb400700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 0x7f6cd00710c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.493+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6cd805c590 con 0x7f6cec0fe0e0 2024-04-12T13:46:59.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.739+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cec111a90 con 0x7f6cd006ec10 2024-04-12T13:46:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.762+0000 7f6ce3400700 1 -- 172.21.15.60:0/2614625875 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6cec111a90 con 0x7f6cd006ec10 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (4m) 8s ago 15m 14.9M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (24s) 8s ago 16m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (16s) 11s ago 14m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 8s ago 15m - - 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (8m) 8s ago 8m 14.2M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (8m) 8s ago 8m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (8m) 11s ago 8m 14.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (8m) 11s ago 8m 13.9M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (3m) 8s ago 17m 500M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (2m) 11s ago 14m 451M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (2m) 8s ago 17m 42.9M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:46:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (83s) 11s ago 14m 32.3M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (5m) 8s ago 16m 7646k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (3m) 11s ago 14m 8102k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (13m) 8s ago 13m 228M 1559M 17.2.7-845-g730340d7 036a68d49952 fc933c8fe115 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (12m) 8s ago 12m 248M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (12m) 8s ago 12m 208M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (11m) 11s ago 11m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (11m) 11s ago 11m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (10m) 11s ago 10m 227M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:46:59.766 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 8s ago 15m 54.9M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 msgr2=0x7f6cd00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 0x7f6cd00710c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc009f00 comp rx=0 tx=0).stop 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 msgr2=0x7f6cec1101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009150 tx=0x7f6cd8009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 shutdown_connections 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6cd006ec10 0x7f6cd00710c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cec0fcef0 0x7f6cec10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 --2- 172.21.15.60:0/2614625875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cec0fe0e0 0x7f6cec1101a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 >> 172.21.15.60:0/2614625875 conn(0x7f6cec0f8530 msgr2=0x7f6cec0f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 shutdown_connections 2024-04-12T13:46:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.765+0000 7f6cf2600700 1 -- 172.21.15.60:0/2614625875 wait complete. 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 -- 172.21.15.60:0/4207962023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fe0e0 msgr2=0x7ff5300fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 --2- 172.21.15.60:0/4207962023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fe0e0 0x7ff5300fe550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff51c004940 tx=0x7ff51c009e30 comp rx=0 tx=0).stop 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 -- 172.21.15.60:0/4207962023 shutdown_connections 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 --2- 172.21.15.60:0/4207962023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fe0e0 0x7ff5300fe550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 --2- 172.21.15.60:0/4207962023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fcef0 0x7ff5300fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 -- 172.21.15.60:0/4207962023 >> 172.21.15.60:0/4207962023 conn(0x7ff5300f8530 msgr2=0x7ff5300fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:46:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 -- 172.21.15.60:0/4207962023 shutdown_connections 2024-04-12T13:46:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.923+0000 7ff534a00700 1 -- 172.21.15.60:0/4207962023 wait complete. 2024-04-12T13:46:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 Processor -- start 2024-04-12T13:46:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 -- start start 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fe0e0 0x7ff530110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530110780 con 0x7ff5300fcef0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.924+0000 7ff534a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530110fd0 con 0x7ff5300fe0e0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49818/0 (socket says 172.21.15.60:49818) 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 -- 172.21.15.60:0/1850530205 learned_addr learned my addr 172.21.15.60:0/1850530205 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52d400700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fe0e0 0x7ff530110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 -- 172.21.15.60:0/1850530205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fe0e0 msgr2=0x7ff530110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fe0e0 0x7ff530110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.925+0000 7ff52de00700 1 -- 172.21.15.60:0/1850530205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c005040 con 0x7ff5300fcef0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff52de00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c8e0 tx=0x7ff5200044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52000a940 con 0x7ff5300fcef0 2024-04-12T13:46:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff52000ce80 con 0x7ff5300fcef0 2024-04-12T13:46:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5301112b0 con 0x7ff5300fcef0 2024-04-12T13:46:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5200113a0 con 0x7ff5300fcef0 2024-04-12T13:46:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.926+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5301117f0 con 0x7ff5300fcef0 2024-04-12T13:46:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.927+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff530101a70 con 0x7ff5300fcef0 2024-04-12T13:46:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.928+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff520012400 con 0x7ff5300fcef0 2024-04-12T13:46:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.930+0000 7ff526000700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 0x7ff5140710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:46:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.930+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff52008e860 con 0x7ff5300fcef0 2024-04-12T13:46:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.930+0000 7ff52d400700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 0x7ff5140710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:46:59.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.931+0000 7ff52d400700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 0x7ff5140710c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff51c004f90 tx=0x7ff51c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:46:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:46:59.935+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff52005b240 con 0x7ff5300fcef0 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:59.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]: dispatch 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]: dispatch 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]': finished 2024-04-12T13:46:59.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:46:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T13:47:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]: dispatch 2024-04-12T13:47:00.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]': finished 2024-04-12T13:47:00.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:46:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T13:47:00.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.288+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff53005f5f0 con 0x7ff5300fcef0 2024-04-12T13:47:00.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.289+0000 7ff526000700 1 -- 172.21.15.60:0/1850530205 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7ff52005add0 con 0x7ff5300fcef0 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6 2024-04-12T13:47:00.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 10, 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:47:00.293 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:47:00.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 msgr2=0x7ff5140710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 0x7ff5140710c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff51c004f90 tx=0x7ff51c009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 msgr2=0x7ff53010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c8e0 tx=0x7ff5200044c0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 shutdown_connections 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff51406ec10 0x7ff5140710c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5300fcef0 0x7ff53010fc40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 --2- 172.21.15.60:0/1850530205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5300fe0e0 0x7ff530110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 >> 172.21.15.60:0/1850530205 conn(0x7ff5300f8530 msgr2=0x7ff5300f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:00.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 shutdown_connections 2024-04-12T13:47:00.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.292+0000 7ff534a00700 1 -- 172.21.15.60:0/1850530205 wait complete. 2024-04-12T13:47:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 -- 172.21.15.60:0/256068825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 msgr2=0x7f0454070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 --2- 172.21.15.60:0/256068825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f0454070d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0440004940 tx=0x7f0440009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 -- 172.21.15.60:0/256068825 shutdown_connections 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 --2- 172.21.15.60:0/256068825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f0454070d00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 --2- 172.21.15.60:0/256068825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.448+0000 7f045a400700 1 -- 172.21.15.60:0/256068825 >> 172.21.15.60:0/256068825 conn(0x7f04540f8540 msgr2=0x7f04540fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.449+0000 7f045a400700 1 -- 172.21.15.60:0/256068825 shutdown_connections 2024-04-12T13:47:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.449+0000 7f045a400700 1 -- 172.21.15.60:0/256068825 wait complete. 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.449+0000 7f045a400700 1 Processor -- start 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f045a400700 1 -- start start 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f045a400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f045a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f045a400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454110790 con 0x7f0454070890 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f045a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454110fe0 con 0x7f0454071e50 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f0453400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f0453400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49834/0 (socket says 172.21.15.60:49834) 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.450+0000 7f0453400700 1 -- 172.21.15.60:0/3236296374 learned_addr learned my addr 172.21.15.60:0/3236296374 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0452a00700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0453400700 1 -- 172.21.15.60:0/3236296374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 msgr2=0x7f0454110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0453400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0453400700 1 -- 172.21.15.60:0/3236296374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440005040 con 0x7f0454070890 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0452a00700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:47:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.451+0000 7f0453400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0444002a80 tx=0x7f0444004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.452+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0444007cc0 con 0x7f0454070890 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.452+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f044400f040 con 0x7f0454070890 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.452+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04541112c0 con 0x7f0454070890 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.452+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044400dad0 con 0x7f0454070890 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.452+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454111800 con 0x7f0454070890 2024-04-12T13:47:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.453+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045405f5f0 con 0x7f0454070890 2024-04-12T13:47:00.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.454+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f044400dc30 con 0x7f0454070890 2024-04-12T13:47:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.455+0000 7f044b400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 0x7f04380710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.455+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f044408e4e0 con 0x7f0454070890 2024-04-12T13:47:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.455+0000 7f0452a00700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 0x7f04380710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.456+0000 7f0452a00700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 0x7f04380710c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f044000b7a0 tx=0x7f0440009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:00.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.460+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f044405aee0 con 0x7f0454070890 2024-04-12T13:47:00.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:00.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:00.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all crash 2024-04-12T13:47:00.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T13:47:00.707 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: Upgrade: osd.0 is safe to restart 2024-04-12T13:47:00.708 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:00.708 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:00.708 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:00 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1850530205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:00.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.735+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f045404bed0 con 0x7f0454070890 2024-04-12T13:47:00.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.735+0000 7f044b400700 1 -- 172.21.15.60:0/3236296374 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f044405aa70 con 0x7f0454070890 2024-04-12T13:47:00.738 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:47:00.738 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:47:00.738 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:47:00.739 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:47:00.740 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:00.741 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 msgr2=0x7f04380710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 0x7f04380710c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f044000b7a0 tx=0x7f0440009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 msgr2=0x7f045410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0444002a80 tx=0x7f0444004600 comp rx=0 tx=0).stop 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 shutdown_connections 2024-04-12T13:47:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f043806ec10 0x7f04380710c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0454070890 0x7f045410fc50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 --2- 172.21.15.60:0/3236296374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0454071e50 0x7f0454110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 >> 172.21.15.60:0/3236296374 conn(0x7f04540f8540 msgr2=0x7f04540f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 shutdown_connections 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.738+0000 7f045a400700 1 -- 172.21.15.60:0/3236296374 wait complete. 2024-04-12T13:47:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:47:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.884+0000 7f6ecc600700 1 -- 172.21.15.60:0/3019757024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 msgr2=0x7f6ec41023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.884+0000 7f6ecc600700 1 --2- 172.21.15.60:0/3019757024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec41023b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0004940 tx=0x7f6eb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 -- 172.21.15.60:0/3019757024 shutdown_connections 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 --2- 172.21.15.60:0/3019757024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec41023b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 --2- 172.21.15.60:0/3019757024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 0x7f6ec40ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 -- 172.21.15.60:0/3019757024 >> 172.21.15.60:0/3019757024 conn(0x7f6ec40f74c0 msgr2=0x7f6ec40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 -- 172.21.15.60:0/3019757024 shutdown_connections 2024-04-12T13:47:00.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.885+0000 7f6ecc600700 1 -- 172.21.15.60:0/3019757024 wait complete. 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 Processor -- start 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 -- start start 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 0x7f6ec40fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40fbf40 con 0x7f6ec40fffd0 2024-04-12T13:47:00.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ecc600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40fc0b0 con 0x7f6ec4066290 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ec9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ec9200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49858/0 (socket says 172.21.15.60:49858) 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.886+0000 7f6ec9200700 1 -- 172.21.15.60:0/1152345647 learned_addr learned my addr 172.21.15.60:0/1152345647 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec9c00700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 0x7f6ec40fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec9200700 1 -- 172.21.15.60:0/1152345647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 msgr2=0x7f6ec40fd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec9200700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 0x7f6ec40fd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec9200700 1 -- 172.21.15.60:0/1152345647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0005040 con 0x7f6ec40fffd0 2024-04-12T13:47:00.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec9200700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000b3b0 tx=0x7f6eb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb000e040 con 0x7f6ec40fffd0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6eb000bcc0 con 0x7f6ec40fffd0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb001c630 con 0x7f6ec40fffd0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.887+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec40fc330 con 0x7f6ec40fffd0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.888+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4115a30 con 0x7f6ec40fffd0 2024-04-12T13:47:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.889+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec405f5f0 con 0x7f6ec40fffd0 2024-04-12T13:47:00.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.890+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6eb0013980 con 0x7f6ec40fffd0 2024-04-12T13:47:00.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.890+0000 7f6ec1600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 0x7f6eac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:00.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.891+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6eb008f4e0 con 0x7f6ec40fffd0 2024-04-12T13:47:00.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.891+0000 7f6ec9c00700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 0x7f6eac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:00.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.892+0000 7f6ec9c00700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 0x7f6eac0710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009fd0 tx=0x7f6eb8009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:00.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:00.896+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6eb0058310 con 0x7f6ec40fffd0 2024-04-12T13:47:00.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:00.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all crash 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: Upgrade: osd.0 is safe to restart 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:00.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:00 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1850530205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:01.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.139+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ec40f8fb0 con 0x7f6eac06ec00 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.141+0000 7f6ec1600700 1 -- 172.21.15.60:0/1152345647 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ec40f8fb0 con 0x7f6eac06ec00 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:47:01.144 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "6/21 daemons upgraded", 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:47:01.145 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 msgr2=0x7f6eac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 0x7f6eac0710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009fd0 tx=0x7f6eb8009f00 comp rx=0 tx=0).stop 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 msgr2=0x7f6ec40fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000b3b0 tx=0x7f6eb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 shutdown_connections 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6eac06ec00 0x7f6eac0710b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec4066290 0x7f6ec40fd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 --2- 172.21.15.60:0/1152345647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec40fffd0 0x7f6ec40fb990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 >> 172.21.15.60:0/1152345647 conn(0x7f6ec40f74c0 msgr2=0x7f6ec40f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.144+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 shutdown_connections 2024-04-12T13:47:01.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.145+0000 7f6ecc600700 1 -- 172.21.15.60:0/1152345647 wait complete. 2024-04-12T13:47:01.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.287+0000 7f32eae00700 1 -- 172.21.15.60:0/2104115634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 msgr2=0x7f32e41004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.287+0000 7f32eae00700 1 --2- 172.21.15.60:0/2104115634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e41004e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32d0004940 tx=0x7f32d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 -- 172.21.15.60:0/2104115634 shutdown_connections 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 --2- 172.21.15.60:0/2104115634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e41004e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 --2- 172.21.15.60:0/2104115634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 0x7f32e40ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 -- 172.21.15.60:0/2104115634 >> 172.21.15.60:0/2104115634 conn(0x7f32e40fa790 msgr2=0x7f32e40fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 -- 172.21.15.60:0/2104115634 shutdown_connections 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.288+0000 7f32eae00700 1 -- 172.21.15.60:0/2104115634 wait complete. 2024-04-12T13:47:01.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.289+0000 7f32eae00700 1 Processor -- start 2024-04-12T13:47:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.289+0000 7f32eae00700 1 -- start start 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32eae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 0x7f32e410fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32eae00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32eae00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e41105b0 con 0x7f32e4100070 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32eae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4110e00 con 0x7f32e40fef00 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49880/0 (socket says 172.21.15.60:49880) 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 -- 172.21.15.60:0/17444845 learned_addr learned my addr 172.21.15.60:0/17444845 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9a00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 0x7f32e410fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 -- 172.21.15.60:0/17444845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 msgr2=0x7f32e410fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 0x7f32e410fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.290+0000 7f32e9000700 1 -- 172.21.15.60:0/17444845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d0005040 con 0x7f32e4100070 2024-04-12T13:47:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32e9000700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009150 tx=0x7f32d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d000e040 con 0x7f32e4100070 2024-04-12T13:47:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32d000bcc0 con 0x7f32e4100070 2024-04-12T13:47:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d001c630 con 0x7f32e4100070 2024-04-12T13:47:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e4111080 con 0x7f32e4100070 2024-04-12T13:47:01.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.291+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e41115c0 con 0x7f32e4100070 2024-04-12T13:47:01.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.293+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e40fe290 con 0x7f32e4100070 2024-04-12T13:47:01.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.293+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f32d0013420 con 0x7f32e4100070 2024-04-12T13:47:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.294+0000 7f32e1600700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 0x7f32cc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.294+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f32d008f480 con 0x7f32e4100070 2024-04-12T13:47:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.295+0000 7f32e9a00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 0x7f32cc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.295+0000 7f32e9a00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 0x7f32cc0710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32d8004c40 tx=0x7f32d8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:01.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.299+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f32d005be60 con 0x7f32e4100070 2024-04-12T13:47:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.649+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f32e404bed0 con 0x7f32e4100070 2024-04-12T13:47:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.649+0000 7f32e1600700 1 -- 172.21.15.60:0/17444845 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f32d005b9f0 con 0x7f32e4100070 2024-04-12T13:47:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:47:01.652 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:47:01.652 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:47:01.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 msgr2=0x7f32cc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 0x7f32cc0710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32d8004c40 tx=0x7f32d8009040 comp rx=0 tx=0).stop 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 msgr2=0x7f32e410ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009150 tx=0x7f32d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 shutdown_connections 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f32cc06ec00 0x7f32cc0710b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32e40fef00 0x7f32e410fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 --2- 172.21.15.60:0/17444845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e4100070 0x7f32e410ffb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 >> 172.21.15.60:0/17444845 conn(0x7f32e40fa790 msgr2=0x7f32e40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 shutdown_connections 2024-04-12T13:47:01.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:01.652+0000 7f32eae00700 1 -- 172.21.15.60:0/17444845 wait complete. 2024-04-12T13:47:01.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:01 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3236296374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:47:01.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:01 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:01.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:01 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:47:01.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:01 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:01.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:01 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/17444845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:47:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:01 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3236296374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:47:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:01 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:01 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T13:47:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:01 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:01 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/17444845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:47:02.834 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:02 smithi060 ceph-mon[94333]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:02.834 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:02 smithi060 ceph-mon[94333]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:02.835 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:02 smithi060 ceph-mon[94333]: Upgrade: Updating osd.0 2024-04-12T13:47:02.835 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:02 smithi060 ceph-mon[94333]: Deploying daemon osd.0 on smithi060 2024-04-12T13:47:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:02 smithi110 ceph-mon[82130]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:02 smithi110 ceph-mon[82130]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:02 smithi110 ceph-mon[82130]: Upgrade: Updating osd.0 2024-04-12T13:47:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:02 smithi110 ceph-mon[82130]: Deploying daemon osd.0 on smithi060 2024-04-12T13:47:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:04 smithi110 ceph-mon[82130]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:05.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:04 smithi060 ceph-mon[94333]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:06 smithi060 ceph-mon[94333]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:06.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:06 smithi060 systemd[1]: Stopping Ceph osd.0 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:47:06.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:06 smithi110 ceph-mon[82130]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:07.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:06 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[47436]: 2024-04-12T13:47:06.973+0000 7feefdc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:47:07.432 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:06 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[47436]: 2024-04-12T13:47:06.973+0000 7feefdc00700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-12T13:47:07.432 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:06 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[47436]: 2024-04-12T13:47:06.973+0000 7feefdc00700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:47:07.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:07 smithi110 ceph-mon[82130]: osd.0 marked itself down and dead 2024-04-12T13:47:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:07 smithi060 ceph-mon[94333]: osd.0 marked itself down and dead 2024-04-12T13:47:08.652 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:08 smithi060 podman[102624]: 2024-04-12 13:47:08.301617845 +0000 UTC m=+1.453943439 container died fc933c8fe115ac9c75928200701f30daa5050d6c01cf67ce52344fbcb6c0f9ea (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-64502-quincy-2-730340d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2) 2024-04-12T13:47:08.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:08 smithi060 ceph-mon[94333]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:08.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:08 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:47:08.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:08 smithi060 ceph-mon[94333]: osdmap e50: 6 total, 5 up, 6 in 2024-04-12T13:47:08.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:08 smithi060 podman[102624]: 2024-04-12 13:47:08.799267837 +0000 UTC m=+1.951593485 container cleanup fc933c8fe115ac9c75928200701f30daa5050d6c01cf67ce52344fbcb6c0f9ea (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, RELEASE=wip-64502-quincy-2-730340d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-12T13:47:08.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:08 smithi060 bash[102624]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0 2024-04-12T13:47:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:08 smithi110 ceph-mon[82130]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:08 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:47:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:08 smithi110 ceph-mon[82130]: osdmap e50: 6 total, 5 up, 6 in 2024-04-12T13:47:09.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:08 smithi060 podman[102642]: 2024-04-12 13:47:08.983842145 +0000 UTC m=+0.667802128 container remove fc933c8fe115ac9c75928200701f30daa5050d6c01cf67ce52344fbcb6c0f9ea (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-64502-quincy-2-730340d, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:47:10.129 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:09 smithi060 ceph-mon[94333]: osdmap e51: 6 total, 5 up, 6 in 2024-04-12T13:47:10.130 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:09 smithi060 podman[102730]: 2024-04-12 13:47:09.780598562 +0000 UTC m=+0.043864415 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:10.130 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:09 smithi060 podman[102730]: 2024-04-12 13:47:09.951661309 +0000 UTC m=+0.214927219 container create c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0) 2024-04-12T13:47:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:09 smithi110 ceph-mon[82130]: osdmap e51: 6 total, 5 up, 6 in 2024-04-12T13:47:10.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:10 smithi060 podman[102730]: 2024-04-12 13:47:10.231109294 +0000 UTC m=+0.494375184 container init c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:10.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:10 smithi060 podman[102730]: 2024-04-12 13:47:10.243228907 +0000 UTC m=+0.506494810 container start c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5) 2024-04-12T13:47:10.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:10 smithi060 podman[102730]: 2024-04-12 13:47:10.346011955 +0000 UTC m=+0.609277825 container attach c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:11.090 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:10 smithi060 ceph-mon[94333]: pgmap v66: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:11.090 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:10 smithi060 podman[102730]: 2024-04-12 13:47:10.710733592 +0000 UTC m=+0.973999481 container died c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-12T13:47:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:10 smithi110 ceph-mon[82130]: pgmap v66: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:11.801 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:11 smithi060 podman[102756]: 2024-04-12 13:47:11.449733149 +0000 UTC m=+0.721514101 container remove c870e65dcfcfb0903afcbbf78c2f2f90cc0e093e8b45070c2831ea05b72e6d6a (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-12T13:47:11.801 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:11 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-12T13:47:11.802 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:11 smithi060 systemd[1]: Stopped Ceph osd.0 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:47:11.802 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:11 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.0.service: Consumed 1min 43.433s CPU time. 2024-04-12T13:47:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:11 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:12.180 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:11 smithi060 systemd[1]: Starting Ceph osd.0 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:47:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:11 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 40/222 objects degraded (18.018%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:12.574 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:12 smithi060 podman[102856]: 2024-04-12 13:47:12.163374732 +0000 UTC m=+0.033361610 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:12.575 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:12 smithi060 podman[102856]: 2024-04-12 13:47:12.284770101 +0000 UTC m=+0.154757010 container create 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:47:12.575 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:12 smithi060 podman[102856]: 2024-04-12 13:47:12.57249302 +0000 UTC m=+0.442479950 container init 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, GIT_BRANCH=HEAD) 2024-04-12T13:47:12.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:12 smithi060 ceph-mon[94333]: pgmap v67: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:12.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:12 smithi060 podman[102856]: 2024-04-12 13:47:12.585957673 +0000 UTC m=+0.455944556 container start 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, ceph=True, RELEASE=main-a971fd5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-12T13:47:12.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:12 smithi060 podman[102856]: 2024-04-12 13:47:12.670979091 +0000 UTC m=+0.540966019 container attach 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:47:13.130 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:12 smithi110 ceph-mon[82130]: pgmap v67: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:13.682 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T13:47:13.682 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T13:47:13.683 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T13:47:13.683 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T13:47:13.683 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T13:47:13.683 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T13:47:13.683 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 bash[102856]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate[102871]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-12T13:47:13.684 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:13 smithi060 podman[102856]: 2024-04-12 13:47:13.532509045 +0000 UTC m=+1.402495991 container died 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403) 2024-04-12T13:47:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:14 smithi110 ceph-mon[82130]: pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:14.637 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:14 smithi060 ceph-mon[94333]: pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:14.637 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:14.637 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:14.637 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:14 smithi060 podman[102994]: 2024-04-12 13:47:14.274972691 +0000 UTC m=+0.723079846 container remove 4fad39b604a6f7f2a5bebb9aedbca7e6aa88a9d331c95bc0cf7df7983bdf0c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-activate, ceph=True, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:47:14.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:14 smithi060 podman[103058]: 2024-04-12 13:47:14.540414967 +0000 UTC m=+0.033896896 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:14.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:14 smithi060 podman[103058]: 2024-04-12 13:47:14.684322926 +0000 UTC m=+0.177804895 container create ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-04-12T13:47:15.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:14 smithi060 podman[103058]: 2024-04-12 13:47:14.946522092 +0000 UTC m=+0.440004065 container init ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.vendor=CentOS) 2024-04-12T13:47:15.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:14 smithi060 podman[103058]: 2024-04-12 13:47:14.959435465 +0000 UTC m=+0.452917458 container start ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-12T13:47:15.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:15 smithi060 ceph-osd[103077]: -- 172.21.15.60:0/2477550795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574be2c5680 con 0x5574be28f000 2024-04-12T13:47:15.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:15 smithi060 bash[103058]: ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 2024-04-12T13:47:15.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:15 smithi060 systemd[1]: Started Ceph osd.0 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:47:15.929 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:15 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T13:47:15.534+0000 7fe3c97047c0 -1 Falling back to public interface 2024-04-12T13:47:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:16 smithi110 ceph-mon[82130]: pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:16.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:16.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:16.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:16 smithi060 ceph-mon[94333]: pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:16.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:16.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:16.532 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:18 smithi110 ceph-mon[82130]: pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:18.664 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:18 smithi060 ceph-mon[94333]: pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:20.337 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:20 smithi060 ceph-mon[94333]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:20 smithi110 ceph-mon[82130]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:21.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:21 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T13:47:21.260+0000 7fe3c97047c0 -1 osd.0 49 log_to_monitors true 2024-04-12T13:47:22.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 13:47:22 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T13:47:22.276+0000 7fe3b8a00700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:47:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:22 smithi060 ceph-mon[94333]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:22 smithi060 ceph-mon[94333]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T13:47:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:22 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:22.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:22 smithi110 ceph-mon[82130]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:22.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:22 smithi110 ceph-mon[82130]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T13:47:22.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:22.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:22 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:23.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:23 smithi060 ceph-mon[94333]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T13:47:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:23 smithi060 ceph-mon[94333]: osdmap e52: 6 total, 5 up, 6 in 2024-04-12T13:47:23.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:23 smithi060 ceph-mon[94333]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:47:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:23 smithi110 ceph-mon[82130]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T13:47:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:23 smithi110 ceph-mon[82130]: osdmap e52: 6 total, 5 up, 6 in 2024-04-12T13:47:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:23 smithi110 ceph-mon[82130]: from='osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: pgmap v74: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022] boot 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: osdmap e53: 6 total, 6 up, 6 in 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:24.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: pgmap v74: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/222 objects degraded (18.018%) 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: osd.0 [v2:172.21.15.60:6802/1148773022,v1:172.21.15.60:6803/1148773022] boot 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: osdmap e53: 6 total, 6 up, 6 in 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:25.348 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:25 smithi060 ceph-mon[94333]: osdmap e54: 6 total, 6 up, 6 in 2024-04-12T13:47:25.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:25 smithi110 ceph-mon[82130]: osdmap e54: 6 total, 6 up, 6 in 2024-04-12T13:47:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:26 smithi060 ceph-mon[94333]: pgmap v77: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-04-12T13:47:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:26 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:26 smithi110 ceph-mon[82130]: pgmap v77: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-04-12T13:47:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:26 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:28 smithi060 ceph-mon[94333]: pgmap v78: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-04-12T13:47:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:28.662 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:28 smithi110 ceph-mon[82130]: pgmap v78: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-04-12T13:47:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:29.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:29 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-04-12T13:47:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:29 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: pgmap v79: 65 pgs: 25 peering, 40 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:47:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:30 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:30.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: pgmap v79: 65 pgs: 25 peering, 40 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:30.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:30.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:30.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:30.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:47:30.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:30 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:31.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:31.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T13:47:31.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:31 smithi060 ceph-mon[94333]: Upgrade: osd.1 is safe to restart 2024-04-12T13:47:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T13:47:31.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:31 smithi110 ceph-mon[82130]: Upgrade: osd.1 is safe to restart 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 -- 172.21.15.60:0/3500502802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 msgr2=0x7f49bc0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 --2- 172.21.15.60:0/3500502802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc0fe460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49a8004940 tx=0x7f49a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 -- 172.21.15.60:0/3500502802 shutdown_connections 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 --2- 172.21.15.60:0/3500502802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc0fe460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 --2- 172.21.15.60:0/3500502802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 0x7f49bc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 -- 172.21.15.60:0/3500502802 >> 172.21.15.60:0/3500502802 conn(0x7f49bc0f8580 msgr2=0x7f49bc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 -- 172.21.15.60:0/3500502802 shutdown_connections 2024-04-12T13:47:31.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.828+0000 7f49c0e00700 1 -- 172.21.15.60:0/3500502802 wait complete. 2024-04-12T13:47:31.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.829+0000 7f49c0e00700 1 Processor -- start 2024-04-12T13:47:31.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.829+0000 7f49c0e00700 1 -- start start 2024-04-12T13:47:31.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49c0e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 0x7f49bc071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49c0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49c0e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc072260 con 0x7f49bc0fdff0 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49c0e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc070850 con 0x7f49bc0fce80 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49b9400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49b9400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50412/0 (socket says 172.21.15.60:50412) 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49b9400700 1 -- 172.21.15.60:0/2658945667 learned_addr learned my addr 172.21.15.60:0/2658945667 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:31.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.830+0000 7f49b9e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 0x7f49bc071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.831+0000 7f49b9400700 1 -- 172.21.15.60:0/2658945667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 msgr2=0x7f49bc071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.831+0000 7f49b9400700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 0x7f49bc071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.831+0000 7f49b9400700 1 -- 172.21.15.60:0/2658945667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8005040 con 0x7f49bc0fdff0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.831+0000 7f49b9400700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009150 tx=0x7f49a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.831+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a800e040 con 0x7f49bc0fdff0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.832+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc070aa0 con 0x7f49bc0fdff0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.832+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49a800bbf0 con 0x7f49bc0fdff0 2024-04-12T13:47:31.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.832+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a801c630 con 0x7f49bc0fdff0 2024-04-12T13:47:31.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.832+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc071060 con 0x7f49bc0fdff0 2024-04-12T13:47:31.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.834+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc04c710 con 0x7f49bc0fdff0 2024-04-12T13:47:31.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.835+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f49a800bd60 con 0x7f49bc0fdff0 2024-04-12T13:47:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.836+0000 7f49b2000700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 0x7f49a00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.836+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f49a808fb20 con 0x7f49bc0fdff0 2024-04-12T13:47:31.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.836+0000 7f49b9e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 0x7f49a00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:31.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.837+0000 7f49b9e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 0x7f49a00710b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004f40 tx=0x7f49ac00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:31.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:31.841+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f49a805c500 con 0x7f49bc0fdff0 2024-04-12T13:47:32.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.109+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49bc102380 con 0x7f49a006ec00 2024-04-12T13:47:32.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.112+0000 7f49b2000700 1 -- 172.21.15.60:0/2658945667 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f49bc102380 con 0x7f49a006ec00 2024-04-12T13:47:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 msgr2=0x7f49a00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 0x7f49a00710b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004f40 tx=0x7f49ac00b040 comp rx=0 tx=0).stop 2024-04-12T13:47:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 msgr2=0x7f49bc070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009150 tx=0x7f49a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 shutdown_connections 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f49a006ec00 0x7f49a00710b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49bc0fce80 0x7f49bc071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 --2- 172.21.15.60:0/2658945667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc0fdff0 0x7f49bc070310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 >> 172.21.15.60:0/2658945667 conn(0x7f49bc0f8580 msgr2=0x7f49bc0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 shutdown_connections 2024-04-12T13:47:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.115+0000 7f49c0e00700 1 -- 172.21.15.60:0/2658945667 wait complete. 2024-04-12T13:47:32.135 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 -- 172.21.15.60:0/845756139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 msgr2=0x7f4c180fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/845756139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c180fd250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c004940 tx=0x7f4c0c009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 -- 172.21.15.60:0/845756139 shutdown_connections 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/845756139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 0x7f4c180fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/845756139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c180fd250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 -- 172.21.15.60:0/845756139 >> 172.21.15.60:0/845756139 conn(0x7f4c180f8530 msgr2=0x7f4c180fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 -- 172.21.15.60:0/845756139 shutdown_connections 2024-04-12T13:47:32.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.278+0000 7f4c1fa00700 1 -- 172.21.15.60:0/845756139 wait complete. 2024-04-12T13:47:32.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.279+0000 7f4c1fa00700 1 Processor -- start 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.279+0000 7f4c1fa00700 1 -- start start 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1fa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 0x7f4c18070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1fa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180708c0 con 0x7f4c180fce40 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18070a30 con 0x7f4c180fe040 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50434/0 (socket says 172.21.15.60:50434) 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 -- 172.21.15.60:0/3475240692 learned_addr learned my addr 172.21.15.60:0/3475240692 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c17e00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 0x7f4c18070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 -- 172.21.15.60:0/3475240692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 msgr2=0x7f4c18070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 0x7f4c18070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.280+0000 7f4c1d000700 1 -- 172.21.15.60:0/3475240692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c005040 con 0x7f4c180fce40 2024-04-12T13:47:32.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c1d000700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00b970 tx=0x7f4c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:32.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c0c00e040 con 0x7f4c180fce40 2024-04-12T13:47:32.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c0c00bbf0 con 0x7f4c180fce40 2024-04-12T13:47:32.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c0c01c630 con 0x7f4c180fce40 2024-04-12T13:47:32.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c18070cb0 con 0x7f4c180fce40 2024-04-12T13:47:32.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.281+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c18115aa0 con 0x7f4c180fce40 2024-04-12T13:47:32.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.282+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1805f5f0 con 0x7f4c180fce40 2024-04-12T13:47:32.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.284+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4c0c00bd60 con 0x7f4c180fce40 2024-04-12T13:47:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.285+0000 7f4c14c00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 0x7f4c000710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.285+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4c0c08fac0 con 0x7f4c180fce40 2024-04-12T13:47:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.286+0000 7f4c17e00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 0x7f4c000710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.287+0000 7f4c17e00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 0x7f4c000710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c040041d0 tx=0x7f4c04009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:32.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.292+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f4c0c058a30 con 0x7f4c180fce40 2024-04-12T13:47:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.554+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c181023a0 con 0x7f4c0006ec10 2024-04-12T13:47:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.556+0000 7f4c14c00700 1 -- 172.21.15.60:0/3475240692 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4c181023a0 con 0x7f4c0006ec10 2024-04-12T13:47:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 msgr2=0x7f4c000710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 0x7f4c000710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c040041d0 tx=0x7f4c04009040 comp rx=0 tx=0).stop 2024-04-12T13:47:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 msgr2=0x7f4c18071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00b970 tx=0x7f4c0c009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 shutdown_connections 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4c0006ec10 0x7f4c000710c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c180fce40 0x7f4c18071e40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 --2- 172.21.15.60:0/3475240692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c180fe040 0x7f4c18070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 >> 172.21.15.60:0/3475240692 conn(0x7f4c180f8530 msgr2=0x7f4c180f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 shutdown_connections 2024-04-12T13:47:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.559+0000 7f4c1fa00700 1 -- 172.21.15.60:0/3475240692 wait complete. 2024-04-12T13:47:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.719+0000 7f10b6e00700 1 -- 172.21.15.60:0/2549769744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 msgr2=0x7f10b00fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.719+0000 7f10b6e00700 1 --2- 172.21.15.60:0/2549769744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b00fd280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10a0004940 tx=0x7f10a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 -- 172.21.15.60:0/2549769744 shutdown_connections 2024-04-12T13:47:32.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 --2- 172.21.15.60:0/2549769744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 0x7f10b00fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 --2- 172.21.15.60:0/2549769744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b00fd280 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 -- 172.21.15.60:0/2549769744 >> 172.21.15.60:0/2549769744 conn(0x7f10b00f85a0 msgr2=0x7f10b00fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 -- 172.21.15.60:0/2549769744 shutdown_connections 2024-04-12T13:47:32.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.720+0000 7f10b6e00700 1 -- 172.21.15.60:0/2549769744 wait complete. 2024-04-12T13:47:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 Processor -- start 2024-04-12T13:47:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 -- start start 2024-04-12T13:47:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 0x7f10b0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0072260 con 0x7f10b00fce70 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10b6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0070850 con 0x7f10b00fe070 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.721+0000 7f10afe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50456/0 (socket says 172.21.15.60:50456) 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 -- 172.21.15.60:0/3493115911 learned_addr learned my addr 172.21.15.60:0/3493115911 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10a7e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 0x7f10b0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 -- 172.21.15.60:0/3493115911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 msgr2=0x7f10b0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 0x7f10b0070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 -- 172.21.15.60:0/3493115911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0005040 con 0x7f10b00fce70 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.722+0000 7f10afe00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b970 tx=0x7f10a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.723+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a000e040 con 0x7f10b00fce70 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.723+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10a0004290 con 0x7f10b00fce70 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.723+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b0070aa0 con 0x7f10b00fce70 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.723+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a001c630 con 0x7f10b00fce70 2024-04-12T13:47:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.723+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b0071060 con 0x7f10b00fce70 2024-04-12T13:47:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.724+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b004c710 con 0x7f10b00fce70 2024-04-12T13:47:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.725+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f10a000bbf0 con 0x7f10b00fce70 2024-04-12T13:47:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.726+0000 7f10acc00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 0x7f10940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.726+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f10a008fb20 con 0x7f10b00fce70 2024-04-12T13:47:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.727+0000 7f10a7e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 0x7f10940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:32.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.727+0000 7f10a7e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 0x7f10940710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1098007fd0 tx=0x7f1098009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:32.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.732+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f10a005c500 con 0x7f10b00fce70 2024-04-12T13:47:32.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:32.974+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10b01023e0 con 0x7f109406ec00 2024-04-12T13:47:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.011+0000 7f10acc00700 1 -- 172.21.15.60:0/3493115911 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f10b01023e0 con 0x7f109406ec00 2024-04-12T13:47:33.014 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:47:33.014 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (5m) 11s ago 16m 14.9M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:47:33.014 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (57s) 11s ago 16m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:47:33.014 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (49s) 44s ago 15m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 11s ago 16m - - 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (9m) 11s ago 9m 14.3M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (9m) 11s ago 9m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (9m) 44s ago 9m 14.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (9m) 44s ago 9m 13.9M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (4m) 11s ago 18m 502M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (3m) 44s ago 15m 451M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (2m) 11s ago 18m 45.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (116s) 44s ago 14m 32.3M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (5m) 11s ago 16m 7944k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (4m) 44s ago 15m 8102k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (18s) 11s ago 14m 11.1M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (13m) 11s ago 13m 248M 1559M 17.2.7-845-g730340d7 036a68d49952 c13c009637fc 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (12m) 11s ago 12m 207M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:47:33.015 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (12m) 44s ago 12m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:47:33.016 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (11m) 44s ago 11m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:47:33.016 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (11m) 44s ago 11m 227M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:47:33.016 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (3m) 11s ago 15m 55.9M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.014+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 msgr2=0x7f10940710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.014+0000 7f10b6e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 0x7f10940710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1098007fd0 tx=0x7f1098009040 comp rx=0 tx=0).stop 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.014+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 msgr2=0x7f10b0071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.014+0000 7f10b6e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b970 tx=0x7f10a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 shutdown_connections 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f109406ec00 0x7f10940710b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10b00fce70 0x7f10b0071c60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 --2- 172.21.15.60:0/3493115911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10b00fe070 0x7f10b0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 >> 172.21.15.60:0/3493115911 conn(0x7f10b00f85a0 msgr2=0x7f10b00f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:33.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 shutdown_connections 2024-04-12T13:47:33.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.015+0000 7f10b6e00700 1 -- 172.21.15.60:0/3493115911 wait complete. 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 -- 172.21.15.60:0/2819446194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 msgr2=0x7f10f00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 --2- 172.21.15.60:0/2819446194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f00703b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10e0004940 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 -- 172.21.15.60:0/2819446194 shutdown_connections 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 --2- 172.21.15.60:0/2819446194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 0x7f10f0070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 --2- 172.21.15.60:0/2819446194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f00703b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 -- 172.21.15.60:0/2819446194 >> 172.21.15.60:0/2819446194 conn(0x7f10f00f8530 msgr2=0x7f10f00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.176+0000 7f10f6800700 1 -- 172.21.15.60:0/2819446194 shutdown_connections 2024-04-12T13:47:33.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.177+0000 7f10f6800700 1 -- 172.21.15.60:0/2819446194 wait complete. 2024-04-12T13:47:33.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.177+0000 7f10f6800700 1 Processor -- start 2024-04-12T13:47:33.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.177+0000 7f10f6800700 1 -- start start 2024-04-12T13:47:33.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10f6800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 0x7f10f010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10f6800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10f6800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f01107a0 con 0x7f10f0071ea0 2024-04-12T13:47:33.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10f6800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0110ff0 con 0x7f10f00708f0 2024-04-12T13:47:33.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10eea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10eea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50468/0 (socket says 172.21.15.60:50468) 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.178+0000 7f10eea00700 1 -- 172.21.15.60:0/3463958767 learned_addr learned my addr 172.21.15.60:0/3463958767 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10ef400700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 0x7f10f010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10eea00700 1 -- 172.21.15.60:0/3463958767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 msgr2=0x7f10f010fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10eea00700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 0x7f10f010fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10eea00700 1 -- 172.21.15.60:0/3463958767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0005040 con 0x7f10f0071ea0 2024-04-12T13:47:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10eea00700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00c830 tx=0x7f10dc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.179+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc00a760 con 0x7f10f0071ea0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.180+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10dc00ad90 con 0x7f10f0071ea0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.180+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f01112d0 con 0x7f10f0071ea0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.180+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc0113a0 con 0x7f10f0071ea0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.180+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f0111810 con 0x7f10f0071ea0 2024-04-12T13:47:33.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.181+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f005f5f0 con 0x7f10f0071ea0 2024-04-12T13:47:33.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.183+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f10dc012400 con 0x7f10f0071ea0 2024-04-12T13:47:33.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.184+0000 7f10e7400700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 0x7f10d40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.184+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f10dc08e750 con 0x7f10f0071ea0 2024-04-12T13:47:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.185+0000 7f10ef400700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 0x7f10d40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.185+0000 7f10ef400700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 0x7f10d40710c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10e000b3b0 tx=0x7f10e0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:33.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.190+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f10dc05b1f0 con 0x7f10f0071ea0 2024-04-12T13:47:33.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:33.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:33.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:33.510 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:33.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:47:33.511 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:33.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.523+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10f004bed0 con 0x7f10f0071ea0 2024-04-12T13:47:33.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.524+0000 7f10e7400700 1 -- 172.21.15.60:0/3463958767 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f10dc05ad80 con 0x7f10f0071ea0 2024-04-12T13:47:33.526 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:47:33.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 5, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 9, 2024-04-12T13:47:33.527 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 5 2024-04-12T13:47:33.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:47:33.528 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 msgr2=0x7f10d40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 0x7f10d40710c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10e000b3b0 tx=0x7f10e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 msgr2=0x7f10f01101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00c830 tx=0x7f10dc004470 comp rx=0 tx=0).stop 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 shutdown_connections 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f10d406ec10 0x7f10d40710c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10f00708f0 0x7f10f010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 --2- 172.21.15.60:0/3463958767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10f0071ea0 0x7f10f01101a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.527+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 >> 172.21.15.60:0/3463958767 conn(0x7f10f00f8530 msgr2=0x7f10f00f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:33.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.528+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 shutdown_connections 2024-04-12T13:47:33.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.528+0000 7f10f6800700 1 -- 172.21.15.60:0/3463958767 wait complete. 2024-04-12T13:47:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.690+0000 7f6867200700 1 -- 172.21.15.60:0/4279543166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680ffd40 msgr2=0x7f6868102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.690+0000 7f6867200700 1 --2- 172.21.15.60:0/4279543166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680ffd40 0x7f6868102160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6854004940 tx=0x7f6854009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 -- 172.21.15.60:0/4279543166 shutdown_connections 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 --2- 172.21.15.60:0/4279543166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680ffd40 0x7f6868102160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 --2- 172.21.15.60:0/4279543166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680662f0 0x7f68680ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 -- 172.21.15.60:0/4279543166 >> 172.21.15.60:0/4279543166 conn(0x7f68680f7270 msgr2=0x7f68680f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 -- 172.21.15.60:0/4279543166 shutdown_connections 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.691+0000 7f6867200700 1 -- 172.21.15.60:0/4279543166 wait complete. 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.692+0000 7f6867200700 1 Processor -- start 2024-04-12T13:47:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.692+0000 7f6867200700 1 -- start start 2024-04-12T13:47:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6867200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6867200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680ffd40 0x7f686810fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6867200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68681105f0 con 0x7f68680662f0 2024-04-12T13:47:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6867200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868110e40 con 0x7f68680ffd40 2024-04-12T13:47:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6865e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6865e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50486/0 (socket says 172.21.15.60:50486) 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6865e00700 1 -- 172.21.15.60:0/3181119126 learned_addr learned my addr 172.21.15.60:0/3181119126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.693+0000 7f6865400700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680ffd40 0x7f686810fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f6865e00700 1 -- 172.21.15.60:0/3181119126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680ffd40 msgr2=0x7f686810fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f6865e00700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680ffd40 0x7f686810fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f6865e00700 1 -- 172.21.15.60:0/3181119126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854005040 con 0x7f68680662f0 2024-04-12T13:47:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f6865e00700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6858002a50 tx=0x7f6858004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6858007cc0 con 0x7f68680662f0 2024-04-12T13:47:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f685800f040 con 0x7f68680662f0 2024-04-12T13:47:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685800daf0 con 0x7f68680662f0 2024-04-12T13:47:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.694+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6868111120 con 0x7f68680662f0 2024-04-12T13:47:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.695+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6868111610 con 0x7f68680662f0 2024-04-12T13:47:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.696+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68680f8df0 con 0x7f68680662f0 2024-04-12T13:47:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.697+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6858009810 con 0x7f68680662f0 2024-04-12T13:47:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.698+0000 7f685e000700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 0x7f684c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.698+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f685808e660 con 0x7f68680662f0 2024-04-12T13:47:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.699+0000 7f6865400700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 0x7f684c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.699+0000 7f6865400700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 0x7f684c0710c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f685400b3b0 tx=0x7f6854009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:33.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:33.704+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f685805af40 con 0x7f68680662f0 2024-04-12T13:47:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:33.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:33.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T13:47:33.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:47:34.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.008+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6868105860 con 0x7f68680662f0 2024-04-12T13:47:34.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.008+0000 7f685e000700 1 -- 172.21.15.60:0/3181119126 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f685805aad0 con 0x7f68680662f0 2024-04-12T13:47:34.011 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:47:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:47:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:47:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:34.015 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:34.015 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:47:34.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 msgr2=0x7f684c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 0x7f684c0710c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f685400b3b0 tx=0x7f6854009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 msgr2=0x7f686810fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6858002a50 tx=0x7f6858004600 comp rx=0 tx=0).stop 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 shutdown_connections 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f684c06ec10 0x7f684c0710c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68680662f0 0x7f686810fab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 --2- 172.21.15.60:0/3181119126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68680ffd40 0x7f686810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.011+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 >> 172.21.15.60:0/3181119126 conn(0x7f68680f7270 msgr2=0x7f68680fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.012+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 shutdown_connections 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.012+0000 7f6867200700 1 -- 172.21.15.60:0/3181119126 wait complete. 2024-04-12T13:47:34.016 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 -- 172.21.15.60:0/2021266317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 msgr2=0x7f7d540fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 --2- 172.21.15.60:0/2021266317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d540fd040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d44004940 tx=0x7f7d44009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 -- 172.21.15.60:0/2021266317 shutdown_connections 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 --2- 172.21.15.60:0/2021266317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d540fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 --2- 172.21.15.60:0/2021266317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d540fd040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 -- 172.21.15.60:0/2021266317 >> 172.21.15.60:0/2021266317 conn(0x7f7d540f83d0 msgr2=0x7f7d540fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:34.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 -- 172.21.15.60:0/2021266317 shutdown_connections 2024-04-12T13:47:34.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.155+0000 7f7d53200700 1 -- 172.21.15.60:0/2021266317 wait complete. 2024-04-12T13:47:34.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.156+0000 7f7d53200700 1 Processor -- start 2024-04-12T13:47:34.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d53200700 1 -- start start 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d53200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d53200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d54070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d53200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540708c0 con 0x7f7d540fcc30 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d53200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54070a30 con 0x7f7d540fdee0 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d51e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d51e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50494/0 (socket says 172.21.15.60:50494) 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.157+0000 7f7d51e00700 1 -- 172.21.15.60:0/3123917670 learned_addr learned my addr 172.21.15.60:0/3123917670 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51400700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d54070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51e00700 1 -- 172.21.15.60:0/3123917670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 msgr2=0x7f7d54070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51e00700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d54070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51e00700 1 -- 172.21.15.60:0/3123917670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44005040 con 0x7f7d540fcc30 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51400700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d54070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:47:34.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d51e00700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009150 tx=0x7f7d44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4400e040 con 0x7f7d540fcc30 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d4400bbf0 con 0x7f7d540fcc30 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4401c630 con 0x7f7d540fcc30 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.158+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54070cb0 con 0x7f7d540fcc30 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.159+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d541158d0 con 0x7f7d540fcc30 2024-04-12T13:47:34.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.160+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5405f5f0 con 0x7f7d540fcc30 2024-04-12T13:47:34.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.161+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7d4400bd60 con 0x7f7d540fcc30 2024-04-12T13:47:34.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.162+0000 7f7d4a000700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 0x7f7d380710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.162+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7d4408fb90 con 0x7f7d540fcc30 2024-04-12T13:47:34.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.162+0000 7f7d51400700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 0x7f7d380710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.163+0000 7f7d51400700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 0x7f7d380710c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d40007fd0 tx=0x7f7d40009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:34.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.169+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7d44058a60 con 0x7f7d540fcc30 2024-04-12T13:47:34.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.436+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d541021f0 con 0x7f7d3806ec10 2024-04-12T13:47:34.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.438+0000 7f7d4a000700 1 -- 172.21.15.60:0/3123917670 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7d541021f0 con 0x7f7d3806ec10 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "7/21 daemons upgraded", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:47:34.441 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:47:34.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 msgr2=0x7f7d380710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 0x7f7d380710c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d40007fd0 tx=0x7f7d40009040 comp rx=0 tx=0).stop 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 msgr2=0x7f7d54071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009150 tx=0x7f7d44009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 shutdown_connections 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7d3806ec10 0x7f7d380710c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d540fcc30 0x7f7d54071e40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 --2- 172.21.15.60:0/3123917670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d540fdee0 0x7f7d54070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 >> 172.21.15.60:0/3123917670 conn(0x7f7d540f83d0 msgr2=0x7f7d540f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 shutdown_connections 2024-04-12T13:47:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.441+0000 7f7d53200700 1 -- 172.21.15.60:0/3123917670 wait complete. 2024-04-12T13:47:34.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 -- 172.21.15.60:0/2395008088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 msgr2=0x7fc3d00fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 --2- 172.21.15.60:0/2395008088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d00fffd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc004940 tx=0x7fc3bc009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:34.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 -- 172.21.15.60:0/2395008088 shutdown_connections 2024-04-12T13:47:34.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 --2- 172.21.15.60:0/2395008088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d00fffd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 --2- 172.21.15.60:0/2395008088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 0x7fc3d00fd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.603+0000 7fc3cf200700 1 -- 172.21.15.60:0/2395008088 >> 172.21.15.60:0/2395008088 conn(0x7fc3d00f7290 msgr2=0x7fc3d00f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:34.608 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:34 smithi060 ceph-mon[94333]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:34.608 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:34 smithi060 ceph-mon[94333]: Upgrade: Updating osd.1 2024-04-12T13:47:34.608 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:34 smithi060 ceph-mon[94333]: Deploying daemon osd.1 on smithi060 2024-04-12T13:47:34.609 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:34 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3463958767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:34.609 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:34 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3181119126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.604+0000 7fc3cf200700 1 -- 172.21.15.60:0/2395008088 shutdown_connections 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.604+0000 7fc3cf200700 1 -- 172.21.15.60:0/2395008088 wait complete. 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.605+0000 7fc3cf200700 1 Processor -- start 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.606+0000 7fc3cf200700 1 -- start start 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.606+0000 7fc3cf200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 0x7fc3d0113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.606+0000 7fc3cf200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.606+0000 7fc3cf200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0114ab0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.606+0000 7fc3cf200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01151a0 con 0x7fc3d0066b80 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50510/0 (socket says 172.21.15.60:50510) 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 -- 172.21.15.60:0/3562397630 learned_addr learned my addr 172.21.15.60:0/3562397630 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cde00700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 0x7fc3d0113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 -- 172.21.15.60:0/3562397630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 msgr2=0x7fc3d0113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 0x7fc3d0113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.607+0000 7fc3cd400700 1 -- 172.21.15.60:0/3562397630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc005040 con 0x7fc3d00fdb50 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3cd400700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00b3b0 tx=0x7fc3bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3bc00e040 con 0x7fc3d00fdb50 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3bc004290 con 0x7fc3d00fdb50 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3bc01c630 con 0x7fc3d00fdb50 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d0115420 con 0x7fc3d00fdb50 2024-04-12T13:47:34.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.608+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d01159e0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.610+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d005f5f0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.611+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc3bc00bbf0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.612+0000 7fc3c6000700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 0x7fc3b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:47:34.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.612+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc3bc08fbf0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.612+0000 7fc3cde00700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 0x7fc3b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:47:34.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.613+0000 7fc3cde00700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 0x7fc3b40710c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:47:34.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.617+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc3bc05c5d0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:34 smithi110 ceph-mon[82130]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:34 smithi110 ceph-mon[82130]: Upgrade: Updating osd.1 2024-04-12T13:47:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:34 smithi110 ceph-mon[82130]: Deploying daemon osd.1 on smithi060 2024-04-12T13:47:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:34 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3463958767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:47:34.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:34 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3181119126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:47:34.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.946+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3d004bed0 con 0x7fc3d00fdb50 2024-04-12T13:47:34.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.947+0000 7fc3c6000700 1 -- 172.21.15.60:0/3562397630 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7fc3bc05c160 con 0x7fc3d00fdb50 2024-04-12T13:47:34.950 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:47:34.950 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:47:34.950 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:47:34.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 msgr2=0x7fc3b40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 0x7fc3b40710c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0009040 comp rx=0 tx=0).stop 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 msgr2=0x7fc3d01144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00b3b0 tx=0x7fc3bc009e30 comp rx=0 tx=0).stop 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 shutdown_connections 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3b406ec10 0x7fc3b40710c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d0066b80 0x7fc3d0113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 --2- 172.21.15.60:0/3562397630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3d00fdb50 0x7fc3d01144b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 >> 172.21.15.60:0/3562397630 conn(0x7fc3d00f7290 msgr2=0x7fc3d00f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 shutdown_connections 2024-04-12T13:47:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:47:34.950+0000 7fc3cf200700 1 -- 172.21.15.60:0/3562397630 wait complete. 2024-04-12T13:47:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:35 smithi060 ceph-mon[94333]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:35 smithi060 ceph-mon[94333]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:35 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3562397630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:47:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:35 smithi110 ceph-mon[82130]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:35 smithi110 ceph-mon[82130]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:47:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:35 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3562397630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:47:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:37 smithi060 ceph-mon[94333]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:37.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:37 smithi110 ceph-mon[82130]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:38.430 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:38 smithi060 systemd[1]: Stopping Ceph osd.1 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:47:38.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:38 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[54798]: 2024-04-12T13:47:38.540+0000 7f826ba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:47:38.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:38 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[54798]: 2024-04-12T13:47:38.540+0000 7f826ba00700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-12T13:47:38.931 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:38 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[54798]: 2024-04-12T13:47:38.540+0000 7f826ba00700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:47:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:39 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:39 smithi060 ceph-mon[94333]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:39 smithi060 ceph-mon[94333]: osd.1 marked itself down and dead 2024-04-12T13:47:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:39 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:39 smithi110 ceph-mon[82130]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:39 smithi110 ceph-mon[82130]: osd.1 marked itself down and dead 2024-04-12T13:47:40.180 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:39 smithi060 podman[108327]: 2024-04-12 13:47:39.921515421 +0000 UTC m=+1.533409064 container stop c13c009637fca4b9cd0a4c2c12c0a7f9ab960382b9fcdb9f06b39dc350d50d03 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-12T13:47:40.180 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:39 smithi060 podman[108327]: 2024-04-12 13:47:39.951543092 +0000 UTC m=+1.563436712 container died c13c009637fca4b9cd0a4c2c12c0a7f9ab960382b9fcdb9f06b39dc350d50d03 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-12T13:47:40.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:40 smithi060 podman[108327]: 2024-04-12 13:47:40.449309603 +0000 UTC m=+2.061203247 container cleanup c13c009637fca4b9cd0a4c2c12c0a7f9ab960382b9fcdb9f06b39dc350d50d03 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-64502-quincy-2-730340d) 2024-04-12T13:47:40.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:40 smithi060 bash[108327]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1 2024-04-12T13:47:40.476 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:40 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:47:40.477 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:40 smithi060 ceph-mon[94333]: osdmap e55: 6 total, 5 up, 6 in 2024-04-12T13:47:40.477 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:40 smithi060 ceph-mon[94333]: osdmap e56: 6 total, 5 up, 6 in 2024-04-12T13:47:40.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:40 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:47:40.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:40 smithi110 ceph-mon[82130]: osdmap e55: 6 total, 5 up, 6 in 2024-04-12T13:47:40.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:40 smithi110 ceph-mon[82130]: osdmap e56: 6 total, 5 up, 6 in 2024-04-12T13:47:41.180 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:40 smithi060 podman[108346]: 2024-04-12 13:47:40.726009187 +0000 UTC m=+0.783916643 container remove c13c009637fca4b9cd0a4c2c12c0a7f9ab960382b9fcdb9f06b39dc350d50d03 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:41.571 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:41 smithi060 ceph-mon[94333]: pgmap v88: 65 pgs: 12 stale+active+clean, 53 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:41 smithi110 ceph-mon[82130]: pgmap v88: 65 pgs: 12 stale+active+clean, 53 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T13:47:41.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:41 smithi060 podman[108433]: 2024-04-12 13:47:41.474978922 +0000 UTC m=+0.033697076 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:41.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:41 smithi060 podman[108433]: 2024-04-12 13:47:41.769220878 +0000 UTC m=+0.327939084 container create 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:42.364 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:42 smithi060 podman[108433]: 2024-04-12 13:47:42.098244662 +0000 UTC m=+0.656962868 container init 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:47:42.364 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:42 smithi060 podman[108433]: 2024-04-12 13:47:42.112419199 +0000 UTC m=+0.671137415 container start 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-12T13:47:42.364 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:42 smithi060 podman[108433]: 2024-04-12 13:47:42.188615835 +0000 UTC m=+0.747334071 container attach 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:42.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:42 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded (PG_DEGRADED) 2024-04-12T13:47:42.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:42 smithi060 podman[108433]: 2024-04-12 13:47:42.576923627 +0000 UTC m=+1.135641820 container died 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-12T13:47:42.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:42 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded (PG_DEGRADED) 2024-04-12T13:47:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:43 smithi110 ceph-mon[82130]: pgmap v89: 65 pgs: 1 active+undersized+degraded, 9 stale+active+clean, 4 active+undersized, 51 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-04-12T13:47:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:43 smithi060 ceph-mon[94333]: pgmap v89: 65 pgs: 1 active+undersized+degraded, 9 stale+active+clean, 4 active+undersized, 51 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-04-12T13:47:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:43.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:43 smithi060 podman[108459]: 2024-04-12 13:47:43.426757099 +0000 UTC m=+0.830052317 container remove 6f80cd7b1abfdf0c97c1758a0d8452173f8a2da114daae3f66727131eea40f78 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-12T13:47:43.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:43 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-12T13:47:43.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:43 smithi060 systemd[1]: Stopped Ceph osd.1 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:47:43.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:43 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.1.service: Consumed 1min 55.767s CPU time. 2024-04-12T13:47:44.180 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:43 smithi060 systemd[1]: Starting Ceph osd.1 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:47:44.552 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:44 smithi060 podman[108563]: 2024-04-12 13:47:44.277951347 +0000 UTC m=+0.130382812 container create bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-12T13:47:44.552 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:44 smithi060 podman[108563]: 2024-04-12 13:47:44.185426007 +0000 UTC m=+0.037857440 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:44.552 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:44 smithi060 podman[108563]: 2024-04-12 13:47:44.5494838 +0000 UTC m=+0.401915317 container init bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, ceph=True) 2024-04-12T13:47:44.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:44 smithi060 podman[108563]: 2024-04-12 13:47:44.563745819 +0000 UTC m=+0.416177319 container start bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5) 2024-04-12T13:47:44.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:44 smithi060 podman[108563]: 2024-04-12 13:47:44.680945208 +0000 UTC m=+0.533376754 container attach bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:47:45.474 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-mon[94333]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:45.475 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T13:47:45.475 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T13:47:45.475 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 bash[108563]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T13:47:45.476 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate[108578]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-12T13:47:45.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:45 smithi110 ceph-mon[82130]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:45.897 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:45 smithi060 podman[108563]: 2024-04-12 13:47:45.534602588 +0000 UTC m=+1.387034065 container died bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-12T13:47:46.680 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:46 smithi060 podman[108701]: 2024-04-12 13:47:46.364820709 +0000 UTC m=+0.809737145 container remove bfda90c818705d9445008bd7542d713fda1beef10b870c3afe1ff312ff9fad01 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-04-12T13:47:47.078 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:46 smithi060 podman[108767]: 2024-04-12 13:47:46.653477726 +0000 UTC m=+0.038619315 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:47:47.078 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:46 smithi060 podman[108767]: 2024-04-12 13:47:46.786400632 +0000 UTC m=+0.171542236 container create 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5) 2024-04-12T13:47:47.078 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 podman[108767]: 2024-04-12 13:47:47.076144565 +0000 UTC m=+0.461286185 container init 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-04-12T13:47:47.391 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 podman[108767]: 2024-04-12 13:47:47.089229034 +0000 UTC m=+0.474370611 container start 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-a971fd5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-12T13:47:47.391 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-osd[108787]: -- 172.21.15.60:0/2705207052 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fdf4b1f680 con 0x55fdf4ae9000 2024-04-12T13:47:47.391 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 bash[108767]: 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 2024-04-12T13:47:47.392 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 systemd[1]: Started Ceph osd.1 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:47:47.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-mon[94333]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:47.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:47.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:47.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:47 smithi110 ceph-mon[82130]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:47.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:47 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:47.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:47 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:47.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:47 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:47:47.930 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:47 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T13:47:47.666+0000 7f06fa5867c0 -1 Falling back to public interface 2024-04-12T13:47:48.658 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:48 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:48.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:48 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T13:47:49.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:49 smithi060 ceph-mon[94333]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:49 smithi110 ceph-mon[82130]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:51 smithi060 ceph-mon[94333]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:51.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:51 smithi110 ceph-mon[82130]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:53 smithi060 ceph-mon[94333]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:53.681 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:53 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T13:47:53.598+0000 7f06fa5867c0 -1 osd.1 54 log_to_monitors true 2024-04-12T13:47:53.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:53 smithi110 ceph-mon[82130]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:54 smithi060 ceph-mon[94333]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T13:47:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:54.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:54.681 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 13:47:54 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T13:47:54.445+0000 7f06e9a00700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:47:54.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:54 smithi110 ceph-mon[82130]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T13:47:54.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:54.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:55 smithi110 ceph-mon[82130]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:55 smithi110 ceph-mon[82130]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T13:47:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:55 smithi110 ceph-mon[82130]: osdmap e57: 6 total, 5 up, 6 in 2024-04-12T13:47:55.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:55 smithi110 ceph-mon[82130]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:47:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:55 smithi060 ceph-mon[94333]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:55 smithi060 ceph-mon[94333]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T13:47:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:55 smithi060 ceph-mon[94333]: osdmap e57: 6 total, 5 up, 6 in 2024-04-12T13:47:55.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:55 smithi060 ceph-mon[94333]: from='osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:47:56.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:47:56.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170] boot 2024-04-12T13:47:56.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: osdmap e58: 6 total, 6 up, 6 in 2024-04-12T13:47:56.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:47:56.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:56.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:56.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:56 smithi110 ceph-mon[82130]: osdmap e59: 6 total, 6 up, 6 in 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: osd.1 [v2:172.21.15.60:6810/1855254170,v1:172.21.15.60:6811/1855254170] boot 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: osdmap e58: 6 total, 6 up, 6 in 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:56 smithi060 ceph-mon[94333]: osdmap e59: 6 total, 6 up, 6 in 2024-04-12T13:47:57.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:57 smithi060 ceph-mon[94333]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:57.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:57 smithi110 ceph-mon[82130]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:59.317 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:59.317 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:59.317 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:47:59 smithi060 ceph-mon[94333]: pgmap v100: 65 pgs: 12 active+undersized+degraded, 20 active+undersized, 33 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:47:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:47:59.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:47:59.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:47:59 smithi110 ceph-mon[82130]: pgmap v100: 65 pgs: 12 active+undersized+degraded, 20 active+undersized, 33 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-04-12T13:48:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:00 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded) 2024-04-12T13:48:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:00 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/222 objects degraded (12.613%), 12 pgs degraded) 2024-04-12T13:48:01.558 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:01 smithi060 ceph-mon[94333]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:01 smithi110 ceph-mon[82130]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T13:48:03.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:03 smithi060 ceph-mon[94333]: Upgrade: osd.2 is safe to restart 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:03.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T13:48:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T13:48:03.480 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:03 smithi110 ceph-mon[82130]: Upgrade: osd.2 is safe to restart 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 -- 172.21.15.60:0/3529472041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fcff0 msgr2=0x7f0cb00fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3529472041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fcff0 0x7f0cb00fd460 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c004940 tx=0x7f0c9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 -- 172.21.15.60:0/3529472041 shutdown_connections 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3529472041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fcff0 0x7f0cb00fd460 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3529472041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fbd40 0x7f0cb00fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 -- 172.21.15.60:0/3529472041 >> 172.21.15.60:0/3529472041 conn(0x7f0cb00f74c0 msgr2=0x7f0cb00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:05.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 -- 172.21.15.60:0/3529472041 shutdown_connections 2024-04-12T13:48:05.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.127+0000 7f0cb5200700 1 -- 172.21.15.60:0/3529472041 wait complete. 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.128+0000 7f0cb5200700 1 Processor -- start 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.128+0000 7f0cb5200700 1 -- start start 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cb5200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cb5200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fcff0 0x7f0cb0114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cb5200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0114b70 con 0x7f0cb00fbd40 2024-04-12T13:48:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cb5200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01153c0 con 0x7f0cb00fcff0 2024-04-12T13:48:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cade00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cade00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48332/0 (socket says 172.21.15.60:48332) 2024-04-12T13:48:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cade00700 1 -- 172.21.15.60:0/3497137121 learned_addr learned my addr 172.21.15.60:0/3497137121 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.129+0000 7f0cad400700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fcff0 0x7f0cb0114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0cade00700 1 -- 172.21.15.60:0/3497137121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fcff0 msgr2=0x7f0cb0114570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0cade00700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fcff0 0x7f0cb0114570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0cade00700 1 -- 172.21.15.60:0/3497137121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c005040 con 0x7f0cb00fbd40 2024-04-12T13:48:05.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0cade00700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0002a50 tx=0x7f0ca00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:05.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca0007cc0 con 0x7f0cb00fbd40 2024-04-12T13:48:05.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.130+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ca000f040 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.131+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb01156a0 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.131+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca0009640 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.131+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0115be0 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.132+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb0101980 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.133+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ca00097c0 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.134+0000 7f0ca6000700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 0x7f0c940710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.134+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0ca008e620 con 0x7f0cb00fbd40 2024-04-12T13:48:05.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.135+0000 7f0cad400700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 0x7f0c940710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.135+0000 7f0cad400700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 0x7f0c940710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b3b0 tx=0x7f0c9c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.145+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f0ca005af00 con 0x7f0cb00fbd40 2024-04-12T13:48:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.401+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cb0104930 con 0x7f0c9406ec10 2024-04-12T13:48:05.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.403+0000 7f0ca6000700 1 -- 172.21.15.60:0/3497137121 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0cb0104930 con 0x7f0c9406ec10 2024-04-12T13:48:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 msgr2=0x7f0c940710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 0x7f0c940710c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b3b0 tx=0x7f0c9c009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 msgr2=0x7f0cb0114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0002a50 tx=0x7f0ca00046b0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 shutdown_connections 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c9406ec10 0x7f0c940710c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb00fbd40 0x7f0cb0114030 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 --2- 172.21.15.60:0/3497137121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cb00fcff0 0x7f0cb0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.407+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 >> 172.21.15.60:0/3497137121 conn(0x7f0cb00f74c0 msgr2=0x7f0cb00f8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.408+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 shutdown_connections 2024-04-12T13:48:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.408+0000 7f0cb5200700 1 -- 172.21.15.60:0/3497137121 wait complete. 2024-04-12T13:48:05.435 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 -- 172.21.15.60:0/3222100694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e40709a0 msgr2=0x7f22e4070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3222100694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e40709a0 0x7f22e4070e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22d0004940 tx=0x7f22d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 -- 172.21.15.60:0/3222100694 shutdown_connections 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3222100694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e40709a0 0x7f22e4070e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3222100694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e4071f50 0x7f22e4070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 -- 172.21.15.60:0/3222100694 >> 172.21.15.60:0/3222100694 conn(0x7f22e40f8530 msgr2=0x7f22e40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 -- 172.21.15.60:0/3222100694 shutdown_connections 2024-04-12T13:48:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.569+0000 7f22ebc00700 1 -- 172.21.15.60:0/3222100694 wait complete. 2024-04-12T13:48:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.570+0000 7f22ebc00700 1 Processor -- start 2024-04-12T13:48:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22ebc00700 1 -- start start 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22ebc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e40709a0 0x7f22e4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22ebc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22ebc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4114c40 con 0x7f22e4071f50 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22ebc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4115430 con 0x7f22e40709a0 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22e3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48352/0 (socket says 172.21.15.60:48352) 2024-04-12T13:48:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.571+0000 7f22e3e00700 1 -- 172.21.15.60:0/3127242264 learned_addr learned my addr 172.21.15.60:0/3127242264 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.572+0000 7f22e9200700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e40709a0 0x7f22e4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.572+0000 7f22e3e00700 1 -- 172.21.15.60:0/3127242264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e40709a0 msgr2=0x7f22e4114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.572+0000 7f22e3e00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e40709a0 0x7f22e4114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.572+0000 7f22e3e00700 1 -- 172.21.15.60:0/3127242264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0005040 con 0x7f22e4071f50 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.572+0000 7f22e3e00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b3b0 tx=0x7f22d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.573+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d000e040 con 0x7f22e4071f50 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.573+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22d0004290 con 0x7f22e4071f50 2024-04-12T13:48:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.573+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e41156b0 con 0x7f22e4071f50 2024-04-12T13:48:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.573+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d001c630 con 0x7f22e4071f50 2024-04-12T13:48:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.573+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e4115c70 con 0x7f22e4071f50 2024-04-12T13:48:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.574+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e405f5f0 con 0x7f22e4071f50 2024-04-12T13:48:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.575+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f22d000bbf0 con 0x7f22e4071f50 2024-04-12T13:48:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.576+0000 7f22e0c00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 0x7f22cc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.577+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f22d008fcc0 con 0x7f22e4071f50 2024-04-12T13:48:05.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.577+0000 7f22e9200700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 0x7f22cc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.577+0000 7f22e9200700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 0x7f22cc0710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fd0 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:05.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.582+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f22d0095020 con 0x7f22e4071f50 2024-04-12T13:48:05.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.876+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22e4115f00 con 0x7f22cc06ec10 2024-04-12T13:48:05.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.878+0000 7f22e0c00700 1 -- 172.21.15.60:0/3127242264 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f22e4115f00 con 0x7f22cc06ec10 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 msgr2=0x7f22cc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 0x7f22cc0710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22d8006fd0 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 msgr2=0x7f22e41145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b3b0 tx=0x7f22d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 shutdown_connections 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f22cc06ec10 0x7f22cc0710c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e40709a0 0x7f22e4114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 --2- 172.21.15.60:0/3127242264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22e4071f50 0x7f22e41145b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 >> 172.21.15.60:0/3127242264 conn(0x7f22e40f8530 msgr2=0x7f22e40f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 shutdown_connections 2024-04-12T13:48:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:05.881+0000 7f22ebc00700 1 -- 172.21.15.60:0/3127242264 wait complete. 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: Upgrade: Updating osd.2 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:06.004 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:05 smithi060 ceph-mon[94333]: Deploying daemon osd.2 on smithi060 2024-04-12T13:48:06.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.032+0000 7fdba7e00700 1 -- 172.21.15.60:0/783496137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 msgr2=0x7fdba00ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.032+0000 7fdba7e00700 1 --2- 172.21.15.60:0/783496137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba00ff9e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb94004940 tx=0x7fdb94009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 -- 172.21.15.60:0/783496137 shutdown_connections 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 --2- 172.21.15.60:0/783496137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba0102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 --2- 172.21.15.60:0/783496137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba00ff9e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 -- 172.21.15.60:0/783496137 >> 172.21.15.60:0/783496137 conn(0x7fdba00f7450 msgr2=0x7fdba00f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 -- 172.21.15.60:0/783496137 shutdown_connections 2024-04-12T13:48:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.033+0000 7fdba7e00700 1 -- 172.21.15.60:0/783496137 wait complete. 2024-04-12T13:48:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 Processor -- start 2024-04-12T13:48:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 -- start start 2024-04-12T13:48:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba010e590 con 0x7fdba0066b80 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba7e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba010ede0 con 0x7fdba00fff20 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.034+0000 7fdba5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48374/0 (socket says 172.21.15.60:48374) 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 -- 172.21.15.60:0/2702441289 learned_addr learned my addr 172.21.15.60:0/2702441289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba4a00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 -- 172.21.15.60:0/2702441289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 msgr2=0x7fdba010df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba010df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 -- 172.21.15.60:0/2702441289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94005040 con 0x7fdba0066b80 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba4a00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:48:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.035+0000 7fdba5400700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b970 tx=0x7fdb94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.036+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb9400e040 con 0x7fdba0066b80 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.036+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb94004290 con 0x7fdba0066b80 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.036+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb9401c630 con 0x7fdba0066b80 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.036+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba010f060 con 0x7fdba0066b80 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.036+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba010f5a0 con 0x7fdba0066b80 2024-04-12T13:48:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.037+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba005f5f0 con 0x7fdba0066b80 2024-04-12T13:48:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.038+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb9400bbf0 con 0x7fdba0066b80 2024-04-12T13:48:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.040+0000 7fdb9d600700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 0x7fdb880710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.040+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdb9408fb20 con 0x7fdba0066b80 2024-04-12T13:48:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.040+0000 7fdba4a00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 0x7fdb880710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.041+0000 7fdba4a00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 0x7fdb880710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c007fd0 tx=0x7fdb8c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.044+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fdb9405c500 con 0x7fdba0066b80 2024-04-12T13:48:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: Upgrade: Updating osd.2 2024-04-12T13:48:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:06.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T13:48:06.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:06.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:05 smithi110 ceph-mon[82130]: Deploying daemon osd.2 on smithi060 2024-04-12T13:48:06.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.286+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba010f9e0 con 0x7fdb8806ec10 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.301+0000 7fdb9d600700 1 -- 172.21.15.60:0/2702441289 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdba010f9e0 con 0x7fdb8806ec10 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (5m) 12s ago 16m 14.9M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (90s) 12s ago 17m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (82s) 77s ago 15m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 12s ago 16m - - 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (9m) 12s ago 9m 14.4M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (9m) 12s ago 9m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:48:06.303 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (9m) 77s ago 9m 14.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (9m) 77s ago 9m 13.9M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (4m) 12s ago 18m 504M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (3m) 77s ago 15m 451M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (3m) 12s ago 18m 45.7M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (2m) 77s ago 15m 32.3M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (6m) 12s ago 17m 7948k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 77s ago 15m 8102k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (51s) 12s ago 14m 86.5M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (19s) 12s ago 13m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (13m) 12s ago 13m 208M 1559M 17.2.7-845-g730340d7 036a68d49952 67be85d9f8d7 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (12m) 77s ago 12m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (12m) 77s ago 12m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (11m) 77s ago 11m 227M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:48:06.304 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (3m) 12s ago 16m 56.8M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 msgr2=0x7fdb880710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 0x7fdb880710c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c007fd0 tx=0x7fdb8c009040 comp rx=0 tx=0).stop 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 msgr2=0x7fdba010da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b970 tx=0x7fdb94009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 shutdown_connections 2024-04-12T13:48:06.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb8806ec10 0x7fdb880710c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdba0066b80 0x7fdba010da50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 --2- 172.21.15.60:0/2702441289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdba00fff20 0x7fdba010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 >> 172.21.15.60:0/2702441289 conn(0x7fdba00f7450 msgr2=0x7fdba00f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:06.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 shutdown_connections 2024-04-12T13:48:06.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.304+0000 7fdba7e00700 1 -- 172.21.15.60:0/2702441289 wait complete. 2024-04-12T13:48:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 -- 172.21.15.60:0/4216472647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700662f0 msgr2=0x7fd4700ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 --2- 172.21.15.60:0/4216472647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700662f0 0x7fd4700ffa30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd460004940 tx=0x7fd460009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 -- 172.21.15.60:0/4216472647 shutdown_connections 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 --2- 172.21.15.60:0/4216472647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700fff70 0x7fd470102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 --2- 172.21.15.60:0/4216472647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700662f0 0x7fd4700ffa30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 -- 172.21.15.60:0/4216472647 >> 172.21.15.60:0/4216472647 conn(0x7fd4700f74c0 msgr2=0x7fd4700f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 -- 172.21.15.60:0/4216472647 shutdown_connections 2024-04-12T13:48:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.452+0000 7fd476800700 1 -- 172.21.15.60:0/4216472647 wait complete. 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 Processor -- start 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 -- start start 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 0x7fd47010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47010e5a0 con 0x7fd4700fff70 2024-04-12T13:48:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.453+0000 7fd476800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47010edf0 con 0x7fd4700662f0 2024-04-12T13:48:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48388/0 (socket says 172.21.15.60:48388) 2024-04-12T13:48:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 -- 172.21.15.60:0/1495000036 learned_addr learned my addr 172.21.15.60:0/1495000036 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46f400700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 0x7fd47010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 -- 172.21.15.60:0/1495000036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 msgr2=0x7fd47010da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 0x7fd47010da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46ea00700 1 -- 172.21.15.60:0/1495000036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460005040 con 0x7fd4700fff70 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.454+0000 7fd46f400700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 0x7fd47010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd46ea00700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd45c002a50 tx=0x7fd45c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45c007cc0 con 0x7fd4700fff70 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd45c00f040 con 0x7fd4700fff70 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45c009640 con 0x7fd4700fff70 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47010f0d0 con 0x7fd4700fff70 2024-04-12T13:48:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.455+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47010f610 con 0x7fd4700fff70 2024-04-12T13:48:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.456+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47005f5f0 con 0x7fd4700fff70 2024-04-12T13:48:06.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.458+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd45c0097a0 con 0x7fd4700fff70 2024-04-12T13:48:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.458+0000 7fd467400700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 0x7fd4540710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.459+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd45c08e510 con 0x7fd4700fff70 2024-04-12T13:48:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.459+0000 7fd46f400700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 0x7fd4540710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.459+0000 7fd46f400700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 0x7fd4540710b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b970 tx=0x7fd460009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.463+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd45c05af10 con 0x7fd4700fff70 2024-04-12T13:48:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.799+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4701058b0 con 0x7fd4700fff70 2024-04-12T13:48:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.800+0000 7fd467400700 1 -- 172.21.15.60:0/1495000036 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fd45c05aaa0 con 0x7fd4700fff70 2024-04-12T13:48:06.802 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:48:06.802 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:48:06.802 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 8, 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:48:06.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:48:06.804 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 msgr2=0x7fd4540710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 0x7fd4540710b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b970 tx=0x7fd460009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 msgr2=0x7fd47010dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd45c002a50 tx=0x7fd45c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 shutdown_connections 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd45406ec00 0x7fd4540710b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4700662f0 0x7fd47010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 --2- 172.21.15.60:0/1495000036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4700fff70 0x7fd47010dfa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 >> 172.21.15.60:0/1495000036 conn(0x7fd4700f74c0 msgr2=0x7fd4700f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.803+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 shutdown_connections 2024-04-12T13:48:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.804+0000 7fd476800700 1 -- 172.21.15.60:0/1495000036 wait complete. 2024-04-12T13:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.959+0000 7f5ed9600700 1 -- 172.21.15.60:0/3080897736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 msgr2=0x7f5ed40fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.959+0000 7f5ed9600700 1 --2- 172.21.15.60:0/3080897736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed40fd260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4004940 tx=0x7f5ec4009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:06.961 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:06 smithi060 ceph-mon[94333]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:06.961 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:06 smithi060 ceph-mon[94333]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:06.961 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:06 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1495000036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:06.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 -- 172.21.15.60:0/3080897736 shutdown_connections 2024-04-12T13:48:06.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 --2- 172.21.15.60:0/3080897736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed40fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 --2- 172.21.15.60:0/3080897736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed40fd260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 -- 172.21.15.60:0/3080897736 >> 172.21.15.60:0/3080897736 conn(0x7f5ed40f8580 msgr2=0x7f5ed40fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 -- 172.21.15.60:0/3080897736 shutdown_connections 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.960+0000 7f5ed9600700 1 -- 172.21.15.60:0/3080897736 wait complete. 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 Processor -- start 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 -- start start 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed4110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4110890 con 0x7f5ed40fce50 2024-04-12T13:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.961+0000 7f5ed9600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4110fd0 con 0x7f5ed40fe050 2024-04-12T13:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48404/0 (socket says 172.21.15.60:48404) 2024-04-12T13:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 -- 172.21.15.60:0/1893552107 learned_addr learned my addr 172.21.15.60:0/1893552107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5eca000700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed4110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 -- 172.21.15.60:0/1893552107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 msgr2=0x7f5ed4110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed4110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 -- 172.21.15.60:0/1893552107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4005040 con 0x7f5ed40fce50 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5eca000700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.962+0000 7f5ed2a00700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400b970 tx=0x7f5ec4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.963+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec400e040 con 0x7f5ed40fce50 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.963+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ec400bbf0 con 0x7f5ed40fce50 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.963+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec401c630 con 0x7f5ed40fce50 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.963+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed4111250 con 0x7f5ed40fce50 2024-04-12T13:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.963+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed4111810 con 0x7f5ed40fce50 2024-04-12T13:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.964+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed41019e0 con 0x7f5ed40fce50 2024-04-12T13:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.965+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5ec400bd60 con 0x7f5ed40fce50 2024-04-12T13:48:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.966+0000 7f5ecb400700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 0x7f5eb80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.966+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5ec408fb80 con 0x7f5ed40fce50 2024-04-12T13:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.966+0000 7f5eca000700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 0x7f5eb80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.967+0000 7f5eca000700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 0x7f5eb80710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009fd0 tx=0x7f5ebc009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:06.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:06.971+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f5ec405c560 con 0x7f5ed40fce50 2024-04-12T13:48:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:06 smithi110 ceph-mon[82130]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:06 smithi110 ceph-mon[82130]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:07.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:06 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1495000036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.243+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5ed404bed0 con 0x7f5ed40fce50 2024-04-12T13:48:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.244+0000 7f5ecb400700 1 -- 172.21.15.60:0/1893552107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f5ec405c0f0 con 0x7f5ed40fce50 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:48:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:48:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:07.248 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:07.249 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:48:07.249 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:07.249 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:07.249 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:07.249 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:07.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 msgr2=0x7f5eb80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 0x7f5eb80710c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009fd0 tx=0x7f5ebc009ee0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 msgr2=0x7f5ed410fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400b970 tx=0x7f5ec4009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 shutdown_connections 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5eb806ec10 0x7f5eb80710c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ed40fce50 0x7f5ed410fd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 --2- 172.21.15.60:0/1893552107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ed40fe050 0x7f5ed4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 >> 172.21.15.60:0/1893552107 conn(0x7f5ed40f8580 msgr2=0x7f5ed40f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 shutdown_connections 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.247+0000 7f5ed9600700 1 -- 172.21.15.60:0/1893552107 wait complete. 2024-04-12T13:48:07.251 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:48:07.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 -- 172.21.15.60:0/1406189007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 msgr2=0x7f90e40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 --2- 172.21.15.60:0/1406189007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e40fcb70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90d0004940 tx=0x7f90d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:07.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 -- 172.21.15.60:0/1406189007 shutdown_connections 2024-04-12T13:48:07.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 --2- 172.21.15.60:0/1406189007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e40fcb70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 --2- 172.21.15.60:0/1406189007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e40fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 -- 172.21.15.60:0/1406189007 >> 172.21.15.60:0/1406189007 conn(0x7f90e40f6bd0 msgr2=0x7f90e40f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:07.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.403+0000 7f90eaa00700 1 -- 172.21.15.60:0/1406189007 shutdown_connections 2024-04-12T13:48:07.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.404+0000 7f90eaa00700 1 -- 172.21.15.60:0/1406189007 wait complete. 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.404+0000 7f90eaa00700 1 Processor -- start 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90eaa00700 1 -- start start 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90eaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90eaa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90eaa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41106c0 con 0x7f90e40fc700 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90eaa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4110f10 con 0x7f90e40fb450 2024-04-12T13:48:07.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90e3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48426/0 (socket says 172.21.15.60:48426) 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.405+0000 7f90e3400700 1 -- 172.21.15.60:0/4034004328 learned_addr learned my addr 172.21.15.60:0/4034004328 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3e00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3400700 1 -- 172.21.15.60:0/4034004328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 msgr2=0x7f90e410fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3400700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e410fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3400700 1 -- 172.21.15.60:0/4034004328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0005040 con 0x7f90e40fc700 2024-04-12T13:48:07.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3e00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90e3400700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90d000b0d0 tx=0x7f90d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d000e030 con 0x7f90e40fc700 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90d001c400 con 0x7f90e40fc700 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.406+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4111190 con 0x7f90e40fc700 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.407+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d000b650 con 0x7f90e40fc700 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.407+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e41116d0 con 0x7f90e40fc700 2024-04-12T13:48:07.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.408+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e405f5f0 con 0x7f90e40fc700 2024-04-12T13:48:07.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.409+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f90d001c570 con 0x7f90e40fc700 2024-04-12T13:48:07.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.410+0000 7f90dbe00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 0x7f90c80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.410+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f90d008ff90 con 0x7f90e40fc700 2024-04-12T13:48:07.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.410+0000 7f90e3e00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 0x7f90c80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.411+0000 7f90e3e00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 0x7f90c80710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004710 tx=0x7f90d400c040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:07.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.415+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f90d005c970 con 0x7f90e40fc700 2024-04-12T13:48:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.696+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90e4111a00 con 0x7f90c806ec00 2024-04-12T13:48:07.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.698+0000 7f90dbe00700 1 -- 172.21.15.60:0/4034004328 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f90e4111a00 con 0x7f90c806ec00 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "8/21 daemons upgraded", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:48:07.700 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:48:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.701+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 msgr2=0x7f90c80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.701+0000 7f90eaa00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 0x7f90c80710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004710 tx=0x7f90d400c040 comp rx=0 tx=0).stop 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.701+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 msgr2=0x7f90e41100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.701+0000 7f90eaa00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f90d000b0d0 tx=0x7f90d0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 shutdown_connections 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f90c806ec00 0x7f90c80710b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90e40fb450 0x7f90e410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 --2- 172.21.15.60:0/4034004328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e40fc700 0x7f90e41100c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 >> 172.21.15.60:0/4034004328 conn(0x7f90e40f6bd0 msgr2=0x7f90e40f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 shutdown_connections 2024-04-12T13:48:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.702+0000 7f90eaa00700 1 -- 172.21.15.60:0/4034004328 wait complete. 2024-04-12T13:48:07.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.851+0000 7fa0c4600700 1 -- 172.21.15.60:0/1997883541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 msgr2=0x7fa0bc104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.851+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1997883541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc104b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8004940 tx=0x7fa0a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 -- 172.21.15.60:0/1997883541 shutdown_connections 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1997883541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc104b40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1997883541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 0x7fa0bc103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 -- 172.21.15.60:0/1997883541 >> 172.21.15.60:0/1997883541 conn(0x7fa0bc072640 msgr2=0x7fa0bc074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 -- 172.21.15.60:0/1997883541 shutdown_connections 2024-04-12T13:48:07.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 -- 172.21.15.60:0/1997883541 wait complete. 2024-04-12T13:48:07.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.852+0000 7fa0c4600700 1 Processor -- start 2024-04-12T13:48:07.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c4600700 1 -- start start 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 0x7fa0bc113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c4600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c4600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc114a90 con 0x7fa0bc1046d0 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c4600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc114c00 con 0x7fa0bc103420 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c1200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c1200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48454/0 (socket says 172.21.15.60:48454) 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.853+0000 7fa0c1200700 1 -- 172.21.15.60:0/1895346924 learned_addr learned my addr 172.21.15.60:0/1895346924 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.854+0000 7fa0c1c00700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 0x7fa0bc113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.854+0000 7fa0c1200700 1 -- 172.21.15.60:0/1895346924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 msgr2=0x7fa0bc113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.854+0000 7fa0c1200700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 0x7fa0bc113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.854+0000 7fa0c1200700 1 -- 172.21.15.60:0/1895346924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8005040 con 0x7fa0bc1046d0 2024-04-12T13:48:07.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.854+0000 7fa0c1200700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009150 tx=0x7fa0a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:07.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.856+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a800e040 con 0x7fa0bc1046d0 2024-04-12T13:48:07.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.856+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0a800bbf0 con 0x7fa0bc1046d0 2024-04-12T13:48:07.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.856+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc119600 con 0x7fa0bc1046d0 2024-04-12T13:48:07.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.856+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0a801c630 con 0x7fa0bc1046d0 2024-04-12T13:48:07.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.856+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc119bc0 con 0x7fa0bc1046d0 2024-04-12T13:48:07.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.857+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc04c710 con 0x7fa0bc1046d0 2024-04-12T13:48:07.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.858+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa0a800bd60 con 0x7fa0bc1046d0 2024-04-12T13:48:07.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.859+0000 7fa0b9600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 0x7fa0a40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.859+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa0a808fad0 con 0x7fa0bc1046d0 2024-04-12T13:48:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.859+0000 7fa0c1c00700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 0x7fa0a40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.860+0000 7fa0c1c00700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 0x7fa0a40710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0004990 tx=0x7fa0b0009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:07.864+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fa0a805c570 con 0x7fa0bc1046d0 2024-04-12T13:48:08.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:07 smithi060 ceph-mon[94333]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:08.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:07 smithi060 ceph-mon[94333]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:08.040 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:07 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1893552107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:48:08.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.199+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa0bc10bf10 con 0x7fa0bc1046d0 2024-04-12T13:48:08.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.199+0000 7fa0b9600700 1 -- 172.21.15.60:0/1895346924 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7fa0a805c100 con 0x7fa0bc1046d0 2024-04-12T13:48:08.201 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:48:08.201 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:48:08.201 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:48:08.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 msgr2=0x7fa0a40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 0x7fa0a40710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0004990 tx=0x7fa0b0009ee0 comp rx=0 tx=0).stop 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 msgr2=0x7fa0bc114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009150 tx=0x7fa0a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 shutdown_connections 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa0a406ec00 0x7fa0a40710b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0bc103420 0x7fa0bc113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 --2- 172.21.15.60:0/1895346924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0bc1046d0 0x7fa0bc114490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 >> 172.21.15.60:0/1895346924 conn(0x7fa0bc072640 msgr2=0x7fa0bc073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 shutdown_connections 2024-04-12T13:48:08.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:08.203+0000 7fa0c4600700 1 -- 172.21.15.60:0/1895346924 wait complete. 2024-04-12T13:48:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:07 smithi110 ceph-mon[82130]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:07 smithi110 ceph-mon[82130]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:07 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1893552107' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:48:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:08 smithi060 ceph-mon[94333]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:08 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1895346924' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:48:09.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:08 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:08 smithi110 ceph-mon[82130]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:08 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1895346924' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:48:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:08 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:09.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:09 smithi060 ceph-mon[94333]: pgmap v106: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:09 smithi110 ceph-mon[82130]: pgmap v106: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:10.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:10 smithi060 systemd[1]: Stopping Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:48:10.872 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:10 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[62543]: 2024-04-12T13:48:10.537+0000 7f4fa0a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:48:10.873 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:10 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[62543]: 2024-04-12T13:48:10.537+0000 7f4fa0a00700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-12T13:48:10.873 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:10 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[62543]: 2024-04-12T13:48:10.537+0000 7f4fa0a00700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:48:11.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:10 smithi060 ceph-mon[94333]: osd.2 marked itself down and dead 2024-04-12T13:48:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:10 smithi110 ceph-mon[82130]: osd.2 marked itself down and dead 2024-04-12T13:48:11.875 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:11 smithi060 podman[113882]: 2024-04-12 13:48:11.56881657 +0000 UTC m=+1.188442065 container stop 67be85d9f8d70ba0280eeff33d4af67f0023d1f63e37accc8dbd1f8055557f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, RELEASE=wip-64502-quincy-2-730340d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-12T13:48:11.875 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:11 smithi060 podman[113882]: 2024-04-12 13:48:11.598723645 +0000 UTC m=+1.218349140 container died 67be85d9f8d70ba0280eeff33d4af67f0023d1f63e37accc8dbd1f8055557f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, RELEASE=wip-64502-quincy-2-730340d, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-12T13:48:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:11 smithi060 ceph-mon[94333]: pgmap v107: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:11 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:48:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:11 smithi060 ceph-mon[94333]: osdmap e60: 6 total, 5 up, 6 in 2024-04-12T13:48:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:11 smithi110 ceph-mon[82130]: pgmap v107: 65 pgs: 65 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:11 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:48:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:11 smithi110 ceph-mon[82130]: osdmap e60: 6 total, 5 up, 6 in 2024-04-12T13:48:12.626 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:12 smithi060 podman[113882]: 2024-04-12 13:48:12.180738813 +0000 UTC m=+1.800364304 container cleanup 67be85d9f8d70ba0280eeff33d4af67f0023d1f63e37accc8dbd1f8055557f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-64502-quincy-2-730340d, ceph=True, org.label-schema.schema-version=1.0) 2024-04-12T13:48:12.626 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:12 smithi060 bash[113882]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2 2024-04-12T13:48:12.896 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:12 smithi060 podman[113903]: 2024-04-12 13:48:12.624036243 +0000 UTC m=+1.034638289 container remove 67be85d9f8d70ba0280eeff33d4af67f0023d1f63e37accc8dbd1f8055557f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-64502-quincy-2-730340d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-12T13:48:13.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:12 smithi060 ceph-mon[94333]: osdmap e61: 6 total, 5 up, 6 in 2024-04-12T13:48:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:12 smithi110 ceph-mon[82130]: osdmap e61: 6 total, 5 up, 6 in 2024-04-12T13:48:13.808 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:13 smithi060 podman[113990]: 2024-04-12 13:48:13.383480005 +0000 UTC m=+0.042902352 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:48:13.808 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:13 smithi060 podman[113990]: 2024-04-12 13:48:13.508701839 +0000 UTC m=+0.168124225 container create e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-a971fd5, GIT_CLEAN=True) 2024-04-12T13:48:13.808 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:13 smithi060 podman[113990]: 2024-04-12 13:48:13.804972033 +0000 UTC m=+0.464394472 container init e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-12T13:48:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: pgmap v110: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 2]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 5]}]: dispatch 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:14.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:14.182 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:13 smithi060 podman[113990]: 2024-04-12 13:48:13.818502902 +0000 UTC m=+0.477925288 container start e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:48:14.182 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:13 smithi060 podman[113990]: 2024-04-12 13:48:13.903008734 +0000 UTC m=+0.562431122 container attach e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-a971fd5, org.label-schema.license=GPLv2) 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: pgmap v110: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 2]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 5]}]: dispatch 2024-04-12T13:48:14.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:14.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:14.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:14 smithi060 podman[113990]: 2024-04-12 13:48:14.295610682 +0000 UTC m=+0.955033071 container died e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240403) 2024-04-12T13:48:15.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]': finished 2024-04-12T13:48:15.051 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 2]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 5]}]': finished 2024-04-12T13:48:15.052 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:14 smithi060 ceph-mon[94333]: osdmap e62: 6 total, 5 up, 6 in 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 5]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 2]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [1, 5]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 2]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 5]}]': finished 2024-04-12T13:48:15.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:14 smithi110 ceph-mon[82130]: osdmap e62: 6 total, 5 up, 6 in 2024-04-12T13:48:15.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 podman[114016]: 2024-04-12 13:48:15.048907911 +0000 UTC m=+0.731777426 container remove e81d9183e25c785b3f3763323b67ef999ca86cc883499fcfd11857cf470ae2ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:48:15.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-12T13:48:15.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 systemd[1]: Stopped Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:48:15.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service: Consumed 1min 38.725s CPU time. 2024-04-12T13:48:15.875 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 systemd[1]: Starting Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:48:16.125 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:15 smithi060 ceph-mon[94333]: pgmap v112: 65 pgs: 5 peering, 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 37 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-04-12T13:48:16.125 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:15 smithi060 ceph-mon[94333]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-12T13:48:16.125 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:15 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:16.125 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:15 smithi060 ceph-mon[94333]: osdmap e63: 6 total, 5 up, 6 in 2024-04-12T13:48:16.125 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 podman[114117]: 2024-04-12 13:48:15.779693287 +0000 UTC m=+0.038005832 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:48:16.126 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:15 smithi060 podman[114117]: 2024-04-12 13:48:15.923069292 +0000 UTC m=+0.181381868 container create c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-a971fd5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:48:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:15 smithi110 ceph-mon[82130]: pgmap v112: 65 pgs: 5 peering, 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 37 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-04-12T13:48:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:15 smithi110 ceph-mon[82130]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-12T13:48:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:15 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:15 smithi110 ceph-mon[82130]: osdmap e63: 6 total, 5 up, 6 in 2024-04-12T13:48:16.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:16 smithi060 podman[114117]: 2024-04-12 13:48:16.230330552 +0000 UTC m=+0.488643152 container init c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-12T13:48:16.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:16 smithi060 podman[114117]: 2024-04-12 13:48:16.242889148 +0000 UTC m=+0.501201700 container start c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, RELEASE=main-a971fd5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:48:16.431 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:16 smithi060 podman[114117]: 2024-04-12 13:48:16.345553019 +0000 UTC m=+0.603865609 container attach c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-a971fd5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:48:17.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:16 smithi060 ceph-mon[94333]: osdmap e64: 6 total, 5 up, 6 in 2024-04-12T13:48:17.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:16 smithi110 ceph-mon[82130]: osdmap e64: 6 total, 5 up, 6 in 2024-04-12T13:48:17.682 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T13:48:17.682 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T13:48:17.682 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T13:48:17.682 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T13:48:17.682 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 bash[114117]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate[114131]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-12T13:48:17.683 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:17 smithi060 podman[114117]: 2024-04-12 13:48:17.26865043 +0000 UTC m=+1.526963028 container died c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, ceph=True, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403) 2024-04-12T13:48:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-mon[94333]: pgmap v115: 65 pgs: 6 peering, 12 active+undersized+degraded, 1 stale+active+clean, 12 active+undersized, 34 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-04-12T13:48:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:17 smithi060 ceph-mon[94333]: osdmap e65: 6 total, 5 up, 6 in 2024-04-12T13:48:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:17 smithi110 ceph-mon[82130]: pgmap v115: 65 pgs: 6 peering, 12 active+undersized+degraded, 1 stale+active+clean, 12 active+undersized, 34 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-04-12T13:48:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:17 smithi110 ceph-mon[82130]: osdmap e65: 6 total, 5 up, 6 in 2024-04-12T13:48:18.646 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:18 smithi060 podman[114270]: 2024-04-12 13:48:18.267586681 +0000 UTC m=+0.981791898 container remove c901b23a6c76e72ae27c835a023d733771ccfa254d17431a5b1354def2cf5085 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:48:18.930 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:18 smithi060 podman[114330]: 2024-04-12 13:48:18.551716423 +0000 UTC m=+0.036085580 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:48:18.930 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:18 smithi060 podman[114330]: 2024-04-12 13:48:18.68530317 +0000 UTC m=+0.169672362 container create ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:48:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:18 smithi110 ceph-mon[82130]: osdmap e66: 6 total, 5 up, 6 in 2024-04-12T13:48:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:18 smithi110 ceph-mon[82130]: pgmap v118: 65 pgs: 6 peering, 12 active+undersized+degraded, 1 stale+active+clean, 12 active+undersized, 34 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-04-12T13:48:19.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:18 smithi060 ceph-mon[94333]: osdmap e66: 6 total, 5 up, 6 in 2024-04-12T13:48:19.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:18 smithi060 ceph-mon[94333]: pgmap v118: 65 pgs: 6 peering, 12 active+undersized+degraded, 1 stale+active+clean, 12 active+undersized, 34 active+clean; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-04-12T13:48:19.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 podman[114330]: 2024-04-12 13:48:19.006434054 +0000 UTC m=+0.490803283 container init ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:48:19.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 podman[114330]: 2024-04-12 13:48:19.020183413 +0000 UTC m=+0.504552575 container start ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-04-12T13:48:19.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 ceph-osd[114349]: -- 172.21.15.60:0/1391971139 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce1be35680 con 0x55ce1bdff000 2024-04-12T13:48:19.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 bash[114330]: ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce 2024-04-12T13:48:19.430 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 systemd[1]: Started Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:48:19.930 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:19 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T13:48:19.591+0000 7ff5599317c0 -1 Falling back to public interface 2024-04-12T13:48:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:20.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:20 smithi060 ceph-mon[94333]: osdmap e67: 6 total, 5 up, 6 in 2024-04-12T13:48:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:20.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:20.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:20 smithi110 ceph-mon[82130]: osdmap e67: 6 total, 5 up, 6 in 2024-04-12T13:48:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:21 smithi060 ceph-mon[94333]: pgmap v120: 65 pgs: 32 active+clean, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+remapped, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 6 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 716/222 objects misplaced (322.523%); 7 B/s, 2 keys/s, 195 objects/s recovering 2024-04-12T13:48:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:21 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 27/222 objects degraded (12.162%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:21 smithi060 ceph-mon[94333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T13:48:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:21 smithi060 ceph-mon[94333]: osdmap e68: 6 total, 5 up, 6 in 2024-04-12T13:48:21.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:21 smithi110 ceph-mon[82130]: pgmap v120: 65 pgs: 32 active+clean, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+remapped, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 6 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 716/222 objects misplaced (322.523%); 7 B/s, 2 keys/s, 195 objects/s recovering 2024-04-12T13:48:21.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:21 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 27/222 objects degraded (12.162%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:21.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:21 smithi110 ceph-mon[82130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T13:48:21.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:21 smithi110 ceph-mon[82130]: osdmap e68: 6 total, 5 up, 6 in 2024-04-12T13:48:23.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:23 smithi060 ceph-mon[94333]: pgmap v122: 65 pgs: 32 active+clean, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+remapped, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 6 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 716/222 objects misplaced (322.523%); 6 B/s, 1 keys/s, 158 objects/s recovering 2024-04-12T13:48:23.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:23 smithi060 ceph-mon[94333]: osdmap e69: 6 total, 5 up, 6 in 2024-04-12T13:48:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:23 smithi110 ceph-mon[82130]: pgmap v122: 65 pgs: 32 active+clean, 2 active+recovering+undersized+remapped, 1 active+recovery_wait+undersized+remapped, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 6 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 716/222 objects misplaced (322.523%); 6 B/s, 1 keys/s, 158 objects/s recovering 2024-04-12T13:48:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:23 smithi110 ceph-mon[82130]: osdmap e69: 6 total, 5 up, 6 in 2024-04-12T13:48:24.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:24 smithi060 ceph-mon[94333]: osdmap e70: 6 total, 5 up, 6 in 2024-04-12T13:48:24.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:24 smithi110 ceph-mon[82130]: osdmap e70: 6 total, 5 up, 6 in 2024-04-12T13:48:25.361 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:25 smithi060 ceph-mon[94333]: pgmap v125: 65 pgs: 33 active+clean, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 8 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%); 0 B/s, 479 objects/s recovering 2024-04-12T13:48:25.361 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:25 smithi060 ceph-mon[94333]: osdmap e71: 6 total, 5 up, 6 in 2024-04-12T13:48:25.361 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:25 smithi060 ceph-mon[94333]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T13:48:25.361 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:24 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T13:48:24.974+0000 7ff5599317c0 -1 osd.2 59 log_to_monitors true 2024-04-12T13:48:25.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:25 smithi110 ceph-mon[82130]: pgmap v125: 65 pgs: 33 active+clean, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 8 active+clean+remapped; 202 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%); 0 B/s, 479 objects/s recovering 2024-04-12T13:48:25.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:25 smithi110 ceph-mon[82130]: osdmap e71: 6 total, 5 up, 6 in 2024-04-12T13:48:25.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:25 smithi110 ceph-mon[82130]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T13:48:26.680 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T13:48:26.382+0000 7ff543c00700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:48:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-mon[94333]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T13:48:26.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-mon[94333]: osdmap e72: 6 total, 5 up, 6 in 2024-04-12T13:48:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-mon[94333]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:48:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:26.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:26 smithi110 ceph-mon[82130]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T13:48:26.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:26 smithi110 ceph-mon[82130]: osdmap e72: 6 total, 5 up, 6 in 2024-04-12T13:48:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:26 smithi110 ceph-mon[82130]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-04-12T13:48:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:26.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:27 smithi060 ceph-mon[94333]: pgmap v128: 65 pgs: 33 active+clean, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 8 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%); 0 B/s, 504 objects/s recovering 2024-04-12T13:48:27.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:27 smithi060 ceph-mon[94333]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' 2024-04-12T13:48:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:27 smithi110 ceph-mon[82130]: pgmap v128: 65 pgs: 33 active+clean, 12 active+undersized, 1 active+undersized+remapped, 11 active+undersized+degraded, 8 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%); 0 B/s, 504 objects/s recovering 2024-04-12T13:48:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:27 smithi110 ceph-mon[82130]: from='osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082]' entity='osd.2' 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082] boot 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: osdmap e73: 6 total, 6 up, 6 in 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: osdmap e74: 6 total, 6 up, 6 in 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:28.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:28.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: osd.2 [v2:172.21.15.60:6818/2464051082,v1:172.21.15.60:6819/2464051082] boot 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: osdmap e73: 6 total, 6 up, 6 in 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: osdmap e74: 6 total, 6 up, 6 in 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:28.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:29 smithi060 ceph-mon[94333]: pgmap v131: 65 pgs: 33 active+clean, 12 active+undersized, 11 active+undersized+degraded, 9 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%) 2024-04-12T13:48:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:29 smithi060 ceph-mon[94333]: osdmap e75: 6 total, 6 up, 6 in 2024-04-12T13:48:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:29 smithi110 ceph-mon[82130]: pgmap v131: 65 pgs: 33 active+clean, 12 active+undersized, 11 active+undersized+degraded, 9 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%); 12/222 objects misplaced (5.405%) 2024-04-12T13:48:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:29 smithi110 ceph-mon[82130]: osdmap e75: 6 total, 6 up, 6 in 2024-04-12T13:48:30.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:30 smithi060 ceph-mon[94333]: osdmap e76: 6 total, 6 up, 6 in 2024-04-12T13:48:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:30 smithi060 ceph-mon[94333]: osdmap e77: 6 total, 6 up, 6 in 2024-04-12T13:48:30.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:30 smithi110 ceph-mon[82130]: osdmap e76: 6 total, 6 up, 6 in 2024-04-12T13:48:30.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:30 smithi110 ceph-mon[82130]: osdmap e77: 6 total, 6 up, 6 in 2024-04-12T13:48:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:31 smithi060 ceph-mon[94333]: pgmap v134: 65 pgs: 46 active+clean, 1 active+recovering+undersized+remapped, 6 active+undersized, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+undersized+remapped, 6 active+undersized+degraded, 2 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 782/222 objects degraded (352.252%); 7.0 MiB/s, 47 objects/s recovering 2024-04-12T13:48:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:31 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 782/222 objects degraded (352.252%), 7 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:31.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:31 smithi110 ceph-mon[82130]: pgmap v134: 65 pgs: 46 active+clean, 1 active+recovering+undersized+remapped, 6 active+undersized, 1 active+recovery_wait+undersized+degraded+remapped, 3 active+undersized+remapped, 6 active+undersized+degraded, 2 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 782/222 objects degraded (352.252%); 7.0 MiB/s, 47 objects/s recovering 2024-04-12T13:48:31.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:31 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 782/222 objects degraded (352.252%), 7 pgs degraded (PG_DEGRADED) 2024-04-12T13:48:32.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:32 smithi060 ceph-mon[94333]: osdmap e78: 6 total, 6 up, 6 in 2024-04-12T13:48:32.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:32 smithi110 ceph-mon[82130]: osdmap e78: 6 total, 6 up, 6 in 2024-04-12T13:48:33.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:33 smithi060 ceph-mon[94333]: pgmap v137: 65 pgs: 3 peering, 55 active+clean, 1 active+recovering+undersized+remapped, 3 active+undersized, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+degraded, 1 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 768/222 objects degraded (345.946%); 5.0 MiB/s, 43 objects/s recovering 2024-04-12T13:48:33.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:33 smithi060 ceph-mon[94333]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:48:33.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:33 smithi060 ceph-mon[94333]: osdmap e79: 6 total, 6 up, 6 in 2024-04-12T13:48:33.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:33 smithi110 ceph-mon[82130]: pgmap v137: 65 pgs: 3 peering, 55 active+clean, 1 active+recovering+undersized+remapped, 3 active+undersized, 1 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+degraded, 1 active+clean+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 768/222 objects degraded (345.946%); 5.0 MiB/s, 43 objects/s recovering 2024-04-12T13:48:33.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:33 smithi110 ceph-mon[82130]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:48:33.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:33 smithi110 ceph-mon[82130]: osdmap e79: 6 total, 6 up, 6 in 2024-04-12T13:48:34.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: osdmap e80: 6 total, 6 up, 6 in 2024-04-12T13:48:34.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:34.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:34.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:34.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:48:34.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:34.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: osdmap e80: 6 total, 6 up, 6 in 2024-04-12T13:48:34.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:34.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:34.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:34.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:48:34.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:35.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: pgmap v140: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 187 objects/s recovering 2024-04-12T13:48:35.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: pgmap v141: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 200 objects/s recovering 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: pgmap v142: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 275 objects/s recovering 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 768/222 objects degraded (345.946%), 2 pgs degraded) 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: osdmap e81: 6 total, 6 up, 6 in 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:35.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:35 smithi060 ceph-mon[94333]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: pgmap v140: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 187 objects/s recovering 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: pgmap v141: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 200 objects/s recovering 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: pgmap v142: 65 pgs: 4 peering, 60 active+clean, 1 active+recovering+undersized+remapped; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 275 objects/s recovering 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 768/222 objects degraded (345.946%), 2 pgs degraded) 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: osdmap e81: 6 total, 6 up, 6 in 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:35.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:35.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:35 smithi110 ceph-mon[82130]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-04-12T13:48:36.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:36 smithi060 ceph-mon[94333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:48:36.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:36 smithi110 ceph-mon[82130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:48:37.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:37 smithi060 ceph-mon[94333]: pgmap v144: 65 pgs: 1 peering, 64 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 353 objects/s recovering 2024-04-12T13:48:37.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:37 smithi110 ceph-mon[82130]: pgmap v144: 65 pgs: 1 peering, 64 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 353 objects/s recovering 2024-04-12T13:48:38.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 -- 172.21.15.60:0/3505009601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c066b80 msgr2=0x7f630c101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 --2- 172.21.15.60:0/3505009601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c066b80 0x7f630c101de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6300004940 tx=0x7f6300009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:38.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 -- 172.21.15.60:0/3505009601 shutdown_connections 2024-04-12T13:48:38.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 --2- 172.21.15.60:0/3505009601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c102320 0x7f630c104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 --2- 172.21.15.60:0/3505009601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c066b80 0x7f630c101de0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.384+0000 7f6314600700 1 -- 172.21.15.60:0/3505009601 >> 172.21.15.60:0/3505009601 conn(0x7f630c0f7450 msgr2=0x7f630c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:38.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.385+0000 7f6314600700 1 -- 172.21.15.60:0/3505009601 shutdown_connections 2024-04-12T13:48:38.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.385+0000 7f6314600700 1 -- 172.21.15.60:0/3505009601 wait complete. 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.385+0000 7f6314600700 1 Processor -- start 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6314600700 1 -- start start 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6314600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 0x7f630c0fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6314600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6314600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0fe910 con 0x7f630c102320 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6314600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0ff160 con 0x7f630c066b80 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6311200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6311200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55916/0 (socket says 172.21.15.60:55916) 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.386+0000 7f6311200700 1 -- 172.21.15.60:0/3325660431 learned_addr learned my addr 172.21.15.60:0/3325660431 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311200700 1 -- 172.21.15.60:0/3325660431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 msgr2=0x7f630c0fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311c00700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 0x7f630c0fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311200700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 0x7f630c0fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311200700 1 -- 172.21.15.60:0/3325660431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300005040 con 0x7f630c102320 2024-04-12T13:48:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311c00700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 0x7f630c0fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.387+0000 7f6311200700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c8c0 tx=0x7f62f80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.388+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f800a980 con 0x7f630c102320 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.388+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62f800ce60 con 0x7f630c102320 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.388+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0ff440 con 0x7f630c102320 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.388+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f80115e0 con 0x7f630c102320 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.388+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c0ffa00 con 0x7f630c102320 2024-04-12T13:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.389+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c05f5f0 con 0x7f630c102320 2024-04-12T13:48:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.390+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f62f8012400 con 0x7f630c102320 2024-04-12T13:48:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.391+0000 7f6309600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 0x7f62f40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.392+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f62f808eaa0 con 0x7f630c102320 2024-04-12T13:48:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.392+0000 7f6311c00700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 0x7f62f40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.393+0000 7f6311c00700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 0x7f62f40710c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f630000b970 tx=0x7f6300009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.397+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f62f80577b0 con 0x7f630c102320 2024-04-12T13:48:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.648+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f630c0ffd40 con 0x7f62f406ec10 2024-04-12T13:48:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.649+0000 7f6309600700 1 -- 172.21.15.60:0/3325660431 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f630c0ffd40 con 0x7f62f406ec10 2024-04-12T13:48:38.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 msgr2=0x7f62f40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 0x7f62f40710c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f630000b970 tx=0x7f6300009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:38.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 msgr2=0x7f630c0fe2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c8c0 tx=0x7f62f80044c0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 shutdown_connections 2024-04-12T13:48:38.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f62f406ec10 0x7f62f40710c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f630c066b80 0x7f630c0fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 --2- 172.21.15.60:0/3325660431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f630c102320 0x7f630c0fe2c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.652+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 >> 172.21.15.60:0/3325660431 conn(0x7f630c0f7450 msgr2=0x7f630c0f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:38.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.653+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 shutdown_connections 2024-04-12T13:48:38.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.653+0000 7f6314600700 1 -- 172.21.15.60:0/3325660431 wait complete. 2024-04-12T13:48:38.672 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:48:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 -- 172.21.15.60:0/1486949215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d0103420 msgr2=0x7fe3d0103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 --2- 172.21.15.60:0/1486949215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d0103420 0x7fe3d0103830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0004940 tx=0x7fe3c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 -- 172.21.15.60:0/1486949215 shutdown_connections 2024-04-12T13:48:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 --2- 172.21.15.60:0/1486949215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d01046d0 0x7fe3d0104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 --2- 172.21.15.60:0/1486949215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d0103420 0x7fe3d0103830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.814+0000 7fe3d6000700 1 -- 172.21.15.60:0/1486949215 >> 172.21.15.60:0/1486949215 conn(0x7fe3d0072640 msgr2=0x7fe3d0074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.815+0000 7fe3d6000700 1 -- 172.21.15.60:0/1486949215 shutdown_connections 2024-04-12T13:48:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.815+0000 7fe3d6000700 1 -- 172.21.15.60:0/1486949215 wait complete. 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 Processor -- start 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 -- start start 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d0103420 0x7fe3d0113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0114b20 con 0x7fe3d01046d0 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3d6000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01194c0 con 0x7fe3d0103420 2024-04-12T13:48:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3cea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3cea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55934/0 (socket says 172.21.15.60:55934) 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.816+0000 7fe3cea00700 1 -- 172.21.15.60:0/903899005 learned_addr learned my addr 172.21.15.60:0/903899005 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.817+0000 7fe3cf400700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d0103420 0x7fe3d0113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.817+0000 7fe3cea00700 1 -- 172.21.15.60:0/903899005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d0103420 msgr2=0x7fe3d0113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.817+0000 7fe3cea00700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d0103420 0x7fe3d0113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:38.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.817+0000 7fe3cea00700 1 -- 172.21.15.60:0/903899005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0005040 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.817+0000 7fe3cea00700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00b790 tx=0x7fe3bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.818+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3bc00f770 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.818+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3bc00fda0 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.818+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3bc00d310 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.818+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0119720 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.818+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d0119c60 con 0x7fe3d01046d0 2024-04-12T13:48:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.819+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d004c710 con 0x7fe3d01046d0 2024-04-12T13:48:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.820+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe3bc010420 con 0x7fe3d01046d0 2024-04-12T13:48:38.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.821+0000 7fe3c7400700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 0x7fe3b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:38.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.821+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fe3bc08e9f0 con 0x7fe3d01046d0 2024-04-12T13:48:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.821+0000 7fe3cf400700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 0x7fe3b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.822+0000 7fe3cf400700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 0x7fe3b40710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000b3b0 tx=0x7fe3c0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:38.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:38.826+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe3bc05b230 con 0x7fe3d01046d0 2024-04-12T13:48:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.084+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d0108970 con 0x7fe3b406ec00 2024-04-12T13:48:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.087+0000 7fe3c7400700 1 -- 172.21.15.60:0/903899005 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe3d0108970 con 0x7fe3b406ec00 2024-04-12T13:48:39.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 msgr2=0x7fe3b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 0x7fe3b40710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000b3b0 tx=0x7fe3c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 msgr2=0x7fe3d0114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00b790 tx=0x7fe3bc009250 comp rx=0 tx=0).stop 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 shutdown_connections 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe3b406ec00 0x7fe3b40710b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3d0103420 0x7fe3d0113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 --2- 172.21.15.60:0/903899005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d01046d0 0x7fe3d0114490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.090+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 >> 172.21.15.60:0/903899005 conn(0x7fe3d0072640 msgr2=0x7fe3d0073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:39.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.091+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 shutdown_connections 2024-04-12T13:48:39.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.091+0000 7fe3d6000700 1 -- 172.21.15.60:0/903899005 wait complete. 2024-04-12T13:48:39.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.251+0000 7f7f11200700 1 -- 172.21.15.60:0/191680422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 msgr2=0x7f7f0c0fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.251+0000 7f7f11200700 1 --2- 172.21.15.60:0/191680422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c0fe070 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004940 tx=0x7f7ef4009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:39.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 -- 172.21.15.60:0/191680422 shutdown_connections 2024-04-12T13:48:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 --2- 172.21.15.60:0/191680422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c0fe070 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 --2- 172.21.15.60:0/191680422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 0x7f7f0c0fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 -- 172.21.15.60:0/191680422 >> 172.21.15.60:0/191680422 conn(0x7f7f0c0f8540 msgr2=0x7f7f0c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 -- 172.21.15.60:0/191680422 shutdown_connections 2024-04-12T13:48:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.252+0000 7f7f11200700 1 -- 172.21.15.60:0/191680422 wait complete. 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 Processor -- start 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 -- start start 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 0x7f7f0c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c1108a0 con 0x7f7f0c0fd710 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f11200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c110fe0 con 0x7f7f0c0fcdc0 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.253+0000 7f7f03e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52302/0 (socket says 172.21.15.60:52302) 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 -- 172.21.15.60:0/2675256370 learned_addr learned my addr 172.21.15.60:0/2675256370 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f09e00700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 0x7f7f0c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 -- 172.21.15.60:0/2675256370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 msgr2=0x7f7f0c10fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 0x7f7f0c10fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 -- 172.21.15.60:0/2675256370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4005040 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.254+0000 7f7f03e00700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.255+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef400e040 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.255+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ef400bcc0 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.255+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c111260 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.255+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef401c630 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.255+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c111820 con 0x7f7f0c0fd710 2024-04-12T13:48:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.256+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c101a60 con 0x7f7f0c0fd710 2024-04-12T13:48:39.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.257+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7ef4013980 con 0x7f7f0c0fd710 2024-04-12T13:48:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.258+0000 7f7f02000700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 0x7f7ef00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.258+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f7ef408fc60 con 0x7f7f0c0fd710 2024-04-12T13:48:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.258+0000 7f7f09e00700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 0x7f7ef00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.259+0000 7f7f09e00700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 0x7f7ef00710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7efc007fd0 tx=0x7f7efc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.263+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7ef405c520 con 0x7f7f0c0fd710 2024-04-12T13:48:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.512+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f0c111b50 con 0x7f7ef006ec00 2024-04-12T13:48:39.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.529+0000 7f7f02000700 1 -- 172.21.15.60:0/2675256370 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7f0c111b50 con 0x7f7ef006ec00 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (6m) 13s ago 17m 15.0M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (2m) 13s ago 17m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (115s) 110s ago 16m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 13s ago 17m - - 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (10m) 13s ago 10m 14.6M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (10m) 13s ago 10m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (10m) 110s ago 10m 14.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (10m) 110s ago 10m 13.9M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (5m) 13s ago 19m 505M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:48:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (4m) 110s ago 16m 451M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (3m) 13s ago 19m 49.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (3m) 110s ago 16m 32.3M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (6m) 13s ago 17m 7780k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 110s ago 16m 8102k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (84s) 13s ago 15m 103M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (52s) 13s ago 14m 150M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (20s) 13s ago 13m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (13m) 110s ago 13m 286M 2581M 17.2.7-845-g730340d7 036a68d49952 7bd59116f674 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (12m) 110s ago 12m 252M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (12m) 110s ago 12m 227M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:48:39.534 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 13s ago 16m 57.0M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:48:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.532+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 msgr2=0x7f7ef00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.532+0000 7f7f11200700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 0x7f7ef00710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7efc007fd0 tx=0x7f7efc009040 comp rx=0 tx=0).stop 2024-04-12T13:48:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.532+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 msgr2=0x7f7f0c1102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.532+0000 7f7f11200700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4000c00 tx=0x7f7ef4009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 shutdown_connections 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef006ec00 0x7f7ef00710b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0fcdc0 0x7f7f0c10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 --2- 172.21.15.60:0/2675256370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c0fd710 0x7f7f0c1102a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 >> 172.21.15.60:0/2675256370 conn(0x7f7f0c0f8540 msgr2=0x7f7f0c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 shutdown_connections 2024-04-12T13:48:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.533+0000 7f7f11200700 1 -- 172.21.15.60:0/2675256370 wait complete. 2024-04-12T13:48:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 -- 172.21.15.60:0/4037116920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 msgr2=0x7f949c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 --2- 172.21.15.60:0/4037116920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c104b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9484004940 tx=0x7f9484009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 -- 172.21.15.60:0/4037116920 shutdown_connections 2024-04-12T13:48:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 --2- 172.21.15.60:0/4037116920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c104b40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 --2- 172.21.15.60:0/4037116920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.695+0000 7f94a3400700 1 -- 172.21.15.60:0/4037116920 >> 172.21.15.60:0/4037116920 conn(0x7f949c072640 msgr2=0x7f949c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.696+0000 7f94a3400700 1 -- 172.21.15.60:0/4037116920 shutdown_connections 2024-04-12T13:48:39.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.696+0000 7f94a3400700 1 -- 172.21.15.60:0/4037116920 wait complete. 2024-04-12T13:48:39.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 Processor -- start 2024-04-12T13:48:39.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 -- start start 2024-04-12T13:48:39.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c114b20 con 0x7f949c1046d0 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f94a3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1194c0 con 0x7f949c103420 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f9493e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f9493e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52330/0 (socket says 172.21.15.60:52330) 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.697+0000 7f9493e00700 1 -- 172.21.15.60:0/2261727402 learned_addr learned my addr 172.21.15.60:0/2261727402 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f9493e00700 1 -- 172.21.15.60:0/2261727402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 msgr2=0x7f949c113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f94a0a00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f9493e00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f9493e00700 1 -- 172.21.15.60:0/2261727402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484005040 con 0x7f949c1046d0 2024-04-12T13:48:39.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f94a0a00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.698+0000 7f9493e00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f948400b3b0 tx=0x7f9484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.699+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948400e040 con 0x7f949c1046d0 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.699+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9484004290 con 0x7f949c1046d0 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.699+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1196c0 con 0x7f949c1046d0 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.699+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f948401c630 con 0x7f949c1046d0 2024-04-12T13:48:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.699+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c119c30 con 0x7f949c1046d0 2024-04-12T13:48:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.700+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c04c710 con 0x7f949c1046d0 2024-04-12T13:48:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.701+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f948400bbf0 con 0x7f949c1046d0 2024-04-12T13:48:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.702+0000 7f9499600700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.702+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f948408fdc0 con 0x7f949c1046d0 2024-04-12T13:48:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.702+0000 7f94a0a00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.703+0000 7f94a0a00700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 0x7f94800710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f948c006fd0 tx=0x7f948c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:39.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:39.707+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f9484093030 con 0x7f949c1046d0 2024-04-12T13:48:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:39 smithi060 ceph-mon[94333]: pgmap v145: 65 pgs: 1 peering, 64 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 280 objects/s recovering 2024-04-12T13:48:39.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:39 smithi060 ceph-mon[94333]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:39 smithi110 ceph-mon[82130]: pgmap v145: 65 pgs: 1 peering, 64 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 280 objects/s recovering 2024-04-12T13:48:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:39 smithi110 ceph-mon[82130]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:40.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.032+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f949c10bf90 con 0x7f949c1046d0 2024-04-12T13:48:40.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.033+0000 7f9499600700 1 -- 172.21.15.60:0/2261727402 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f948405c600 con 0x7f949c1046d0 2024-04-12T13:48:40.035 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:48:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:48:40.035 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 3, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 3 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 7, 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 7 2024-04-12T13:48:40.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:48:40.037 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:48:40.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 msgr2=0x7f94800710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 0x7f94800710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f948c006fd0 tx=0x7f948c008040 comp rx=0 tx=0).stop 2024-04-12T13:48:40.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 msgr2=0x7f949c114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f948400b3b0 tx=0x7f9484009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 shutdown_connections 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f948006ec00 0x7f94800710b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949c103420 0x7f949c113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 --2- 172.21.15.60:0/2261727402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f949c1046d0 0x7f949c114490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.036+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 >> 172.21.15.60:0/2261727402 conn(0x7f949c072640 msgr2=0x7f949c073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.037+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 shutdown_connections 2024-04-12T13:48:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.037+0000 7f94a3400700 1 -- 172.21.15.60:0/2261727402 wait complete. 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 -- 172.21.15.60:0/4137018302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c100090 msgr2=0x7ff78c100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 --2- 172.21.15.60:0/4137018302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c100090 0x7ff78c100500 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff778004940 tx=0x7ff778009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 -- 172.21.15.60:0/4137018302 shutdown_connections 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 --2- 172.21.15.60:0/4137018302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c100090 0x7ff78c100500 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 --2- 172.21.15.60:0/4137018302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c0fee90 0x7ff78c0ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 -- 172.21.15.60:0/4137018302 >> 172.21.15.60:0/4137018302 conn(0x7ff78c0fa790 msgr2=0x7ff78c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 -- 172.21.15.60:0/4137018302 shutdown_connections 2024-04-12T13:48:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.196+0000 7ff791800700 1 -- 172.21.15.60:0/4137018302 wait complete. 2024-04-12T13:48:40.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.197+0000 7ff791800700 1 Processor -- start 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.197+0000 7ff791800700 1 -- start start 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff791800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff791800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c100090 0x7ff78c10ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff791800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c110580 con 0x7ff78c0fee90 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff791800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c110dd0 con 0x7ff78c100090 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52346/0 (socket says 172.21.15.60:52346) 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 -- 172.21.15.60:0/3597849961 learned_addr learned my addr 172.21.15.60:0/3597849961 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78b400700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c100090 0x7ff78c10ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 -- 172.21.15.60:0/3597849961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c100090 msgr2=0x7ff78c10ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c100090 0x7ff78c10ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.198+0000 7ff78be00700 1 -- 172.21.15.60:0/3597849961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778005040 con 0x7ff78c0fee90 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff78be00700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c8e0 tx=0x7ff77c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c00a940 con 0x7ff78c0fee90 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff77c00ce80 con 0x7ff78c0fee90 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c0113a0 con 0x7ff78c0fee90 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c1110b0 con 0x7ff78c0fee90 2024-04-12T13:48:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.199+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c1115f0 con 0x7ff78c0fee90 2024-04-12T13:48:40.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.200+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c0fe290 con 0x7ff78c0fee90 2024-04-12T13:48:40.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.201+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff77c012400 con 0x7ff78c0fee90 2024-04-12T13:48:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.202+0000 7ff783e00700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 0x7ff7700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.202+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7ff77c08e980 con 0x7ff78c0fee90 2024-04-12T13:48:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.203+0000 7ff78b400700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 0x7ff7700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.203+0000 7ff78b400700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 0x7ff7700710b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff77800b970 tx=0x7ff778009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.207+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff77c05b240 con 0x7ff78c0fee90 2024-04-12T13:48:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.492+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff78c04bed0 con 0x7ff78c0fee90 2024-04-12T13:48:40.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.494+0000 7ff783e00700 1 -- 172.21.15.60:0/3597849961 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7ff77c05add0 con 0x7ff78c0fee90 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:48:40.497 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:48:40.498 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:40.499 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 msgr2=0x7ff7700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 0x7ff7700710b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff77800b970 tx=0x7ff778009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 msgr2=0x7ff78c10fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c8e0 tx=0x7ff77c0044c0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 shutdown_connections 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff77006ec00 0x7ff7700710b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff78c0fee90 0x7ff78c10fa40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 --2- 172.21.15.60:0/3597849961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff78c100090 0x7ff78c10ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.498+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 >> 172.21.15.60:0/3597849961 conn(0x7ff78c0fa790 msgr2=0x7ff78c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.499+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 shutdown_connections 2024-04-12T13:48:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.499+0000 7ff791800700 1 -- 172.21.15.60:0/3597849961 wait complete. 2024-04-12T13:48:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:48:40.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 -- 172.21.15.60:0/3649705577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 msgr2=0x7f6168100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 --2- 172.21.15.60:0/3649705577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168100740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6154004940 tx=0x7f6154009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 -- 172.21.15.60:0/3649705577 shutdown_connections 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 --2- 172.21.15.60:0/3649705577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168100740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 --2- 172.21.15.60:0/3649705577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f61680ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 -- 172.21.15.60:0/3649705577 >> 172.21.15.60:0/3649705577 conn(0x7f61680fa950 msgr2=0x7f61680fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 -- 172.21.15.60:0/3649705577 shutdown_connections 2024-04-12T13:48:40.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.661+0000 7f616e600700 1 -- 172.21.15.60:0/3649705577 wait complete. 2024-04-12T13:48:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 Processor -- start 2024-04-12T13:48:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 -- start start 2024-04-12T13:48:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f616810fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168110720 con 0x7f61681002d0 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f616e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61681150c0 con 0x7f61680ff020 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.662+0000 7f6166a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52354/0 (socket says 172.21.15.60:52354) 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 -- 172.21.15.60:0/2489532028 learned_addr learned my addr 172.21.15.60:0/2489532028 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6167400700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f616810fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 -- 172.21.15.60:0/2489532028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 msgr2=0x7f616810fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f616810fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 -- 172.21.15.60:0/2489532028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154005040 con 0x7f61681002d0 2024-04-12T13:48:40.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6167400700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f616810fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.663+0000 7f6166a00700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f615400b3b0 tx=0x7f6154009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.664+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615400e040 con 0x7f61681002d0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.664+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6154004290 con 0x7f61681002d0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.664+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61681152c0 con 0x7f61681002d0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.664+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615401c630 con 0x7f61681002d0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.664+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6168115830 con 0x7f61681002d0 2024-04-12T13:48:40.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.665+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616804c710 con 0x7f61681002d0 2024-04-12T13:48:40.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.666+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f615400bbf0 con 0x7f61681002d0 2024-04-12T13:48:40.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.667+0000 7f615f400700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 0x7f614c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:40.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.667+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f615408fde0 con 0x7f61681002d0 2024-04-12T13:48:40.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.667+0000 7f6167400700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 0x7f614c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:40.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.668+0000 7f6167400700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 0x7f614c0710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6158006fd0 tx=0x7f6158008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:40.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.672+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f615405c620 con 0x7f61681002d0 2024-04-12T13:48:40.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:40 smithi060 ceph-mon[94333]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:40.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:40 smithi060 ceph-mon[94333]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:40.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:40 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2261727402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:40.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:40 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3597849961' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:48:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.929+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6168104570 con 0x7f614c06ec00 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.931+0000 7f615f400700 1 -- 172.21.15.60:0/2489532028 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6168104570 con 0x7f614c06ec00 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "9/21 daemons upgraded", 2024-04-12T13:48:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:48:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:48:40.935 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:48:40.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 msgr2=0x7f614c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 0x7f614c0710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6158006fd0 tx=0x7f6158008040 comp rx=0 tx=0).stop 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 msgr2=0x7f6168110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f615400b3b0 tx=0x7f6154009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 shutdown_connections 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614c06ec00 0x7f614c0710b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61680ff020 0x7f616810fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 --2- 172.21.15.60:0/2489532028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61681002d0 0x7f6168110090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:40.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.934+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 >> 172.21.15.60:0/2489532028 conn(0x7f61680fa950 msgr2=0x7f61680fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:40.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.935+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 shutdown_connections 2024-04-12T13:48:40.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:40.935+0000 7f616e600700 1 -- 172.21.15.60:0/2489532028 wait complete. 2024-04-12T13:48:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:40 smithi110 ceph-mon[82130]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:40 smithi110 ceph-mon[82130]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:40 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2261727402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:48:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:40 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3597849961' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:48:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 -- 172.21.15.60:0/3731715750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c1046d0 msgr2=0x7f318c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 --2- 172.21.15.60:0/3731715750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c1046d0 0x7f318c104b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3178004940 tx=0x7f3178009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 -- 172.21.15.60:0/3731715750 shutdown_connections 2024-04-12T13:48:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 --2- 172.21.15.60:0/3731715750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c1046d0 0x7f318c104b40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 --2- 172.21.15.60:0/3731715750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c103420 0x7f318c103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.089+0000 7f3192600700 1 -- 172.21.15.60:0/3731715750 >> 172.21.15.60:0/3731715750 conn(0x7f318c072640 msgr2=0x7f318c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:41.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.090+0000 7f3192600700 1 -- 172.21.15.60:0/3731715750 shutdown_connections 2024-04-12T13:48:41.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.090+0000 7f3192600700 1 -- 172.21.15.60:0/3731715750 wait complete. 2024-04-12T13:48:41.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 Processor -- start 2024-04-12T13:48:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 -- start start 2024-04-12T13:48:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c1046d0 0x7f318c114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c114a90 con 0x7f318c103420 2024-04-12T13:48:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.091+0000 7f3192600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c114c00 con 0x7f318c1046d0 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52370/0 (socket says 172.21.15.60:52370) 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 -- 172.21.15.60:0/660075330 learned_addr learned my addr 172.21.15.60:0/660075330 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318aa00700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c1046d0 0x7f318c114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 -- 172.21.15.60:0/660075330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c1046d0 msgr2=0x7f318c114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c1046d0 0x7f318c114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.092+0000 7f318b400700 1 -- 172.21.15.60:0/660075330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178005040 con 0x7f318c103420 2024-04-12T13:48:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f318b400700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f317c002a50 tx=0x7f317c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c007cc0 con 0x7f318c103420 2024-04-12T13:48:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f317c00f040 con 0x7f318c103420 2024-04-12T13:48:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c009640 con 0x7f318c103420 2024-04-12T13:48:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c119660 con 0x7f318c103420 2024-04-12T13:48:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.093+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c119c20 con 0x7f318c103420 2024-04-12T13:48:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.094+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c04c710 con 0x7f318c103420 2024-04-12T13:48:41.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.096+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f317c0097c0 con 0x7f318c103420 2024-04-12T13:48:41.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.096+0000 7f3183400700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 0x7f31700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:48:41.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.097+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f317c08e670 con 0x7f318c103420 2024-04-12T13:48:41.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.097+0000 7f318aa00700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 0x7f31700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:48:41.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.098+0000 7f318aa00700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 0x7f31700710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f317800b3b0 tx=0x7f3178009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:48:41.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.101+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f317c05aeb0 con 0x7f318c103420 2024-04-12T13:48:41.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.414+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f318c10bf10 con 0x7f318c103420 2024-04-12T13:48:41.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.415+0000 7f3183400700 1 -- 172.21.15.60:0/660075330 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f317c05aa40 con 0x7f318c103420 2024-04-12T13:48:41.418 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:48:41.419 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:48:41.419 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:48:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 msgr2=0x7f31700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 0x7f31700710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f317800b3b0 tx=0x7f3178009e30 comp rx=0 tx=0).stop 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 msgr2=0x7f318c113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f317c002a50 tx=0x7f317c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 shutdown_connections 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f317006ec00 0x7f31700710b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f318c103420 0x7f318c113f50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 --2- 172.21.15.60:0/660075330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c1046d0 0x7f318c114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 >> 172.21.15.60:0/660075330 conn(0x7f318c072640 msgr2=0x7f318c073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:48:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.418+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 shutdown_connections 2024-04-12T13:48:41.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:48:41.419+0000 7f3192600700 1 -- 172.21.15.60:0/660075330 wait complete. 2024-04-12T13:48:41.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:41 smithi060 ceph-mon[94333]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 91 objects/s recovering 2024-04-12T13:48:41.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:41 smithi060 ceph-mon[94333]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:41.963 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:41 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/660075330' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:48:41.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:41 smithi110 ceph-mon[82130]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 91 objects/s recovering 2024-04-12T13:48:41.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:41 smithi110 ceph-mon[82130]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:48:41.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:41 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/660075330' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:48:43.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:43 smithi110 ceph-mon[82130]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 70 objects/s recovering 2024-04-12T13:48:43.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:43.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:43 smithi060 ceph-mon[94333]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 70 objects/s recovering 2024-04-12T13:48:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:45.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:45 smithi110 ceph-mon[82130]: pgmap v148: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 56 objects/s recovering 2024-04-12T13:48:46.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:45 smithi060 ceph-mon[94333]: pgmap v148: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 56 objects/s recovering 2024-04-12T13:48:47.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:47 smithi110 ceph-mon[82130]: pgmap v149: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:48.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:47 smithi060 ceph-mon[94333]: pgmap v149: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:49.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:49.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:49 smithi060 ceph-mon[94333]: pgmap v150: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:49 smithi110 ceph-mon[82130]: pgmap v150: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:50.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:50.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:50 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:50.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:50 smithi060 ceph-mon[94333]: Upgrade: osd.3 is safe to restart 2024-04-12T13:48:50.685 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:50.685 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:50 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T13:48:50.685 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:50 smithi110 ceph-mon[82130]: Upgrade: osd.3 is safe to restart 2024-04-12T13:48:51.584 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:51 smithi060 ceph-mon[94333]: pgmap v151: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:51.634 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:51 smithi110 ceph-mon[82130]: pgmap v151: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: Upgrade: Updating osd.3 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: Deploying daemon osd.3 on smithi110 2024-04-12T13:48:53.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:53 smithi110 ceph-mon[82130]: pgmap v152: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: Upgrade: Updating osd.3 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: Deploying daemon osd.3 on smithi110 2024-04-12T13:48:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:53 smithi060 ceph-mon[94333]: pgmap v152: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:55.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:55 smithi060 ceph-mon[94333]: pgmap v153: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:55.680 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:55 smithi110 ceph-mon[82130]: pgmap v153: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:57.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:57 smithi110 ceph-mon[82130]: pgmap v154: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:57.710 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:57 smithi110 systemd[1]: Stopping Ceph osd.3 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:48:57.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:57 smithi060 ceph-mon[94333]: pgmap v154: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:57.978 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:57 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[41509]: 2024-04-12T13:48:57.706+0000 7f38ca800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:48:57.979 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:57 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[41509]: 2024-04-12T13:48:57.706+0000 7f38ca800700 -1 osd.3 81 *** Got signal Terminated *** 2024-04-12T13:48:57.979 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:57 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[41509]: 2024-04-12T13:48:57.706+0000 7f38ca800700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:48:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:58 smithi110 ceph-mon[82130]: osd.3 marked itself down and dead 2024-04-12T13:48:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:58.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:58 smithi060 ceph-mon[94333]: osd.3 marked itself down and dead 2024-04-12T13:48:58.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:48:59.451 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:59 smithi110 podman[91208]: 2024-04-12 13:48:59.134449888 +0000 UTC m=+1.558162817 container died 7bd59116f6749c0856290e4adb427eab6b2c793d8164521d37358a6256528b96 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, RELEASE=wip-64502-quincy-2-730340d, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:48:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:59 smithi110 ceph-mon[82130]: pgmap v155: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:59.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:59 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:48:59.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:48:59 smithi110 ceph-mon[82130]: osdmap e82: 6 total, 5 up, 6 in 2024-04-12T13:48:59.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:59 smithi110 podman[91208]: 2024-04-12 13:48:59.649406918 +0000 UTC m=+2.073119844 container cleanup 7bd59116f6749c0856290e4adb427eab6b2c793d8164521d37358a6256528b96 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-64502-quincy-2-730340d, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-12T13:48:59.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:59 smithi110 bash[91208]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3 2024-04-12T13:48:59.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:59 smithi060 ceph-mon[94333]: pgmap v155: 65 pgs: 65 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:48:59.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:59 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:48:59.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:48:59 smithi060 ceph-mon[94333]: osdmap e82: 6 total, 5 up, 6 in 2024-04-12T13:49:00.228 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:48:59 smithi110 podman[91228]: 2024-04-12 13:48:59.891958737 +0000 UTC m=+0.743243288 container remove 7bd59116f6749c0856290e4adb427eab6b2c793d8164521d37358a6256528b96 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-64502-quincy-2-730340d, ceph=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2) 2024-04-12T13:49:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:00 smithi110 ceph-mon[82130]: osdmap e83: 6 total, 5 up, 6 in 2024-04-12T13:49:00.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:00 smithi060 ceph-mon[94333]: osdmap e83: 6 total, 5 up, 6 in 2024-04-12T13:49:01.011 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:00 smithi110 podman[91311]: 2024-04-12 13:49:00.65932921 +0000 UTC m=+0.034028047 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:01.011 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:00 smithi110 podman[91311]: 2024-04-12 13:49:00.826461991 +0000 UTC m=+0.201160865 container create f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-12T13:49:01.477 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:01 smithi110 podman[91311]: 2024-04-12 13:49:01.179806706 +0000 UTC m=+0.554505606 container init f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS) 2024-04-12T13:49:01.477 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:01 smithi110 podman[91311]: 2024-04-12 13:49:01.194075877 +0000 UTC m=+0.568774776 container start f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:01.477 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:01 smithi110 podman[91311]: 2024-04-12 13:49:01.295321231 +0000 UTC m=+0.670020165 container attach f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-12T13:49:01.728 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:01 smithi110 podman[91337]: 2024-04-12 13:49:01.705639888 +0000 UTC m=+0.034038739 container died f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-12T13:49:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:01 smithi110 ceph-mon[82130]: pgmap v158: 65 pgs: 24 peering, 4 stale+active+clean, 37 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:01.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:01 smithi110 ceph-mon[82130]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-04-12T13:49:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:01 smithi060 ceph-mon[94333]: pgmap v158: 65 pgs: 24 peering, 4 stale+active+clean, 37 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:01 smithi060 ceph-mon[94333]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-04-12T13:49:02.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:02 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 5 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:02.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:02 smithi110 podman[91337]: 2024-04-12 13:49:02.423533468 +0000 UTC m=+0.751932358 container remove f3172db325cedae74c7789f18a1047cec08dab8685706b274b99be0f20d07388 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-04-12T13:49:02.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:02 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-12T13:49:02.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:02 smithi110 systemd[1]: Stopped Ceph osd.3 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:49:02.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:02 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.3.service: Consumed 2min 30.152s CPU time. 2024-04-12T13:49:02.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:02 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 5 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:03.210 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:02 smithi110 systemd[1]: Starting Ceph osd.3 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:49:03.479 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:03 smithi110 podman[91441]: 2024-04-12 13:49:03.112876191 +0000 UTC m=+0.031571276 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:03.479 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:03 smithi110 podman[91441]: 2024-04-12 13:49:03.216577433 +0000 UTC m=+0.135272555 container create 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-a971fd5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:03 smithi060 ceph-mon[94333]: pgmap v159: 65 pgs: 5 active+undersized, 5 active+undersized+degraded, 24 peering, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2024-04-12T13:49:03.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:03 smithi110 ceph-mon[82130]: pgmap v159: 65 pgs: 5 active+undersized, 5 active+undersized+degraded, 24 peering, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2024-04-12T13:49:03.978 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:03 smithi110 podman[91441]: 2024-04-12 13:49:03.511844855 +0000 UTC m=+0.430539997 container init 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:49:03.979 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:03 smithi110 podman[91441]: 2024-04-12 13:49:03.526129621 +0000 UTC m=+0.444824734 container start 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, ceph=True, org.label-schema.license=GPLv2) 2024-04-12T13:49:03.979 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:03 smithi110 podman[91441]: 2024-04-12 13:49:03.660589233 +0000 UTC m=+0.579284399 container attach 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:49:04.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T13:49:04.729 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 bash[91441]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate[91456]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-12T13:49:04.730 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:04 smithi110 podman[91441]: 2024-04-12 13:49:04.440534122 +0000 UTC m=+1.359229284 container died 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-12T13:49:05.478 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 podman[91591]: 2024-04-12 13:49:05.214008713 +0000 UTC m=+0.753623907 container remove 53b8f3f199cf8f6c3108cb3378162fa88cf5adf9bfc36a190066704893c1c051 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-activate, RELEASE=main-a971fd5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-12T13:49:05.920 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:05 smithi110 ceph-mon[82130]: pgmap v160: 65 pgs: 14 active+undersized, 11 active+undersized+degraded, 9 peering, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-04-12T13:49:05.920 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 podman[91651]: 2024-04-12 13:49:05.480180637 +0000 UTC m=+0.034766991 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:05.920 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 podman[91651]: 2024-04-12 13:49:05.606716535 +0000 UTC m=+0.161302925 container create eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-a971fd5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:49:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:05 smithi060 ceph-mon[94333]: pgmap v160: 65 pgs: 14 active+undersized, 11 active+undersized+degraded, 9 peering, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-04-12T13:49:06.228 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 podman[91651]: 2024-04-12 13:49:05.918587778 +0000 UTC m=+0.473174188 container init eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:06.229 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 podman[91651]: 2024-04-12 13:49:05.92982026 +0000 UTC m=+0.484406623 container start eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, RELEASE=main-a971fd5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS) 2024-04-12T13:49:06.229 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:05 smithi110 ceph-osd[91669]: -- 172.21.15.110:0/2355101358 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bbaadbd680 con 0x55bbaad86c00 2024-04-12T13:49:06.229 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:06 smithi110 bash[91651]: eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 2024-04-12T13:49:06.229 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:06 smithi110 systemd[1]: Started Ceph osd.3 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:49:06.978 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:06 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T13:49:06.504+0000 7efc77e477c0 -1 Falling back to public interface 2024-04-12T13:49:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:07 smithi060 ceph-mon[94333]: pgmap v161: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:07.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:07 smithi110 ceph-mon[82130]: pgmap v161: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:08.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:08 smithi060 ceph-mon[94333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T13:49:08.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:08 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 46/222 objects degraded (20.721%), 16 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:08.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:08 smithi110 ceph-mon[82130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T13:49:08.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:08 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 46/222 objects degraded (20.721%), 16 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:09 smithi060 ceph-mon[94333]: pgmap v162: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:09.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:09 smithi110 ceph-mon[82130]: pgmap v162: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:11.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 -- 172.21.15.60:0/1364577416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 msgr2=0x7f1ad80703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:11.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 --2- 172.21.15.60:0/1364577416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad80703b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8004940 tx=0x7f1ac8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 -- 172.21.15.60:0/1364577416 shutdown_connections 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 --2- 172.21.15.60:0/1364577416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 --2- 172.21.15.60:0/1364577416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad80703b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 -- 172.21.15.60:0/1364577416 >> 172.21.15.60:0/1364577416 conn(0x7f1ad80f8530 msgr2=0x7f1ad80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 -- 172.21.15.60:0/1364577416 shutdown_connections 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.592+0000 7f1adf200700 1 -- 172.21.15.60:0/1364577416 wait complete. 2024-04-12T13:49:11.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.593+0000 7f1adf200700 1 Processor -- start 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.593+0000 7f1adf200700 1 -- start start 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1adf200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1adf200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad8110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1adf200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8110730 con 0x7f1ad8071ea0 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1adf200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8110f80 con 0x7f1ad80708f0 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1ad7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.594+0000 7f1ad7400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad8110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:11.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.595+0000 7f1ad7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:37694/0 (socket says 172.21.15.60:37694) 2024-04-12T13:49:11.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.595+0000 7f1ad7e00700 1 -- 172.21.15.60:0/641494775 learned_addr learned my addr 172.21.15.60:0/641494775 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:11.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.595+0000 7f1ad7e00700 1 -- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 msgr2=0x7f1ad8110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:11.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.595+0000 7f1ad7e00700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad8110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.595+0000 7f1ad7e00700 1 -- 172.21.15.60:0/641494775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8005040 con 0x7f1ad80708f0 2024-04-12T13:49:11.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.596+0000 7f1ad7e00700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80040d0 tx=0x7f1ac8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.596+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac800e070 con 0x7f1ad80708f0 2024-04-12T13:49:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.596+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8111200 con 0x7f1ad80708f0 2024-04-12T13:49:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.596+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad81116e0 con 0x7f1ad80708f0 2024-04-12T13:49:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.597+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ac8026460 con 0x7f1ad80708f0 2024-04-12T13:49:11.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.597+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac801c620 con 0x7f1ad80708f0 2024-04-12T13:49:11.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.598+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab80052e0 con 0x7f1ad80708f0 2024-04-12T13:49:11.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.600+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1ac8013af0 con 0x7f1ad80708f0 2024-04-12T13:49:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.601+0000 7f1acfe00700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 0x7f1abc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.601+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f1ac8090a10 con 0x7f1ad80708f0 2024-04-12T13:49:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.602+0000 7f1ad7400700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 0x7f1abc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:11.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.603+0000 7f1ad7400700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 0x7f1abc0710c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009b80 tx=0x7f1ac400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.618+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1ac805d2b0 con 0x7f1ad80708f0 2024-04-12T13:49:11.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:11 smithi110 ceph-mon[82130]: pgmap v163: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:11.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:11.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.875+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ab8000bf0 con 0x7f1abc06ec10 2024-04-12T13:49:11.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:11 smithi060 ceph-mon[94333]: pgmap v163: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:11.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:11.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.878+0000 7f1acfe00700 1 -- 172.21.15.60:0/641494775 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1ab8000bf0 con 0x7f1abc06ec10 2024-04-12T13:49:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 msgr2=0x7f1abc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 0x7f1abc0710c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009b80 tx=0x7f1ac400b040 comp rx=0 tx=0).stop 2024-04-12T13:49:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 msgr2=0x7f1ad810fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80040d0 tx=0x7f1ac8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 shutdown_connections 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1abc06ec10 0x7f1abc0710c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ad80708f0 0x7f1ad810fbf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 --2- 172.21.15.60:0/641494775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ad8071ea0 0x7f1ad8110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 >> 172.21.15.60:0/641494775 conn(0x7f1ad80f8530 msgr2=0x7f1ad80f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 shutdown_connections 2024-04-12T13:49:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:11.882+0000 7f1adf200700 1 -- 172.21.15.60:0/641494775 wait complete. 2024-04-12T13:49:11.902 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:49:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 -- 172.21.15.60:0/3317503599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0900708f0 msgr2=0x7fe090070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 --2- 172.21.15.60:0/3317503599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0900708f0 0x7fe090070d60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004940 tx=0x7fe07c009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 -- 172.21.15.60:0/3317503599 shutdown_connections 2024-04-12T13:49:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 --2- 172.21.15.60:0/3317503599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0900708f0 0x7fe090070d60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 --2- 172.21.15.60:0/3317503599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe090071ea0 0x7fe0900703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.048+0000 7fe097800700 1 -- 172.21.15.60:0/3317503599 >> 172.21.15.60:0/3317503599 conn(0x7fe0900f8530 msgr2=0x7fe0900fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.049+0000 7fe097800700 1 -- 172.21.15.60:0/3317503599 shutdown_connections 2024-04-12T13:49:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.049+0000 7fe097800700 1 -- 172.21.15.60:0/3317503599 wait complete. 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 Processor -- start 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 -- start start 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0900708f0 0x7fe09010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090110760 con 0x7fe090071ea0 2024-04-12T13:49:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.050+0000 7fe097800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090110fb0 con 0x7fe0900708f0 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39048/0 (socket says 172.21.15.60:39048) 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 -- 172.21.15.60:0/3304464831 learned_addr learned my addr 172.21.15.60:0/3304464831 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe094e00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0900708f0 0x7fe09010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 -- 172.21.15.60:0/3304464831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0900708f0 msgr2=0x7fe09010fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0900708f0 0x7fe09010fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.051+0000 7fe08fe00700 1 -- 172.21.15.60:0/3304464831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c005040 con 0x7fe090071ea0 2024-04-12T13:49:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe08fe00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b970 tx=0x7fe07c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c00e040 con 0x7fe090071ea0 2024-04-12T13:49:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe07c004290 con 0x7fe090071ea0 2024-04-12T13:49:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe090111230 con 0x7fe090071ea0 2024-04-12T13:49:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c01c630 con 0x7fe090071ea0 2024-04-12T13:49:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.052+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe090111770 con 0x7fe090071ea0 2024-04-12T13:49:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.053+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09005f5f0 con 0x7fe090071ea0 2024-04-12T13:49:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.055+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe07c00bbf0 con 0x7fe090071ea0 2024-04-12T13:49:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.056+0000 7fe08cc00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 0x7fe0780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.056+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fe07c08fb60 con 0x7fe090071ea0 2024-04-12T13:49:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.056+0000 7fe094e00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 0x7fe0780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.057+0000 7fe094e00700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 0x7fe0780710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe090071be0 tx=0x7fe08400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.062+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe07c05c420 con 0x7fe090071ea0 2024-04-12T13:49:12.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.312+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe090111b60 con 0x7fe07806ec10 2024-04-12T13:49:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.315+0000 7fe08cc00700 1 -- 172.21.15.60:0/3304464831 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe090111b60 con 0x7fe07806ec10 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 msgr2=0x7fe0780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 0x7fe0780710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe090071be0 tx=0x7fe08400b040 comp rx=0 tx=0).stop 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 msgr2=0x7fe090110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b970 tx=0x7fe07c009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 shutdown_connections 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe07806ec10 0x7fe0780710c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0900708f0 0x7fe09010fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 --2- 172.21.15.60:0/3304464831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe090071ea0 0x7fe090110160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 >> 172.21.15.60:0/3304464831 conn(0x7fe0900f8530 msgr2=0x7fe0900f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 shutdown_connections 2024-04-12T13:49:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.318+0000 7fe097800700 1 -- 172.21.15.60:0/3304464831 wait complete. 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.475+0000 7f55a0c00700 1 -- 172.21.15.60:0/1391322462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fbcf0 msgr2=0x7f559c0fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1391322462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fbcf0 0x7f559c0fc100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f558c004940 tx=0x7f558c009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 -- 172.21.15.60:0/1391322462 shutdown_connections 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1391322462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fcfa0 0x7f559c0fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1391322462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fbcf0 0x7f559c0fc100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 -- 172.21.15.60:0/1391322462 >> 172.21.15.60:0/1391322462 conn(0x7f559c0f7450 msgr2=0x7f559c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 -- 172.21.15.60:0/1391322462 shutdown_connections 2024-04-12T13:49:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.476+0000 7f55a0c00700 1 -- 172.21.15.60:0/1391322462 wait complete. 2024-04-12T13:49:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 Processor -- start 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 -- start start 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fbcf0 0x7f559c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c10e510 con 0x7f559c0fcfa0 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.477+0000 7f55a0c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c10ed60 con 0x7f559c0fbcf0 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39068/0 (socket says 172.21.15.60:39068) 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 -- 172.21.15.60:0/1905805025 learned_addr learned my addr 172.21.15.60:0/1905805025 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599e00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fbcf0 0x7f559c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 -- 172.21.15.60:0/1905805025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fbcf0 msgr2=0x7f559c10d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fbcf0 0x7f559c10d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.478+0000 7f5599400700 1 -- 172.21.15.60:0/1905805025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c005040 con 0x7f559c0fcfa0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f5599400700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f558800eb40 tx=0x7f558800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5588007cc0 con 0x7f559c0fcfa0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f558800f040 con 0x7f559c0fcfa0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c10efe0 con 0x7f559c0fcfa0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f558800ca10 con 0x7f559c0fcfa0 2024-04-12T13:49:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.479+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c10f520 con 0x7f559c0fcfa0 2024-04-12T13:49:12.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.480+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c101b30 con 0x7f559c0fcfa0 2024-04-12T13:49:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.481+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f558800cb70 con 0x7f559c0fcfa0 2024-04-12T13:49:12.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.483+0000 7f5592000700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 0x7f55800710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.483+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f558808e3f0 con 0x7f559c0fcfa0 2024-04-12T13:49:12.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.483+0000 7f5599e00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 0x7f55800710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.484+0000 7f5599e00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 0x7f55800710c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f558c009fd0 tx=0x7f558c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.488+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f558805ad80 con 0x7f559c0fcfa0 2024-04-12T13:49:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:12 smithi060 ceph-mon[94333]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:12 smithi060 ceph-mon[94333]: from='osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:49:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:12 smithi060 ceph-mon[94333]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:49:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:12.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:12.728 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T13:49:12.386+0000 7efc77e477c0 -1 osd.3 81 log_to_monitors true 2024-04-12T13:49:12.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-mon[82130]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:12.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-mon[82130]: from='osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:49:12.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-mon[82130]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T13:49:12.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:12.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.739+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f559c10f790 con 0x7f558006ec10 2024-04-12T13:49:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.756+0000 7f5592000700 1 -- 172.21.15.60:0/1905805025 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f559c10f790 con 0x7f558006ec10 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 46s ago 18m 15.0M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (2m) 46s ago 18m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (2m) 2s ago 16m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 46s ago 17m - - 2024-04-12T13:49:12.759 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (10m) 46s ago 10m 14.6M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (10m) 46s ago 10m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (10m) 2s ago 10m 14.6M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (10m) 2s ago 10m 14.4M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (5m) 46s ago 19m 505M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (4m) 2s ago 16m 452M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (4m) 46s ago 20m 49.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (3m) 2s ago 16m 36.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 46s ago 18m 7780k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (6m) 2s ago 16m 8028k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (118s) 46s ago 15m 103M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (86s) 46s ago 15m 150M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (54s) 46s ago 14m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:49:12.760 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (7s) 2s ago 13m 11.2M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:49:12.761 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (13m) 2s ago 13m 283M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:49:12.761 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (12m) 2s ago 12m 295M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:49:12.761 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 46s ago 17m 57.0M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:49:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 msgr2=0x7f55800710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 0x7f55800710c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f558c009fd0 tx=0x7f558c009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 msgr2=0x7f559c10df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f558800eb40 tx=0x7f558800b040 comp rx=0 tx=0).stop 2024-04-12T13:49:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 shutdown_connections 2024-04-12T13:49:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f558006ec10 0x7f55800710c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0fbcf0 0x7f559c10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 --2- 172.21.15.60:0/1905805025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f559c0fcfa0 0x7f559c10df10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.759+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 >> 172.21.15.60:0/1905805025 conn(0x7f559c0f7450 msgr2=0x7f559c0663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.760+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 shutdown_connections 2024-04-12T13:49:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.760+0000 7f55a0c00700 1 -- 172.21.15.60:0/1905805025 wait complete. 2024-04-12T13:49:12.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.911+0000 7f7f13a00700 1 -- 172.21.15.60:0/2387489123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 msgr2=0x7f7f0c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.911+0000 7f7f13a00700 1 --2- 172.21.15.60:0/2387489123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c104b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8004940 tx=0x7f7ef8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 -- 172.21.15.60:0/2387489123 shutdown_connections 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 --2- 172.21.15.60:0/2387489123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c104b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 --2- 172.21.15.60:0/2387489123 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 0x7f7f0c103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 -- 172.21.15.60:0/2387489123 >> 172.21.15.60:0/2387489123 conn(0x7f7f0c072640 msgr2=0x7f7f0c074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 -- 172.21.15.60:0/2387489123 shutdown_connections 2024-04-12T13:49:12.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.912+0000 7f7f13a00700 1 -- 172.21.15.60:0/2387489123 wait complete. 2024-04-12T13:49:12.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 Processor -- start 2024-04-12T13:49:12.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 -- start start 2024-04-12T13:49:12.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 0x7f7f0c113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c114a90 con 0x7f7f0c1046d0 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f13a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c114c00 con 0x7f7f0c103420 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f0be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f11000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 0x7f7f0c113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f0be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39082/0 (socket says 172.21.15.60:39082) 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.913+0000 7f7f0be00700 1 -- 172.21.15.60:0/1620783967 learned_addr learned my addr 172.21.15.60:0/1620783967 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.914+0000 7f7f0be00700 1 -- 172.21.15.60:0/1620783967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 msgr2=0x7f7f0c113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.914+0000 7f7f0be00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 0x7f7f0c113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.914+0000 7f7f0be00700 1 -- 172.21.15.60:0/1620783967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8005040 con 0x7f7f0c1046d0 2024-04-12T13:49:12.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.914+0000 7f7f0be00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800b970 tx=0x7f7ef8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.914+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef800e040 con 0x7f7f0c1046d0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.915+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ef800bbf0 con 0x7f7f0c1046d0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.915+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c119600 con 0x7f7f0c1046d0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.915+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef801c630 con 0x7f7f0c1046d0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.915+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c119bc0 con 0x7f7f0c1046d0 2024-04-12T13:49:12.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.916+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c04c710 con 0x7f7f0c1046d0 2024-04-12T13:49:12.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.917+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7ef800bd60 con 0x7f7f0c1046d0 2024-04-12T13:49:12.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.918+0000 7f7f08c00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 0x7f7ef40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:12.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.918+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f7ef808fbf0 con 0x7f7f0c1046d0 2024-04-12T13:49:12.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.919+0000 7f7f11000700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 0x7f7ef40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:12.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.919+0000 7f7f11000700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 0x7f7ef40710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f00004f40 tx=0x7f7f0000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:12.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:12.924+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7ef805c4b0 con 0x7f7f0c1046d0 2024-04-12T13:49:13.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.244+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f0c10bf10 con 0x7f7f0c1046d0 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.245+0000 7f7f08c00700 1 -- 172.21.15.60:0/1620783967 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f7ef805c040 con 0x7f7f0c1046d0 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:49:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2, 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 3 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 6, 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 7 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:49:13.249 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:49:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 msgr2=0x7f7ef40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 0x7f7ef40710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f00004f40 tx=0x7f7f0000b040 comp rx=0 tx=0).stop 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 msgr2=0x7f7f0c114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800b970 tx=0x7f7ef8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 shutdown_connections 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7ef406ec00 0x7f7ef40710b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c103420 0x7f7f0c113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 --2- 172.21.15.60:0/1620783967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f0c1046d0 0x7f7f0c114490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 >> 172.21.15.60:0/1620783967 conn(0x7f7f0c072640 msgr2=0x7f7f0c073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.249+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 shutdown_connections 2024-04-12T13:49:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.250+0000 7f7f13a00700 1 -- 172.21.15.60:0/1620783967 wait complete. 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.397+0000 7f8092800700 1 -- 172.21.15.60:0/3377866917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c1002b0 msgr2=0x7f808c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.397+0000 7f8092800700 1 --2- 172.21.15.60:0/3377866917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c1002b0 0x7f808c100720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8078004940 tx=0x7f8078009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 -- 172.21.15.60:0/3377866917 shutdown_connections 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 --2- 172.21.15.60:0/3377866917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c1002b0 0x7f808c100720 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 --2- 172.21.15.60:0/3377866917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c0ff000 0x7f808c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 -- 172.21.15.60:0/3377866917 >> 172.21.15.60:0/3377866917 conn(0x7f808c0fa790 msgr2=0x7f808c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 -- 172.21.15.60:0/3377866917 shutdown_connections 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 -- 172.21.15.60:0/3377866917 wait complete. 2024-04-12T13:49:13.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.398+0000 7f8092800700 1 Processor -- start 2024-04-12T13:49:13.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f8092800700 1 -- start start 2024-04-12T13:49:13.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f8092800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f8092800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 0x7f808c110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f8092800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c110670 con 0x7f808c0ff000 2024-04-12T13:49:13.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f8092800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1107e0 con 0x7f808c1002b0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f808b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f808aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 0x7f808c110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f808b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39100/0 (socket says 172.21.15.60:39100) 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.399+0000 7f808b400700 1 -- 172.21.15.60:0/2377019557 learned_addr learned my addr 172.21.15.60:0/2377019557 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f808aa00700 1 -- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 msgr2=0x7f808c10fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f808aa00700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f808aa00700 1 -- 172.21.15.60:0/2377019557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078005040 con 0x7f808c1002b0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f808b400700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f808aa00700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 0x7f808c110070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f807800b970 tx=0x7f8078009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807800e040 con 0x7f808c1002b0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f807800bbf0 con 0x7f808c1002b0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.400+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c1151e0 con 0x7f808c1002b0 2024-04-12T13:49:13.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.401+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807801c3f0 con 0x7f808c1002b0 2024-04-12T13:49:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.401+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1157a0 con 0x7f808c1002b0 2024-04-12T13:49:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.402+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c04c710 con 0x7f808c1002b0 2024-04-12T13:49:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.403+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f807800bd60 con 0x7f808c1002b0 2024-04-12T13:49:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.404+0000 7f8083400700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 0x7f80700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.404+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f807808fbc0 con 0x7f808c1002b0 2024-04-12T13:49:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.404+0000 7f808b400700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 0x7f80700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.405+0000 7f808b400700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 0x7f80700710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f807c0041d0 tx=0x7f807c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.410+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f807805c400 con 0x7f808c1002b0 2024-04-12T13:49:13.660 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T13:49:13.391+0000 7efc62200700 -1 osd.3 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:49:13.660 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:13.660 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: pgmap v164: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: osdmap e84: 6 total, 5 up, 6 in 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1620783967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:13.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:13 smithi110 ceph-mon[82130]: from='osd.3 ' entity='osd.3' 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: pgmap v164: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: osdmap e84: 6 total, 5 up, 6 in 2024-04-12T13:49:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:13.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:13.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:13.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:13.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1620783967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:13.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:13 smithi060 ceph-mon[94333]: from='osd.3 ' entity='osd.3' 2024-04-12T13:49:13.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.688+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f808c107af0 con 0x7f808c1002b0 2024-04-12T13:49:13.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.689+0000 7f8083400700 1 -- 172.21.15.60:0/2377019557 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f807805bf90 con 0x7f808c1002b0 2024-04-12T13:49:13.692 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:49:13.692 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:49:13.692 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:49:13.692 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:49:13.693 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:49:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:13.695 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 msgr2=0x7f80700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 0x7f80700710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f807c0041d0 tx=0x7f807c00b040 comp rx=0 tx=0).stop 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 msgr2=0x7f808c110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 0x7f808c110070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f807800b970 tx=0x7f8078009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 shutdown_connections 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f807006ec00 0x7f80700710b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f808c0ff000 0x7f808c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 --2- 172.21.15.60:0/2377019557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f808c1002b0 0x7f808c110070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 >> 172.21.15.60:0/2377019557 conn(0x7f808c0fa790 msgr2=0x7f808c0fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:13.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 shutdown_connections 2024-04-12T13:49:13.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.693+0000 7f8092800700 1 -- 172.21.15.60:0/2377019557 wait complete. 2024-04-12T13:49:13.697 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 -- 172.21.15.60:0/1727744835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc100090 msgr2=0x7fc6bc100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/1727744835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc100090 0x7fc6bc100500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8004940 tx=0x7fc6a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 -- 172.21.15.60:0/1727744835 shutdown_connections 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/1727744835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc100090 0x7fc6bc100500 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/1727744835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc0ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 -- 172.21.15.60:0/1727744835 >> 172.21.15.60:0/1727744835 conn(0x7fc6bc0fa790 msgr2=0x7fc6bc0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 -- 172.21.15.60:0/1727744835 shutdown_connections 2024-04-12T13:49:13.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.848+0000 7fc6bbe00700 1 -- 172.21.15.60:0/1727744835 wait complete. 2024-04-12T13:49:13.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.849+0000 7fc6bbe00700 1 Processor -- start 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.849+0000 7fc6bbe00700 1 -- start start 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6bbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6bc100090 0x7fc6bc10ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6bbe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc110630 con 0x7fc6bc0fee90 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6bbe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc110e20 con 0x7fc6bc100090 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39124/0 (socket says 172.21.15.60:39124) 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 -- 172.21.15.60:0/975308809 learned_addr learned my addr 172.21.15.60:0/975308809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 -- 172.21.15.60:0/975308809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6bc100090 msgr2=0x7fc6bc10ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6bc100090 0x7fc6bc10ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:13.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.850+0000 7fc6baa00700 1 -- 172.21.15.60:0/975308809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8005040 con 0x7fc6bc0fee90 2024-04-12T13:49:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6baa00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b790 tx=0x7fc6ac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac00f6f0 con 0x7fc6bc0fee90 2024-04-12T13:49:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6ac00fd20 con 0x7fc6bc0fee90 2024-04-12T13:49:13.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6ac0103a0 con 0x7fc6bc0fee90 2024-04-12T13:49:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc111100 con 0x7fc6bc0fee90 2024-04-12T13:49:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.851+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1116c0 con 0x7fc6bc0fee90 2024-04-12T13:49:13.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.852+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0fe290 con 0x7fc6bc0fee90 2024-04-12T13:49:13.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.853+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc6ac011400 con 0x7fc6bc0fee90 2024-04-12T13:49:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.854+0000 7fc6b2a00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 0x7fc6a00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.854+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fc6ac08e840 con 0x7fc6bc0fee90 2024-04-12T13:49:13.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.855+0000 7fc6ba000700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 0x7fc6a00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:13.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.856+0000 7fc6ba000700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 0x7fc6a00710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8004f90 tx=0x7fc6a8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:13.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:13.859+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc6ac05b000 con 0x7fc6bc0fee90 2024-04-12T13:49:14.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.111+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6bc111aa0 con 0x7fc6a006ec00 2024-04-12T13:49:14.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.114+0000 7fc6b2a00700 1 -- 172.21.15.60:0/975308809 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc6bc111aa0 con 0x7fc6a006ec00 2024-04-12T13:49:14.116 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "10/21 daemons upgraded", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:49:14.117 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:49:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 msgr2=0x7fc6a00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 0x7fc6a00710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8004f90 tx=0x7fc6a8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 msgr2=0x7fc6bc10fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b790 tx=0x7fc6ac009220 comp rx=0 tx=0).stop 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 shutdown_connections 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc6a006ec00 0x7fc6a00710b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0fee90 0x7fc6bc10fa60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 --2- 172.21.15.60:0/975308809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6bc100090 0x7fc6bc10ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 >> 172.21.15.60:0/975308809 conn(0x7fc6bc0fa790 msgr2=0x7fc6bc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 shutdown_connections 2024-04-12T13:49:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.117+0000 7fc6bbe00700 1 -- 172.21.15.60:0/975308809 wait complete. 2024-04-12T13:49:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 -- 172.21.15.60:0/2647689358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 msgr2=0x7f5df4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 --2- 172.21.15.60:0/2647689358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4070460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5de4004940 tx=0x7f5de4009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 -- 172.21.15.60:0/2647689358 shutdown_connections 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 --2- 172.21.15.60:0/2647689358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 0x7f5df4070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 --2- 172.21.15.60:0/2647689358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4070460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 -- 172.21.15.60:0/2647689358 >> 172.21.15.60:0/2647689358 conn(0x7f5df40f84e0 msgr2=0x7f5df40fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 -- 172.21.15.60:0/2647689358 shutdown_connections 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.273+0000 7f5df9800700 1 -- 172.21.15.60:0/2647689358 wait complete. 2024-04-12T13:49:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.274+0000 7f5df9800700 1 Processor -- start 2024-04-12T13:49:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.274+0000 7f5df9800700 1 -- start start 2024-04-12T13:49:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 0x7f5df4113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df9800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df9800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4114b20 con 0x7f5df4071f60 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df9800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4115370 con 0x7f5df40709a0 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df2000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df2000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39132/0 (socket says 172.21.15.60:39132) 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df2000700 1 -- 172.21.15.60:0/2712237717 learned_addr learned my addr 172.21.15.60:0/2712237717 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.275+0000 7f5df2a00700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 0x7f5df4113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5df2000700 1 -- 172.21.15.60:0/2712237717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 msgr2=0x7f5df4113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5df2000700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 0x7f5df4113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5df2000700 1 -- 172.21.15.60:0/2712237717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4005040 con 0x7f5df4071f60 2024-04-12T13:49:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5df2000700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5de0002a50 tx=0x7f5de00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de0007cc0 con 0x7f5df4071f60 2024-04-12T13:49:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5de000f040 con 0x7f5df4071f60 2024-04-12T13:49:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de0009640 con 0x7f5df4071f60 2024-04-12T13:49:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.276+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df4115650 con 0x7f5df4071f60 2024-04-12T13:49:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.277+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df4115b90 con 0x7f5df4071f60 2024-04-12T13:49:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.278+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df405f5f0 con 0x7f5df4071f60 2024-04-12T13:49:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.279+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5de00097a0 con 0x7f5df4071f60 2024-04-12T13:49:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.280+0000 7f5deaa00700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 0x7f5dd80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.280+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f5de008e630 con 0x7f5df4071f60 2024-04-12T13:49:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.280+0000 7f5df2a00700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 0x7f5dd80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.281+0000 7f5df2a00700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 0x7f5dd80710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5de400b970 tx=0x7f5de4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:14.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.284+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f5de005af10 con 0x7f5df4071f60 2024-04-12T13:49:14.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:14 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2377019557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:49:14.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:14 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:49:14.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:14 smithi110 ceph-mon[82130]: osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302] boot 2024-04-12T13:49:14.590 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:14 smithi110 ceph-mon[82130]: osdmap e85: 6 total, 6 up, 6 in 2024-04-12T13:49:14.591 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:49:14.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.622+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5df4115f60 con 0x7f5df4071f60 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.623+0000 7f5deaa00700 1 -- 172.21.15.60:0/2712237717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1214 (secure 0 0 0) 0x7f5de005aaa0 con 0x7f5df4071f60 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s); Degraded data redundancy: 46/222 objects degraded (20.721%), 16 pgs degraded 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/222 objects degraded (20.721%), 16 pgs degraded 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-04-12T13:49:14.626 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-04-12T13:49:14.627 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1f is active+undersized+degraded, acting [2,4] 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 msgr2=0x7f5dd80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 0x7f5dd80710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5de400b970 tx=0x7f5de4009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 msgr2=0x7f5df4114520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5de0002a50 tx=0x7f5de00046b0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 shutdown_connections 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5dd806ec00 0x7f5dd80710b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5df40709a0 0x7f5df4113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 --2- 172.21.15.60:0/2712237717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5df4071f60 0x7f5df4114520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.626+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 >> 172.21.15.60:0/2712237717 conn(0x7f5df40f84e0 msgr2=0x7f5df40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.627+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 shutdown_connections 2024-04-12T13:49:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:14.627+0000 7f5df9800700 1 -- 172.21.15.60:0/2712237717 wait complete. 2024-04-12T13:49:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:14 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2377019557' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:49:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:14 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:49:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:14 smithi060 ceph-mon[94333]: osd.3 [v2:172.21.15.110:6800/842224302,v1:172.21.15.110:6801/842224302] boot 2024-04-12T13:49:14.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:14 smithi060 ceph-mon[94333]: osdmap e85: 6 total, 6 up, 6 in 2024-04-12T13:49:14.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T13:49:15.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:15 smithi110 ceph-mon[82130]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:15.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:15 smithi110 ceph-mon[82130]: pgmap v166: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:15.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:15 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2712237717' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:49:15.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:15 smithi110 ceph-mon[82130]: osdmap e86: 6 total, 6 up, 6 in 2024-04-12T13:49:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:15 smithi060 ceph-mon[94333]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:15 smithi060 ceph-mon[94333]: pgmap v166: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/222 objects degraded (20.721%) 2024-04-12T13:49:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:15 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2712237717' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:49:15.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:15 smithi060 ceph-mon[94333]: osdmap e86: 6 total, 6 up, 6 in 2024-04-12T13:49:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:16 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:16.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:16 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:17.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:17 smithi110 ceph-mon[82130]: pgmap v169: 65 pgs: 10 peering, 15 active+undersized, 9 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-04-12T13:49:17.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:17 smithi060 ceph-mon[94333]: pgmap v169: 65 pgs: 10 peering, 15 active+undersized, 9 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: pgmap v170: 65 pgs: 10 peering, 5 active+undersized, 2 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: pgmap v171: 65 pgs: 10 peering, 5 active+undersized, 2 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:19.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:19.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:19 smithi060 ceph-mon[94333]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: pgmap v170: 65 pgs: 10 peering, 5 active+undersized, 2 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: pgmap v171: 65 pgs: 10 peering, 5 active+undersized, 2 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:19.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:19.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:19.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:19 smithi110 ceph-mon[82130]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-04-12T13:49:20.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:20 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/222 objects degraded (3.604%), 2 pgs degraded) 2024-04-12T13:49:20.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:20 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/222 objects degraded (3.604%), 2 pgs degraded) 2024-04-12T13:49:21.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:21 smithi060 ceph-mon[94333]: pgmap v172: 65 pgs: 3 peering, 62 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:21.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:21 smithi110 ceph-mon[82130]: pgmap v172: 65 pgs: 3 peering, 62 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:23.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:23 smithi110 ceph-mon[82130]: pgmap v173: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:23.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:23 smithi060 ceph-mon[94333]: pgmap v173: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:25.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:25 smithi110 ceph-mon[82130]: pgmap v174: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:25 smithi060 ceph-mon[94333]: pgmap v174: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:27.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:27 smithi110 ceph-mon[82130]: pgmap v175: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:27 smithi060 ceph-mon[94333]: pgmap v175: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:29 smithi060 ceph-mon[94333]: pgmap v176: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:29 smithi110 ceph-mon[82130]: pgmap v176: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:29.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:31.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:31 smithi060 ceph-mon[94333]: pgmap v177: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:31.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:31 smithi110 ceph-mon[82130]: pgmap v177: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:33.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:33 smithi060 ceph-mon[94333]: pgmap v178: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:33.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:33 smithi110 ceph-mon[82130]: pgmap v178: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:34.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:34.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:34 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:34.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:34 smithi060 ceph-mon[94333]: Upgrade: osd.4 is safe to restart 2024-04-12T13:49:34.720 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:34.720 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:34 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T13:49:34.720 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:34 smithi110 ceph-mon[82130]: Upgrade: osd.4 is safe to restart 2024-04-12T13:49:35.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:35 smithi060 ceph-mon[94333]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:35.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:35 smithi110 ceph-mon[82130]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:37.279 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: Upgrade: Updating osd.4 2024-04-12T13:49:37.279 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:37.279 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:49:37.279 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:49:37.280 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: Deploying daemon osd.4 on smithi110 2024-04-12T13:49:37.280 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:37 smithi110 ceph-mon[82130]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: Upgrade: Updating osd.4 2024-04-12T13:49:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:37.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T13:49:37.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:49:37.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: Deploying daemon osd.4 on smithi110 2024-04-12T13:49:37.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:37 smithi060 ceph-mon[94333]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:39.595 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:39 smithi110 ceph-mon[82130]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:39 smithi060 ceph-mon[94333]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:41 smithi060 ceph-mon[94333]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:41.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:41 smithi110 ceph-mon[82130]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:41.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:41 smithi110 systemd[1]: Stopping Ceph osd.4 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:49:42.230 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[48145]: 2024-04-12T13:49:41.727+0000 7f4f84800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:49:42.230 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[48145]: 2024-04-12T13:49:41.727+0000 7f4f84800700 -1 osd.4 86 *** Got signal Terminated *** 2024-04-12T13:49:42.230 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[48145]: 2024-04-12T13:49:41.727+0000 7f4f84800700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:49:42.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:42 smithi060 ceph-mon[94333]: osd.4 marked itself down and dead 2024-04-12T13:49:42.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:42 smithi110 ceph-mon[82130]: osd.4 marked itself down and dead 2024-04-12T13:49:43.301 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:42 smithi110 podman[96494]: 2024-04-12 13:49:42.993654136 +0000 UTC m=+1.460198699 container died 3bf060e78bc37c75b9846b134f4be7a50cb166133a457ec1ec068bc3be513454 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-64502-quincy-2-730340d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-12T13:49:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:43 smithi060 ceph-mon[94333]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:43 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:49:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:43 smithi060 ceph-mon[94333]: osdmap e87: 6 total, 5 up, 6 in 2024-04-12T13:49:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:43.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:43 smithi110 podman[96494]: 2024-04-12 13:49:43.477547506 +0000 UTC m=+1.944092088 container cleanup 3bf060e78bc37c75b9846b134f4be7a50cb166133a457ec1ec068bc3be513454 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-64502-quincy-2-730340d) 2024-04-12T13:49:43.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:43 smithi110 bash[96494]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4 2024-04-12T13:49:43.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:43 smithi110 ceph-mon[82130]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:49:43.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:43 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:49:43.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:43 smithi110 ceph-mon[82130]: osdmap e87: 6 total, 5 up, 6 in 2024-04-12T13:49:43.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:43.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:44.228 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:43 smithi110 podman[96512]: 2024-04-12 13:49:43.829039043 +0000 UTC m=+0.822758113 container remove 3bf060e78bc37c75b9846b134f4be7a50cb166133a457ec1ec068bc3be513454 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-64502-quincy-2-730340d, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:49:44.654 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:44 smithi110 ceph-mon[82130]: osdmap e88: 6 total, 5 up, 6 in 2024-04-12T13:49:44.654 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:44 smithi110 podman[96598]: 2024-04-12 13:49:44.308411195 +0000 UTC m=+0.035147787 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:44.654 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:44 smithi110 podman[96598]: 2024-04-12 13:49:44.42170139 +0000 UTC m=+0.148438006 container create 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5) 2024-04-12T13:49:44.801 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:44 smithi060 ceph-mon[94333]: osdmap e88: 6 total, 5 up, 6 in 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.799+0000 7fba46600700 1 -- 172.21.15.60:0/3034223471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fce80 msgr2=0x7fba400fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.799+0000 7fba46600700 1 --2- 172.21.15.60:0/3034223471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fce80 0x7fba400fd290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fba30004940 tx=0x7fba30009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 -- 172.21.15.60:0/3034223471 shutdown_connections 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 --2- 172.21.15.60:0/3034223471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fdff0 0x7fba400fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 --2- 172.21.15.60:0/3034223471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fce80 0x7fba400fd290 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 -- 172.21.15.60:0/3034223471 >> 172.21.15.60:0/3034223471 conn(0x7fba400f8580 msgr2=0x7fba400fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 -- 172.21.15.60:0/3034223471 shutdown_connections 2024-04-12T13:49:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.800+0000 7fba46600700 1 -- 172.21.15.60:0/3034223471 wait complete. 2024-04-12T13:49:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 Processor -- start 2024-04-12T13:49:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 -- start start 2024-04-12T13:49:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fce80 0x7fba4010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4010e470 con 0x7fba400fdff0 2024-04-12T13:49:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba46600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4010e5e0 con 0x7fba400fce80 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba3ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba3ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41882/0 (socket says 172.21.15.60:41882) 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.801+0000 7fba3ea00700 1 -- 172.21.15.60:0/4043830101 learned_addr learned my addr 172.21.15.60:0/4043830101 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.802+0000 7fba3f400700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fce80 0x7fba4010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.802+0000 7fba3ea00700 1 -- 172.21.15.60:0/4043830101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fce80 msgr2=0x7fba4010d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.802+0000 7fba3ea00700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fce80 0x7fba4010d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.802+0000 7fba3ea00700 1 -- 172.21.15.60:0/4043830101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30005040 con 0x7fba400fdff0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.802+0000 7fba3ea00700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba2c002a50 tx=0x7fba2c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.803+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2c007cc0 con 0x7fba400fdff0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.803+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba2c00f040 con 0x7fba400fdff0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.803+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2c009640 con 0x7fba400fdff0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.803+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba40113040 con 0x7fba400fdff0 2024-04-12T13:49:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.803+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401135d0 con 0x7fba400fdff0 2024-04-12T13:49:44.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.804+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4004c710 con 0x7fba400fdff0 2024-04-12T13:49:44.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.805+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fba2c0097a0 con 0x7fba400fdff0 2024-04-12T13:49:44.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.806+0000 7fba37400700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 0x7fba240710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.806+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fba2c08e610 con 0x7fba400fdff0 2024-04-12T13:49:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.807+0000 7fba3f400700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 0x7fba240710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.807+0000 7fba3f400700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 0x7fba240710b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b3b0 tx=0x7fba30009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:44.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:44.812+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fba2c05aef0 con 0x7fba400fdff0 2024-04-12T13:49:45.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.063+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba40102380 con 0x7fba2406ec00 2024-04-12T13:49:45.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.065+0000 7fba37400700 1 -- 172.21.15.60:0/4043830101 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fba40102380 con 0x7fba2406ec00 2024-04-12T13:49:45.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 msgr2=0x7fba240710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 0x7fba240710b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b3b0 tx=0x7fba30009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 msgr2=0x7fba4010de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fba2c002a50 tx=0x7fba2c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 shutdown_connections 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba2406ec00 0x7fba240710b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba400fce80 0x7fba4010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 --2- 172.21.15.60:0/4043830101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400fdff0 0x7fba4010de70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 >> 172.21.15.60:0/4043830101 conn(0x7fba400f8580 msgr2=0x7fba400f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.069+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 shutdown_connections 2024-04-12T13:49:45.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.070+0000 7fba46600700 1 -- 172.21.15.60:0/4043830101 wait complete. 2024-04-12T13:49:45.087 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:49:45.229 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:44 smithi110 podman[96598]: 2024-04-12 13:49:44.775612999 +0000 UTC m=+0.502349632 container init 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:45.229 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:44 smithi110 podman[96598]: 2024-04-12 13:49:44.788081718 +0000 UTC m=+0.514818299 container start 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-12T13:49:45.229 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:44 smithi110 podman[96598]: 2024-04-12 13:49:44.924442573 +0000 UTC m=+0.651179223 container attach 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 -- 172.21.15.60:0/1546423987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fbd30 msgr2=0x7fb4e40fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 --2- 172.21.15.60:0/1546423987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fbd30 0x7fb4e40fc140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4004940 tx=0x7fb4d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 -- 172.21.15.60:0/1546423987 shutdown_connections 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 --2- 172.21.15.60:0/1546423987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e40fd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 --2- 172.21.15.60:0/1546423987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fbd30 0x7fb4e40fc140 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 -- 172.21.15.60:0/1546423987 >> 172.21.15.60:0/1546423987 conn(0x7fb4e40f7490 msgr2=0x7fb4e40f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 -- 172.21.15.60:0/1546423987 shutdown_connections 2024-04-12T13:49:45.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.231+0000 7fb4ea600700 1 -- 172.21.15.60:0/1546423987 wait complete. 2024-04-12T13:49:45.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.232+0000 7fb4ea600700 1 Processor -- start 2024-04-12T13:49:45.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.232+0000 7fb4ea600700 1 -- start start 2024-04-12T13:49:45.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4ea600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fbd30 0x7fb4e410fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4ea600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4ea600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e41109a0 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4ea600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4110b10 con 0x7fb4e40fbd30 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41894/0 (socket says 172.21.15.60:41894) 2024-04-12T13:49:45.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.233+0000 7fb4e2a00700 1 -- 172.21.15.60:0/2559065118 learned_addr learned my addr 172.21.15.60:0/2559065118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4e3400700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fbd30 0x7fb4e410fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4e2a00700 1 -- 172.21.15.60:0/2559065118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fbd30 msgr2=0x7fb4e410fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4e2a00700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fbd30 0x7fb4e410fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4e2a00700 1 -- 172.21.15.60:0/2559065118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4005040 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4e2a00700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c8c0 tx=0x7fb4d00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d000a980 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.234+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4d000ce60 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.235+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e4115570 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.235+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d00115e0 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.235+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e4115b30 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.236+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e404c710 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.237+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb4d0012400 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.238+0000 7fb4db400700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 0x7fb4c80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.238+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fb4d008ea00 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.238+0000 7fb4e3400700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 0x7fb4c80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.239+0000 7fb4e3400700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 0x7fb4c80710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400b3b0 tx=0x7fb4d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:45.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.243+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fb4d005b2e0 con 0x7fb4e40fcfe0 2024-04-12T13:49:45.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.498+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4e41012f0 con 0x7fb4c806ec00 2024-04-12T13:49:45.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.500+0000 7fb4db400700 1 -- 172.21.15.60:0/2559065118 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb4e41012f0 con 0x7fb4c806ec00 2024-04-12T13:49:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.503+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 msgr2=0x7fb4c80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.503+0000 7fb4ea600700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 0x7fb4c80710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400b3b0 tx=0x7fb4d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.503+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 msgr2=0x7fb4e41103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.503+0000 7fb4ea600700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c8c0 tx=0x7fb4d00044c0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 shutdown_connections 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fb4c806ec00 0x7fb4c80710b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4e40fbd30 0x7fb4e410fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 --2- 172.21.15.60:0/2559065118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e40fcfe0 0x7fb4e41103a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 >> 172.21.15.60:0/2559065118 conn(0x7fb4e40f7490 msgr2=0x7fb4e40f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 shutdown_connections 2024-04-12T13:49:45.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.504+0000 7fb4ea600700 1 -- 172.21.15.60:0/2559065118 wait complete. 2024-04-12T13:49:45.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:45 smithi110 ceph-mon[82130]: pgmap v186: 65 pgs: 4 active+undersized, 3 active+undersized+degraded, 10 peering, 3 stale+active+clean, 45 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:45.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:45 smithi110 ceph-mon[82130]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:49:45.600 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:45 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:45.601 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:45 smithi110 podman[96598]: 2024-04-12 13:49:45.23928699 +0000 UTC m=+0.966023592 container died 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403) 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 -- 172.21.15.60:0/860624398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 msgr2=0x7f2ee80ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 --2- 172.21.15.60:0/860624398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee80ff400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2edc004940 tx=0x7f2edc009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 -- 172.21.15.60:0/860624398 shutdown_connections 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 --2- 172.21.15.60:0/860624398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 0x7f2ee8100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 --2- 172.21.15.60:0/860624398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee80ff400 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 -- 172.21.15.60:0/860624398 >> 172.21.15.60:0/860624398 conn(0x7f2ee80fa790 msgr2=0x7f2ee80fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 -- 172.21.15.60:0/860624398 shutdown_connections 2024-04-12T13:49:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.666+0000 7f2ef0400700 1 -- 172.21.15.60:0/860624398 wait complete. 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.667+0000 7f2ef0400700 1 Processor -- start 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.667+0000 7f2ef0400700 1 -- start start 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2ef0400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2ef0400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 0x7f2ee8110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2ef0400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8110680 con 0x7f2ee80feff0 2024-04-12T13:49:45.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2ef0400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee81107f0 con 0x7f2ee81002a0 2024-04-12T13:49:45.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2eeda00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2eeda00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41910/0 (socket says 172.21.15.60:41910) 2024-04-12T13:49:45.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2eeda00700 1 -- 172.21.15.60:0/1683823008 learned_addr learned my addr 172.21.15.60:0/1683823008 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:45.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.668+0000 7f2eed000700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 0x7f2ee8110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2eeda00700 1 -- 172.21.15.60:0/1683823008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 msgr2=0x7f2ee8110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2eeda00700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 0x7f2ee8110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2eeda00700 1 -- 172.21.15.60:0/1683823008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc005040 con 0x7f2ee80feff0 2024-04-12T13:49:45.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2eeda00700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009150 tx=0x7f2edc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:45.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2edc00e040 con 0x7f2ee80feff0 2024-04-12T13:49:45.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2edc00bbf0 con 0x7f2ee80feff0 2024-04-12T13:49:45.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee81151f0 con 0x7f2ee80feff0 2024-04-12T13:49:45.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.669+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2edc01c630 con 0x7f2ee80feff0 2024-04-12T13:49:45.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.670+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee81157b0 con 0x7f2ee80feff0 2024-04-12T13:49:45.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.671+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee804c710 con 0x7f2ee80feff0 2024-04-12T13:49:45.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.672+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2edc00bd60 con 0x7f2ee80feff0 2024-04-12T13:49:45.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.673+0000 7f2ee5600700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 0x7f2ed00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:45.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.673+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f2edc08fcb0 con 0x7f2ee80feff0 2024-04-12T13:49:45.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.674+0000 7f2eed000700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 0x7f2ed00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:45.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.674+0000 7f2eed000700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 0x7f2ed00710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004990 tx=0x7f2ed4009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:45.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.679+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f2edc05c570 con 0x7f2ee80feff0 2024-04-12T13:49:45.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.918+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ee804c710 con 0x7f2ed006ec00 2024-04-12T13:49:45.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:45 smithi060 ceph-mon[94333]: pgmap v186: 65 pgs: 4 active+undersized, 3 active+undersized+degraded, 10 peering, 3 stale+active+clean, 45 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-04-12T13:49:45.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:45 smithi060 ceph-mon[94333]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-12T13:49:45.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:45 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.955+0000 7f2ee5600700 1 -- 172.21.15.60:0/1683823008 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2ee804c710 con 0x7f2ed006ec00 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 79s ago 18m 15.0M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (3m) 79s ago 18m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (3m) 35s ago 17m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 79s ago 18m - - 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (11m) 79s ago 11m 14.6M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (11m) 79s ago 11m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (11m) 35s ago 11m 14.6M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (11m) 35s ago 11m 14.4M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (6m) 79s ago 20m 505M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:49:45.957 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (5m) 35s ago 17m 452M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (4m) 79s ago 20m 49.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (4m) 35s ago 17m 36.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 79s ago 18m 7780k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (6m) 35s ago 17m 8028k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (2m) 79s ago 16m 103M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (119s) 79s ago 15m 150M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (87s) 79s ago 15m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (40s) 35s ago 14m 11.2M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (13m) 35s ago 13m 283M 2581M 17.2.7-845-g730340d7 036a68d49952 3bf060e78bc3 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (13m) 35s ago 13m 295M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:49:45.958 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (5m) 79s ago 17m 57.0M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:49:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.958+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 msgr2=0x7f2ed00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.958+0000 7f2ef0400700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 0x7f2ed00710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004990 tx=0x7f2ed4009ee0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.958+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 msgr2=0x7f2ee810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.958+0000 7f2ef0400700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009150 tx=0x7f2edc009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 shutdown_connections 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2ed006ec00 0x7f2ed00710b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee80feff0 0x7f2ee810fb40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 --2- 172.21.15.60:0/1683823008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee81002a0 0x7f2ee8110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 >> 172.21.15.60:0/1683823008 conn(0x7f2ee80fa790 msgr2=0x7f2ee80fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 shutdown_connections 2024-04-12T13:49:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:45.959+0000 7f2ef0400700 1 -- 172.21.15.60:0/1683823008 wait complete. 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 -- 172.21.15.60:0/594553213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8103420 msgr2=0x7fc3c8103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 --2- 172.21.15.60:0/594553213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8103420 0x7fc3c8103830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8004940 tx=0x7fc3b8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 -- 172.21.15.60:0/594553213 shutdown_connections 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 --2- 172.21.15.60:0/594553213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c81046d0 0x7fc3c8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 --2- 172.21.15.60:0/594553213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8103420 0x7fc3c8103830 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 -- 172.21.15.60:0/594553213 >> 172.21.15.60:0/594553213 conn(0x7fc3c8072640 msgr2=0x7fc3c8074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 -- 172.21.15.60:0/594553213 shutdown_connections 2024-04-12T13:49:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.117+0000 7fc3ce200700 1 -- 172.21.15.60:0/594553213 wait complete. 2024-04-12T13:49:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.118+0000 7fc3ce200700 1 Processor -- start 2024-04-12T13:49:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.119+0000 7fc3ce200700 1 -- start start 2024-04-12T13:49:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.119+0000 7fc3ce200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 0x7fc3c8113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.119+0000 7fc3ce200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.119+0000 7fc3ce200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8114a20 con 0x7fc3c81046d0 2024-04-12T13:49:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.119+0000 7fc3ce200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8114b90 con 0x7fc3c8103420 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3bfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3c7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 0x7fc3c8113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3bfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41924/0 (socket says 172.21.15.60:41924) 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3bfe00700 1 -- 172.21.15.60:0/540675777 learned_addr learned my addr 172.21.15.60:0/540675777 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3c7400700 1 -- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 msgr2=0x7fc3c8114420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3c7400700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3c7400700 1 -- 172.21.15.60:0/540675777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0005040 con 0x7fc3c8103420 2024-04-12T13:49:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.120+0000 7fc3bfe00700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:49:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3c7400700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 0x7fc3c8113ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b0d0 tx=0x7fc3b8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3c8103420 2024-04-12T13:49:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b8005040 con 0x7fc3c8103420 2024-04-12T13:49:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3b8013de0 con 0x7fc3c8103420 2024-04-12T13:49:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b800be30 con 0x7fc3c8103420 2024-04-12T13:49:46.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.121+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c81199c0 con 0x7fc3c8103420 2024-04-12T13:49:46.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.122+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c804c710 con 0x7fc3c8103420 2024-04-12T13:49:46.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.124+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc3b800b680 con 0x7fc3c8103420 2024-04-12T13:49:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.125+0000 7fc3bf400700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 0x7fc3ac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.125+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fc3b808f5a0 con 0x7fc3c8103420 2024-04-12T13:49:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.125+0000 7fc3bfe00700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 0x7fc3ac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.126+0000 7fc3bfe00700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 0x7fc3ac0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00044e0 tx=0x7fc3b000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.138+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc3b805be60 con 0x7fc3c8103420 2024-04-12T13:49:46.391 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:45 smithi110 podman[96624]: 2024-04-12 13:49:45.981814027 +0000 UTC m=+0.723001708 container remove 4f8a4f7f3aa8f1079d8b17b9a5230240e9a45d7e0ec6c7e29e74fe909cce1bec (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux ) 2024-04-12T13:49:46.391 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-12T13:49:46.391 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 systemd[1]: Stopped Ceph osd.4 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:49:46.391 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.4.service: Consumed 2min 5.017s CPU time. 2024-04-12T13:49:46.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.464+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3c8119de0 con 0x7fc3c8103420 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.465+0000 7fc3bf400700 1 -- 172.21.15.60:0/540675777 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fc3b805b9f0 con 0x7fc3c8103420 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:46.467 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 5, 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 8 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:49:46.468 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 msgr2=0x7fc3ac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 0x7fc3ac0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00044e0 tx=0x7fc3b000b040 comp rx=0 tx=0).stop 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 msgr2=0x7fc3c8113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 0x7fc3c8113ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b0d0 tx=0x7fc3b8009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 shutdown_connections 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc3ac06ec00 0x7fc3ac0710b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3c8103420 0x7fc3c8113ee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 --2- 172.21.15.60:0/540675777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c81046d0 0x7fc3c8114420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 >> 172.21.15.60:0/540675777 conn(0x7fc3c8072640 msgr2=0x7fc3c8073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 shutdown_connections 2024-04-12T13:49:46.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.468+0000 7fc3ce200700 1 -- 172.21.15.60:0/540675777 wait complete. 2024-04-12T13:49:46.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 -- 172.21.15.60:0/7685798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a0066290 msgr2=0x7f58a00ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 --2- 172.21.15.60:0/7685798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a0066290 0x7f58a00ffa90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5890004940 tx=0x7f5890009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 -- 172.21.15.60:0/7685798 shutdown_connections 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 --2- 172.21.15.60:0/7685798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00fffd0 0x7f58a01023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 --2- 172.21.15.60:0/7685798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a0066290 0x7f58a00ffa90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 -- 172.21.15.60:0/7685798 >> 172.21.15.60:0/7685798 conn(0x7f58a00f74c0 msgr2=0x7f58a00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 -- 172.21.15.60:0/7685798 shutdown_connections 2024-04-12T13:49:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.619+0000 7f58a4e00700 1 -- 172.21.15.60:0/7685798 wait complete. 2024-04-12T13:49:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 Processor -- start 2024-04-12T13:49:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 -- start start 2024-04-12T13:49:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a0066290 0x7f58a00fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00fbf40 con 0x7f58a00fffd0 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f58a4e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00fc0b0 con 0x7f58a0066290 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f589d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f589d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41940/0 (socket says 172.21.15.60:41940) 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.620+0000 7f589d400700 1 -- 172.21.15.60:0/731183854 learned_addr learned my addr 172.21.15.60:0/731183854 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f589de00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a0066290 0x7f58a00fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f589d400700 1 -- 172.21.15.60:0/731183854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a0066290 msgr2=0x7f58a00fd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f589d400700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a0066290 0x7f58a00fd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f589d400700 1 -- 172.21.15.60:0/731183854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890005040 con 0x7f58a00fffd0 2024-04-12T13:49:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f589d400700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f588c002a50 tx=0x7f588c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588c007cc0 con 0x7f58a00fffd0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f588c00f040 con 0x7f58a00fffd0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.621+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f588c00db70 con 0x7f58a00fffd0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.622+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a00fc390 con 0x7f58a00fffd0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.622+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a0115aa0 con 0x7f58a00fffd0 2024-04-12T13:49:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.623+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a005f5f0 con 0x7f58a00fffd0 2024-04-12T13:49:46.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.624+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f588c00dd10 con 0x7f58a00fffd0 2024-04-12T13:49:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.625+0000 7f5896000700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 0x7f58840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.625+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f588c08df20 con 0x7f58a00fffd0 2024-04-12T13:49:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.625+0000 7f589de00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 0x7f58840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.626+0000 7f589de00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 0x7f58840710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5890004890 tx=0x7f5890009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:46.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.629+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f588c0c2fa0 con 0x7f58a00fffd0 2024-04-12T13:49:46.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 systemd[1]: Starting Ceph osd.4 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:49:46.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:46 smithi110 ceph-mon[82130]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:46 smithi110 ceph-mon[82130]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:46 smithi110 ceph-mon[82130]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.905+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f58a01058e0 con 0x7f58a00fffd0 2024-04-12T13:49:46.908 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:46 smithi060 ceph-mon[94333]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.908 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:46 smithi060 ceph-mon[94333]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.908 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:46 smithi060 ceph-mon[94333]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.907+0000 7f5896000700 1 -- 172.21.15.60:0/731183854 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f588c056cd0 con 0x7f58a00fffd0 2024-04-12T13:49:46.909 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:49:46.909 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:49:46.909 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:49:46.909 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:49:46.910 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:49:46.911 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:46.912 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 msgr2=0x7f58840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 0x7f58840710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5890004890 tx=0x7f5890009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 msgr2=0x7f58a00fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f588c002a50 tx=0x7f588c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 shutdown_connections 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f588406ec00 0x7f58840710b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a0066290 0x7f58a00fd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 --2- 172.21.15.60:0/731183854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58a00fffd0 0x7f58a00fb990 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f588c002a50 tx=0x7f588c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:49:46.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 >> 172.21.15.60:0/731183854 conn(0x7f58a00f74c0 msgr2=0x7f58a00f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:46.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 shutdown_connections 2024-04-12T13:49:46.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:46.910+0000 7f58a4e00700 1 -- 172.21.15.60:0/731183854 wait complete. 2024-04-12T13:49:46.914 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:49:47.034 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 podman[96726]: 2024-04-12 13:49:46.65685258 +0000 UTC m=+0.039880314 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:47.034 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:46 smithi110 podman[96726]: 2024-04-12 13:49:46.879870941 +0000 UTC m=+0.262898760 container create fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 -- 172.21.15.60:0/708222101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940ff020 msgr2=0x7fa0940ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 --2- 172.21.15.60:0/708222101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940ff020 0x7fa0940ff430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa084004940 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 -- 172.21.15.60:0/708222101 shutdown_connections 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 --2- 172.21.15.60:0/708222101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0941002d0 0x7fa094100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 --2- 172.21.15.60:0/708222101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940ff020 0x7fa0940ff430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 -- 172.21.15.60:0/708222101 >> 172.21.15.60:0/708222101 conn(0x7fa0940fa950 msgr2=0x7fa0940fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 -- 172.21.15.60:0/708222101 shutdown_connections 2024-04-12T13:49:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.065+0000 7fa099c00700 1 -- 172.21.15.60:0/708222101 wait complete. 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 Processor -- start 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 -- start start 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940ff020 0x7fa09410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0941106a0 con 0x7fa0941002d0 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.066+0000 7fa099c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094110810 con 0x7fa0940ff020 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41958/0 (socket says 172.21.15.60:41958) 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 -- 172.21.15.60:0/2268049922 learned_addr learned my addr 172.21.15.60:0/2268049922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092a00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940ff020 0x7fa09410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 -- 172.21.15.60:0/2268049922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940ff020 msgr2=0x7fa09410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940ff020 0x7fa09410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 -- 172.21.15.60:0/2268049922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084005040 con 0x7fa0941002d0 2024-04-12T13:49:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.067+0000 7fa092000700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa080002a50 tx=0x7fa0800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.068+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa080007cc0 con 0x7fa0941002d0 2024-04-12T13:49:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.068+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa08000f040 con 0x7fa0941002d0 2024-04-12T13:49:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.068+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa080009640 con 0x7fa0941002d0 2024-04-12T13:49:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.068+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa094115270 con 0x7fa0941002d0 2024-04-12T13:49:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.068+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa094115830 con 0x7fa0941002d0 2024-04-12T13:49:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.069+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09404c710 con 0x7fa0941002d0 2024-04-12T13:49:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.070+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa0800097a0 con 0x7fa0941002d0 2024-04-12T13:49:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.071+0000 7fa08aa00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 0x7fa078071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.071+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fa08008e600 con 0x7fa0941002d0 2024-04-12T13:49:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.072+0000 7fa092a00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 0x7fa078071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.072+0000 7fa092a00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 0x7fa078071170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b3b0 tx=0x7fa084009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:47.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.076+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fa08005aec0 con 0x7fa0941002d0 2024-04-12T13:49:47.319 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:47 smithi110 podman[96726]: 2024-04-12 13:49:47.192278447 +0000 UTC m=+0.575306219 container init fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:49:47.319 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:47 smithi110 podman[96726]: 2024-04-12 13:49:47.204652207 +0000 UTC m=+0.587679986 container start fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-12T13:49:47.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.318+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa094104690 con 0x7fa07806ecc0 2024-04-12T13:49:47.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.321+0000 7fa08aa00700 1 -- 172.21.15.60:0/2268049922 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa094104690 con 0x7fa07806ecc0 2024-04-12T13:49:47.322 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:49:47.322 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:49:47.322 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:49:47.322 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "10/21 daemons upgraded", 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:49:47.323 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 msgr2=0x7fa078071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 0x7fa078071170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b3b0 tx=0x7fa084009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 msgr2=0x7fa0941100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa080002a50 tx=0x7fa0800046b0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 shutdown_connections 2024-04-12T13:49:47.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa07806ecc0 0x7fa078071170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0940ff020 0x7fa09410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 --2- 172.21.15.60:0/2268049922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0941002d0 0x7fa0941100a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.323+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 >> 172.21.15.60:0/2268049922 conn(0x7fa0940fa950 msgr2=0x7fa0940fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:47.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.324+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 shutdown_connections 2024-04-12T13:49:47.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.324+0000 7fa099c00700 1 -- 172.21.15.60:0/2268049922 wait complete. 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 -- 172.21.15.60:0/2860368849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c103400 msgr2=0x7fe27c103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 --2- 172.21.15.60:0/2860368849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c103400 0x7fe27c103810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe270004940 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 -- 172.21.15.60:0/2860368849 shutdown_connections 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 --2- 172.21.15.60:0/2860368849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c1046b0 0x7fe27c104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 --2- 172.21.15.60:0/2860368849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c103400 0x7fe27c103810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 -- 172.21.15.60:0/2860368849 >> 172.21.15.60:0/2860368849 conn(0x7fe27c072590 msgr2=0x7fe27c0749c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 -- 172.21.15.60:0/2860368849 shutdown_connections 2024-04-12T13:49:47.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.470+0000 7fe283c00700 1 -- 172.21.15.60:0/2860368849 wait complete. 2024-04-12T13:49:47.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.471+0000 7fe283c00700 1 Processor -- start 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.471+0000 7fe283c00700 1 -- start start 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe283c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c103400 0x7fe27c113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe283c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe283c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c114b30 con 0x7fe27c1046b0 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe283c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c115380 con 0x7fe27c103400 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe27be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe27be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41970/0 (socket says 172.21.15.60:41970) 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe27be00700 1 -- 172.21.15.60:0/3603515106 learned_addr learned my addr 172.21.15.60:0/3603515106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:49:47.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.472+0000 7fe281200700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c103400 0x7fe27c113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe27be00700 1 -- 172.21.15.60:0/3603515106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c103400 msgr2=0x7fe27c113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe27be00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c103400 0x7fe27c113ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe27be00700 1 -- 172.21.15.60:0/3603515106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270005040 con 0x7fe27c1046b0 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe27be00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c830 tx=0x7fe268004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26800a760 con 0x7fe27c1046b0 2024-04-12T13:49:47.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe26800ad90 con 0x7fe27c1046b0 2024-04-12T13:49:47.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c115660 con 0x7fe27c1046b0 2024-04-12T13:49:47.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2680113a0 con 0x7fe27c1046b0 2024-04-12T13:49:47.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.473+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c115ba0 con 0x7fe27c1046b0 2024-04-12T13:49:47.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.475+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c05f5f0 con 0x7fe27c1046b0 2024-04-12T13:49:47.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.476+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe268012400 con 0x7fe27c1046b0 2024-04-12T13:49:47.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.477+0000 7fe278c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 0x7fe2640710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:49:47.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.477+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fe26808ea10 con 0x7fe27c1046b0 2024-04-12T13:49:47.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.477+0000 7fe281200700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 0x7fe2640710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:49:47.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.478+0000 7fe281200700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 0x7fe2640710c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b3b0 tx=0x7fe270009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:49:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.481+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe26805b250 con 0x7fe27c1046b0 2024-04-12T13:49:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:47 smithi060 ceph-mon[94333]: pgmap v187: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 10 peering, 2 stale+active+clean, 37 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/222 objects degraded (9.459%) 2024-04-12T13:49:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:47 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/540675777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:47 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/731183854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:49:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:47 smithi110 ceph-mon[82130]: pgmap v187: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 10 peering, 2 stale+active+clean, 37 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21/222 objects degraded (9.459%) 2024-04-12T13:49:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:47 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/540675777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:49:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:47 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/731183854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:49:47.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:47 smithi110 podman[96726]: 2024-04-12 13:49:47.315969565 +0000 UTC m=+0.698997327 container attach fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:47.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.808+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe27c04bed0 con 0x7fe27c1046b0 2024-04-12T13:49:47.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.809+0000 7fe278c00700 1 -- 172.21.15.60:0/3603515106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1096 (secure 0 0 0) 0x7fe26805ade0 con 0x7fe27c1046b0 2024-04-12T13:49:47.811 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s); 1 osds down; Reduced data availability: 1 pg peering; Degraded data redundancy: 21/222 objects degraded (9.459%), 9 pgs degraded 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: osd.4 (root=default,host=smithi110) is down 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.11 is stuck peering for 4m, current state peering, last acting [3,1] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 21/222 objects degraded (9.459%), 9 pgs degraded 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.13 is active+undersized+degraded, acting [5,2] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1a is active+undersized+degraded, acting [2,5] 2024-04-12T13:49:47.812 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-12T13:49:47.813 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-04-12T13:49:47.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 msgr2=0x7fe2640710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 0x7fe2640710c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b3b0 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2024-04-12T13:49:47.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 msgr2=0x7fe27c114530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:49:47.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c830 tx=0x7fe268004470 comp rx=0 tx=0).stop 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 shutdown_connections 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe26406ec10 0x7fe2640710c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c103400 0x7fe27c113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 --2- 172.21.15.60:0/3603515106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe27c1046b0 0x7fe27c114530 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 >> 172.21.15.60:0/3603515106 conn(0x7fe27c072590 msgr2=0x7fe27c073c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 shutdown_connections 2024-04-12T13:49:47.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:49:47.812+0000 7fe283c00700 1 -- 172.21.15.60:0/3603515106 wait complete. 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-12T13:49:48.460 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 bash[96726]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate[96741]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-12T13:49:48.461 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 podman[96726]: 2024-04-12 13:49:48.132261769 +0000 UTC m=+1.515289561 container died fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-12T13:49:48.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-mon[82130]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:48.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:48 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3603515106' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:49:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:48 smithi060 ceph-mon[94333]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:49:48.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:48 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3603515106' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:49:49.342 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:48 smithi110 podman[96861]: 2024-04-12 13:49:48.978301543 +0000 UTC m=+0.826999377 container remove fc01e12787a19d5dd895ac74f234709f972cb864235d8cea9295a85b3fb0334b (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:49:49.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:49 smithi110 ceph-mon[82130]: pgmap v188: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:49.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:49 smithi110 ceph-mon[82130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:49:49.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 podman[96922]: 2024-04-12 13:49:49.246919996 +0000 UTC m=+0.036592495 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:49:49.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 podman[96922]: 2024-04-12 13:49:49.395821235 +0000 UTC m=+0.185493770 container create 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5) 2024-04-12T13:49:49.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 podman[96922]: 2024-04-12 13:49:49.72446407 +0000 UTC m=+0.514136612 container init 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:49:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:49 smithi060 ceph-mon[94333]: pgmap v188: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:49.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:49 smithi060 ceph-mon[94333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-12T13:49:49.978 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 podman[96922]: 2024-04-12 13:49:49.735405866 +0000 UTC m=+0.525078421 container start 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS) 2024-04-12T13:49:49.979 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 ceph-osd[96941]: -- 172.21.15.110:0/219555698 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560da054d680 con 0x560da0517000 2024-04-12T13:49:49.979 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 bash[96922]: 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 2024-04-12T13:49:49.979 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:49 smithi110 systemd[1]: Started Ceph osd.4 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:49:50.728 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:50 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T13:49:50.310+0000 7fef717817c0 -1 Falling back to public interface 2024-04-12T13:49:51.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:51.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:51.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:50 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:51.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:50 smithi110 ceph-mon[82130]: pgmap v189: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:50 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:49:51.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:50 smithi060 ceph-mon[94333]: pgmap v189: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:53 smithi060 ceph-mon[94333]: pgmap v190: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:53.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:53 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:53.725 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:53 smithi110 ceph-mon[82130]: pgmap v190: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:53.725 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:53 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 38/222 objects degraded (17.117%), 15 pgs degraded (PG_DEGRADED) 2024-04-12T13:49:55.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:55.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:55.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:55 smithi060 ceph-mon[94333]: pgmap v191: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:55 smithi110 ceph-mon[82130]: pgmap v191: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:56.478 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:56 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T13:49:56.180+0000 7fef717817c0 -1 osd.4 86 log_to_monitors true 2024-04-12T13:49:56.478 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 13:49:56 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T13:49:56.379+0000 7fef60c00700 -1 osd.4 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:49:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:56 smithi110 ceph-mon[82130]: from='osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:49:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:56 smithi110 ceph-mon[82130]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:49:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:56 smithi060 ceph-mon[94333]: from='osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:49:56.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:56 smithi060 ceph-mon[94333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: pgmap v192: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: osdmap e89: 6 total, 5 up, 6 in 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: from='osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:57.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:57.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:57.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: pgmap v192: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/222 objects degraded (17.117%) 2024-04-12T13:49:57.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T13:49:57.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: osdmap e89: 6 total, 5 up, 6 in 2024-04-12T13:49:57.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:57.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: from='osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:57.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:49:57.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750] boot 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: osdmap e90: 6 total, 6 up, 6 in 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: osd.4 [v2:172.21.15.110:6808/223716750,v1:172.21.15.110:6809/223716750] boot 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: osdmap e90: 6 total, 6 up, 6 in 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:49:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:49:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:59 smithi110 ceph-mon[82130]: osdmap e91: 6 total, 6 up, 6 in 2024-04-12T13:49:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:49:59 smithi110 ceph-mon[82130]: pgmap v195: 65 pgs: 9 peering, 12 active+undersized, 11 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24/222 objects degraded (10.811%) 2024-04-12T13:49:59.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:59 smithi060 ceph-mon[94333]: osdmap e91: 6 total, 6 up, 6 in 2024-04-12T13:49:59.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:49:59 smithi060 ceph-mon[94333]: pgmap v195: 65 pgs: 9 peering, 12 active+undersized, 11 active+undersized+degraded, 33 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24/222 objects degraded (10.811%) 2024-04-12T13:50:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:00.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: [WRN] PG_DEGRADED: Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.13 is active+undersized+degraded, acting [5,2] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.1a is active+undersized+degraded, acting [2,5] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-12T13:50:00.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:00 smithi060 ceph-mon[94333]: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: [WRN] PG_DEGRADED: Degraded data redundancy: 24/222 objects degraded (10.811%), 11 pgs degraded 2024-04-12T13:50:00.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.13 is active+undersized+degraded, acting [5,2] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.1a is active+undersized+degraded, acting [2,5] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-12T13:50:00.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:00 smithi110 ceph-mon[82130]: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-04-12T13:50:01.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:01 smithi060 ceph-mon[94333]: pgmap v197: 65 pgs: 9 peering, 6 active+undersized, 3 active+undersized+degraded, 47 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5/222 objects degraded (2.252%) 2024-04-12T13:50:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:01 smithi110 ceph-mon[82130]: pgmap v197: 65 pgs: 9 peering, 6 active+undersized, 3 active+undersized+degraded, 47 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5/222 objects degraded (2.252%) 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: pgmap v198: 65 pgs: 9 peering, 3 active+undersized, 1 active+undersized+degraded, 52 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:03.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: pgmap v198: 65 pgs: 9 peering, 3 active+undersized, 1 active+undersized+degraded, 52 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:03.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:04.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:03 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:04.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:03 smithi060 ceph-mon[94333]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-12T13:50:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:03 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:03 smithi110 ceph-mon[82130]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-12T13:50:05.171 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:04 smithi060 ceph-mon[94333]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:05.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:04 smithi110 ceph-mon[82130]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:06.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:05 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded) 2024-04-12T13:50:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:05 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded) 2024-04-12T13:50:07.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:06 smithi060 ceph-mon[94333]: pgmap v200: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:07.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:06 smithi110 ceph-mon[82130]: pgmap v200: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:08 smithi110 ceph-mon[82130]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:08 smithi060 ceph-mon[94333]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:11.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:10 smithi110 ceph-mon[82130]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:11.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:10 smithi060 ceph-mon[94333]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:13.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:12 smithi110 ceph-mon[82130]: pgmap v203: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:13.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:12 smithi060 ceph-mon[94333]: pgmap v203: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:14.414 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:14.415 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:14.415 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:14.415 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:14 smithi110 ceph-mon[82130]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:14 smithi060 ceph-mon[94333]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:16.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:16 smithi060 ceph-mon[94333]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:16 smithi110 ceph-mon[82130]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:17.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:17 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:17.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:17 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:17.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 -- 172.21.15.60:0/885178127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 msgr2=0x7fd5ec0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:17.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 --2- 172.21.15.60:0/885178127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec0ff410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc004940 tx=0x7fd5dc009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:17.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 -- 172.21.15.60:0/885178127 shutdown_connections 2024-04-12T13:50:17.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 --2- 172.21.15.60:0/885178127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 0x7fd5ec100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:17.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 --2- 172.21.15.60:0/885178127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec0ff410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 -- 172.21.15.60:0/885178127 >> 172.21.15.60:0/885178127 conn(0x7fd5ec0fa950 msgr2=0x7fd5ec0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 -- 172.21.15.60:0/885178127 shutdown_connections 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.984+0000 7fd5f2000700 1 -- 172.21.15.60:0/885178127 wait complete. 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.985+0000 7fd5f2000700 1 Processor -- start 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.985+0000 7fd5f2000700 1 -- start start 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5f2000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5f2000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 0x7fd5ec1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5f2000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec1107a0 con 0x7fd5ec0ff000 2024-04-12T13:50:17.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5f2000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec110ff0 con 0x7fd5ec1002b0 2024-04-12T13:50:17.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5eb400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:17.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5eb400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44912/0 (socket says 172.21.15.60:44912) 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5eb400700 1 -- 172.21.15.60:0/2878960380 learned_addr learned my addr 172.21.15.60:0/2878960380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.986+0000 7fd5eaa00700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 0x7fd5ec1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5eb400700 1 -- 172.21.15.60:0/2878960380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 msgr2=0x7fd5ec1101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5eb400700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 0x7fd5ec1101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5eb400700 1 -- 172.21.15.60:0/2878960380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc005040 con 0x7fd5ec0ff000 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5eb400700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b3b0 tx=0x7fd5dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc00e040 con 0x7fd5ec0ff000 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc00bbf0 con 0x7fd5ec0ff000 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc01c630 con 0x7fd5ec0ff000 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.987+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec111270 con 0x7fd5ec0ff000 2024-04-12T13:50:17.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.988+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec1117b0 con 0x7fd5ec0ff000 2024-04-12T13:50:17.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.989+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec05f5f0 con 0x7fd5ec0ff000 2024-04-12T13:50:17.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.990+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd5dc00bd60 con 0x7fd5ec0ff000 2024-04-12T13:50:17.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.991+0000 7fd5e3400700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 0x7fd5d00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:17.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.991+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fd5dc08f4a0 con 0x7fd5ec0ff000 2024-04-12T13:50:17.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.991+0000 7fd5eaa00700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 0x7fd5d00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.992+0000 7fd5eaa00700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 0x7fd5d00710b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8004f40 tx=0x7fd5d800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:17.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:17.996+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd5dc05bd80 con 0x7fd5ec0ff000 2024-04-12T13:50:18.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.250+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5ec111b30 con 0x7fd5d006ec00 2024-04-12T13:50:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.252+0000 7fd5e3400700 1 -- 172.21.15.60:0/2878960380 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd5ec111b30 con 0x7fd5d006ec00 2024-04-12T13:50:18.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 msgr2=0x7fd5d00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 0x7fd5d00710b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8004f40 tx=0x7fd5d800b040 comp rx=0 tx=0).stop 2024-04-12T13:50:18.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 msgr2=0x7fd5ec10fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b3b0 tx=0x7fd5dc009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 shutdown_connections 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d006ec00 0x7fd5d00710b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec0ff000 0x7fd5ec10fc60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 --2- 172.21.15.60:0/2878960380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5ec1002b0 0x7fd5ec1101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 >> 172.21.15.60:0/2878960380 conn(0x7fd5ec0fa950 msgr2=0x7fd5ec0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 shutdown_connections 2024-04-12T13:50:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.255+0000 7fd5f2000700 1 -- 172.21.15.60:0/2878960380 wait complete. 2024-04-12T13:50:18.273 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 -- 172.21.15.60:0/1830837088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f0103420 msgr2=0x7fd5f0103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 --2- 172.21.15.60:0/1830837088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f0103420 0x7fd5f0103830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0004940 tx=0x7fd5e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 -- 172.21.15.60:0/1830837088 shutdown_connections 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 --2- 172.21.15.60:0/1830837088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f01046d0 0x7fd5f0104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 --2- 172.21.15.60:0/1830837088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f0103420 0x7fd5f0103830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 -- 172.21.15.60:0/1830837088 >> 172.21.15.60:0/1830837088 conn(0x7fd5f0072640 msgr2=0x7fd5f0074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 -- 172.21.15.60:0/1830837088 shutdown_connections 2024-04-12T13:50:18.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.421+0000 7fd5f5200700 1 -- 172.21.15.60:0/1830837088 wait complete. 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.422+0000 7fd5f5200700 1 Processor -- start 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.422+0000 7fd5f5200700 1 -- start start 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5f5200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f0103420 0x7fd5f0113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5f5200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5f5200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0114a40 con 0x7fd5f01046d0 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5f5200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0114bb0 con 0x7fd5f0103420 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44942/0 (socket says 172.21.15.60:44942) 2024-04-12T13:50:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 -- 172.21.15.60:0/2547735717 learned_addr learned my addr 172.21.15.60:0/2547735717 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ede00700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f0103420 0x7fd5f0113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 -- 172.21.15.60:0/2547735717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f0103420 msgr2=0x7fd5f0113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f0103420 0x7fd5f0113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.423+0000 7fd5ed400700 1 -- 172.21.15.60:0/2547735717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0005040 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5ed400700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00eb70 tx=0x7fd5dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc007cc0 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc00f040 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc009640 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f01195b0 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.424+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f0119af0 con 0x7fd5f01046d0 2024-04-12T13:50:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.426+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f004c710 con 0x7fd5f01046d0 2024-04-12T13:50:18.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.427+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd5dc0097a0 con 0x7fd5f01046d0 2024-04-12T13:50:18.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.428+0000 7fd5e6000700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 0x7fd5d40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.428+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fd5dc08e600 con 0x7fd5f01046d0 2024-04-12T13:50:18.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.428+0000 7fd5ede00700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 0x7fd5d40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.429+0000 7fd5ede00700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 0x7fd5d40710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000b0d0 tx=0x7fd5e0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:18.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.432+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd5dc05adc0 con 0x7fd5f01046d0 2024-04-12T13:50:18.442 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:18 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:18.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:18 smithi110 ceph-mon[82130]: Upgrade: osd.5 is safe to restart 2024-04-12T13:50:18.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:18 smithi110 ceph-mon[82130]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:18.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:18 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T13:50:18.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:18 smithi060 ceph-mon[94333]: Upgrade: osd.5 is safe to restart 2024-04-12T13:50:18.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:18 smithi060 ceph-mon[94333]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.688+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5f01089a0 con 0x7fd5d406ec00 2024-04-12T13:50:18.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.691+0000 7fd5e6000700 1 -- 172.21.15.60:0/2547735717 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd5f01089a0 con 0x7fd5d406ec00 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 msgr2=0x7fd5d40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 0x7fd5d40710b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000b0d0 tx=0x7fd5e0009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 msgr2=0x7fd5f0114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00eb70 tx=0x7fd5dc00b040 comp rx=0 tx=0).stop 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 shutdown_connections 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd5d406ec00 0x7fd5d40710b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5f0103420 0x7fd5f0113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 --2- 172.21.15.60:0/2547735717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5f01046d0 0x7fd5f0114440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.694+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 >> 172.21.15.60:0/2547735717 conn(0x7fd5f0072640 msgr2=0x7fd5f0073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:18.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.695+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 shutdown_connections 2024-04-12T13:50:18.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.695+0000 7fd5f5200700 1 -- 172.21.15.60:0/2547735717 wait complete. 2024-04-12T13:50:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 -- 172.21.15.60:0/2826498737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fe040 msgr2=0x7f61e80fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 --2- 172.21.15.60:0/2826498737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fe040 0x7f61e80fe4b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61d4004940 tx=0x7f61d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 -- 172.21.15.60:0/2826498737 shutdown_connections 2024-04-12T13:50:18.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 --2- 172.21.15.60:0/2826498737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fe040 0x7f61e80fe4b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 --2- 172.21.15.60:0/2826498737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fce40 0x7f61e80fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 -- 172.21.15.60:0/2826498737 >> 172.21.15.60:0/2826498737 conn(0x7f61e80f8530 msgr2=0x7f61e80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.855+0000 7f61ef000700 1 -- 172.21.15.60:0/2826498737 shutdown_connections 2024-04-12T13:50:18.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.856+0000 7f61ef000700 1 -- 172.21.15.60:0/2826498737 wait complete. 2024-04-12T13:50:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.856+0000 7f61ef000700 1 Processor -- start 2024-04-12T13:50:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.856+0000 7f61ef000700 1 -- start start 2024-04-12T13:50:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61ef000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61ef000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fe040 0x7f61e8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61ef000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80708c0 con 0x7f61e80fce40 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61ef000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8070a30 con 0x7f61e80fe040 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61e7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61e7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44950/0 (socket says 172.21.15.60:44950) 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.857+0000 7f61e7e00700 1 -- 172.21.15.60:0/3265591749 learned_addr learned my addr 172.21.15.60:0/3265591749 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61e7400700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fe040 0x7f61e8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61e7e00700 1 -- 172.21.15.60:0/3265591749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fe040 msgr2=0x7f61e8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61e7e00700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fe040 0x7f61e8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61e7e00700 1 -- 172.21.15.60:0/3265591749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4005040 con 0x7f61e80fce40 2024-04-12T13:50:18.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61e7e00700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c8e0 tx=0x7f61d80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61d800a940 con 0x7f61e80fce40 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61d800ce80 con 0x7f61e80fce40 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8070d10 con 0x7f61e80fce40 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.858+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61d80113a0 con 0x7f61e80fce40 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.859+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e8115a70 con 0x7f61e80fce40 2024-04-12T13:50:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.860+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e805f5f0 con 0x7f61e80fce40 2024-04-12T13:50:18.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.861+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f61d8012400 con 0x7f61e80fce40 2024-04-12T13:50:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.862+0000 7f61dfe00700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 0x7f61cc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.862+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f61d808e9d0 con 0x7f61e80fce40 2024-04-12T13:50:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.862+0000 7f61e7400700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 0x7f61cc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.863+0000 7f61e7400700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 0x7f61cc0710b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b3b0 tx=0x7f61d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:18.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:18.867+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f61d8057780 con 0x7f61e80fce40 2024-04-12T13:50:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.107+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e81023b0 con 0x7f61cc06ec00 2024-04-12T13:50:19.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.138+0000 7f61dfe00700 1 -- 172.21.15.60:0/3265591749 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f61e81023b0 con 0x7f61cc06ec00 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 112s ago 19m 15.0M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (3m) 112s ago 19m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (3m) 24s ago 18m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 112s ago 18m - - 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (11m) 112s ago 11m 14.6M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (12m) 112s ago 11m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (11m) 24s ago 11m 14.8M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (11m) 24s ago 11m 14.6M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (7m) 112s ago 20m 505M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (5m) 24s ago 17m 452M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (5m) 112s ago 21m 49.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (4m) 24s ago 17m 38.0M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 112s ago 19m 7780k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 24s ago 17m 8112k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (3m) 112s ago 16m 103M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (2m) 112s ago 16m 150M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (2m) 112s ago 15m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (73s) 24s ago 14m 102M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (29s) 24s ago 14m 11.1M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (13m) 24s ago 13m 294M 2581M 17.2.7-845-g730340d7 036a68d49952 3b987b02327f 2024-04-12T13:50:19.141 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 112s ago 18m 57.0M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:50:19.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 msgr2=0x7f61cc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 0x7f61cc0710b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b3b0 tx=0x7f61d4009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:19.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 msgr2=0x7f61e8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c8e0 tx=0x7f61d80044c0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 shutdown_connections 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f61cc06ec00 0x7f61cc0710b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e80fce40 0x7f61e8071e40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 --2- 172.21.15.60:0/3265591749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61e80fe040 0x7f61e8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.142+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 >> 172.21.15.60:0/3265591749 conn(0x7f61e80f8530 msgr2=0x7f61e80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.143+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 shutdown_connections 2024-04-12T13:50:19.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.143+0000 7f61ef000700 1 -- 172.21.15.60:0/3265591749 wait complete. 2024-04-12T13:50:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.304+0000 7f6850200700 1 -- 172.21.15.60:0/4069995370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848070890 msgr2=0x7f6848070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.304+0000 7f6850200700 1 --2- 172.21.15.60:0/4069995370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848070890 0x7f6848070d00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6834004940 tx=0x7f6834009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 -- 172.21.15.60:0/4069995370 shutdown_connections 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 --2- 172.21.15.60:0/4069995370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848070890 0x7f6848070d00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 --2- 172.21.15.60:0/4069995370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848071e40 0x7f6848070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 -- 172.21.15.60:0/4069995370 >> 172.21.15.60:0/4069995370 conn(0x7f68480f8530 msgr2=0x7f68480fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 -- 172.21.15.60:0/4069995370 shutdown_connections 2024-04-12T13:50:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.305+0000 7f6850200700 1 -- 172.21.15.60:0/4069995370 wait complete. 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 Processor -- start 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 -- start start 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848070890 0x7f684810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848110770 con 0x7f6848071e40 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.306+0000 7f6850200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848110fc0 con 0x7f6848070890 2024-04-12T13:50:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55754/0 (socket says 172.21.15.60:55754) 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 -- 172.21.15.60:0/2797460298 learned_addr learned my addr 172.21.15.60:0/2797460298 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684d800700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848070890 0x7f684810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 -- 172.21.15.60:0/2797460298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848070890 msgr2=0x7f684810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848070890 0x7f684810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 -- 172.21.15.60:0/2797460298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834005040 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.307+0000 7f684ce00700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f683400b3b0 tx=0x7f6834009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.308+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683400e040 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.308+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6834004290 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.308+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6848111240 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.308+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683401c630 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.308+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6848111780 con 0x7f6848071e40 2024-04-12T13:50:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.309+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684805f5f0 con 0x7f6848071e40 2024-04-12T13:50:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.310+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f683400bbf0 con 0x7f6848071e40 2024-04-12T13:50:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.311+0000 7f6845600700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 0x7f68300710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.311+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f683408fd10 con 0x7f6848071e40 2024-04-12T13:50:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.311+0000 7f684d800700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 0x7f68300710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.312+0000 7f684d800700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 0x7f68300710c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f683c007fd0 tx=0x7f683c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:19.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.316+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f683405c5d0 con 0x7f6848071e40 2024-04-12T13:50:19.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:19 smithi110 ceph-mon[82130]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:19.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:19 smithi110 ceph-mon[82130]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.650+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6848107af0 con 0x7f6848071e40 2024-04-12T13:50:19.652 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:19 smithi060 ceph-mon[94333]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:19.653 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:19 smithi060 ceph-mon[94333]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:19.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.651+0000 7f6845600700 1 -- 172.21.15.60:0/2797460298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f683405c160 con 0x7f6848071e40 2024-04-12T13:50:19.653 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:50:19.653 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:50:19.653 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 1, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 5 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 4 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 5, 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 9 2024-04-12T13:50:19.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:50:19.655 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:50:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 msgr2=0x7f68300710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 0x7f68300710c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f683c007fd0 tx=0x7f683c009040 comp rx=0 tx=0).stop 2024-04-12T13:50:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 msgr2=0x7f6848110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f683400b3b0 tx=0x7f6834009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 shutdown_connections 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f683006ec10 0x7f68300710c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6848070890 0x7f684810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 --2- 172.21.15.60:0/2797460298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6848071e40 0x7f6848110170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 >> 172.21.15.60:0/2797460298 conn(0x7f68480f8530 msgr2=0x7f68480f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 shutdown_connections 2024-04-12T13:50:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.655+0000 7f6850200700 1 -- 172.21.15.60:0/2797460298 wait complete. 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 -- 172.21.15.60:0/1918879988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fce50 msgr2=0x7f17940fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 --2- 172.21.15.60:0/1918879988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fce50 0x7f17940fd260 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1784009ce0 tx=0x7f1784004d10 comp rx=0 tx=0).stop 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 -- 172.21.15.60:0/1918879988 shutdown_connections 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 --2- 172.21.15.60:0/1918879988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fe050 0x7f17940fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 --2- 172.21.15.60:0/1918879988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fce50 0x7f17940fd260 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 -- 172.21.15.60:0/1918879988 >> 172.21.15.60:0/1918879988 conn(0x7f17940f8580 msgr2=0x7f17940fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:19.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.810+0000 7f179b200700 1 -- 172.21.15.60:0/1918879988 shutdown_connections 2024-04-12T13:50:19.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.811+0000 7f179b200700 1 -- 172.21.15.60:0/1918879988 wait complete. 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.811+0000 7f179b200700 1 Processor -- start 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f179b200700 1 -- start start 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f179b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f179b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f179b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794111130 con 0x7f17940fe050 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f179b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17941112a0 con 0x7f17940fce50 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.812+0000 7f1793400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55768/0 (socket says 172.21.15.60:55768) 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793400700 1 -- 172.21.15.60:0/2308825922 learned_addr learned my addr 172.21.15.60:0/2308825922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:19.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.60:55796/0 (socket says 172.21.15.60:55796) 2024-04-12T13:50:19.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793e00700 1 -- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 msgr2=0x7f17941103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:19.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793e00700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793e00700 1 -- 172.21.15.60:0/2308825922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009940 con 0x7f17940fce50 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.813+0000 7f1793400700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f1793e00700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f80 tx=0x7f1784004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178400e040 con 0x7f17940fce50 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17941114c0 con 0x7f17940fce50 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1794111a80 con 0x7f17940fce50 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1784004e10 con 0x7f17940fce50 2024-04-12T13:50:19.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.814+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178401c400 con 0x7f17940fce50 2024-04-12T13:50:19.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.816+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17740052e0 con 0x7f17940fce50 2024-04-12T13:50:19.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.817+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1784012410 con 0x7f17940fce50 2024-04-12T13:50:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.818+0000 7f178be00700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 0x7f17780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.818+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f1784044e40 con 0x7f17940fce50 2024-04-12T13:50:19.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.818+0000 7f1793400700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 0x7f17780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:19.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.819+0000 7f1793400700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 0x7f17780710c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17800041d0 tx=0x7f178000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:19.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:19.825+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f17840591d0 con 0x7f17940fce50 2024-04-12T13:50:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.095+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1774005860 con 0x7f17940fce50 2024-04-12T13:50:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.097+0000 7f178be00700 1 -- 172.21.15.60:0/2308825922 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f1784008f30 con 0x7f17940fce50 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:e13 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 13 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:50:20.099 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:38:35.348866+0000 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14444} 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:50:20.100 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:14444} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6826/3800124536,v1:172.21.15.60:6827/3800124536] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:14458} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:20.101 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:20.102 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.100+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 msgr2=0x7f17780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.100+0000 7f179b200700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 0x7f17780710c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17800041d0 tx=0x7f178000b040 comp rx=0 tx=0).stop 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.100+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 msgr2=0x7f179410fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.100+0000 7f179b200700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f80 tx=0x7f1784004d10 comp rx=0 tx=0).stop 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 shutdown_connections 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f177806ec10 0x7f17780710c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17940fce50 0x7f179410fe80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 --2- 172.21.15.60:0/2308825922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17940fe050 0x7f17941103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 >> 172.21.15.60:0/2308825922 conn(0x7f17940f8580 msgr2=0x7f17940f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 shutdown_connections 2024-04-12T13:50:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.101+0000 7f179b200700 1 -- 172.21.15.60:0/2308825922 wait complete. 2024-04-12T13:50:20.104 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 -- 172.21.15.60:0/181669940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 msgr2=0x7ff0641004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 --2- 172.21.15.60:0/181669940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff0641004e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff050004940 tx=0x7ff050009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 -- 172.21.15.60:0/181669940 shutdown_connections 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 --2- 172.21.15.60:0/181669940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff0641004e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 --2- 172.21.15.60:0/181669940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff0640ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 -- 172.21.15.60:0/181669940 >> 172.21.15.60:0/181669940 conn(0x7ff0640fa790 msgr2=0x7ff0640fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.257+0000 7ff068c00700 1 -- 172.21.15.60:0/181669940 shutdown_connections 2024-04-12T13:50:20.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.258+0000 7ff068c00700 1 -- 172.21.15.60:0/181669940 wait complete. 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.258+0000 7ff068c00700 1 Processor -- start 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.258+0000 7ff068c00700 1 -- start start 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff068c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff06410fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff068c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff068c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0641105b0 con 0x7ff064100070 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff068c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff064110e00 con 0x7ff0640fef00 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff062a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff062a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55774/0 (socket says 172.21.15.60:55774) 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff062a00700 1 -- 172.21.15.60:0/3798524373 learned_addr learned my addr 172.21.15.60:0/3798524373 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff063400700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff06410fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.259+0000 7ff062a00700 1 -- 172.21.15.60:0/3798524373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 msgr2=0x7ff06410fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff062a00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff06410fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff062a00700 1 -- 172.21.15.60:0/3798524373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050005040 con 0x7ff064100070 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff063400700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff06410fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff062a00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff05000b3b0 tx=0x7ff050009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05000e040 con 0x7ff064100070 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064111080 con 0x7ff064100070 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff050004290 con 0x7ff064100070 2024-04-12T13:50:20.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05001c630 con 0x7ff064100070 2024-04-12T13:50:20.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.260+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0641115c0 con 0x7ff064100070 2024-04-12T13:50:20.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.262+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0640fe290 con 0x7ff064100070 2024-04-12T13:50:20.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.263+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff05000bbf0 con 0x7ff064100070 2024-04-12T13:50:20.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.263+0000 7ff05b400700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 0x7ff0480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.264+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7ff05008fdc0 con 0x7ff064100070 2024-04-12T13:50:20.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.264+0000 7ff063400700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 0x7ff0480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:20.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.264+0000 7ff063400700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 0x7ff0480710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff054007fd0 tx=0x7ff054009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:20.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.270+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff050093030 con 0x7ff064100070 2024-04-12T13:50:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.515+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0641118a0 con 0x7ff04806ec00 2024-04-12T13:50:20.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.518+0000 7ff05b400700 1 -- 172.21.15.60:0/3798524373 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff0641118a0 con 0x7ff04806ec00 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "11/21 daemons upgraded", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:50:20.520 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:50:20.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 msgr2=0x7ff0480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 0x7ff0480710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff054007fd0 tx=0x7ff054009040 comp rx=0 tx=0).stop 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 msgr2=0x7ff06410ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff05000b3b0 tx=0x7ff050009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 shutdown_connections 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff04806ec00 0x7ff0480710b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0640fef00 0x7ff06410fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 --2- 172.21.15.60:0/3798524373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff064100070 0x7ff06410ffb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 >> 172.21.15.60:0/3798524373 conn(0x7ff0640fa790 msgr2=0x7ff0640fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 shutdown_connections 2024-04-12T13:50:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.521+0000 7ff068c00700 1 -- 172.21.15.60:0/3798524373 wait complete. 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 -- 172.21.15.60:0/2107780435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fe040 msgr2=0x7f8b1c0fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 --2- 172.21.15.60:0/2107780435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fe040 0x7f8b1c0fe4b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b08004940 tx=0x7f8b08009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 -- 172.21.15.60:0/2107780435 shutdown_connections 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 --2- 172.21.15.60:0/2107780435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fe040 0x7f8b1c0fe4b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 --2- 172.21.15.60:0/2107780435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 -- 172.21.15.60:0/2107780435 >> 172.21.15.60:0/2107780435 conn(0x7f8b1c0f8590 msgr2=0x7f8b1c0fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 -- 172.21.15.60:0/2107780435 shutdown_connections 2024-04-12T13:50:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.669+0000 7f8b24000700 1 -- 172.21.15.60:0/2107780435 wait complete. 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.670+0000 7f8b24000700 1 Processor -- start 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.670+0000 7f8b24000700 1 -- start start 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b24000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b24000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0fe040 0x7f8b1c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b24000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c110860 con 0x7f8b1c0fce40 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b24000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c110fa0 con 0x7f8b1c0fe040 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55786/0 (socket says 172.21.15.60:55786) 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 -- 172.21.15.60:0/940053078 learned_addr learned my addr 172.21.15.60:0/940053078 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 -- 172.21.15.60:0/940053078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0fe040 msgr2=0x7f8b1c110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0fe040 0x7f8b1c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.671+0000 7f8b21600700 1 -- 172.21.15.60:0/940053078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08005040 con 0x7f8b1c0fce40 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b21600700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b10002a80 tx=0x7f8b10004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:20.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b10007cc0 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b1000f040 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c111280 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1000dad0 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.672+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c111840 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.673+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c1019d0 con 0x7f8b1c0fce40 2024-04-12T13:50:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.674+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8b1000dc30 con 0x7f8b1c0fce40 2024-04-12T13:50:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.675+0000 7f8b19600700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 0x7f8b040710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.676+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f8b1008e6a0 con 0x7f8b1c0fce40 2024-04-12T13:50:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.676+0000 7f8b20c00700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 0x7f8b040710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.676+0000 7f8b20c00700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 0x7f8b040710c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b08004f90 tx=0x7f8b08009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:20.680+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f8b1005aee0 con 0x7f8b1c0fce40 2024-04-12T13:50:20.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:20.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: Upgrade: Updating osd.5 2024-04-12T13:50:20.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: Deploying daemon osd.5 on smithi110 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2797460298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:20.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:20 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2308825922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:50:20.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:20.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: Upgrade: Updating osd.5 2024-04-12T13:50:20.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: Deploying daemon osd.5 on smithi110 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2797460298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:20.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:20 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2308825922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:50:21.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.001+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8b1c05f5f0 con 0x7f8b1c0fce40 2024-04-12T13:50:21.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.002+0000 7f8b19600700 1 -- 172.21.15.60:0/940053078 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f8b1005aa70 con 0x7f8b1c0fce40 2024-04-12T13:50:21.003 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:50:21.004 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:50:21.004 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:50:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 msgr2=0x7f8b040710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 0x7f8b040710c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b08004f90 tx=0x7f8b08009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 msgr2=0x7f8b1c10fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b10002a80 tx=0x7f8b10004600 comp rx=0 tx=0).stop 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 shutdown_connections 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8b0406ec10 0x7f8b040710c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0fce40 0x7f8b1c10fd20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 --2- 172.21.15.60:0/940053078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0fe040 0x7f8b1c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 >> 172.21.15.60:0/940053078 conn(0x7f8b1c0f8590 msgr2=0x7f8b1c0f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 shutdown_connections 2024-04-12T13:50:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:21.005+0000 7f8b24000700 1 -- 172.21.15.60:0/940053078 wait complete. 2024-04-12T13:50:21.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:21 smithi060 ceph-mon[94333]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:21.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:21 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/940053078' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:50:21.947 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:21 smithi110 ceph-mon[82130]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:21.947 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:21 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/940053078' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:50:22.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:22 smithi110 ceph-mon[82130]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:22.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:22 smithi060 ceph-mon[94333]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:24.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:24 smithi110 ceph-mon[82130]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:24 smithi060 ceph-mon[94333]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:24.979 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:24 smithi110 systemd[1]: Stopping Ceph osd.5 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:50:25.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:25 smithi060 ceph-mon[94333]: osd.5 marked itself down and dead 2024-04-12T13:50:25.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:25 smithi110 ceph-mon[82130]: osd.5 marked itself down and dead 2024-04-12T13:50:25.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:25 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[55187]: 2024-04-12T13:50:25.063+0000 7f48f8c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T13:50:25.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:25 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[55187]: 2024-04-12T13:50:25.063+0000 7f48f8c00700 -1 osd.5 91 *** Got signal Terminated *** 2024-04-12T13:50:25.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:25 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[55187]: 2024-04-12T13:50:25.063+0000 7f48f8c00700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T13:50:25.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:25 smithi110 podman[101330]: 2024-04-12 13:50:25.710929667 +0000 UTC m=+0.813608759 container died 3b987b02327f6ce56301050c943d1ccfee5e51ba59f94e49eb8c59d74babd729 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, RELEASE=wip-64502-quincy-2-730340d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS) 2024-04-12T13:50:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:26 smithi060 ceph-mon[94333]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:50:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:26 smithi060 ceph-mon[94333]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-12T13:50:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:26 smithi060 ceph-mon[94333]: osdmap e92: 6 total, 5 up, 6 in 2024-04-12T13:50:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:26 smithi060 ceph-mon[94333]: pgmap v211: 65 pgs: 9 peering, 11 stale+active+clean, 45 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:26.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:26 smithi060 ceph-mon[94333]: osdmap e93: 6 total, 5 up, 6 in 2024-04-12T13:50:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:26 smithi110 ceph-mon[82130]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T13:50:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:26 smithi110 ceph-mon[82130]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-12T13:50:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:26 smithi110 ceph-mon[82130]: osdmap e92: 6 total, 5 up, 6 in 2024-04-12T13:50:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:26 smithi110 ceph-mon[82130]: pgmap v211: 65 pgs: 9 peering, 11 stale+active+clean, 45 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T13:50:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:26 smithi110 ceph-mon[82130]: osdmap e93: 6 total, 5 up, 6 in 2024-04-12T13:50:26.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:26 smithi110 podman[101330]: 2024-04-12 13:50:26.382687271 +0000 UTC m=+1.485366394 container cleanup 3b987b02327f6ce56301050c943d1ccfee5e51ba59f94e49eb8c59d74babd729 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-64502-quincy-2-730340d) 2024-04-12T13:50:26.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:26 smithi110 bash[101330]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5 2024-04-12T13:50:26.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:26 smithi110 podman[101349]: 2024-04-12 13:50:26.608931381 +0000 UTC m=+0.880500983 container remove 3b987b02327f6ce56301050c943d1ccfee5e51ba59f94e49eb8c59d74babd729 (image=quay.ceph.io/ceph-ci/ceph@sha256:dc489f443d706a8c840f77eb5cb2f4c483c58750088abf1e2e28dd3291f1c36f, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, RELEASE=wip-64502-quincy-2-730340d, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409) 2024-04-12T13:50:27.419 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:27 smithi110 ceph-mon[82130]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-12T13:50:27.420 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:27 smithi110 podman[101435]: 2024-04-12 13:50:27.313866306 +0000 UTC m=+0.037163969 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:50:27.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:27 smithi060 ceph-mon[94333]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-12T13:50:27.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:27 smithi110 podman[101435]: 2024-04-12 13:50:27.418077289 +0000 UTC m=+0.141374971 container create 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240403) 2024-04-12T13:50:28.180 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:27 smithi110 podman[101435]: 2024-04-12 13:50:27.750405391 +0000 UTC m=+0.473703191 container init 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, ceph=True, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-12T13:50:28.180 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:27 smithi110 podman[101435]: 2024-04-12 13:50:27.762599297 +0000 UTC m=+0.485896979 container start 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-12T13:50:28.180 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:27 smithi110 podman[101435]: 2024-04-12 13:50:27.846134992 +0000 UTC m=+0.569432698 container attach 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-a971fd5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-12T13:50:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:28 smithi060 ceph-mon[94333]: pgmap v213: 65 pgs: 11 active+undersized, 8 active+undersized+degraded, 9 peering, 1 stale+active+clean, 36 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/222 objects degraded (11.261%) 2024-04-12T13:50:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:28 smithi110 ceph-mon[82130]: pgmap v213: 65 pgs: 11 active+undersized, 8 active+undersized+degraded, 9 peering, 1 stale+active+clean, 36 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/222 objects degraded (11.261%) 2024-04-12T13:50:28.478 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:28 smithi110 podman[101435]: 2024-04-12 13:50:28.215956252 +0000 UTC m=+0.939253964 container died 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T13:50:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:29 smithi110 ceph-mon[82130]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 8 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:29.229 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:28 smithi110 podman[101461]: 2024-04-12 13:50:28.932794674 +0000 UTC m=+0.698499767 container remove 56995c63c2f8c5dda57257ba99277cf2f13be037c468f75c1c6d00338b6ee373 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-12T13:50:29.229 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:28 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-12T13:50:29.229 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:28 smithi110 systemd[1]: Stopped Ceph osd.5 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:50:29.229 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:28 smithi110 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.5.service: Consumed 2min 12.337s CPU time. 2024-04-12T13:50:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:29 smithi060 ceph-mon[94333]: Health check failed: Degraded data redundancy: 25/222 objects degraded (11.261%), 8 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:29.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:29.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:29 smithi110 systemd[1]: Starting Ceph osd.5 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T13:50:30.006 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:29 smithi110 podman[101565]: 2024-04-12 13:50:29.654744855 +0000 UTC m=+0.032926402 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:50:30.006 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:29 smithi110 podman[101565]: 2024-04-12 13:50:29.834597111 +0000 UTC m=+0.212778695 container create e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, ceph=True) 2024-04-12T13:50:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:30 smithi110 ceph-mon[82130]: pgmap v214: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 9 peering, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-04-12T13:50:30.478 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:30 smithi110 podman[101565]: 2024-04-12 13:50:30.138739929 +0000 UTC m=+0.516921520 container init e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-12T13:50:30.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:30 smithi110 podman[101565]: 2024-04-12 13:50:30.151891296 +0000 UTC m=+0.530072855 container start e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T13:50:30.479 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:30 smithi110 podman[101565]: 2024-04-12 13:50:30.253926293 +0000 UTC m=+0.632107931 container attach e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-a971fd5) 2024-04-12T13:50:30.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:30 smithi060 ceph-mon[94333]: pgmap v214: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 9 peering, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T13:50:31.424 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 bash[101565]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate[101579]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-12T13:50:31.425 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 podman[101565]: 2024-04-12 13:50:31.081945494 +0000 UTC m=+1.460127082 container died e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2) 2024-04-12T13:50:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:32 smithi110 ceph-mon[82130]: pgmap v215: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:32 smithi110 ceph-mon[82130]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-12T13:50:32.229 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:31 smithi110 podman[101699]: 2024-04-12 13:50:31.932651953 +0000 UTC m=+0.832463170 container remove e5122c92f83a13478d62b06d00fde807482c5079c5ce658d72717e95ba661276 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, RELEASE=main-a971fd5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-12T13:50:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:32 smithi060 ceph-mon[94333]: pgmap v215: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:32 smithi060 ceph-mon[94333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-12T13:50:32.672 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 podman[101760]: 2024-04-12 13:50:32.191844951 +0000 UTC m=+0.032504946 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T13:50:32.672 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 podman[101760]: 2024-04-12 13:50:32.358726512 +0000 UTC m=+0.199386543 container create 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-04-12T13:50:32.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 podman[101760]: 2024-04-12 13:50:32.67054322 +0000 UTC m=+0.511203261 container init 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T13:50:32.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 podman[101760]: 2024-04-12 13:50:32.681758212 +0000 UTC m=+0.522418211 container start 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , ceph=True) 2024-04-12T13:50:32.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 ceph-osd[101779]: -- 172.21.15.110:0/781905582 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x55b25fd29ba0 con 0x55b25fcfac00 2024-04-12T13:50:32.979 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 ceph-osd[101779]: -- 172.21.15.110:0/781905582 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b25fd31680 con 0x55b25fcfac00 2024-04-12T13:50:32.979 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 bash[101760]: 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 2024-04-12T13:50:32.979 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:32 smithi110 systemd[1]: Started Ceph osd.5 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T13:50:33.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:33 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T13:50:33.265+0000 7f3c0c4967c0 -1 Falling back to public interface 2024-04-12T13:50:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:34.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:34.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:34.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:34 smithi060 ceph-mon[94333]: pgmap v216: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:34 smithi110 ceph-mon[82130]: pgmap v216: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:36 smithi060 ceph-mon[94333]: pgmap v217: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:36 smithi110 ceph-mon[82130]: pgmap v217: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:38 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 13 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:38 smithi110 ceph-mon[82130]: pgmap v218: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:38 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 13 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:38.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:38 smithi060 ceph-mon[94333]: pgmap v218: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:38.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:38 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T13:50:38.674+0000 7f3c0c4967c0 -1 osd.5 91 log_to_monitors true 2024-04-12T13:50:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:39 smithi060 ceph-mon[94333]: from='osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:50:39.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:39 smithi060 ceph-mon[94333]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:50:39.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 13:50:39 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T13:50:39.280+0000 7f3bfb800700 -1 osd.5 91 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T13:50:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:39 smithi110 ceph-mon[82130]: from='osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:50:39.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:39 smithi110 ceph-mon[82130]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T13:50:40.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T13:50:40.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: osdmap e94: 6 total, 5 up, 6 in 2024-04-12T13:50:40.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: from='osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:50:40.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:50:40.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:40.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:40.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:40 smithi110 ceph-mon[82130]: pgmap v220: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: osdmap e94: 6 total, 5 up, 6 in 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: from='osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:40.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:40 smithi060 ceph-mon[94333]: pgmap v220: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-04-12T13:50:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:41 smithi110 ceph-mon[82130]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:50:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:41 smithi110 ceph-mon[82130]: osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652] boot 2024-04-12T13:50:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:41 smithi110 ceph-mon[82130]: osdmap e95: 6 total, 6 up, 6 in 2024-04-12T13:50:41.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:41 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:50:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:41 smithi060 ceph-mon[94333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T13:50:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:41 smithi060 ceph-mon[94333]: osd.5 [v2:172.21.15.110:6816/3606855652,v1:172.21.15.110:6817/3606855652] boot 2024-04-12T13:50:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:41 smithi060 ceph-mon[94333]: osdmap e95: 6 total, 6 up, 6 in 2024-04-12T13:50:41.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:41 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T13:50:42.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:42 smithi060 ceph-mon[94333]: osdmap e96: 6 total, 6 up, 6 in 2024-04-12T13:50:42.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:42 smithi060 ceph-mon[94333]: pgmap v223: 65 pgs: 5 peering, 16 active+undersized, 8 active+undersized+degraded, 36 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-04-12T13:50:42.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:42 smithi110 ceph-mon[82130]: osdmap e96: 6 total, 6 up, 6 in 2024-04-12T13:50:42.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:42 smithi110 ceph-mon[82130]: pgmap v223: 65 pgs: 5 peering, 16 active+undersized, 8 active+undersized+degraded, 36 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-04-12T13:50:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:43 smithi110 ceph-mon[82130]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 8 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:43.630 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:43 smithi060 ceph-mon[94333]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 8 pgs degraded (PG_DEGRADED) 2024-04-12T13:50:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:43.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:44.581 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:44 smithi110 ceph-mon[82130]: pgmap v224: 65 pgs: 5 peering, 12 active+undersized, 5 active+undersized+degraded, 43 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12/222 objects degraded (5.405%) 2024-04-12T13:50:44.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:44 smithi060 ceph-mon[94333]: pgmap v224: 65 pgs: 5 peering, 12 active+undersized, 5 active+undersized+degraded, 43 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12/222 objects degraded (5.405%) 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: pgmap v225: 65 pgs: 5 peering, 60 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: pgmap v226: 65 pgs: 5 peering, 60 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-12T13:50:46.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-12T13:50:46.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-12T13:50:46.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-12T13:50:46.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-12T13:50:46.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: pgmap v225: 65 pgs: 5 peering, 60 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: pgmap v226: 65 pgs: 5 peering, 60 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-12T13:50:46.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-12T13:50:46.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-12T13:50:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all osd 2024-04-12T13:50:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: Upgrade: Setting require_osd_release to 19 squid 2024-04-12T13:50:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/222 objects degraded (5.405%), 5 pgs degraded) 2024-04-12T13:50:47.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-12T13:50:47.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-12T13:50:47.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: osdmap e97: 6 total, 6 up, 6 in 2024-04-12T13:50:47.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.mwwohl"]}]: dispatch 2024-04-12T13:50:47.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all osd 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: Upgrade: Setting require_osd_release to 19 squid 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/222 objects degraded (5.405%), 5 pgs degraded) 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: osdmap e97: 6 total, 6 up, 6 in 2024-04-12T13:50:47.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.mwwohl"]}]: dispatch 2024-04-12T13:50:48.134 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:47 smithi060 ceph-mon[94333]: Upgrade: It appears safe to stop mds.cephfs.smithi060.mwwohl 2024-04-12T13:50:48.134 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:47 smithi060 ceph-mon[94333]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:47 smithi110 ceph-mon[82130]: Upgrade: It appears safe to stop mds.cephfs.smithi060.mwwohl 2024-04-12T13:50:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:47 smithi110 ceph-mon[82130]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: Upgrade: Updating mds.cephfs.smithi060.mwwohl 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: Deploying daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:50:49.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:49 smithi060 ceph-mon[94333]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:49.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: Upgrade: Updating mds.cephfs.smithi060.mwwohl 2024-04-12T13:50:49.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:49.983 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.mwwohl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:50:49.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:50:49.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: Deploying daemon mds.cephfs.smithi060.mwwohl on smithi060 2024-04-12T13:50:49.984 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:49 smithi110 ceph-mon[82130]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 -- 172.21.15.60:0/3466021669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fce40 msgr2=0x7f35640fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 --2- 172.21.15.60:0/3466021669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fce40 0x7f35640fd250 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3554004940 tx=0x7f3554009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 -- 172.21.15.60:0/3466021669 shutdown_connections 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 --2- 172.21.15.60:0/3466021669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fe040 0x7f35640fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 --2- 172.21.15.60:0/3466021669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fce40 0x7f35640fd250 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.165+0000 7f356ae00700 1 -- 172.21.15.60:0/3466021669 >> 172.21.15.60:0/3466021669 conn(0x7f35640f8590 msgr2=0x7f35640fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.166+0000 7f356ae00700 1 -- 172.21.15.60:0/3466021669 shutdown_connections 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.166+0000 7f356ae00700 1 -- 172.21.15.60:0/3466021669 wait complete. 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.167+0000 7f356ae00700 1 Processor -- start 2024-04-12T13:50:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.167+0000 7f356ae00700 1 -- start start 2024-04-12T13:50:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f356ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 0x7f356410da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f356ae00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f356ae00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356410e590 con 0x7f35640fe040 2024-04-12T13:50:51.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f356ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356410ede0 con 0x7f35640fce40 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f3563400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f3563400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42926/0 (socket says 172.21.15.60:42926) 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f3563400700 1 -- 172.21.15.60:0/3544367125 learned_addr learned my addr 172.21.15.60:0/3544367125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.168+0000 7f3563e00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 0x7f356410da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f3563400700 1 -- 172.21.15.60:0/3544367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 msgr2=0x7f356410da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f3563400700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 0x7f356410da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f3563400700 1 -- 172.21.15.60:0/3544367125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554005040 con 0x7f35640fe040 2024-04-12T13:50:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f3563e00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 0x7f356410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f3563400700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3550002a50 tx=0x7f35500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.169+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3550007cc0 con 0x7f35640fe040 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.170+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f355000f040 con 0x7f35640fe040 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.170+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355000db70 con 0x7f35640fe040 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.170+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356410f0c0 con 0x7f35640fe040 2024-04-12T13:50:51.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.170+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356410f600 con 0x7f35640fe040 2024-04-12T13:50:51.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.171+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356405f5f0 con 0x7f35640fe040 2024-04-12T13:50:51.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.173+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f355000dd10 con 0x7f35640fe040 2024-04-12T13:50:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.174+0000 7f355be00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 0x7f35480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.174+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f355008dff0 con 0x7f35640fe040 2024-04-12T13:50:51.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.174+0000 7f3563e00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 0x7f35480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.175+0000 7f3563e00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 0x7f35480710b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f355400b970 tx=0x7f3554009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:51.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.184+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f355005a850 con 0x7f35640fe040 2024-04-12T13:50:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.472+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f356410f9f0 con 0x7f354806ec00 2024-04-12T13:50:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.474+0000 7f355be00700 1 -- 172.21.15.60:0/3544367125 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f356410f9f0 con 0x7f354806ec00 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.477+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 msgr2=0x7f35480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.477+0000 7f356ae00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 0x7f35480710b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f355400b970 tx=0x7f3554009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.477+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 msgr2=0x7f356410df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.477+0000 7f356ae00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3550002a50 tx=0x7f35500046b0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 shutdown_connections 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f354806ec00 0x7f35480710b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35640fce40 0x7f356410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 --2- 172.21.15.60:0/3544367125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640fe040 0x7f356410df90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 >> 172.21.15.60:0/3544367125 conn(0x7f35640f8590 msgr2=0x7f35640f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 shutdown_connections 2024-04-12T13:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.478+0000 7f356ae00700 1 -- 172.21.15.60:0/3544367125 wait complete. 2024-04-12T13:50:51.496 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 -- 172.21.15.60:0/1820033328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 msgr2=0x7fbb580fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 --2- 172.21.15.60:0/1820033328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb580fe550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb44004940 tx=0x7fbb44009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 -- 172.21.15.60:0/1820033328 shutdown_connections 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 --2- 172.21.15.60:0/1820033328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb580fe550 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 --2- 172.21.15.60:0/1820033328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb580fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 -- 172.21.15.60:0/1820033328 >> 172.21.15.60:0/1820033328 conn(0x7fbb580f8530 msgr2=0x7fbb580fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 -- 172.21.15.60:0/1820033328 shutdown_connections 2024-04-12T13:50:51.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.631+0000 7fbb5d200700 1 -- 172.21.15.60:0/1820033328 wait complete. 2024-04-12T13:50:51.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 Processor -- start 2024-04-12T13:50:51.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 -- start start 2024-04-12T13:50:51.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb5810fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581107a0 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.632+0000 7fbb5d200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58110ff0 con 0x7fbb580fcef0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42944/0 (socket says 172.21.15.60:42944) 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 -- 172.21.15.60:0/2023622437 learned_addr learned my addr 172.21.15.60:0/2023622437 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 -- 172.21.15.60:0/2023622437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 msgr2=0x7fbb5810fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55e00700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb5810fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb5810fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55400700 1 -- 172.21.15.60:0/2023622437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44005040 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.633+0000 7fbb55e00700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb5810fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb55400700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009150 tx=0x7fbb44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb4400e040 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb4400bbf0 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58111270 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb4401c630 con 0x7fbb580fe0e0 2024-04-12T13:50:51.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.634+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb581117b0 con 0x7fbb580fe0e0 2024-04-12T13:50:51.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.635+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58101a70 con 0x7fbb580fe0e0 2024-04-12T13:50:51.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.636+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbb4400bd60 con 0x7fbb580fe0e0 2024-04-12T13:50:51.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.637+0000 7fbb4e000700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 0x7fbb3c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.637+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fbb4408fcb0 con 0x7fbb580fe0e0 2024-04-12T13:50:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.638+0000 7fbb55e00700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 0x7fbb3c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.638+0000 7fbb55e00700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 0x7fbb3c0710c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb48007fd0 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.642+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fbb4405c590 con 0x7fbb580fe0e0 2024-04-12T13:50:51.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.921+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb58111a90 con 0x7fbb3c06ec10 2024-04-12T13:50:51.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.923+0000 7fbb4e000700 1 -- 172.21.15.60:0/2023622437 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbb58111a90 con 0x7fbb3c06ec10 2024-04-12T13:50:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 msgr2=0x7fbb3c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 0x7fbb3c0710c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb48007fd0 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2024-04-12T13:50:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 msgr2=0x7fbb581101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:51.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009150 tx=0x7fbb44009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 shutdown_connections 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbb3c06ec10 0x7fbb3c0710c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb580fcef0 0x7fbb5810fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 --2- 172.21.15.60:0/2023622437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb580fe0e0 0x7fbb581101a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 >> 172.21.15.60:0/2023622437 conn(0x7fbb580f8530 msgr2=0x7fbb580f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 shutdown_connections 2024-04-12T13:50:51.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:51.926+0000 7fbb5d200700 1 -- 172.21.15.60:0/2023622437 wait complete. 2024-04-12T13:50:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 -- 172.21.15.60:0/4150039365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fdee0 msgr2=0x7fe25c0fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 --2- 172.21.15.60:0/4150039365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fdee0 0x7fe25c0fe350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe248004940 tx=0x7fe248009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T13:50:51.722+0000 7f4adbc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: osdmap e98: 6 total, 6 up, 6 in 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: Standby daemon mds.cephfs.smithi060.epmcph assigned to filesystem cephfs as rank 0 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:50:52.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:51 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:replay} 2 up:standby 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 -- 172.21.15.60:0/4150039365 shutdown_connections 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 --2- 172.21.15.60:0/4150039365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fdee0 0x7fe25c0fe350 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 --2- 172.21.15.60:0/4150039365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fcc30 0x7fe25c0fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.078+0000 7fe25b200700 1 -- 172.21.15.60:0/4150039365 >> 172.21.15.60:0/4150039365 conn(0x7fe25c0f83d0 msgr2=0x7fe25c0fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.079+0000 7fe25b200700 1 -- 172.21.15.60:0/4150039365 shutdown_connections 2024-04-12T13:50:52.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.079+0000 7fe25b200700 1 -- 172.21.15.60:0/4150039365 wait complete. 2024-04-12T13:50:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.080+0000 7fe25b200700 1 Processor -- start 2024-04-12T13:50:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.080+0000 7fe25b200700 1 -- start start 2024-04-12T13:50:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.080+0000 7fe25b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe25b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fdee0 0x7fe25c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe25b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c107aa0 con 0x7fe25c0fcc30 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe25b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c1082f0 con 0x7fe25c0fdee0 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe259e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe259e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42952/0 (socket says 172.21.15.60:42952) 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.081+0000 7fe259e00700 1 -- 172.21.15.60:0/2627787371 learned_addr learned my addr 172.21.15.60:0/2627787371 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.082+0000 7fe259e00700 1 -- 172.21.15.60:0/2627787371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fdee0 msgr2=0x7fe25c107450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T13:50:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.082+0000 7fe259400700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fdee0 0x7fe25c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.082+0000 7fe259e00700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fdee0 0x7fe25c107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.082+0000 7fe259e00700 1 -- 172.21.15.60:0/2627787371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248005040 con 0x7fe25c0fcc30 2024-04-12T13:50:52.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.083+0000 7fe259e00700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe24c002a50 tx=0x7fe24c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:52.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.083+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24c007cc0 con 0x7fe25c0fcc30 2024-04-12T13:50:52.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.083+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c1085d0 con 0x7fe25c0fcc30 2024-04-12T13:50:52.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.083+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c108b90 con 0x7fe25c0fcc30 2024-04-12T13:50:52.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.084+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe24c00f040 con 0x7fe25c0fcc30 2024-04-12T13:50:52.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.084+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24c009640 con 0x7fe25c0fcc30 2024-04-12T13:50:52.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.085+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c0052b0 con 0x7fe25c0fcc30 2024-04-12T13:50:52.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.087+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe24c00dd80 con 0x7fe25c0fcc30 2024-04-12T13:50:52.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.088+0000 7fe252000700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 0x7fe2400710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.089+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe24c08ec10 con 0x7fe25c0fcc30 2024-04-12T13:50:52.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.089+0000 7fe259400700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 0x7fe2400710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.090+0000 7fe259400700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 0x7fe2400710c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b970 tx=0x7fe248009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:52.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.092+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe24c057a10 con 0x7fe25c0fcc30 2024-04-12T13:50:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: osdmap e98: 6 total, 6 up, 6 in 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: Standby daemon mds.cephfs.smithi060.epmcph assigned to filesystem cephfs as rank 0 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:50:52.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:51 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:replay} 2 up:standby 2024-04-12T13:50:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.348+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe23c000bc0 con 0x7fe24006ec10 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.366+0000 7fe252000700 1 -- 172.21.15.60:0/2627787371 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe23c000bc0 con 0x7fe24006ec10 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 2m ago 19m 15.0M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (4m) 2m ago 20m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (4m) 15s ago 18m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 2m ago 19m - - 2024-04-12T13:50:52.368 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (12m) 2m ago 12m 14.6M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (12m) 2m ago 12m 134M - 17.2.7-845-g730340d7 036a68d49952 9a2994e95049 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (12m) 15s ago 12m 15.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (12m) 15s ago 12m 14.8M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (7m) 2m ago 21m 505M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (6m) 15s ago 18m 453M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (6m) 2m ago 21m 49.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (5m) 15s ago 18m 39.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 2m ago 19m 7780k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 15s ago 18m 7633k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (3m) 2m ago 17m 103M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (3m) 2m ago 16m 150M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (2m) 2m ago 16m 11.2M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (106s) 15s ago 15m 103M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (63s) 15s ago 14m 92.9M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:50:52.369 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (20s) 15s ago 14m 11.2M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:50:52.370 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 2m ago 19m 57.0M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:50:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 msgr2=0x7fe2400710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 0x7fe2400710c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b970 tx=0x7fe248009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 msgr2=0x7fe25c106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe24c002a50 tx=0x7fe24c0046b0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 shutdown_connections 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe24006ec10 0x7fe2400710c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25c0fcc30 0x7fe25c106f10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 --2- 172.21.15.60:0/2627787371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0fdee0 0x7fe25c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.368+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 >> 172.21.15.60:0/2627787371 conn(0x7fe25c0f83d0 msgr2=0x7fe25c0f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.369+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 shutdown_connections 2024-04-12T13:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.369+0000 7fe25b200700 1 -- 172.21.15.60:0/2627787371 wait complete. 2024-04-12T13:50:52.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 -- 172.21.15.60:0/3874300441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 msgr2=0x7f92200fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 --2- 172.21.15.60:0/3874300441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f92200fc150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9214004940 tx=0x7f9214009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 -- 172.21.15.60:0/3874300441 shutdown_connections 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 --2- 172.21.15.60:0/3874300441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92200fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 --2- 172.21.15.60:0/3874300441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f92200fc150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 -- 172.21.15.60:0/3874300441 >> 172.21.15.60:0/3874300441 conn(0x7f92200f74c0 msgr2=0x7f92200f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 -- 172.21.15.60:0/3874300441 shutdown_connections 2024-04-12T13:50:52.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.517+0000 7f9227400700 1 -- 172.21.15.60:0/3874300441 wait complete. 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.518+0000 7f9227400700 1 Processor -- start 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.518+0000 7f9227400700 1 -- start start 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9227400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9227400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92201101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9227400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220110830 con 0x7f92200fbd40 2024-04-12T13:50:52.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9227400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220111020 con 0x7f92200fcff0 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42984/0 (socket says 172.21.15.60:42984) 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 -- 172.21.15.60:0/1959534091 learned_addr learned my addr 172.21.15.60:0/1959534091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f921fe00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92201101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 -- 172.21.15.60:0/1959534091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 msgr2=0x7f92201101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92201101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.519+0000 7f9224a00700 1 -- 172.21.15.60:0/1959534091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214005040 con 0x7f92200fbd40 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f921fe00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92201101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f9224a00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f921400b3b0 tx=0x7f9214009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921400e040 con 0x7f92200fbd40 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9214004290 con 0x7f92200fbd40 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921401c630 con 0x7f92200fbd40 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92201112a0 con 0x7f92200fbd40 2024-04-12T13:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.520+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9220111860 con 0x7f92200fbd40 2024-04-12T13:50:52.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.522+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9220101980 con 0x7f92200fbd40 2024-04-12T13:50:52.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.523+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f921400bbf0 con 0x7f92200fbd40 2024-04-12T13:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.524+0000 7f921cc00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 0x7f92080710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.524+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f921408fd10 con 0x7f92200fbd40 2024-04-12T13:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.524+0000 7f921fe00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 0x7f92080710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.525+0000 7f921fe00700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 0x7f92080710c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f920c006fd0 tx=0x7f920c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.533+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f921405c580 con 0x7f92200fbd40 2024-04-12T13:50:52.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.905+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9220111b40 con 0x7f92200fbd40 2024-04-12T13:50:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.907+0000 7f921cc00700 1 -- 172.21.15.60:0/1959534091 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f9214013e60 con 0x7f92200fbd40 2024-04-12T13:50:52.909 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:50:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:50:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 3 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:50:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 3, 2024-04-12T13:50:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 10 2024-04-12T13:50:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:50:52.912 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:50:52.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 msgr2=0x7f92080710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 0x7f92080710c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f920c006fd0 tx=0x7f920c008040 comp rx=0 tx=0).stop 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 msgr2=0x7f922010fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f921400b3b0 tx=0x7f9214009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 shutdown_connections 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f920806ec10 0x7f92080710c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200fbd40 0x7f922010fc60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 --2- 172.21.15.60:0/1959534091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92200fcff0 0x7f92201101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 >> 172.21.15.60:0/1959534091 conn(0x7f92200f74c0 msgr2=0x7f9220065ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.911+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 shutdown_connections 2024-04-12T13:50:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:52.912+0000 7f9227400700 1 -- 172.21.15.60:0/1959534091 wait complete. 2024-04-12T13:50:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.082+0000 7f2040a00700 1 -- 172.21.15.60:0/1756200181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c070890 msgr2=0x7f203c070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.082+0000 7f2040a00700 1 --2- 172.21.15.60:0/1756200181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c070890 0x7f203c070d00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2028004940 tx=0x7f2028009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 -- 172.21.15.60:0/1756200181 shutdown_connections 2024-04-12T13:50:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 --2- 172.21.15.60:0/1756200181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c070890 0x7f203c070d00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 --2- 172.21.15.60:0/1756200181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c071e40 0x7f203c070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 -- 172.21.15.60:0/1756200181 >> 172.21.15.60:0/1756200181 conn(0x7f203c0f8530 msgr2=0x7f203c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 -- 172.21.15.60:0/1756200181 shutdown_connections 2024-04-12T13:50:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.083+0000 7f2040a00700 1 -- 172.21.15.60:0/1756200181 wait complete. 2024-04-12T13:50:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 Processor -- start 2024-04-12T13:50:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 -- start start 2024-04-12T13:50:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c070890 0x7f203c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c110770 con 0x7f203c071e40 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.084+0000 7f2040a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c110fc0 con 0x7f203c070890 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42992/0 (socket says 172.21.15.60:42992) 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 -- 172.21.15.60:0/677273902 learned_addr learned my addr 172.21.15.60:0/677273902 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039e00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c070890 0x7f203c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 -- 172.21.15.60:0/677273902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c070890 msgr2=0x7f203c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c070890 0x7f203c10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.085+0000 7f2039400700 1 -- 172.21.15.60:0/677273902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028005040 con 0x7f203c071e40 2024-04-12T13:50:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2039400700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f202800b3b0 tx=0x7f2028009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202800e040 con 0x7f203c071e40 2024-04-12T13:50:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2028004290 con 0x7f203c071e40 2024-04-12T13:50:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202801c630 con 0x7f203c071e40 2024-04-12T13:50:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c111240 con 0x7f203c071e40 2024-04-12T13:50:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.086+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c111780 con 0x7f203c071e40 2024-04-12T13:50:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.087+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c05f5f0 con 0x7f203c071e40 2024-04-12T13:50:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.089+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f202800bbf0 con 0x7f203c071e40 2024-04-12T13:50:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.089+0000 7f2032000700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 0x7f20200710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.090+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f202808fd60 con 0x7f203c071e40 2024-04-12T13:50:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.090+0000 7f2039e00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 0x7f20200710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.091+0000 7f2039e00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 0x7f20200710c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f202c009fd0 tx=0x7f202c009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:53.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.095+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f2028094070 con 0x7f203c071e40 2024-04-12T13:50:53.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:52 smithi060 ceph-mon[94333]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:53.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:52 smithi060 ceph-mon[94333]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:53.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:52 smithi110 ceph-mon[82130]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:53.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:52 smithi110 ceph-mon[82130]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:53.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.408+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f203c1113d0 con 0x7f203c071e40 2024-04-12T13:50:53.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.409+0000 7f2032000700 1 -- 172.21.15.60:0/677273902 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1704 (secure 0 0 0) 0x7f203c1113d0 con 0x7f203c071e40 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-04-12T13:50:53.412 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:50:51.730618+0000 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 98 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:50:53.413 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14458} 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{0:14458} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:53.414 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:50:53.415 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:50:53.415 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:53.415 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:50:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.411+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 msgr2=0x7f20200710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.411+0000 7f2040a00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 0x7f20200710c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f202c009fd0 tx=0x7f202c009f00 comp rx=0 tx=0).stop 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.411+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 msgr2=0x7f203c110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.411+0000 7f2040a00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f202800b3b0 tx=0x7f2028009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 shutdown_connections 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f202006ec10 0x7f20200710c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f203c070890 0x7f203c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 --2- 172.21.15.60:0/677273902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f203c071e40 0x7f203c110170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 >> 172.21.15.60:0/677273902 conn(0x7f203c0f8530 msgr2=0x7f203c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 shutdown_connections 2024-04-12T13:50:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.412+0000 7f2040a00700 1 -- 172.21.15.60:0/677273902 wait complete. 2024-04-12T13:50:53.417 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 -- 172.21.15.60:0/1257676206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 msgr2=0x7f237c0ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 --2- 172.21.15.60:0/1257676206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c0ffa60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f236c004940 tx=0x7f236c009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 -- 172.21.15.60:0/1257676206 shutdown_connections 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 --2- 172.21.15.60:0/1257676206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 0x7f237c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 --2- 172.21.15.60:0/1257676206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c0ffa60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.562+0000 7f2381c00700 1 -- 172.21.15.60:0/1257676206 >> 172.21.15.60:0/1257676206 conn(0x7f237c0f7450 msgr2=0x7f237c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.563+0000 7f2381c00700 1 -- 172.21.15.60:0/1257676206 shutdown_connections 2024-04-12T13:50:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.563+0000 7f2381c00700 1 -- 172.21.15.60:0/1257676206 wait complete. 2024-04-12T13:50:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 Processor -- start 2024-04-12T13:50:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 -- start start 2024-04-12T13:50:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 0x7f237c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c110860 con 0x7f237c066b00 2024-04-12T13:50:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.564+0000 7f2381c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c110fa0 con 0x7f237c0fffa0 2024-04-12T13:50:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43004/0 (socket says 172.21.15.60:43004) 2024-04-12T13:50:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 -- 172.21.15.60:0/731102954 learned_addr learned my addr 172.21.15.60:0/731102954 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237a000700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 0x7f237c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 -- 172.21.15.60:0/731102954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 msgr2=0x7f237c110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 0x7f237c110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.565+0000 7f237aa00700 1 -- 172.21.15.60:0/731102954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c005040 con 0x7f237c066b00 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f237aa00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f236c00b970 tx=0x7f236c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236c00e040 con 0x7f237c066b00 2024-04-12T13:50:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f236c00bbf0 con 0x7f237c066b00 2024-04-12T13:50:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c111220 con 0x7f237c066b00 2024-04-12T13:50:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236c01c630 con 0x7f237c066b00 2024-04-12T13:50:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.566+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c1117e0 con 0x7f237c066b00 2024-04-12T13:50:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.567+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c05f5f0 con 0x7f237c066b00 2024-04-12T13:50:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.569+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f236c00bd60 con 0x7f237c066b00 2024-04-12T13:50:53.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.570+0000 7f2372a00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 0x7f23600710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:53.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.570+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f236c090750 con 0x7f237c066b00 2024-04-12T13:50:53.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.570+0000 7f237a000700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 0x7f23600710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:53.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.571+0000 7f237a000700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 0x7f23600710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2368004990 tx=0x7f2368009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:53.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.578+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f236c05d080 con 0x7f237c066b00 2024-04-12T13:50:53.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.845+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f237c111c20 con 0x7f236006ec10 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.846+0000 7f2372a00700 1 -- 172.21.15.60:0/731102954 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f237c111c20 con 0x7f236006ec10 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:50:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "12/21 daemons upgraded", 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:50:53.850 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:50:53.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 msgr2=0x7f23600710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 0x7f23600710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2368004990 tx=0x7f2368009ee0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 msgr2=0x7f237c10fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f236c00b970 tx=0x7f236c009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 shutdown_connections 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236006ec10 0x7f23600710c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f237c066b00 0x7f237c10fd20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 --2- 172.21.15.60:0/731102954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f237c0fffa0 0x7f237c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.849+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 >> 172.21.15.60:0/731102954 conn(0x7f237c0f7450 msgr2=0x7f237c0fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.850+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 shutdown_connections 2024-04-12T13:50:53.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.850+0000 7f2381c00700 1 -- 172.21.15.60:0/731102954 wait complete. 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 -- 172.21.15.60:0/2001448782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780662f0 msgr2=0x7f7b780ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2001448782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780662f0 0x7f7b780ffa30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7b68004940 tx=0x7f7b68009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 -- 172.21.15.60:0/2001448782 shutdown_connections 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2001448782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780fff70 0x7f7b78102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2001448782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780662f0 0x7f7b780ffa30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 -- 172.21.15.60:0/2001448782 >> 172.21.15.60:0/2001448782 conn(0x7f7b780f74c0 msgr2=0x7f7b780f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 -- 172.21.15.60:0/2001448782 shutdown_connections 2024-04-12T13:50:54.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.997+0000 7f7b7d400700 1 -- 172.21.15.60:0/2001448782 wait complete. 2024-04-12T13:50:54.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.998+0000 7f7b7d400700 1 Processor -- start 2024-04-12T13:50:54.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b7d400700 1 -- start start 2024-04-12T13:50:54.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b7d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780662f0 0x7f7b780fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:54.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b7d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:54.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b7d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780fbee0 con 0x7f7b780fff70 2024-04-12T13:50:54.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b7d400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780fc050 con 0x7f7b780662f0 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:53.999+0000 7f7b6fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43030/0 (socket says 172.21.15.60:43030) 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 -- 172.21.15.60:0/2580185086 learned_addr learned my addr 172.21.15.60:0/2580185086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b76800700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780662f0 0x7f7b780fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 -- 172.21.15.60:0/2580185086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780662f0 msgr2=0x7f7b780fd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:54.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780662f0 0x7f7b780fd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 -- 172.21.15.60:0/2580185086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68005040 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.000+0000 7f7b6fe00700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c830 tx=0x7f7b60004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.001+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6000a760 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.001+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b6000ad90 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.001+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b780fc330 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.001+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b600113a0 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.001+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78115a90 con 0x7f7b780fff70 2024-04-12T13:50:54.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.002+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7805f5f0 con 0x7f7b780fff70 2024-04-12T13:50:54.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.003+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7b60012400 con 0x7f7b780fff70 2024-04-12T13:50:54.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.005+0000 7f7b6ea00700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 0x7f7b5c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:50:54.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.005+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f7b6008e8c0 con 0x7f7b780fff70 2024-04-12T13:50:54.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.005+0000 7f7b76800700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 0x7f7b5c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:50:54.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.006+0000 7f7b76800700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 0x7f7b5c0710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b68000c00 tx=0x7f7b68009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:50:54.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.009+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7b600576c0 con 0x7f7b780fff70 2024-04-12T13:50:54.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:53 smithi060 ceph-mon[94333]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:54.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:53 smithi060 ceph-mon[94333]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 1 op/s 2024-04-12T13:50:54.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:53 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1959534091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:54.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:53 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/677273902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:50:54.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:53 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:53 smithi110 ceph-mon[82130]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:53 smithi110 ceph-mon[82130]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 1 op/s 2024-04-12T13:50:54.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:53 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1959534091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:50:54.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:53 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/677273902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:50:54.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:53 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.327+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7b78115ed0 con 0x7f7b780fff70 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.328+0000 7f7b6ea00700 1 -- 172.21.15.60:0/2580185086 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+251 (secure 0 0 0) 0x7f7b6005ad80 con 0x7f7b780fff70 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-12T13:50:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: fs cephfs is degraded 2024-04-12T13:50:54.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.330+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 msgr2=0x7f7b5c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:54.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.330+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 0x7f7b5c0710c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b68000c00 tx=0x7f7b68009e30 comp rx=0 tx=0).stop 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.330+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 msgr2=0x7f7b780fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.330+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c830 tx=0x7f7b60004470 comp rx=0 tx=0).stop 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 shutdown_connections 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b5c06ec10 0x7f7b5c0710c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b780662f0 0x7f7b780fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 --2- 172.21.15.60:0/2580185086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b780fff70 0x7f7b780fb930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:50:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 >> 172.21.15.60:0/2580185086 conn(0x7f7b780f74c0 msgr2=0x7f7b780f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:50:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 shutdown_connections 2024-04-12T13:50:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:50:54.331+0000 7f7b7d400700 1 -- 172.21.15.60:0/2580185086 wait complete. 2024-04-12T13:50:55.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:54 smithi110 ceph-mon[82130]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:55.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:54 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:50:55.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:54 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2580185086' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:50:55.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:54 smithi060 ceph-mon[94333]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:50:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:54 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:50:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:54 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2580185086' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:50:56.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:55 smithi110 ceph-mon[82130]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-04-12T13:50:56.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:55 smithi060 ceph-mon[94333]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-04-12T13:50:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:57 smithi110 ceph-mon[82130]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-12T13:50:58.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:57 smithi060 ceph-mon[94333]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-12T13:50:59.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:59.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:59.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:50:59 smithi060 ceph-mon[94333]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-12T13:50:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:50:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:50:59.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:50:59 smithi110 ceph-mon[82130]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-12T13:51:01.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:01 smithi060 ceph-mon[94333]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00199998 2024-04-12T13:51:01.493 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:01 smithi060 ceph-mon[94333]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299998 2024-04-12T13:51:01.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:01 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:reconnect 2024-04-12T13:51:01.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:01 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:reconnect} 2 up:standby 2024-04-12T13:51:01.494 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:01 smithi060 ceph-mon[94333]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-12T13:51:01.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:01 smithi110 ceph-mon[82130]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00199998 2024-04-12T13:51:01.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:01 smithi110 ceph-mon[82130]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299998 2024-04-12T13:51:01.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:01 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:reconnect 2024-04-12T13:51:01.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:01 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:reconnect} 2 up:standby 2024-04-12T13:51:01.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:01 smithi110 ceph-mon[82130]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-12T13:51:02.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:02 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:rejoin 2024-04-12T13:51:02.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:02 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:rejoin} 2 up:standby 2024-04-12T13:51:02.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:02 smithi060 ceph-mon[94333]: daemon mds.cephfs.smithi060.epmcph is now active in filesystem cephfs as rank 0 2024-04-12T13:51:02.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:02 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:rejoin 2024-04-12T13:51:02.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:02 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.epmcph=up:rejoin} 2 up:standby 2024-04-12T13:51:02.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:02 smithi110 ceph-mon[82130]: daemon mds.cephfs.smithi060.epmcph is now active in filesystem cephfs as rank 0 2024-04-12T13:51:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:03 smithi060 ceph-mon[94333]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:51:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:03 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:active 2024-04-12T13:51:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:03 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.epmcph=up:active} 2 up:standby 2024-04-12T13:51:03.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:03 smithi060 ceph-mon[94333]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 92 B/s wr, 6 op/s 2024-04-12T13:51:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:03 smithi110 ceph-mon[82130]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:51:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:03 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] up:active 2024-04-12T13:51:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:03 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi060.epmcph=up:active} 2 up:standby 2024-04-12T13:51:03.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:03 smithi110 ceph-mon[82130]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 92 B/s wr, 6 op/s 2024-04-12T13:51:06.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:05 smithi060 ceph-mon[94333]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 341 B/s wr, 5 op/s 2024-04-12T13:51:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:05 smithi110 ceph-mon[82130]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 341 B/s wr, 5 op/s 2024-04-12T13:51:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 511 B/s wr, 6 op/s 2024-04-12T13:51:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:boot 2024-04-12T13:51:08.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.epmcph=up:active} 3 up:standby 2024-04-12T13:51:08.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:51:08.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:08.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:07 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 511 B/s wr, 6 op/s 2024-04-12T13:51:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:boot 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi060.epmcph=up:active} 3 up:standby 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:08.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:07 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:10.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:09 smithi060 ceph-mon[94333]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 511 B/s wr, 5 op/s 2024-04-12T13:51:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:09 smithi110 ceph-mon[82130]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 511 B/s wr, 5 op/s 2024-04-12T13:51:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:11 smithi060 ceph-mon[94333]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-12T13:51:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:11 smithi110 ceph-mon[82130]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-12T13:51:13.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:13 smithi060 ceph-mon[94333]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-12T13:51:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:13 smithi110 ceph-mon[82130]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-12T13:51:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:15.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:15 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:15 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:15.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:15 smithi110 ceph-mon[82130]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-12T13:51:16.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:15 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:15 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:16.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:15 smithi060 ceph-mon[94333]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-12T13:51:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:17 smithi060 ceph-mon[94333]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 4 op/s 2024-04-12T13:51:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:17 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:17 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:17 smithi110 ceph-mon[82130]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 4 op/s 2024-04-12T13:51:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:17 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:17 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:20.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:19 smithi060 ceph-mon[94333]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:19 smithi110 ceph-mon[82130]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:22.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:21 smithi060 ceph-mon[94333]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:21 smithi110 ceph-mon[82130]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: Detected new or changed devices on smithi060 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:23.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:23.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:23.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:23.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:23.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:23 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.epmcph"]}]: dispatch 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: Detected new or changed devices on smithi060 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:24.016 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:24.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:24.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:24.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:24.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:24.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:23 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.epmcph"]}]: dispatch 2024-04-12T13:51:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 -- 172.21.15.60:0/2693015000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 msgr2=0x7f6694070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 --2- 172.21.15.60:0/2693015000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694070460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6684004940 tx=0x7f6684009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 -- 172.21.15.60:0/2693015000 shutdown_connections 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 --2- 172.21.15.60:0/2693015000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 0x7f6694070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 --2- 172.21.15.60:0/2693015000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694070460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 -- 172.21.15.60:0/2693015000 >> 172.21.15.60:0/2693015000 conn(0x7f66940f8530 msgr2=0x7f66940fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 -- 172.21.15.60:0/2693015000 shutdown_connections 2024-04-12T13:51:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.506+0000 7f669b200700 1 -- 172.21.15.60:0/2693015000 wait complete. 2024-04-12T13:51:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 Processor -- start 2024-04-12T13:51:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 -- start start 2024-04-12T13:51:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 0x7f669410fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694110870 con 0x7f6694071f50 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.507+0000 7f669b200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694110fb0 con 0x7f66940709a0 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48328/0 (socket says 172.21.15.60:48328) 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 -- 172.21.15.60:0/2662550657 learned_addr learned my addr 172.21.15.60:0/2662550657 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693e00700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 0x7f669410fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 -- 172.21.15.60:0/2662550657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 msgr2=0x7f669410fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 0x7f669410fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.508+0000 7f6693400700 1 -- 172.21.15.60:0/2662550657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684005040 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f6693400700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f668000c830 tx=0x7f6680004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668000a760 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f668000ad90 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66800113a0 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694111290 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.509+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694111850 con 0x7f6694071f50 2024-04-12T13:51:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.510+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669405f5f0 con 0x7f6694071f50 2024-04-12T13:51:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.512+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6680012400 con 0x7f6694071f50 2024-04-12T13:51:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.513+0000 7f668be00700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 0x7f66780710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.513+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f668008e8c0 con 0x7f6694071f50 2024-04-12T13:51:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.513+0000 7f6693e00700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 0x7f66780710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.514+0000 7f6693e00700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 0x7f66780710c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6684009fd0 tx=0x7f6684009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:24.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.519+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f668005b1f0 con 0x7f6694071f50 2024-04-12T13:51:24.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.776+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6694111cf0 con 0x7f667806ec10 2024-04-12T13:51:24.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.778+0000 7f668be00700 1 -- 172.21.15.60:0/2662550657 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6694111cf0 con 0x7f667806ec10 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.781+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 msgr2=0x7f66780710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.781+0000 7f669b200700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 0x7f66780710c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6684009fd0 tx=0x7f6684009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.781+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 msgr2=0x7f6694110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.781+0000 7f669b200700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f668000c830 tx=0x7f6680004470 comp rx=0 tx=0).stop 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.781+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 shutdown_connections 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f667806ec10 0x7f66780710c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66940709a0 0x7f669410fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 --2- 172.21.15.60:0/2662550657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6694071f50 0x7f6694110270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 >> 172.21.15.60:0/2662550657 conn(0x7f66940f8530 msgr2=0x7f66940f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:24.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 shutdown_connections 2024-04-12T13:51:24.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.782+0000 7f669b200700 1 -- 172.21.15.60:0/2662550657 wait complete. 2024-04-12T13:51:24.799 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 -- 172.21.15.60:0/2076738537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00662f0 msgr2=0x7fd8a00ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/2076738537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00662f0 0x7fd8a00ffa30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd890004940 tx=0x7fd890009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 -- 172.21.15.60:0/2076738537 shutdown_connections 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/2076738537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00fff70 0x7fd8a0102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/2076738537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00662f0 0x7fd8a00ffa30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 -- 172.21.15.60:0/2076738537 >> 172.21.15.60:0/2076738537 conn(0x7fd8a00f74c0 msgr2=0x7fd8a00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:24.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.930+0000 7fd8a6c00700 1 -- 172.21.15.60:0/2076738537 shutdown_connections 2024-04-12T13:51:24.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.931+0000 7fd8a6c00700 1 -- 172.21.15.60:0/2076738537 wait complete. 2024-04-12T13:51:24.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.931+0000 7fd8a6c00700 1 Processor -- start 2024-04-12T13:51:24.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.931+0000 7fd8a6c00700 1 -- start start 2024-04-12T13:51:24.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd8a6c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00662f0 0x7fd8a010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd8a6c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd8a6c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0110790 con 0x7fd8a00fff70 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd8a6c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0110fe0 con 0x7fd8a00662f0 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd897e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd897e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48356/0 (socket says 172.21.15.60:48356) 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd897e00700 1 -- 172.21.15.60:0/1688464233 learned_addr learned my addr 172.21.15.60:0/1688464233 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.932+0000 7fd89fe00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00662f0 0x7fd8a010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd897e00700 1 -- 172.21.15.60:0/1688464233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00662f0 msgr2=0x7fd8a010fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd897e00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00662f0 0x7fd8a010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd897e00700 1 -- 172.21.15.60:0/1688464233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890005040 con 0x7fd8a00fff70 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd897e00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c830 tx=0x7fd888004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88800a760 con 0x7fd8a00fff70 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd88800ad90 con 0x7fd8a00fff70 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a01112c0 con 0x7fd8a00fff70 2024-04-12T13:51:24.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8880113a0 con 0x7fd8a00fff70 2024-04-12T13:51:24.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.933+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0111800 con 0x7fd8a00fff70 2024-04-12T13:51:24.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.934+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a00f8ff0 con 0x7fd8a00fff70 2024-04-12T13:51:24.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.936+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd888012400 con 0x7fd8a00fff70 2024-04-12T13:51:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.937+0000 7fd89cc00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 0x7fd8840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.937+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fd88808e980 con 0x7fd8a00fff70 2024-04-12T13:51:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.937+0000 7fd89fe00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 0x7fd8840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.938+0000 7fd89fe00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 0x7fd8840710b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd89000b970 tx=0x7fd890009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:24.941+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd88805b1f0 con 0x7fd8a00fff70 2024-04-12T13:51:24.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:24 smithi060 ceph-mon[94333]: Upgrade: It appears safe to stop mds.cephfs.smithi060.epmcph 2024-04-12T13:51:24.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:24 smithi110 ceph-mon[82130]: Upgrade: It appears safe to stop mds.cephfs.smithi060.epmcph 2024-04-12T13:51:25.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.194+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8a0111ad0 con 0x7fd88406ec00 2024-04-12T13:51:25.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.197+0000 7fd89cc00700 1 -- 172.21.15.60:0/1688464233 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd8a0111ad0 con 0x7fd88406ec00 2024-04-12T13:51:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 msgr2=0x7fd8840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 0x7fd8840710b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd89000b970 tx=0x7fd890009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 msgr2=0x7fd8a0110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c830 tx=0x7fd888004470 comp rx=0 tx=0).stop 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 shutdown_connections 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd88406ec00 0x7fd8840710b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a00662f0 0x7fd8a010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 --2- 172.21.15.60:0/1688464233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a00fff70 0x7fd8a0110190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 >> 172.21.15.60:0/1688464233 conn(0x7fd8a00f74c0 msgr2=0x7fd8a00fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.200+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 shutdown_connections 2024-04-12T13:51:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.201+0000 7fd8a6c00700 1 -- 172.21.15.60:0/1688464233 wait complete. 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 -- 172.21.15.60:0/1230018289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fe0e0 msgr2=0x7fe2f00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 --2- 172.21.15.60:0/1230018289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fe0e0 0x7fe2f00fe550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8004940 tx=0x7fe2d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 -- 172.21.15.60:0/1230018289 shutdown_connections 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 --2- 172.21.15.60:0/1230018289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fe0e0 0x7fe2f00fe550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 --2- 172.21.15.60:0/1230018289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f00fcef0 0x7fe2f00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 -- 172.21.15.60:0/1230018289 >> 172.21.15.60:0/1230018289 conn(0x7fe2f00f8530 msgr2=0x7fe2f00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 -- 172.21.15.60:0/1230018289 shutdown_connections 2024-04-12T13:51:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.361+0000 7fe2f6800700 1 -- 172.21.15.60:0/1230018289 wait complete. 2024-04-12T13:51:25.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.362+0000 7fe2f6800700 1 Processor -- start 2024-04-12T13:51:25.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.362+0000 7fe2f6800700 1 -- start start 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.362+0000 7fe2f6800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.362+0000 7fe2f6800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f00fe0e0 0x7fe2f01101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2f6800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f01107a0 con 0x7fe2f00fcef0 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2f6800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0110ff0 con 0x7fe2f00fe0e0 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48382/0 (socket says 172.21.15.60:48382) 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 -- 172.21.15.60:0/20562746 learned_addr learned my addr 172.21.15.60:0/20562746 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 -- 172.21.15.60:0/20562746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f00fe0e0 msgr2=0x7fe2f01101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f00fe0e0 0x7fe2f01101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 -- 172.21.15.60:0/20562746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8005040 con 0x7fe2f00fcef0 2024-04-12T13:51:25.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.363+0000 7fe2ef400700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0001ce0 tx=0x7fe2e0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:25.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.364+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e000db60 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.364+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2e000f040 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.364+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2e0009790 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.364+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f01112d0 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.364+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f0111810 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.365+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0101a70 con 0x7fe2f00fcef0 2024-04-12T13:51:25.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.366+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe2e0007920 con 0x7fe2f00fcef0 2024-04-12T13:51:25.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.367+0000 7fe2e7e00700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 0x7fe2d40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.367+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe2e008e490 con 0x7fe2f00fcef0 2024-04-12T13:51:25.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.367+0000 7fe2e6a00700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 0x7fe2d40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:25.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.368+0000 7fe2e6a00700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 0x7fe2d40710c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8004f90 tx=0x7fe2d8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:25.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.372+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe2e005ad30 con 0x7fe2f00fcef0 2024-04-12T13:51:25.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.623+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2f0111a30 con 0x7fe2d406ec10 2024-04-12T13:51:25.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.653+0000 7fe2e7e00700 1 -- 172.21.15.60:0/20562746 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe2f0111a30 con 0x7fe2d406ec10 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (9m) 10s ago 20m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (4m) 10s ago 20m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (4m) 48s ago 19m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 10s ago 19m - - 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (12m) 10s ago 12m 85.3M - 17.2.7-845-g730340d7 036a68d49952 021a9350310e 2024-04-12T13:51:25.656 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (22s) 10s ago 13m 11.0M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (13m) 48s ago 13m 15.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (12m) 48s ago 12m 14.8M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (8m) 10s ago 22m 508M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (7m) 48s ago 18m 453M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (6m) 10s ago 22m 55.6M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (5m) 48s ago 18m 39.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 10s ago 20m 7856k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 48s ago 19m 7633k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 10s ago 17m 112M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (3m) 10s ago 17m 195M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 10s ago 16m 124M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:51:25.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (2m) 48s ago 16m 103M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:51:25.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (96s) 48s ago 15m 92.9M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:51:25.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (53s) 48s ago 14m 11.2M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:51:25.658 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (7m) 10s ago 19m 59.7M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:51:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.656+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 msgr2=0x7fe2d40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.656+0000 7fe2f6800700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 0x7fe2d40710c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8004f90 tx=0x7fe2d8009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 msgr2=0x7fe2f010fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0001ce0 tx=0x7fe2e0009e60 comp rx=0 tx=0).stop 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 shutdown_connections 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe2d406ec10 0x7fe2d40710c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2f00fcef0 0x7fe2f010fc60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 --2- 172.21.15.60:0/20562746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2f00fe0e0 0x7fe2f01101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 >> 172.21.15.60:0/20562746 conn(0x7fe2f00f8530 msgr2=0x7fe2f00f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 shutdown_connections 2024-04-12T13:51:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.657+0000 7fe2f6800700 1 -- 172.21.15.60:0/20562746 wait complete. 2024-04-12T13:51:25.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 -- 172.21.15.60:0/3930343381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0709a0 msgr2=0x7f269c070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 --2- 172.21.15.60:0/3930343381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0709a0 0x7f269c070e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2688004940 tx=0x7f2688009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 -- 172.21.15.60:0/3930343381 shutdown_connections 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 --2- 172.21.15.60:0/3930343381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0709a0 0x7f269c070e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 --2- 172.21.15.60:0/3930343381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c071f50 0x7f269c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 -- 172.21.15.60:0/3930343381 >> 172.21.15.60:0/3930343381 conn(0x7f269c0f8530 msgr2=0x7f269c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 -- 172.21.15.60:0/3930343381 shutdown_connections 2024-04-12T13:51:25.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.817+0000 7f26a3000700 1 -- 172.21.15.60:0/3930343381 wait complete. 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.818+0000 7f26a3000700 1 Processor -- start 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.818+0000 7f26a3000700 1 -- start start 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f26a3000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0709a0 0x7f269c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f26a3000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f26a3000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c110780 con 0x7f269c071f50 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f26a3000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c110fd0 con 0x7f269c0709a0 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f269b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f269b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48396/0 (socket says 172.21.15.60:48396) 2024-04-12T13:51:25.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f269b400700 1 -- 172.21.15.60:0/866598564 learned_addr learned my addr 172.21.15.60:0/866598564 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:25.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.819+0000 7f269be00700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0709a0 0x7f269c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:25.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f269b400700 1 -- 172.21.15.60:0/866598564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0709a0 msgr2=0x7f269c10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:25.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f269b400700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0709a0 0x7f269c10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f269b400700 1 -- 172.21.15.60:0/866598564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688005040 con 0x7f269c071f50 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f269b400700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f268800b3b0 tx=0x7f2688009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268800e040 con 0x7f269c071f50 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c111250 con 0x7f269c071f50 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2688004290 con 0x7f269c071f50 2024-04-12T13:51:25.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.820+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268801c630 con 0x7f269c071f50 2024-04-12T13:51:25.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.821+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c111790 con 0x7f269c071f50 2024-04-12T13:51:25.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.822+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c05f5f0 con 0x7f269c071f50 2024-04-12T13:51:25.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.823+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f268800bbf0 con 0x7f269c071f50 2024-04-12T13:51:25.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.824+0000 7f2693e00700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 0x7f26800710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:25.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.824+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f268808fd60 con 0x7f269c071f50 2024-04-12T13:51:25.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.825+0000 7f269be00700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 0x7f26800710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:25.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.825+0000 7f269be00700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 0x7f26800710c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f268c009fd0 tx=0x7f268c009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:25.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:25.829+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f2688094070 con 0x7f269c071f50 2024-04-12T13:51:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:25 smithi060 ceph-mon[94333]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:25 smithi060 ceph-mon[94333]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:25 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:25 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:51:25.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:25 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:25 smithi110 ceph-mon[82130]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:25 smithi110 ceph-mon[82130]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:25 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:25 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.epmcph", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:51:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:25 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:26.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.173+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f269c111b60 con 0x7f269c071f50 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.175+0000 7f2693e00700 1 -- 172.21.15.60:0/866598564 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f268805c5d0 con 0x7f269c071f50 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:26.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 3, 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 1 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 3, 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 11 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:51:26.178 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 msgr2=0x7f26800710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 0x7f26800710c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f268c009fd0 tx=0x7f268c009f00 comp rx=0 tx=0).stop 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 msgr2=0x7f269c110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f268800b3b0 tx=0x7f2688009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 shutdown_connections 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f268006ec10 0x7f26800710c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f269c0709a0 0x7f269c10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 --2- 172.21.15.60:0/866598564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c071f50 0x7f269c110180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.177+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 >> 172.21.15.60:0/866598564 conn(0x7f269c0f8530 msgr2=0x7f269c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:26.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.178+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 shutdown_connections 2024-04-12T13:51:26.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.178+0000 7f26a3000700 1 -- 172.21.15.60:0/866598564 wait complete. 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 -- 172.21.15.60:0/3470869881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080fdd60 msgr2=0x7f31081001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 --2- 172.21.15.60:0/3470869881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080fdd60 0x7f31081001e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f30f4004940 tx=0x7f30f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 -- 172.21.15.60:0/3470869881 shutdown_connections 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 --2- 172.21.15.60:0/3470869881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080fdd60 0x7f31081001e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 --2- 172.21.15.60:0/3470869881 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080662f0 0x7f31080fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.335+0000 7f310fa00700 1 -- 172.21.15.60:0/3470869881 >> 172.21.15.60:0/3470869881 conn(0x7f31080f74c0 msgr2=0x7f31080f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.336+0000 7f310fa00700 1 -- 172.21.15.60:0/3470869881 shutdown_connections 2024-04-12T13:51:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.336+0000 7f310fa00700 1 -- 172.21.15.60:0/3470869881 wait complete. 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.336+0000 7f310fa00700 1 Processor -- start 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310fa00700 1 -- start start 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310fa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 0x7f31081145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310fa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108114ba0 con 0x7f31080662f0 2024-04-12T13:51:26.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108115380 con 0x7f31080fdd60 2024-04-12T13:51:26.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48414/0 (socket says 172.21.15.60:48414) 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.337+0000 7f310d000700 1 -- 172.21.15.60:0/850321498 learned_addr learned my addr 172.21.15.60:0/850321498 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f3107e00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 0x7f31081145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f310d000700 1 -- 172.21.15.60:0/850321498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 msgr2=0x7f31081145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f310d000700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 0x7f31081145a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f310d000700 1 -- 172.21.15.60:0/850321498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4005040 con 0x7f31080662f0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f3107e00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 0x7f31081145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f310d000700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30fc001d00 tx=0x7f30fc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc007d10 con 0x7f31080662f0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30fc007e70 con 0x7f31080662f0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.338+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3108115660 con 0x7f31080662f0 2024-04-12T13:51:26.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.339+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc014640 con 0x7f31080662f0 2024-04-12T13:51:26.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.339+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108115ba0 con 0x7f31080662f0 2024-04-12T13:51:26.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.340+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310805f5f0 con 0x7f31080662f0 2024-04-12T13:51:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.341+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f30fc00e900 con 0x7f31080662f0 2024-04-12T13:51:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.342+0000 7f3104c00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 0x7f30f00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.342+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f30fc08e6b0 con 0x7f31080662f0 2024-04-12T13:51:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.342+0000 7f3107e00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 0x7f30f00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.343+0000 7f3107e00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 0x7f30f00710c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f30f400b7a0 tx=0x7f30f4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.346+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f30fc05aff0 con 0x7f31080662f0 2024-04-12T13:51:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.653+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3108115f10 con 0x7f31080662f0 2024-04-12T13:51:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.654+0000 7f3104c00700 1 -- 172.21.15.60:0/850321498 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1892 (secure 0 0 0) 0x7f30fc05ab80 con 0x7f31080662f0 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:e19 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 18 2024-04-12T13:51:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:51:02.251047+0000 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 98 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:51:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14458} 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 14458 members: 14458 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{0:14458} state up:active seq 192 join_fscid=1 addr [v2:172.21.15.60:6828/2341264545,v1:172.21.15.60:6829/2341264545] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:51:26.659 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:24277} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:51:26.660 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{-1:34456} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 msgr2=0x7f30f00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 0x7f30f00710c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f30f400b7a0 tx=0x7f30f4009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 msgr2=0x7f3108114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f30fc001d00 tx=0x7f30fc009e40 comp rx=0 tx=0).stop 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 shutdown_connections 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f30f006ec10 0x7f30f00710c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31080662f0 0x7f3108114060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 --2- 172.21.15.60:0/850321498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31080fdd60 0x7f31081145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 >> 172.21.15.60:0/850321498 conn(0x7f31080f74c0 msgr2=0x7f31080f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 shutdown_connections 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.657+0000 7f310fa00700 1 -- 172.21.15.60:0/850321498 wait complete. 2024-04-12T13:51:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 19 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 -- 172.21.15.60:0/4024654031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 msgr2=0x7f0f64104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 --2- 172.21.15.60:0/4024654031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64104b40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c004940 tx=0x7f0f4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 -- 172.21.15.60:0/4024654031 shutdown_connections 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 --2- 172.21.15.60:0/4024654031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64104b40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 --2- 172.21.15.60:0/4024654031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 -- 172.21.15.60:0/4024654031 >> 172.21.15.60:0/4024654031 conn(0x7f0f64072640 msgr2=0x7f0f64074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 -- 172.21.15.60:0/4024654031 shutdown_connections 2024-04-12T13:51:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.809+0000 7f0f69200700 1 -- 172.21.15.60:0/4024654031 wait complete. 2024-04-12T13:51:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.810+0000 7f0f69200700 1 Processor -- start 2024-04-12T13:51:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.811+0000 7f0f69200700 1 -- start start 2024-04-12T13:51:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.811+0000 7f0f69200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.811+0000 7f0f69200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.811+0000 7f0f69200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64114b20 con 0x7f0f641046d0 2024-04-12T13:51:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.811+0000 7f0f69200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641194c0 con 0x7f0f64103420 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48430/0 (socket says 172.21.15.60:48430) 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 -- 172.21.15.60:0/1133993767 learned_addr learned my addr 172.21.15.60:0/1133993767 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f61e00700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 -- 172.21.15.60:0/1133993767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 msgr2=0x7f0f64113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 -- 172.21.15.60:0/1133993767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c005040 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f61e00700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.812+0000 7f0f59400700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009150 tx=0x7f0f4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.813+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c00e040 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.813+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f4c00bcc0 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.813+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4c01c630 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.813+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f641196c0 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.813+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64119c00 con 0x7f0f641046d0 2024-04-12T13:51:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.814+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6404c710 con 0x7f0f641046d0 2024-04-12T13:51:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.815+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0f4c013420 con 0x7f0f641046d0 2024-04-12T13:51:26.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.816+0000 7f0f5aa00700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 0x7f0f480710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:26.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.816+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f0f4c08f530 con 0x7f0f641046d0 2024-04-12T13:51:26.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.816+0000 7f0f61e00700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 0x7f0f480710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:26.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.817+0000 7f0f61e00700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 0x7f0f480710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007fd0 tx=0x7f0f540074f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:26.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:26.821+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f0f4c05be60 con 0x7f0f641046d0 2024-04-12T13:51:27.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.078+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f64108970 con 0x7f0f4806ec00 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: Upgrade: Updating mds.cephfs.smithi060.epmcph 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: Deploying daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/866598564' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:27.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:26 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/850321498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.081+0000 7f0f5aa00700 1 -- 172.21.15.60:0/1133993767 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0f64108970 con 0x7f0f4806ec00 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:51:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "13/21 daemons upgraded", 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:51:27.085 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:51:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.084+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 msgr2=0x7f0f480710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.084+0000 7f0f69200700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 0x7f0f480710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007fd0 tx=0x7f0f540074f0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.084+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 msgr2=0x7f0f64114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.084+0000 7f0f69200700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009150 tx=0x7f0f4c009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 shutdown_connections 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0f4806ec00 0x7f0f480710b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64103420 0x7f0f64113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 --2- 172.21.15.60:0/1133993767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f641046d0 0x7f0f64114490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 >> 172.21.15.60:0/1133993767 conn(0x7f0f64072640 msgr2=0x7f0f64073ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 shutdown_connections 2024-04-12T13:51:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.085+0000 7f0f69200700 1 -- 172.21.15.60:0/1133993767 wait complete. 2024-04-12T13:51:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: Upgrade: Updating mds.cephfs.smithi060.epmcph 2024-04-12T13:51:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: Deploying daemon mds.cephfs.smithi060.epmcph on smithi060 2024-04-12T13:51:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/866598564' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:27.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:26 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/850321498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:51:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 -- 172.21.15.60:0/3233617201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 msgr2=0x7f3f98104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3233617201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98104b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f80004940 tx=0x7f3f80009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 -- 172.21.15.60:0/3233617201 shutdown_connections 2024-04-12T13:51:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3233617201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98104b40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3233617201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 -- 172.21.15.60:0/3233617201 >> 172.21.15.60:0/3233617201 conn(0x7f3f98072640 msgr2=0x7f3f98074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 -- 172.21.15.60:0/3233617201 shutdown_connections 2024-04-12T13:51:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.237+0000 7f3f9d600700 1 -- 172.21.15.60:0/3233617201 wait complete. 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 Processor -- start 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 -- start start 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98114a90 con 0x7f3f981046d0 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.238+0000 7f3f9d600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98114c00 con 0x7f3f98103420 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48444/0 (socket says 172.21.15.60:48444) 2024-04-12T13:51:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 -- 172.21.15.60:0/3662206901 learned_addr learned my addr 172.21.15.60:0/3662206901 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 -- 172.21.15.60:0/3662206901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 msgr2=0x7f3f98113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96a00700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 -- 172.21.15.60:0/3662206901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80005040 con 0x7f3f981046d0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96a00700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.239+0000 7f3f96000700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000b3b0 tx=0x7f3f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.240+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8000e040 con 0x7f3f981046d0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.240+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f80004290 con 0x7f3f981046d0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.240+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f8001c630 con 0x7f3f981046d0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.240+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98119600 con 0x7f3f981046d0 2024-04-12T13:51:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.240+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98119bc0 con 0x7f3f981046d0 2024-04-12T13:51:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.241+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9804c710 con 0x7f3f981046d0 2024-04-12T13:51:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.242+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3f8000bbf0 con 0x7f3f981046d0 2024-04-12T13:51:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.243+0000 7f3f8ea00700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 0x7f3f7c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.243+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f3f8008fd60 con 0x7f3f981046d0 2024-04-12T13:51:27.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.244+0000 7f3f96a00700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 0x7f3f7c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:27.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.245+0000 7f3f96a00700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 0x7f3f7c0710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f88007fd0 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:27.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.248+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f3f80094070 con 0x7f3f981046d0 2024-04-12T13:51:27.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.594+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3f9811a070 con 0x7f3f981046d0 2024-04-12T13:51:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.594+0000 7f3f8ea00700 1 -- 172.21.15.60:0/3662206901 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f3f8005c5d0 con 0x7f3f981046d0 2024-04-12T13:51:27.597 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:51:27.597 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:51:27.597 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 msgr2=0x7f3f7c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 0x7f3f7c0710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f88007fd0 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 msgr2=0x7f3f98114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000b3b0 tx=0x7f3f80009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 shutdown_connections 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3f7c06ec00 0x7f3f7c0710b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f98103420 0x7f3f98113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 --2- 172.21.15.60:0/3662206901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f981046d0 0x7f3f98114490 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.597+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 >> 172.21.15.60:0/3662206901 conn(0x7f3f98072640 msgr2=0x7f3f98073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.598+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 shutdown_connections 2024-04-12T13:51:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:27.598+0000 7f3f9d600700 1 -- 172.21.15.60:0/3662206901 wait complete. 2024-04-12T13:51:27.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:27 smithi060 ceph-mon[94333]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:27.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:27 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3662206901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:51:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:27 smithi110 ceph-mon[82130]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:27 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3662206901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:51:28.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T13:51:28.526+0000 7f4adbc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: osdmap e99: 6 total, 6 up, 6 in 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: Standby daemon mds.cephfs.smithi110.getdvx assigned to filesystem cephfs as rank 0 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:51:28.931 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:28 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:replay} 2 up:standby 2024-04-12T13:51:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:51:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:51:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: osdmap e99: 6 total, 6 up, 6 in 2024-04-12T13:51:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: Standby daemon mds.cephfs.smithi110.getdvx assigned to filesystem cephfs as rank 0 2024-04-12T13:51:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:51:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:51:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:28 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:replay} 2 up:standby 2024-04-12T13:51:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:29 smithi060 ceph-mon[94333]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:51:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:29 smithi110 ceph-mon[82130]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:51:32.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:31 smithi060 ceph-mon[94333]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-12T13:51:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:31 smithi110 ceph-mon[82130]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-04-12T13:51:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:33 smithi060 ceph-mon[94333]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-04-12T13:51:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:33 smithi110 ceph-mon[82130]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 9.4 MiB/s rd, 3 op/s 2024-04-12T13:51:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:35 smithi060 ceph-mon[94333]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T13:51:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:35 smithi110 ceph-mon[82130]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T13:51:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:37 smithi060 ceph-mon[94333]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-04-12T13:51:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:37 smithi110 ceph-mon[82130]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-04-12T13:51:39.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00399993 2024-04-12T13:51:39.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00499992 2024-04-12T13:51:39.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:reconnect 2024-04-12T13:51:39.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:reconnect} 2 up:standby 2024-04-12T13:51:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:rejoin 2024-04-12T13:51:39.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:38 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:rejoin} 2 up:standby 2024-04-12T13:51:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00399993 2024-04-12T13:51:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00499992 2024-04-12T13:51:39.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:reconnect 2024-04-12T13:51:39.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:reconnect} 2 up:standby 2024-04-12T13:51:39.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:rejoin 2024-04-12T13:51:39.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:38 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.getdvx=up:rejoin} 2 up:standby 2024-04-12T13:51:39.918 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:39 smithi060 ceph-mon[94333]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:51:39.918 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:39 smithi060 ceph-mon[94333]: daemon mds.cephfs.smithi110.getdvx is now active in filesystem cephfs as rank 0 2024-04-12T13:51:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:39 smithi110 ceph-mon[82130]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:51:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:39 smithi110 ceph-mon[82130]: daemon mds.cephfs.smithi110.getdvx is now active in filesystem cephfs as rank 0 2024-04-12T13:51:41.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:51:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:active 2024-04-12T13:51:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi110.getdvx=up:active} 2 up:standby 2024-04-12T13:51:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] up:active 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi110.getdvx=up:active} 2 up:standby 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:42.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:41 smithi060 ceph-mon[94333]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-12T13:51:42.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:41 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] up:boot 2024-04-12T13:51:42.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:41 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi110.getdvx=up:active} 3 up:standby 2024-04-12T13:51:42.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:41 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:51:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:41 smithi110 ceph-mon[82130]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-12T13:51:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:41 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] up:boot 2024-04-12T13:51:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:41 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi110.getdvx=up:active} 3 up:standby 2024-04-12T13:51:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:41 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:51:43.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:43 smithi060 ceph-mon[94333]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-12T13:51:43.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:44.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:43 smithi110 ceph-mon[82130]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-12T13:51:44.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:46.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:45 smithi060 ceph-mon[94333]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-12T13:51:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:45 smithi110 ceph-mon[82130]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-12T13:51:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:47 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:47 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:47.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:47 smithi060 ceph-mon[94333]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T13:51:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:47 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:47 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:47.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:47 smithi110 ceph-mon[82130]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 820 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T13:51:49.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:49.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:49 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:49.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:49 smithi060 ceph-mon[94333]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 956 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:51:49.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:49.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:49 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:49.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:49 smithi110 ceph-mon[82130]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 956 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:51:51.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:51 smithi060 ceph-mon[94333]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 274 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:51:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:51 smithi110 ceph-mon[82130]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 274 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:51:53.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:53 smithi060 ceph-mon[94333]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-12T13:51:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:53 smithi110 ceph-mon[82130]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-12T13:51:55.369 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.369 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 813 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi110.getdvx"]}]: dispatch 2024-04-12T13:51:55.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:55 smithi110 ceph-mon[82130]: Upgrade: It appears safe to stop mds.cephfs.smithi110.getdvx 2024-04-12T13:51:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 813 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi110.getdvx"]}]: dispatch 2024-04-12T13:51:55.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:55 smithi060 ceph-mon[94333]: Upgrade: It appears safe to stop mds.cephfs.smithi110.getdvx 2024-04-12T13:51:57.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:57 smithi110 ceph-mon[82130]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:57.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:57.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:51:57.388 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:57 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:57.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:57 smithi060 ceph-mon[94333]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:57.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:51:57.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.getdvx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:51:57.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:57 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 -- 172.21.15.60:0/3139338538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc0708f0 msgr2=0x7fa2fc070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 --2- 172.21.15.60:0/3139338538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc0708f0 0x7fa2fc070d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8004940 tx=0x7fa2e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 -- 172.21.15.60:0/3139338538 shutdown_connections 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 --2- 172.21.15.60:0/3139338538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc0708f0 0x7fa2fc070d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 --2- 172.21.15.60:0/3139338538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.771+0000 7fa303e00700 1 -- 172.21.15.60:0/3139338538 >> 172.21.15.60:0/3139338538 conn(0x7fa2fc0f8530 msgr2=0x7fa2fc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.772+0000 7fa303e00700 1 -- 172.21.15.60:0/3139338538 shutdown_connections 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.772+0000 7fa303e00700 1 -- 172.21.15.60:0/3139338538 wait complete. 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 Processor -- start 2024-04-12T13:51:57.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 -- start start 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc114710 0x7fa2fc115560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc114bd0 con 0x7fa2fc071ea0 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa303e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc114d10 con 0x7fa2fc114710 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.773+0000 7fa301400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52290/0 (socket says 172.21.15.60:52290) 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 -- 172.21.15.60:0/4093748202 learned_addr learned my addr 172.21.15.60:0/4093748202 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa300a00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc114710 0x7fa2fc115560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:57.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 -- 172.21.15.60:0/4093748202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc114710 msgr2=0x7fa2fc115560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc114710 0x7fa2fc115560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 -- 172.21.15.60:0/4093748202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8005040 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.774+0000 7fa301400700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0002a80 tx=0x7fa2f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.775+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f0007cc0 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.775+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f000f040 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.775+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f000da30 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.775+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc115bc0 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.775+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc116150 con 0x7fa2fc071ea0 2024-04-12T13:51:57.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.776+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2fc10c700 con 0x7fa2fc071ea0 2024-04-12T13:51:57.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.777+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa2f000db90 con 0x7fa2fc071ea0 2024-04-12T13:51:57.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.778+0000 7fa2f9600700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 0x7fa2e40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:57.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.778+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fa2f008e6d0 con 0x7fa2fc071ea0 2024-04-12T13:51:57.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.778+0000 7fa300a00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 0x7fa2e40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:57.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.779+0000 7fa300a00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 0x7fa2e40710c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b970 tx=0x7fa2e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:57.784+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fa2f005ae60 con 0x7fa2fc071ea0 2024-04-12T13:51:58.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.033+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2fc0ffee0 con 0x7fa2e406ec10 2024-04-12T13:51:58.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.035+0000 7fa2f9600700 1 -- 172.21.15.60:0/4093748202 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa2fc0ffee0 con 0x7fa2e406ec10 2024-04-12T13:51:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 msgr2=0x7fa2e40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 0x7fa2e40710c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800b970 tx=0x7fa2e8009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 msgr2=0x7fa2fc1141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0002a80 tx=0x7fa2f0004600 comp rx=0 tx=0).stop 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 shutdown_connections 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa2e406ec10 0x7fa2e40710c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2fc071ea0 0x7fa2fc1141d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 --2- 172.21.15.60:0/4093748202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2fc114710 0x7fa2fc115560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 >> 172.21.15.60:0/4093748202 conn(0x7fa2fc0f8530 msgr2=0x7fa2fc0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 shutdown_connections 2024-04-12T13:51:58.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.038+0000 7fa303e00700 1 -- 172.21.15.60:0/4093748202 wait complete. 2024-04-12T13:51:58.055 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:51:58.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 -- 172.21.15.60:0/39342989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fdff0 msgr2=0x7fac480fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 --2- 172.21.15.60:0/39342989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fdff0 0x7fac480fe460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac30004940 tx=0x7fac30009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 -- 172.21.15.60:0/39342989 shutdown_connections 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 --2- 172.21.15.60:0/39342989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fdff0 0x7fac480fe460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 --2- 172.21.15.60:0/39342989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fce80 0x7fac480fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 -- 172.21.15.60:0/39342989 >> 172.21.15.60:0/39342989 conn(0x7fac480f8580 msgr2=0x7fac480fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 -- 172.21.15.60:0/39342989 shutdown_connections 2024-04-12T13:51:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.199+0000 7fac4e200700 1 -- 172.21.15.60:0/39342989 wait complete. 2024-04-12T13:51:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.200+0000 7fac4e200700 1 Processor -- start 2024-04-12T13:51:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.200+0000 7fac4e200700 1 -- start start 2024-04-12T13:51:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.200+0000 7fac4e200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.200+0000 7fac4e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fdff0 0x7fac4810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac4e200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4810e450 con 0x7fac480fce80 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac4e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4810e5c0 con 0x7fac480fdff0 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52306/0 (socket says 172.21.15.60:52306) 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 -- 172.21.15.60:0/2793846462 learned_addr learned my addr 172.21.15.60:0/2793846462 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac3fe00700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fdff0 0x7fac4810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 -- 172.21.15.60:0/2793846462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fdff0 msgr2=0x7fac4810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fdff0 0x7fac4810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.201+0000 7fac47400700 1 -- 172.21.15.60:0/2793846462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30005040 con 0x7fac480fce80 2024-04-12T13:51:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac47400700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c830 tx=0x7fac38004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3800a760 con 0x7fac480fce80 2024-04-12T13:51:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac3800ad90 con 0x7fac480fce80 2024-04-12T13:51:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac380113a0 con 0x7fac480fce80 2024-04-12T13:51:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac48112fc0 con 0x7fac480fce80 2024-04-12T13:51:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.202+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac48113550 con 0x7fac480fce80 2024-04-12T13:51:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.203+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4804c710 con 0x7fac480fce80 2024-04-12T13:51:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.205+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fac38012400 con 0x7fac480fce80 2024-04-12T13:51:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.205+0000 7fac3f400700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 0x7fac2c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.206+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7fac3808e9e0 con 0x7fac480fce80 2024-04-12T13:51:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.206+0000 7fac3fe00700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 0x7fac2c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.207+0000 7fac3fe00700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 0x7fac2c0710b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac30004f90 tx=0x7fac30009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.211+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fac3805b1f0 con 0x7fac480fce80 2024-04-12T13:51:58.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:58 smithi110 ceph-mon[82130]: Upgrade: Updating mds.cephfs.smithi110.getdvx 2024-04-12T13:51:58.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:58 smithi110 ceph-mon[82130]: Deploying daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:51:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:58 smithi060 ceph-mon[94333]: Upgrade: Updating mds.cephfs.smithi110.getdvx 2024-04-12T13:51:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:58 smithi060 ceph-mon[94333]: Deploying daemon mds.cephfs.smithi110.getdvx on smithi110 2024-04-12T13:51:58.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.456+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac48102400 con 0x7fac2c06ec00 2024-04-12T13:51:58.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.459+0000 7fac3f400700 1 -- 172.21.15.60:0/2793846462 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fac48102400 con 0x7fac2c06ec00 2024-04-12T13:51:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 msgr2=0x7fac2c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 0x7fac2c0710b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac30004f90 tx=0x7fac30009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 msgr2=0x7fac4810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c830 tx=0x7fac38004470 comp rx=0 tx=0).stop 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 shutdown_connections 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac2c06ec00 0x7fac2c0710b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac480fce80 0x7fac4810d910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 --2- 172.21.15.60:0/2793846462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac480fdff0 0x7fac4810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 >> 172.21.15.60:0/2793846462 conn(0x7fac480f8580 msgr2=0x7fac480f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:58.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.462+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 shutdown_connections 2024-04-12T13:51:58.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.463+0000 7fac4e200700 1 -- 172.21.15.60:0/2793846462 wait complete. 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 -- 172.21.15.60:0/2187830714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa900ff000 msgr2=0x7faa900ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 --2- 172.21.15.60:0/2187830714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa900ff000 0x7faa900ff410 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faa80004940 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 -- 172.21.15.60:0/2187830714 shutdown_connections 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 --2- 172.21.15.60:0/2187830714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa901002b0 0x7faa90100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 --2- 172.21.15.60:0/2187830714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa900ff000 0x7faa900ff410 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 -- 172.21.15.60:0/2187830714 >> 172.21.15.60:0/2187830714 conn(0x7faa900fa950 msgr2=0x7faa900fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:58.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 -- 172.21.15.60:0/2187830714 shutdown_connections 2024-04-12T13:51:58.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.614+0000 7faa96c00700 1 -- 172.21.15.60:0/2187830714 wait complete. 2024-04-12T13:51:58.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.615+0000 7faa96c00700 1 Processor -- start 2024-04-12T13:51:58.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.615+0000 7faa96c00700 1 -- start start 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa96c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa900ff000 0x7faa9010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa96c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa96c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa90110700 con 0x7faa901002b0 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa96c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa90110f50 con 0x7faa900ff000 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52326/0 (socket says 172.21.15.60:52326) 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 -- 172.21.15.60:0/8818374 learned_addr learned my addr 172.21.15.60:0/8818374 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8fe00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa900ff000 0x7faa9010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 -- 172.21.15.60:0/8818374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa900ff000 msgr2=0x7faa9010fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa900ff000 0x7faa9010fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.616+0000 7faa8f400700 1 -- 172.21.15.60:0/8818374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80005040 con 0x7faa901002b0 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa8f400700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00eb40 tx=0x7faa7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:58.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c007cc0 con 0x7faa901002b0 2024-04-12T13:51:58.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa7c00f040 con 0x7faa901002b0 2024-04-12T13:51:58.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa901111d0 con 0x7faa901002b0 2024-04-12T13:51:58.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c00ca10 con 0x7faa901002b0 2024-04-12T13:51:58.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.617+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa90111710 con 0x7faa901002b0 2024-04-12T13:51:58.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.618+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9005f5f0 con 0x7faa901002b0 2024-04-12T13:51:58.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.620+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faa7c00cb70 con 0x7faa901002b0 2024-04-12T13:51:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.621+0000 7faa87e00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 0x7faa740710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.621+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7faa7c08e4a0 con 0x7faa901002b0 2024-04-12T13:51:58.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.621+0000 7faa8fe00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 0x7faa740710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:58.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.622+0000 7faa8fe00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 0x7faa740710c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b0d0 tx=0x7faa80009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:58.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.626+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7faa7c05ad80 con 0x7faa901002b0 2024-04-12T13:51:58.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.859+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa90111a90 con 0x7faa7406ec10 2024-04-12T13:51:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.880+0000 7faa87e00700 1 -- 172.21.15.60:0/8818374 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faa90111a90 con 0x7faa7406ec10 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (9m) 12s ago 20m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (5m) 12s ago 21m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (5m) 81s ago 19m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 12s ago 20m - - 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (19s) 12s ago 13m 10.9M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (55s) 12s ago 13m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (13m) 81s ago 13m 15.0M - 17.2.7-845-g730340d7 036a68d49952 d1dadb2e6fa1 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (13m) 81s ago 13m 14.8M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:51:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (8m) 12s ago 22m 509M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (7m) 81s ago 19m 453M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (7m) 12s ago 22m 56.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (6m) 81s ago 19m 39.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (10m) 12s ago 21m 8024k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 81s ago 19m 7633k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 12s ago 18m 112M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 12s ago 17m 197M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 12s ago 17m 120M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (2m) 81s ago 16m 103M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (2m) 81s ago 16m 92.9M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:51:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (86s) 81s ago 15m 11.2M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:51:58.884 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (7m) 12s ago 20m 59.9M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:51:58.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 msgr2=0x7faa740710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 0x7faa740710c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b0d0 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 msgr2=0x7faa90110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00eb40 tx=0x7faa7c00b040 comp rx=0 tx=0).stop 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 shutdown_connections 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7faa7406ec10 0x7faa740710c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa900ff000 0x7faa9010fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 --2- 172.21.15.60:0/8818374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa901002b0 0x7faa90110100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 >> 172.21.15.60:0/8818374 conn(0x7faa900fa950 msgr2=0x7faa900fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.883+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 shutdown_connections 2024-04-12T13:51:58.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:58.884+0000 7faa96c00700 1 -- 172.21.15.60:0/8818374 wait complete. 2024-04-12T13:51:59.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 -- 172.21.15.60:0/1974048773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c0ff070 msgr2=0x7f2e6c0ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1974048773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c0ff480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c004940 tx=0x7f2e5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:59.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 -- 172.21.15.60:0/1974048773 shutdown_connections 2024-04-12T13:51:59.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1974048773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c100320 0x7f2e6c100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1974048773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c0ff480 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.036+0000 7f2e72e00700 1 -- 172.21.15.60:0/1974048773 >> 172.21.15.60:0/1974048773 conn(0x7f2e6c0fa950 msgr2=0x7f2e6c0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:59.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.037+0000 7f2e72e00700 1 -- 172.21.15.60:0/1974048773 shutdown_connections 2024-04-12T13:51:59.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.037+0000 7f2e72e00700 1 -- 172.21.15.60:0/1974048773 wait complete. 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.037+0000 7f2e72e00700 1 Processor -- start 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e72e00700 1 -- start start 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e72e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c10fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e72e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e72e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c110750 con 0x7f2e6c100320 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e72e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c110fa0 con 0x7f2e6c0ff070 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e63e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e63e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52354/0 (socket says 172.21.15.60:52354) 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.038+0000 7f2e63e00700 1 -- 172.21.15.60:0/1242795362 learned_addr learned my addr 172.21.15.60:0/1242795362 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e6be00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c10fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e63e00700 1 -- 172.21.15.60:0/1242795362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c0ff070 msgr2=0x7f2e6c10fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e63e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c10fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e63e00700 1 -- 172.21.15.60:0/1242795362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c005040 con 0x7f2e6c100320 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e63e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c830 tx=0x7f2e54004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5400a760 con 0x7f2e6c100320 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e5400ad90 con 0x7f2e6c100320 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e540113a0 con 0x7f2e6c100320 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.039+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c111280 con 0x7f2e6c100320 2024-04-12T13:51:59.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.040+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c1117c0 con 0x7f2e6c100320 2024-04-12T13:51:59.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.041+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c05f5f0 con 0x7f2e6c100320 2024-04-12T13:51:59.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.042+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2e54012400 con 0x7f2e6c100320 2024-04-12T13:51:59.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.043+0000 7f2e68c00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 0x7f2e500710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.043+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f2e5408e920 con 0x7f2e6c100320 2024-04-12T13:51:59.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.043+0000 7f2e6be00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 0x7f2e500710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.044+0000 7f2e6be00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 0x7f2e500710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00b970 tx=0x7f2e5c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.048+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f2e5405b1f0 con 0x7f2e6c100320 2024-04-12T13:51:59.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:59 smithi110 ceph-mon[82130]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:59 smithi110 ceph-mon[82130]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:59.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:59.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:59 smithi110 ceph-mon[82130]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:51:59 smithi110 ceph-mon[82130]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.374+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e6c111be0 con 0x7f2e6c100320 2024-04-12T13:51:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.375+0000 7f2e68c00700 1 -- 172.21.15.60:0/1242795362 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f2e5405ad80 con 0x7f2e6c100320 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:51:59.377 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2, 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 17.2.7-845-g730340d7 (730340d76f41e9c8e5e38d06015fbcce8efa14be) quincy (stable)": 2, 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 12 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:51:59.378 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:51:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.378+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 msgr2=0x7f2e500710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.378+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 0x7f2e500710c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00b970 tx=0x7f2e5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.378+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 msgr2=0x7f2e6c110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.378+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c830 tx=0x7f2e54004470 comp rx=0 tx=0).stop 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 shutdown_connections 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2e5006ec10 0x7f2e500710c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e6c0ff070 0x7f2e6c10fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 --2- 172.21.15.60:0/1242795362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e6c100320 0x7f2e6c110150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 >> 172.21.15.60:0/1242795362 conn(0x7f2e6c0fa950 msgr2=0x7f2e6c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 shutdown_connections 2024-04-12T13:51:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.379+0000 7f2e72e00700 1 -- 172.21.15.60:0/1242795362 wait complete. 2024-04-12T13:51:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:59 smithi060 ceph-mon[94333]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:59 smithi060 ceph-mon[94333]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:51:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:51:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:59 smithi060 ceph-mon[94333]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:51:59 smithi060 ceph-mon[94333]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:51:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.528+0000 7f3c15a00700 1 -- 172.21.15.60:0/1960784759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 msgr2=0x7f3c100ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.528+0000 7f3c15a00700 1 --2- 172.21.15.60:0/1960784759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c100ff310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3c00004940 tx=0x7f3c00009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 -- 172.21.15.60:0/1960784759 shutdown_connections 2024-04-12T13:51:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 --2- 172.21.15.60:0/1960784759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 0x7f3c101004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 --2- 172.21.15.60:0/1960784759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c100ff310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 -- 172.21.15.60:0/1960784759 >> 172.21.15.60:0/1960784759 conn(0x7f3c100fa790 msgr2=0x7f3c100fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 -- 172.21.15.60:0/1960784759 shutdown_connections 2024-04-12T13:51:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.529+0000 7f3c15a00700 1 -- 172.21.15.60:0/1960784759 wait complete. 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 Processor -- start 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 -- start start 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 0x7f3c1010ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101105a0 con 0x7f3c100fef00 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c15a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10110df0 con 0x7f3c10100070 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c0fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c0fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48680/0 (socket says 172.21.15.60:48680) 2024-04-12T13:51:59.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.530+0000 7f3c0fe00700 1 -- 172.21.15.60:0/146232756 learned_addr learned my addr 172.21.15.60:0/146232756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c07e00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 0x7f3c1010ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c0fe00700 1 -- 172.21.15.60:0/146232756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 msgr2=0x7f3c1010ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c0fe00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 0x7f3c1010ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c0fe00700 1 -- 172.21.15.60:0/146232756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00005040 con 0x7f3c100fef00 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c0fe00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b3b0 tx=0x7f3c00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.531+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0000e040 con 0x7f3c100fef00 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.532+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c00004290 con 0x7f3c100fef00 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.532+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0001c630 con 0x7f3c100fef00 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.532+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c10111070 con 0x7f3c100fef00 2024-04-12T13:51:59.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.532+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c101115b0 con 0x7f3c100fef00 2024-04-12T13:51:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.533+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c100fe290 con 0x7f3c100fef00 2024-04-12T13:51:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.534+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3c0000bbf0 con 0x7f3c100fef00 2024-04-12T13:51:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.535+0000 7f3c0cc00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 0x7f3bf40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.535+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f3c0008fdc0 con 0x7f3c100fef00 2024-04-12T13:51:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.535+0000 7f3c07e00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 0x7f3bf40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.536+0000 7f3c07e00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 0x7f3bf40710b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8004990 tx=0x7f3bf8009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.540+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f3c00093030 con 0x7f3c100fef00 2024-04-12T13:51:59.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.812+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c10111980 con 0x7f3c100fef00 2024-04-12T13:51:59.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.813+0000 7f3c0cc00700 1 -- 172.21.15.60:0/146232756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1893 (secure 0 0 0) 0x7f3c0005c5d0 con 0x7f3c100fef00 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:e25 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:51:59.816 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 24 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:51:39.795722+0000 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 99 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:51:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24277} 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 24277 members: 24277 2024-04-12T13:51:59.818 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{0:24277} state up:active seq 202 join_fscid=1 addr [v2:172.21.15.110:6824/382915624,v1:172.21.15.110:6825/382915624] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:24293} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{-1:34456} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:51:59.819 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 msgr2=0x7f3bf40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 0x7f3bf40710b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8004990 tx=0x7f3bf8009ee0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 msgr2=0x7f3c1010fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b3b0 tx=0x7f3c00009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 shutdown_connections 2024-04-12T13:51:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3bf406ec00 0x7f3bf40710b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c100fef00 0x7f3c1010fa60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 --2- 172.21.15.60:0/146232756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c10100070 0x7f3c1010ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 >> 172.21.15.60:0/146232756 conn(0x7f3c100fa790 msgr2=0x7f3c100fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 shutdown_connections 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.817+0000 7f3c15a00700 1 -- 172.21.15.60:0/146232756 wait complete. 2024-04-12T13:51:59.821 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2024-04-12T13:51:59.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 -- 172.21.15.60:0/3456039449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d500ff000 msgr2=0x7f0d500ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 --2- 172.21.15.60:0/3456039449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d500ff000 0x7f0d500ff410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d44004940 tx=0x7f0d44009e30 comp rx=0 tx=0).stop 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 -- 172.21.15.60:0/3456039449 shutdown_connections 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 --2- 172.21.15.60:0/3456039449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d501002b0 0x7f0d50100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 --2- 172.21.15.60:0/3456039449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d500ff000 0x7f0d500ff410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 -- 172.21.15.60:0/3456039449 >> 172.21.15.60:0/3456039449 conn(0x7f0d500fa950 msgr2=0x7f0d500fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 -- 172.21.15.60:0/3456039449 shutdown_connections 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.975+0000 7f0d57e00700 1 -- 172.21.15.60:0/3456039449 wait complete. 2024-04-12T13:51:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.976+0000 7f0d57e00700 1 Processor -- start 2024-04-12T13:51:59.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d57e00700 1 -- start start 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d57e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 0x7f0d5010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d57e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 0x7f0d50110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d57e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50110650 con 0x7f0d501002b0 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d57e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d501107c0 con 0x7f0d500ff000 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.977+0000 7f0d54a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 0x7f0d50110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d54a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 0x7f0d50110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48700/0 (socket says 172.21.15.60:48700) 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d54a00700 1 -- 172.21.15.60:0/2343232903 learned_addr learned my addr 172.21.15.60:0/2343232903 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:51:59.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d55400700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 0x7f0d5010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d55400700 1 -- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 msgr2=0x7f0d50110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:51:59.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d55400700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 0x7f0d50110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:51:59.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d55400700 1 -- 172.21.15.60:0/2343232903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44005040 con 0x7f0d500ff000 2024-04-12T13:51:59.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.978+0000 7f0d55400700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 0x7f0d5010fb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400b970 tx=0x7f0d44009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.979+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4400e040 con 0x7f0d500ff000 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.979+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d44004290 con 0x7f0d500ff000 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.979+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4401c3f0 con 0x7f0d500ff000 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.979+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d501151c0 con 0x7f0d500ff000 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.979+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d50115780 con 0x7f0d500ff000 2024-04-12T13:51:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.980+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5004c710 con 0x7f0d500ff000 2024-04-12T13:51:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.982+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0d4400bbf0 con 0x7f0d500ff000 2024-04-12T13:51:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.982+0000 7f0d4d600700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 0x7f0d380710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:51:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.983+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6786+0+0 (secure 0 0 0) 0x7f0d44090750 con 0x7f0d500ff000 2024-04-12T13:51:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.983+0000 7f0d54a00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 0x7f0d380710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:51:59.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.983+0000 7f0d54a00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 0x7f0d380710b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0041d0 tx=0x7f0d3c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:51:59.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:51:59.988+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f0d4405cf60 con 0x7f0d500ff000 2024-04-12T13:52:00.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.264+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d50104590 con 0x7f0d3806ec00 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.265+0000 7f0d4d600700 1 -- 172.21.15.60:0/2343232903 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0d50104590 con 0x7f0d3806ec00 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:52:00.267 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:52:00.268 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "14/21 daemons upgraded", 2024-04-12T13:52:00.268 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T13:52:00.268 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:52:00.268 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:52:00.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.268+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 msgr2=0x7f0d380710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.268+0000 7f0d57e00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 0x7f0d380710b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0041d0 tx=0x7f0d3c00b040 comp rx=0 tx=0).stop 2024-04-12T13:52:00.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.268+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 msgr2=0x7f0d5010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 0x7f0d5010fb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400b970 tx=0x7f0d44009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:00.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 shutdown_connections 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0d3806ec00 0x7f0d380710b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d500ff000 0x7f0d5010fb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 --2- 172.21.15.60:0/2343232903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d501002b0 0x7f0d50110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 >> 172.21.15.60:0/2343232903 conn(0x7f0d500fa950 msgr2=0x7f0d500fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 shutdown_connections 2024-04-12T13:52:00.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.269+0000 7f0d57e00700 1 -- 172.21.15.60:0/2343232903 wait complete. 2024-04-12T13:52:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.415+0000 7f2414c00700 1 -- 172.21.15.60:0/596797354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 msgr2=0x7f2410103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.415+0000 7f2414c00700 1 --2- 172.21.15.60:0/596797354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410103830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2400004940 tx=0x7f2400009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 -- 172.21.15.60:0/596797354 shutdown_connections 2024-04-12T13:52:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 --2- 172.21.15.60:0/596797354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 0x7f2410104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 --2- 172.21.15.60:0/596797354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410103830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 -- 172.21.15.60:0/596797354 >> 172.21.15.60:0/596797354 conn(0x7f2410072640 msgr2=0x7f2410074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 -- 172.21.15.60:0/596797354 shutdown_connections 2024-04-12T13:52:00.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:00 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1242795362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:00.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:00 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/146232756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:52:00.418 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:00 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T13:52:00.171+0000 7f4adbc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.416+0000 7f2414c00700 1 -- 172.21.15.60:0/596797354 wait complete. 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 Processor -- start 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 -- start start 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 0x7f2410114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410114a20 con 0x7f2410103420 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.417+0000 7f2414c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410114b90 con 0x7f24101046d0 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48710/0 (socket says 172.21.15.60:48710) 2024-04-12T13:52:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 -- 172.21.15.60:0/2262050347 learned_addr learned my addr 172.21.15.60:0/2262050347 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240d400700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 0x7f2410114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 -- 172.21.15.60:0/2262050347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 msgr2=0x7f2410114420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 0x7f2410114420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 -- 172.21.15.60:0/2262050347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400005040 con 0x7f2410103420 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.418+0000 7f240de00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2400013870 tx=0x7f2400009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.419+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240000e070 con 0x7f2410103420 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.419+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f240001c400 con 0x7f2410103420 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.419+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2410119590 con 0x7f2410103420 2024-04-12T13:52:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.419+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240000b630 con 0x7f2410103420 2024-04-12T13:52:00.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.419+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2410119a70 con 0x7f2410103420 2024-04-12T13:52:00.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.420+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241004c710 con 0x7f2410103420 2024-04-12T13:52:00.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.421+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f240001c570 con 0x7f2410103420 2024-04-12T13:52:00.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.422+0000 7f2406000700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 0x7f23f40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.422+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6872+0+0 (secure 0 0 0) 0x7f2400090230 con 0x7f2410103420 2024-04-12T13:52:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.423+0000 7f240d400700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 0x7f23f40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.423+0000 7f240d400700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 0x7f23f40710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23fc004600 tx=0x7f23fc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:00.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.427+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f240005c970 con 0x7f2410103420 2024-04-12T13:52:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:00 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1242795362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:00 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/146232756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:52:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.739+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2410119e70 con 0x7f2410103420 2024-04-12T13:52:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.740+0000 7f2406000700 1 -- 172.21.15.60:0/2262050347 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+251 (secure 0 0 0) 0x7f240005c500 con 0x7f2410103420 2024-04-12T13:52:00.742 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-12T13:52:00.742 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:52:00.742 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:52:00.742 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-12T13:52:00.742 INFO:teuthology.orchestra.run.smithi060.stdout: fs cephfs is degraded 2024-04-12T13:52:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.743+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 msgr2=0x7f23f40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.743+0000 7f2414c00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 0x7f23f40710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23fc004600 tx=0x7f23fc00b040 comp rx=0 tx=0).stop 2024-04-12T13:52:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.743+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 msgr2=0x7f2410113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.743+0000 7f2414c00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2400013870 tx=0x7f2400009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 shutdown_connections 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f23f406ec00 0x7f23f40710b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2410103420 0x7f2410113ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 --2- 172.21.15.60:0/2262050347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24101046d0 0x7f2410114420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 >> 172.21.15.60:0/2262050347 conn(0x7f2410072640 msgr2=0x7f2410073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.744+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 shutdown_connections 2024-04-12T13:52:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:00.745+0000 7f2414c00700 1 -- 172.21.15.60:0/2262050347 wait complete. 2024-04-12T13:52:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:52:01.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: osdmap e100: 6 total, 6 up, 6 in 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: Standby daemon mds.cephfs.smithi110.zqdflr assigned to filesystem cephfs as rank 0 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:replay} 2 up:standby 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: from='client.44311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:01.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:01 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2262050347' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:52:01.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: osdmap e100: 6 total, 6 up, 6 in 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: Standby daemon mds.cephfs.smithi110.zqdflr assigned to filesystem cephfs as rank 0 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:replay} 2 up:standby 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: from='client.44311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:01.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:01 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2262050347' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:52:03.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:03 smithi060 ceph-mon[94333]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 0 op/s 2024-04-12T13:52:03.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:03 smithi110 ceph-mon[82130]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 0 op/s 2024-04-12T13:52:05.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:05 smithi060 ceph-mon[94333]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-04-12T13:52:05.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:05 smithi110 ceph-mon[82130]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 2 op/s 2024-04-12T13:52:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:07 smithi060 ceph-mon[94333]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T13:52:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:07 smithi110 ceph-mon[82130]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T13:52:09.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:09 smithi110 ceph-mon[82130]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:09.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:09 smithi060 ceph-mon[94333]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:11.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:11 smithi110 ceph-mon[82130]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:52:11.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:11 smithi110 ceph-mon[82130]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00299995 2024-04-12T13:52:11.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:11 smithi110 ceph-mon[82130]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299995 2024-04-12T13:52:11.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:11 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:reconnect 2024-04-12T13:52:11.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:11 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:reconnect} 2 up:standby 2024-04-12T13:52:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:11 smithi060 ceph-mon[94333]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:52:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:11 smithi060 ceph-mon[94333]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00299995 2024-04-12T13:52:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:11 smithi060 ceph-mon[94333]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299995 2024-04-12T13:52:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:11 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:reconnect 2024-04-12T13:52:11.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:11 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:reconnect} 2 up:standby 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:rejoin 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:rejoin} 2 up:standby 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: daemon mds.cephfs.smithi110.zqdflr is now active in filesystem cephfs as rank 0 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:12.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:12 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:rejoin 2024-04-12T13:52:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi110.zqdflr=up:rejoin} 2 up:standby 2024-04-12T13:52:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: daemon mds.cephfs.smithi110.zqdflr is now active in filesystem cephfs as rank 0 2024-04-12T13:52:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:12.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:12 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:52:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] up:boot 2024-04-12T13:52:13.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:active 2024-04-12T13:52:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi110.zqdflr=up:active} 3 up:standby 2024-04-12T13:52:13.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] up:boot 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6826/2604118377,v1:172.21.15.110:6827/2604118377] up:active 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi110.zqdflr=up:active} 3 up:standby 2024-04-12T13:52:13.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:52:14.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:14.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:15.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:15 smithi110 ceph-mon[82130]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-12T13:52:15.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:15 smithi060 ceph-mon[94333]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-12T13:52:17.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:17 smithi060 ceph-mon[94333]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-12T13:52:17.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:17 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:17.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:17 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:17.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:17 smithi110 ceph-mon[82130]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-12T13:52:17.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:17 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:17.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:17 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:19 smithi110 ceph-mon[82130]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-12T13:52:19.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:19.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:19 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:19.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:19 smithi060 ceph-mon[94333]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-12T13:52:19.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:19.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:19 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:21.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:21 smithi110 ceph-mon[82130]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:21.732 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:21 smithi060 ceph-mon[94333]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:23.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:23 smithi060 ceph-mon[94333]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:23.697 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:23 smithi110 ceph-mon[82130]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: Detected new or changed devices on smithi110 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-04-12T13:52:25.151 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.152 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi110.zqdflr"]}]: dispatch 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: Detected new or changed devices on smithi110 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:52:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:25.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi110.zqdflr"]}]: dispatch 2024-04-12T13:52:25.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:25 smithi110 ceph-mon[82130]: Upgrade: It appears safe to stop mds.cephfs.smithi110.zqdflr 2024-04-12T13:52:26.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:25 smithi060 ceph-mon[94333]: Upgrade: It appears safe to stop mds.cephfs.smithi110.zqdflr 2024-04-12T13:52:27.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:26 smithi060 ceph-mon[94333]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 314 B/s rd, 4.9 KiB/s wr, 2 op/s 2024-04-12T13:52:27.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:27.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:52:27.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:26 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:26 smithi110 ceph-mon[82130]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 314 B/s rd, 4.9 KiB/s wr, 2 op/s 2024-04-12T13:52:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.zqdflr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T13:52:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:26 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:28.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:27 smithi060 ceph-mon[94333]: Upgrade: Updating mds.cephfs.smithi110.zqdflr 2024-04-12T13:52:28.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:27 smithi060 ceph-mon[94333]: Deploying daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:52:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:27 smithi110 ceph-mon[82130]: Upgrade: Updating mds.cephfs.smithi110.zqdflr 2024-04-12T13:52:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:27 smithi110 ceph-mon[82130]: Deploying daemon mds.cephfs.smithi110.zqdflr on smithi110 2024-04-12T13:52:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:28 smithi060 ceph-mon[94333]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-04-12T13:52:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:28 smithi110 ceph-mon[82130]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-04-12T13:52:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:29.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T13:52:29.503+0000 7f4adbc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: osdmap e101: 6 total, 6 up, 6 in 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: Standby daemon mds.cephfs.smithi060.mwwohl assigned to filesystem cephfs as rank 0 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:52:30.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:29 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:replay} 2 up:standby 2024-04-12T13:52:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T13:52:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T13:52:30.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: osdmap e101: 6 total, 6 up, 6 in 2024-04-12T13:52:30.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: Standby daemon mds.cephfs.smithi060.mwwohl assigned to filesystem cephfs as rank 0 2024-04-12T13:52:30.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T13:52:30.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T13:52:30.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:29 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:replay} 2 up:standby 2024-04-12T13:52:30.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.910+0000 7f1380000700 1 -- 172.21.15.60:0/1939124767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 msgr2=0x7f1378070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.910+0000 7f1380000700 1 --2- 172.21.15.60:0/1939124767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f1378070d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1364004970 tx=0x7f1364009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 -- 172.21.15.60:0/1939124767 shutdown_connections 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 --2- 172.21.15.60:0/1939124767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f1378070d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 --2- 172.21.15.60:0/1939124767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 0x7f13780703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 -- 172.21.15.60:0/1939124767 >> 172.21.15.60:0/1939124767 conn(0x7f13780f8530 msgr2=0x7f13780fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 -- 172.21.15.60:0/1939124767 shutdown_connections 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.911+0000 7f1380000700 1 -- 172.21.15.60:0/1939124767 wait complete. 2024-04-12T13:52:30.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.912+0000 7f1380000700 1 Processor -- start 2024-04-12T13:52:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.912+0000 7f1380000700 1 -- start start 2024-04-12T13:52:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f1380000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f1380000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 0x7f1378110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f1380000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378110700 con 0x7f1378070920 2024-04-12T13:52:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f1380000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378110f50 con 0x7f1378071ed0 2024-04-12T13:52:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f137d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f137d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32970/0 (socket says 172.21.15.60:32970) 2024-04-12T13:52:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.913+0000 7f137d600700 1 -- 172.21.15.60:0/1743266680 learned_addr learned my addr 172.21.15.60:0/1743266680 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.914+0000 7f137cc00700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 0x7f1378110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.914+0000 7f137d600700 1 -- 172.21.15.60:0/1743266680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 msgr2=0x7f1378110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.914+0000 7f137d600700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 0x7f1378110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.914+0000 7f137d600700 1 -- 172.21.15.60:0/1743266680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364005040 con 0x7f1378070920 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.914+0000 7f137d600700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c8b0 tx=0x7f136c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.915+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c00a760 con 0x7f1378070920 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.915+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1378111230 con 0x7f1378070920 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.915+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f136c00ad90 con 0x7f1378070920 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.915+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136c0113a0 con 0x7f1378070920 2024-04-12T13:52:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.915+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378111770 con 0x7f1378070920 2024-04-12T13:52:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.916+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137805f5f0 con 0x7f1378070920 2024-04-12T13:52:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.917+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f136c012400 con 0x7f1378070920 2024-04-12T13:52:30.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.918+0000 7f1375600700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 0x7f13600710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.918+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f136c08eae0 con 0x7f1378070920 2024-04-12T13:52:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.919+0000 7f137cc00700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 0x7f13600710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.919+0000 7f137cc00700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 0x7f13600710c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f136400b800 tx=0x7f1364009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:30.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:30.924+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f136c05b1d0 con 0x7f1378070920 2024-04-12T13:52:31.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:30 smithi060 ceph-mon[94333]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:31.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.201+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1378111bb0 con 0x7f136006ec10 2024-04-12T13:52:31.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.203+0000 7f1375600700 1 -- 172.21.15.60:0/1743266680 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1378111bb0 con 0x7f136006ec10 2024-04-12T13:52:31.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 msgr2=0x7f13600710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 0x7f13600710c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f136400b800 tx=0x7f1364009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:31.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 msgr2=0x7f137810fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c8b0 tx=0x7f136c004470 comp rx=0 tx=0).stop 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 shutdown_connections 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f136006ec10 0x7f13600710c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1378070920 0x7f137810fbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 --2- 172.21.15.60:0/1743266680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1378071ed0 0x7f1378110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 >> 172.21.15.60:0/1743266680 conn(0x7f13780f8530 msgr2=0x7f13780f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 shutdown_connections 2024-04-12T13:52:31.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.206+0000 7f1380000700 1 -- 172.21.15.60:0/1743266680 wait complete. 2024-04-12T13:52:31.223 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:52:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:30 smithi110 ceph-mon[82130]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 -- 172.21.15.60:0/1210150596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c80ffde0 msgr2=0x7f07c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1210150596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c80ffde0 0x7f07c81021c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07b4004940 tx=0x7f07b4009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 -- 172.21.15.60:0/1210150596 shutdown_connections 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1210150596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c80ffde0 0x7f07c81021c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1210150596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c8066b00 0x7f07c80ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.355+0000 7f07ccc00700 1 -- 172.21.15.60:0/1210150596 >> 172.21.15.60:0/1210150596 conn(0x7f07c80f7290 msgr2=0x7f07c80f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.356+0000 7f07ccc00700 1 -- 172.21.15.60:0/1210150596 shutdown_connections 2024-04-12T13:52:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.356+0000 7f07ccc00700 1 -- 172.21.15.60:0/1210150596 wait complete. 2024-04-12T13:52:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.357+0000 7f07ccc00700 1 Processor -- start 2024-04-12T13:52:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.357+0000 7f07ccc00700 1 -- start start 2024-04-12T13:52:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07ccc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07ccc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c80ffde0 0x7f07c810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07ccc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c810e490 con 0x7f07c8066b00 2024-04-12T13:52:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07ccc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c810ec30 con 0x7f07c80ffde0 2024-04-12T13:52:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07c7400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07c7400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32986/0 (socket says 172.21.15.60:32986) 2024-04-12T13:52:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07c7400700 1 -- 172.21.15.60:0/1563959783 learned_addr learned my addr 172.21.15.60:0/1563959783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.358+0000 7f07c6a00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c80ffde0 0x7f07c810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07c7400700 1 -- 172.21.15.60:0/1563959783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c80ffde0 msgr2=0x7f07c810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07c7400700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c80ffde0 0x7f07c810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07c7400700 1 -- 172.21.15.60:0/1563959783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4005040 con 0x7f07c8066b00 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07c7400700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07b800b790 tx=0x7f07b8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b800f6f0 con 0x7f07c8066b00 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c810ef10 con 0x7f07c8066b00 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07b800fd20 con 0x7f07c8066b00 2024-04-12T13:52:31.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b80103a0 con 0x7f07c8066b00 2024-04-12T13:52:31.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.359+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c810f4d0 con 0x7f07c8066b00 2024-04-12T13:52:31.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.361+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c805f5f0 con 0x7f07c8066b00 2024-04-12T13:52:31.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.362+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f07b8011400 con 0x7f07c8066b00 2024-04-12T13:52:31.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.363+0000 7f07bf400700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 0x7f07ac0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.363+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f07b808e8e0 con 0x7f07c8066b00 2024-04-12T13:52:31.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.364+0000 7f07c6a00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 0x7f07ac0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.364+0000 7f07c6a00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 0x7f07ac0710b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.371+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f07b805afd0 con 0x7f07c8066b00 2024-04-12T13:52:31.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.628+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c810f8b0 con 0x7f07ac06ec00 2024-04-12T13:52:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.630+0000 7f07bf400700 1 -- 172.21.15.60:0/1563959783 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f07c810f8b0 con 0x7f07ac06ec00 2024-04-12T13:52:31.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 msgr2=0x7f07ac0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 0x7f07ac0710b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:31.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 msgr2=0x7f07c810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07b800b790 tx=0x7f07b8009220 comp rx=0 tx=0).stop 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 shutdown_connections 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f07ac06ec00 0x7f07ac0710b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07c8066b00 0x7f07c810d8c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 --2- 172.21.15.60:0/1563959783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c80ffde0 0x7f07c810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 >> 172.21.15.60:0/1563959783 conn(0x7f07c80f7290 msgr2=0x7f07c80f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 shutdown_connections 2024-04-12T13:52:31.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.634+0000 7f07ccc00700 1 -- 172.21.15.60:0/1563959783 wait complete. 2024-04-12T13:52:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.793+0000 7f174de00700 1 -- 172.21.15.60:0/3713652901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 msgr2=0x7f17481023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.793+0000 7f174de00700 1 --2- 172.21.15.60:0/3713652901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f17481023b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1734004940 tx=0x7f1734009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 -- 172.21.15.60:0/3713652901 shutdown_connections 2024-04-12T13:52:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 --2- 172.21.15.60:0/3713652901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f17481023b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 --2- 172.21.15.60:0/3713652901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f17480ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 -- 172.21.15.60:0/3713652901 >> 172.21.15.60:0/3713652901 conn(0x7f17480f74c0 msgr2=0x7f17480f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 -- 172.21.15.60:0/3713652901 shutdown_connections 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.794+0000 7f174de00700 1 -- 172.21.15.60:0/3713652901 wait complete. 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.795+0000 7f174de00700 1 Processor -- start 2024-04-12T13:52:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.795+0000 7f174de00700 1 -- start start 2024-04-12T13:52:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f174de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f174810fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f174de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f174de00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748110760 con 0x7f17480fffd0 2024-04-12T13:52:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f174de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748110fb0 con 0x7f1748066290 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f1746000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f1746000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33010/0 (socket says 172.21.15.60:33010) 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f1746000700 1 -- 172.21.15.60:0/1531931010 learned_addr learned my addr 172.21.15.60:0/1531931010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.796+0000 7f1746a00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f174810fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f1746000700 1 -- 172.21.15.60:0/1531931010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 msgr2=0x7f174810fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f1746000700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f174810fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f1746000700 1 -- 172.21.15.60:0/1531931010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734005040 con 0x7f17480fffd0 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f1746a00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f174810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:52:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f1746000700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f173400b3b0 tx=0x7f1734009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173400e040 con 0x7f17480fffd0 2024-04-12T13:52:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1734004290 con 0x7f17480fffd0 2024-04-12T13:52:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748111230 con 0x7f17480fffd0 2024-04-12T13:52:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.797+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173401c630 con 0x7f17480fffd0 2024-04-12T13:52:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.798+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1748111770 con 0x7f17480fffd0 2024-04-12T13:52:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.799+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174805f5f0 con 0x7f17480fffd0 2024-04-12T13:52:31.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.800+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f173400bbf0 con 0x7f17480fffd0 2024-04-12T13:52:31.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.801+0000 7f173ea00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 0x7f172c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:31.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.802+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f173408ff30 con 0x7f17480fffd0 2024-04-12T13:52:31.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.802+0000 7f1746a00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 0x7f172c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:31.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.803+0000 7f1746a00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 0x7f172c0710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1738007fd0 tx=0x7f1738009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:31.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:31.806+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f173405c620 con 0x7f17480fffd0 2024-04-12T13:52:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.057+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1748111b00 con 0x7f172c06ec10 2024-04-12T13:52:32.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.077+0000 7f173ea00700 1 -- 172.21.15.60:0/1531931010 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1748111b00 con 0x7f172c06ec10 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (10m) 45s ago 21m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (5m) 45s ago 21m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (5m) 15s ago 20m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 45s ago 21m - - 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (52s) 45s ago 14m 10.9M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (88s) 45s ago 14m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (21s) 15s ago 14m 10.9M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (14m) 15s ago 14m 94.5M - 17.2.7-845-g730340d7 036a68d49952 0cc7027c07af 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (9m) 45s ago 23m 509M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (8m) 15s ago 20m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (7m) 45s ago 23m 56.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:52:32.080 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (6m) 15s ago 19m 43.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (10m) 45s ago 21m 8024k - 1.5.0 0da6a335fe13 d4f88c1d6562 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (9m) 15s ago 20m 7931k - 1.5.0 0da6a335fe13 e46852ed70de 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 45s ago 19m 112M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 45s ago 18m 197M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 45s ago 17m 120M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (3m) 15s ago 17m 113M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (2m) 15s ago 16m 94.7M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (119s) 15s ago 16m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:52:32.081 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (8m) 45s ago 20m 59.9M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:52:32.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 msgr2=0x7f172c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 0x7f172c0710c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1738007fd0 tx=0x7f1738009040 comp rx=0 tx=0).stop 2024-04-12T13:52:32.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 msgr2=0x7f1748110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f173400b3b0 tx=0x7f1734009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 shutdown_connections 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f172c06ec10 0x7f172c0710c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1748066290 0x7f174810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 --2- 172.21.15.60:0/1531931010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17480fffd0 0x7f1748110160 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 >> 172.21.15.60:0/1531931010 conn(0x7f17480f74c0 msgr2=0x7f17480fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 shutdown_connections 2024-04-12T13:52:32.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.080+0000 7f174de00700 1 -- 172.21.15.60:0/1531931010 wait complete. 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 -- 172.21.15.60:0/306725563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 msgr2=0x7f158c102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 --2- 172.21.15.60:0/306725563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c102410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1578004940 tx=0x7f1578009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 -- 172.21.15.60:0/306725563 shutdown_connections 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 --2- 172.21.15.60:0/306725563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c102410 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 --2- 172.21.15.60:0/306725563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 0x7f158c0ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.224+0000 7f1592a00700 1 -- 172.21.15.60:0/306725563 >> 172.21.15.60:0/306725563 conn(0x7f158c0f74c0 msgr2=0x7f158c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:32.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.225+0000 7f1592a00700 1 -- 172.21.15.60:0/306725563 shutdown_connections 2024-04-12T13:52:32.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.225+0000 7f1592a00700 1 -- 172.21.15.60:0/306725563 wait complete. 2024-04-12T13:52:32.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.226+0000 7f1592a00700 1 Processor -- start 2024-04-12T13:52:32.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.226+0000 7f1592a00700 1 -- start start 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f1592a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 0x7f158c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f1592a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f1592a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c110890 con 0x7f158c100030 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f1592a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c110fd0 con 0x7f158c066230 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f158b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f158b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33036/0 (socket says 172.21.15.60:33036) 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f158b400700 1 -- 172.21.15.60:0/825623596 learned_addr learned my addr 172.21.15.60:0/825623596 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.227+0000 7f158be00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 0x7f158c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.228+0000 7f158b400700 1 -- 172.21.15.60:0/825623596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 msgr2=0x7f158c10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.228+0000 7f158b400700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 0x7f158c10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.228+0000 7f158b400700 1 -- 172.21.15.60:0/825623596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578005040 con 0x7f158c100030 2024-04-12T13:52:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.228+0000 7f158b400700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f157800b970 tx=0x7f1578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:32.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.228+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157800e040 con 0x7f158c100030 2024-04-12T13:52:32.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.229+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1578004290 con 0x7f158c100030 2024-04-12T13:52:32.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.229+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157801c630 con 0x7f158c100030 2024-04-12T13:52:32.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.229+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c111250 con 0x7f158c100030 2024-04-12T13:52:32.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.229+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c111810 con 0x7f158c100030 2024-04-12T13:52:32.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.230+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c05f5f0 con 0x7f158c100030 2024-04-12T13:52:32.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.232+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f157800bbf0 con 0x7f158c100030 2024-04-12T13:52:32.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.233+0000 7f1583e00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 0x7f15700710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.233+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f157808fd90 con 0x7f158c100030 2024-04-12T13:52:32.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.233+0000 7f158be00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 0x7f15700710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.234+0000 7f158be00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 0x7f15700710c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f157c007fd0 tx=0x7f157c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:32.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.238+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f157805c500 con 0x7f158c100030 2024-04-12T13:52:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.558+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f158c1058e0 con 0x7f158c100030 2024-04-12T13:52:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.558+0000 7f1583e00700 1 -- 172.21.15.60:0/825623596 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1578013e60 con 0x7f158c100030 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:52:32.561 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 3 2024-04-12T13:52:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:52:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:52:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 13 2024-04-12T13:52:32.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:52:32.562 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:52:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 msgr2=0x7f15700710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 0x7f15700710c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f157c007fd0 tx=0x7f157c009040 comp rx=0 tx=0).stop 2024-04-12T13:52:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 msgr2=0x7f158c110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f157800b970 tx=0x7f1578009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 shutdown_connections 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f157006ec10 0x7f15700710c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f158c066230 0x7f158c10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 --2- 172.21.15.60:0/825623596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f158c100030 0x7f158c110290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 >> 172.21.15.60:0/825623596 conn(0x7f158c0f74c0 msgr2=0x7f158c0fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 shutdown_connections 2024-04-12T13:52:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.562+0000 7f1592a00700 1 -- 172.21.15.60:0/825623596 wait complete. 2024-04-12T13:52:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.709+0000 7fc74c200700 1 -- 172.21.15.60:0/3893886592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc744102370 msgr2=0x7fc744104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.709+0000 7fc74c200700 1 --2- 172.21.15.60:0/3893886592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc744102370 0x7fc744104750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc730004940 tx=0x7fc730009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 -- 172.21.15.60:0/3893886592 shutdown_connections 2024-04-12T13:52:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 --2- 172.21.15.60:0/3893886592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc744102370 0x7fc744104750 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 --2- 172.21.15.60:0/3893886592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7440662f0 0x7fc744101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 -- 172.21.15.60:0/3893886592 >> 172.21.15.60:0/3893886592 conn(0x7fc7440f74c0 msgr2=0x7fc7440f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 -- 172.21.15.60:0/3893886592 shutdown_connections 2024-04-12T13:52:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.710+0000 7fc74c200700 1 -- 172.21.15.60:0/3893886592 wait complete. 2024-04-12T13:52:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 Processor -- start 2024-04-12T13:52:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 -- start start 2024-04-12T13:52:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc744102370 0x7fc744110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744110810 con 0x7fc7440662f0 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.711+0000 7fc74c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744111000 con 0x7fc744102370 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33046/0 (socket says 172.21.15.60:33046) 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 -- 172.21.15.60:0/1299227739 learned_addr learned my addr 172.21.15.60:0/1299227739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc748e00700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc744102370 0x7fc744110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 -- 172.21.15.60:0/1299227739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc744102370 msgr2=0x7fc744110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc744102370 0x7fc744110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 -- 172.21.15.60:0/1299227739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730005040 con 0x7fc7440662f0 2024-04-12T13:52:32.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.712+0000 7fc749800700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc73800b790 tx=0x7fc738009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.713+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73800f6f0 con 0x7fc7440662f0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.713+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc73800fd20 con 0x7fc7440662f0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.713+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7441112e0 con 0x7fc7440662f0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.713+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7380103a0 con 0x7fc7440662f0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.713+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7441118a0 con 0x7fc7440662f0 2024-04-12T13:52:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.714+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74405f5f0 con 0x7fc7440662f0 2024-04-12T13:52:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.715+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc738011400 con 0x7fc7440662f0 2024-04-12T13:52:32.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.717+0000 7fc741600700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 0x7fc72c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:32.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.717+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc73808e8e0 con 0x7fc7440662f0 2024-04-12T13:52:32.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.717+0000 7fc748e00700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 0x7fc72c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:32.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.718+0000 7fc748e00700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 0x7fc72c0710c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b3b0 tx=0x7fc730009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:32.722+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc73805afd0 con 0x7fc7440662f0 2024-04-12T13:52:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.035+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc744111c30 con 0x7fc7440662f0 2024-04-12T13:52:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.035+0000 7fc741600700 1 -- 172.21.15.60:0/1299227739 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1750 (secure 0 0 0) 0x7fc73805ab60 con 0x7fc7440662f0 2024-04-12T13:52:33.038 INFO:teuthology.orchestra.run.smithi060.stdout:e32 2024-04-12T13:52:33.038 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:52:33.038 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:52:33.038 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:52:33.038 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 32 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:52:29.517413+0000 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:52:33.039 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 101 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34456} 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:52:33.040 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:34456} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:52:33.041 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 msgr2=0x7fc72c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 0x7fc72c0710c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b3b0 tx=0x7fc730009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 msgr2=0x7fc74410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc73800b790 tx=0x7fc738009220 comp rx=0 tx=0).stop 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 shutdown_connections 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc72c06ec10 0x7fc72c0710c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7440662f0 0x7fc74410fc40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 --2- 172.21.15.60:0/1299227739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc744102370 0x7fc744110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.038+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 >> 172.21.15.60:0/1299227739 conn(0x7fc7440f74c0 msgr2=0x7fc7440f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.039+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 shutdown_connections 2024-04-12T13:52:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.039+0000 7fc74c200700 1 -- 172.21.15.60:0/1299227739 wait complete. 2024-04-12T13:52:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 32 2024-04-12T13:52:33.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:32 smithi060 ceph-mon[94333]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:33.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:32 smithi060 ceph-mon[94333]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:33.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:32 smithi060 ceph-mon[94333]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 1 op/s 2024-04-12T13:52:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:32 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/825623596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 -- 172.21.15.60:0/2798591073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 msgr2=0x7fcaf8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 --2- 172.21.15.60:0/2798591073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf8102410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcae4004940 tx=0x7fcae4009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 -- 172.21.15.60:0/2798591073 shutdown_connections 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 --2- 172.21.15.60:0/2798591073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf8102410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 --2- 172.21.15.60:0/2798591073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 0x7fcaf80ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 -- 172.21.15.60:0/2798591073 >> 172.21.15.60:0/2798591073 conn(0x7fcaf80f74c0 msgr2=0x7fcaf80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.187+0000 7fcafd600700 1 -- 172.21.15.60:0/2798591073 shutdown_connections 2024-04-12T13:52:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.188+0000 7fcafd600700 1 -- 172.21.15.60:0/2798591073 wait complete. 2024-04-12T13:52:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.189+0000 7fcafd600700 1 Processor -- start 2024-04-12T13:52:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.189+0000 7fcafd600700 1 -- start start 2024-04-12T13:52:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcafd600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 0x7fcaf80fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcafd600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcafd600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80fbfa0 con 0x7fcaf8100030 2024-04-12T13:52:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcafd600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80fc110 con 0x7fcaf8066230 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcaf6000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcaf6000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33070/0 (socket says 172.21.15.60:33070) 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcaf6000700 1 -- 172.21.15.60:0/299558482 learned_addr learned my addr 172.21.15.60:0/299558482 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.190+0000 7fcaf6a00700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 0x7fcaf80fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaf6000700 1 -- 172.21.15.60:0/299558482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 msgr2=0x7fcaf80fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaf6000700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 0x7fcaf80fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaf6000700 1 -- 172.21.15.60:0/299558482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4005040 con 0x7fcaf8100030 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaf6000700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcae400b3b0 tx=0x7fcae4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae400e040 con 0x7fcaf8100030 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcae400bcc0 con 0x7fcaf8100030 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.191+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf80fc390 con 0x7fcaf8100030 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.192+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae401c630 con 0x7fcaf8100030 2024-04-12T13:52:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.192+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf8115a80 con 0x7fcaf8100030 2024-04-12T13:52:33.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.193+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf805f5f0 con 0x7fcaf8100030 2024-04-12T13:52:33.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.194+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcae40139f0 con 0x7fcaf8100030 2024-04-12T13:52:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.195+0000 7fcaeea00700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 0x7fcadc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.195+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fcae408f6f0 con 0x7fcaf8100030 2024-04-12T13:52:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.195+0000 7fcaf6a00700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 0x7fcadc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.196+0000 7fcaf6a00700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 0x7fcadc0710b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009fd0 tx=0x7fcae8009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.204+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fcae4058330 con 0x7fcaf8100030 2024-04-12T13:52:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:32 smithi110 ceph-mon[82130]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:32 smithi110 ceph-mon[82130]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:32 smithi110 ceph-mon[82130]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 1 op/s 2024-04-12T13:52:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:32 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/825623596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:33.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.457+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaf80f8fb0 con 0x7fcadc06ec00 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.460+0000 7fcaeea00700 1 -- 172.21.15.60:0/299558482 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcaf80f8fb0 con 0x7fcadc06ec00 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:52:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "15/21 daemons upgraded", 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:52:33.463 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.463+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 msgr2=0x7fcadc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.463+0000 7fcafd600700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 0x7fcadc0710b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009fd0 tx=0x7fcae8009f00 comp rx=0 tx=0).stop 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.463+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 msgr2=0x7fcaf80fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.463+0000 7fcafd600700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcae400b3b0 tx=0x7fcae4009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.463+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 shutdown_connections 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcadc06ec00 0x7fcadc0710b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaf8066230 0x7fcaf80fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 --2- 172.21.15.60:0/299558482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf8100030 0x7fcaf80fb9f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 >> 172.21.15.60:0/299558482 conn(0x7fcaf80f74c0 msgr2=0x7fcaf80f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 shutdown_connections 2024-04-12T13:52:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.464+0000 7fcafd600700 1 -- 172.21.15.60:0/299558482 wait complete. 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 -- 172.21.15.60:0/4092279142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774066230 msgr2=0x7f17740ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 --2- 172.21.15.60:0/4092279142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774066230 0x7f17740ffaf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1764004940 tx=0x7f1764009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 -- 172.21.15.60:0/4092279142 shutdown_connections 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 --2- 172.21.15.60:0/4092279142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774100030 0x7f1774102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 --2- 172.21.15.60:0/4092279142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774066230 0x7f17740ffaf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 -- 172.21.15.60:0/4092279142 >> 172.21.15.60:0/4092279142 conn(0x7f17740f74c0 msgr2=0x7f17740f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 -- 172.21.15.60:0/4092279142 shutdown_connections 2024-04-12T13:52:33.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.624+0000 7f177b000700 1 -- 172.21.15.60:0/4092279142 wait complete. 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.625+0000 7f177b000700 1 Processor -- start 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f177b000700 1 -- start start 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f177b000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774066230 0x7f177410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f177b000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f177b000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1774110890 con 0x7f1774100030 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f177b000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1774110fd0 con 0x7f1774066230 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f1773400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f1773400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33078/0 (socket says 172.21.15.60:33078) 2024-04-12T13:52:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.626+0000 7f1773400700 1 -- 172.21.15.60:0/2601190245 learned_addr learned my addr 172.21.15.60:0/2601190245 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:52:33.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f1773e00700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774066230 0x7f177410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f1773400700 1 -- 172.21.15.60:0/2601190245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774066230 msgr2=0x7f177410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f1773400700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774066230 0x7f177410fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f1773400700 1 -- 172.21.15.60:0/2601190245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764005040 con 0x7f1774100030 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f1773400700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f176000c800 tx=0x7f1760004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.627+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f176000a760 con 0x7f1774100030 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.628+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f176000ad90 con 0x7f1774100030 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.628+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17600113a0 con 0x7f1774100030 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.628+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17741112b0 con 0x7f1774100030 2024-04-12T13:52:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.628+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1774111870 con 0x7f1774100030 2024-04-12T13:52:33.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.629+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177405f5f0 con 0x7f1774100030 2024-04-12T13:52:33.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.630+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1760012400 con 0x7f1774100030 2024-04-12T13:52:33.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.631+0000 7f176be00700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 0x7f17580710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:52:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.631+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f176008eb00 con 0x7f1774100030 2024-04-12T13:52:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.632+0000 7f1773e00700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 0x7f17580710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:52:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.632+0000 7f1773e00700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 0x7f17580710c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f176400b3b0 tx=0x7f1764009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:52:33.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.640+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f176005b1f0 con 0x7f1774100030 2024-04-12T13:52:33.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.970+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1774111c50 con 0x7f1774100030 2024-04-12T13:52:33.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.971+0000 7f176be00700 1 -- 172.21.15.60:0/2601190245 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+251 (secure 0 0 0) 0x7f176005ad80 con 0x7f1774100030 2024-04-12T13:52:33.973 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-12T13:52:33.974 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:52:33.974 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:52:33.974 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-12T13:52:33.974 INFO:teuthology.orchestra.run.smithi060.stdout: fs cephfs is degraded 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.973+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 msgr2=0x7f17580710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.973+0000 7f177b000700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 0x7f17580710c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f176400b3b0 tx=0x7f1764009e30 comp rx=0 tx=0).stop 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.973+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 msgr2=0x7f1774110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.973+0000 7f177b000700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f176000c800 tx=0x7f1760004470 comp rx=0 tx=0).stop 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 shutdown_connections 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f175806ec10 0x7f17580710c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1774066230 0x7f177410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 --2- 172.21.15.60:0/2601190245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1774100030 0x7f1774110290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:52:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 >> 172.21.15.60:0/2601190245 conn(0x7f17740f74c0 msgr2=0x7f17740fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:52:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 shutdown_connections 2024-04-12T13:52:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:52:33.974+0000 7f177b000700 1 -- 172.21.15.60:0/2601190245 wait complete. 2024-04-12T13:52:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:33 smithi060 ceph-mon[94333]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:34.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:33 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1299227739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:52:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:33 smithi110 ceph-mon[82130]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:33 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1299227739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:52:35.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:34 smithi060 ceph-mon[94333]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:34 smithi060 ceph-mon[94333]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 2 op/s 2024-04-12T13:52:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:34 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2601190245' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:52:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:34 smithi110 ceph-mon[82130]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:52:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:34 smithi110 ceph-mon[82130]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 2 op/s 2024-04-12T13:52:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:34 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2601190245' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:52:37.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:36 smithi060 ceph-mon[94333]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:36 smithi110 ceph-mon[82130]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T13:52:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:38 smithi110 ceph-mon[82130]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T13:52:39.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:38 smithi060 ceph-mon[94333]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T13:52:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:39 smithi060 ceph-mon[94333]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00299997 2024-04-12T13:52:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:39 smithi060 ceph-mon[94333]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299997 2024-04-12T13:52:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:39 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:reconnect 2024-04-12T13:52:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:39 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:reconnect} 2 up:standby 2024-04-12T13:52:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:39 smithi110 ceph-mon[82130]: reconnect by client.14510 192.168.0.1:0/46605736 after 0.00299997 2024-04-12T13:52:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:39 smithi110 ceph-mon[82130]: reconnect by client.24331 192.168.0.1:0/2685587643 after 0.00299997 2024-04-12T13:52:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:39 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:reconnect 2024-04-12T13:52:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:39 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:reconnect} 2 up:standby 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:rejoin 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] up:boot 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:rejoin} 3 up:standby 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:52:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: daemon mds.cephfs.smithi060.mwwohl is now active in filesystem cephfs as rank 0 2024-04-12T13:52:41.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:41.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:41.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T13:52:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:rejoin 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] up:boot 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: fsmap cephfs:1/1 {0=cephfs.smithi060.mwwohl=up:rejoin} 3 up:standby 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: daemon mds.cephfs.smithi060.mwwohl is now active in filesystem cephfs as rank 0 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:41.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:42.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:41 smithi060 ceph-mon[94333]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:52:42.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:41 smithi060 ceph-mon[94333]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:active 2024-04-12T13:52:42.183 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:41 smithi060 ceph-mon[94333]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:52:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:41 smithi110 ceph-mon[82130]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T13:52:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:41 smithi110 ceph-mon[82130]: mds.? [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] up:active 2024-04-12T13:52:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:41 smithi110 ceph-mon[82130]: fsmap cephfs:1 {0=cephfs.smithi060.mwwohl=up:active} 3 up:standby 2024-04-12T13:52:43.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:42 smithi060 ceph-mon[94333]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-12T13:52:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:42 smithi110 ceph-mon[82130]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-12T13:52:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:45.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:44 smithi110 ceph-mon[82130]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-12T13:52:45.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:44 smithi060 ceph-mon[94333]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-12T13:52:46.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:46.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:46.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:46 smithi110 ceph-mon[82130]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-12T13:52:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:47.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:46 smithi060 ceph-mon[94333]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-12T13:52:49.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:48 smithi060 ceph-mon[94333]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:49.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:48 smithi110 ceph-mon[82130]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:51.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:50 smithi060 ceph-mon[94333]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:51.219 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:50 smithi110 ceph-mon[82130]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 360 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:52.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all mds 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.epmcph"}]': finished 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.mwwohl"}]': finished 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.getdvx"}]': finished 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:52:52.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.zqdflr"}]': finished 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all rgw 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all iscsi 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.682 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all nfs 2024-04-12T13:52:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: Upgrade: Setting container_image for all nvmeof 2024-04-12T13:52:52.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:52 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 360 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all mds 2024-04-12T13:52:52.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.epmcph"}]: dispatch 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.epmcph"}]': finished 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.mwwohl"}]: dispatch 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.mwwohl"}]': finished 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.getdvx"}]: dispatch 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.getdvx"}]': finished 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.zqdflr"}]: dispatch 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.zqdflr"}]': finished 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all rgw 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all iscsi 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all nfs 2024-04-12T13:52:52.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:52.733 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:52:52.733 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: Upgrade: Setting container_image for all nvmeof 2024-04-12T13:52:52.733 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:52 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:54.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:54 smithi060 ceph-mon[94333]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-04-12T13:52:54.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:54 smithi110 ceph-mon[82130]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-04-12T13:52:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:55 smithi060 ceph-mon[94333]: Upgrade: Updating node-exporter.smithi060 (1/2) 2024-04-12T13:52:55.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:55 smithi060 ceph-mon[94333]: Deploying daemon node-exporter.smithi060 on smithi060 2024-04-12T13:52:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:55 smithi110 ceph-mon[82130]: Upgrade: Updating node-exporter.smithi060 (1/2) 2024-04-12T13:52:55.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:55 smithi110 ceph-mon[82130]: Deploying daemon node-exporter.smithi060 on smithi060 2024-04-12T13:52:56.644 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:56 smithi060 ceph-mon[94333]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:56.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:56 smithi110 ceph-mon[82130]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:58 smithi060 ceph-mon[94333]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:58.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:58 smithi110 ceph-mon[82130]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:52:58.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:52:59.829 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:59.829 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:52:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:59.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:52:59.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:52:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:00.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:00 smithi110 ceph-mon[82130]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:00.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:00 smithi060 ceph-mon[94333]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:01 smithi060 ceph-mon[94333]: Upgrade: Updating node-exporter.smithi110 (2/2) 2024-04-12T13:53:01.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:01 smithi060 ceph-mon[94333]: Deploying daemon node-exporter.smithi110 on smithi110 2024-04-12T13:53:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:01 smithi110 ceph-mon[82130]: Upgrade: Updating node-exporter.smithi110 (2/2) 2024-04-12T13:53:01.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:01 smithi110 ceph-mon[82130]: Deploying daemon node-exporter.smithi110 on smithi110 2024-04-12T13:53:02.782 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:02 smithi110 ceph-mon[82130]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:02.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:02 smithi060 ceph-mon[94333]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 -- 172.21.15.60:0/1493118649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 msgr2=0x7f66c0100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 --2- 172.21.15.60:0/1493118649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0100740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66ac004940 tx=0x7f66ac009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 -- 172.21.15.60:0/1493118649 shutdown_connections 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 --2- 172.21.15.60:0/1493118649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0100740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 --2- 172.21.15.60:0/1493118649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c00ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 -- 172.21.15.60:0/1493118649 >> 172.21.15.60:0/1493118649 conn(0x7f66c00fa950 msgr2=0x7f66c00fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 -- 172.21.15.60:0/1493118649 shutdown_connections 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.149+0000 7f66c6200700 1 -- 172.21.15.60:0/1493118649 wait complete. 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.150+0000 7f66c6200700 1 Processor -- start 2024-04-12T13:53:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.151+0000 7f66c6200700 1 -- start start 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.151+0000 7f66c6200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.151+0000 7f66c6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.151+0000 7f66c6200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0110640 con 0x7f66c00ff020 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.151+0000 7f66c6200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c01107b0 con 0x7f66c01002d0 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58500/0 (socket says 172.21.15.60:58500) 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 -- 172.21.15.60:0/3310129548 learned_addr learned my addr 172.21.15.60:0/3310129548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bea00700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 -- 172.21.15.60:0/3310129548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 msgr2=0x7f66c0110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bf400700 1 -- 172.21.15.60:0/3310129548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac005040 con 0x7f66c00ff020 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.152+0000 7f66bea00700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66bf400700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66b000eb40 tx=0x7f66b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b0007cc0 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c01151b0 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66b000f040 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b000ca10 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.153+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c01156f0 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.154+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c004c710 con 0x7f66c00ff020 2024-04-12T13:53:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.155+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f66b000cc80 con 0x7f66c00ff020 2024-04-12T13:53:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.156+0000 7f66b7400700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 0x7f66a40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.157+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f66b008e6e0 con 0x7f66c00ff020 2024-04-12T13:53:04.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.157+0000 7f66bea00700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 0x7f66a40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.158+0000 7f66bea00700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 0x7f66a40710b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00b0d0 tx=0x7f66ac009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:04.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.162+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f66b005ae00 con 0x7f66c00ff020 2024-04-12T13:53:04.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.415+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66c0104570 con 0x7f66a406ec00 2024-04-12T13:53:04.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.419+0000 7f66b7400700 1 -- 172.21.15.60:0/3310129548 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f66c0104570 con 0x7f66a406ec00 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 msgr2=0x7f66a40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 0x7f66a40710b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00b0d0 tx=0x7f66ac009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 msgr2=0x7f66c010fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66b000eb40 tx=0x7f66b000b040 comp rx=0 tx=0).stop 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 shutdown_connections 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f66a406ec00 0x7f66a40710b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c00ff020 0x7f66c010fb00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 --2- 172.21.15.60:0/3310129548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66c01002d0 0x7f66c0110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.422+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 >> 172.21.15.60:0/3310129548 conn(0x7f66c00fa950 msgr2=0x7f66c00fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.423+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 shutdown_connections 2024-04-12T13:53:04.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.423+0000 7f66c6200700 1 -- 172.21.15.60:0/3310129548 wait complete. 2024-04-12T13:53:04.441 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:53:04.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 -- 172.21.15.60:0/2068932680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf300ff020 msgr2=0x7fcf300ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 --2- 172.21.15.60:0/2068932680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf300ff020 0x7fcf300ff430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf20004940 tx=0x7fcf20009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 -- 172.21.15.60:0/2068932680 shutdown_connections 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 --2- 172.21.15.60:0/2068932680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf301002d0 0x7fcf30100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 --2- 172.21.15.60:0/2068932680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf300ff020 0x7fcf300ff430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 -- 172.21.15.60:0/2068932680 >> 172.21.15.60:0/2068932680 conn(0x7fcf300fa950 msgr2=0x7fcf300fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 -- 172.21.15.60:0/2068932680 shutdown_connections 2024-04-12T13:53:04.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.579+0000 7fcf35e00700 1 -- 172.21.15.60:0/2068932680 wait complete. 2024-04-12T13:53:04.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.580+0000 7fcf35e00700 1 Processor -- start 2024-04-12T13:53:04.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.580+0000 7fcf35e00700 1 -- start start 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf35e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf300ff020 0x7fcf30075c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf35e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf35e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30072720 con 0x7fcf301002d0 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf35e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30072890 con 0x7fcf300ff020 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf2e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf2e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58520/0 (socket says 172.21.15.60:58520) 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf2e000700 1 -- 172.21.15.60:0/3779620478 learned_addr learned my addr 172.21.15.60:0/3779620478 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.581+0000 7fcf2ea00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf300ff020 0x7fcf30075c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf2e000700 1 -- 172.21.15.60:0/3779620478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf300ff020 msgr2=0x7fcf30075c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf2e000700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf300ff020 0x7fcf30075c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf2e000700 1 -- 172.21.15.60:0/3779620478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf301002d0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf2e000700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c830 tx=0x7fcf1c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c00a760 con 0x7fcf301002d0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf1c00ad90 con 0x7fcf301002d0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30072b20 con 0x7fcf301002d0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c0113a0 con 0x7fcf301002d0 2024-04-12T13:53:04.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.582+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf300730e0 con 0x7fcf301002d0 2024-04-12T13:53:04.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.583+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30108320 con 0x7fcf301002d0 2024-04-12T13:53:04.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.585+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcf1c012400 con 0x7fcf301002d0 2024-04-12T13:53:04.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.586+0000 7fcf26a00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:04.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.586+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fcf1c08ea80 con 0x7fcf301002d0 2024-04-12T13:53:04.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.586+0000 7fcf2ea00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:04.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.587+0000 7fcf2ea00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 0x7fcf140710b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf20004f90 tx=0x7fcf20009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:04.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.591+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fcf1c05b1f0 con 0x7fcf301002d0 2024-04-12T13:53:04.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:04 smithi060 ceph-mon[94333]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:04.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:04 smithi110 ceph-mon[82130]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.839+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf30104690 con 0x7fcf1406ec00 2024-04-12T13:53:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.841+0000 7fcf26a00700 1 -- 172.21.15.60:0/3779620478 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fcf30104690 con 0x7fcf1406ec00 2024-04-12T13:53:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.843+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 msgr2=0x7fcf140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.843+0000 7fcf35e00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 0x7fcf140710b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf20004f90 tx=0x7fcf20009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.843+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 msgr2=0x7fcf300761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.843+0000 7fcf35e00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c830 tx=0x7fcf1c004470 comp rx=0 tx=0).stop 2024-04-12T13:53:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.843+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 shutdown_connections 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf300ff020 0x7fcf30075c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 --2- 172.21.15.60:0/3779620478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf301002d0 0x7fcf300761c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 >> 172.21.15.60:0/3779620478 conn(0x7fcf300fa950 msgr2=0x7fcf300fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 shutdown_connections 2024-04-12T13:53:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:04.844+0000 7fcf35e00700 1 -- 172.21.15.60:0/3779620478 wait complete. 2024-04-12T13:53:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 -- 172.21.15.60:0/3607975260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc071e40 msgr2=0x7fc8cc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3607975260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc071e40 0x7fc8cc070350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0004940 tx=0x7fc8c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 -- 172.21.15.60:0/3607975260 shutdown_connections 2024-04-12T13:53:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3607975260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc070890 0x7fc8cc070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3607975260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc071e40 0x7fc8cc070350 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.001+0000 7fc8d4000700 1 -- 172.21.15.60:0/3607975260 >> 172.21.15.60:0/3607975260 conn(0x7fc8cc0f8580 msgr2=0x7fc8cc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:05.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.002+0000 7fc8d4000700 1 -- 172.21.15.60:0/3607975260 shutdown_connections 2024-04-12T13:53:05.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.002+0000 7fc8d4000700 1 -- 172.21.15.60:0/3607975260 wait complete. 2024-04-12T13:53:05.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.002+0000 7fc8d4000700 1 Processor -- start 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d4000700 1 -- start start 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d4000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc071e40 0x7fc8cc1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d4000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc1106c0 con 0x7fc8cc070890 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d4000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc110830 con 0x7fc8cc071e40 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d1600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58536/0 (socket says 172.21.15.60:58536) 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.003+0000 7fc8d1600700 1 -- 172.21.15.60:0/3777780660 learned_addr learned my addr 172.21.15.60:0/3777780660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d1600700 1 -- 172.21.15.60:0/3777780660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc071e40 msgr2=0x7fc8cc1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d1600700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc071e40 0x7fc8cc1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d1600700 1 -- 172.21.15.60:0/3777780660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0005040 con 0x7fc8cc070890 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d1600700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000b970 tx=0x7fc8c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c000e040 con 0x7fc8cc070890 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8c000bbf0 con 0x7fc8cc070890 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc115230 con 0x7fc8cc070890 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c001c630 con 0x7fc8cc070890 2024-04-12T13:53:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.004+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc1157f0 con 0x7fc8cc070890 2024-04-12T13:53:05.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.006+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc04c710 con 0x7fc8cc070890 2024-04-12T13:53:05.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.007+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc8c000bd60 con 0x7fc8cc070890 2024-04-12T13:53:05.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.008+0000 7fc8c9600700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 0x7fc8b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.008+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc8c008fdf0 con 0x7fc8cc070890 2024-04-12T13:53:05.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.008+0000 7fc8d0c00700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 0x7fc8b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.009+0000 7fc8d0c00700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 0x7fc8b40710b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8004ad0 tx=0x7fc8b8007d40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.012+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc8c005c560 con 0x7fc8cc070890 2024-04-12T13:53:05.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.258+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8cc103d80 con 0x7fc8b406ec00 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.269+0000 7fc8c9600700 1 -- 172.21.15.60:0/3777780660 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc8cc103d80 con 0x7fc8b406ec00 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (10m) 79s ago 21m 15.4M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (6m) 79s ago 22m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (6m) 21s ago 20m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 79s ago 21m - - 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (85s) 79s ago 14m 10.9M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:53:05.271 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (2m) 79s ago 14m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (54s) 21s ago 14m 11.1M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (25s) 21s ago 14m 10.9M - 19.0.0-2778-ga971fd5f b96c509eef84 0c26cec850b0 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (9m) 79s ago 23m 509M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (8m) 21s ago 20m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (8m) 79s ago 23m 56.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (7m) 21s ago 20m 42.9M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 starting - - - - 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 starting - - - - 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 79s ago 19m 112M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 79s ago 18m 197M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 79s ago 18m 120M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (3m) 21s ago 17m 115M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (3m) 21s ago 17m 94.8M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (2m) 21s ago 16m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:53:05.272 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (8m) 79s ago 21m 59.9M - 2.43.0 a07b618ecd1d 1aaac972d9d7 2024-04-12T13:53:05.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 msgr2=0x7fc8b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 0x7fc8b40710b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8004ad0 tx=0x7fc8b8007d40 comp rx=0 tx=0).stop 2024-04-12T13:53:05.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 msgr2=0x7fc8cc10fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000b970 tx=0x7fc8c0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 shutdown_connections 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc8b406ec00 0x7fc8b40710b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8cc070890 0x7fc8cc10fb80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 --2- 172.21.15.60:0/3777780660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc071e40 0x7fc8cc1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.271+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 >> 172.21.15.60:0/3777780660 conn(0x7fc8cc0f8580 msgr2=0x7fc8cc0fa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.272+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 shutdown_connections 2024-04-12T13:53:05.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.272+0000 7fc8d4000700 1 -- 172.21.15.60:0/3777780660 wait complete. 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 -- 172.21.15.60:0/3778147442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fcef0 msgr2=0x7f615c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 --2- 172.21.15.60:0/3778147442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fcef0 0x7f615c0fd320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f614c004940 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 -- 172.21.15.60:0/3778147442 shutdown_connections 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 --2- 172.21.15.60:0/3778147442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fe0e0 0x7f615c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 --2- 172.21.15.60:0/3778147442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fcef0 0x7f615c0fd320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 -- 172.21.15.60:0/3778147442 >> 172.21.15.60:0/3778147442 conn(0x7f615c0f8530 msgr2=0x7f615c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.441+0000 7f6161400700 1 -- 172.21.15.60:0/3778147442 shutdown_connections 2024-04-12T13:53:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.442+0000 7f6161400700 1 -- 172.21.15.60:0/3778147442 wait complete. 2024-04-12T13:53:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.442+0000 7f6161400700 1 Processor -- start 2024-04-12T13:53:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.442+0000 7f6161400700 1 -- start start 2024-04-12T13:53:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6161400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fcef0 0x7f615c10fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6161400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6161400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110750 con 0x7f615c0fe0e0 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6161400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110fa0 con 0x7f615c0fcef0 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6159e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6159e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58552/0 (socket says 172.21.15.60:58552) 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f6159e00700 1 -- 172.21.15.60:0/2031379194 learned_addr learned my addr 172.21.15.60:0/2031379194 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.443+0000 7f615a800700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fcef0 0x7f615c10fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6159e00700 1 -- 172.21.15.60:0/2031379194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fcef0 msgr2=0x7f615c10fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6159e00700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fcef0 0x7f615c10fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6159e00700 1 -- 172.21.15.60:0/2031379194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c005040 con 0x7f615c0fe0e0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6159e00700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f614800eb70 tx=0x7f614800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6148007cc0 con 0x7f615c0fe0e0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.444+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c111220 con 0x7f615c0fe0e0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.445+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614800f040 con 0x7f615c0fe0e0 2024-04-12T13:53:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.445+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614800ca90 con 0x7f615c0fe0e0 2024-04-12T13:53:05.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.445+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c111760 con 0x7f615c0fe0e0 2024-04-12T13:53:05.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.446+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c101a70 con 0x7f615c0fe0e0 2024-04-12T13:53:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.447+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f614800cbf0 con 0x7f615c0fe0e0 2024-04-12T13:53:05.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.449+0000 7f6152a00700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 0x7f61400710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.449+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f614808e680 con 0x7f615c0fe0e0 2024-04-12T13:53:05.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.449+0000 7f615a800700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 0x7f61400710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.450+0000 7f615a800700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 0x7f61400710c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f614c013870 tx=0x7f614c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.453+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f614805acf0 con 0x7f615c0fe0e0 2024-04-12T13:53:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.772+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f615c05f5f0 con 0x7f615c0fe0e0 2024-04-12T13:53:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.773+0000 7f6152a00700 1 -- 172.21.15.60:0/2031379194 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f614805a880 con 0x7f615c0fe0e0 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:05.776 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 14 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:53:05.777 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:53:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 msgr2=0x7f61400710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 0x7f61400710c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f614c013870 tx=0x7f614c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 msgr2=0x7f615c110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f614800eb70 tx=0x7f614800b040 comp rx=0 tx=0).stop 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 shutdown_connections 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f614006ec10 0x7f61400710c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f615c0fcef0 0x7f615c10fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 --2- 172.21.15.60:0/2031379194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f615c0fe0e0 0x7f615c110150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.776+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 >> 172.21.15.60:0/2031379194 conn(0x7f615c0f8530 msgr2=0x7f615c0f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.777+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 shutdown_connections 2024-04-12T13:53:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.777+0000 7f6161400700 1 -- 172.21.15.60:0/2031379194 wait complete. 2024-04-12T13:53:05.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:05 smithi060 ceph-mon[94333]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:05 smithi060 ceph-mon[94333]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:05.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:05 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 -- 172.21.15.60:0/1613042017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fdee0 msgr2=0x7f9c040fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 --2- 172.21.15.60:0/1613042017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fdee0 0x7f9c040fe350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0004940 tx=0x7f9bf0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 -- 172.21.15.60:0/1613042017 shutdown_connections 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 --2- 172.21.15.60:0/1613042017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fdee0 0x7f9c040fe350 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 --2- 172.21.15.60:0/1613042017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fcc30 0x7f9c040fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 -- 172.21.15.60:0/1613042017 >> 172.21.15.60:0/1613042017 conn(0x7f9c040f83d0 msgr2=0x7f9c040fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 -- 172.21.15.60:0/1613042017 shutdown_connections 2024-04-12T13:53:05.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.937+0000 7f9c03200700 1 -- 172.21.15.60:0/1613042017 wait complete. 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.938+0000 7f9c03200700 1 Processor -- start 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.938+0000 7f9c03200700 1 -- start start 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c03200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c03200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fdee0 0x7f9c04070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c03200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040708c0 con 0x7f9c040fcc30 2024-04-12T13:53:05.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c03200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04070a30 con 0x7f9c040fdee0 2024-04-12T13:53:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c01e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c01e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58558/0 (socket says 172.21.15.60:58558) 2024-04-12T13:53:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.939+0000 7f9c01e00700 1 -- 172.21.15.60:0/438524891 learned_addr learned my addr 172.21.15.60:0/438524891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.940+0000 7f9c01400700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fdee0 0x7f9c04070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.940+0000 7f9c01e00700 1 -- 172.21.15.60:0/438524891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fdee0 msgr2=0x7f9c04070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:05.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.940+0000 7f9c01e00700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fdee0 0x7f9c04070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:05.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.940+0000 7f9c01e00700 1 -- 172.21.15.60:0/438524891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf0005040 con 0x7f9c040fcc30 2024-04-12T13:53:05.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9c01e00700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400eb40 tx=0x7f9bf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf4007cc0 con 0x7f9c040fcc30 2024-04-12T13:53:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bf400f040 con 0x7f9c040fcc30 2024-04-12T13:53:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c04070cb0 con 0x7f9c040fcc30 2024-04-12T13:53:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf400ca10 con 0x7f9c040fcc30 2024-04-12T13:53:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.941+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04115830 con 0x7f9c040fcc30 2024-04-12T13:53:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.942+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0405f5f0 con 0x7f9c040fcc30 2024-04-12T13:53:05.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.944+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9bf400cc80 con 0x7f9c040fcc30 2024-04-12T13:53:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.945+0000 7f9bfa000700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 0x7f9be80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.945+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f9bf408e6e0 con 0x7f9c040fcc30 2024-04-12T13:53:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.945+0000 7f9c01400700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 0x7f9be80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:05.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.946+0000 7f9c01400700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 0x7f9be80710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009fd0 tx=0x7f9bf0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:05.950+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f9bf40572d0 con 0x7f9c040fcc30 2024-04-12T13:53:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:05 smithi110 ceph-mon[82130]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:05 smithi110 ceph-mon[82130]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:05.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:05 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:06.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.252+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c04115ac0 con 0x7f9c040fcc30 2024-04-12T13:53:06.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.253+0000 7f9bfa000700 1 -- 172.21.15.60:0/438524891 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1935 (secure 0 0 0) 0x7f9bf405a990 con 0x7f9c040fcc30 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:06.256 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 35 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:52:40.918247+0000 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:53:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 101 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34456} 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:53:06.258 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34456 members: 34456 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:34456} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:06.259 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:06.260 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:06.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.256+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 msgr2=0x7f9be80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.256+0000 7f9c03200700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 0x7f9be80710c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009fd0 tx=0x7f9bf0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.256+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 msgr2=0x7f9c04071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.256+0000 7f9c03200700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400eb40 tx=0x7f9bf400b040 comp rx=0 tx=0).stop 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 shutdown_connections 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9be806ec10 0x7f9be80710c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c040fcc30 0x7f9c04071e40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 --2- 172.21.15.60:0/438524891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c040fdee0 0x7f9c04070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 >> 172.21.15.60:0/438524891 conn(0x7f9c040f83d0 msgr2=0x7f9c040f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 shutdown_connections 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.257+0000 7f9c03200700 1 -- 172.21.15.60:0/438524891 wait complete. 2024-04-12T13:53:06.261 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 -- 172.21.15.60:0/1667606976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b41046d0 msgr2=0x7f93b4104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 --2- 172.21.15.60:0/1667606976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b41046d0 0x7f93b4104b40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93a0004940 tx=0x7f93a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 -- 172.21.15.60:0/1667606976 shutdown_connections 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 --2- 172.21.15.60:0/1667606976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b41046d0 0x7f93b4104b40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 --2- 172.21.15.60:0/1667606976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b4103420 0x7f93b4103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 -- 172.21.15.60:0/1667606976 >> 172.21.15.60:0/1667606976 conn(0x7f93b4072640 msgr2=0x7f93b4074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 -- 172.21.15.60:0/1667606976 shutdown_connections 2024-04-12T13:53:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.404+0000 7f93bc000700 1 -- 172.21.15.60:0/1667606976 wait complete. 2024-04-12T13:53:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.405+0000 7f93bc000700 1 Processor -- start 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.405+0000 7f93bc000700 1 -- start start 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93bc000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93bc000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b41046d0 0x7f93b4114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93bc000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4114a90 con 0x7f93b4103420 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93bc000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4114c00 con 0x7f93b41046d0 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93b9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93b9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58582/0 (socket says 172.21.15.60:58582) 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93b9600700 1 -- 172.21.15.60:0/4216392846 learned_addr learned my addr 172.21.15.60:0/4216392846 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.406+0000 7f93b8c00700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b41046d0 0x7f93b4114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b9600700 1 -- 172.21.15.60:0/4216392846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b41046d0 msgr2=0x7f93b4114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b9600700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b41046d0 0x7f93b4114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b9600700 1 -- 172.21.15.60:0/4216392846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0005040 con 0x7f93b4103420 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b9600700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93a8002a50 tx=0x7f93a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a8007cc0 con 0x7f93b4103420 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93a800f040 con 0x7f93b4103420 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4119660 con 0x7f93b4103420 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a8009640 con 0x7f93b4103420 2024-04-12T13:53:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.407+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b4119c20 con 0x7f93b4103420 2024-04-12T13:53:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.408+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b404c710 con 0x7f93b4103420 2024-04-12T13:53:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.410+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f93a80097a0 con 0x7f93b4103420 2024-04-12T13:53:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.411+0000 7f93b1600700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 0x7f939c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.411+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f93a808e850 con 0x7f93b4103420 2024-04-12T13:53:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.411+0000 7f93b8c00700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 0x7f939c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.412+0000 7f93b8c00700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 0x7f939c0710b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f93a000b970 tx=0x7f93a0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.415+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f93a805af60 con 0x7f93b4103420 2024-04-12T13:53:06.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.666+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93b4108a10 con 0x7f939c06ec00 2024-04-12T13:53:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.668+0000 7f93b1600700 1 -- 172.21.15.60:0/4216392846 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f93b4108a10 con 0x7f939c06ec00 2024-04-12T13:53:06.670 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:53:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mds", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "crash" 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "16/21 daemons upgraded", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:53:06.671 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 msgr2=0x7f939c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 0x7f939c0710b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f93a000b970 tx=0x7f93a0009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 msgr2=0x7f93b4113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93a8002a50 tx=0x7f93a80046b0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 shutdown_connections 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f939c06ec00 0x7f939c0710b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b4103420 0x7f93b4113f50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 --2- 172.21.15.60:0/4216392846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b41046d0 0x7f93b4114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.670+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 >> 172.21.15.60:0/4216392846 conn(0x7f93b4072640 msgr2=0x7f93b4073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:06.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.671+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 shutdown_connections 2024-04-12T13:53:06.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.671+0000 7f93bc000700 1 -- 172.21.15.60:0/4216392846 wait complete. 2024-04-12T13:53:06.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:06 smithi110 ceph-mon[82130]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:06.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:06 smithi110 ceph-mon[82130]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:06.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:06 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2031379194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:06.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:06 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/438524891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 -- 172.21.15.60:0/3884239463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 msgr2=0x7f82a00ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3884239463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a00ff410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8290004940 tx=0x7f8290009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 -- 172.21.15.60:0/3884239463 shutdown_connections 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3884239463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 0x7f82a0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3884239463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a00ff410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 -- 172.21.15.60:0/3884239463 >> 172.21.15.60:0/3884239463 conn(0x7f82a00fa950 msgr2=0x7f82a00fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 -- 172.21.15.60:0/3884239463 shutdown_connections 2024-04-12T13:53:06.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.817+0000 7f82a4e00700 1 -- 172.21.15.60:0/3884239463 wait complete. 2024-04-12T13:53:06.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.818+0000 7f82a4e00700 1 Processor -- start 2024-04-12T13:53:06.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.818+0000 7f82a4e00700 1 -- start start 2024-04-12T13:53:06.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f82a4e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f82a4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 0x7f82a0110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f82a4e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0110650 con 0x7f82a00ff000 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f82a4e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01107c0 con 0x7f82a01002b0 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58590/0 (socket says 172.21.15.60:58590) 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 -- 172.21.15.60:0/3508001711 learned_addr learned my addr 172.21.15.60:0/3508001711 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829d400700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 0x7f82a0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 -- 172.21.15.60:0/3508001711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 msgr2=0x7f82a0110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 0x7f82a0110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.819+0000 7f829de00700 1 -- 172.21.15.60:0/3508001711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290005040 con 0x7f82a00ff000 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f829de00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f829000b3b0 tx=0x7f8290009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f829000e040 con 0x7f82a00ff000 2024-04-12T13:53:06.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a01151c0 con 0x7f82a00ff000 2024-04-12T13:53:06.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8290004290 con 0x7f82a00ff000 2024-04-12T13:53:06.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f829001c630 con 0x7f82a00ff000 2024-04-12T13:53:06.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.820+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a0115780 con 0x7f82a00ff000 2024-04-12T13:53:06.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.821+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a004c710 con 0x7f82a00ff000 2024-04-12T13:53:06.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.822+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f829000bbf0 con 0x7f82a00ff000 2024-04-12T13:53:06.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.823+0000 7f8296000700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 0x7f82840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:06.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.823+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f829008ff30 con 0x7f82a00ff000 2024-04-12T13:53:06.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.823+0000 7f829d400700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 0x7f82840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:06.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.824+0000 7f829d400700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 0x7f82840710b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f828c004d60 tx=0x7f828c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:06.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:06.828+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f829005c620 con 0x7f82a00ff000 2024-04-12T13:53:06.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:06 smithi060 ceph-mon[94333]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:06 smithi060 ceph-mon[94333]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:06 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2031379194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:06.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:06 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/438524891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:53:07.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.147+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f82a0115c80 con 0x7f82a00ff000 2024-04-12T13:53:07.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.147+0000 7f8296000700 1 -- 172.21.15.60:0/3508001711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f829005c1b0 con 0x7f82a00ff000 2024-04-12T13:53:07.150 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:53:07.151 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:53:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 msgr2=0x7f82840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 0x7f82840710b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f828c004d60 tx=0x7f828c00b040 comp rx=0 tx=0).stop 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 msgr2=0x7f82a010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f829000b3b0 tx=0x7f8290009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 shutdown_connections 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f828406ec00 0x7f82840710b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82a00ff000 0x7f82a010fb10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 --2- 172.21.15.60:0/3508001711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a01002b0 0x7f82a0110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.150+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 >> 172.21.15.60:0/3508001711 conn(0x7f82a00fa950 msgr2=0x7f82a00fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.151+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 shutdown_connections 2024-04-12T13:53:07.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:07.151+0000 7f82a4e00700 1 -- 172.21.15.60:0/3508001711 wait complete. 2024-04-12T13:53:07.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:07 smithi060 ceph-mon[94333]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:07.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:07 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3508001711' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:53:07.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:07 smithi110 ceph-mon[82130]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:07.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:07 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3508001711' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:53:08.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:08 smithi060 ceph-mon[94333]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:08 smithi110 ceph-mon[82130]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:09 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:10.154 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:10.155 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:09 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:10.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:10 smithi110 ceph-mon[82130]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:11.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:10 smithi060 ceph-mon[94333]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:12.146 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.146 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.146 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.146 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:11 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:11 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:12.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:12 smithi110 ceph-mon[82130]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:13.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:12 smithi060 ceph-mon[94333]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:15.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:14 smithi060 ceph-mon[94333]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:15.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:14 smithi110 ceph-mon[82130]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:16.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:16 smithi060 ceph-mon[94333]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:16.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:16 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:17.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:16 smithi110 ceph-mon[82130]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:17.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:17.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:16 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:19.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:18 smithi060 ceph-mon[94333]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:18 smithi110 ceph-mon[82130]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:21.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:20 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:21.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:20 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:23.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:22 smithi060 ceph-mon[94333]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:23.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:22 smithi110 ceph-mon[82130]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:24.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:23 smithi060 ceph-mon[94333]: Upgrade: Updating prometheus.smithi060 2024-04-12T13:53:24.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:23 smithi060 ceph-mon[94333]: Deploying daemon prometheus.smithi060 on smithi060 2024-04-12T13:53:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:23 smithi110 ceph-mon[82130]: Upgrade: Updating prometheus.smithi060 2024-04-12T13:53:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:23 smithi110 ceph-mon[82130]: Deploying daemon prometheus.smithi060 on smithi060 2024-04-12T13:53:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:24 smithi060 ceph-mon[94333]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:25.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:24 smithi110 ceph-mon[82130]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:27.142 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:26 smithi060 ceph-mon[94333]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:26 smithi110 ceph-mon[82130]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:28 smithi060 ceph-mon[94333]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:28 smithi110 ceph-mon[82130]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:31.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:30 smithi060 ceph-mon[94333]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:30 smithi110 ceph-mon[82130]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:32.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:32.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:32.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:35.029 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:34 smithi060 ceph-mon[94333]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:34 smithi110 ceph-mon[82130]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:37.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:36 smithi060 ceph-mon[94333]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:37.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:36 smithi110 ceph-mon[82130]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 -- 172.21.15.60:0/1304456521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 msgr2=0x7fc87c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 --2- 172.21.15.60:0/1304456521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c102390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc868004940 tx=0x7fc868009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 -- 172.21.15.60:0/1304456521 shutdown_connections 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 --2- 172.21.15.60:0/1304456521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c102390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 --2- 172.21.15.60:0/1304456521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc87c0662f0 0x7fc87c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.325+0000 7fc883000700 1 -- 172.21.15.60:0/1304456521 >> 172.21.15.60:0/1304456521 conn(0x7fc87c0f74c0 msgr2=0x7fc87c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.326+0000 7fc883000700 1 -- 172.21.15.60:0/1304456521 shutdown_connections 2024-04-12T13:53:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.326+0000 7fc883000700 1 -- 172.21.15.60:0/1304456521 wait complete. 2024-04-12T13:53:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 Processor -- start 2024-04-12T13:53:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 -- start start 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc87c0662f0 0x7fc87c10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1107a0 con 0x7fc87c0fff70 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.327+0000 7fc883000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c110ff0 con 0x7fc87c0662f0 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42314/0 (socket says 172.21.15.60:42314) 2024-04-12T13:53:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 -- 172.21.15.60:0/2756432499 learned_addr learned my addr 172.21.15.60:0/2756432499 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 -- 172.21.15.60:0/2756432499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc87c0662f0 msgr2=0x7fc87c10fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc87c0662f0 0x7fc87c10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.328+0000 7fc87b400700 1 -- 172.21.15.60:0/2756432499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868005040 con 0x7fc87c0fff70 2024-04-12T13:53:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.329+0000 7fc87b400700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc86800b3b0 tx=0x7fc868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.329+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc86800e040 con 0x7fc87c0fff70 2024-04-12T13:53:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.329+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc868004290 con 0x7fc87c0fff70 2024-04-12T13:53:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.329+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc86801c630 con 0x7fc87c0fff70 2024-04-12T13:53:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.329+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c111270 con 0x7fc87c0fff70 2024-04-12T13:53:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.330+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c1117b0 con 0x7fc87c0fff70 2024-04-12T13:53:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.331+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0f8ff0 con 0x7fc87c0fff70 2024-04-12T13:53:37.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.332+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc86800bbf0 con 0x7fc87c0fff70 2024-04-12T13:53:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.333+0000 7fc873e00700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 0x7fc8600710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.334+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc86808fe60 con 0x7fc87c0fff70 2024-04-12T13:53:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.334+0000 7fc87be00700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 0x7fc8600710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.335+0000 7fc87be00700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 0x7fc8600710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc87c066030 tx=0x7fc86c009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.339+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc86805c5d0 con 0x7fc87c0fff70 2024-04-12T13:53:37.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.630+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc87c111a20 con 0x7fc86006ec10 2024-04-12T13:53:37.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.633+0000 7fc873e00700 1 -- 172.21.15.60:0/2756432499 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fc87c111a20 con 0x7fc86006ec10 2024-04-12T13:53:37.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 msgr2=0x7fc8600710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 0x7fc8600710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc87c066030 tx=0x7fc86c009ce0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 msgr2=0x7fc87c1101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc86800b3b0 tx=0x7fc868009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 shutdown_connections 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc86006ec10 0x7fc8600710c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc87c0662f0 0x7fc87c10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 --2- 172.21.15.60:0/2756432499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc87c0fff70 0x7fc87c1101a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 >> 172.21.15.60:0/2756432499 conn(0x7fc87c0f74c0 msgr2=0x7fc87c0fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 shutdown_connections 2024-04-12T13:53:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.637+0000 7fc883000700 1 -- 172.21.15.60:0/2756432499 wait complete. 2024-04-12T13:53:37.656 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 -- 172.21.15.60:0/1121506210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c071f50 msgr2=0x7fd72c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 --2- 172.21.15.60:0/1121506210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c071f50 0x7fd72c070460 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd71c004940 tx=0x7fd71c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 -- 172.21.15.60:0/1121506210 shutdown_connections 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 --2- 172.21.15.60:0/1121506210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c0709a0 0x7fd72c070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 --2- 172.21.15.60:0/1121506210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c071f50 0x7fd72c070460 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 -- 172.21.15.60:0/1121506210 >> 172.21.15.60:0/1121506210 conn(0x7fd72c0f8530 msgr2=0x7fd72c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 -- 172.21.15.60:0/1121506210 shutdown_connections 2024-04-12T13:53:37.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.793+0000 7fd731200700 1 -- 172.21.15.60:0/1121506210 wait complete. 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.794+0000 7fd731200700 1 Processor -- start 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.794+0000 7fd731200700 1 -- start start 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd731200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd731200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 0x7fd72c1145d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd731200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c114bd0 con 0x7fd72c0709a0 2024-04-12T13:53:37.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd731200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c115420 con 0x7fd72c071f50 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd729e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd729e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42328/0 (socket says 172.21.15.60:42328) 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd729e00700 1 -- 172.21.15.60:0/752333737 learned_addr learned my addr 172.21.15.60:0/752333737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.795+0000 7fd729400700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 0x7fd72c1145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd729e00700 1 -- 172.21.15.60:0/752333737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 msgr2=0x7fd72c1145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:37.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd729e00700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 0x7fd72c1145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd729e00700 1 -- 172.21.15.60:0/752333737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c005040 con 0x7fd72c0709a0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd729400700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 0x7fd72c1145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd729e00700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd71c00e040 con 0x7fd72c0709a0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd71c00bcc0 con 0x7fd72c0709a0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd71c01c630 con 0x7fd72c0709a0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c1156a0 con 0x7fd72c0709a0 2024-04-12T13:53:37.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.796+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c115be0 con 0x7fd72c0709a0 2024-04-12T13:53:37.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.798+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c05f5f0 con 0x7fd72c0709a0 2024-04-12T13:53:37.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.799+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd71c013980 con 0x7fd72c0709a0 2024-04-12T13:53:37.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.800+0000 7fd722000700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 0x7fd7100710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:37.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.800+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fd71c08fdb0 con 0x7fd72c0709a0 2024-04-12T13:53:37.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.800+0000 7fd729400700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 0x7fd7100710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:37.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.801+0000 7fd729400700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 0x7fd7100710b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd718007fd0 tx=0x7fd718009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:37.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:37.806+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd71c05c520 con 0x7fd72c0709a0 2024-04-12T13:53:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.064+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd72c05f5f0 con 0x7fd71006ec00 2024-04-12T13:53:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.067+0000 7fd722000700 1 -- 172.21.15.60:0/752333737 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fd72c05f5f0 con 0x7fd71006ec00 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.069+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 msgr2=0x7fd7100710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.069+0000 7fd731200700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 0x7fd7100710b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd718007fd0 tx=0x7fd718009040 comp rx=0 tx=0).stop 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 msgr2=0x7fd72c114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 shutdown_connections 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd71006ec00 0x7fd7100710b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd72c0709a0 0x7fd72c114090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 --2- 172.21.15.60:0/752333737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd72c071f50 0x7fd72c1145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 >> 172.21.15.60:0/752333737 conn(0x7fd72c0f8530 msgr2=0x7fd72c0f9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 shutdown_connections 2024-04-12T13:53:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.070+0000 7fd731200700 1 -- 172.21.15.60:0/752333737 wait complete. 2024-04-12T13:53:38.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 -- 172.21.15.60:0/3759439065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 msgr2=0x7fd650070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 --2- 172.21.15.60:0/3759439065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd650070d60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd63c004940 tx=0x7fd63c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 -- 172.21.15.60:0/3759439065 shutdown_connections 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 --2- 172.21.15.60:0/3759439065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd650070d60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 --2- 172.21.15.60:0/3759439065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 0x7fd6500703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.228+0000 7fd657a00700 1 -- 172.21.15.60:0/3759439065 >> 172.21.15.60:0/3759439065 conn(0x7fd6500f8530 msgr2=0x7fd6500fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.229+0000 7fd657a00700 1 -- 172.21.15.60:0/3759439065 shutdown_connections 2024-04-12T13:53:38.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.229+0000 7fd657a00700 1 -- 172.21.15.60:0/3759439065 wait complete. 2024-04-12T13:53:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.229+0000 7fd657a00700 1 Processor -- start 2024-04-12T13:53:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd657a00700 1 -- start start 2024-04-12T13:53:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd657a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd657a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 0x7fd650110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd657a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650110760 con 0x7fd6500708f0 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd657a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650110fb0 con 0x7fd650071ea0 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd655000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd655000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42348/0 (socket says 172.21.15.60:42348) 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.230+0000 7fd655000700 1 -- 172.21.15.60:0/3683156719 learned_addr learned my addr 172.21.15.60:0/3683156719 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.231+0000 7fd64fe00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 0x7fd650110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.231+0000 7fd655000700 1 -- 172.21.15.60:0/3683156719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 msgr2=0x7fd650110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.231+0000 7fd655000700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 0x7fd650110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.231+0000 7fd655000700 1 -- 172.21.15.60:0/3683156719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c005040 con 0x7fd6500708f0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd655000700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd644002a80 tx=0x7fd644004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd644007cc0 con 0x7fd6500708f0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd64400f040 con 0x7fd6500708f0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64400dad0 con 0x7fd6500708f0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd650111290 con 0x7fd6500708f0 2024-04-12T13:53:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.232+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6501117d0 con 0x7fd6500708f0 2024-04-12T13:53:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.233+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65005f5f0 con 0x7fd6500708f0 2024-04-12T13:53:38.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.234+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd64400dc30 con 0x7fd6500708f0 2024-04-12T13:53:38.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.235+0000 7fd64cc00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 0x7fd6380710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.236+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fd64408e7f0 con 0x7fd6500708f0 2024-04-12T13:53:38.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.236+0000 7fd64fe00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 0x7fd6380710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.237+0000 7fd64fe00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 0x7fd6380710c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd63c004f90 tx=0x7fd63c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:38.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.241+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fd64405aee0 con 0x7fd6500708f0 2024-04-12T13:53:38.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.483+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd650111bb0 con 0x7fd63806ec10 2024-04-12T13:53:38.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.498+0000 7fd64cc00700 1 -- 172.21.15.60:0/3683156719 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd650111bb0 con 0x7fd63806ec10 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (11m) 0s ago 22m 14.8M - 0.25.0 c8568f914cd2 58d2f033f2e8 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (7m) 0s ago 22m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (6m) 29s ago 21m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 0s ago 22m - - 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (118s) 0s ago 15m 11.6M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (2m) 0s ago 15m 83.6M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (87s) 29s ago 15m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (59s) 29s ago 15m 11.1M - 19.0.0-2778-ga971fd5f b96c509eef84 0c26cec850b0 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (10m) 0s ago 24m 513M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (9m) 29s ago 21m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (8m) 0s ago 24m 60.7M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:53:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (8m) 29s ago 21m 43.8M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (40s) 0s ago 22m 7151k - 1.5.0 0da6a335fe13 9dc5b1bd6177 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (34s) 29s ago 21m 6819k - 1.5.0 0da6a335fe13 f4688cc75136 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 0s ago 20m 113M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 0s ago 19m 200M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 0s ago 18m 121M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (4m) 29s ago 18m 115M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (3m) 29s ago 17m 95.0M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (3m) 29s ago 17m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:53:38.501 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (8s) 0s ago 21m 40.3M - 2.43.0 a07b618ecd1d 8e9ff49cdadb 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 msgr2=0x7fd6380710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 0x7fd6380710c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd63c004f90 tx=0x7fd63c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 msgr2=0x7fd65010fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd644002a80 tx=0x7fd644004600 comp rx=0 tx=0).stop 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 shutdown_connections 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fd63806ec10 0x7fd6380710c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6500708f0 0x7fd65010fc20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 --2- 172.21.15.60:0/3683156719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd650071ea0 0x7fd650110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 >> 172.21.15.60:0/3683156719 conn(0x7fd6500f8530 msgr2=0x7fd6500f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:38.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 shutdown_connections 2024-04-12T13:53:38.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.502+0000 7fd657a00700 1 -- 172.21.15.60:0/3683156719 wait complete. 2024-04-12T13:53:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 -- 172.21.15.60:0/2384883448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 msgr2=0x7fa44c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 --2- 172.21.15.60:0/2384883448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c102390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa438004940 tx=0x7fa438009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 -- 172.21.15.60:0/2384883448 shutdown_connections 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 --2- 172.21.15.60:0/2384883448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c102390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 --2- 172.21.15.60:0/2384883448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 0x7fa44c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 -- 172.21.15.60:0/2384883448 >> 172.21.15.60:0/2384883448 conn(0x7fa44c0f74c0 msgr2=0x7fa44c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 -- 172.21.15.60:0/2384883448 shutdown_connections 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.658+0000 7fa451e00700 1 -- 172.21.15.60:0/2384883448 wait complete. 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.659+0000 7fa451e00700 1 Processor -- start 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa451e00700 1 -- start start 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa451e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 0x7fa44c10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa451e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa451e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c110730 con 0x7fa44c0fff70 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa451e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c110f80 con 0x7fa44c0662f0 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa44a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa44a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42352/0 (socket says 172.21.15.60:42352) 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.660+0000 7fa44a000700 1 -- 172.21.15.60:0/2268554278 learned_addr learned my addr 172.21.15.60:0/2268554278 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.661+0000 7fa44aa00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 0x7fa44c10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.661+0000 7fa44a000700 1 -- 172.21.15.60:0/2268554278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 msgr2=0x7fa44c10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.661+0000 7fa44a000700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 0x7fa44c10fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.661+0000 7fa44a000700 1 -- 172.21.15.60:0/2268554278 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438005040 con 0x7fa44c0fff70 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.661+0000 7fa44a000700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa438013870 tx=0x7fa438009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.662+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa438021070 con 0x7fa44c0fff70 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.662+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa43801c400 con 0x7fa44c0fff70 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.662+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa43800e070 con 0x7fa44c0fff70 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.662+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c111200 con 0x7fa44c0fff70 2024-04-12T13:53:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.662+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c111740 con 0x7fa44c0fff70 2024-04-12T13:53:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.663+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c05f5f0 con 0x7fa44c0fff70 2024-04-12T13:53:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.664+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa43801ca20 con 0x7fa44c0fff70 2024-04-12T13:53:38.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.666+0000 7fa442a00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 0x7fa4300710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:38.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.666+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fa438090380 con 0x7fa44c0fff70 2024-04-12T13:53:38.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.666+0000 7fa44aa00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 0x7fa4300710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:38.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.667+0000 7fa44aa00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 0x7fa4300710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa43c004600 tx=0x7fa43c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:38.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.670+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fa43805cbb0 con 0x7fa44c0fff70 2024-04-12T13:53:38.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:38.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:38.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:38 smithi060 ceph-mon[94333]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:38.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:38 smithi060 ceph-mon[94333]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:38 smithi110 ceph-mon[82130]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:38.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:38 smithi110 ceph-mon[82130]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:38.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.988+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa44c1058d0 con 0x7fa44c0fff70 2024-04-12T13:53:38.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.988+0000 7fa442a00700 1 -- 172.21.15.60:0/2268554278 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa438004490 con 0x7fa44c0fff70 2024-04-12T13:53:38.989 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 14 2024-04-12T13:53:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:53:38.991 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:53:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 msgr2=0x7fa4300710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 0x7fa4300710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa43c004600 tx=0x7fa43c00b040 comp rx=0 tx=0).stop 2024-04-12T13:53:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 msgr2=0x7fa44c110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa438013870 tx=0x7fa438009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 shutdown_connections 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa43006ec00 0x7fa4300710b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa44c0662f0 0x7fa44c10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 --2- 172.21.15.60:0/2268554278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa44c0fff70 0x7fa44c110130 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 >> 172.21.15.60:0/2268554278 conn(0x7fa44c0f74c0 msgr2=0x7fa44c0fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 shutdown_connections 2024-04-12T13:53:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:38.991+0000 7fa451e00700 1 -- 172.21.15.60:0/2268554278 wait complete. 2024-04-12T13:53:39.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 -- 172.21.15.60:0/2064185930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140fff70 msgr2=0x7f5014102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 --2- 172.21.15.60:0/2064185930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140fff70 0x7f5014102390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5004004940 tx=0x7f5004009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 -- 172.21.15.60:0/2064185930 shutdown_connections 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 --2- 172.21.15.60:0/2064185930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140fff70 0x7f5014102390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 --2- 172.21.15.60:0/2064185930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140662f0 0x7f50140ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 -- 172.21.15.60:0/2064185930 >> 172.21.15.60:0/2064185930 conn(0x7f50140f74c0 msgr2=0x7f50140f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 -- 172.21.15.60:0/2064185930 shutdown_connections 2024-04-12T13:53:39.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.138+0000 7f501c800700 1 -- 172.21.15.60:0/2064185930 wait complete. 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.139+0000 7f501c800700 1 Processor -- start 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.139+0000 7f501c800700 1 -- start start 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f501c800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f501c800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140fff70 0x7f5014110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f501c800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5014110850 con 0x7f50140662f0 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f501c800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5014110f90 con 0x7f50140fff70 2024-04-12T13:53:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f5019e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f5019e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42374/0 (socket says 172.21.15.60:42374) 2024-04-12T13:53:39.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f5019e00700 1 -- 172.21.15.60:0/3095143145 learned_addr learned my addr 172.21.15.60:0/3095143145 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f5019400700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140fff70 0x7f5014110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.140+0000 7f5019e00700 1 -- 172.21.15.60:0/3095143145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140fff70 msgr2=0x7f5014110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f5019e00700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140fff70 0x7f5014110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f5019e00700 1 -- 172.21.15.60:0/3095143145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004005040 con 0x7f50140662f0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f5019e00700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5008002a50 tx=0x7f5008004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5008007cc0 con 0x7f50140662f0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f500800f040 con 0x7f50140662f0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5014111270 con 0x7f50140662f0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f500800da40 con 0x7f50140662f0 2024-04-12T13:53:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.141+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5014111830 con 0x7f50140662f0 2024-04-12T13:53:39.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.142+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50140f8ff0 con 0x7f50140662f0 2024-04-12T13:53:39.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.143+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f50080097c0 con 0x7f50140662f0 2024-04-12T13:53:39.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.144+0000 7f500e000700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 0x7f4ffc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.145+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f500808e870 con 0x7f50140662f0 2024-04-12T13:53:39.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.145+0000 7f5019400700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 0x7f4ffc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.145+0000 7f5019400700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 0x7f4ffc0710c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f500400b3b0 tx=0x7f5004009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:39.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.153+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f500805af60 con 0x7f50140662f0 2024-04-12T13:53:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.443+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50141059f0 con 0x7f50140662f0 2024-04-12T13:53:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.444+0000 7f500e000700 1 -- 172.21.15.60:0/3095143145 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1935 (secure 0 0 0) 0x7f500805aaf0 con 0x7f50140662f0 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 35 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:52:40.918247+0000 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:53:39.446 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 101 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34456} 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:53:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34456 members: 34456 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:34456} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:39.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:53:39.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 msgr2=0x7f4ffc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 0x7f4ffc0710c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f500400b3b0 tx=0x7f5004009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:39.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 msgr2=0x7f501410fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5008002a50 tx=0x7f5008004600 comp rx=0 tx=0).stop 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 shutdown_connections 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4ffc06ec10 0x7f4ffc0710c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50140662f0 0x7f501410fd10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 --2- 172.21.15.60:0/3095143145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50140fff70 0x7f5014110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 >> 172.21.15.60:0/3095143145 conn(0x7f50140f74c0 msgr2=0x7f50140fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 shutdown_connections 2024-04-12T13:53:39.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.448+0000 7f501c800700 1 -- 172.21.15.60:0/3095143145 wait complete. 2024-04-12T13:53:39.451 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-04-12T13:53:39.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 -- 172.21.15.60:0/4239284678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28100030 msgr2=0x7fda28102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 --2- 172.21.15.60:0/4239284678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28100030 0x7fda28102410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda14004940 tx=0x7fda14009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 -- 172.21.15.60:0/4239284678 shutdown_connections 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 --2- 172.21.15.60:0/4239284678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28100030 0x7fda28102410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 --2- 172.21.15.60:0/4239284678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28066230 0x7fda280ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 -- 172.21.15.60:0/4239284678 >> 172.21.15.60:0/4239284678 conn(0x7fda280f74c0 msgr2=0x7fda280f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 -- 172.21.15.60:0/4239284678 shutdown_connections 2024-04-12T13:53:39.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.613+0000 7fda2de00700 1 -- 172.21.15.60:0/4239284678 wait complete. 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 Processor -- start 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 -- start start 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28100030 0x7fda281101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281107a0 con 0x7fda28066230 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.614+0000 7fda2de00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28110ff0 con 0x7fda28100030 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59774/0 (socket says 172.21.15.60:59774) 2024-04-12T13:53:39.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 -- 172.21.15.60:0/1567323176 learned_addr learned my addr 172.21.15.60:0/1567323176 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26000700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28100030 0x7fda281101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 -- 172.21.15.60:0/1567323176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28100030 msgr2=0x7fda281101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28100030 0x7fda281101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.615+0000 7fda26a00700 1 -- 172.21.15.60:0/1567323176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14005040 con 0x7fda28066230 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda26a00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fda18002a80 tx=0x7fda18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:39.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda18007cc0 con 0x7fda28066230 2024-04-12T13:53:39.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda281112d0 con 0x7fda28066230 2024-04-12T13:53:39.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda1800f040 con 0x7fda28066230 2024-04-12T13:53:39.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda1800dad0 con 0x7fda28066230 2024-04-12T13:53:39.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.616+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda28111810 con 0x7fda28066230 2024-04-12T13:53:39.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.617+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2805f5f0 con 0x7fda28066230 2024-04-12T13:53:39.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.618+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fda1800dc30 con 0x7fda28066230 2024-04-12T13:53:39.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.619+0000 7fda1ea00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 0x7fda0c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:39.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.619+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fda1808e8a0 con 0x7fda28066230 2024-04-12T13:53:39.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.620+0000 7fda26000700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 0x7fda0c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:39.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.620+0000 7fda26000700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 0x7fda0c0710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda1400b970 tx=0x7fda14009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:39.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.625+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fda1805af10 con 0x7fda28066230 2024-04-12T13:53:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.880+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda28111ba0 con 0x7fda0c06ec00 2024-04-12T13:53:39.881 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:39 smithi060 ceph-mon[94333]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:39.882 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:39 smithi060 ceph-mon[94333]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:39.882 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:39 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2268554278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:39.882 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:39 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3095143145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:53:39.882 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:39 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:39.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.883+0000 7fda1ea00700 1 -- 172.21.15.60:0/1567323176 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fda28111ba0 con 0x7fda0c06ec00 2024-04-12T13:53:39.884 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:53:39.884 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:53:39.884 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mds", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "crash" 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "16/21 daemons upgraded", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:53:39.885 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 msgr2=0x7fda0c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 0x7fda0c0710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda1400b970 tx=0x7fda14009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 msgr2=0x7fda2810fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fda18002a80 tx=0x7fda18004600 comp rx=0 tx=0).stop 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 shutdown_connections 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda0c06ec00 0x7fda0c0710b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda28066230 0x7fda2810fc60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 --2- 172.21.15.60:0/1567323176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda28100030 0x7fda281101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.887+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 >> 172.21.15.60:0/1567323176 conn(0x7fda280f74c0 msgr2=0x7fda280fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.888+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 shutdown_connections 2024-04-12T13:53:39.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:39.888+0000 7fda2de00700 1 -- 172.21.15.60:0/1567323176 wait complete. 2024-04-12T13:53:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:39 smithi110 ceph-mon[82130]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:39 smithi110 ceph-mon[82130]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:39 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2268554278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:39 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3095143145' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:53:39.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:39 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 -- 172.21.15.60:0/2656901781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba700709a0 msgr2=0x7fba70070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 --2- 172.21.15.60:0/2656901781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba700709a0 0x7fba70070e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fba5c004940 tx=0x7fba5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 -- 172.21.15.60:0/2656901781 shutdown_connections 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 --2- 172.21.15.60:0/2656901781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba700709a0 0x7fba70070e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 --2- 172.21.15.60:0/2656901781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba70071f50 0x7fba70070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 -- 172.21.15.60:0/2656901781 >> 172.21.15.60:0/2656901781 conn(0x7fba700f8530 msgr2=0x7fba700fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.051+0000 7fba75400700 1 -- 172.21.15.60:0/2656901781 shutdown_connections 2024-04-12T13:53:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.052+0000 7fba75400700 1 -- 172.21.15.60:0/2656901781 wait complete. 2024-04-12T13:53:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.052+0000 7fba75400700 1 Processor -- start 2024-04-12T13:53:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.052+0000 7fba75400700 1 -- start start 2024-04-12T13:53:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba75400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba700709a0 0x7fba7010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba75400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba75400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70110780 con 0x7fba70071f50 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba75400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70110fd0 con 0x7fba700709a0 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba6de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba6de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59802/0 (socket says 172.21.15.60:59802) 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba6de00700 1 -- 172.21.15.60:0/3741429353 learned_addr learned my addr 172.21.15.60:0/3741429353 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:53:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.053+0000 7fba6e800700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba700709a0 0x7fba7010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba6de00700 1 -- 172.21.15.60:0/3741429353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba700709a0 msgr2=0x7fba7010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba6de00700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba700709a0 0x7fba7010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba6de00700 1 -- 172.21.15.60:0/3741429353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c005040 con 0x7fba70071f50 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba6de00700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b3b0 tx=0x7fba5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c00e040 con 0x7fba70071f50 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba5c004290 con 0x7fba70071f50 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba70111250 con 0x7fba70071f50 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c01c630 con 0x7fba70071f50 2024-04-12T13:53:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.054+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba70111790 con 0x7fba70071f50 2024-04-12T13:53:40.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.056+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7005f5f0 con 0x7fba70071f50 2024-04-12T13:53:40.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.057+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fba5c00bbf0 con 0x7fba70071f50 2024-04-12T13:53:40.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.058+0000 7fba66a00700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 0x7fba540710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:53:40.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.058+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fba5c08fe60 con 0x7fba70071f50 2024-04-12T13:53:40.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.058+0000 7fba6e800700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 0x7fba540710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:53:40.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.059+0000 7fba6e800700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 0x7fba540710c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba70071c90 tx=0x7fba6000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:53:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.063+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fba5c05c5d0 con 0x7fba70071f50 2024-04-12T13:53:40.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.398+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fba7004bed0 con 0x7fba70071f50 2024-04-12T13:53:40.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.399+0000 7fba66a00700 1 -- 172.21.15.60:0/3741429353 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7fba5c05c160 con 0x7fba70071f50 2024-04-12T13:53:40.400 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:53:40.400 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:53:40.400 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 msgr2=0x7fba540710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 0x7fba540710c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba70071c90 tx=0x7fba6000b040 comp rx=0 tx=0).stop 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 msgr2=0x7fba70110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b3b0 tx=0x7fba5c009e30 comp rx=0 tx=0).stop 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 shutdown_connections 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fba5406ec10 0x7fba540710c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba700709a0 0x7fba7010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 --2- 172.21.15.60:0/3741429353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba70071f50 0x7fba70110180 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:53:40.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 >> 172.21.15.60:0/3741429353 conn(0x7fba700f8530 msgr2=0x7fba700f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:53:40.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 shutdown_connections 2024-04-12T13:53:40.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:53:40.402+0000 7fba75400700 1 -- 172.21.15.60:0/3741429353 wait complete. 2024-04-12T13:53:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:40 smithi060 ceph-mon[94333]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:40 smithi060 ceph-mon[94333]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:40.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:40 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3741429353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:53:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:40 smithi110 ceph-mon[82130]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:40.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:40 smithi110 ceph-mon[82130]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:53:40.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:40 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3741429353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:53:43.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:42 smithi060 ceph-mon[94333]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:43.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:42 smithi110 ceph-mon[82130]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:44.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:45.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:44 smithi060 ceph-mon[94333]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:45.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:44 smithi110 ceph-mon[82130]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:53:46.680 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:46 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:46.729 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.730 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:46.731 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:46 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:53:48.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:48 smithi110 ceph-mon[82130]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:48.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:48 smithi060 ceph-mon[94333]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:49.722 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:49 smithi060 ceph-mon[94333]: Upgrade: Updating alertmanager.smithi060 2024-04-12T13:53:49.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:49 smithi060 ceph-mon[94333]: Deploying daemon alertmanager.smithi060 on smithi060 2024-04-12T13:53:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:49 smithi110 ceph-mon[82130]: Upgrade: Updating alertmanager.smithi060 2024-04-12T13:53:49.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:49 smithi110 ceph-mon[82130]: Deploying daemon alertmanager.smithi060 on smithi060 2024-04-12T13:53:50.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:50 smithi110 ceph-mon[82130]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:50.800 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:50 smithi060 ceph-mon[94333]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:52.728 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:52 smithi110 ceph-mon[82130]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:52.923 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:52 smithi060 ceph-mon[94333]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:54.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:54 smithi060 ceph-mon[94333]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:54.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:54 smithi110 ceph-mon[82130]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:56 smithi060 ceph-mon[94333]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:56.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:56 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:56 smithi110 ceph-mon[82130]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:56.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:53:56.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:56 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:53:58.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:58 smithi060 ceph-mon[94333]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:58.843 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:53:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:53:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:58 smithi110 ceph-mon[82130]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:53:58.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:53:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:00.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:00 smithi060 ceph-mon[94333]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:00.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:00 smithi110 ceph-mon[82130]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:02.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:02 smithi060 ceph-mon[94333]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:02.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:02.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:02 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:02 smithi110 ceph-mon[82130]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:02.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:02 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:04.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:04 smithi060 ceph-mon[94333]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:04.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:04.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:04 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:04 smithi110 ceph-mon[82130]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:04.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:04 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:06.634 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:06 smithi060 ceph-mon[94333]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:06.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:06 smithi110 ceph-mon[82130]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:08.873 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:08 smithi060 ceph-mon[94333]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:08.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:08 smithi110 ceph-mon[82130]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 -- 172.21.15.60:0/1891171655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc0071ea0 msgr2=0x7f3bc00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/1891171655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc0071ea0 0x7f3bc00703b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0004940 tx=0x7f3bb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 -- 172.21.15.60:0/1891171655 shutdown_connections 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/1891171655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc00708f0 0x7f3bc0070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/1891171655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc0071ea0 0x7f3bc00703b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 -- 172.21.15.60:0/1891171655 >> 172.21.15.60:0/1891171655 conn(0x7f3bc00f8580 msgr2=0x7f3bc00fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 -- 172.21.15.60:0/1891171655 shutdown_connections 2024-04-12T13:54:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.571+0000 7f3bc6e00700 1 -- 172.21.15.60:0/1891171655 wait complete. 2024-04-12T13:54:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.572+0000 7f3bc6e00700 1 Processor -- start 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.572+0000 7f3bc6e00700 1 -- start start 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bc6e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bc6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc0071ea0 0x7f3bc0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bc6e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0110700 con 0x7f3bc00708f0 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bc6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0110870 con 0x7f3bc0071ea0 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bbfe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43088/0 (socket says 172.21.15.60:43088) 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bbfe00700 1 -- 172.21.15.60:0/2938422043 learned_addr learned my addr 172.21.15.60:0/2938422043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.573+0000 7f3bbf400700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc0071ea0 0x7f3bc0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bbfe00700 1 -- 172.21.15.60:0/2938422043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc0071ea0 msgr2=0x7f3bc0110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bbfe00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc0071ea0 0x7f3bc0110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bbfe00700 1 -- 172.21.15.60:0/2938422043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0005040 con 0x7f3bc00708f0 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bbfe00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b970 tx=0x7f3bb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb000e040 con 0x7f3bc00708f0 2024-04-12T13:54:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bb0004290 con 0x7f3bc00708f0 2024-04-12T13:54:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc0115270 con 0x7f3bc00708f0 2024-04-12T13:54:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.574+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb001c630 con 0x7f3bc00708f0 2024-04-12T13:54:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.575+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc0115830 con 0x7f3bc00708f0 2024-04-12T13:54:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.576+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc004c710 con 0x7f3bc00708f0 2024-04-12T13:54:10.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.577+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3bb000bbf0 con 0x7f3bc00708f0 2024-04-12T13:54:10.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.578+0000 7f3bb7e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 0x7f3ba40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:10.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.578+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f3bb008fe90 con 0x7f3bc00708f0 2024-04-12T13:54:10.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.579+0000 7f3bbf400700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 0x7f3ba40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:10.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.579+0000 7f3bbf400700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 0x7f3ba40710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bac004990 tx=0x7f3bac009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.584+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f3bb005c580 con 0x7f3bc00708f0 2024-04-12T13:54:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.844+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc0103ea0 con 0x7f3ba406ec00 2024-04-12T13:54:10.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.847 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.848 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.849 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:10 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.847+0000 7f3bb7e00700 1 -- 172.21.15.60:0/2938422043 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f3bc0103ea0 con 0x7f3ba406ec00 2024-04-12T13:54:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 msgr2=0x7f3ba40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 0x7f3ba40710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bac004990 tx=0x7f3bac009ee0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 msgr2=0x7f3bc010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000b970 tx=0x7f3bb0009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 shutdown_connections 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f3ba406ec00 0x7f3ba40710b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3bc00708f0 0x7f3bc010fbc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 --2- 172.21.15.60:0/2938422043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bc0071ea0 0x7f3bc0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 >> 172.21.15.60:0/2938422043 conn(0x7f3bc00f8580 msgr2=0x7f3bc00f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 shutdown_connections 2024-04-12T13:54:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:10.850+0000 7f3bc6e00700 1 -- 172.21.15.60:0/2938422043 wait complete. 2024-04-12T13:54:10.870 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.980 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:10.981 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:10 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 -- 172.21.15.60:0/1153339168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b98071f50 msgr2=0x7f7b98070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 --2- 172.21.15.60:0/1153339168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b98071f50 0x7f7b98070460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7b88004940 tx=0x7f7b88009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 -- 172.21.15.60:0/1153339168 shutdown_connections 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 --2- 172.21.15.60:0/1153339168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b980709a0 0x7f7b98070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 --2- 172.21.15.60:0/1153339168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b98071f50 0x7f7b98070460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 -- 172.21.15.60:0/1153339168 >> 172.21.15.60:0/1153339168 conn(0x7f7b980f8530 msgr2=0x7f7b980fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 -- 172.21.15.60:0/1153339168 shutdown_connections 2024-04-12T13:54:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.012+0000 7f7b9e200700 1 -- 172.21.15.60:0/1153339168 wait complete. 2024-04-12T13:54:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.013+0000 7f7b9e200700 1 Processor -- start 2024-04-12T13:54:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.013+0000 7f7b9e200700 1 -- start start 2024-04-12T13:54:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b9e200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b9e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b98071f50 0x7f7b98110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b9e200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98110870 con 0x7f7b980709a0 2024-04-12T13:54:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b9e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98110fb0 con 0x7f7b98071f50 2024-04-12T13:54:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43108/0 (socket says 172.21.15.60:43108) 2024-04-12T13:54:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 -- 172.21.15.60:0/2417166615 learned_addr learned my addr 172.21.15.60:0/2417166615 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b96a00700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b98071f50 0x7f7b98110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 -- 172.21.15.60:0/2417166615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b98071f50 msgr2=0x7f7b98110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b98071f50 0x7f7b98110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.014+0000 7f7b97400700 1 -- 172.21.15.60:0/2417166615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88005040 con 0x7f7b980709a0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b97400700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800b970 tx=0x7f7b88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8800e040 con 0x7f7b980709a0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b88004290 con 0x7f7b980709a0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b98111230 con 0x7f7b980709a0 2024-04-12T13:54:11.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8801c630 con 0x7f7b980709a0 2024-04-12T13:54:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.015+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b981117f0 con 0x7f7b980709a0 2024-04-12T13:54:11.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.017+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9805f5f0 con 0x7f7b980709a0 2024-04-12T13:54:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.018+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7b8800bbf0 con 0x7f7b980709a0 2024-04-12T13:54:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.019+0000 7f7b8f400700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 0x7f7b7c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.020+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f7b8808fb50 con 0x7f7b980709a0 2024-04-12T13:54:11.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.020+0000 7f7b96a00700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 0x7f7b7c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.021+0000 7f7b96a00700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 0x7f7b7c0710c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.025+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7b8805c2c0 con 0x7f7b980709a0 2024-04-12T13:54:11.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.280+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b98111b00 con 0x7f7b7c06ec10 2024-04-12T13:54:11.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.282+0000 7f7b8f400700 1 -- 172.21.15.60:0/2417166615 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f7b98111b00 con 0x7f7b7c06ec10 2024-04-12T13:54:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.285+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 msgr2=0x7f7b7c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.285+0000 7f7b9e200700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 0x7f7b7c0710c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84009040 comp rx=0 tx=0).stop 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.285+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 msgr2=0x7f7b9810fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.285+0000 7f7b9e200700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800b970 tx=0x7f7b88009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 shutdown_connections 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7b7c06ec10 0x7f7b7c0710c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b980709a0 0x7f7b9810fd30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 --2- 172.21.15.60:0/2417166615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b98071f50 0x7f7b98110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 >> 172.21.15.60:0/2417166615 conn(0x7f7b980f8530 msgr2=0x7f7b980f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 shutdown_connections 2024-04-12T13:54:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.286+0000 7f7b9e200700 1 -- 172.21.15.60:0/2417166615 wait complete. 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 -- 172.21.15.60:0/3411866900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 msgr2=0x7ff360100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 --2- 172.21.15.60:0/3411866900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360100720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff34c004940 tx=0x7ff34c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 -- 172.21.15.60:0/3411866900 shutdown_connections 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 --2- 172.21.15.60:0/3411866900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360100720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 --2- 172.21.15.60:0/3411866900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3600ff000 0x7ff3600ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 -- 172.21.15.60:0/3411866900 >> 172.21.15.60:0/3411866900 conn(0x7ff3600fa950 msgr2=0x7ff3600fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.440+0000 7ff364e00700 1 -- 172.21.15.60:0/3411866900 shutdown_connections 2024-04-12T13:54:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.441+0000 7ff364e00700 1 -- 172.21.15.60:0/3411866900 wait complete. 2024-04-12T13:54:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.441+0000 7ff364e00700 1 Processor -- start 2024-04-12T13:54:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.441+0000 7ff364e00700 1 -- start start 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff364e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3600ff000 0x7ff36010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff364e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff364e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360110770 con 0x7ff3601002b0 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff364e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360110fc0 con 0x7ff3600ff000 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff35d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff35d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43126/0 (socket says 172.21.15.60:43126) 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.442+0000 7ff35d400700 1 -- 172.21.15.60:0/2038843894 learned_addr learned my addr 172.21.15.60:0/2038843894 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff35d400700 1 -- 172.21.15.60:0/2038843894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3600ff000 msgr2=0x7ff36010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff35d400700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3600ff000 0x7ff36010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff35d400700 1 -- 172.21.15.60:0/2038843894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c005040 con 0x7ff3601002b0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff35d400700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009150 tx=0x7ff34c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34c00e040 con 0x7ff3601002b0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff34c00bbf0 con 0x7ff3601002b0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.443+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34c01c630 con 0x7ff3601002b0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.444+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360111240 con 0x7ff3601002b0 2024-04-12T13:54:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.444+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360111780 con 0x7ff3601002b0 2024-04-12T13:54:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.445+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36005f5f0 con 0x7ff3601002b0 2024-04-12T13:54:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.446+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff34c00bd60 con 0x7ff3601002b0 2024-04-12T13:54:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.447+0000 7ff356000700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 0x7ff3440710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.447+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7ff34c08fe00 con 0x7ff3601002b0 2024-04-12T13:54:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.447+0000 7ff35de00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 0x7ff3440710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.448+0000 7ff35de00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 0x7ff3440710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff350004b70 tx=0x7ff350007cc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.452+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff34c05c570 con 0x7ff3601002b0 2024-04-12T13:54:11.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.712+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff360111bc0 con 0x7ff34406ec10 2024-04-12T13:54:11.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.732+0000 7ff356000700 1 -- 172.21.15.60:0/2038843894 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff360111bc0 con 0x7ff34406ec10 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (16s) 9s ago 23m 13.5M - 0.25.0 c8568f914cd2 1ddde97968ad 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (7m) 9s ago 23m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (7m) 63s ago 21m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 error 9s ago 22m - - 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (2m) 9s ago 15m 11.8M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (3m) 9s ago 15m 83.7M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (2m) 63s ago 15m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (92s) 63s ago 15m 11.1M - 19.0.0-2778-ga971fd5f b96c509eef84 0c26cec850b0 2024-04-12T13:54:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (10m) 9s ago 24m 513M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (9m) 63s ago 21m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (9m) 9s ago 24m 61.8M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (8m) 63s ago 21m 43.8M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (73s) 9s ago 23m 7680k - 1.5.0 0da6a335fe13 9dc5b1bd6177 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (67s) 63s ago 21m 6819k - 1.5.0 0da6a335fe13 f4688cc75136 2024-04-12T13:54:11.736 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 9s ago 20m 113M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (6m) 9s ago 20m 200M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 9s ago 19m 121M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (5m) 63s ago 18m 115M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (4m) 63s ago 18m 95.0M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (3m) 63s ago 17m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (41s) 9s ago 22m 46.6M - 2.43.0 a07b618ecd1d 8e9ff49cdadb 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 msgr2=0x7ff3440710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 0x7ff3440710c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff350004b70 tx=0x7ff350007cc0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 msgr2=0x7ff360110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009150 tx=0x7ff34c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 shutdown_connections 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff34406ec10 0x7ff3440710c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3600ff000 0x7ff36010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 --2- 172.21.15.60:0/2038843894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3601002b0 0x7ff360110170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.735+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 >> 172.21.15.60:0/2038843894 conn(0x7ff3600fa950 msgr2=0x7ff3600fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.736+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 shutdown_connections 2024-04-12T13:54:11.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.736+0000 7ff364e00700 1 -- 172.21.15.60:0/2038843894 wait complete. 2024-04-12T13:54:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 -- 172.21.15.60:0/2028286175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60071e20 msgr2=0x7fda60070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 --2- 172.21.15.60:0/2028286175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60071e20 0x7fda60070330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fda50004940 tx=0x7fda50009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 -- 172.21.15.60:0/2028286175 shutdown_connections 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 --2- 172.21.15.60:0/2028286175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60070870 0x7fda60070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 --2- 172.21.15.60:0/2028286175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60071e20 0x7fda60070330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 -- 172.21.15.60:0/2028286175 >> 172.21.15.60:0/2028286175 conn(0x7fda600f8590 msgr2=0x7fda600fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 -- 172.21.15.60:0/2028286175 shutdown_connections 2024-04-12T13:54:11.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.882+0000 7fda65000700 1 -- 172.21.15.60:0/2028286175 wait complete. 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.883+0000 7fda65000700 1 Processor -- start 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.883+0000 7fda65000700 1 -- start start 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda65000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda65000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60071e20 0x7fda60110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda65000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60110790 con 0x7fda60070870 2024-04-12T13:54:11.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda65000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60110fe0 con 0x7fda60071e20 2024-04-12T13:54:11.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda5de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda5de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43134/0 (socket says 172.21.15.60:43134) 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda5de00700 1 -- 172.21.15.60:0/1068997135 learned_addr learned my addr 172.21.15.60:0/1068997135 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.884+0000 7fda5d400700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60071e20 0x7fda60110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda5de00700 1 -- 172.21.15.60:0/1068997135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60071e20 msgr2=0x7fda60110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda5de00700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60071e20 0x7fda60110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda5de00700 1 -- 172.21.15.60:0/1068997135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50005040 con 0x7fda60070870 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda5de00700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fda5000b970 tx=0x7fda50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5000e040 con 0x7fda60070870 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda50004290 con 0x7fda60070870 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda60111260 con 0x7fda60070870 2024-04-12T13:54:11.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601117a0 con 0x7fda60070870 2024-04-12T13:54:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.885+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5001c630 con 0x7fda60070870 2024-04-12T13:54:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.886+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6005f5f0 con 0x7fda60070870 2024-04-12T13:54:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.887+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fda5000bbf0 con 0x7fda60070870 2024-04-12T13:54:11.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.888+0000 7fda56000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 0x7fda440710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.888+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fda5008fe90 con 0x7fda60070870 2024-04-12T13:54:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.889+0000 7fda5d400700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 0x7fda440710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:11.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.889+0000 7fda5d400700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 0x7fda440710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:11.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:11.893+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fda5005c580 con 0x7fda60070870 2024-04-12T13:54:11.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:11 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:54:11.962 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:11 smithi060 ceph-mon[94333]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:11.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:11 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T13:54:11.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:11 smithi110 ceph-mon[82130]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:12.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.224+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda60111ad0 con 0x7fda60070870 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.225+0000 7fda56000700 1 -- 172.21.15.60:0/1068997135 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fda50013e60 con 0x7fda60070870 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:12.228 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 14 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:54:12.229 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.228+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 msgr2=0x7fda440710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.228+0000 7fda65000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 0x7fda440710c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda4c007fd0 tx=0x7fda4c009040 comp rx=0 tx=0).stop 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.228+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 msgr2=0x7fda6010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.228+0000 7fda65000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fda5000b970 tx=0x7fda50009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 shutdown_connections 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda4406ec10 0x7fda440710c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda60070870 0x7fda6010fc50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 --2- 172.21.15.60:0/1068997135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda60071e20 0x7fda60110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 >> 172.21.15.60:0/1068997135 conn(0x7fda600f8590 msgr2=0x7fda600f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 shutdown_connections 2024-04-12T13:54:12.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.229+0000 7fda65000700 1 -- 172.21.15.60:0/1068997135 wait complete. 2024-04-12T13:54:12.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 -- 172.21.15.60:0/3827438781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 msgr2=0x7f9464104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 --2- 172.21.15.60:0/3827438781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464104b40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9450004940 tx=0x7f9450009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 -- 172.21.15.60:0/3827438781 shutdown_connections 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 --2- 172.21.15.60:0/3827438781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464104b40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 --2- 172.21.15.60:0/3827438781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 0x7f9464103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 -- 172.21.15.60:0/3827438781 >> 172.21.15.60:0/3827438781 conn(0x7f9464072640 msgr2=0x7f9464074a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 -- 172.21.15.60:0/3827438781 shutdown_connections 2024-04-12T13:54:12.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.388+0000 7f946bc00700 1 -- 172.21.15.60:0/3827438781 wait complete. 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.389+0000 7f946bc00700 1 Processor -- start 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.389+0000 7f946bc00700 1 -- start start 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f946bc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 0x7f9464113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f946bc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f946bc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464114a90 con 0x7f94641046d0 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f946bc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464114c00 con 0x7f9464103420 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9463e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9463e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43144/0 (socket says 172.21.15.60:43144) 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9463e00700 1 -- 172.21.15.60:0/450080513 learned_addr learned my addr 172.21.15.60:0/450080513 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9469200700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 0x7f9464113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9463e00700 1 -- 172.21.15.60:0/450080513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 msgr2=0x7f9464113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.390+0000 7f9463e00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 0x7f9464113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f9463e00700 1 -- 172.21.15.60:0/450080513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450005040 con 0x7f94641046d0 2024-04-12T13:54:12.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f9463e00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f945000b3b0 tx=0x7f9450009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f945000e040 con 0x7f94641046d0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9450004290 con 0x7f94641046d0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464119600 con 0x7f94641046d0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f945001c630 con 0x7f94641046d0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.391+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464119bc0 con 0x7f94641046d0 2024-04-12T13:54:12.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.393+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946404c710 con 0x7f94641046d0 2024-04-12T13:54:12.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.394+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f945000bbf0 con 0x7f94641046d0 2024-04-12T13:54:12.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.395+0000 7f9460c00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 0x7f944c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.395+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f945008ff10 con 0x7f94641046d0 2024-04-12T13:54:12.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.395+0000 7f9469200700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 0x7f944c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.396+0000 7f9469200700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 0x7f944c0710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9458004fa0 tx=0x7f945800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:12.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.400+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f945005c600 con 0x7f94641046d0 2024-04-12T13:54:12.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.713+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9464119de0 con 0x7f94641046d0 2024-04-12T13:54:12.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.714+0000 7f9460c00700 1 -- 172.21.15.60:0/450080513 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1935 (secure 0 0 0) 0x7f9464119de0 con 0x7f94641046d0 2024-04-12T13:54:12.716 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 35 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:52:40.918247+0000 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:54:12.717 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 101 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34456} 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:54:12.718 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34456 members: 34456 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:34456} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:54:12.719 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:54:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.716+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 msgr2=0x7f944c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.716+0000 7f946bc00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 0x7f944c0710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9458004fa0 tx=0x7f945800b040 comp rx=0 tx=0).stop 2024-04-12T13:54:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.716+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 msgr2=0x7f9464114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.716+0000 7f946bc00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f945000b3b0 tx=0x7f9450009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 shutdown_connections 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f944c06ec00 0x7f944c0710b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9464103420 0x7f9464113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 --2- 172.21.15.60:0/450080513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94641046d0 0x7f9464114490 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 >> 172.21.15.60:0/450080513 conn(0x7f9464072640 msgr2=0x7f9464073d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 shutdown_connections 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.717+0000 7f946bc00700 1 -- 172.21.15.60:0/450080513 wait complete. 2024-04-12T13:54:12.721 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-04-12T13:54:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 -- 172.21.15.60:0/748000012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 msgr2=0x7f1e64102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 --2- 172.21.15.60:0/748000012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e64102390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1e50004940 tx=0x7f1e50009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 -- 172.21.15.60:0/748000012 shutdown_connections 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 --2- 172.21.15.60:0/748000012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e64102390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 --2- 172.21.15.60:0/748000012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 0x7f1e640ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 -- 172.21.15.60:0/748000012 >> 172.21.15.60:0/748000012 conn(0x7f1e640f74c0 msgr2=0x7f1e640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 -- 172.21.15.60:0/748000012 shutdown_connections 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.868+0000 7f1e6a000700 1 -- 172.21.15.60:0/748000012 wait complete. 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.869+0000 7f1e6a000700 1 Processor -- start 2024-04-12T13:54:12.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e6a000700 1 -- start start 2024-04-12T13:54:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e6a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 0x7f1e640fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e6a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e6a000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640fbee0 con 0x7f1e640fff70 2024-04-12T13:54:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e6a000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640fc050 con 0x7f1e640662f0 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e62a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e62a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43154/0 (socket says 172.21.15.60:43154) 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.870+0000 7f1e62a00700 1 -- 172.21.15.60:0/1150013558 learned_addr learned my addr 172.21.15.60:0/1150013558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.871+0000 7f1e63400700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 0x7f1e640fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.871+0000 7f1e62a00700 1 -- 172.21.15.60:0/1150013558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 msgr2=0x7f1e640fd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.871+0000 7f1e62a00700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 0x7f1e640fd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:12.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.871+0000 7f1e62a00700 1 -- 172.21.15.60:0/1150013558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50005040 con 0x7f1e640fff70 2024-04-12T13:54:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.871+0000 7f1e62a00700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009150 tx=0x7f1e50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.872+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5000e040 con 0x7f1e640fff70 2024-04-12T13:54:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.872+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e5000bbf0 con 0x7f1e640fff70 2024-04-12T13:54:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.872+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5001c630 con 0x7f1e640fff70 2024-04-12T13:54:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.872+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640fc2d0 con 0x7f1e640fff70 2024-04-12T13:54:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.872+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e64115a90 con 0x7f1e640fff70 2024-04-12T13:54:12.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.874+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6405f5f0 con 0x7f1e640fff70 2024-04-12T13:54:12.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.874+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1e5000bd60 con 0x7f1e640fff70 2024-04-12T13:54:12.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.876+0000 7f1e5b400700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 0x7f1e480710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:12.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.876+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f1e5008fd40 con 0x7f1e640fff70 2024-04-12T13:54:12.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.876+0000 7f1e63400700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 0x7f1e480710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.877+0000 7f1e63400700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 0x7f1e480710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e640fd1f0 tx=0x7f1e54009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:12.881+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1e50058a40 con 0x7f1e640fff70 2024-04-12T13:54:12.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:12 smithi110 ceph-mon[82130]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:12.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:12 smithi110 ceph-mon[82130]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:12 smithi110 ceph-mon[82130]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:12.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:12 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1068997135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:12 smithi060 ceph-mon[94333]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:12 smithi060 ceph-mon[94333]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:12 smithi060 ceph-mon[94333]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:13.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:12 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1068997135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:13.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.187+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e640f8fb0 con 0x7f1e4806ec10 2024-04-12T13:54:13.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.196+0000 7f1e5b400700 1 -- 172.21.15.60:0/1150013558 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f1e640f8fb0 con 0x7f1e4806ec10 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608", 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-04-12T13:54:13.199 INFO:teuthology.orchestra.run.smithi060.stdout: "mds", 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: "crash" 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "16/21 daemons upgraded", 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading grafana daemons", 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:54:13.200 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.199+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 msgr2=0x7f1e480710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.199+0000 7f1e6a000700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 0x7f1e480710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e640fd1f0 tx=0x7f1e54009040 comp rx=0 tx=0).stop 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.199+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 msgr2=0x7f1e640fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.199+0000 7f1e6a000700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009150 tx=0x7f1e50009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 shutdown_connections 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1e4806ec10 0x7f1e480710c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e640662f0 0x7f1e640fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 --2- 172.21.15.60:0/1150013558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e640fff70 0x7f1e640fb930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 >> 172.21.15.60:0/1150013558 conn(0x7f1e640f74c0 msgr2=0x7f1e640f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 shutdown_connections 2024-04-12T13:54:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.200+0000 7f1e6a000700 1 -- 172.21.15.60:0/1150013558 wait complete. 2024-04-12T13:54:13.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4236303214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 msgr2=0x7f5a18102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4236303214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a18102360 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a04004940 tx=0x7f5a04009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:13.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4236303214 shutdown_connections 2024-04-12T13:54:13.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4236303214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a18102360 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4236303214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 0x7f5a180ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4236303214 >> 172.21.15.60:0/4236303214 conn(0x7f5a180f7450 msgr2=0x7f5a180f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4236303214 shutdown_connections 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.369+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4236303214 wait complete. 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 Processor -- start 2024-04-12T13:54:13.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 -- start start 2024-04-12T13:54:13.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 0x7f5a1810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:13.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:13.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181106d0 con 0x7f5a180fff80 2024-04-12T13:54:13.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.370+0000 7f5a1fc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18110840 con 0x7f5a18066ea0 2024-04-12T13:54:13.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43174/0 (socket says 172.21.15.60:43174) 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 -- 172.21.15.60:0/4097191588 learned_addr learned my addr 172.21.15.60:0/4097191588 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a1d200700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 0x7f5a1810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 -- 172.21.15.60:0/4097191588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 msgr2=0x7f5a1810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 0x7f5a1810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.371+0000 7f5a17e00700 1 -- 172.21.15.60:0/4097191588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04005040 con 0x7f5a180fff80 2024-04-12T13:54:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a17e00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b3b0 tx=0x7f5a04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0400e040 con 0x7f5a180fff80 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a04004290 con 0x7f5a180fff80 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0401c630 con 0x7f5a180fff80 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a18115240 con 0x7f5a180fff80 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.372+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a18115800 con 0x7f5a180fff80 2024-04-12T13:54:13.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.374+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1804c710 con 0x7f5a180fff80 2024-04-12T13:54:13.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.374+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5a0400bbf0 con 0x7f5a180fff80 2024-04-12T13:54:13.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.376+0000 7f5a14c00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 0x7f5a000710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:13.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.376+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f5a0408fe60 con 0x7f5a180fff80 2024-04-12T13:54:13.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.376+0000 7f5a1d200700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 0x7f5a000710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:13.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.377+0000 7f5a1d200700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 0x7f5a000710b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009fd0 tx=0x7f5a0c009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:13.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.380+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f5a0405c5d0 con 0x7f5a180fff80 2024-04-12T13:54:13.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.713+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5a18115ca0 con 0x7f5a180fff80 2024-04-12T13:54:13.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.713+0000 7f5a14c00700 1 -- 172.21.15.60:0/4097191588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+155 (secure 0 0 0) 0x7f5a0405c160 con 0x7f5a180fff80 2024-04-12T13:54:13.716 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-04-12T13:54:13.716 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-04-12T13:54:13.716 INFO:teuthology.orchestra.run.smithi060.stdout: daemon grafana.smithi060 on smithi060 is in error state 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.716+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 msgr2=0x7f5a000710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.716+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 0x7f5a000710b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009fd0 tx=0x7f5a0c009f00 comp rx=0 tx=0).stop 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.716+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 msgr2=0x7f5a181100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.716+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400b3b0 tx=0x7f5a04009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 shutdown_connections 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5a0006ec00 0x7f5a000710b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18066ea0 0x7f5a1810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 --2- 172.21.15.60:0/4097191588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a180fff80 0x7f5a181100d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:13.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 >> 172.21.15.60:0/4097191588 conn(0x7f5a180f7450 msgr2=0x7f5a180fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:13.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 shutdown_connections 2024-04-12T13:54:13.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:13.717+0000 7f5a1fc00700 1 -- 172.21.15.60:0/4097191588 wait complete. 2024-04-12T13:54:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:13 smithi060 ceph-mon[94333]: Upgrade: Updating grafana.smithi060 2024-04-12T13:54:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:13 smithi060 ceph-mon[94333]: Deploying daemon grafana.smithi060 on smithi060 2024-04-12T13:54:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:13 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/450080513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:54:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:13.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:13 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/4097191588' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:54:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:13 smithi110 ceph-mon[82130]: Upgrade: Updating grafana.smithi060 2024-04-12T13:54:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:13 smithi110 ceph-mon[82130]: Deploying daemon grafana.smithi060 on smithi060 2024-04-12T13:54:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:13 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/450080513' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:54:13.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:13.979 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:13 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/4097191588' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:54:15.079 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:14 smithi060 ceph-mon[94333]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:15.079 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:14 smithi060 ceph-mon[94333]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:15.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:14 smithi110 ceph-mon[82130]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:15.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:14 smithi110 ceph-mon[82130]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:17.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:16 smithi060 ceph-mon[94333]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:17.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:16 smithi110 ceph-mon[82130]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:19.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:18 smithi060 ceph-mon[94333]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:19.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:18 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:19.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:18 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:19.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:18 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:18 smithi110 ceph-mon[82130]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:18 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:18 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:19.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:18 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:20.914 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:20 smithi060 ceph-mon[94333]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:21.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:20 smithi110 ceph-mon[82130]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:22.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:22 smithi060 ceph-mon[94333]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:23.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:22 smithi110 ceph-mon[82130]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:25.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:24 smithi060 ceph-mon[94333]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:25.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:24 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:25.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:24 smithi110 ceph-mon[82130]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:25.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:25.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:24 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:27.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:26 smithi060 ceph-mon[94333]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:26 smithi110 ceph-mon[82130]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:28.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:27 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:28.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:27 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:27 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:27 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:29.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:28 smithi060 ceph-mon[94333]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:29.083 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:28 smithi110 ceph-mon[82130]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:29.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:31.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:30 smithi060 ceph-mon[94333]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:31.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:30 smithi110 ceph-mon[82130]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:33.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:32 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:33.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:32 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T13:54:34.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T13:54:34.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: Cluster is now healthy 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:33 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:34.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:54:34.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T13:54:34.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.230 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.231 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T13:54:34.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T13:54:34.233 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: Cluster is now healthy 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:34.234 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:33 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:34 smithi060 ceph-mon[94333]: Upgrade: Finalizing container_image settings 2024-04-12T13:54:35.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:34 smithi060 ceph-mon[94333]: Upgrade: Complete! 2024-04-12T13:54:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:34 smithi110 ceph-mon[82130]: Upgrade: Finalizing container_image settings 2024-04-12T13:54:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:34 smithi110 ceph-mon[82130]: Upgrade: Complete! 2024-04-12T13:54:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:35 smithi060 ceph-mon[94333]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:36.241 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:35 smithi110 ceph-mon[82130]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:37 smithi060 ceph-mon[94333]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:37 smithi110 ceph-mon[82130]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:39 smithi060 ceph-mon[94333]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:39 smithi110 ceph-mon[82130]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:41 smithi110 ceph-mon[82130]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:42.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:41 smithi060 ceph-mon[94333]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 -- 172.21.15.60:0/2527559908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f78071ea0 msgr2=0x7f7f780703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 --2- 172.21.15.60:0/2527559908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f78071ea0 0x7f7f780703b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004940 tx=0x7f7f6c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 -- 172.21.15.60:0/2527559908 shutdown_connections 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 --2- 172.21.15.60:0/2527559908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f780708f0 0x7f7f78070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 --2- 172.21.15.60:0/2527559908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f78071ea0 0x7f7f780703b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 -- 172.21.15.60:0/2527559908 >> 172.21.15.60:0/2527559908 conn(0x7f7f780f8530 msgr2=0x7f7f780fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 -- 172.21.15.60:0/2527559908 shutdown_connections 2024-04-12T13:54:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.891+0000 7f7f7f600700 1 -- 172.21.15.60:0/2527559908 wait complete. 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.892+0000 7f7f7f600700 1 Processor -- start 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7f600700 1 -- start start 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7f600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7f600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 0x7f7f78110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7f600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78110860 con 0x7f7f780708f0 2024-04-12T13:54:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7f600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78110fa0 con 0x7f7f78071ea0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7cc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38586/0 (socket says 172.21.15.60:38586) 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.893+0000 7f7f7cc00700 1 -- 172.21.15.60:0/826292815 learned_addr learned my addr 172.21.15.60:0/826292815 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f77e00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 0x7f7f78110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f7cc00700 1 -- 172.21.15.60:0/826292815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 msgr2=0x7f7f78110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f7cc00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 0x7f7f78110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f7cc00700 1 -- 172.21.15.60:0/826292815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c005040 con 0x7f7f780708f0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f77e00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 0x7f7f78110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.894+0000 7f7f7cc00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000c00 tx=0x7f7f6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.895+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6c00e040 con 0x7f7f780708f0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.895+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f6c00bcc0 con 0x7f7f780708f0 2024-04-12T13:54:43.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.895+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f78111220 con 0x7f7f780708f0 2024-04-12T13:54:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.895+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6c01c630 con 0x7f7f780708f0 2024-04-12T13:54:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.895+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f781117e0 con 0x7f7f780708f0 2024-04-12T13:54:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.896+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7805f5f0 con 0x7f7f780708f0 2024-04-12T13:54:43.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.897+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7f6c013980 con 0x7f7f780708f0 2024-04-12T13:54:43.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.898+0000 7f7f74c00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 0x7f7f600710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:43.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.898+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f7f6c08fe70 con 0x7f7f780708f0 2024-04-12T13:54:43.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.898+0000 7f7f77e00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 0x7f7f600710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.899+0000 7f7f77e00700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 0x7f7f600710b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f6400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:43.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:43.904+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f7f6c05c610 con 0x7f7f780708f0 2024-04-12T13:54:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.158+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f78111b60 con 0x7f7f6006ec00 2024-04-12T13:54:44.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:43 smithi060 ceph-mon[94333]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:44.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:44.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:44.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.160+0000 7f7f74c00700 1 -- 172.21.15.60:0/826292815 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f7f78111b60 con 0x7f7f6006ec00 2024-04-12T13:54:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 msgr2=0x7f7f600710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 0x7f7f600710b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f6400b040 comp rx=0 tx=0).stop 2024-04-12T13:54:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 msgr2=0x7f7f7810fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000c00 tx=0x7f7f6c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 shutdown_connections 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f7f6006ec00 0x7f7f600710b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f780708f0 0x7f7f7810fd20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.163+0000 7f7f7f600700 1 --2- 172.21.15.60:0/826292815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f78071ea0 0x7f7f78110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.164+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 >> 172.21.15.60:0/826292815 conn(0x7f7f780f8530 msgr2=0x7f7f780f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.164+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 shutdown_connections 2024-04-12T13:54:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:44.164+0000 7f7f7f600700 1 -- 172.21.15.60:0/826292815 wait complete. 2024-04-12T13:54:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:43 smithi110 ceph-mon[82130]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:54:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:44.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph orch ps' 2024-04-12T13:54:45.495 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:54:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:45 smithi110 ceph-mon[82130]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:45 smithi110 ceph-mon[82130]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:45 smithi060 ceph-mon[94333]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:45 smithi060 ceph-mon[94333]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 -- 172.21.15.60:0/1889460871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 msgr2=0x7fdb441031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 --2- 172.21.15.60:0/1889460871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb441031f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdb38004940 tx=0x7fdb38009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 -- 172.21.15.60:0/1889460871 shutdown_connections 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 --2- 172.21.15.60:0/1889460871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 0x7fdb440fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 --2- 172.21.15.60:0/1889460871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb441031f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 -- 172.21.15.60:0/1889460871 >> 172.21.15.60:0/1889460871 conn(0x7fdb440f89d0 msgr2=0x7fdb440fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 -- 172.21.15.60:0/1889460871 shutdown_connections 2024-04-12T13:54:47.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.661+0000 7fdb4c200700 1 -- 172.21.15.60:0/1889460871 wait complete. 2024-04-12T13:54:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 Processor -- start 2024-04-12T13:54:47.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 -- start start 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 0x7fdb441140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44114740 con 0x7fdb44102e20 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.662+0000 7fdb4c200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4410db30 con 0x7fdb441037c0 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:47.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38600/0 (socket says 172.21.15.60:38600) 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 -- 172.21.15.60:0/3593236599 learned_addr learned my addr 172.21.15.60:0/3593236599 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb48e00700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 0x7fdb441140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 -- 172.21.15.60:0/3593236599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 msgr2=0x7fdb441140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 0x7fdb441140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.663+0000 7fdb49800700 1 -- 172.21.15.60:0/3593236599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38005040 con 0x7fdb44102e20 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb49800700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009150 tx=0x7fdb38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb3800e040 con 0x7fdb44102e20 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb38013420 con 0x7fdb44102e20 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb3801c630 con 0x7fdb44102e20 2024-04-12T13:54:47.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4410ddb0 con 0x7fdb44102e20 2024-04-12T13:54:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.664+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4410e370 con 0x7fdb44102e20 2024-04-12T13:54:47.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.666+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb44100130 con 0x7fdb44102e20 2024-04-12T13:54:47.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.667+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb38013590 con 0x7fdb44102e20 2024-04-12T13:54:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.668+0000 7fdb41600700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 0x7fdb2c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.668+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fdb3808fcc0 con 0x7fdb44102e20 2024-04-12T13:54:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.668+0000 7fdb48e00700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 0x7fdb2c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.669+0000 7fdb48e00700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 0x7fdb2c0710c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb4410ecf0 tx=0x7fdb30009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.673+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fdb38095020 con 0x7fdb44102e20 2024-04-12T13:54:47.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.918+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb4410f270 con 0x7fdb2c06ec10 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.938+0000 7fdb41600700 1 -- 172.21.15.60:0/3593236599 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdb4410f270 con 0x7fdb2c06ec10 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (52s) 23s ago 23m 14.2M - 0.25.0 c8568f914cd2 1ddde97968ad 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (8m) 23s ago 23m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (8m) 99s ago 22m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (30s) 23s ago 23m 49.7M - 9.4.12 2bacad6d85d8 86318ce12c66 2024-04-12T13:54:47.941 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (3m) 23s ago 16m 11.9M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (3m) 23s ago 16m 83.7M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (2m) 99s ago 16m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (2m) 99s ago 16m 11.1M - 19.0.0-2778-ga971fd5f b96c509eef84 0c26cec850b0 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (11m) 23s ago 25m 521M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (10m) 99s ago 22m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (10m) 23s ago 25m 61.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (9m) 99s ago 22m 43.8M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (110s) 23s ago 23m 7457k - 1.5.0 0da6a335fe13 9dc5b1bd6177 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (103s) 99s ago 22m 6819k - 1.5.0 0da6a335fe13 f4688cc75136 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 23s ago 21m 113M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 23s ago 20m 200M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (6m) 23s ago 20m 122M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:54:47.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (5m) 99s ago 19m 115M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:54:47.943 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (4m) 99s ago 18m 95.0M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:54:47.943 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (4m) 99s ago 18m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:54:47.943 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (77s) 23s ago 22m 49.7M - 2.43.0 a07b618ecd1d 8e9ff49cdadb 2024-04-12T13:54:47.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.941+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 msgr2=0x7fdb2c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:47.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.941+0000 7fdb4c200700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 0x7fdb2c0710c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb4410ecf0 tx=0x7fdb30009ee0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.941+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 msgr2=0x7fdb44113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:47.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.941+0000 7fdb4c200700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009150 tx=0x7fdb38009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:47.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 shutdown_connections 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb2c06ec10 0x7fdb2c0710c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb44102e20 0x7fdb44113bb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 --2- 172.21.15.60:0/3593236599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb441037c0 0x7fdb441140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 >> 172.21.15.60:0/3593236599 conn(0x7fdb440f89d0 msgr2=0x7fdb44107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 shutdown_connections 2024-04-12T13:54:47.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:47.942+0000 7fdb4c200700 1 -- 172.21.15.60:0/3593236599 wait complete. 2024-04-12T13:54:48.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:47 smithi060 ceph-mon[94333]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:47 smithi110 ceph-mon[82130]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:48.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph orch upgrade status' 2024-04-12T13:54:49.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:48 smithi110 ceph-mon[82130]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:49.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:48 smithi060 ceph-mon[94333]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:54:50.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:49 smithi110 ceph-mon[82130]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:50.373 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:49 smithi060 ceph-mon[94333]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 -- 172.21.15.60:0/1854120813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a881059a0 msgr2=0x7f1a880ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/1854120813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a881059a0 0x7f1a880ff010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a74004940 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 -- 172.21.15.60:0/1854120813 shutdown_connections 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/1854120813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a881059a0 0x7f1a880ff010 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/1854120813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a88105000 0x7f1a881053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 -- 172.21.15.60:0/1854120813 >> 172.21.15.60:0/1854120813 conn(0x7f1a880fabd0 msgr2=0x7f1a880fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.581+0000 7f1a8ca00700 1 -- 172.21.15.60:0/1854120813 shutdown_connections 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.582+0000 7f1a8ca00700 1 -- 172.21.15.60:0/1854120813 wait complete. 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.582+0000 7f1a8ca00700 1 Processor -- start 2024-04-12T13:54:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.582+0000 7f1a8ca00700 1 -- start start 2024-04-12T13:54:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a8ca00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a8ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a881059a0 0x7f1a881160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a8ca00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88116740 con 0x7f1a88105000 2024-04-12T13:54:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a8ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8810fd20 con 0x7f1a881059a0 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a85e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a85e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37850/0 (socket says 172.21.15.60:37850) 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.583+0000 7f1a85e00700 1 -- 172.21.15.60:0/2160679288 learned_addr learned my addr 172.21.15.60:0/2160679288 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a85400700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a881059a0 0x7f1a881160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a85e00700 1 -- 172.21.15.60:0/2160679288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a881059a0 msgr2=0x7f1a881160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a85e00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a881059a0 0x7f1a881160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a85e00700 1 -- 172.21.15.60:0/2160679288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74005040 con 0x7f1a88105000 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a85e00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c8c0 tx=0x7f1a780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7800a980 con 0x7f1a88105000 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a7800ce60 con 0x7f1a88105000 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.584+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a88110000 con 0x7f1a88105000 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.585+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a780115e0 con 0x7f1a88105000 2024-04-12T13:54:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.585+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a881105c0 con 0x7f1a88105000 2024-04-12T13:54:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.586+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88100750 con 0x7f1a88105000 2024-04-12T13:54:51.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.587+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1a78012400 con 0x7f1a88105000 2024-04-12T13:54:51.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.588+0000 7f1a7e000700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 0x7f1a6c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:51.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.588+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f1a7808eb00 con 0x7f1a88105000 2024-04-12T13:54:51.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.588+0000 7f1a85400700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 0x7f1a6c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:51.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.589+0000 7f1a85400700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 0x7f1a6c0710b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b3b0 tx=0x7f1a74009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:51.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.593+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f1a7805b270 con 0x7f1a88105000 2024-04-12T13:54:51.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.843+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a88111200 con 0x7f1a6c06ec00 2024-04-12T13:54:51.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.846+0000 7f1a7e000700 1 -- 172.21.15.60:0/2160679288 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f1a88111200 con 0x7f1a6c06ec00 2024-04-12T13:54:51.848 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:54:51.848 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": null, 2024-04-12T13:54:51.848 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": false, 2024-04-12T13:54:51.848 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "", 2024-04-12T13:54:51.849 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-04-12T13:54:51.849 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": null, 2024-04-12T13:54:51.849 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-04-12T13:54:51.849 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-04-12T13:54:51.849 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:54:51.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 msgr2=0x7f1a6c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:51.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 0x7f1a6c0710b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b3b0 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:51.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 msgr2=0x7f1a88115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:51.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c8c0 tx=0x7f1a780044c0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 shutdown_connections 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f1a6c06ec00 0x7f1a6c0710b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a88105000 0x7f1a88115bb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 --2- 172.21.15.60:0/2160679288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a881059a0 0x7f1a881160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.849+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 >> 172.21.15.60:0/2160679288 conn(0x7f1a880fabd0 msgr2=0x7f1a880fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.850+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 shutdown_connections 2024-04-12T13:54:51.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:51.850+0000 7f1a8ca00700 1 -- 172.21.15.60:0/2160679288 wait complete. 2024-04-12T13:54:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:51 smithi060 ceph-mon[94333]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:51 smithi110 ceph-mon[82130]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:52.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph health detail' 2024-04-12T13:54:53.214 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:54:53.369 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:52 smithi060 ceph-mon[94333]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:53.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:52 smithi110 ceph-mon[82130]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:54:54.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:53 smithi060 ceph-mon[94333]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:53 smithi110 ceph-mon[82130]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.594+0000 7fdb39e00700 1 -- 172.21.15.60:0/2942545032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070c10 msgr2=0x7fdb34109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.594+0000 7fdb39e00700 1 --2- 172.21.15.60:0/2942545032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070c10 0x7fdb34109190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c004970 tx=0x7fdb1c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 -- 172.21.15.60:0/2942545032 shutdown_connections 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 --2- 172.21.15.60:0/2942545032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070c10 0x7fdb34109190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 --2- 172.21.15.60:0/2942545032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070300 0x7fdb340706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 -- 172.21.15.60:0/2942545032 >> 172.21.15.60:0/2942545032 conn(0x7fdb340f89b0 msgr2=0x7fdb340fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 -- 172.21.15.60:0/2942545032 shutdown_connections 2024-04-12T13:54:55.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.595+0000 7fdb39e00700 1 -- 172.21.15.60:0/2942545032 wait complete. 2024-04-12T13:54:55.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 Processor -- start 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 -- start start 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 0x7fdb34116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34116760 con 0x7fdb34070300 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.596+0000 7fdb39e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3410fd40 con 0x7fdb34070c10 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37862/0 (socket says 172.21.15.60:37862) 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 -- 172.21.15.60:0/1434593199 learned_addr learned my addr 172.21.15.60:0/1434593199 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb2a000700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 0x7fdb34116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 -- 172.21.15.60:0/1434593199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 msgr2=0x7fdb34116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 0x7fdb34116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb32a00700 1 -- 172.21.15.60:0/1434593199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c005040 con 0x7fdb34070300 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.597+0000 7fdb2a000700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 0x7fdb34116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:54:55.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb32a00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb24001d00 tx=0x7fdb24009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb24004020 con 0x7fdb34070300 2024-04-12T13:54:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb2400f040 con 0x7fdb34070300 2024-04-12T13:54:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb34110020 con 0x7fdb34070300 2024-04-12T13:54:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb24009310 con 0x7fdb34070300 2024-04-12T13:54:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.598+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb34110560 con 0x7fdb34070300 2024-04-12T13:54:55.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.599+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb34071a40 con 0x7fdb34070300 2024-04-12T13:54:55.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.600+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdb24009490 con 0x7fdb34070300 2024-04-12T13:54:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.601+0000 7fdb2b400700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 0x7fdb180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.601+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fdb2408e400 con 0x7fdb34070300 2024-04-12T13:54:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.602+0000 7fdb2a000700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 0x7fdb180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.602+0000 7fdb2a000700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 0x7fdb180710b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b9c0 tx=0x7fdb1c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:55.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.607+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fdb2405aaf0 con 0x7fdb34070300 2024-04-12T13:54:55.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.939+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdb34111220 con 0x7fdb34070300 2024-04-12T13:54:55.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.940+0000 7fdb2b400700 1 -- 172.21.15.60:0/1434593199 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdb2405a680 con 0x7fdb34070300 2024-04-12T13:54:55.942 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 msgr2=0x7fdb180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 0x7fdb180710b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b9c0 tx=0x7fdb1c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 msgr2=0x7fdb34115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb24001d00 tx=0x7fdb24009f30 comp rx=0 tx=0).stop 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 shutdown_connections 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdb1806ec00 0x7fdb180710b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb34070300 0x7fdb34115bd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 --2- 172.21.15.60:0/1434593199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb34070c10 0x7fdb34116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:55.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.943+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 >> 172.21.15.60:0/1434593199 conn(0x7fdb340f89b0 msgr2=0x7fdb340f9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:55.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.944+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 shutdown_connections 2024-04-12T13:54:55.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:55.944+0000 7fdb39e00700 1 -- 172.21.15.60:0/1434593199 wait complete. 2024-04-12T13:54:56.381 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:55 smithi060 ceph-mon[94333]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:56.382 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:55 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1434593199' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:54:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:55 smithi110 ceph-mon[82130]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:55 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1434593199' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T13:54:56.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph versions' 2024-04-12T13:54:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:54:58.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:57 smithi060 ceph-mon[94333]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:57 smithi110 ceph-mon[82130]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:54:59.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:54:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:54:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.443+0000 7f909f200700 1 -- 172.21.15.60:0/521295746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a01035e0 msgr2=0x7f90a00fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.443+0000 7f909f200700 1 --2- 172.21.15.60:0/521295746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a01035e0 0x7f90a00fcc50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f908c004940 tx=0x7f908c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.443+0000 7f909f200700 1 -- 172.21.15.60:0/521295746 shutdown_connections 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.443+0000 7f909f200700 1 --2- 172.21.15.60:0/521295746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a01035e0 0x7f90a00fcc50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.443+0000 7f909f200700 1 --2- 172.21.15.60:0/521295746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a0102c40 0x7f90a0103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.444+0000 7f909f200700 1 -- 172.21.15.60:0/521295746 >> 172.21.15.60:0/521295746 conn(0x7f90a00f8790 msgr2=0x7f90a00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.444+0000 7f909f200700 1 -- 172.21.15.60:0/521295746 shutdown_connections 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.444+0000 7f909f200700 1 -- 172.21.15.60:0/521295746 wait complete. 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 Processor -- start 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 -- start start 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:59.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a01035e0 0x7f90a0070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0070e20 con 0x7f90a0102c40 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0070f60 con 0x7f90a01035e0 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.445+0000 7f909de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47588/0 (socket says 172.21.15.60:47588) 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 -- 172.21.15.60:0/2737037572 learned_addr learned my addr 172.21.15.60:0/2737037572 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909d400700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a01035e0 0x7f90a0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 -- 172.21.15.60:0/2737037572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a01035e0 msgr2=0x7f90a0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a01035e0 0x7f90a0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 -- 172.21.15.60:0/2737037572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c005040 con 0x7f90a0102c40 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.446+0000 7f909de00700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f909000b790 tx=0x7f9090009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.447+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909000f770 con 0x7f90a0102c40 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.447+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f909000fda0 con 0x7f90a0102c40 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.447+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909000d310 con 0x7f90a0102c40 2024-04-12T13:54:59.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.447+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a0119cc0 con 0x7f90a0102c40 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.447+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a011a1d0 con 0x7f90a0102c40 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.448+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00fe390 con 0x7f90a0102c40 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.449+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9090010420 con 0x7f90a0102c40 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.450+0000 7f9096000700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 0x7f90840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.450+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f909008ea50 con 0x7f90a0102c40 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.451+0000 7f909d400700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 0x7f90840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.451+0000 7f909d400700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 0x7f90840710b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f908c00b020 tx=0x7f908c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:54:59.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.455+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f9090057690 con 0x7f90a0102c40 2024-04-12T13:54:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.784+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90a00719b0 con 0x7f90a0102c40 2024-04-12T13:54:59.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.785+0000 7f9096000700 1 -- 172.21.15.60:0/2737037572 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f909005ad50 con 0x7f90a0102c40 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 14 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:54:59.789 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:54:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 msgr2=0x7f90840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 0x7f90840710b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f908c00b020 tx=0x7f908c009e30 comp rx=0 tx=0).stop 2024-04-12T13:54:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 msgr2=0x7f90a00702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:54:59.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f909000b790 tx=0x7f9090009250 comp rx=0 tx=0).stop 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 shutdown_connections 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f908406ec00 0x7f90840710b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a0102c40 0x7f90a00702c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 --2- 172.21.15.60:0/2737037572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90a01035e0 0x7f90a0070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 >> 172.21.15.60:0/2737037572 conn(0x7f90a00f8790 msgr2=0x7f90a00f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 shutdown_connections 2024-04-12T13:54:59.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:54:59.789+0000 7f909f200700 1 -- 172.21.15.60:0/2737037572 wait complete. 2024-04-12T13:55:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:00 smithi060 ceph-mon[94333]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:00 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2737037572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:55:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:00 smithi110 ceph-mon[82130]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:00 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2737037572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:55:00.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-12T13:55:01.060 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:55:02.259 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:02 smithi060 ceph-mon[94333]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:02 smithi110 ceph-mon[82130]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:03.175 INFO:teuthology.orchestra.run.smithi060.stdout:wait for servicemap items w/ changing names to refresh 2024-04-12T13:55:03.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'sleep 60' 2024-04-12T13:55:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:04 smithi060 ceph-mon[94333]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:04.433 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:55:04.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:04 smithi110 ceph-mon[82130]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:06.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:06 smithi060 ceph-mon[94333]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:06.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:06 smithi110 ceph-mon[82130]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:07.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:07 smithi060 ceph-mon[94333]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:07.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:07 smithi110 ceph-mon[82130]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:09.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:09 smithi110 ceph-mon[82130]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:09 smithi060 ceph-mon[94333]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:12.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:11 smithi060 ceph-mon[94333]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:11 smithi110 ceph-mon[82130]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:14.033 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:13 smithi110 ceph-mon[82130]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:14.033 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:13 smithi060 ceph-mon[94333]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:16.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:15 smithi060 ceph-mon[94333]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:15 smithi110 ceph-mon[82130]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:18.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:17 smithi060 ceph-mon[94333]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:17 smithi110 ceph-mon[82130]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:20.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:19 smithi060 ceph-mon[94333]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:19 smithi110 ceph-mon[82130]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:22.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:21 smithi060 ceph-mon[94333]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:21 smithi110 ceph-mon[82130]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:24.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:23 smithi060 ceph-mon[94333]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:23 smithi110 ceph-mon[82130]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:25.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:25 smithi060 ceph-mon[94333]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:25 smithi110 ceph-mon[82130]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:28.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:27 smithi060 ceph-mon[94333]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:27 smithi110 ceph-mon[82130]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:29.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:30.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:29 smithi060 ceph-mon[94333]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:29 smithi110 ceph-mon[82130]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:32.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:31 smithi060 ceph-mon[94333]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:31 smithi110 ceph-mon[82130]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:33 smithi060 ceph-mon[94333]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:34.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:33 smithi110 ceph-mon[82130]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:35.065 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:34 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:55:35.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:34 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:55:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:35 smithi060 ceph-mon[94333]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:55:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:55:36.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:35 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:55:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:35 smithi110 ceph-mon[82130]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:55:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:55:36.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:35 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:55:38.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:37 smithi060 ceph-mon[94333]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:37 smithi110 ceph-mon[82130]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:39 smithi060 ceph-mon[94333]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:39 smithi110 ceph-mon[82130]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:42.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:41 smithi060 ceph-mon[94333]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:41 smithi110 ceph-mon[82130]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:43 smithi060 ceph-mon[94333]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:43 smithi110 ceph-mon[82130]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:46.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:45 smithi060 ceph-mon[94333]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:45 smithi110 ceph-mon[82130]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:48.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:47 smithi060 ceph-mon[94333]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:47 smithi110 ceph-mon[82130]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:50.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:49 smithi060 ceph-mon[94333]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:50.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:49 smithi110 ceph-mon[82130]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:52.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:51 smithi060 ceph-mon[94333]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:51 smithi110 ceph-mon[82130]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:54.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:53 smithi060 ceph-mon[94333]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:53 smithi110 ceph-mon[82130]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:56.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:55 smithi060 ceph-mon[94333]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:55 smithi110 ceph-mon[82130]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:58.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:57 smithi060 ceph-mon[94333]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:57 smithi110 ceph-mon[82130]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:55:59.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:55:59.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:00.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:55:59 smithi060 ceph-mon[94333]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:55:59 smithi110 ceph-mon[82130]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:01 smithi060 ceph-mon[94333]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:02.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:01 smithi110 ceph-mon[82130]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:03 smithi060 ceph-mon[94333]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:03 smithi110 ceph-mon[82130]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:06.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:05 smithi060 ceph-mon[94333]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:05 smithi110 ceph-mon[82130]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:07.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph orch ps' 2024-04-12T13:56:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:56:08.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:07 smithi060 ceph-mon[94333]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:07 smithi110 ceph-mon[82130]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:09 smithi060 ceph-mon[94333]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:09 smithi110 ceph-mon[82130]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:10.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 -- 172.21.15.60:0/1105873000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 msgr2=0x7fa918100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1105873000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa918100bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa904004940 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 -- 172.21.15.60:0/1105873000 shutdown_connections 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1105873000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa918100bc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1105873000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 0x7fa9180fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 -- 172.21.15.60:0/1105873000 >> 172.21.15.60:0/1105873000 conn(0x7fa9180f78e0 msgr2=0x7fa9180f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 -- 172.21.15.60:0/1105873000 shutdown_connections 2024-04-12T13:56:10.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.543+0000 7fa91fa00700 1 -- 172.21.15.60:0/1105873000 wait complete. 2024-04-12T13:56:10.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.544+0000 7fa91fa00700 1 Processor -- start 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.544+0000 7fa91fa00700 1 -- start start 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa91fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 0x7fa91811a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa91fa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa91fa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91811abe0 con 0x7fa9180fc5a0 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa91fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9181141c0 con 0x7fa9180fbc00 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa90fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa90fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34164/0 (socket says 172.21.15.60:34164) 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa90fe00700 1 -- 172.21.15.60:0/1966525428 learned_addr learned my addr 172.21.15.60:0/1966525428 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.545+0000 7fa91d000700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 0x7fa91811a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa90fe00700 1 -- 172.21.15.60:0/1966525428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 msgr2=0x7fa91811a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:10.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa90fe00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 0x7fa91811a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa90fe00700 1 -- 172.21.15.60:0/1966525428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904005040 con 0x7fa9180fc5a0 2024-04-12T13:56:10.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa90fe00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa904009150 tx=0x7fa904009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:10.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90400e040 con 0x7fa9180fc5a0 2024-04-12T13:56:10.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa904013420 con 0x7fa9180fc5a0 2024-04-12T13:56:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa918114440 con 0x7fa9180fc5a0 2024-04-12T13:56:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90401c630 con 0x7fa9180fc5a0 2024-04-12T13:56:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.546+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa918114980 con 0x7fa9180fc5a0 2024-04-12T13:56:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.548+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa918066780 con 0x7fa9180fc5a0 2024-04-12T13:56:10.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.549+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa904013590 con 0x7fa9180fc5a0 2024-04-12T13:56:10.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.550+0000 7fa915600700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 0x7fa8f40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:10.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.550+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fa90408fd00 con 0x7fa9180fc5a0 2024-04-12T13:56:10.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.550+0000 7fa91d000700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 0x7fa8f40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:10.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.551+0000 7fa91d000700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 0x7fa8f40710b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc004990 tx=0x7fa8fc009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:10.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.555+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fa904093030 con 0x7fa9180fc5a0 2024-04-12T13:56:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.795+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 --> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa918110580 con 0x7fa8f406ec00 2024-04-12T13:56:10.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.828+0000 7fa915600700 1 -- 172.21.15.60:0/1966525428 <== mgr.34102 v2:172.21.15.60:6800/126565405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa918110580 con 0x7fa8f406ec00 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (2m) 106s ago 24m 14.2M - 0.25.0 c8568f914cd2 1ddde97968ad 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (9m) 106s ago 25m 6660k - 19.0.0-2778-ga971fd5f b96c509eef84 e6b7391162db 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi110 smithi110 running (9m) 3m ago 23m 6656k - 19.0.0-2778-ga971fd5f b96c509eef84 4da7aedebd20 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (113s) 106s ago 24m 49.7M - 9.4.12 2bacad6d85d8 86318ce12c66 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.epmcph smithi060 running (4m) 106s ago 17m 11.9M - 19.0.0-2778-ga971fd5f b96c509eef84 a81e5fb0273e 2024-04-12T13:56:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.mwwohl smithi060 running (5m) 106s ago 17m 83.7M - 19.0.0-2778-ga971fd5f b96c509eef84 fbfb2a64b9fd 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.getdvx smithi110 running (4m) 3m ago 17m 11.2M - 19.0.0-2778-ga971fd5f b96c509eef84 709e454afb99 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi110.zqdflr smithi110 running (3m) 3m ago 17m 11.1M - 19.0.0-2778-ga971fd5f b96c509eef84 0c26cec850b0 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.bpzacg smithi060 *:8443,9283,8765 running (12m) 106s ago 26m 521M - 19.0.0-2778-ga971fd5f b96c509eef84 73d2df60ca58 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi110.ezwdax smithi110 *:8443,9283,8765 running (11m) 3m ago 23m 454M - 19.0.0-2778-ga971fd5f b96c509eef84 b67569f1709c 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (11m) 106s ago 26m 61.5M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 d8408587103d 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi110 smithi110 running (10m) 3m ago 23m 43.8M 2048M 19.0.0-2778-ga971fd5f b96c509eef84 ff4fbde68ed9 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (3m) 106s ago 25m 7457k - 1.5.0 0da6a335fe13 9dc5b1bd6177 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi110 smithi110 *:9100 running (3m) 3m ago 23m 6819k - 1.5.0 0da6a335fe13 f4688cc75136 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (8m) 106s ago 22m 113M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ce149293c20b 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (8m) 106s ago 22m 200M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 406defa859c0 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (7m) 106s ago 21m 122M 1559M 19.0.0-2778-ga971fd5f b96c509eef84 ebee837f2e3a 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi110 running (7m) 3m ago 20m 115M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 eba67478cde9 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi110 running (6m) 3m ago 20m 95.0M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 033af6691a0b 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi110 running (5m) 3m ago 19m 101M 2581M 19.0.0-2778-ga971fd5f b96c509eef84 0bece313e853 2024-04-12T13:56:10.832 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 106s ago 24m 49.7M - 2.43.0 a07b618ecd1d 8e9ff49cdadb 2024-04-12T13:56:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 msgr2=0x7fa8f40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 0x7fa8f40710b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc004990 tx=0x7fa8fc009ee0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 msgr2=0x7fa91811a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa904009150 tx=0x7fa904009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 shutdown_connections 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fa8f406ec00 0x7fa8f40710b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9180fbc00 0x7fa91811a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 --2- 172.21.15.60:0/1966525428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9180fc5a0 0x7fa91811a590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.831+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 >> 172.21.15.60:0/1966525428 conn(0x7fa9180f78e0 msgr2=0x7fa9180f8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.832+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 shutdown_connections 2024-04-12T13:56:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:10.832+0000 7fa91fa00700 1 -- 172.21.15.60:0/1966525428 wait complete. 2024-04-12T13:56:11.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph versions' 2024-04-12T13:56:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:11 smithi060 ceph-mon[94333]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:11 smithi060 ceph-mon[94333]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:56:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:11 smithi110 ceph-mon[82130]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:11 smithi110 ceph-mon[82130]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T13:56:12.374 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:56:14.139 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:13 smithi060 ceph-mon[94333]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:14.139 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:13 smithi110 ceph-mon[82130]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 -- 172.21.15.60:0/3268005140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d901037c0 msgr2=0x7f6d900fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3268005140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d901037c0 0x7f6d900fce30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c004940 tx=0x7f6d7c009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 -- 172.21.15.60:0/3268005140 shutdown_connections 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3268005140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d901037c0 0x7f6d900fce30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3268005140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d90102e20 0x7f6d901031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 -- 172.21.15.60:0/3268005140 >> 172.21.15.60:0/3268005140 conn(0x7f6d900f89d0 msgr2=0x7f6d900fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 -- 172.21.15.60:0/3268005140 shutdown_connections 2024-04-12T13:56:14.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.752+0000 7f6d94e00700 1 -- 172.21.15.60:0/3268005140 wait complete. 2024-04-12T13:56:14.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.753+0000 7f6d94e00700 1 Processor -- start 2024-04-12T13:56:14.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.753+0000 7f6d94e00700 1 -- start start 2024-04-12T13:56:14.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d94e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:14.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d94e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d901037c0 0x7f6d90070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:14.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d94e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90070d90 con 0x7f6d90102e20 2024-04-12T13:56:14.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d94e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90070ed0 con 0x7f6d901037c0 2024-04-12T13:56:14.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d8de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:14.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d8de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34178/0 (socket says 172.21.15.60:34178) 2024-04-12T13:56:14.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.754+0000 7f6d8de00700 1 -- 172.21.15.60:0/3344058641 learned_addr learned my addr 172.21.15.60:0/3344058641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:14.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d8de00700 1 -- 172.21.15.60:0/3344058641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d901037c0 msgr2=0x7f6d90070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:14.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d8de00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d901037c0 0x7f6d90070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:14.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d8de00700 1 -- 172.21.15.60:0/3344058641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c005040 con 0x7f6d90102e20 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d8de00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d80002a50 tx=0x7f6d800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d80007cc0 con 0x7f6d90102e20 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d8000f040 con 0x7f6d90102e20 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d80009640 con 0x7f6d90102e20 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.755+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d90119eb0 con 0x7f6d90102e20 2024-04-12T13:56:14.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.756+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9011a330 con 0x7f6d90102e20 2024-04-12T13:56:14.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.757+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d901052f0 con 0x7f6d90102e20 2024-04-12T13:56:14.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.758+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6d800097a0 con 0x7f6d90102e20 2024-04-12T13:56:14.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.759+0000 7f6d86000700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 0x7f6d740710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:14.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.759+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f6d8008e800 con 0x7f6d90102e20 2024-04-12T13:56:14.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.760+0000 7f6d8d400700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 0x7f6d740710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:14.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.760+0000 7f6d8d400700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 0x7f6d740710c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c004f90 tx=0x7f6d7c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:14.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:14.765+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6d800573c0 con 0x7f6d90102e20 2024-04-12T13:56:15.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.095+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d90109f00 con 0x7f6d90102e20 2024-04-12T13:56:15.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.096+0000 7f6d86000700 1 -- 172.21.15.60:0/3344058641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6d8005aa80 con 0x7f6d90102e20 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 2 2024-04-12T13:56:15.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 6 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 4 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-04-12T13:56:15.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)": 14 2024-04-12T13:56:15.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-12T13:56:15.101 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 msgr2=0x7f6d740710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 0x7f6d740710c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c004f90 tx=0x7f6d7c009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 msgr2=0x7f6d900702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d80002a50 tx=0x7f6d800046b0 comp rx=0 tx=0).stop 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 shutdown_connections 2024-04-12T13:56:15.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6d7406ec10 0x7f6d740710c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:15.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d90102e20 0x7f6d900702c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:15.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 --2- 172.21.15.60:0/3344058641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d901037c0 0x7f6d90070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:15.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 >> 172.21.15.60:0/3344058641 conn(0x7f6d900f89d0 msgr2=0x7f6d901021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:15.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.100+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 shutdown_connections 2024-04-12T13:56:15.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:15.101+0000 7f6d94e00700 1 -- 172.21.15.60:0/3344058641 wait complete. 2024-04-12T13:56:15.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-12T13:56:16.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:15 smithi060 ceph-mon[94333]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:16.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:15 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3344058641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:15 smithi110 ceph-mon[82130]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:15 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3344058641' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:16.416 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:56:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:17 smithi060 ceph-mon[94333]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:17 smithi110 ceph-mon[82130]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.684+0000 7f9544600700 1 -- 172.21.15.60:0/484080626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 msgr2=0x7f953c0fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.684+0000 7f9544600700 1 --2- 172.21.15.60:0/484080626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fe260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9530004940 tx=0x7f9530009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 -- 172.21.15.60:0/484080626 shutdown_connections 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 --2- 172.21.15.60:0/484080626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 --2- 172.21.15.60:0/484080626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fe260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 -- 172.21.15.60:0/484080626 >> 172.21.15.60:0/484080626 conn(0x7f953c0f7900 msgr2=0x7f953c0f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 -- 172.21.15.60:0/484080626 shutdown_connections 2024-04-12T13:56:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.685+0000 7f9544600700 1 -- 172.21.15.60:0/484080626 wait complete. 2024-04-12T13:56:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.686+0000 7f9544600700 1 Processor -- start 2024-04-12T13:56:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.686+0000 7f9544600700 1 -- start start 2024-04-12T13:56:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9544600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9544600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c0fc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9544600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0fdc10 con 0x7f953c0fde90 2024-04-12T13:56:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9544600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c0fc740 con 0x7f953c0fe830 2024-04-12T13:56:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9541c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9541c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34196/0 (socket says 172.21.15.60:34196) 2024-04-12T13:56:18.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.687+0000 7f9541c00700 1 -- 172.21.15.60:0/4006974141 learned_addr learned my addr 172.21.15.60:0/4006974141 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541200700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c0fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541c00700 1 -- 172.21.15.60:0/4006974141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 msgr2=0x7f953c0fc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541c00700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c0fc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541c00700 1 -- 172.21.15.60:0/4006974141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530005040 con 0x7f953c0fde90 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541200700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c0fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9541c00700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9530009180 tx=0x7f9530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953000e040 con 0x7f953c0fde90 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9530013420 con 0x7f953c0fde90 2024-04-12T13:56:18.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.688+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c0fc9c0 con 0x7f953c0fde90 2024-04-12T13:56:18.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.689+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c11a030 con 0x7f953c0fde90 2024-04-12T13:56:18.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.689+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953001c630 con 0x7f953c0fde90 2024-04-12T13:56:18.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.690+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c066b60 con 0x7f953c0fde90 2024-04-12T13:56:18.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.691+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9530013590 con 0x7f953c0fde90 2024-04-12T13:56:18.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.692+0000 7f9539600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 0x7f95240710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:18.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.692+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f953008fea0 con 0x7f953c0fde90 2024-04-12T13:56:18.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.692+0000 7f9541200700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 0x7f95240710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:18.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.693+0000 7f9541200700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 0x7f95240710b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9528007fd0 tx=0x7f9528009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:18.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:18.697+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f9530058a60 con 0x7f953c0fde90 2024-04-12T13:56:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.019+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f953c11a330 con 0x7f953c0fde90 2024-04-12T13:56:19.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.020+0000 7f9539600700 1 -- 172.21.15.60:0/4006974141 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f953005c120 con 0x7f953c0fde90 2024-04-12T13:56:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 msgr2=0x7f95240710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 0x7f95240710b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9528007fd0 tx=0x7f9528009040 comp rx=0 tx=0).stop 2024-04-12T13:56:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 msgr2=0x7f953c0fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9530009180 tx=0x7f9530009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 shutdown_connections 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f952406ec00 0x7f95240710b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f953c0fde90 0x7f953c0fbcc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 --2- 172.21.15.60:0/4006974141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f953c0fe830 0x7f953c0fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 >> 172.21.15.60:0/4006974141 conn(0x7f953c0f7900 msgr2=0x7f953c1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.023+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 shutdown_connections 2024-04-12T13:56:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:19.024+0000 7f9544600700 1 -- 172.21.15.60:0/4006974141 wait complete. 2024-04-12T13:56:19.043 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-04-12T13:56:19.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -e sha1=a971fd5f5719038c70b817bafacd6d5400b1d888 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-12T13:56:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:19 smithi060 ceph-mon[94333]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:19 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/4006974141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:19 smithi110 ceph-mon[82130]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:19 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/4006974141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:20.415 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:56:22.154 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:21 smithi060 ceph-mon[94333]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:21 smithi110 ceph-mon[82130]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.667+0000 7f65b8a00700 1 -- 172.21.15.60:0/2615480296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 msgr2=0x7f65b40fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.667+0000 7f65b8a00700 1 --2- 172.21.15.60:0/2615480296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fc770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f659c004940 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 -- 172.21.15.60:0/2615480296 shutdown_connections 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 --2- 172.21.15.60:0/2615480296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fc770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 --2- 172.21.15.60:0/2615480296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 0x7f65b4101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:22.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 -- 172.21.15.60:0/2615480296 >> 172.21.15.60:0/2615480296 conn(0x7f65b40721b0 msgr2=0x7f65b40725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:22.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 -- 172.21.15.60:0/2615480296 shutdown_connections 2024-04-12T13:56:22.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.668+0000 7f65b8a00700 1 -- 172.21.15.60:0/2615480296 wait complete. 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 Processor -- start 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 -- start start 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 0x7f65b40fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40fe310 con 0x7f65b40fc300 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.669+0000 7f65b8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40fe450 con 0x7f65b4101c00 2024-04-12T13:56:22.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58126/0 (socket says 172.21.15.60:58126) 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 -- 172.21.15.60:0/997728676 learned_addr learned my addr 172.21.15.60:0/997728676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b1e00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 0x7f65b40fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 -- 172.21.15.60:0/997728676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 msgr2=0x7f65b40fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 0x7f65b40fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.670+0000 7f65b2800700 1 -- 172.21.15.60:0/997728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c005040 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65b2800700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f65a4001ce0 tx=0x7f65a4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a400db60 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4119cf0 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65a400f040 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a4009730 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.671+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b411a170 con 0x7f65b40fc300 2024-04-12T13:56:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.672+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b40fd310 con 0x7f65b40fc300 2024-04-12T13:56:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.673+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f65a4007920 con 0x7f65b40fc300 2024-04-12T13:56:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.674+0000 7f65aaa00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 0x7f65980710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.674+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f65a408e5a0 con 0x7f65b40fc300 2024-04-12T13:56:22.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.675+0000 7f65b1e00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 0x7f65980710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:22.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.675+0000 7f65b1e00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 0x7f65980710b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65b40ff180 tx=0x7f659c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:22.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:22.679+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f65a4057190 con 0x7f65b40fc300 2024-04-12T13:56:23.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.008+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65b40fef30 con 0x7f65b40fc300 2024-04-12T13:56:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.009+0000 7f65aaa00700 1 -- 172.21.15.60:0/997728676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f65a405a850 con 0x7f65b40fc300 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 msgr2=0x7f65980710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 0x7f65980710b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65b40ff180 tx=0x7f659c009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 msgr2=0x7f65b40fd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f65a4001ce0 tx=0x7f65a4009e60 comp rx=0 tx=0).stop 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 shutdown_connections 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f659806ec00 0x7f65980710b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:23.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65b40fc300 0x7f65b40fd840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 --2- 172.21.15.60:0/997728676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b4101c00 0x7f65b40fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 >> 172.21.15.60:0/997728676 conn(0x7f65b40721b0 msgr2=0x7f65b4100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 shutdown_connections 2024-04-12T13:56:23.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:23.012+0000 7f65b8a00700 1 -- 172.21.15.60:0/997728676 wait complete. 2024-04-12T13:56:23.031 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.0.0-2778-ga971fd5f (a971fd5f5719038c70b817bafacd6d5400b1d888) squid (dev)" 2024-04-12T13:56:23.771 DEBUG:teuthology.parallel:result is None 2024-04-12T13:56:23.771 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T13:56:23.783 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T13:56:23.784 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:wip-64502-quincy-2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T13:56:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:23 smithi110 ceph-mon[82130]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:23 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/997728676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:24.311 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/mon.smithi060/config 2024-04-12T13:56:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:23 smithi060 ceph-mon[94333]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:23 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/997728676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T13:56:26.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:25 smithi060 ceph-mon[94333]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:25 smithi110 ceph-mon[82130]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:26.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.604+0000 7fc24ac00700 1 -- 172.21.15.60:0/3475024121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 msgr2=0x7fc2440fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:26.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.604+0000 7fc24ac00700 1 --2- 172.21.15.60:0/3475024121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc2440fce30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc230004940 tx=0x7fc230009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:26.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 -- 172.21.15.60:0/3475024121 shutdown_connections 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 --2- 172.21.15.60:0/3475024121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc2440fce30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 --2- 172.21.15.60:0/3475024121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc2441031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 -- 172.21.15.60:0/3475024121 >> 172.21.15.60:0/3475024121 conn(0x7fc2440f89b0 msgr2=0x7fc2440fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 -- 172.21.15.60:0/3475024121 shutdown_connections 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.605+0000 7fc24ac00700 1 -- 172.21.15.60:0/3475024121 wait complete. 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.606+0000 7fc24ac00700 1 Processor -- start 2024-04-12T13:56:26.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.606+0000 7fc24ac00700 1 -- start start 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc24ac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc24410b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc24ac00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc24ac00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24410f170 con 0x7fc2441037c0 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc24ac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24410f2b0 con 0x7fc244102e20 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc243400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc243400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58144/0 (socket says 172.21.15.60:58144) 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.607+0000 7fc243400700 1 -- 172.21.15.60:0/617444389 learned_addr learned my addr 172.21.15.60:0/617444389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243e00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc24410b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243400700 1 -- 172.21.15.60:0/617444389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 msgr2=0x7fc24410b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243400700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc24410b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243400700 1 -- 172.21.15.60:0/617444389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230005040 con 0x7fc2441037c0 2024-04-12T13:56:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243e00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc24410b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.608+0000 7fc243400700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc230009100 tx=0x7fc230009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.609+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23000e040 con 0x7fc2441037c0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.609+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc230013420 con 0x7fc2441037c0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.609+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24410bca0 con 0x7fc2441037c0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.609+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23001c630 con 0x7fc2441037c0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.609+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24411e6a0 con 0x7fc2441037c0 2024-04-12T13:56:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.610+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2440fe570 con 0x7fc2441037c0 2024-04-12T13:56:26.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.612+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc230013590 con 0x7fc2441037c0 2024-04-12T13:56:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.613+0000 7fc23be00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 0x7fc2280710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.613+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc2300907d0 con 0x7fc2441037c0 2024-04-12T13:56:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.614+0000 7fc243e00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 0x7fc2280710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.614+0000 7fc243e00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 0x7fc2280710b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:26.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.617+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc230059410 con 0x7fc2441037c0 2024-04-12T13:56:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.901+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc244109f70 con 0x7fc2441037c0 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.902+0000 7fc23be00700 1 -- 172.21.15.60:0/617444389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1935 (secure 0 0 0) 0x7fc23005cad0 con 0x7fc2441037c0 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-04-12T13:56:26.904 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 35 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-04-12T13:38:14.569115+0000 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-04-12T13:52:40.918247+0000 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 101 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T13:56:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34456} 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34456 members: 34456 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.mwwohl{0:34456} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.60:6826/3121261391,v1:172.21.15.60:6827/3121261391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:56:26.906 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.epmcph{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3859091803,v1:172.21.15.60:6829/3859091803] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.getdvx{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6824/367285564,v1:172.21.15.110:6825/367285564] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:56:26.907 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi110.zqdflr{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/11148834,v1:172.21.15.110:6827/11148834] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T13:56:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 msgr2=0x7fc2280710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 0x7fc2280710b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234008040 comp rx=0 tx=0).stop 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 msgr2=0x7fc24410b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc230009100 tx=0x7fc230009e30 comp rx=0 tx=0).stop 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 shutdown_connections 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc22806ec00 0x7fc2280710b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc244102e20 0x7fc24410b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 --2- 172.21.15.60:0/617444389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2441037c0 0x7fc24410b6a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.906+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 >> 172.21.15.60:0/617444389 conn(0x7fc2440f89b0 msgr2=0x7fc244071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.907+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 shutdown_connections 2024-04-12T13:56:26.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:26.907+0000 7fc24ac00700 1 -- 172.21.15.60:0/617444389 wait complete. 2024-04-12T13:56:26.910 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-04-12T13:56:27.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:26 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/617444389' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:56:27.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:26 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/617444389' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T13:56:27.756 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-12T13:56:27.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 -- 172.21.15.60:0/1771224275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102000 msgr2=0x7f2a281023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 --2- 172.21.15.60:0/1771224275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102000 0x7f2a281023d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a180048d0 tx=0x7f2a18009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 -- 172.21.15.60:0/1771224275 shutdown_connections 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 --2- 172.21.15.60:0/1771224275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a281029a0 0x7f2a280fc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 --2- 172.21.15.60:0/1771224275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102000 0x7f2a281023d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 -- 172.21.15.60:0/1771224275 >> 172.21.15.60:0/1771224275 conn(0x7f2a280f7b90 msgr2=0x7f2a280f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 -- 172.21.15.60:0/1771224275 shutdown_connections 2024-04-12T13:56:28.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.998+0000 7f2a27e00640 1 -- 172.21.15.60:0/1771224275 wait complete. 2024-04-12T13:56:28.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.999+0000 7f2a27e00640 1 Processor -- start 2024-04-12T13:56:28.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:27.999+0000 7f2a27e00640 1 -- start start 2024-04-12T13:56:28.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a27e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a28102000 0x7f2a28112b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a27e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a27e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28113680 con 0x7f2a281029a0 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a27e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2810ccd0 con 0x7f2a28102000 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58168/0 (socket says 172.21.15.60:58168) 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 -- 172.21.15.60:0/3224339175 learned_addr learned my addr 172.21.15.60:0/3224339175 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26a00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a28102000 0x7f2a28112b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 -- 172.21.15.60:0/3224339175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a28102000 msgr2=0x7f2a28112b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a28102000 0x7f2a28112b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.000+0000 7f2a26000640 1 -- 172.21.15.60:0/3224339175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18005040 con 0x7f2a281029a0 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a26000640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c790 tx=0x7f2a140043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a1400a820 con 0x7f2a281029a0 2024-04-12T13:56:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a1400ae50 con 0x7f2a281029a0 2024-04-12T13:56:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2810cfb0 con 0x7f2a281029a0 2024-04-12T13:56:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a140115e0 con 0x7f2a281029a0 2024-04-12T13:56:28.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.001+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2810d4d0 con 0x7f2a281029a0 2024-04-12T13:56:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.002+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a280fd770 con 0x7f2a281029a0 2024-04-12T13:56:28.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.003+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2a14012400 con 0x7f2a281029a0 2024-04-12T13:56:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.004+0000 7f2a1ea00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 0x7f2a0c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.005+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f2a1408ece0 con 0x7f2a281029a0 2024-04-12T13:56:28.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.005+0000 7f2a26a00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 0x7f2a0c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.006+0000 7f2a26a00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 0x7f2a0c071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a18031870 tx=0x7f2a18009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.010+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f2a140578a0 con 0x7f2a281029a0 2024-04-12T13:56:28.182 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:27 smithi060 ceph-mon[94333]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.216+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a28109190 con 0x7f2a281029a0 2024-04-12T13:56:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.219+0000 7f2a1ea00640 1 -- 172.21.15.60:0/3224339175 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+17367 (secure 0 0 0) 0x7f2a14057030 con 0x7f2a281029a0 2024-04-12T13:56:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:28.221 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":101,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:52:29.504455+0000","last_up_change":"2024-04-12T13:50:40.271283+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T13:38:13.485475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T13:38:14.117573+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6803","nonce":1148773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6805","nonce":1148773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6809","nonce":1148773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6807","nonce":1148773022}]},"public_addr":"172.21.15.60:6803/1148773022","cluster_addr":"172.21.15.60:6805/1148773022","heartbeat_back_addr":"172.21.15.60:6809/1148773022","heartbeat_front_addr":"172.21.15.60:6807/1148773022","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":95,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6811","nonce":1855254170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6813","nonce":1855254170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6817","nonce":1855254170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6815","nonce":1855254170}]},"public_addr":"172.21.15.60:6811/1855254170","cluster_addr":"172.21.15.60:6813/1855254170","heartbeat_back_addr":"172.21.15.60:6817/1855254170","heartbeat_front_addr":"172.21.15.60:6815/1855254170","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":73,"up_thru":95,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6819","nonce":2464051082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6821","nonce":2464051082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6825","nonce":2464051082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6823","nonce":2464051082}]},"public_addr":"172.21.15.60:6819/2464051082","cluster_addr":"172.21.15.60:6821/2464051082","heartbeat_back_addr":"172.21.15.60:6825/2464051082","heartbeat_front_addr":"172.21.15.60:6823/2464051082","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6801","nonce":842224302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6803","nonce":842224302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6807","nonce":842224302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6805","nonce":842224302}]},"public_addr":"172.21.15.110:6801/842224302","cluster_addr":"172.21.15.110:6803/842224302","heartbeat_back_addr":"172.21.15.110:6807/842224302","heartbeat_front_addr":"172.21.15.110:6805/842224302","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6809","nonce":223716750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6811","nonce":223716750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6815","nonce":223716750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6813","nonce":223716750}]},"public_addr":"172.21.15.110:6809/223716750","cluster_addr":"172.21.15.110:6811/223716750","heartbeat_back_addr":"172.21.15.110:6815/223716750","heartbeat_front_addr":"172.21.15.110:6813/223716750","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6817","nonce":3606855652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6819","nonce":3606855652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6823","nonce":3606855652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6821","nonce":3606855652}]},"public_addr":"172.21.15.110:6817/3606855652","cluster_addr":"172.21.15.110:6819/3606855652","heartbeat_back_addr":"172.21.15.110:6823/3606855652","heartbeat_front_addr":"172.21.15.110:6821/3606855652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":0,"to":5}]},{"pgid":"2.1a","mappings":[{"from":3,"to":2}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"2.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":5}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6825/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.60:6828/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:6827/3800124536":"2024-04-13T13:50:51.723732+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/1128934038":"2024-04-13T13:45:13.090200+0000","172.21.15.110:6829/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.110:0/890951757":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/657445096":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/578861147":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6826/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.60:6801/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/2674766807":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6800/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.110:0/817733215":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6829/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.110:6824/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.110:0/3047753227":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2672639608":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1310101403":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/2874214879":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6827/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.110:0/2534067942":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.110:6828/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1631919154":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1303426533":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1963942392":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6826/3800124536":"2024-04-13T13:50:51.723732+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:56:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 msgr2=0x7f2a0c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 0x7f2a0c071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a18031870 tx=0x7f2a18009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 msgr2=0x7f2a28113080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c790 tx=0x7f2a140043c0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 shutdown_connections 2024-04-12T13:56:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f2a0c06eb70 0x7f2a0c071020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a281029a0 0x7f2a28113080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 --2- 172.21.15.60:0/3224339175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a28102000 0x7f2a28112b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 >> 172.21.15.60:0/3224339175 conn(0x7f2a280f7b90 msgr2=0x7f2a280f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 shutdown_connections 2024-04-12T13:56:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.221+0000 7f2a27e00640 1 -- 172.21.15.60:0/3224339175 wait complete. 2024-04-12T13:56:28.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T13:34:54.600821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T13:38:13.485475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T13:38:14.117573+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T13:56:28.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 -- 172.21.15.60:0/3579365880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 msgr2=0x7f33241027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 --2- 172.21.15.60:0/3579365880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f33241027c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3314009c50 tx=0x7f3314004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 -- 172.21.15.60:0/3579365880 shutdown_connections 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 --2- 172.21.15.60:0/3579365880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3324102d90 0x7f33240fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 --2- 172.21.15.60:0/3579365880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f33241027c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.446+0000 7f332a200640 1 -- 172.21.15.60:0/3579365880 >> 172.21.15.60:0/3579365880 conn(0x7f33240f7fe0 msgr2=0x7f33240fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:28.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.447+0000 7f332a200640 1 -- 172.21.15.60:0/3579365880 shutdown_connections 2024-04-12T13:56:28.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.447+0000 7f332a200640 1 -- 172.21.15.60:0/3579365880 wait complete. 2024-04-12T13:56:28.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.447+0000 7f332a200640 1 Processor -- start 2024-04-12T13:56:28.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.447+0000 7f332a200640 1 -- start start 2024-04-12T13:56:28.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f332a200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f332a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3324102d90 0x7f3324115680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f332a200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3324115c80 con 0x7f33241023f0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f332a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332410f2d0 con 0x7f3324102d90 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58180/0 (socket says 172.21.15.60:58180) 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 -- 172.21.15.60:0/1550636489 learned_addr learned my addr 172.21.15.60:0/1550636489 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 -- 172.21.15.60:0/1550636489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3324102d90 msgr2=0x7f3324115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3324102d90 0x7f3324115680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.448+0000 7f3323400640 1 -- 172.21.15.60:0/1550636489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140098b0 con 0x7f33241023f0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f3323400640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f331402c1e0 tx=0x7f3314004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331403a070 con 0x7f33241023f0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3314009740 con 0x7f33241023f0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332410f550 con 0x7f33241023f0 2024-04-12T13:56:28.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f331403eb40 con 0x7f33241023f0 2024-04-12T13:56:28.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.449+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332410faf0 con 0x7f33241023f0 2024-04-12T13:56:28.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.450+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33240fdb60 con 0x7f33241023f0 2024-04-12T13:56:28.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.451+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3314032070 con 0x7f33241023f0 2024-04-12T13:56:28.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.452+0000 7f331be00640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 0x7f3308071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.452+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f33140b0ec0 con 0x7f33241023f0 2024-04-12T13:56:28.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.453+0000 7f331aa00640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 0x7f3308071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.453+0000 7f331aa00640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 0x7f3308071030 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3324110a00 tx=0x7f330c007cb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.457+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f3314079b30 con 0x7f33241023f0 2024-04-12T13:56:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:27 smithi110 ceph-mon[82130]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:28.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.666+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33241107b0 con 0x7f33241023f0 2024-04-12T13:56:28.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.667+0000 7f331be00640 1 -- 172.21.15.60:0/1550636489 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f331407d1f0 con 0x7f33241023f0 2024-04-12T13:56:28.669 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 msgr2=0x7f3308071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 0x7f3308071030 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3324110a00 tx=0x7f330c007cb0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 msgr2=0x7f3324115140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f331402c1e0 tx=0x7f3314004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 shutdown_connections 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f330806eb80 0x7f3308071030 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3324102d90 0x7f3324115680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 --2- 172.21.15.60:0/1550636489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33241023f0 0x7f3324115140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 >> 172.21.15.60:0/1550636489 conn(0x7f33240f7fe0 msgr2=0x7f3324070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:28.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 shutdown_connections 2024-04-12T13:56:28.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.670+0000 7f332a200640 1 -- 172.21.15.60:0/1550636489 wait complete. 2024-04-12T13:56:28.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 -- 172.21.15.60:0/4038588174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc1021c0 msgr2=0x7f6dcc102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4038588174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc102590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00048d0 tx=0x7f6dc0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 -- 172.21.15.60:0/4038588174 shutdown_connections 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4038588174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc102b60 0x7f6dcc0fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4038588174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc102590 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.911+0000 7f6dd4800640 1 -- 172.21.15.60:0/4038588174 >> 172.21.15.60:0/4038588174 conn(0x7f6dcc0708f0 msgr2=0x7f6dcc070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.912+0000 7f6dd4800640 1 -- 172.21.15.60:0/4038588174 shutdown_connections 2024-04-12T13:56:28.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.912+0000 7f6dd4800640 1 -- 172.21.15.60:0/4038588174 wait complete. 2024-04-12T13:56:28.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.912+0000 7f6dd4800640 1 Processor -- start 2024-04-12T13:56:28.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd4800640 1 -- start start 2024-04-12T13:56:28.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd4800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd4800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd4800640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc115ab0 con 0x7f6dcc102b60 2024-04-12T13:56:28.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd4800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc10f100 con 0x7f6dcc1021c0 2024-04-12T13:56:28.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd1400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd1400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58206/0 (socket says 172.21.15.60:58206) 2024-04-12T13:56:28.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.913+0000 7f6dd1400640 1 -- 172.21.15.60:0/4020664257 learned_addr learned my addr 172.21.15.60:0/4020664257 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1e00640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1400640 1 -- 172.21.15.60:0/4020664257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 msgr2=0x7f6dcc114f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1400640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc114f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1400640 1 -- 172.21.15.60:0/4020664257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0005040 con 0x7f6dcc102b60 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1e00640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dd1400640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc002a50 tx=0x7f6dbc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.914+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dbc007c30 con 0x7f6dcc102b60 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.915+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dbc00f040 con 0x7f6dcc102b60 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.915+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dbc00db50 con 0x7f6dcc102b60 2024-04-12T13:56:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.915+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc10f3e0 con 0x7f6dcc102b60 2024-04-12T13:56:28.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.915+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc10f900 con 0x7f6dcc102b60 2024-04-12T13:56:28.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.916+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc065350 con 0x7f6dcc102b60 2024-04-12T13:56:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.917+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6dbc00dcf0 con 0x7f6dcc102b60 2024-04-12T13:56:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.918+0000 7f6dc6000640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 0x7f6db4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.918+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f6dbc08e350 con 0x7f6dcc102b60 2024-04-12T13:56:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.918+0000 7f6dd1e00640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 0x7f6db4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:28.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.919+0000 7f6dd1e00640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 0x7f6db4071030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000c00 tx=0x7f6dc0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:28.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:28.923+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6dbc056f10 con 0x7f6dcc102b60 2024-04-12T13:56:29.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.135+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6dcc105da0 con 0x7f6dcc102b60 2024-04-12T13:56:29.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.136+0000 7f6dc6000640 1 -- 172.21.15.60:0/4020664257 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6dbc05a5d0 con 0x7f6dcc102b60 2024-04-12T13:56:29.138 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:29.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 msgr2=0x7f6db4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 0x7f6db4071030 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000c00 tx=0x7f6dc0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 msgr2=0x7f6dcc1154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc002a50 tx=0x7f6dbc004600 comp rx=0 tx=0).stop 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 shutdown_connections 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f6db406eb80 0x7f6db4071030 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dcc102b60 0x7f6dcc1154b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 --2- 172.21.15.60:0/4020664257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc1021c0 0x7f6dcc114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 >> 172.21.15.60:0/4020664257 conn(0x7f6dcc0708f0 msgr2=0x7f6dcc102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.139+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 shutdown_connections 2024-04-12T13:56:29.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.140+0000 7f6dd4800640 1 -- 172.21.15.60:0/4020664257 wait complete. 2024-04-12T13:56:29.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T13:56:29.243 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:28 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3224339175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:29.243 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:29.243 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:28 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1550636489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.379+0000 7f95da600640 1 -- 172.21.15.60:0/3181482348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 msgr2=0x7f95d4104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.379+0000 7f95da600640 1 --2- 172.21.15.60:0/3181482348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4104620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95c40048d0 tx=0x7f95c4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 -- 172.21.15.60:0/3181482348 shutdown_connections 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 --2- 172.21.15.60:0/3181482348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95d4104bf0 0x7f95d40fe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 --2- 172.21.15.60:0/3181482348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4104620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 -- 172.21.15.60:0/3181482348 >> 172.21.15.60:0/3181482348 conn(0x7f95d40f9fc0 msgr2=0x7f95d40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:29.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 -- 172.21.15.60:0/3181482348 shutdown_connections 2024-04-12T13:56:29.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 -- 172.21.15.60:0/3181482348 wait complete. 2024-04-12T13:56:29.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.380+0000 7f95da600640 1 Processor -- start 2024-04-12T13:56:29.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95da600640 1 -- start start 2024-04-12T13:56:29.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95da600640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95da600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95d4104bf0 0x7f95d4115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95da600640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41159c0 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95da600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d410ef80 con 0x7f95d4104bf0 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95d9200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95d9200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51938/0 (socket says 172.21.15.60:51938) 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.381+0000 7f95d9200640 1 -- 172.21.15.60:0/2233117388 learned_addr learned my addr 172.21.15.60:0/2233117388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d9200640 1 -- 172.21.15.60:0/2233117388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95d4104bf0 msgr2=0x7f95d4115330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d9200640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95d4104bf0 0x7f95d4115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d9200640 1 -- 172.21.15.60:0/2233117388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4005040 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d9200640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95c40047f0 tx=0x7f95c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c40094c0 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95c4032e50 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c40435f0 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d410f200 con 0x7f95d4104250 2024-04-12T13:56:29.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.382+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d410f6c0 con 0x7f95d4104250 2024-04-12T13:56:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.384+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d40ff9c0 con 0x7f95d4104250 2024-04-12T13:56:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.385+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f95c402f070 con 0x7f95d4104250 2024-04-12T13:56:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.386+0000 7f95d1600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 0x7f95b8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.386+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f95c40b0860 con 0x7f95d4104250 2024-04-12T13:56:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.386+0000 7f95cbe00640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 0x7f95b8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:29.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.387+0000 7f95cbe00640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 0x7f95b8071030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95d41106b0 tx=0x7f95bc006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.391+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f95c4079440 con 0x7f95d4104250 2024-04-12T13:56:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:28 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3224339175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:28 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1550636489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:29.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.600+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f95d410b4a0 con 0x7f95d4104250 2024-04-12T13:56:29.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.601+0000 7f95d1600640 1 -- 172.21.15.60:0/2233117388 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7f95c407cb00 con 0x7f95d4104250 2024-04-12T13:56:29.603 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:29.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 msgr2=0x7f95b8071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 0x7f95b8071030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95d41106b0 tx=0x7f95bc006d20 comp rx=0 tx=0).stop 2024-04-12T13:56:29.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 msgr2=0x7f95d4114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95c40047f0 tx=0x7f95c4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 shutdown_connections 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f95b806eb80 0x7f95b8071030 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95d4104bf0 0x7f95d4115330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 --2- 172.21.15.60:0/2233117388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95d4104250 0x7f95d4114df0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 >> 172.21.15.60:0/2233117388 conn(0x7f95d40f9fc0 msgr2=0x7f95d40fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 shutdown_connections 2024-04-12T13:56:29.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.604+0000 7f95da600640 1 -- 172.21.15.60:0/2233117388 wait complete. 2024-04-12T13:56:29.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 -- 172.21.15.60:0/448067624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 msgr2=0x7f0104102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 --2- 172.21.15.60:0/448067624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f0104102b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f00f40048d0 tx=0x7f00f4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 -- 172.21.15.60:0/448067624 shutdown_connections 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 --2- 172.21.15.60:0/448067624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f0104102b40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 --2- 172.21.15.60:0/448067624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 0x7f0104108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.838+0000 7f010b200640 1 -- 172.21.15.60:0/448067624 >> 172.21.15.60:0/448067624 conn(0x7f0104071e70 msgr2=0x7f0104074280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.839+0000 7f010b200640 1 -- 172.21.15.60:0/448067624 shutdown_connections 2024-04-12T13:56:29.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.839+0000 7f010b200640 1 -- 172.21.15.60:0/448067624 wait complete. 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.839+0000 7f010b200640 1 Processor -- start 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.840+0000 7f010b200640 1 -- start start 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.840+0000 7f010b200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.840+0000 7f010b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 0x7f0104119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.840+0000 7f010b200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104119c20 con 0x7f01041026d0 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.840+0000 7f010b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104113270 con 0x7f01041086a0 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51962/0 (socket says 172.21.15.60:51962) 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 -- 172.21.15.60:0/3430036272 learned_addr learned my addr 172.21.15.60:0/3430036272 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:29.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109400640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 0x7f0104119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:29.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 -- 172.21.15.60:0/3430036272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 msgr2=0x7f0104119620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:29.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 0x7f0104119620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:29.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 -- 172.21.15.60:0/3430036272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4005040 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.841+0000 7f0109e00640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c810 tx=0x7f00f80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.842+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f800a7a0 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.842+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00f800add0 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.842+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0104113550 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.842+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f80115c0 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.842+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0104113a40 con 0x7f01041026d0 2024-04-12T13:56:29.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.843+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0104103dc0 con 0x7f01041026d0 2024-04-12T13:56:29.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.844+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00f8012420 con 0x7f01041026d0 2024-04-12T13:56:29.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.845+0000 7f00fe000640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 0x7f00ec071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:29.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.845+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f00f808ef90 con 0x7f01041026d0 2024-04-12T13:56:29.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.845+0000 7f0109400640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 0x7f00ec071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:29.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.846+0000 7f0109400640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 0x7f00ec071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00f40048a0 tx=0x7f00f4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:29.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:29.850+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f00f8057b50 con 0x7f01041026d0 2024-04-12T13:56:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.102+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f010410f7b0 con 0x7f01041026d0 2024-04-12T13:56:30.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.103+0000 7f00fe000640 1 -- 172.21.15.60:0/3430036272 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5205 (secure 0 0 0) 0x7f00f805b210 con 0x7f01041026d0 2024-04-12T13:56:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:30.106 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44335,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/11148834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":11148834},{"type":"v1","addr":"172.21.15.110:6827","nonce":11148834}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:40.918247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":0,"incarnation":32,"state":"up:active","state_seq":26,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34456,"qdb_cluster":[34456]},"id":1}]} 2024-04-12T13:56:30.106 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 msgr2=0x7f00ec071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 0x7f00ec071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00f40048a0 tx=0x7f00f4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 msgr2=0x7f01041190e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c810 tx=0x7f00f80043c0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 shutdown_connections 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00ec06eb70 0x7f00ec071020 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01041086a0 0x7f0104119620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 --2- 172.21.15.60:0/3430036272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01041026d0 0x7f01041190e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 >> 172.21.15.60:0/3430036272 conn(0x7f0104071e70 msgr2=0x7f0104073d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 shutdown_connections 2024-04-12T13:56:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.106+0000 7f010b200640 1 -- 172.21.15.60:0/3430036272 wait complete. 2024-04-12T13:56:30.126 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-04-12T13:56:30.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-04-12T13:56:30.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 -- 172.21.15.60:0/519627674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb8102670 msgr2=0x7facb8102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 --2- 172.21.15.60:0/519627674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb8102670 0x7facb8102ae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faca00048d0 tx=0x7faca0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 -- 172.21.15.60:0/519627674 shutdown_connections 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 --2- 172.21.15.60:0/519627674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb8102670 0x7facb8102ae0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 --2- 172.21.15.60:0/519627674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb81075a0 0x7facb8107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 -- 172.21.15.60:0/519627674 >> 172.21.15.60:0/519627674 conn(0x7facb8071e60 msgr2=0x7facb8074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 -- 172.21.15.60:0/519627674 shutdown_connections 2024-04-12T13:56:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.334+0000 7facb7e00640 1 -- 172.21.15.60:0/519627674 wait complete. 2024-04-12T13:56:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 Processor -- start 2024-04-12T13:56:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 -- start start 2024-04-12T13:56:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8102670 0x7facb8119110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8119c50 con 0x7facb81075a0 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.335+0000 7facb7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81132f0 con 0x7facb8102670 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51986/0 (socket says 172.21.15.60:51986) 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 -- 172.21.15.60:0/550183347 learned_addr learned my addr 172.21.15.60:0/550183347 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6a00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8102670 0x7facb8119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 -- 172.21.15.60:0/550183347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8102670 msgr2=0x7facb8119110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8102670 0x7facb8119110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 -- 172.21.15.60:0/550183347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0005040 con 0x7facb81075a0 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.336+0000 7facb6000640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faca00047f0 tx=0x7faca0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.337+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca00094c0 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.337+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb8113570 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.337+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faca0032e50 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.337+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb8113a30 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.337+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca0044450 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.338+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb8103d60 con 0x7facb81075a0 2024-04-12T13:56:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.339+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faca002f070 con 0x7facb81075a0 2024-04-12T13:56:30.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.340+0000 7facaea00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 0x7fac9c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.341+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7faca00b0980 con 0x7facb81075a0 2024-04-12T13:56:30.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.341+0000 7facb6a00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 0x7fac9c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.342+0000 7facb6a00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 0x7fac9c071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:30.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.346+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7faca0079560 con 0x7facb81075a0 2024-04-12T13:56:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:30 smithi060 ceph-mon[94333]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:30 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/4020664257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:30.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:30 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2233117388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:30 smithi110 ceph-mon[82130]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:30 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/4020664257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:30 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2233117388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:30.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.599+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7facb810f810 con 0x7facb81075a0 2024-04-12T13:56:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.600+0000 7facaea00640 1 -- 172.21.15.60:0/550183347 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v35) v1 ==== 107+0+4070 (secure 0 0 0) 0x7faca007cc20 con 0x7facb81075a0 2024-04-12T13:56:30.603 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:30.603 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:50:51.723753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:30.603 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.603+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 msgr2=0x7fac9c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.603+0000 7facb7e00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 0x7fac9c071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8009e50 comp rx=0 tx=0).stop 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.603+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 msgr2=0x7facb8119650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.603+0000 7facb7e00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faca00047f0 tx=0x7faca0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 shutdown_connections 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fac9c06eb70 0x7fac9c071020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facb81075a0 0x7facb8119650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 --2- 172.21.15.60:0/550183347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facb8102670 0x7facb8119110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 >> 172.21.15.60:0/550183347 conn(0x7facb8071e60 msgr2=0x7facb8104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:30.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 shutdown_connections 2024-04-12T13:56:30.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.604+0000 7facb7e00640 1 -- 172.21.15.60:0/550183347 wait complete. 2024-04-12T13:56:30.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.831+0000 7fbf95c00640 1 -- 172.21.15.60:0/250644856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 msgr2=0x7fbf901023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.831+0000 7fbf95c00640 1 --2- 172.21.15.60:0/250644856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf901023e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009c50 tx=0x7fbf80004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 -- 172.21.15.60:0/250644856 shutdown_connections 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 --2- 172.21.15.60:0/250644856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 0x7fbf900fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 --2- 172.21.15.60:0/250644856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf901023e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 -- 172.21.15.60:0/250644856 >> 172.21.15.60:0/250644856 conn(0x7fbf900f7b80 msgr2=0x7fbf900f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 -- 172.21.15.60:0/250644856 shutdown_connections 2024-04-12T13:56:30.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.832+0000 7fbf95c00640 1 -- 172.21.15.60:0/250644856 wait complete. 2024-04-12T13:56:30.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 Processor -- start 2024-04-12T13:56:30.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 -- start start 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 0x7fbf90115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901158f0 con 0x7fbf90102010 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.833+0000 7fbf95c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9010eeb0 con 0x7fbf901029b0 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.834+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.834+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52002/0 (socket says 172.21.15.60:52002) 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.834+0000 7fbf8fe00640 1 -- 172.21.15.60:0/1279756800 learned_addr learned my addr 172.21.15.60:0/1279756800 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:30.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.834+0000 7fbf8f400640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 0x7fbf90115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf8fe00640 1 -- 172.21.15.60:0/1279756800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 msgr2=0x7fbf90115260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:30.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf8fe00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 0x7fbf90115260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:30.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf8fe00640 1 -- 172.21.15.60:0/1279756800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800098b0 con 0x7fbf90102010 2024-04-12T13:56:30.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf8fe00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002c1f0 tx=0x7fbf80004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf8003a070 con 0x7fbf90102010 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf80009740 con 0x7fbf90102010 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf8003eb40 con 0x7fbf90102010 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9010f130 con 0x7fbf90102010 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.835+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9010f650 con 0x7fbf90102010 2024-04-12T13:56:30.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.837+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf900fd780 con 0x7fbf90102010 2024-04-12T13:56:30.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.838+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbf80032070 con 0x7fbf90102010 2024-04-12T13:56:30.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.838+0000 7fbf87e00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 0x7fbf74071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:30.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.839+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fbf800b0f10 con 0x7fbf90102010 2024-04-12T13:56:30.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.839+0000 7fbf8f400640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 0x7fbf74071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:30.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.840+0000 7fbf8f400640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 0x7fbf74071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf901105e0 tx=0x7fbf7c009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:30.844+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fbf80079b80 con 0x7fbf90102010 2024-04-12T13:56:31.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.096+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7fbf90110420 con 0x7fbf90102010 2024-04-12T13:56:31.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.098+0000 7fbf87e00640 1 -- 172.21.15.60:0/1279756800 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v35) v1 ==== 107+0+4081 (secure 0 0 0) 0x7fbf8007d240 con 0x7fbf90102010 2024-04-12T13:56:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:31.100 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:50:51.730618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":0,"incarnation":15,"state":"up:replay","state_seq":3,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:31.101 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 msgr2=0x7fbf74071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 0x7fbf74071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf901105e0 tx=0x7fbf7c009120 comp rx=0 tx=0).stop 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 msgr2=0x7fbf90114d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002c1f0 tx=0x7fbf80004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 shutdown_connections 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbf7406eb70 0x7fbf74071020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf901029b0 0x7fbf90115260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 --2- 172.21.15.60:0/1279756800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90102010 0x7fbf90114d20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 >> 172.21.15.60:0/1279756800 conn(0x7fbf900f7b80 msgr2=0x7fbf90071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 shutdown_connections 2024-04-12T13:56:31.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.101+0000 7fbf95c00640 1 -- 172.21.15.60:0/1279756800 wait complete. 2024-04-12T13:56:31.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-12T13:56:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 -- 172.21.15.60:0/1085710922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 msgr2=0x7f23840fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 --2- 172.21.15.60:0/1085710922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f23840fe260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f236c009c50 tx=0x7f236c004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 -- 172.21.15.60:0/1085710922 shutdown_connections 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 --2- 172.21.15.60:0/1085710922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f23840fe260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 --2- 172.21.15.60:0/1085710922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 0x7f2384104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 -- 172.21.15.60:0/1085710922 >> 172.21.15.60:0/1085710922 conn(0x7f23840f9fc0 msgr2=0x7f23840fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.336+0000 7f2383e00640 1 -- 172.21.15.60:0/1085710922 shutdown_connections 2024-04-12T13:56:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.337+0000 7f2383e00640 1 -- 172.21.15.60:0/1085710922 wait complete. 2024-04-12T13:56:31.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.337+0000 7f2383e00640 1 Processor -- start 2024-04-12T13:56:31.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.337+0000 7f2383e00640 1 -- start start 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f2383e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 0x7f2384114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f2383e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f2383e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384115860 con 0x7f2384104bd0 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f2383e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238410eeb0 con 0x7f2384104230 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f237a000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f237a000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52018/0 (socket says 172.21.15.60:52018) 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.338+0000 7f237a000640 1 -- 172.21.15.60:0/966372107 learned_addr learned my addr 172.21.15.60:0/966372107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f2382a00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 0x7f2384114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237a000640 1 -- 172.21.15.60:0/966372107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 msgr2=0x7f2384114d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237a000640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 0x7f2384114d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237a000640 1 -- 172.21.15.60:0/966372107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0098b0 con 0x7f2384104bd0 2024-04-12T13:56:31.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237a000640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f236c02c1f0 tx=0x7f236c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:31.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236c03a070 con 0x7f2384104bd0 2024-04-12T13:56:31.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f236c004610 con 0x7f2384104bd0 2024-04-12T13:56:31.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f236c03ebe0 con 0x7f2384104bd0 2024-04-12T13:56:31.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.339+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238410f130 con 0x7f2384104bd0 2024-04-12T13:56:31.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.340+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238410f6d0 con 0x7f2384104bd0 2024-04-12T13:56:31.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.341+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23840ff9a0 con 0x7f2384104bd0 2024-04-12T13:56:31.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.342+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f236c032070 con 0x7f2384104bd0 2024-04-12T13:56:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.343+0000 7f237b400640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 0x7f2368071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.343+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f236c0b0eb0 con 0x7f2384104bd0 2024-04-12T13:56:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.344+0000 7f2382a00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 0x7f2368071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.345+0000 7f2382a00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 0x7f2368071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2374004ce0 tx=0x7f237400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.348+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f236c079be0 con 0x7f2384104bd0 2024-04-12T13:56:31.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:31 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3430036272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:56:31.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:31 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/550183347' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-12T13:56:31.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:31 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3430036272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T13:56:31.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:31 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/550183347' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-12T13:56:31.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.595+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f238410b390 con 0x7f2384104bd0 2024-04-12T13:56:31.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.597+0000 7f237b400640 1 -- 172.21.15.60:0/966372107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4086 (secure 0 0 0) 0x7f236c07d2a0 con 0x7f2384104bd0 2024-04-12T13:56:31.599 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:31.599 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:00.214878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":190,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:31.599 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 msgr2=0x7f2368071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 0x7f2368071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2374004ce0 tx=0x7f237400b040 comp rx=0 tx=0).stop 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 msgr2=0x7f2384115260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f236c02c1f0 tx=0x7f236c004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 shutdown_connections 2024-04-12T13:56:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f236806eb70 0x7f2368071020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2384104bd0 0x7f2384115260 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 --2- 172.21.15.60:0/966372107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384104230 0x7f2384114d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 >> 172.21.15.60:0/966372107 conn(0x7f23840f9fc0 msgr2=0x7f23840fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 shutdown_connections 2024-04-12T13:56:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.600+0000 7f2383e00640 1 -- 172.21.15.60:0/966372107 wait complete. 2024-04-12T13:56:31.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 -- 172.21.15.60:0/400619506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 msgr2=0x7f505c0fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 --2- 172.21.15.60:0/400619506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c0fe260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f50440048d0 tx=0x7f5044009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 -- 172.21.15.60:0/400619506 shutdown_connections 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 --2- 172.21.15.60:0/400619506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c0fe260 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 --2- 172.21.15.60:0/400619506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c104230 0x7f505c104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 -- 172.21.15.60:0/400619506 >> 172.21.15.60:0/400619506 conn(0x7f505c0f9fc0 msgr2=0x7f505c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:31.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 -- 172.21.15.60:0/400619506 shutdown_connections 2024-04-12T13:56:31.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.836+0000 7f5061e00640 1 -- 172.21.15.60:0/400619506 wait complete. 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 Processor -- start 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 -- start start 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c104230 0x7f505c114c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c1157b0 con 0x7f505c104bd0 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.837+0000 7f5061e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c115920 con 0x7f505c104230 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:31.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52042/0 (socket says 172.21.15.60:52042) 2024-04-12T13:56:31.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 -- 172.21.15.60:0/3429717158 learned_addr learned my addr 172.21.15.60:0/3429717158 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:31.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 -- 172.21.15.60:0/3429717158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c104230 msgr2=0x7f505c114c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:31.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c104230 0x7f505c114c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:31.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 -- 172.21.15.60:0/3429717158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044005040 con 0x7f505c104bd0 2024-04-12T13:56:31.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.838+0000 7f505be00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50440047f0 tx=0x7f5044009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.839+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50440094c0 con 0x7f505c104bd0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.839+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5044032e50 con 0x7f505c104bd0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.839+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50440433b0 con 0x7f505c104bd0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.839+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c10ef50 con 0x7f505c104bd0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.839+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c10f410 con 0x7f505c104bd0 2024-04-12T13:56:31.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.840+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c0ff9a0 con 0x7f505c104bd0 2024-04-12T13:56:31.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.841+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f504402f070 con 0x7f505c104bd0 2024-04-12T13:56:31.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.842+0000 7f5058c00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 0x7f5040071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:31.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.843+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f50440b0980 con 0x7f505c104bd0 2024-04-12T13:56:31.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.843+0000 7f5060a00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 0x7f5040071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:31.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.844+0000 7f5060a00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 0x7f5040071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f504c004c80 tx=0x7f504c009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:31.847+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f50440794c0 con 0x7f505c104bd0 2024-04-12T13:56:32.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.096+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f505c10f680 con 0x7f505c104bd0 2024-04-12T13:56:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.097+0000 7f5058c00640 1 -- 172.21.15.60:0/3429717158 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4083 (secure 0 0 0) 0x7f504407cb80 con 0x7f505c104bd0 2024-04-12T13:56:32.099 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:32.099 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:00.242797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":191,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 17 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.099+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 msgr2=0x7f5040071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 0x7f5040071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f504c004c80 tx=0x7f504c009c50 comp rx=0 tx=0).stop 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 msgr2=0x7f505c1151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50440047f0 tx=0x7f5044009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 shutdown_connections 2024-04-12T13:56:32.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f504006eb70 0x7f5040071020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f505c104bd0 0x7f505c1151b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 --2- 172.21.15.60:0/3429717158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c104230 0x7f505c114c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 >> 172.21.15.60:0/3429717158 conn(0x7f505c0f9fc0 msgr2=0x7f505c0fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 shutdown_connections 2024-04-12T13:56:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.100+0000 7f5061e00640 1 -- 172.21.15.60:0/3429717158 wait complete. 2024-04-12T13:56:32.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.325+0000 7fe9d5e00640 1 -- 172.21.15.60:0/1474273604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 msgr2=0x7fe9d00fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.325+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/1474273604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d00fd420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40048d0 tx=0x7fe9c4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 -- 172.21.15.60:0/1474273604 shutdown_connections 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/1474273604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d0106030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/1474273604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d00fd420 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 -- 172.21.15.60:0/1474273604 >> 172.21.15.60:0/1474273604 conn(0x7fe9d00f6aa0 msgr2=0x7fe9d00f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 -- 172.21.15.60:0/1474273604 shutdown_connections 2024-04-12T13:56:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.326+0000 7fe9d5e00640 1 -- 172.21.15.60:0/1474273604 wait complete. 2024-04-12T13:56:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 Processor -- start 2024-04-12T13:56:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 -- start start 2024-04-12T13:56:32.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d01130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01136b0 con 0x7fe9d00fd050 2024-04-12T13:56:32.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d5e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d010cd00 con 0x7fe9d00fd960 2024-04-12T13:56:32.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d4a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d4a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52060/0 (socket says 172.21.15.60:52060) 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.327+0000 7fe9d4a00640 1 -- 172.21.15.60:0/4242522130 learned_addr learned my addr 172.21.15.60:0/4242522130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9cfe00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d01130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9d4a00640 1 -- 172.21.15.60:0/4242522130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 msgr2=0x7fe9d01130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9d4a00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d01130b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9d4a00640 1 -- 172.21.15.60:0/4242522130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4005040 con 0x7fe9d00fd050 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9cfe00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d01130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:32.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.328+0000 7fe9d4a00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40041d0 tx=0x7fe9c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.329+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c4030870 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.329+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9c40092e0 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.329+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c4043400 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.329+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d010cf80 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.329+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d010d450 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.330+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d0065d60 con 0x7fe9d00fd050 2024-04-12T13:56:32.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.331+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe9c403b420 con 0x7fe9d00fd050 2024-04-12T13:56:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.332+0000 7fe9ccc00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 0x7fe9b8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.333+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fe9c40b1850 con 0x7fe9d00fd050 2024-04-12T13:56:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.333+0000 7fe9cfe00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 0x7fe9b8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.333+0000 7fe9cfe00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 0x7fe9b8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9d010e430 tx=0x7fe9bc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:32.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.337+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe9c407a4d0 con 0x7fe9d00fd050 2024-04-12T13:56:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:32 smithi060 ceph-mon[94333]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:32 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1279756800' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-12T13:56:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:32 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/966372107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-12T13:56:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:32 smithi110 ceph-mon[82130]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:32 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1279756800' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-12T13:56:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:32 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/966372107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-12T13:56:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.583+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fe9d010d6c0 con 0x7fe9d00fd050 2024-04-12T13:56:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.584+0000 7fe9ccc00640 1 -- 172.21.15.60:0/4242522130 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4092 (secure 0 0 0) 0x7fe9c407db90 con 0x7fe9d00fd050 2024-04-12T13:56:32.587 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:32.587 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:02.251047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":0,"incarnation":15,"state":"up:active","state_seq":192,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14458,"qdb_cluster":[14458]},"id":1}]} 2024-04-12T13:56:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 msgr2=0x7fe9b8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 0x7fe9b8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9d010e430 tx=0x7fe9bc00b040 comp rx=0 tx=0).stop 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 msgr2=0x7fe9d0112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40041d0 tx=0x7fe9c4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 shutdown_connections 2024-04-12T13:56:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe9b806eb70 0x7fe9b8071020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d00fd960 0x7fe9d01130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 --2- 172.21.15.60:0/4242522130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d00fd050 0x7fe9d0112b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.587+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 >> 172.21.15.60:0/4242522130 conn(0x7fe9d00f6aa0 msgr2=0x7fe9d00f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.588+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 shutdown_connections 2024-04-12T13:56:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.588+0000 7fe9d5e00640 1 -- 172.21.15.60:0/4242522130 wait complete. 2024-04-12T13:56:32.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 -- 172.21.15.60:0/271285523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918108860 msgr2=0x7f4918108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 --2- 172.21.15.60:0/271285523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918108860 0x7f4918108c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f490c0048d0 tx=0x7f490c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 -- 172.21.15.60:0/271285523 shutdown_connections 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 --2- 172.21.15.60:0/271285523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918102840 0x7f4918102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 --2- 172.21.15.60:0/271285523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918108860 0x7f4918108c30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 -- 172.21.15.60:0/271285523 >> 172.21.15.60:0/271285523 conn(0x7f4918072050 msgr2=0x7f4918074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 -- 172.21.15.60:0/271285523 shutdown_connections 2024-04-12T13:56:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.820+0000 7f491fe00640 1 -- 172.21.15.60:0/271285523 wait complete. 2024-04-12T13:56:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.821+0000 7f491fe00640 1 Processor -- start 2024-04-12T13:56:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.821+0000 7f491fe00640 1 -- start start 2024-04-12T13:56:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491fe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 0x7f49181197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491fe00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918119dc0 con 0x7f4918102840 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918119f30 con 0x7f4918108860 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52066/0 (socket says 172.21.15.60:52066) 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 -- 172.21.15.60:0/1078149434 learned_addr learned my addr 172.21.15.60:0/1078149434 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491ca00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 0x7f49181197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 -- 172.21.15.60:0/1078149434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 msgr2=0x7f49181197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 0x7f49181197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491d400640 1 -- 172.21.15.60:0/1078149434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c005040 con 0x7f4918102840 2024-04-12T13:56:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.822+0000 7f491ca00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 0x7f49181197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f491d400640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f490c0047f0 tx=0x7f490c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490c0094c0 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f490c032e50 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918113560 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f490c0435f0 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.823+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918113a20 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.824+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4918103f80 con 0x7f4918102840 2024-04-12T13:56:32.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.825+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f490c02f070 con 0x7f4918102840 2024-04-12T13:56:32.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.826+0000 7f4915600640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 0x7f4900071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:32.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.827+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f490c0b0990 con 0x7f4918102840 2024-04-12T13:56:32.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.827+0000 7f491ca00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 0x7f4900071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:32.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.828+0000 7f491ca00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 0x7f4900071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4918114b80 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:32.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:32.832+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f490c0794d0 con 0x7f4918102840 2024-04-12T13:56:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.075+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f4918064380 con 0x7f4918102840 2024-04-12T13:56:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.076+0000 7f4915600640 1 -- 172.21.15.60:0/1078149434 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4939 (secure 0 0 0) 0x7f490c07cb90 con 0x7f4918102840 2024-04-12T13:56:33.078 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:33.078 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:02.251047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi060.epmcph","rank":0,"incarnation":15,"state":"up:active","state_seq":192,"addr":"172.21.15.60:6829/2341264545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2341264545},{"type":"v1","addr":"172.21.15.60:6829","nonce":2341264545}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14458,"qdb_cluster":[14458]},"id":1}]} 2024-04-12T13:56:33.079 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 19 2024-04-12T13:56:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 msgr2=0x7f4900071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 0x7f4900071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4918114b80 tx=0x7f4904009040 comp rx=0 tx=0).stop 2024-04-12T13:56:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 msgr2=0x7f4918119280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f490c0047f0 tx=0x7f490c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 shutdown_connections 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f490006eb70 0x7f4900071020 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4918108860 0x7f49181197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 --2- 172.21.15.60:0/1078149434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4918102840 0x7f4918119280 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 >> 172.21.15.60:0/1078149434 conn(0x7f4918072050 msgr2=0x7f4918073fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 shutdown_connections 2024-04-12T13:56:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.079+0000 7f491fe00640 1 -- 172.21.15.60:0/1078149434 wait complete. 2024-04-12T13:56:33.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-12T13:56:33.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.308+0000 7fdac8a00640 1 -- 172.21.15.60:0/4259731027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 msgr2=0x7fdac41023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.308+0000 7fdac8a00640 1 --2- 172.21.15.60:0/4259731027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac41023e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009c50 tx=0x7fdab4004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:33.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 -- 172.21.15.60:0/4259731027 shutdown_connections 2024-04-12T13:56:33.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 --2- 172.21.15.60:0/4259731027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdac41029b0 0x7fdac40fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 --2- 172.21.15.60:0/4259731027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac41023e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 -- 172.21.15.60:0/4259731027 >> 172.21.15.60:0/4259731027 conn(0x7fdac40f7b80 msgr2=0x7fdac40f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:33.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 -- 172.21.15.60:0/4259731027 shutdown_connections 2024-04-12T13:56:33.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 -- 172.21.15.60:0/4259731027 wait complete. 2024-04-12T13:56:33.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.309+0000 7fdac8a00640 1 Processor -- start 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac8a00640 1 -- start start 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac8a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdac41029b0 0x7fdac4115240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac8a00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4115840 con 0x7fdac4102010 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac410ee90 con 0x7fdac41029b0 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac3400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac3400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52080/0 (socket says 172.21.15.60:52080) 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.310+0000 7fdac3400640 1 -- 172.21.15.60:0/2358137828 learned_addr learned my addr 172.21.15.60:0/2358137828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac3400640 1 -- 172.21.15.60:0/2358137828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdac41029b0 msgr2=0x7fdac4115240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac3400640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdac41029b0 0x7fdac4115240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac3400640 1 -- 172.21.15.60:0/2358137828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40098b0 con 0x7fdac4102010 2024-04-12T13:56:33.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac3400640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdab402c1e0 tx=0x7fdab4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab403a070 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdab4009740 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab403eb40 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac410f110 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.311+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac410f6b0 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.313+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40fd780 con 0x7fdac4102010 2024-04-12T13:56:33.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.313+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdab4032070 con 0x7fdac4102010 2024-04-12T13:56:33.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.314+0000 7fdabbe00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 0x7fdaa8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.314+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fdab40b0f10 con 0x7fdac4102010 2024-04-12T13:56:33.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.315+0000 7fdabaa00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 0x7fdaa8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:33.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.315+0000 7fdabaa00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 0x7fdaa8071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdac41105c0 tx=0x7fdaac007c30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.319+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fdab4079b80 con 0x7fdac4102010 2024-04-12T13:56:33.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:33 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3429717158' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-12T13:56:33.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:33 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/4242522130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-12T13:56:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:33 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3429717158' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-12T13:56:33.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:33 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/4242522130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-12T13:56:33.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.570+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fdac4109150 con 0x7fdac4102010 2024-04-12T13:56:33.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.571+0000 7fdabbe00640 1 -- 172.21.15.60:0/2358137828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4138 (secure 0 0 0) 0x7fdab407d240 con 0x7fdac4102010 2024-04-12T13:56:33.573 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:33.574 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:28.527516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:33.574 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 20 2024-04-12T13:56:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 msgr2=0x7fdaa8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 0x7fdaa8071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdac41105c0 tx=0x7fdaac007c30 comp rx=0 tx=0).stop 2024-04-12T13:56:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 msgr2=0x7fdac4114d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdab402c1e0 tx=0x7fdab4004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 shutdown_connections 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fdaa806eb70 0x7fdaa8071020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdac41029b0 0x7fdac4115240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 --2- 172.21.15.60:0/2358137828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdac4102010 0x7fdac4114d00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 >> 172.21.15.60:0/2358137828 conn(0x7fdac40f7b80 msgr2=0x7fdac4070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.574+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 shutdown_connections 2024-04-12T13:56:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.575+0000 7fdac8a00640 1 -- 172.21.15.60:0/2358137828 wait complete. 2024-04-12T13:56:33.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-12T13:56:33.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 -- 172.21.15.60:0/2294131460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 msgr2=0x7fda700fc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 --2- 172.21.15.60:0/2294131460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda700fc010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fda580048d0 tx=0x7fda58009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 -- 172.21.15.60:0/2294131460 shutdown_connections 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 --2- 172.21.15.60:0/2294131460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda700fc010 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 --2- 172.21.15.60:0/2294131460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 0x7fda701023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.806+0000 7fda6f200640 1 -- 172.21.15.60:0/2294131460 >> 172.21.15.60:0/2294131460 conn(0x7fda700f7b90 msgr2=0x7fda700f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.807+0000 7fda6f200640 1 -- 172.21.15.60:0/2294131460 shutdown_connections 2024-04-12T13:56:33.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.807+0000 7fda6f200640 1 -- 172.21.15.60:0/2294131460 wait complete. 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.807+0000 7fda6f200640 1 Processor -- start 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda6f200640 1 -- start start 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda6f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 0x7fda70112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda6f200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda6f200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda701135f0 con 0x7fda70102980 2024-04-12T13:56:33.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda6f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70113760 con 0x7fda70101fe0 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda67e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.808+0000 7fda67e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52084/0 (socket says 172.21.15.60:52084) 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda67e00640 1 -- 172.21.15.60:0/1507157133 learned_addr learned my addr 172.21.15.60:0/1507157133 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda6de00640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 0x7fda70112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda67e00640 1 -- 172.21.15.60:0/1507157133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 msgr2=0x7fda70112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda67e00640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 0x7fda70112ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda67e00640 1 -- 172.21.15.60:0/1507157133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58005040 con 0x7fda70102980 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.809+0000 7fda67e00640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fda58004930 tx=0x7fda58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.810+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda580094c0 con 0x7fda70102980 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.810+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda58032e50 con 0x7fda70102980 2024-04-12T13:56:33.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.810+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda580433b0 con 0x7fda70102980 2024-04-12T13:56:33.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.810+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7010cd90 con 0x7fda70102980 2024-04-12T13:56:33.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.810+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7010d250 con 0x7fda70102980 2024-04-12T13:56:33.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.811+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda700fd750 con 0x7fda70102980 2024-04-12T13:56:33.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.812+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fda5802f070 con 0x7fda70102980 2024-04-12T13:56:33.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.813+0000 7fda66000640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 0x7fda54071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:33.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.813+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fda580b0900 con 0x7fda70102980 2024-04-12T13:56:33.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.814+0000 7fda6de00640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 0x7fda54071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:33.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.814+0000 7fda6de00640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 0x7fda54071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda60009fd0 tx=0x7fda60009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:33.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:33.820+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fda58079440 con 0x7fda70102980 2024-04-12T13:56:34.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.074+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fda7004bcc0 con 0x7fda70102980 2024-04-12T13:56:34.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.075+0000 7fda66000640 1 -- 172.21.15.60:0/1507157133 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4149 (secure 0 0 0) 0x7fda5807cb00 con 0x7fda70102980 2024-04-12T13:56:34.077 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:34.077 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:28.539427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":0,"incarnation":21,"state":"up:replay","state_seq":4,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:34.078 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-04-12T13:56:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 msgr2=0x7fda54071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 0x7fda54071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda60009fd0 tx=0x7fda60009e50 comp rx=0 tx=0).stop 2024-04-12T13:56:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 msgr2=0x7fda70112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fda58004930 tx=0x7fda58009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 shutdown_connections 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fda5406eb70 0x7fda54071020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda70102980 0x7fda70112ff0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 --2- 172.21.15.60:0/1507157133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda70101fe0 0x7fda70112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 >> 172.21.15.60:0/1507157133 conn(0x7fda700f7b90 msgr2=0x7fda700f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 shutdown_connections 2024-04-12T13:56:34.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.078+0000 7fda6f200640 1 -- 172.21.15.60:0/1507157133 wait complete. 2024-04-12T13:56:34.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-12T13:56:34.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 -- 172.21.15.60:0/1856096196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 msgr2=0x7f4b080fc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/1856096196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b080fc040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4af40048d0 tx=0x7f4af4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 -- 172.21.15.60:0/1856096196 shutdown_connections 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/1856096196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b080fc040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/1856096196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 0x7f4b081023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 -- 172.21.15.60:0/1856096196 >> 172.21.15.60:0/1856096196 conn(0x7f4b080f7ba0 msgr2=0x7f4b080f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 -- 172.21.15.60:0/1856096196 shutdown_connections 2024-04-12T13:56:34.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.305+0000 7f4b0ca00640 1 -- 172.21.15.60:0/1856096196 wait complete. 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.306+0000 7f4b0ca00640 1 Processor -- start 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.306+0000 7f4b0ca00640 1 -- start start 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b0ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 0x7f4b08114d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b0ca00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b0ca00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08115880 con 0x7f4b081029b0 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b0ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0810eed0 con 0x7f4b08102010 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b05e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b05e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52104/0 (socket says 172.21.15.60:52104) 2024-04-12T13:56:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.307+0000 7f4b05e00640 1 -- 172.21.15.60:0/4014668532 learned_addr learned my addr 172.21.15.60:0/4014668532 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4b06800640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 0x7f4b08114d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4b05e00640 1 -- 172.21.15.60:0/4014668532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 msgr2=0x7f4b08114d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4b05e00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 0x7f4b08114d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4b05e00640 1 -- 172.21.15.60:0/4014668532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4005040 con 0x7f4b081029b0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4b05e00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4af40047f0 tx=0x7f4af4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.308+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af40094c0 con 0x7f4b081029b0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.309+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0810f150 con 0x7f4b081029b0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.309+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4af4032e50 con 0x7f4b081029b0 2024-04-12T13:56:34.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.309+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af40433b0 con 0x7f4b081029b0 2024-04-12T13:56:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.309+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0810f610 con 0x7f4b081029b0 2024-04-12T13:56:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.310+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b080fd780 con 0x7f4b081029b0 2024-04-12T13:56:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.311+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4af402f070 con 0x7f4b081029b0 2024-04-12T13:56:34.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.312+0000 7f4afea00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 0x7f4aec071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.312+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f4af40b0a60 con 0x7f4b081029b0 2024-04-12T13:56:34.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.313+0000 7f4b06800640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 0x7f4aec071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:34.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.313+0000 7f4b06800640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 0x7f4aec071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4af8004ce0 tx=0x7f4af800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.317+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f4af40795a0 con 0x7f4b081029b0 2024-04-12T13:56:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:34 smithi060 ceph-mon[94333]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:34 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1078149434' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-12T13:56:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:34 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2358137828' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-12T13:56:34.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:34 smithi110 ceph-mon[82130]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:34.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:34 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1078149434' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-12T13:56:34.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:34 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2358137828' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-12T13:56:34.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.567+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f4b0804bcc0 con 0x7f4b081029b0 2024-04-12T13:56:34.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.569+0000 7f4afea00640 1 -- 172.21.15.60:0/4014668532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4154 (secure 0 0 0) 0x7f4af407cc60 con 0x7f4b081029b0 2024-04-12T13:56:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:34.571 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:37.178999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":200,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:34.571 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 22 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 msgr2=0x7f4aec071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 0x7f4aec071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4af8004ce0 tx=0x7f4af800b040 comp rx=0 tx=0).stop 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 msgr2=0x7f4b08115280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4af40047f0 tx=0x7f4af4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 shutdown_connections 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f4aec06eb70 0x7f4aec071020 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b081029b0 0x7f4b08115280 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 --2- 172.21.15.60:0/4014668532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b08102010 0x7f4b08114d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.571+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 >> 172.21.15.60:0/4014668532 conn(0x7f4b080f7ba0 msgr2=0x7f4b080711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.572+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 shutdown_connections 2024-04-12T13:56:34.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.572+0000 7f4b0ca00640 1 -- 172.21.15.60:0/4014668532 wait complete. 2024-04-12T13:56:34.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.813+0000 7f4845a00640 1 -- 172.21.15.60:0/2165556397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 msgr2=0x7f484010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.813+0000 7f4845a00640 1 --2- 172.21.15.60:0/2165556397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f484010cb50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f48280048d0 tx=0x7f4828009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.813+0000 7f4845a00640 1 -- 172.21.15.60:0/2165556397 shutdown_connections 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 --2- 172.21.15.60:0/2165556397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f484010cb50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 --2- 172.21.15.60:0/2165556397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840071a00 0x7f4840071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 -- 172.21.15.60:0/2165556397 >> 172.21.15.60:0/2165556397 conn(0x7f48400f9fc0 msgr2=0x7f48400fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 -- 172.21.15.60:0/2165556397 shutdown_connections 2024-04-12T13:56:34.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 -- 172.21.15.60:0/2165556397 wait complete. 2024-04-12T13:56:34.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 Processor -- start 2024-04-12T13:56:34.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.814+0000 7f4845a00640 1 -- start start 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4845a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840071a00 0x7f48401192e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4845a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4845a00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840119e20 con 0x7f4840072310 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4845a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840113470 con 0x7f4840071a00 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4836000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4836000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52128/0 (socket says 172.21.15.60:52128) 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.815+0000 7f4836000640 1 -- 172.21.15.60:0/3811873122 learned_addr learned my addr 172.21.15.60:0/3811873122 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4836000640 1 -- 172.21.15.60:0/3811873122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840071a00 msgr2=0x7f48401192e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4836000640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840071a00 0x7f48401192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:34.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4836000640 1 -- 172.21.15.60:0/3811873122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828005040 con 0x7f4840072310 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4836000640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48280047f0 tx=0x7f4828009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48280094c0 con 0x7f4840072310 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4828032e50 con 0x7f4840072310 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48280435f0 con 0x7f4840072310 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48401136f0 con 0x7f4840072310 2024-04-12T13:56:34.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.816+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4840113bb0 con 0x7f4840072310 2024-04-12T13:56:34.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.818+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840073140 con 0x7f4840072310 2024-04-12T13:56:34.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.818+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f482802f070 con 0x7f4840072310 2024-04-12T13:56:34.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.819+0000 7f4837400640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 0x7f4824071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:34.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.819+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f48280b08f0 con 0x7f4840072310 2024-04-12T13:56:34.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.820+0000 7f483ea00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 0x7f4824071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:34.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.820+0000 7f483ea00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 0x7f4824071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4830004a50 tx=0x7f4830007cb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:34.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:34.825+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f48280794d0 con 0x7f4840072310 2024-04-12T13:56:35.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.076+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f484010f930 con 0x7f4840072310 2024-04-12T13:56:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.077+0000 7f4837400640 1 -- 172.21.15.60:0/3811873122 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4151 (secure 0 0 0) 0x7f482807cb90 con 0x7f4840072310 2024-04-12T13:56:35.080 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:35.080 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:37.782330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":201,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 msgr2=0x7f4824071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 0x7f4824071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4830004a50 tx=0x7f4830007cb0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 msgr2=0x7f4840119820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48280047f0 tx=0x7f4828009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 shutdown_connections 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f482406eb70 0x7f4824071020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4840072310 0x7f4840119820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 --2- 172.21.15.60:0/3811873122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4840071a00 0x7f48401192e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.080+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 >> 172.21.15.60:0/3811873122 conn(0x7f48400f9fc0 msgr2=0x7f4840106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:35.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.081+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 shutdown_connections 2024-04-12T13:56:35.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.081+0000 7f4845a00640 1 -- 172.21.15.60:0/3811873122 wait complete. 2024-04-12T13:56:35.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-12T13:56:35.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 -- 172.21.15.60:0/4200520026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102220 msgr2=0x7fbdfc1025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 --2- 172.21.15.60:0/4200520026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102220 0x7fbdfc1025f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbde40048d0 tx=0x7fbde4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 -- 172.21.15.60:0/4200520026 shutdown_connections 2024-04-12T13:56:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 --2- 172.21.15.60:0/4200520026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc0fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 --2- 172.21.15.60:0/4200520026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102220 0x7fbdfc1025f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 -- 172.21.15.60:0/4200520026 >> 172.21.15.60:0/4200520026 conn(0x7fbdfc0f7e10 msgr2=0x7fbdfc0fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 -- 172.21.15.60:0/4200520026 shutdown_connections 2024-04-12T13:56:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.315+0000 7fbe00a00640 1 -- 172.21.15.60:0/4200520026 wait complete. 2024-04-12T13:56:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 Processor -- start 2024-04-12T13:56:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 -- start start 2024-04-12T13:56:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc1154f0 0x7fbdfc10f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc115a70 con 0x7fbdfc102bc0 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.316+0000 7fbe00a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc115bb0 con 0x7fbdfc1154f0 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52152/0 (socket says 172.21.15.60:52152) 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 -- 172.21.15.60:0/1309960863 learned_addr learned my addr 172.21.15.60:0/1309960863 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9400640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc1154f0 0x7fbdfc10f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 -- 172.21.15.60:0/1309960863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc1154f0 msgr2=0x7fbdfc10f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc1154f0 0x7fbdfc10f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.317+0000 7fbdf9e00640 1 -- 172.21.15.60:0/1309960863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4005040 con 0x7fbdfc102bc0 2024-04-12T13:56:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbdf9e00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbde402be70 tx=0x7fbde4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbde40094c0 con 0x7fbdfc102bc0 2024-04-12T13:56:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbde4032e30 con 0x7fbdfc102bc0 2024-04-12T13:56:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc10f6e0 con 0x7fbdfc102bc0 2024-04-12T13:56:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbde403b400 con 0x7fbdfc102bc0 2024-04-12T13:56:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.318+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc10fc00 con 0x7fbdfc102bc0 2024-04-12T13:56:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.320+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc0fd990 con 0x7fbdfc102bc0 2024-04-12T13:56:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.321+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbde402f070 con 0x7fbdfc102bc0 2024-04-12T13:56:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.322+0000 7fbdf2000640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 0x7fbde0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.322+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fbde40b0e80 con 0x7fbdfc102bc0 2024-04-12T13:56:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.322+0000 7fbdf9400640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 0x7fbde0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.323+0000 7fbdf9400640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 0x7fbde0071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004e40 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:35.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.327+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fbde4079a60 con 0x7fbdfc102bc0 2024-04-12T13:56:35.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:35 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1507157133' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-12T13:56:35.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:35 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/4014668532' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-12T13:56:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:35 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1507157133' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-12T13:56:35.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:35 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/4014668532' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-12T13:56:35.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.577+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fbdfc064380 con 0x7fbdfc102bc0 2024-04-12T13:56:35.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.579+0000 7fbdf2000640 1 -- 172.21.15.60:0/1309960863 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4160 (secure 0 0 0) 0x7fbde407d120 con 0x7fbdfc102bc0 2024-04-12T13:56:35.581 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:35.581 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:39.795722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":0,"incarnation":21,"state":"up:active","state_seq":202,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-04-12T13:56:35.582 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-04-12T13:56:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.581+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 msgr2=0x7fbde0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.581+0000 7fbe00a00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 0x7fbde0071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004e40 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2024-04-12T13:56:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 msgr2=0x7fbdfc114fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbde402be70 tx=0x7fbde4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 shutdown_connections 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fbde006eb70 0x7fbde0071020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdfc1154f0 0x7fbdfc10f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 --2- 172.21.15.60:0/1309960863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdfc102bc0 0x7fbdfc114fb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 >> 172.21.15.60:0/1309960863 conn(0x7fbdfc0f7e10 msgr2=0x7fbdfc0700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 shutdown_connections 2024-04-12T13:56:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.582+0000 7fbe00a00640 1 -- 172.21.15.60:0/1309960863 wait complete. 2024-04-12T13:56:35.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 -- 172.21.15.60:0/2513082420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 msgr2=0x7f554c071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 --2- 172.21.15.60:0/2513082420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c071dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f55400048d0 tx=0x7f5540009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 -- 172.21.15.60:0/2513082420 shutdown_connections 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 --2- 172.21.15.60:0/2513082420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 0x7f554c10c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 --2- 172.21.15.60:0/2513082420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c071dd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 -- 172.21.15.60:0/2513082420 >> 172.21.15.60:0/2513082420 conn(0x7f554c0f9fc0 msgr2=0x7f554c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 -- 172.21.15.60:0/2513082420 shutdown_connections 2024-04-12T13:56:35.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.824+0000 7f5552400640 1 -- 172.21.15.60:0/2513082420 wait complete. 2024-04-12T13:56:35.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.825+0000 7f5552400640 1 Processor -- start 2024-04-12T13:56:35.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.825+0000 7f5552400640 1 -- start start 2024-04-12T13:56:35.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5552400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5552400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 0x7f554c1195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5552400640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c119bc0 con 0x7f554c071a00 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5552400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c119d30 con 0x7f554c072310 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5551000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5551000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52178/0 (socket says 172.21.15.60:52178) 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f5551000640 1 -- 172.21.15.60:0/2958237244 learned_addr learned my addr 172.21.15.60:0/2958237244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.826+0000 7f554be00640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 0x7f554c1195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5551000640 1 -- 172.21.15.60:0/2958237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 msgr2=0x7f554c1195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5551000640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 0x7f554c1195c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5551000640 1 -- 172.21.15.60:0/2958237244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540005040 con 0x7f554c071a00 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5551000640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f55400047f0 tx=0x7f5540009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55400094c0 con 0x7f554c071a00 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5540032e50 con 0x7f554c071a00 2024-04-12T13:56:35.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55400433b0 con 0x7f554c071a00 2024-04-12T13:56:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c113360 con 0x7f554c071a00 2024-04-12T13:56:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.827+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c113820 con 0x7f554c071a00 2024-04-12T13:56:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.828+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c073140 con 0x7f554c071a00 2024-04-12T13:56:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.829+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f554002f070 con 0x7f554c071a00 2024-04-12T13:56:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.830+0000 7f5548c00640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 0x7f5534071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.830+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f55400b0a20 con 0x7f554c071a00 2024-04-12T13:56:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.831+0000 7f554be00640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 0x7f5534071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.831+0000 7f554be00640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 0x7f5534071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5538007fd0 tx=0x7f5538009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:35.835+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f55400795a0 con 0x7f554c071a00 2024-04-12T13:56:36.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.092+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f554c113a40 con 0x7f554c071a00 2024-04-12T13:56:36.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.094+0000 7f5548c00640 1 -- 172.21.15.60:0/2958237244 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+5007 (secure 0 0 0) 0x7f554007cc60 con 0x7f554c071a00 2024-04-12T13:56:36.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:36.096 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:51:39.795722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi110.getdvx","rank":0,"incarnation":21,"state":"up:active","state_seq":202,"addr":"172.21.15.110:6825/382915624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":382915624},{"type":"v1","addr":"172.21.15.110:6825","nonce":382915624}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-04-12T13:56:36.096 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.096+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 msgr2=0x7f5534071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.096+0000 7f5552400640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 0x7f5534071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5538007fd0 tx=0x7f5538009e90 comp rx=0 tx=0).stop 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.096+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 msgr2=0x7f554c119080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.096+0000 7f5552400640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f55400047f0 tx=0x7f5540009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 shutdown_connections 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f553406eb70 0x7f5534071020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f554c072310 0x7f554c1195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 --2- 172.21.15.60:0/2958237244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c071a00 0x7f554c119080 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 >> 172.21.15.60:0/2958237244 conn(0x7f554c0f9fc0 msgr2=0x7f554c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 shutdown_connections 2024-04-12T13:56:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.097+0000 7f5552400640 1 -- 172.21.15.60:0/2958237244 wait complete. 2024-04-12T13:56:36.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-12T13:56:36.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.330+0000 7f683be00640 1 -- 172.21.15.60:0/2562097170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 msgr2=0x7f683c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.330+0000 7f683be00640 1 --2- 172.21.15.60:0/2562097170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c1023c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f682c0048d0 tx=0x7f682c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 -- 172.21.15.60:0/2562097170 shutdown_connections 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 --2- 172.21.15.60:0/2562097170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c0fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 --2- 172.21.15.60:0/2562097170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c1023c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 -- 172.21.15.60:0/2562097170 >> 172.21.15.60:0/2562097170 conn(0x7f683c0f7ba0 msgr2=0x7f683c0f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:36.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 -- 172.21.15.60:0/2562097170 shutdown_connections 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.331+0000 7f683be00640 1 -- 172.21.15.60:0/2562097170 wait complete. 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 Processor -- start 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 -- start start 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c06fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0716b0 con 0x7f683c101ff0 2024-04-12T13:56:36.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c070250 con 0x7f683c102990 2024-04-12T13:56:36.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.332+0000 7f683aa00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683aa00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52204/0 (socket says 172.21.15.60:52204) 2024-04-12T13:56:36.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683aa00640 1 -- 172.21.15.60:0/3249284980 learned_addr learned my addr 172.21.15.60:0/3249284980 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:36.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683a000640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c06fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683aa00640 1 -- 172.21.15.60:0/3249284980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 msgr2=0x7f683c06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683aa00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c06fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683aa00640 1 -- 172.21.15.60:0/3249284980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c005040 con 0x7f683c101ff0 2024-04-12T13:56:36.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.333+0000 7f683a000640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:56:36.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f683aa00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f682c0047f0 tx=0x7f682c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f682c0094c0 con 0x7f683c101ff0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f682c032e50 con 0x7f683c101ff0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c0704d0 con 0x7f683c101ff0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f682c0433b0 con 0x7f683c101ff0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.334+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c119180 con 0x7f683c101ff0 2024-04-12T13:56:36.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.335+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c0fd760 con 0x7f683c101ff0 2024-04-12T13:56:36.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.337+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f682c02f070 con 0x7f683c101ff0 2024-04-12T13:56:36.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.338+0000 7f6832a00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 0x7f6820071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.338+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f682c0b0a50 con 0x7f683c101ff0 2024-04-12T13:56:36.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.338+0000 7f683a000640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 0x7f6820071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.339+0000 7f683a000640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 0x7f6820071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fd0 tx=0x7f6828009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:36.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.343+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f682c079590 con 0x7f683c101ff0 2024-04-12T13:56:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:36 smithi060 ceph-mon[94333]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:36 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3811873122' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-12T13:56:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:36 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1309960863' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-12T13:56:36.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:36 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:56:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:36 smithi110 ceph-mon[82130]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:36 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3811873122' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-12T13:56:36.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:36 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1309960863' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-12T13:56:36.479 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:36 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:56:36.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.584+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f683c070d40 con 0x7f683c101ff0 2024-04-12T13:56:36.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.585+0000 7f6832a00640 1 -- 172.21.15.60:0/3249284980 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4207 (secure 0 0 0) 0x7f682c07cc50 con 0x7f683c101ff0 2024-04-12T13:56:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:36.587 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:00.171941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:36.588 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 26 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 msgr2=0x7f6820071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 0x7f6820071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fd0 tx=0x7f6828009e50 comp rx=0 tx=0).stop 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 msgr2=0x7f683c06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f682c0047f0 tx=0x7f682c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 shutdown_connections 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f682006eb70 0x7f6820071020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f683c102990 0x7f683c06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 --2- 172.21.15.60:0/3249284980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f683c101ff0 0x7f683c06f7d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 >> 172.21.15.60:0/3249284980 conn(0x7f683c0f7ba0 msgr2=0x7f683c0f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:36.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 shutdown_connections 2024-04-12T13:56:36.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.588+0000 7f683be00640 1 -- 172.21.15.60:0/3249284980 wait complete. 2024-04-12T13:56:36.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-12T13:56:36.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 -- 172.21.15.60:0/3870406971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0270102040 msgr2=0x7f0270102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 --2- 172.21.15.60:0/3870406971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0270102040 0x7f0270102410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f02640048d0 tx=0x7f0264009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 -- 172.21.15.60:0/3870406971 shutdown_connections 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 --2- 172.21.15.60:0/3870406971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02701029e0 0x7f0270064380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 --2- 172.21.15.60:0/3870406971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0270102040 0x7f0270102410 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 -- 172.21.15.60:0/3870406971 >> 172.21.15.60:0/3870406971 conn(0x7f0270071010 msgr2=0x7f0270071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 -- 172.21.15.60:0/3870406971 shutdown_connections 2024-04-12T13:56:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.808+0000 7f0276e00640 1 -- 172.21.15.60:0/3870406971 wait complete. 2024-04-12T13:56:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.809+0000 7f0276e00640 1 Processor -- start 2024-04-12T13:56:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0276e00640 1 -- start start 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0276e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 0x7f0270112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0276e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0276e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02701136d0 con 0x7f02701029e0 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0276e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027010cd20 con 0x7f0270102040 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.810+0000 7f0275000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52224/0 (socket says 172.21.15.60:52224) 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275000640 1 -- 172.21.15.60:0/2799277261 learned_addr learned my addr 172.21.15.60:0/2799277261 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275a00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 0x7f0270112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275000640 1 -- 172.21.15.60:0/2799277261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 msgr2=0x7f0270112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275000640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 0x7f0270112b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275000640 1 -- 172.21.15.60:0/2799277261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264005040 con 0x7f02701029e0 2024-04-12T13:56:36.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.811+0000 7f0275a00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 0x7f0270112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T13:56:36.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f0275000640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f025c002840 tx=0x7f025c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:36.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c007c30 con 0x7f02701029e0 2024-04-12T13:56:36.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027010d000 con 0x7f02701029e0 2024-04-12T13:56:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f025c00f040 con 0x7f02701029e0 2024-04-12T13:56:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c009590 con 0x7f02701029e0 2024-04-12T13:56:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.812+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027010d520 con 0x7f02701029e0 2024-04-12T13:56:36.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.814+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700fd7e0 con 0x7f02701029e0 2024-04-12T13:56:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.815+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f025c00d6b0 con 0x7f02701029e0 2024-04-12T13:56:36.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.816+0000 7f026d600640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 0x7f0258071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:36.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.816+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f025c08e360 con 0x7f02701029e0 2024-04-12T13:56:36.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.816+0000 7f0275a00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 0x7f0258071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.817+0000 7f0275a00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 0x7f0258071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02640048a0 tx=0x7f0264009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:36.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:36.821+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f025c056ea0 con 0x7f02701029e0 2024-04-12T13:56:37.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.090+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f027004bcc0 con 0x7f02701029e0 2024-04-12T13:56:37.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.091+0000 7f026d600640 1 -- 172.21.15.60:0/2799277261 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4218 (secure 0 0 0) 0x7f025c05a560 con 0x7f02701029e0 2024-04-12T13:56:37.093 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:37.094 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:00.181329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24293":{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":0,"incarnation":27,"state":"up:replay","state_seq":2,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:37.094 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2024-04-12T13:56:37.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 msgr2=0x7f0258071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 0x7f0258071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02640048a0 tx=0x7f0264009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 msgr2=0x7f02701130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f025c002840 tx=0x7f025c004570 comp rx=0 tx=0).stop 2024-04-12T13:56:37.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 shutdown_connections 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f025806eb70 0x7f0258071020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02701029e0 0x7f02701130d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 --2- 172.21.15.60:0/2799277261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0270102040 0x7f0270112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 >> 172.21.15.60:0/2799277261 conn(0x7f0270071010 msgr2=0x7f02700fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 shutdown_connections 2024-04-12T13:56:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.094+0000 7f0276e00640 1 -- 172.21.15.60:0/2799277261 wait complete. 2024-04-12T13:56:37.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-12T13:56:37.194 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:37 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2958237244' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-12T13:56:37.194 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:37 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3249284980' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.311+0000 7f5e83e00640 1 -- 172.21.15.60:0/854557314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e841029e0 msgr2=0x7f5e84064380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.311+0000 7f5e83e00640 1 --2- 172.21.15.60:0/854557314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e841029e0 0x7f5e84064380 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0048d0 tx=0x7f5e6c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.311+0000 7f5e83e00640 1 -- 172.21.15.60:0/854557314 shutdown_connections 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.311+0000 7f5e83e00640 1 --2- 172.21.15.60:0/854557314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e841029e0 0x7f5e84064380 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.311+0000 7f5e83e00640 1 --2- 172.21.15.60:0/854557314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e84102040 0x7f5e84102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.312+0000 7f5e83e00640 1 -- 172.21.15.60:0/854557314 >> 172.21.15.60:0/854557314 conn(0x7f5e84071010 msgr2=0x7f5e84071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.312+0000 7f5e83e00640 1 -- 172.21.15.60:0/854557314 shutdown_connections 2024-04-12T13:56:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.312+0000 7f5e83e00640 1 -- 172.21.15.60:0/854557314 wait complete. 2024-04-12T13:56:37.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.312+0000 7f5e83e00640 1 Processor -- start 2024-04-12T13:56:37.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e83e00640 1 -- start start 2024-04-12T13:56:37.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e83e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e83e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e841029e0 0x7f5e84115270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e83e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84115870 con 0x7f5e84102040 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e83e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841159e0 con 0x7f5e841029e0 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e82a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52248/0 (socket says 172.21.15.60:52248) 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e82a00640 1 -- 172.21.15.60:0/2721793015 learned_addr learned my addr 172.21.15.60:0/2721793015 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.313+0000 7f5e82000640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e841029e0 0x7f5e84115270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e82a00640 1 -- 172.21.15.60:0/2721793015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e841029e0 msgr2=0x7f5e84115270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e82a00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e841029e0 0x7f5e84115270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e82a00640 1 -- 172.21.15.60:0/2721793015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c005040 con 0x7f5e84102040 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e82a00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400eb70 tx=0x7f5e7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e74007c30 con 0x7f5e84102040 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7400f040 con 0x7f5e84102040 2024-04-12T13:56:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8410f010 con 0x7f5e84102040 2024-04-12T13:56:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e74009680 con 0x7f5e84102040 2024-04-12T13:56:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.314+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8410f500 con 0x7f5e84102040 2024-04-12T13:56:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.316+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840fd7e0 con 0x7f5e84102040 2024-04-12T13:56:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.317+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5e7400cd40 con 0x7f5e84102040 2024-04-12T13:56:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.318+0000 7f5e7aa00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 0x7f5e68071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.318+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f5e7408e7b0 con 0x7f5e84102040 2024-04-12T13:56:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.318+0000 7f5e82000640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 0x7f5e68071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.319+0000 7f5e82000640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 0x7f5e68071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0048a0 tx=0x7f5e6c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.323+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f5e740573a0 con 0x7f5e84102040 2024-04-12T13:56:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:37 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2958237244' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-12T13:56:37.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:37 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3249284980' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-12T13:56:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.573+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f5e8404bcc0 con 0x7f5e84102040 2024-04-12T13:56:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.574+0000 7f5e7aa00640 1 -- 172.21.15.60:0/2721793015 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4223 (secure 0 0 0) 0x7f5e7405aa60 con 0x7f5e84102040 2024-04-12T13:56:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:37.576 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:09.947522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24293":{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":206,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-04-12T13:56:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 msgr2=0x7f5e68071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 0x7f5e68071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0048a0 tx=0x7f5e6c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 msgr2=0x7f5e84114d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400eb70 tx=0x7f5e7400b040 comp rx=0 tx=0).stop 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 shutdown_connections 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f5e6806eb70 0x7f5e68071020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e841029e0 0x7f5e84115270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 --2- 172.21.15.60:0/2721793015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e84102040 0x7f5e84114d30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 >> 172.21.15.60:0/2721793015 conn(0x7f5e84071010 msgr2=0x7f5e840fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 shutdown_connections 2024-04-12T13:56:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.577+0000 7f5e83e00640 1 -- 172.21.15.60:0/2721793015 wait complete. 2024-04-12T13:56:37.599 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 -- 172.21.15.60:0/404735342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 msgr2=0x7f84dc0fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 --2- 172.21.15.60:0/404735342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc0fe260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f84c80048d0 tx=0x7f84c8009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 -- 172.21.15.60:0/404735342 shutdown_connections 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 --2- 172.21.15.60:0/404735342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc0fe260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 --2- 172.21.15.60:0/404735342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 0x7f84dc104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 -- 172.21.15.60:0/404735342 >> 172.21.15.60:0/404735342 conn(0x7f84dc0f9fc0 msgr2=0x7f84dc0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 -- 172.21.15.60:0/404735342 shutdown_connections 2024-04-12T13:56:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.812+0000 7f84e1a00640 1 -- 172.21.15.60:0/404735342 wait complete. 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.813+0000 7f84e1a00640 1 Processor -- start 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.813+0000 7f84e1a00640 1 -- start start 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84e1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 0x7f84dc114c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84e1a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84e1a00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1157b0 con 0x7f84dc104bd0 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84e1a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc115920 con 0x7f84dc104230 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52262/0 (socket says 172.21.15.60:52262) 2024-04-12T13:56:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 -- 172.21.15.60:0/3736668028 learned_addr learned my addr 172.21.15.60:0/3736668028 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84dbe00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 0x7f84dc114c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 -- 172.21.15.60:0/3736668028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 msgr2=0x7f84dc114c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 0x7f84dc114c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.814+0000 7f84db400640 1 -- 172.21.15.60:0/3736668028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8005040 con 0x7f84dc104bd0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84db400640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f84c80047f0 tx=0x7f84c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c80094c0 con 0x7f84dc104bd0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84c8032e50 con 0x7f84dc104bd0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc10ef50 con 0x7f84dc104bd0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c80433b0 con 0x7f84dc104bd0 2024-04-12T13:56:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.815+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc10f410 con 0x7f84dc104bd0 2024-04-12T13:56:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.817+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc0ff9a0 con 0x7f84dc104bd0 2024-04-12T13:56:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.818+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f84c802f070 con 0x7f84dc104bd0 2024-04-12T13:56:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.818+0000 7f84d3e00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 0x7f84c0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.819+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f84c80b0a60 con 0x7f84dc104bd0 2024-04-12T13:56:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.819+0000 7f84dbe00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 0x7f84c0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.820+0000 7f84dbe00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 0x7f84c0071020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009fd0 tx=0x7f84cc009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:37.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:37.824+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f84c80795a0 con 0x7f84dc104bd0 2024-04-12T13:56:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.073+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f84dc10f630 con 0x7f84dc104bd0 2024-04-12T13:56:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.075+0000 7f84d3e00640 1 -- 172.21.15.60:0/3736668028 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4220 (secure 0 0 0) 0x7f84c807cc60 con 0x7f84dc104bd0 2024-04-12T13:56:38.077 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:38.077 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:10.188852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24293":{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":207,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:38.078 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 msgr2=0x7f84c0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 0x7f84c0071020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009fd0 tx=0x7f84cc009e50 comp rx=0 tx=0).stop 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 msgr2=0x7f84dc1151b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f84c80047f0 tx=0x7f84c8009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 shutdown_connections 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f84c006eb70 0x7f84c0071020 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84dc104bd0 0x7f84dc1151b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 --2- 172.21.15.60:0/3736668028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84dc104230 0x7f84dc114c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 >> 172.21.15.60:0/3736668028 conn(0x7f84dc0f9fc0 msgr2=0x7f84dc0fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 shutdown_connections 2024-04-12T13:56:38.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.078+0000 7f84e1a00640 1 -- 172.21.15.60:0/3736668028 wait complete. 2024-04-12T13:56:38.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 -- 172.21.15.60:0/3100284791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 msgr2=0x7f54c80fc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 --2- 172.21.15.60:0/3100284791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c80fc010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54b00048d0 tx=0x7f54b0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 -- 172.21.15.60:0/3100284791 shutdown_connections 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 --2- 172.21.15.60:0/3100284791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c80fc010 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 --2- 172.21.15.60:0/3100284791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 0x7f54c81023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.312+0000 7f54c7200640 1 -- 172.21.15.60:0/3100284791 >> 172.21.15.60:0/3100284791 conn(0x7f54c80f7b90 msgr2=0x7f54c80f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.313+0000 7f54c7200640 1 -- 172.21.15.60:0/3100284791 shutdown_connections 2024-04-12T13:56:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.313+0000 7f54c7200640 1 -- 172.21.15.60:0/3100284791 wait complete. 2024-04-12T13:56:38.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 Processor -- start 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 -- start start 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 0x7f54c8114cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8115810 con 0x7f54c8102980 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c810ee60 con 0x7f54c8101fe0 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.314+0000 7f54c5400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52280/0 (socket says 172.21.15.60:52280) 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 -- 172.21.15.60:0/141382639 learned_addr learned my addr 172.21.15.60:0/141382639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5e00640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 0x7f54c8114cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 -- 172.21.15.60:0/141382639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 msgr2=0x7f54c8114cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 0x7f54c8114cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 -- 172.21.15.60:0/141382639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0005040 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.315+0000 7f54c5400640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54b00047f0 tx=0x7f54b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.316+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b00094c0 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.316+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54b0032e50 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.316+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b00433b0 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.316+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c810f0e0 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.316+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c810f550 con 0x7f54c8102980 2024-04-12T13:56:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.317+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80fd750 con 0x7f54c8102980 2024-04-12T13:56:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.318+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f54b002f070 con 0x7f54c8102980 2024-04-12T13:56:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.319+0000 7f54be000640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 0x7f54ac071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.319+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f54b00b0a30 con 0x7f54c8102980 2024-04-12T13:56:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.319+0000 7f54c5e00640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 0x7f54ac071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.320+0000 7f54c5e00640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 0x7f54ac071020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54b8007fd0 tx=0x7f54b8009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:38.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.324+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f54b0079570 con 0x7f54c8102980 2024-04-12T13:56:38.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2799277261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-12T13:56:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:56:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:56:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:56:38.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:38 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2721793015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2799277261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:56:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:38 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2721793015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-12T13:56:38.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.574+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f54c8109140 con 0x7f54c8102980 2024-04-12T13:56:38.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.575+0000 7f54be000640 1 -- 172.21.15.60:0/141382639 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+5076 (secure 0 0 0) 0x7f54b007cc30 con 0x7f54c8102980 2024-04-12T13:56:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:38.578 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:12.197885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24293":{"gid":24293,"name":"cephfs.smithi110.zqdflr","rank":0,"incarnation":27,"state":"up:active","state_seq":208,"addr":"172.21.15.110:6827/2604118377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2604118377},{"type":"v1","addr":"172.21.15.110:6827","nonce":2604118377}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24293,"qdb_cluster":[24293]},"id":1}]} 2024-04-12T13:56:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-04-12T13:56:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 msgr2=0x7f54ac071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 0x7f54ac071020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54b8007fd0 tx=0x7f54b8009e90 comp rx=0 tx=0).stop 2024-04-12T13:56:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 msgr2=0x7f54c8115210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54b00047f0 tx=0x7f54b0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 shutdown_connections 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f54ac06eb70 0x7f54ac071020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c8102980 0x7f54c8115210 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 --2- 172.21.15.60:0/141382639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c8101fe0 0x7f54c8114cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 >> 172.21.15.60:0/141382639 conn(0x7f54c80f7b90 msgr2=0x7f54c8070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 shutdown_connections 2024-04-12T13:56:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.578+0000 7f54c7200640 1 -- 172.21.15.60:0/141382639 wait complete. 2024-04-12T13:56:38.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-12T13:56:38.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 -- 172.21.15.60:0/4201190811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 msgr2=0x7f0c600fa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 --2- 172.21.15.60:0/4201190811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fa880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c480048d0 tx=0x7f0c48009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 -- 172.21.15.60:0/4201190811 shutdown_connections 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 --2- 172.21.15.60:0/4201190811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 0x7f0c60100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 --2- 172.21.15.60:0/4201190811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fa880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 -- 172.21.15.60:0/4201190811 >> 172.21.15.60:0/4201190811 conn(0x7f0c600f5f70 msgr2=0x7f0c600f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 -- 172.21.15.60:0/4201190811 shutdown_connections 2024-04-12T13:56:38.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.812+0000 7f0c67800640 1 -- 172.21.15.60:0/4201190811 wait complete. 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.813+0000 7f0c67800640 1 Processor -- start 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.813+0000 7f0c67800640 1 -- start start 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c67800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c67800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 0x7f0c600fc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c67800640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600fdc60 con 0x7f0c600fa4b0 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c67800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600fc770 con 0x7f0c600fae50 2024-04-12T13:56:38.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52298/0 (socket says 172.21.15.60:52298) 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 -- 172.21.15.60:0/2847663517 learned_addr learned my addr 172.21.15.60:0/2847663517 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c57e00640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 0x7f0c600fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 -- 172.21.15.60:0/2847663517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 msgr2=0x7f0c600fc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 0x7f0c600fc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.814+0000 7f0c64e00640 1 -- 172.21.15.60:0/2847663517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48005040 con 0x7f0c600fa4b0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c64e00640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fa0 tx=0x7f0c48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c480094c0 con 0x7f0c600fa4b0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c600fc990 con 0x7f0c600fa4b0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c4803d920 con 0x7f0c600fa4b0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c601194e0 con 0x7f0c600fa4b0 2024-04-12T13:56:38.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.815+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4803b8d0 con 0x7f0c600fa4b0 2024-04-12T13:56:38.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.816+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c600fb700 con 0x7f0c600fa4b0 2024-04-12T13:56:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.817+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0c4803da90 con 0x7f0c600fa4b0 2024-04-12T13:56:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.819+0000 7f0c5d600640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 0x7f0c40071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.819+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f0c4802d040 con 0x7f0c600fa4b0 2024-04-12T13:56:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.819+0000 7f0c57e00640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 0x7f0c40071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:38.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.820+0000 7f0c57e00640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 0x7f0c40071020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c600fd420 tx=0x7f0c50008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:38.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:38.824+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f0c4807a580 con 0x7f0c600fa4b0 2024-04-12T13:56:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.075+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f0c60064380 con 0x7f0c600fa4b0 2024-04-12T13:56:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.076+0000 7f0c5d600640 1 -- 172.21.15.60:0/2847663517 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4272 (secure 0 0 0) 0x7f0c4807dc40 con 0x7f0c600fa4b0 2024-04-12T13:56:39.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:39.079 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:29.504993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 msgr2=0x7f0c40071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 0x7f0c40071020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0c600fd420 tx=0x7f0c50008040 comp rx=0 tx=0).stop 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 msgr2=0x7f0c600fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fa0 tx=0x7f0c48009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 shutdown_connections 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0c4006eb70 0x7f0c40071020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600fae50 0x7f0c600fc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 --2- 172.21.15.60:0/2847663517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c600fa4b0 0x7f0c600fbcf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.079+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 >> 172.21.15.60:0/2847663517 conn(0x7f0c600f5f70 msgr2=0x7f0c600f7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.080+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 shutdown_connections 2024-04-12T13:56:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.080+0000 7f0c67800640 1 -- 172.21.15.60:0/2847663517 wait complete. 2024-04-12T13:56:39.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-12T13:56:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 -- 172.21.15.60:0/3268544698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 msgr2=0x7f678c104600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 --2- 172.21.15.60:0/3268544698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c104600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f67740048d0 tx=0x7f6774009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 -- 172.21.15.60:0/3268544698 shutdown_connections 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 --2- 172.21.15.60:0/3268544698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c0fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 --2- 172.21.15.60:0/3268544698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c104600 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 -- 172.21.15.60:0/3268544698 >> 172.21.15.60:0/3268544698 conn(0x7f678c0f9fc0 msgr2=0x7f678c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 -- 172.21.15.60:0/3268544698 shutdown_connections 2024-04-12T13:56:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.319+0000 7f6792000640 1 -- 172.21.15.60:0/3268544698 wait complete. 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 Processor -- start 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 -- start start 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c115230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c115830 con 0x7f678c104230 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.320+0000 7f6792000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c10ee80 con 0x7f678c104bd0 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57684/0 (socket says 172.21.15.60:57684) 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 -- 172.21.15.60:0/2282094521 learned_addr learned my addr 172.21.15.60:0/2282094521 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f678be00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c115230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 -- 172.21.15.60:0/2282094521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 msgr2=0x7f678c115230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c115230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f6790c00640 1 -- 172.21.15.60:0/2282094521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774005040 con 0x7f678c104230 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.321+0000 7f678be00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c115230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6790c00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6774004930 tx=0x7f6774009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67740094c0 con 0x7f678c104230 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6774032e50 con 0x7f678c104230 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67740433b0 con 0x7f678c104230 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c10f100 con 0x7f678c104230 2024-04-12T13:56:39.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.322+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c10f5c0 con 0x7f678c104230 2024-04-12T13:56:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.323+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c0ff9a0 con 0x7f678c104230 2024-04-12T13:56:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.324+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f677402f070 con 0x7f678c104230 2024-04-12T13:56:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.325+0000 7f6788c00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 0x7f6770071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.325+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f67740b09d0 con 0x7f678c104230 2024-04-12T13:56:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.326+0000 7f678be00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 0x7f6770071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.327+0000 7f678be00640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 0x7f6770071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f678c1105b0 tx=0x7f677c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:39.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.330+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6774079510 con 0x7f678c104230 2024-04-12T13:56:39.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:39 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3736668028' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-12T13:56:39.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:39 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/141382639' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-12T13:56:39.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:39 smithi060 ceph-mon[94333]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:39 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3736668028' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-12T13:56:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:39 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/141382639' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-12T13:56:39.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:39 smithi110 ceph-mon[82130]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.578+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f678c110390 con 0x7f678c104230 2024-04-12T13:56:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.580+0000 7f6788c00640 1 -- 172.21.15.60:0/2282094521 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+4351 (secure 0 0 0) 0x7f677407cbd0 con 0x7f678c104230 2024-04-12T13:56:39.582 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:39.583 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:29.517413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 32 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 msgr2=0x7f6770071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 0x7f6770071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f678c1105b0 tx=0x7f677c00b040 comp rx=0 tx=0).stop 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 msgr2=0x7f678c114cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6774004930 tx=0x7f6774009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 shutdown_connections 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f677006eb70 0x7f6770071020 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f678c104bd0 0x7f678c115230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 --2- 172.21.15.60:0/2282094521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f678c104230 0x7f678c114cf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 >> 172.21.15.60:0/2282094521 conn(0x7f678c0f9fc0 msgr2=0x7f678c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:39.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 shutdown_connections 2024-04-12T13:56:39.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.583+0000 7f6792000640 1 -- 172.21.15.60:0/2282094521 wait complete. 2024-04-12T13:56:39.604 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 -- 172.21.15.60:0/2954993848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 msgr2=0x7fcac0107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 --2- 172.21.15.60:0/2954993848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac0107970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcab00048d0 tx=0x7fcab0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 -- 172.21.15.60:0/2954993848 shutdown_connections 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 --2- 172.21.15.60:0/2954993848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 0x7fcac0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 --2- 172.21.15.60:0/2954993848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac0107970 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 -- 172.21.15.60:0/2954993848 >> 172.21.15.60:0/2954993848 conn(0x7fcac0071e60 msgr2=0x7fcac0074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 -- 172.21.15.60:0/2954993848 shutdown_connections 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.820+0000 7fcabfe00640 1 -- 172.21.15.60:0/2954993848 wait complete. 2024-04-12T13:56:39.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.821+0000 7fcabfe00640 1 Processor -- start 2024-04-12T13:56:39.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.821+0000 7fcabfe00640 1 -- start start 2024-04-12T13:56:39.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 0x7fcac0119170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabfe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabfe00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0119cb0 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0113300 con 0x7fcac0102670 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57698/0 (socket says 172.21.15.60:57698) 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 -- 172.21.15.60:0/1658527535 learned_addr learned my addr 172.21.15.60:0/1658527535 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabea00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 0x7fcac0119170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 -- 172.21.15.60:0/1658527535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 msgr2=0x7fcac0119170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 0x7fcac0119170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.822+0000 7fcabe000640 1 -- 172.21.15.60:0/1658527535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0005040 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcabe000640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcaac002a50 tx=0x7fcaac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac007c30 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac00f040 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac01135e0 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac00dad0 con 0x7fcac01075a0 2024-04-12T13:56:39.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.823+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0113b00 con 0x7fcac01075a0 2024-04-12T13:56:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.824+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0103d60 con 0x7fcac01075a0 2024-04-12T13:56:39.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.825+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcaac00dc70 con 0x7fcac01075a0 2024-04-12T13:56:39.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.826+0000 7fcab6a00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 0x7fcaa4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.827+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fcaac08e2b0 con 0x7fcac01075a0 2024-04-12T13:56:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.827+0000 7fcabea00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 0x7fcaa4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:39.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.828+0000 7fcabea00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 0x7fcaa4071020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab002be70 tx=0x7fcab0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:39.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:39.832+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fcaac056e70 con 0x7fcac01075a0 2024-04-12T13:56:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.079+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fcac010f7e0 con 0x7fcac01075a0 2024-04-12T13:56:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.081+0000 7fcab6a00640 1 -- 172.21.15.60:0/1658527535 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+4355 (secure 0 0 0) 0x7fcaac05a530 con 0x7fcac01075a0 2024-04-12T13:56:40.083 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:40.083 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:38.114082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":24,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 33 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.083+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 msgr2=0x7fcaa4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.083+0000 7fcabfe00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 0x7fcaa4071020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcab002be70 tx=0x7fcab0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.083+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 msgr2=0x7fcac01196b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.083+0000 7fcabfe00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcaac002a50 tx=0x7fcaac004600 comp rx=0 tx=0).stop 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 shutdown_connections 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fcaa406eb70 0x7fcaa4071020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac01075a0 0x7fcac01196b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 --2- 172.21.15.60:0/1658527535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcac0102670 0x7fcac0119170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 >> 172.21.15.60:0/1658527535 conn(0x7fcac0071e60 msgr2=0x7fcac0104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 shutdown_connections 2024-04-12T13:56:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.084+0000 7fcabfe00640 1 -- 172.21.15.60:0/1658527535 wait complete. 2024-04-12T13:56:40.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-12T13:56:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 -- 172.21.15.60:0/284725847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 msgr2=0x7f63b81023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 --2- 172.21.15.60:0/284725847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b81023c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0048d0 tx=0x7f63ac009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 -- 172.21.15.60:0/284725847 shutdown_connections 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 --2- 172.21.15.60:0/284725847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 0x7f63b80fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 --2- 172.21.15.60:0/284725847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b81023c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 -- 172.21.15.60:0/284725847 >> 172.21.15.60:0/284725847 conn(0x7f63b80f7ba0 msgr2=0x7f63b80f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 -- 172.21.15.60:0/284725847 shutdown_connections 2024-04-12T13:56:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.322+0000 7f63bea00640 1 -- 172.21.15.60:0/284725847 wait complete. 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.323+0000 7f63bea00640 1 Processor -- start 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.323+0000 7f63bea00640 1 -- start start 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bea00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 0x7f63b81152a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bea00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8115930 con 0x7f63b8101ff0 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b810eef0 con 0x7f63b8102990 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bd600640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bd600640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57716/0 (socket says 172.21.15.60:57716) 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.324+0000 7f63bd600640 1 -- 172.21.15.60:0/3995383657 learned_addr learned my addr 172.21.15.60:0/3995383657 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bcc00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 0x7f63b81152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bd600640 1 -- 172.21.15.60:0/3995383657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 msgr2=0x7f63b81152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bd600640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 0x7f63b81152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bd600640 1 -- 172.21.15.60:0/3995383657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac005040 con 0x7f63b8101ff0 2024-04-12T13:56:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bd600640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0047f0 tx=0x7f63ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63ac0094c0 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63ac032e50 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b810f170 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.325+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63ac0435f0 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.326+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b810f630 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.327+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b80fd760 con 0x7f63b8101ff0 2024-04-12T13:56:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.328+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f63ac02f070 con 0x7f63b8101ff0 2024-04-12T13:56:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.329+0000 7f63b5600640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 0x7f63a0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.329+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f63ac0b08b0 con 0x7f63b8101ff0 2024-04-12T13:56:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.329+0000 7f63bcc00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 0x7f63a0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.330+0000 7f63bcc00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 0x7f63a0071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63b8110620 tx=0x7f63a4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:40.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.334+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f63ac0793f0 con 0x7f63b8101ff0 2024-04-12T13:56:40.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:40 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2847663517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-12T13:56:40.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:40 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2282094521' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-12T13:56:40.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:40 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2847663517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-12T13:56:40.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:40 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2282094521' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-12T13:56:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.584+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f63b804bcc0 con 0x7f63b8101ff0 2024-04-12T13:56:40.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.586+0000 7f63b5600640 1 -- 172.21.15.60:0/3995383657 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5196 (secure 0 0 0) 0x7f63ac07cab0 con 0x7f63b8101ff0 2024-04-12T13:56:40.588 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:40.588 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi060.epmcph","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3859091803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3859091803},{"type":"v1","addr":"172.21.15.60:6829","nonce":3859091803}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi110.getdvx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6825/367285564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":367285564},{"type":"v1","addr":"172.21.15.110:6825","nonce":367285564}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44335,"name":"cephfs.smithi110.zqdflr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/11148834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":11148834},{"type":"v1","addr":"172.21.15.110:6827","nonce":11148834}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T13:38:14.569115+0000","modified":"2024-04-12T13:52:38.901734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34456":{"gid":34456,"name":"cephfs.smithi060.mwwohl","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":25,"addr":"172.21.15.60:6827/3121261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3121261391},{"type":"v1","addr":"172.21.15.60:6827","nonce":3121261391}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T13:56:40.588 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 34 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 msgr2=0x7f63a0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 0x7f63a0071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63b8110620 tx=0x7f63a4008040 comp rx=0 tx=0).stop 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 msgr2=0x7f63b8114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0047f0 tx=0x7f63ac009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 shutdown_connections 2024-04-12T13:56:40.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f63a006eb70 0x7f63a0071020 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b8102990 0x7f63b81152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 --2- 172.21.15.60:0/3995383657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8101ff0 0x7f63b8114d60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 >> 172.21.15.60:0/3995383657 conn(0x7f63b80f7ba0 msgr2=0x7f63b8070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:40.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 shutdown_connections 2024-04-12T13:56:40.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.589+0000 7f63bea00640 1 -- 172.21.15.60:0/3995383657 wait complete. 2024-04-12T13:56:40.611 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-12T13:56:40.623 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-12T13:56:40.623 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:56:40.623 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T13:56:40.681 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:56:40.682 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T13:56:40.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 -- 172.21.15.60:0/3006987802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104bf0 msgr2=0x7f64640fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 --2- 172.21.15.60:0/3006987802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104bf0 0x7f64640fe280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f64500048d0 tx=0x7f6450009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 -- 172.21.15.60:0/3006987802 shutdown_connections 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 --2- 172.21.15.60:0/3006987802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104bf0 0x7f64640fe280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 --2- 172.21.15.60:0/3006987802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104250 0x7f6464104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 -- 172.21.15.60:0/3006987802 >> 172.21.15.60:0/3006987802 conn(0x7f64640f9fc0 msgr2=0x7f64640fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.954+0000 7f646ac00640 1 -- 172.21.15.60:0/3006987802 shutdown_connections 2024-04-12T13:56:40.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.955+0000 7f646ac00640 1 -- 172.21.15.60:0/3006987802 wait complete. 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.955+0000 7f646ac00640 1 Processor -- start 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.955+0000 7f646ac00640 1 -- start start 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f646ac00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f646ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104bf0 0x7f64641152b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f646ac00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64641158b0 con 0x7f6464104250 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f646ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646410ef00 con 0x7f6464104bf0 2024-04-12T13:56:40.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f6469800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f6469800640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57732/0 (socket says 172.21.15.60:57732) 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f6469800640 1 -- 172.21.15.60:0/2907730103 learned_addr learned my addr 172.21.15.60:0/2907730103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f6469800640 1 -- 172.21.15.60:0/2907730103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104bf0 msgr2=0x7f64641152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.956+0000 7f6468e00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104bf0 0x7f64641152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6469800640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104bf0 0x7f64641152b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6469800640 1 -- 172.21.15.60:0/2907730103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450005040 con 0x7f6464104250 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6469800640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6458002a50 tx=0x7f6458004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6458007c30 con 0x7f6464104250 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646410f1e0 con 0x7f6464104250 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f645800f040 con 0x7f6464104250 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645800db50 con 0x7f6464104250 2024-04-12T13:56:40.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.957+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646410f700 con 0x7f6464104250 2024-04-12T13:56:40.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.958+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64640ff9c0 con 0x7f6464104250 2024-04-12T13:56:40.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.960+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f645801c400 con 0x7f6464104250 2024-04-12T13:56:40.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.960+0000 7f6461600640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 0x7f644c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:40.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.961+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f645808e400 con 0x7f6464104250 2024-04-12T13:56:40.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.961+0000 7f6468e00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 0x7f644c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:40.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.962+0000 7f6468e00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 0x7f644c071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6450000c00 tx=0x7f6450009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:40.966+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f6458056f40 con 0x7f6464104250 2024-04-12T13:56:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.174+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f646410f920 con 0x7f6464104250 2024-04-12T13:56:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.177+0000 7f6461600640 1 -- 172.21.15.60:0/2907730103 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+17367 (secure 0 0 0) 0x7f645805a600 con 0x7f6464104250 2024-04-12T13:56:41.180 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:41.180 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":101,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:52:29.504455+0000","last_up_change":"2024-04-12T13:50:40.271283+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T13:38:13.485475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T13:38:14.117573+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6803","nonce":1148773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6805","nonce":1148773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6809","nonce":1148773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6807","nonce":1148773022}]},"public_addr":"172.21.15.60:6803/1148773022","cluster_addr":"172.21.15.60:6805/1148773022","heartbeat_back_addr":"172.21.15.60:6809/1148773022","heartbeat_front_addr":"172.21.15.60:6807/1148773022","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":95,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6811","nonce":1855254170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6813","nonce":1855254170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6817","nonce":1855254170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6815","nonce":1855254170}]},"public_addr":"172.21.15.60:6811/1855254170","cluster_addr":"172.21.15.60:6813/1855254170","heartbeat_back_addr":"172.21.15.60:6817/1855254170","heartbeat_front_addr":"172.21.15.60:6815/1855254170","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":73,"up_thru":95,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6819","nonce":2464051082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6821","nonce":2464051082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6825","nonce":2464051082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6823","nonce":2464051082}]},"public_addr":"172.21.15.60:6819/2464051082","cluster_addr":"172.21.15.60:6821/2464051082","heartbeat_back_addr":"172.21.15.60:6825/2464051082","heartbeat_front_addr":"172.21.15.60:6823/2464051082","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6801","nonce":842224302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6803","nonce":842224302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6807","nonce":842224302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6805","nonce":842224302}]},"public_addr":"172.21.15.110:6801/842224302","cluster_addr":"172.21.15.110:6803/842224302","heartbeat_back_addr":"172.21.15.110:6807/842224302","heartbeat_front_addr":"172.21.15.110:6805/842224302","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6809","nonce":223716750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6811","nonce":223716750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6815","nonce":223716750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6813","nonce":223716750}]},"public_addr":"172.21.15.110:6809/223716750","cluster_addr":"172.21.15.110:6811/223716750","heartbeat_back_addr":"172.21.15.110:6815/223716750","heartbeat_front_addr":"172.21.15.110:6813/223716750","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6817","nonce":3606855652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6819","nonce":3606855652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6823","nonce":3606855652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6821","nonce":3606855652}]},"public_addr":"172.21.15.110:6817/3606855652","cluster_addr":"172.21.15.110:6819/3606855652","heartbeat_back_addr":"172.21.15.110:6823/3606855652","heartbeat_front_addr":"172.21.15.110:6821/3606855652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":0,"to":5}]},{"pgid":"2.1a","mappings":[{"from":3,"to":2}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"2.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":5}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6825/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.60:6828/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:6827/3800124536":"2024-04-13T13:50:51.723732+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/1128934038":"2024-04-13T13:45:13.090200+0000","172.21.15.110:6829/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.110:0/890951757":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/657445096":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/578861147":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6826/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.60:6801/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/2674766807":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6800/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.110:0/817733215":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6829/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.110:6824/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.110:0/3047753227":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2672639608":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1310101403":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/2874214879":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6827/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.110:0/2534067942":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.110:6828/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1631919154":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1303426533":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1963942392":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6826/3800124536":"2024-04-13T13:50:51.723732+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:56:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 msgr2=0x7f644c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 0x7f644c071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6450000c00 tx=0x7f6450009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 msgr2=0x7f6464114d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6458002a50 tx=0x7f6458004600 comp rx=0 tx=0).stop 2024-04-12T13:56:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 shutdown_connections 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f644c06eb70 0x7f644c071020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6464104bf0 0x7f64641152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 --2- 172.21.15.60:0/2907730103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6464104250 0x7f6464114d70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 >> 172.21.15.60:0/2907730103 conn(0x7f64640f9fc0 msgr2=0x7f64640fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 shutdown_connections 2024-04-12T13:56:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.181+0000 7f646ac00640 1 -- 172.21.15.60:0/2907730103 wait complete. 2024-04-12T13:56:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T13:34:54.600821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T13:38:13.485475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T13:38:14.117573+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T13:56:41.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 -- 172.21.15.60:0/3377827525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4650072310 msgr2=0x7f465010c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 --2- 172.21.15.60:0/3377827525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4650072310 0x7f465010c9e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f463c0048d0 tx=0x7f463c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 -- 172.21.15.60:0/3377827525 shutdown_connections 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 --2- 172.21.15.60:0/3377827525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4650072310 0x7f465010c9e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 --2- 172.21.15.60:0/3377827525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 0x7f4650071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 -- 172.21.15.60:0/3377827525 >> 172.21.15.60:0/3377827525 conn(0x7f46500f9fc0 msgr2=0x7f46500fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:41.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 -- 172.21.15.60:0/3377827525 shutdown_connections 2024-04-12T13:56:41.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.422+0000 7f4654a00640 1 -- 172.21.15.60:0/3377827525 wait complete. 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 Processor -- start 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 -- start start 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 0x7f4650119290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4650119d50 con 0x7f46501197d0 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.423+0000 7f4654a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4650119e90 con 0x7f4650071a00 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57752/0 (socket says 172.21.15.60:57752) 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 -- 172.21.15.60:0/75630323 learned_addr learned my addr 172.21.15.60:0/75630323 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:41.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464f400640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 0x7f4650119290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 -- 172.21.15.60:0/75630323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 msgr2=0x7f4650119290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 0x7f4650119290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 -- 172.21.15.60:0/75630323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c005040 con 0x7f46501197d0 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.424+0000 7f464ea00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f463c02be70 tx=0x7f463c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.425+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463c0094c0 con 0x7f46501197d0 2024-04-12T13:56:41.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.425+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f463c004290 con 0x7f46501197d0 2024-04-12T13:56:41.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.425+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46501139c0 con 0x7f46501197d0 2024-04-12T13:56:41.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.425+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463c03b400 con 0x7f46501197d0 2024-04-12T13:56:41.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.425+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4650113ee0 con 0x7f46501197d0 2024-04-12T13:56:41.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.426+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4650073140 con 0x7f46501197d0 2024-04-12T13:56:41.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:41 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1658527535' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-12T13:56:41.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:41 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3995383657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-12T13:56:41.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:41 smithi060 ceph-mon[94333]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.427+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f463c02f070 con 0x7f46501197d0 2024-04-12T13:56:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.428+0000 7f4647400640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 0x7f4634071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.428+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f463c0b0df0 con 0x7f46501197d0 2024-04-12T13:56:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.428+0000 7f464f400640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 0x7f4634071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.429+0000 7f464f400640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 0x7f4634071030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4640007fd0 tx=0x7f4640009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.433+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f463c079930 con 0x7f46501197d0 2024-04-12T13:56:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:41 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1658527535' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-12T13:56:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:41 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3995383657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-12T13:56:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:41 smithi110 ceph-mon[82130]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.637+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46501149d0 con 0x7f46501197d0 2024-04-12T13:56:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.638+0000 7f4647400640 1 -- 172.21.15.60:0/75630323 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f463c07cff0 con 0x7f46501197d0 2024-04-12T13:56:41.641 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 msgr2=0x7f4634071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 0x7f4634071030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4640007fd0 tx=0x7f4640009e90 comp rx=0 tx=0).stop 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 msgr2=0x7f4650113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f463c02be70 tx=0x7f463c009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 shutdown_connections 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f463406eb80 0x7f4634071030 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46501197d0 0x7f4650113420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 --2- 172.21.15.60:0/75630323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4650071a00 0x7f4650119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 >> 172.21.15.60:0/75630323 conn(0x7f46500f9fc0 msgr2=0x7f46500fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 shutdown_connections 2024-04-12T13:56:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.642+0000 7f4654a00640 1 -- 172.21.15.60:0/75630323 wait complete. 2024-04-12T13:56:41.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T13:56:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 -- 172.21.15.60:0/3914386913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 msgr2=0x7ff5dc071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/3914386913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc071dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009c50 tx=0x7ff5cc004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 -- 172.21.15.60:0/3914386913 shutdown_connections 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/3914386913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 0x7ff5dc10cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/3914386913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc071dd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.888+0000 7ff5e1c00640 1 -- 172.21.15.60:0/3914386913 >> 172.21.15.60:0/3914386913 conn(0x7ff5dc0f9fc0 msgr2=0x7ff5dc0fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.889+0000 7ff5e1c00640 1 -- 172.21.15.60:0/3914386913 shutdown_connections 2024-04-12T13:56:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.889+0000 7ff5e1c00640 1 -- 172.21.15.60:0/3914386913 wait complete. 2024-04-12T13:56:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.889+0000 7ff5e1c00640 1 Processor -- start 2024-04-12T13:56:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.890+0000 7ff5e1c00640 1 -- start start 2024-04-12T13:56:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.890+0000 7ff5e1c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.890+0000 7ff5e1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 0x7ff5dc119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.890+0000 7ff5e1c00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc119e30 con 0x7ff5dc071a00 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.890+0000 7ff5e1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc113480 con 0x7ff5dc072310 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57762/0 (socket says 172.21.15.60:57762) 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 -- 172.21.15.60:0/1081690411 learned_addr learned my addr 172.21.15.60:0/1081690411 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5d2000640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 0x7ff5dc119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 -- 172.21.15.60:0/1081690411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 msgr2=0x7ff5dc119830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 0x7ff5dc119830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 -- 172.21.15.60:0/1081690411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0098b0 con 0x7ff5dc071a00 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5daa00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02c1e0 tx=0x7ff5cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5cc03a070 con 0x7ff5dc071a00 2024-04-12T13:56:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5cc009740 con 0x7ff5dc071a00 2024-04-12T13:56:41.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5cc03eb40 con 0x7ff5dc071a00 2024-04-12T13:56:41.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc113700 con 0x7ff5dc071a00 2024-04-12T13:56:41.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.892+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc113ca0 con 0x7ff5dc071a00 2024-04-12T13:56:41.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.893+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc073140 con 0x7ff5dc071a00 2024-04-12T13:56:41.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.894+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff5cc032070 con 0x7ff5dc071a00 2024-04-12T13:56:41.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.895+0000 7ff5d3400640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 0x7ff5c0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:41.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.896+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7ff5cc0b0f10 con 0x7ff5dc071a00 2024-04-12T13:56:41.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.896+0000 7ff5d2000640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 0x7ff5c0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:41.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.897+0000 7ff5d2000640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 0x7ff5c0071030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc114bb0 tx=0x7ff5c4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:41.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:41.900+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ff5cc079b80 con 0x7ff5dc071a00 2024-04-12T13:56:42.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.112+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff5dc114960 con 0x7ff5dc071a00 2024-04-12T13:56:42.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.113+0000 7ff5d3400640 1 -- 172.21.15.60:0/1081690411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff5cc07d240 con 0x7ff5dc071a00 2024-04-12T13:56:42.115 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:42.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 msgr2=0x7ff5c0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 0x7ff5c0071030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc114bb0 tx=0x7ff5c4009040 comp rx=0 tx=0).stop 2024-04-12T13:56:42.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 msgr2=0x7ff5dc1192f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc02c1e0 tx=0x7ff5cc004d10 comp rx=0 tx=0).stop 2024-04-12T13:56:42.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 shutdown_connections 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ff5c006eb80 0x7ff5c0071030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5dc072310 0x7ff5dc119830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 --2- 172.21.15.60:0/1081690411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5dc071a00 0x7ff5dc1192f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 >> 172.21.15.60:0/1081690411 conn(0x7ff5dc0f9fc0 msgr2=0x7ff5dc106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 shutdown_connections 2024-04-12T13:56:42.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.116+0000 7ff5e1c00640 1 -- 172.21.15.60:0/1081690411 wait complete. 2024-04-12T13:56:42.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T13:56:42.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:42 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2907730103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:42.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:42 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/75630323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 -- 172.21.15.60:0/786762132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104250 msgr2=0x7f8e28104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/786762132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104250 0x7f8e28104620 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8e180048d0 tx=0x7f8e18009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 -- 172.21.15.60:0/786762132 shutdown_connections 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/786762132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104bf0 0x7f8e280fe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/786762132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104250 0x7f8e28104620 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 -- 172.21.15.60:0/786762132 >> 172.21.15.60:0/786762132 conn(0x7f8e280f9fc0 msgr2=0x7f8e280fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 -- 172.21.15.60:0/786762132 shutdown_connections 2024-04-12T13:56:42.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.347+0000 7f8e2dc00640 1 -- 172.21.15.60:0/786762132 wait complete. 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 Processor -- start 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 -- start start 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104250 0x7f8e28114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28115970 con 0x7f8e28104bf0 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.348+0000 7f8e2dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2810ef30 con 0x7f8e28104250 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57788/0 (socket says 172.21.15.60:57788) 2024-04-12T13:56:42.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 -- 172.21.15.60:0/3714074304 learned_addr learned my addr 172.21.15.60:0/3714074304 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e27e00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104250 0x7f8e28114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 -- 172.21.15.60:0/3714074304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104250 msgr2=0x7f8e28114da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104250 0x7f8e28114da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 -- 172.21.15.60:0/3714074304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18005040 con 0x7f8e28104bf0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.349+0000 7f8e1fe00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b790 tx=0x7f8e100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.350+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e1000c700 con 0x7f8e28104bf0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.350+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e1000cd30 con 0x7f8e28104bf0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.350+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2810f210 con 0x7f8e28104bf0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.350+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e10013370 con 0x7f8e28104bf0 2024-04-12T13:56:42.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.350+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2810f730 con 0x7f8e28104bf0 2024-04-12T13:56:42.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.351+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e280ff9c0 con 0x7f8e28104bf0 2024-04-12T13:56:42.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.352+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8e10012070 con 0x7f8e28104bf0 2024-04-12T13:56:42.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.353+0000 7f8e24c00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 0x7f8e0c071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.354+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f8e1008e410 con 0x7f8e28104bf0 2024-04-12T13:56:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.354+0000 7f8e27e00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 0x7f8e0c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.354+0000 7f8e27e00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 0x7f8e0c071030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e180048a0 tx=0x7f8e18009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:42.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.359+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f8e10056ff0 con 0x7f8e28104bf0 2024-04-12T13:56:42.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:42 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2907730103' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:42.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:42 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/75630323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:42.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.564+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f8e2810b470 con 0x7f8e28104bf0 2024-04-12T13:56:42.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.565+0000 7f8e24c00640 1 -- 172.21.15.60:0/3714074304 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8e1005a6b0 con 0x7f8e28104bf0 2024-04-12T13:56:42.567 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:42.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 msgr2=0x7f8e0c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 0x7f8e0c071030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e180048a0 tx=0x7f8e18009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 msgr2=0x7f8e281152e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b790 tx=0x7f8e100091d0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 shutdown_connections 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f8e0c06eb80 0x7f8e0c071030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e28104bf0 0x7f8e281152e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 --2- 172.21.15.60:0/3714074304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e28104250 0x7f8e28114da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.568+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 >> 172.21.15.60:0/3714074304 conn(0x7f8e280f9fc0 msgr2=0x7f8e280fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.569+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 shutdown_connections 2024-04-12T13:56:42.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.569+0000 7f8e2dc00640 1 -- 172.21.15.60:0/3714074304 wait complete. 2024-04-12T13:56:42.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 -- 172.21.15.60:0/1766629063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 msgr2=0x7f0ed006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/1766629063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed006f870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00048d0 tx=0x7f0ec0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 -- 172.21.15.60:0/1766629063 shutdown_connections 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/1766629063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/1766629063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed006f870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 -- 172.21.15.60:0/1766629063 >> 172.21.15.60:0/1766629063 conn(0x7f0ed00f7c20 msgr2=0x7f0ed00fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 -- 172.21.15.60:0/1766629063 shutdown_connections 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.809+0000 7f0ecfe00640 1 -- 172.21.15.60:0/1766629063 wait complete. 2024-04-12T13:56:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 Processor -- start 2024-04-12T13:56:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 -- start start 2024-04-12T13:56:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0119170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0119cb0 con 0x7f0ed00714a0 2024-04-12T13:56:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.810+0000 7f0ecfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0113300 con 0x7f0ed006fdb0 2024-04-12T13:56:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57800/0 (socket says 172.21.15.60:57800) 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 -- 172.21.15.60:0/2641309615 learned_addr learned my addr 172.21.15.60:0/2641309615 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ecea00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0119170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 -- 172.21.15.60:0/2641309615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 msgr2=0x7f0ed0119170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0119170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 -- 172.21.15.60:0/2641309615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0005040 con 0x7f0ed00714a0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ecea00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0119170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.811+0000 7f0ece000640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c830 tx=0x7f0ebc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.812+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ebc00a850 con 0x7f0ed00714a0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.812+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ebc00ae80 con 0x7f0ed00714a0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.812+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed01135e0 con 0x7f0ed00714a0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.812+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ebc012ea0 con 0x7f0ed00714a0 2024-04-12T13:56:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.812+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0113b00 con 0x7f0ed00714a0 2024-04-12T13:56:42.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.813+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed0070fb0 con 0x7f0ed00714a0 2024-04-12T13:56:42.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.816+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ebc012400 con 0x7f0ed00714a0 2024-04-12T13:56:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.816+0000 7f0ec6a00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 0x7f0eb4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.817+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f0ebc08ed90 con 0x7f0ed00714a0 2024-04-12T13:56:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.817+0000 7f0ecea00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 0x7f0eb4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.817+0000 7f0ecea00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 0x7f0eb4071030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0003080 tx=0x7f0ec0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:42.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:42.821+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f0ebc057950 con 0x7f0ed00714a0 2024-04-12T13:56:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.039+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ed01147e0 con 0x7f0ed00714a0 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.041+0000 7f0ec6a00640 1 -- 172.21.15.60:0/2641309615 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v101) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f0ebc0126b0 con 0x7f0ed00714a0 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6825/382915624 2024-04-13T13:52:00.171451+0000 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6828/2341264545 2024-04-13T13:51:28.527110+0000 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6827/3800124536 2024-04-13T13:50:51.723732+0000 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/3232156266 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:43.042 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2053434802 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1128934038 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6829/673177696 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/890951757 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/657445096 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/578861147 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1558416897 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6826/2604118377 2024-04-13T13:52:29.504399+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/673590403 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2674766807 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/673590403 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/817733215 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/27363661 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/3232156266 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:43.043 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6829/2341264545 2024-04-13T13:51:28.527110+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/712459421 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6824/382915624 2024-04-13T13:52:00.171451+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/3047753227 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3599234125 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4071152381 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2810993733 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2672639608 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1310101403 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1558416897 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1256818615 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1868456600 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2874214879 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:43.044 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/776827360 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6827/2604118377 2024-04-13T13:52:29.504399+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/2534067942 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4060867973 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4071152381 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6828/673177696 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2903895635 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1631919154 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1303426533 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1868456600 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1963942392 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6826/3800124536 2024-04-13T13:50:51.723732+0000 2024-04-12T13:56:43.046 INFO:teuthology.orchestra.run.smithi060.stderr:listed 43 entries 2024-04-12T13:56:43.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 msgr2=0x7f0eb4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 0x7f0eb4071030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0003080 tx=0x7f0ec0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 msgr2=0x7f0ed01196b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c830 tx=0x7f0ebc004430 comp rx=0 tx=0).stop 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 shutdown_connections 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f0eb406eb80 0x7f0eb4071030 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ed00714a0 0x7f0ed01196b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 --2- 172.21.15.60:0/2641309615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed006fdb0 0x7f0ed0119170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 >> 172.21.15.60:0/2641309615 conn(0x7f0ed00f7c20 msgr2=0x7f0ed00f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 shutdown_connections 2024-04-12T13:56:43.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.044+0000 7f0ecfe00640 1 -- 172.21.15.60:0/2641309615 wait complete. 2024-04-12T13:56:43.065 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-12T13:56:43.065 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T13:56:43.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T13:56:43.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 -- 172.21.15.60:0/628819274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 msgr2=0x7f9e040faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 --2- 172.21.15.60:0/628819274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040faf50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0048d0 tx=0x7f9dec009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 -- 172.21.15.60:0/628819274 shutdown_connections 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 --2- 172.21.15.60:0/628819274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040faf50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 --2- 172.21.15.60:0/628819274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 0x7f9e041012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 -- 172.21.15.60:0/628819274 >> 172.21.15.60:0/628819274 conn(0x7f9e040f6b10 msgr2=0x7f9e040f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 -- 172.21.15.60:0/628819274 shutdown_connections 2024-04-12T13:56:43.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.337+0000 7f9e03e00640 1 -- 172.21.15.60:0/628819274 wait complete. 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 Processor -- start 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 -- start start 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 0x7f9e040fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040feb20 con 0x7f9e041018c0 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.338+0000 7f9e03e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040fd640 con 0x7f9e04100f20 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57824/0 (socket says 172.21.15.60:57824) 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 -- 172.21.15.60:0/3338783825 learned_addr learned my addr 172.21.15.60:0/3338783825 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9e02a00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 0x7f9e040fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 -- 172.21.15.60:0/3338783825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 msgr2=0x7f9e040fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 0x7f9e040fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.339+0000 7f9dfa000640 1 -- 172.21.15.60:0/3338783825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec005040 con 0x7f9e041018c0 2024-04-12T13:56:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9dfa000640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9dec004930 tx=0x7f9dec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec0094c0 con 0x7f9e041018c0 2024-04-12T13:56:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dec032e50 con 0x7f9e041018c0 2024-04-12T13:56:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040fd8c0 con 0x7f9e041018c0 2024-04-12T13:56:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec0433b0 con 0x7f9e041018c0 2024-04-12T13:56:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.340+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e041191f0 con 0x7f9e041018c0 2024-04-12T13:56:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.341+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040fc690 con 0x7f9e041018c0 2024-04-12T13:56:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.342+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9dec02f070 con 0x7f9e041018c0 2024-04-12T13:56:43.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.343+0000 7f9dfb400640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 0x7f9de4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.344+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f9dec0b09e0 con 0x7f9e041018c0 2024-04-12T13:56:43.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.344+0000 7f9e02a00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 0x7f9de4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.344+0000 7f9e02a00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 0x7f9de4071020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9df4004c40 tx=0x7f9df4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:43.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.348+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f9dec079520 con 0x7f9e041018c0 2024-04-12T13:56:43.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:43 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1081690411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:43 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3714074304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:43 smithi060 ceph-mon[94333]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:43 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2641309615' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T13:56:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:43 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1081690411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:43 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3714074304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:43 smithi110 ceph-mon[82130]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:43 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2641309615' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T13:56:43.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.567+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e04108060 con 0x7f9e041018c0 2024-04-12T13:56:43.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.570+0000 7f9dfb400640 1 -- 172.21.15.60:0/3338783825 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+17367 (secure 0 0 0) 0x7f9dec07cbe0 con 0x7f9e041018c0 2024-04-12T13:56:43.572 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-12T13:56:43.572 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":101,"fsid":"7ed74db6-f8d0-11ee-bc8c-c7b262605968","created":"2024-04-12T13:29:12.120682+0000","modified":"2024-04-12T13:52:29.504455+0000","last_up_change":"2024-04-12T13:50:40.271283+0000","last_in_change":"2024-04-12T13:36:12.811098+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T13:34:54.600821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T13:38:13.485475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T13:38:14.117573+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec1d2f83-f08d-4617-af02-a6a7225825b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6803","nonce":1148773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6805","nonce":1148773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6809","nonce":1148773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1148773022},{"type":"v1","addr":"172.21.15.60:6807","nonce":1148773022}]},"public_addr":"172.21.15.60:6803/1148773022","cluster_addr":"172.21.15.60:6805/1148773022","heartbeat_back_addr":"172.21.15.60:6809/1148773022","heartbeat_front_addr":"172.21.15.60:6807/1148773022","state":["exists","up"]},{"osd":1,"uuid":"ac4249c9-82a1-4ca8-b7a9-c56aba9a939a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":95,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6811","nonce":1855254170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6813","nonce":1855254170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6817","nonce":1855254170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1855254170},{"type":"v1","addr":"172.21.15.60:6815","nonce":1855254170}]},"public_addr":"172.21.15.60:6811/1855254170","cluster_addr":"172.21.15.60:6813/1855254170","heartbeat_back_addr":"172.21.15.60:6817/1855254170","heartbeat_front_addr":"172.21.15.60:6815/1855254170","state":["exists","up"]},{"osd":2,"uuid":"b7f399dd-c1bb-492b-9d5f-e2dfb5fb18c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":73,"up_thru":95,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6819","nonce":2464051082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6821","nonce":2464051082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6825","nonce":2464051082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2464051082},{"type":"v1","addr":"172.21.15.60:6823","nonce":2464051082}]},"public_addr":"172.21.15.60:6819/2464051082","cluster_addr":"172.21.15.60:6821/2464051082","heartbeat_back_addr":"172.21.15.60:6825/2464051082","heartbeat_front_addr":"172.21.15.60:6823/2464051082","state":["exists","up"]},{"osd":3,"uuid":"863337af-34ea-4b8e-85c9-aaf55e0cb5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6801","nonce":842224302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6803","nonce":842224302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6807","nonce":842224302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":842224302},{"type":"v1","addr":"172.21.15.110:6805","nonce":842224302}]},"public_addr":"172.21.15.110:6801/842224302","cluster_addr":"172.21.15.110:6803/842224302","heartbeat_back_addr":"172.21.15.110:6807/842224302","heartbeat_front_addr":"172.21.15.110:6805/842224302","state":["exists","up"]},{"osd":4,"uuid":"2638e619-a934-42d4-acea-86c6a01a19ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6809","nonce":223716750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6811","nonce":223716750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6815","nonce":223716750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":223716750},{"type":"v1","addr":"172.21.15.110:6813","nonce":223716750}]},"public_addr":"172.21.15.110:6809/223716750","cluster_addr":"172.21.15.110:6811/223716750","heartbeat_back_addr":"172.21.15.110:6815/223716750","heartbeat_front_addr":"172.21.15.110:6813/223716750","state":["exists","up"]},{"osd":5,"uuid":"786e4b4d-8426-49e5-8473-bd007cc4e71d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6817","nonce":3606855652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6819","nonce":3606855652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6823","nonce":3606855652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3606855652},{"type":"v1","addr":"172.21.15.110:6821","nonce":3606855652}]},"public_addr":"172.21.15.110:6817/3606855652","cluster_addr":"172.21.15.110:6819/3606855652","heartbeat_back_addr":"172.21.15.110:6823/3606855652","heartbeat_front_addr":"172.21.15.110:6821/3606855652","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:33:35.054746+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:12.800022+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:34:50.528707+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:35:24.738231+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:00.287014+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T13:36:34.944637+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":0,"to":5}]},{"pgid":"2.1a","mappings":[{"from":3,"to":2}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"2.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.0","mappings":[{"from":1,"to":5}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6825/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.60:6828/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:6827/3800124536":"2024-04-13T13:50:51.723732+0000","172.21.15.60:6800/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:0/2053434802":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/1128934038":"2024-04-13T13:45:13.090200+0000","172.21.15.110:6829/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.110:0/890951757":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/657445096":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/578861147":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6801/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6826/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.60:6801/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/2674766807":"2024-04-13T13:41:16.431739+0000","172.21.15.60:6800/673590403":"2024-04-13T13:41:16.431739+0000","172.21.15.110:0/817733215":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/27363661":"2024-04-13T13:30:28.130544+0000","172.21.15.60:6801/3232156266":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6829/2341264545":"2024-04-13T13:51:28.527110+0000","172.21.15.60:0/712459421":"2024-04-13T13:29:47.328834+0000","172.21.15.110:6824/382915624":"2024-04-13T13:52:00.171451+0000","172.21.15.110:0/3047753227":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/3599234125":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2810993733":"2024-04-13T13:31:59.892019+0000","172.21.15.60:0/2672639608":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1310101403":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1558416897":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1256818615":"2024-04-13T13:29:47.328834+0000","172.21.15.60:6801/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/2874214879":"2024-04-13T13:41:16.431739+0000","172.21.15.60:0/776827360":"2024-04-13T13:30:28.130544+0000","172.21.15.110:6827/2604118377":"2024-04-13T13:52:29.504399+0000","172.21.15.110:0/2534067942":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/4060867973":"2024-04-13T13:31:59.892019+0000","172.21.15.60:6800/4071152381":"2024-04-13T13:31:59.892019+0000","172.21.15.110:6828/673177696":"2024-04-13T13:43:35.857788+0000","172.21.15.60:0/2903895635":"2024-04-13T13:30:28.130544+0000","172.21.15.60:0/1631919154":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1303426533":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6800/1868456600":"2024-04-13T13:45:13.090200+0000","172.21.15.60:0/1963942392":"2024-04-13T13:45:13.090200+0000","172.21.15.60:6826/3800124536":"2024-04-13T13:50:51.723732+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T13:56:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 msgr2=0x7f9de4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 0x7f9de4071020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9df4004c40 tx=0x7f9df4009040 comp rx=0 tx=0).stop 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 msgr2=0x7f9e040fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9dec004930 tx=0x7f9dec009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 shutdown_connections 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f9de406eb70 0x7f9de4071020 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e041018c0 0x7f9e040fd100 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 --2- 172.21.15.60:0/3338783825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e04100f20 0x7f9e040fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 >> 172.21.15.60:0/3338783825 conn(0x7f9e040f6b10 msgr2=0x7f9e040654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.573+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 shutdown_connections 2024-04-12T13:56:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.574+0000 7f9e03e00640 1 -- 172.21.15.60:0/3338783825 wait complete. 2024-04-12T13:56:43.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T13:34:54.600821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T13:38:13.485475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T13:38:14.117573+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T13:56:43.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T13:56:43.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 -- 172.21.15.60:0/2027803863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0072310 msgr2=0x7ffac010cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 --2- 172.21.15.60:0/2027803863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0072310 0x7ffac010cb80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80048d0 tx=0x7ffaa8009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 -- 172.21.15.60:0/2027803863 shutdown_connections 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 --2- 172.21.15.60:0/2027803863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0072310 0x7ffac010cb80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 --2- 172.21.15.60:0/2027803863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0071a00 0x7ffac0071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 -- 172.21.15.60:0/2027803863 >> 172.21.15.60:0/2027803863 conn(0x7ffac00f9fc0 msgr2=0x7ffac00fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 -- 172.21.15.60:0/2027803863 shutdown_connections 2024-04-12T13:56:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.811+0000 7ffac5200640 1 -- 172.21.15.60:0/2027803863 wait complete. 2024-04-12T13:56:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.812+0000 7ffac5200640 1 Processor -- start 2024-04-12T13:56:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.812+0000 7ffac5200640 1 -- start start 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffac5200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffac5200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0072310 0x7ffac0119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffac5200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0119e30 con 0x7ffac0071a00 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffac5200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0113480 con 0x7ffac0072310 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffabde00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffabde00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57848/0 (socket says 172.21.15.60:57848) 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffabde00640 1 -- 172.21.15.60:0/1949123699 learned_addr learned my addr 172.21.15.60:0/1949123699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.813+0000 7ffab5400640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0072310 0x7ffac0119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffabde00640 1 -- 172.21.15.60:0/1949123699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0072310 msgr2=0x7ffac0119830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffabde00640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0072310 0x7ffac0119830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffabde00640 1 -- 172.21.15.60:0/1949123699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8005040 con 0x7ffac0071a00 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffabde00640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c830 tx=0x7ffab0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab000a7d0 con 0x7ffac0071a00 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffab000ae00 con 0x7ffac0071a00 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac0113760 con 0x7ffac0071a00 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.814+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab00113a0 con 0x7ffac0071a00 2024-04-12T13:56:43.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.815+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0113c50 con 0x7ffac0071a00 2024-04-12T13:56:43.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.816+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac0073140 con 0x7ffac0071a00 2024-04-12T13:56:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.817+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ffab0012400 con 0x7ffac0071a00 2024-04-12T13:56:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.818+0000 7ffab6a00640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 0x7ffaa4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.818+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7ffab008ec00 con 0x7ffac0071a00 2024-04-12T13:56:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.818+0000 7ffab5400640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 0x7ffaa4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.819+0000 7ffab5400640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 0x7ffaa4071030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80048a0 tx=0x7ffaa8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:43.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:43.823+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7ffab0094020 con 0x7ffac0071a00 2024-04-12T13:56:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.035+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffac0109930 con 0x7ffac0071a00 2024-04-12T13:56:44.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.035+0000 7ffab6a00640 1 -- 172.21.15.60:0/1949123699 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffab0057860 con 0x7ffac0071a00 2024-04-12T13:56:44.037 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-04-12T13:56:44.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 msgr2=0x7ffaa4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 0x7ffaa4071030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80048a0 tx=0x7ffaa8009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 msgr2=0x7ffac01192f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c830 tx=0x7ffab0004430 comp rx=0 tx=0).stop 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 shutdown_connections 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7ffaa406eb80 0x7ffaa4071030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffac0072310 0x7ffac0119830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 --2- 172.21.15.60:0/1949123699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac0071a00 0x7ffac01192f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 >> 172.21.15.60:0/1949123699 conn(0x7ffac00f9fc0 msgr2=0x7ffac0106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 shutdown_connections 2024-04-12T13:56:44.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.038+0000 7ffac5200640 1 -- 172.21.15.60:0/1949123699 wait complete. 2024-04-12T13:56:44.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T13:56:44.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 -- 172.21.15.60:0/1892715332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b006f870 msgr2=0x7fc2b006fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 --2- 172.21.15.60:0/1892715332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b006f870 0x7fc2b006fc40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40048d0 tx=0x7fc2a4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 -- 172.21.15.60:0/1892715332 shutdown_connections 2024-04-12T13:56:44.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 --2- 172.21.15.60:0/1892715332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b0070180 0x7fc2b0108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 --2- 172.21.15.60:0/1892715332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b006f870 0x7fc2b006fc40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 -- 172.21.15.60:0/1892715332 >> 172.21.15.60:0/1892715332 conn(0x7fc2b00f7fb0 msgr2=0x7fc2b00fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:44.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 -- 172.21.15.60:0/1892715332 shutdown_connections 2024-04-12T13:56:44.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.269+0000 7fc2b8600640 1 -- 172.21.15.60:0/1892715332 wait complete. 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.270+0000 7fc2b8600640 1 Processor -- start 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.270+0000 7fc2b8600640 1 -- start start 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b8600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 0x7fc2b0115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b8600640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b8600640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0115cd0 con 0x7fc2b0070180 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b8600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b010f320 con 0x7fc2b006f870 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57864/0 (socket says 172.21.15.60:57864) 2024-04-12T13:56:44.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 -- 172.21.15.60:0/3754077673 learned_addr learned my addr 172.21.15.60:0/3754077673 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:44.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5c00640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 0x7fc2b0115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 -- 172.21.15.60:0/3754077673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 msgr2=0x7fc2b0115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 0x7fc2b0115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5200640 1 -- 172.21.15.60:0/3754077673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4005040 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.271+0000 7fc2b5c00640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 0x7fc2b0115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2b5200640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc29c002a50 tx=0x7fc29c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc29c007c30 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc29c00f040 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b010f600 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc29c00dbe0 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.272+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b010fb20 con 0x7fc2b0070180 2024-04-12T13:56:44.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.274+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b0070fb0 con 0x7fc2b0070180 2024-04-12T13:56:44.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.274+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc29c00dd40 con 0x7fc2b0070180 2024-04-12T13:56:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.276+0000 7fc2ad600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 0x7fc298071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.276+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fc29c08ea90 con 0x7fc2b0070180 2024-04-12T13:56:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.276+0000 7fc2b5c00640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 0x7fc298071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.277+0000 7fc2b5c00640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 0x7fc298071020 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:44.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.281+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fc29c057610 con 0x7fc2b0070180 2024-04-12T13:56:44.380 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:44.380 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:44 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3338783825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:44.380 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:44 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1949123699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:44 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3338783825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T13:56:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:44 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1949123699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T13:56:44.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.489+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc2b0110800 con 0x7fc2b0070180 2024-04-12T13:56:44.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.490+0000 7fc2ad600640 1 -- 172.21.15.60:0/3754077673 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc29c05acd0 con 0x7fc2b0070180 2024-04-12T13:56:44.491 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.492+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 msgr2=0x7fc298071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.492+0000 7fc2b8600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 0x7fc298071020 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a4009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.492+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 msgr2=0x7fc2b01156d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.492+0000 7fc2b8600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc29c002a50 tx=0x7fc29c004600 comp rx=0 tx=0).stop 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 shutdown_connections 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fc29806eb70 0x7fc298071020 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b0070180 0x7fc2b01156d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 --2- 172.21.15.60:0/3754077673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b006f870 0x7fc2b0115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 >> 172.21.15.60:0/3754077673 conn(0x7fc2b00f7fb0 msgr2=0x7fc2b00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:44.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 shutdown_connections 2024-04-12T13:56:44.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.493+0000 7fc2b8600640 1 -- 172.21.15.60:0/3754077673 wait complete. 2024-04-12T13:56:44.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.723+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1004403184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0071a00 msgr2=0x7fe6c0071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.723+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1004403184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0071a00 0x7fe6c0071dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00048d0 tx=0x7fe6b0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1004403184 shutdown_connections 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1004403184 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0072310 0x7fe6c010c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1004403184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0071a00 0x7fe6c0071dd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1004403184 >> 172.21.15.60:0/1004403184 conn(0x7fe6c00f9fc0 msgr2=0x7fe6c00fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1004403184 shutdown_connections 2024-04-12T13:56:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.724+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1004403184 wait complete. 2024-04-12T13:56:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.725+0000 7fe6bfe00640 1 Processor -- start 2024-04-12T13:56:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.725+0000 7fe6bfe00640 1 -- start start 2024-04-12T13:56:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0071a00 0x7fe6c01191a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6bfe00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0119d70 con 0x7fe6c0072310 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6bfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0113330 con 0x7fe6c0071a00 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57880/0 (socket says 172.21.15.60:57880) 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 -- 172.21.15.60:0/1893141560 learned_addr learned my addr 172.21.15.60:0/1893141560 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6bea00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0071a00 0x7fe6c01191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 -- 172.21.15.60:0/1893141560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0071a00 msgr2=0x7fe6c01191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0071a00 0x7fe6c01191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.726+0000 7fe6b6000640 1 -- 172.21.15.60:0/1893141560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0005040 con 0x7fe6c0072310 2024-04-12T13:56:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6b6000640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b790 tx=0x7fe6a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a800c700 con 0x7fe6c0072310 2024-04-12T13:56:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6a800cd30 con 0x7fe6c0072310 2024-04-12T13:56:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a8013370 con 0x7fe6c0072310 2024-04-12T13:56:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c0113610 con 0x7fe6c0072310 2024-04-12T13:56:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.727+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c0113b30 con 0x7fe6c0072310 2024-04-12T13:56:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.728+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c0073140 con 0x7fe6c0072310 2024-04-12T13:56:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.729+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe6a8012070 con 0x7fe6c0072310 2024-04-12T13:56:44.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.730+0000 7fe6b7400640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 0x7fe6a4071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:44.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.730+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7fe6a808e480 con 0x7fe6c0072310 2024-04-12T13:56:44.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.731+0000 7fe6bea00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 0x7fe6a4071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:44.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.731+0000 7fe6bea00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 0x7fe6a4071030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00048a0 tx=0x7fe6b0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:44.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.735+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7fe6a8057040 con 0x7fe6c0072310 2024-04-12T13:56:44.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.941+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe6c010f850 con 0x7fe6c0072310 2024-04-12T13:56:44.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.942+0000 7fe6b7400640 1 -- 172.21.15.60:0/1893141560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v101) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe6a805a700 con 0x7fe6c0072310 2024-04-12T13:56:44.943 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 msgr2=0x7fe6a4071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 0x7fe6a4071030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00048a0 tx=0x7fe6b0009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 msgr2=0x7fe6c01196e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b790 tx=0x7fe6a80091d0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 shutdown_connections 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7fe6a406eb80 0x7fe6a4071030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c0072310 0x7fe6c01196e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 --2- 172.21.15.60:0/1893141560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c0071a00 0x7fe6c01191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:44.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 >> 172.21.15.60:0/1893141560 conn(0x7fe6c00f9fc0 msgr2=0x7fe6c00fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:44.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 shutdown_connections 2024-04-12T13:56:44.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:44.945+0000 7fe6bfe00640 1 -- 172.21.15.60:0/1893141560 wait complete. 2024-04-12T13:56:44.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 -- 172.21.15.60:0/577917383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104250 msgr2=0x7f0110104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 --2- 172.21.15.60:0/577917383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104250 0x7f0110104620 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f01000048d0 tx=0x7f0100009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 -- 172.21.15.60:0/577917383 shutdown_connections 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 --2- 172.21.15.60:0/577917383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104bf0 0x7f01100fe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 --2- 172.21.15.60:0/577917383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104250 0x7f0110104620 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 -- 172.21.15.60:0/577917383 >> 172.21.15.60:0/577917383 conn(0x7f01100f9fc0 msgr2=0x7f01100fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.179+0000 7f0115c00640 1 -- 172.21.15.60:0/577917383 shutdown_connections 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.180+0000 7f0115c00640 1 -- 172.21.15.60:0/577917383 wait complete. 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.180+0000 7f0115c00640 1 Processor -- start 2024-04-12T13:56:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.180+0000 7f0115c00640 1 -- start start 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0115c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104250 0x7f0110114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0115c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0115c00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110115860 con 0x7f0110104bf0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0115c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011010eeb0 con 0x7f0110104250 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0107e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0107e00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57890/0 (socket says 172.21.15.60:57890) 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.181+0000 7f0107e00640 1 -- 172.21.15.60:0/2302460840 learned_addr learned my addr 172.21.15.60:0/2302460840 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f010fe00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104250 0x7f0110114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0107e00640 1 -- 172.21.15.60:0/2302460840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104250 msgr2=0x7f0110114d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0107e00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104250 0x7f0110114d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0107e00640 1 -- 172.21.15.60:0/2302460840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100005040 con 0x7f0110104bf0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0107e00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c830 tx=0x7f00f8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f800a850 con 0x7f0110104bf0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00f800ae80 con 0x7f0110104bf0 2024-04-12T13:56:45.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011010f190 con 0x7f0110104bf0 2024-04-12T13:56:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f8012ea0 con 0x7f0110104bf0 2024-04-12T13:56:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.182+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011010f6b0 con 0x7f0110104bf0 2024-04-12T13:56:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.184+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01100ff9c0 con 0x7f0110104bf0 2024-04-12T13:56:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.185+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00f8012400 con 0x7f0110104bf0 2024-04-12T13:56:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.186+0000 7f010cc00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 0x7f00f4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T13:56:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.186+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6958+0+0 (secure 0 0 0) 0x7f00f808ec90 con 0x7f0110104bf0 2024-04-12T13:56:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.186+0000 7f010fe00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 0x7f00f4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T13:56:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.187+0000 7f010fe00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 0x7f00f4071020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0100003080 tx=0x7f0100009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T13:56:45.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.191+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188297 (secure 0 0 0) 0x7f00f80578d0 con 0x7f0110104bf0 2024-04-12T13:56:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.415+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f011004bcc0 con 0x7f0110104bf0 2024-04-12T13:56:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.416+0000 7f010cc00640 1 -- 172.21.15.60:0/2302460840 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v101) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f00f80126b0 con 0x7f0110104bf0 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6825/382915624 2024-04-13T13:52:00.171451+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6828/2341264545 2024-04-13T13:51:28.527110+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6827/3800124536 2024-04-13T13:50:51.723732+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/3232156266 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2053434802 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1128934038 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6829/673177696 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/890951757 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/657445096 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/578861147 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1558416897 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6826/2604118377 2024-04-13T13:52:29.504399+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/673590403 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2674766807 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/673590403 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/817733215 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/27363661 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/3232156266 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6829/2341264545 2024-04-13T13:51:28.527110+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/712459421 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6824/382915624 2024-04-13T13:52:00.171451+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/3047753227 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3599234125 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4071152381 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2810993733 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2672639608 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1310101403 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1558416897 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1256818615 2024-04-13T13:29:47.328834+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1868456600 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2874214879 2024-04-13T13:41:16.431739+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/776827360 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6827/2604118377 2024-04-13T13:52:29.504399+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:0/2534067942 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/4060867973 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4071152381 2024-04-13T13:31:59.892019+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.110:6828/673177696 2024-04-13T13:43:35.857788+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2903895635 2024-04-13T13:30:28.130544+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1631919154 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1303426533 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.420 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1868456600 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.421 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1963942392 2024-04-13T13:45:13.090200+0000 2024-04-12T13:56:45.421 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6826/3800124536 2024-04-13T13:50:51.723732+0000 2024-04-12T13:56:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:listed 43 entries 2024-04-12T13:56:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 msgr2=0x7f00f4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:45.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 0x7f00f4071020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0100003080 tx=0x7f0100009da0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 msgr2=0x7f0110115260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c830 tx=0x7f00f8004430 comp rx=0 tx=0).stop 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 shutdown_connections 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:6800/126565405,v1:172.21.15.60:6801/126565405] conn(0x7f00f406eb70 0x7f00f4071020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0110104bf0 0x7f0110115260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 --2- 172.21.15.60:0/2302460840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0110104250 0x7f0110114d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 >> 172.21.15.60:0/2302460840 conn(0x7f01100f9fc0 msgr2=0x7f01100fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 shutdown_connections 2024-04-12T13:56:45.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-12T13:56:45.419+0000 7f0115c00640 1 -- 172.21.15.60:0/2302460840 wait complete. 2024-04-12T13:56:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:45 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/3754077673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:45 smithi060 ceph-mon[94333]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:45 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/1893141560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:45.440 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2024-04-12T13:56:45.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T13:56:45.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-12T13:56:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:45 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/3754077673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T13:56:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:45 smithi110 ceph-mon[82130]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:45 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/1893141560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T13:56:45.539 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T13:56:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:46 smithi060 ceph-mon[94333]: from='client.? 172.21.15.60:0/2302460840' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T13:56:46.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:46 smithi110 ceph-mon[82130]: from='client.? 172.21.15.60:0/2302460840' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T13:56:47.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:47 smithi060 ceph-mon[94333]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:47 smithi110 ceph-mon[82130]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:50.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:49 smithi060 ceph-mon[94333]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:50.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:49 smithi110 ceph-mon[82130]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:52.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:51 smithi060 ceph-mon[94333]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:51 smithi110 ceph-mon[82130]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:54.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:53 smithi060 ceph-mon[94333]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:53 smithi110 ceph-mon[82130]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:56.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:55 smithi060 ceph-mon[94333]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:55 smithi110 ceph-mon[82130]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:58.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:57 smithi060 ceph-mon[94333]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:57 smithi110 ceph-mon[82130]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:56:59.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:56:59.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:00.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:56:59 smithi060 ceph-mon[94333]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:56:59 smithi110 ceph-mon[82130]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:02.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:01 smithi060 ceph-mon[94333]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:02.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:01 smithi110 ceph-mon[82130]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:03 smithi060 ceph-mon[94333]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:03 smithi110 ceph-mon[82130]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:06.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:05 smithi060 ceph-mon[94333]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:05 smithi110 ceph-mon[82130]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:08.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:07 smithi060 ceph-mon[94333]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:07 smithi110 ceph-mon[82130]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:10.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:09 smithi060 ceph-mon[94333]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:09 smithi110 ceph-mon[82130]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:11 smithi060 ceph-mon[94333]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:11 smithi110 ceph-mon[82130]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:13 smithi060 ceph-mon[94333]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:14.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:13 smithi110 ceph-mon[82130]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:16.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:15 smithi060 ceph-mon[94333]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:15 smithi110 ceph-mon[82130]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:18.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:17 smithi060 ceph-mon[94333]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:17 smithi110 ceph-mon[82130]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:20.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:19 smithi060 ceph-mon[94333]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:20.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:19 smithi110 ceph-mon[82130]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:22.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:21 smithi060 ceph-mon[94333]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:21 smithi110 ceph-mon[82130]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:24.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:23 smithi060 ceph-mon[94333]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:23 smithi110 ceph-mon[82130]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:26.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:25 smithi060 ceph-mon[94333]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:25 smithi110 ceph-mon[82130]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:28.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:27 smithi060 ceph-mon[94333]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:27 smithi110 ceph-mon[82130]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:30.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:29 smithi060 ceph-mon[94333]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:29 smithi110 ceph-mon[82130]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:32.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:31 smithi060 ceph-mon[94333]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:31 smithi110 ceph-mon[82130]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:33 smithi060 ceph-mon[94333]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:33 smithi110 ceph-mon[82130]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:35 smithi060 ceph-mon[94333]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:35 smithi110 ceph-mon[82130]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:37 smithi060 ceph-mon[94333]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:38.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:37 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:57:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:37 smithi110 ceph-mon[82130]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:37 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:57:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:57:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:57:39.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:38 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:57:39.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:57:39.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:57:39.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:38 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:57:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:39 smithi110 ceph-mon[82130]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:40.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:39 smithi060 ceph-mon[94333]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:41 smithi110 ceph-mon[82130]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:42.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:41 smithi060 ceph-mon[94333]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:43 smithi110 ceph-mon[82130]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:44.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:43 smithi060 ceph-mon[94333]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:44.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:45 smithi110 ceph-mon[82130]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:46.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:45 smithi060 ceph-mon[94333]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:47 smithi110 ceph-mon[82130]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:48.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:47 smithi060 ceph-mon[94333]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:50.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:49 smithi110 ceph-mon[82130]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:50.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:49 smithi060 ceph-mon[94333]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:51 smithi110 ceph-mon[82130]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:52.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:51 smithi060 ceph-mon[94333]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:54.232 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:53 smithi060 ceph-mon[94333]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:53 smithi110 ceph-mon[82130]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:56.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:55 smithi060 ceph-mon[94333]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:55 smithi110 ceph-mon[82130]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:58.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:57 smithi060 ceph-mon[94333]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:58.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:57 smithi110 ceph-mon[82130]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:57:59.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:57:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:57:59.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:57:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:00 smithi060 ceph-mon[94333]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:00.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:00 smithi110 ceph-mon[82130]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:02.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:02 smithi060 ceph-mon[94333]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:02.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:02 smithi110 ceph-mon[82130]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:04.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:04 smithi060 ceph-mon[94333]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:04.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:04 smithi110 ceph-mon[82130]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:06.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:06 smithi060 ceph-mon[94333]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:06.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:06 smithi110 ceph-mon[82130]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:08.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:08 smithi060 ceph-mon[94333]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:08.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:08 smithi110 ceph-mon[82130]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:10.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:10 smithi060 ceph-mon[94333]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:10.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:10 smithi110 ceph-mon[82130]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:12.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:12 smithi060 ceph-mon[94333]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:12.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:12 smithi110 ceph-mon[82130]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:14 smithi060 ceph-mon[94333]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:14 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:14 smithi110 ceph-mon[82130]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:14.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:14 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:16.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:16 smithi060 ceph-mon[94333]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:16 smithi110 ceph-mon[82130]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:18.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:18 smithi060 ceph-mon[94333]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:18 smithi110 ceph-mon[82130]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:20.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:20 smithi060 ceph-mon[94333]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:20.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:20 smithi110 ceph-mon[82130]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:21.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:21 smithi060 ceph-mon[94333]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:21.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:21 smithi110 ceph-mon[82130]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:24.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:23 smithi060 ceph-mon[94333]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:23 smithi110 ceph-mon[82130]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:26.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:25 smithi060 ceph-mon[94333]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:25 smithi110 ceph-mon[82130]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:28.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:27 smithi060 ceph-mon[94333]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:27 smithi110 ceph-mon[82130]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:29.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:30.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:29 smithi060 ceph-mon[94333]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:30.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:29 smithi110 ceph-mon[82130]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:32.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:31 smithi060 ceph-mon[94333]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:32.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:31 smithi110 ceph-mon[82130]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:33 smithi060 ceph-mon[94333]: pgmap v475: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:34.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:33 smithi110 ceph-mon[82130]: pgmap v475: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:35 smithi060 ceph-mon[94333]: pgmap v476: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:36.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:35 smithi110 ceph-mon[82130]: pgmap v476: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:38.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:37 smithi060 ceph-mon[94333]: pgmap v477: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:38.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:37 smithi110 ceph-mon[82130]: pgmap v477: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:39 smithi060 ceph-mon[94333]: pgmap v478: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:40.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:39 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:58:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:39 smithi110 ceph-mon[82130]: pgmap v478: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:40.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:39 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:58:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:58:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:58:41.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:40 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:58:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:58:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:58:41.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:40 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:58:42.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:41 smithi060 ceph-mon[94333]: pgmap v479: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:42.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:41 smithi110 ceph-mon[82130]: pgmap v479: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:43 smithi060 ceph-mon[94333]: pgmap v480: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:44.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:44.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:43 smithi110 ceph-mon[82130]: pgmap v480: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:44.232 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:46.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:45 smithi060 ceph-mon[94333]: pgmap v481: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:46.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:45 smithi110 ceph-mon[82130]: pgmap v481: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:48.180 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:47 smithi060 ceph-mon[94333]: pgmap v482: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:48.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:47 smithi110 ceph-mon[82130]: pgmap v482: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:50.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:49 smithi060 ceph-mon[94333]: pgmap v483: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:50.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:49 smithi110 ceph-mon[82130]: pgmap v483: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:52.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:51 smithi060 ceph-mon[94333]: pgmap v484: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:51 smithi110 ceph-mon[82130]: pgmap v484: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:54.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:53 smithi060 ceph-mon[94333]: pgmap v485: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:53 smithi110 ceph-mon[82130]: pgmap v485: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:56.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:55 smithi060 ceph-mon[94333]: pgmap v486: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:55 smithi110 ceph-mon[82130]: pgmap v486: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:58.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:57 smithi060 ceph-mon[94333]: pgmap v487: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:57 smithi110 ceph-mon[82130]: pgmap v487: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:58:59.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:58:59.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:00.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:58:59 smithi060 ceph-mon[94333]: pgmap v488: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:58:59 smithi110 ceph-mon[82130]: pgmap v488: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:02.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:01 smithi110 ceph-mon[82130]: pgmap v489: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:02.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:01 smithi060 ceph-mon[94333]: pgmap v489: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:03 smithi110 ceph-mon[82130]: pgmap v490: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:04.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:03 smithi060 ceph-mon[94333]: pgmap v490: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:05 smithi110 ceph-mon[82130]: pgmap v491: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:06.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:05 smithi060 ceph-mon[94333]: pgmap v491: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:07 smithi110 ceph-mon[82130]: pgmap v492: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:08.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:07 smithi060 ceph-mon[94333]: pgmap v492: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:09 smithi110 ceph-mon[82130]: pgmap v493: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:10.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:09 smithi060 ceph-mon[94333]: pgmap v493: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:11 smithi110 ceph-mon[82130]: pgmap v494: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:12.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:11 smithi060 ceph-mon[94333]: pgmap v494: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:13 smithi110 ceph-mon[82130]: pgmap v495: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:14.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:13 smithi060 ceph-mon[94333]: pgmap v495: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:14.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:16.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:15 smithi060 ceph-mon[94333]: pgmap v496: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:16.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:15 smithi110 ceph-mon[82130]: pgmap v496: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:18.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:17 smithi060 ceph-mon[94333]: pgmap v497: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:18.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:17 smithi110 ceph-mon[82130]: pgmap v497: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:20.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:19 smithi060 ceph-mon[94333]: pgmap v498: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:20.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:19 smithi110 ceph-mon[82130]: pgmap v498: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:22.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:21 smithi060 ceph-mon[94333]: pgmap v499: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:22.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:21 smithi110 ceph-mon[82130]: pgmap v499: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:24.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:24 smithi060 ceph-mon[94333]: pgmap v500: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:24.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:24 smithi110 ceph-mon[82130]: pgmap v500: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:26.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:26 smithi060 ceph-mon[94333]: pgmap v501: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:26.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:26 smithi110 ceph-mon[82130]: pgmap v501: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:28.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:28 smithi060 ceph-mon[94333]: pgmap v502: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:28.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:28 smithi110 ceph-mon[82130]: pgmap v502: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:29.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:29 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:29 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:30 smithi060 ceph-mon[94333]: pgmap v503: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:30 smithi110 ceph-mon[82130]: pgmap v503: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:32.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:32 smithi060 ceph-mon[94333]: pgmap v504: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:32 smithi110 ceph-mon[82130]: pgmap v504: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:34.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:34 smithi060 ceph-mon[94333]: pgmap v505: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:34.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:34 smithi110 ceph-mon[82130]: pgmap v505: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:36.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:36 smithi060 ceph-mon[94333]: pgmap v506: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:36.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:36 smithi110 ceph-mon[82130]: pgmap v506: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:38.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:38 smithi060 ceph-mon[94333]: pgmap v507: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:38 smithi110 ceph-mon[82130]: pgmap v507: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:40.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:40 smithi060 ceph-mon[94333]: pgmap v508: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:40.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:40 smithi110 ceph-mon[82130]: pgmap v508: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:41.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:41 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:59:41.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:41 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T13:59:42.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:42 smithi060 ceph-mon[94333]: pgmap v509: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:42.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:42 smithi110 ceph-mon[82130]: pgmap v509: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:59:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:59:43.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:59:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T13:59:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T13:59:43.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T13:59:44.380 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:44 smithi110 ceph-mon[82130]: pgmap v510: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:44.380 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:44 smithi060 ceph-mon[94333]: pgmap v510: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:46.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:46 smithi060 ceph-mon[94333]: pgmap v511: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:46.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:46 smithi110 ceph-mon[82130]: pgmap v511: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:47.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:47 smithi060 ceph-mon[94333]: pgmap v512: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:47.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:47 smithi110 ceph-mon[82130]: pgmap v512: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:50.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:49 smithi060 ceph-mon[94333]: pgmap v513: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:50.229 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:49 smithi110 ceph-mon[82130]: pgmap v513: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:52.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:51 smithi060 ceph-mon[94333]: pgmap v514: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:52.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:51 smithi110 ceph-mon[82130]: pgmap v514: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:54.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:53 smithi060 ceph-mon[94333]: pgmap v515: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:54.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:53 smithi110 ceph-mon[82130]: pgmap v515: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:56.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:55 smithi060 ceph-mon[94333]: pgmap v516: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:56.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:55 smithi110 ceph-mon[82130]: pgmap v516: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:58.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:57 smithi060 ceph-mon[94333]: pgmap v517: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:58.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:57 smithi110 ceph-mon[82130]: pgmap v517: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T13:59:59.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:58 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T13:59:59.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:58 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:00.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 13:59:59 smithi060 ceph-mon[94333]: pgmap v518: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:00.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 13:59:59 smithi110 ceph-mon[82130]: pgmap v518: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:01.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:00 smithi060 ceph-mon[94333]: overall HEALTH_OK 2024-04-12T14:00:01.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:00 smithi110 ceph-mon[82130]: overall HEALTH_OK 2024-04-12T14:00:02.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:01 smithi060 ceph-mon[94333]: pgmap v519: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:02.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:01 smithi110 ceph-mon[82130]: pgmap v519: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:03 smithi060 ceph-mon[94333]: pgmap v520: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:04.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:03 smithi110 ceph-mon[82130]: pgmap v520: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:06.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:05 smithi060 ceph-mon[94333]: pgmap v521: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:06.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:05 smithi110 ceph-mon[82130]: pgmap v521: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:08.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:07 smithi060 ceph-mon[94333]: pgmap v522: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:07 smithi110 ceph-mon[82130]: pgmap v522: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:10.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:09 smithi060 ceph-mon[94333]: pgmap v523: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:10.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:09 smithi110 ceph-mon[82130]: pgmap v523: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:11 smithi060 ceph-mon[94333]: pgmap v524: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:12.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:11 smithi110 ceph-mon[82130]: pgmap v524: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:13 smithi060 ceph-mon[94333]: pgmap v525: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:13 smithi110 ceph-mon[82130]: pgmap v525: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:16.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:15 smithi110 ceph-mon[82130]: pgmap v526: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:16.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:15 smithi060 ceph-mon[94333]: pgmap v526: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:18.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:17 smithi110 ceph-mon[82130]: pgmap v527: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:18.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:17 smithi060 ceph-mon[94333]: pgmap v527: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:20.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:19 smithi110 ceph-mon[82130]: pgmap v528: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:20.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:19 smithi060 ceph-mon[94333]: pgmap v528: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:22.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:21 smithi110 ceph-mon[82130]: pgmap v529: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:22.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:21 smithi060 ceph-mon[94333]: pgmap v529: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:24.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:23 smithi110 ceph-mon[82130]: pgmap v530: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:24.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:23 smithi060 ceph-mon[94333]: pgmap v530: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:26.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:25 smithi110 ceph-mon[82130]: pgmap v531: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:26.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:25 smithi060 ceph-mon[94333]: pgmap v531: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:28.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:27 smithi110 ceph-mon[82130]: pgmap v532: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:28.232 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:27 smithi060 ceph-mon[94333]: pgmap v532: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:29.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:29.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:30.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:29 smithi060 ceph-mon[94333]: pgmap v533: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:30.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:29 smithi110 ceph-mon[82130]: pgmap v533: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:32.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:31 smithi060 ceph-mon[94333]: pgmap v534: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:32.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:31 smithi110 ceph-mon[82130]: pgmap v534: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:34.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:33 smithi060 ceph-mon[94333]: pgmap v535: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:34.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:33 smithi110 ceph-mon[82130]: pgmap v535: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:36.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:36 smithi060 ceph-mon[94333]: pgmap v536: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:36.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:36 smithi110 ceph-mon[82130]: pgmap v536: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:38.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:38 smithi060 ceph-mon[94333]: pgmap v537: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:38.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:38 smithi110 ceph-mon[82130]: pgmap v537: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:40.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:40 smithi060 ceph-mon[94333]: pgmap v538: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:40.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:40 smithi110 ceph-mon[82130]: pgmap v538: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:42.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:42 smithi060 ceph-mon[94333]: pgmap v539: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:42.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:42 smithi110 ceph-mon[82130]: pgmap v539: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:43.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T14:00:43.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T14:00:44.379 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:44 smithi110 ceph-mon[82130]: pgmap v540: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:44.379 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:44 smithi060 ceph-mon[94333]: pgmap v540: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T14:00:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T14:00:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:45 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T14:00:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T14:00:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T14:00:45.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:45 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' 2024-04-12T14:00:46.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:46 smithi060 ceph-mon[94333]: pgmap v541: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:46.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:46 smithi110 ceph-mon[82130]: pgmap v541: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:48.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:48 smithi060 ceph-mon[94333]: pgmap v542: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:48.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:48 smithi110 ceph-mon[82130]: pgmap v542: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:50.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:50 smithi060 ceph-mon[94333]: pgmap v543: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:50.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:50 smithi110 ceph-mon[82130]: pgmap v543: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:52.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:52 smithi060 ceph-mon[94333]: pgmap v544: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:52.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:52 smithi110 ceph-mon[82130]: pgmap v544: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:54.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:54 smithi060 ceph-mon[94333]: pgmap v545: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:54.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:54 smithi110 ceph-mon[82130]: pgmap v545: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:56.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:56 smithi060 ceph-mon[94333]: pgmap v546: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:56.478 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:56 smithi110 ceph-mon[82130]: pgmap v546: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:58.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:58 smithi060 ceph-mon[94333]: pgmap v547: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:58.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:58 smithi110 ceph-mon[82130]: pgmap v547: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:00:59.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:00:59 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:00:59.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:00:59 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:00.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:00 smithi060 ceph-mon[94333]: pgmap v548: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:00.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:00 smithi110 ceph-mon[82130]: pgmap v548: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:01.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:01 smithi060 ceph-mon[94333]: pgmap v549: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:01.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:01 smithi110 ceph-mon[82130]: pgmap v549: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:04.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:03 smithi060 ceph-mon[94333]: pgmap v550: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:04.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:03 smithi110 ceph-mon[82130]: pgmap v550: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:06.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:05 smithi060 ceph-mon[94333]: pgmap v551: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:06.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:05 smithi110 ceph-mon[82130]: pgmap v551: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:08.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:07 smithi060 ceph-mon[94333]: pgmap v552: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:08.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:07 smithi110 ceph-mon[82130]: pgmap v552: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:10.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:09 smithi060 ceph-mon[94333]: pgmap v553: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:10.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:09 smithi110 ceph-mon[82130]: pgmap v553: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:12.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:11 smithi060 ceph-mon[94333]: pgmap v554: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:12.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:11 smithi110 ceph-mon[82130]: pgmap v554: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:13 smithi060 ceph-mon[94333]: pgmap v555: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:14.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:13 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:14.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:13 smithi110 ceph-mon[82130]: pgmap v555: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:14.228 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:13 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:16.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:15 smithi060 ceph-mon[94333]: pgmap v556: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:16.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:15 smithi110 ceph-mon[82130]: pgmap v556: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:18.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:17 smithi060 ceph-mon[94333]: pgmap v557: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:18.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:17 smithi110 ceph-mon[82130]: pgmap v557: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:20.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:19 smithi060 ceph-mon[94333]: pgmap v558: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:20.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:19 smithi110 ceph-mon[82130]: pgmap v558: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:22.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:21 smithi060 ceph-mon[94333]: pgmap v559: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:22.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:21 smithi110 ceph-mon[82130]: pgmap v559: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:24.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:23 smithi060 ceph-mon[94333]: pgmap v560: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:24.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:23 smithi110 ceph-mon[82130]: pgmap v560: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:26.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:25 smithi060 ceph-mon[94333]: pgmap v561: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:26.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:25 smithi110 ceph-mon[82130]: pgmap v561: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:28.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:27 smithi060 ceph-mon[94333]: pgmap v562: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:28.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:27 smithi110 ceph-mon[82130]: pgmap v562: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:29.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:28 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:29.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:28 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:30.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:29 smithi060 ceph-mon[94333]: pgmap v563: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:30.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:29 smithi110 ceph-mon[82130]: pgmap v563: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:32.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:31 smithi060 ceph-mon[94333]: pgmap v564: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:32.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:31 smithi110 ceph-mon[82130]: pgmap v564: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:34.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:33 smithi060 ceph-mon[94333]: pgmap v565: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:34.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:33 smithi110 ceph-mon[82130]: pgmap v565: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:36.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:35 smithi060 ceph-mon[94333]: pgmap v566: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:36.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:35 smithi110 ceph-mon[82130]: pgmap v566: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:38.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:37 smithi060 ceph-mon[94333]: pgmap v567: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:38.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:37 smithi110 ceph-mon[82130]: pgmap v567: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:40.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:39 smithi060 ceph-mon[94333]: pgmap v568: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:40.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:39 smithi110 ceph-mon[82130]: pgmap v568: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:42.179 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:41 smithi060 ceph-mon[94333]: pgmap v569: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:42.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:41 smithi110 ceph-mon[82130]: pgmap v569: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:44.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:43 smithi110 ceph-mon[82130]: pgmap v570: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:44.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:43 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:44.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:43 smithi060 ceph-mon[94333]: pgmap v570: 65 pgs: 65 active+clean; 203 MiB data, 821 MiB used, 536 GiB / 536 GiB avail 2024-04-12T14:01:44.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:43 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T14:01:44.607 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-12T14:01:44.607 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T14:01:44.609 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-12T14:01:44.621 INFO:tasks.cephadm:Teardown begin 2024-04-12T14:01:44.622 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T14:01:44.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T14:01:44.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T14:01:44.821 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-12T14:01:44.822 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-12T14:01:44.875 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-12T14:01:44.925 INFO:tasks.cephadm:Stopping all daemons... 2024-04-12T14:01:44.926 INFO:tasks.cephadm.mon.smithi060:Stopping mon.smithi060... 2024-04-12T14:01:44.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060 2024-04-12T14:01:45.008 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:44 smithi060 ceph-mon[94333]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T14:01:45.227 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:44 smithi110 ceph-mon[82130]: from='mgr.34102 172.21.15.60:0/185538428' entity='mgr.smithi060.bpzacg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T14:01:45.429 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:45 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:01:45.929 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T14:01:45.466+0000 7f4ae2a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:01:45.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:45 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060[94282]: 2024-04-12T14:01:45.466+0000 7f4ae2a00700 -1 mon.smithi060@0(leader) e3 *** Got Signal Terminated *** 2024-04-12T14:01:45.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:45 smithi060 podman[150667]: 2024-04-12 14:01:45.509022659 +0000 UTC m=+0.219653658 container died d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, ceph=True, RELEASE=main-a971fd5) 2024-04-12T14:01:46.413 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:46 smithi060 podman[150667]: 2024-04-12 14:01:46.201863103 +0000 UTC m=+0.912494145 container cleanup d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-12T14:01:46.413 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:46 smithi060 bash[150667]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060 2024-04-12T14:01:46.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Apr 12 14:01:46 smithi060 podman[150733]: 2024-04-12 14:01:46.411749423 +0000 UTC m=+0.887140367 container remove d8408587103dd36e6c01703d32e2650d738caec928ce765c901705ad1414abb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi060, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-12T14:01:46.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi060.service' 2024-04-12T14:01:47.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:01:47.047 INFO:tasks.cephadm.mon.smithi060:Stopped mon.smithi060 2024-04-12T14:01:47.047 INFO:tasks.cephadm.mon.smithi110:Stopping mon.smithi110... 2024-04-12T14:01:47.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi110 2024-04-12T14:01:47.477 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:47 smithi110 systemd[1]: Stopping Ceph mon.smithi110 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:01:47.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:47 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110[82126]: 2024-04-12T14:01:47.596+0000 7fb3bf600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi110 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:01:47.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:47 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110[82126]: 2024-04-12T14:01:47.596+0000 7fb3bf600700 -1 mon.smithi110@1(peon) e3 *** Got Signal Terminated *** 2024-04-12T14:01:47.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:47 smithi110 podman[118965]: 2024-04-12 14:01:47.741677875 +0000 UTC m=+0.298684486 container died ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:01:48.643 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:48 smithi110 podman[118965]: 2024-04-12 14:01:48.37329007 +0000 UTC m=+0.930296671 container cleanup ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T14:01:48.643 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:48 smithi110 bash[118965]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110 2024-04-12T14:01:48.977 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Apr 12 14:01:48 smithi110 podman[118979]: 2024-04-12 14:01:48.641730222 +0000 UTC m=+0.877863185 container remove ff4fbde68ed930e5b917b902cc9f9967ddd5c21a72db0f947dd8f0166e8161f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-mon-smithi110, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, io.buildah.version=1.33.5, ceph=True) 2024-04-12T14:01:49.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@mon.smithi110.service' 2024-04-12T14:01:49.319 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:01:49.319 INFO:tasks.cephadm.mon.smithi110:Stopped mon.smithi110 2024-04-12T14:01:49.319 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-12T14:01:49.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.0 2024-04-12T14:01:49.679 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:49 smithi060 systemd[1]: Stopping Ceph osd.0 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:01:50.429 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:49 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T14:01:49.955+0000 7fe3bf000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:01:50.429 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:49 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T14:01:49.955+0000 7fe3bf000700 -1 osd.0 101 *** Got signal Terminated *** 2024-04-12T14:01:50.429 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:49 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0[103073]: 2024-04-12T14:01:49.955+0000 7fe3bf000700 -1 osd.0 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:01:55.679 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:55 smithi060 podman[150881]: 2024-04-12 14:01:55.413860876 +0000 UTC m=+5.613272659 container died ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, ceph=True) 2024-04-12T14:01:56.179 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:56 smithi060 podman[150881]: 2024-04-12 14:01:56.0318794 +0000 UTC m=+6.231291176 container cleanup ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:01:56.179 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:56 smithi060 bash[150881]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0 2024-04-12T14:01:56.679 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:56 smithi060 podman[150899]: 2024-04-12 14:01:56.283492681 +0000 UTC m=+0.854019846 container remove ce149293c20bb9fcf41a7b3980c8e1a99a7ffdf82b3ed4570e57f7961cb9a6e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-12T14:01:57.430 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:57 smithi060 podman[150994]: 2024-04-12 14:01:57.062880651 +0000 UTC m=+0.041177826 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:01:57.431 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:57 smithi060 podman[150994]: 2024-04-12 14:01:57.176165218 +0000 UTC m=+0.154462424 container create 30f69a5a67a85dad7529da733137b9bb754c4ad92deb7a19c39e586dfba6bfba (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-04-12T14:01:57.929 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:57 smithi060 podman[150994]: 2024-04-12 14:01:57.58969081 +0000 UTC m=+0.567988089 container init 30f69a5a67a85dad7529da733137b9bb754c4ad92deb7a19c39e586dfba6bfba (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-12T14:01:57.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:57 smithi060 podman[150994]: 2024-04-12 14:01:57.598682202 +0000 UTC m=+0.576979415 container start 30f69a5a67a85dad7529da733137b9bb754c4ad92deb7a19c39e586dfba6bfba (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-12T14:01:57.930 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:57 smithi060 podman[150994]: 2024-04-12 14:01:57.670583681 +0000 UTC m=+0.648880927 container attach 30f69a5a67a85dad7529da733137b9bb754c4ad92deb7a19c39e586dfba6bfba (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-12T14:01:58.364 INFO:journalctl@ceph.osd.0.smithi060.stdout:Apr 12 14:01:58 smithi060 podman[150994]: 2024-04-12 14:01:58.064611493 +0000 UTC m=+1.042908694 container died 30f69a5a67a85dad7529da733137b9bb754c4ad92deb7a19c39e586dfba6bfba (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, ceph=True) 2024-04-12T14:01:58.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.0.service' 2024-04-12T14:01:59.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:01:59.096 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-12T14:01:59.097 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-12T14:01:59.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.1 2024-04-12T14:01:59.679 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:01:59 smithi060 systemd[1]: Stopping Ceph osd.1 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:02:00.179 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:01:59 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T14:01:59.728+0000 7f06f0000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:02:00.179 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:01:59 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T14:01:59.728+0000 7f06f0000700 -1 osd.1 101 *** Got signal Terminated *** 2024-04-12T14:02:00.179 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:01:59 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1[108783]: 2024-04-12T14:01:59.728+0000 7f06f0000700 -1 osd.1 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:02:05.529 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:05 smithi060 podman[151099]: 2024-04-12 14:02:05.2412709 +0000 UTC m=+5.665091906 container died 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, RELEASE=main-a971fd5, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-04-12T14:02:06.064 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:05 smithi060 podman[151099]: 2024-04-12 14:02:05.812045887 +0000 UTC m=+6.235866913 container cleanup 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-12T14:02:06.065 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:05 smithi060 bash[151099]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1 2024-04-12T14:02:06.429 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:06 smithi060 podman[151130]: 2024-04-12 14:02:06.063867176 +0000 UTC m=+0.800724429 container remove 406defa859c019ff1e47bba313034f4cc0ad1b3fd2d200546e0bbe91869bfdd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:02:07.261 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:06 smithi060 podman[151219]: 2024-04-12 14:02:06.865404743 +0000 UTC m=+0.036933055 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:02:07.262 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:06 smithi060 podman[151219]: 2024-04-12 14:02:06.964851551 +0000 UTC m=+0.136379900 container create 5f181133f098f530714d8a6836510e4eff96b9dcbd22c780b15aa9dbdb3ca9d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-04-12T14:02:07.262 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:07 smithi060 podman[151219]: 2024-04-12 14:02:07.260719749 +0000 UTC m=+0.432248121 container init 5f181133f098f530714d8a6836510e4eff96b9dcbd22c780b15aa9dbdb3ca9d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-12T14:02:07.678 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:07 smithi060 podman[151219]: 2024-04-12 14:02:07.274035874 +0000 UTC m=+0.445564246 container start 5f181133f098f530714d8a6836510e4eff96b9dcbd22c780b15aa9dbdb3ca9d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-12T14:02:07.679 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:07 smithi060 podman[151219]: 2024-04-12 14:02:07.375833209 +0000 UTC m=+0.547361638 container attach 5f181133f098f530714d8a6836510e4eff96b9dcbd22c780b15aa9dbdb3ca9d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T14:02:08.127 INFO:journalctl@ceph.osd.1.smithi060.stdout:Apr 12 14:02:07 smithi060 podman[151219]: 2024-04-12 14:02:07.734700698 +0000 UTC m=+0.906229053 container died 5f181133f098f530714d8a6836510e4eff96b9dcbd22c780b15aa9dbdb3ca9d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2) 2024-04-12T14:02:08.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.1.service' 2024-04-12T14:02:08.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:02:08.705 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-12T14:02:08.705 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-12T14:02:08.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2 2024-04-12T14:02:09.179 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:08 smithi060 systemd[1]: Stopping Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:02:09.679 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:09 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T14:02:09.332+0000 7ff54f200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:02:09.679 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:09 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T14:02:09.332+0000 7ff54f200700 -1 osd.2 101 *** Got signal Terminated *** 2024-04-12T14:02:09.679 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:09 smithi060 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2[114345]: 2024-04-12T14:02:09.332+0000 7ff54f200700 -1 osd.2 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:02:15.179 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:14 smithi060 podman[151327]: 2024-04-12 14:02:14.921375563 +0000 UTC m=+5.737911476 container died ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=) 2024-04-12T14:02:15.679 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:15 smithi060 podman[151327]: 2024-04-12 14:02:15.341649866 +0000 UTC m=+6.158185839 container cleanup ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-12T14:02:15.679 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:15 smithi060 bash[151327]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2 2024-04-12T14:02:16.179 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:15 smithi060 podman[151346]: 2024-04-12 14:02:15.709278596 +0000 UTC m=+0.783303064 container remove ebee837f2e3a6b07612c2ff932e076125423acc9d9f389063943cfd4b81852ce (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-12T14:02:16.929 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:16 smithi060 podman[151437]: 2024-04-12 14:02:16.549330538 +0000 UTC m=+0.037124465 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:02:16.929 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:16 smithi060 podman[151437]: 2024-04-12 14:02:16.68348808 +0000 UTC m=+0.171282026 container create 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, ceph=True, org.label-schema.vendor=CentOS) 2024-04-12T14:02:17.228 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:17 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:17.126+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:17.228 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:16 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:16.928+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:17.429 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:16 smithi060 podman[151437]: 2024-04-12 14:02:16.982852327 +0000 UTC m=+0.470646316 container init 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5) 2024-04-12T14:02:17.429 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:16 smithi060 podman[151437]: 2024-04-12 14:02:16.995423865 +0000 UTC m=+0.483217781 container start 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2) 2024-04-12T14:02:17.429 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:17 smithi060 podman[151437]: 2024-04-12 14:02:17.104833485 +0000 UTC m=+0.592627474 container attach 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-12T14:02:17.814 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:17 smithi060 podman[151437]: 2024-04-12 14:02:17.462051828 +0000 UTC m=+0.949845817 container died 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5) 2024-04-12T14:02:18.160 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:17 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:17.895+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:18.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service' 2024-04-12T14:02:18.458 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:18 smithi060 podman[151462]: 2024-04-12 14:02:18.316706789 +0000 UTC m=+0.833898400 container remove 0c5b8e6106175c9c8efda1edaaa5516fe46f1166a3304e4abe32b007686d3fd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True) 2024-04-12T14:02:18.459 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:18 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-12T14:02:18.459 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:18 smithi060 systemd[1]: Stopped Ceph osd.2 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968. 2024-04-12T14:02:18.459 INFO:journalctl@ceph.osd.2.smithi060.stdout:Apr 12 14:02:18 smithi060 systemd[1]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.2.service: Consumed 27.988s CPU time. 2024-04-12T14:02:18.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:18 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:18.159+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:18.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:02:18.501 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-12T14:02:18.501 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-12T14:02:18.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.3 2024-04-12T14:02:18.861 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:18 smithi110 systemd[1]: Stopping Ceph osd.3 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:02:19.146 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:18 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:18.858+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:19.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:19 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:19.167+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:19.478 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:19 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:19.144+0000 7efc6d800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:02:19.478 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:19 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:19.144+0000 7efc6d800700 -1 osd.3 101 *** Got signal Terminated *** 2024-04-12T14:02:19.478 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:19 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:19.144+0000 7efc6d800700 -1 osd.3 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:02:20.157 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:19 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:19.827+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:20.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:20 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:20.156+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:20.837 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:20 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:20.492+0000 7efc64000700 -1 osd.3 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:54.874131+0000 front 2024-04-12T14:01:54.874185+0000 (oldest deadline 2024-04-12T14:02:19.573934+0000) 2024-04-12T14:02:21.199 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:20 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:20.836+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:21.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:21 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:21.198+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:21.817 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:21 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:21.524+0000 7efc64000700 -1 osd.3 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:54.874131+0000 front 2024-04-12T14:01:54.874185+0000 (oldest deadline 2024-04-12T14:02:19.573934+0000) 2024-04-12T14:02:22.183 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:21 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:21.816+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:22.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:22 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:22.182+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:22.977 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:22 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:22.573+0000 7efc64000700 -1 osd.3 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:54.874131+0000 front 2024-04-12T14:01:54.874185+0000 (oldest deadline 2024-04-12T14:02:19.573934+0000) 2024-04-12T14:02:22.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:22 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:22.778+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:23.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:23 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:23.168+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:23.977 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:23 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3[91665]: 2024-04-12T14:02:23.532+0000 7efc64000700 -1 osd.3 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:54.874131+0000 front 2024-04-12T14:01:54.874185+0000 (oldest deadline 2024-04-12T14:02:19.573934+0000) 2024-04-12T14:02:23.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:23 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:23.755+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:24.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:24 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:24.166+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:24.977 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:24 smithi110 podman[119100]: 2024-04-12 14:02:24.665884181 +0000 UTC m=+5.723267456 container died eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240403, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-12T14:02:24.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:24 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:24.710+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:25.353 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:25 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:25.194+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:25.354 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:25 smithi110 podman[119100]: 2024-04-12 14:02:25.110018325 +0000 UTC m=+6.167401637 container cleanup eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:02:25.354 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:25 smithi110 bash[119100]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3 2024-04-12T14:02:25.709 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:25 smithi110 podman[119119]: 2024-04-12 14:02:25.352901049 +0000 UTC m=+0.677689875 container remove eba67478cde9455d8839998ac968216365316583c62b55625c2c12becf6d1049 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-a971fd5, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-12T14:02:25.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:25 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:25.706+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:26.386 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:26 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:26.184+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:26.387 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.042699499 +0000 UTC m=+0.035755665 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:02:26.387 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.187677618 +0000 UTC m=+0.180733821 container create 870a76bb519615c00fc6263f8941a1d45bc80e56fa3f4c8b4bcf4a7fe76bdb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-a971fd5, GIT_CLEAN=True) 2024-04-12T14:02:26.687 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.516200018 +0000 UTC m=+0.509256234 container init 870a76bb519615c00fc6263f8941a1d45bc80e56fa3f4c8b4bcf4a7fe76bdb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-12T14:02:26.687 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.530016181 +0000 UTC m=+0.523072374 container start 870a76bb519615c00fc6263f8941a1d45bc80e56fa3f4c8b4bcf4a7fe76bdb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS) 2024-04-12T14:02:26.969 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.803956438 +0000 UTC m=+0.797012598 container attach 870a76bb519615c00fc6263f8941a1d45bc80e56fa3f4c8b4bcf4a7fe76bdb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=main-a971fd5) 2024-04-12T14:02:26.969 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:26 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:26.685+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:27.224 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 12 14:02:26 smithi110 podman[119207]: 2024-04-12 14:02:26.969885287 +0000 UTC m=+0.962941472 container died 870a76bb519615c00fc6263f8941a1d45bc80e56fa3f4c8b4bcf4a7fe76bdb41 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-a971fd5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2) 2024-04-12T14:02:27.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:27 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:27.222+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:27.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:27 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:27.222+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:27.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.3.service' 2024-04-12T14:02:27.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:02:27.922 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-12T14:02:27.922 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-12T14:02:27.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.4 2024-04-12T14:02:27.973 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:27 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:27.702+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:28.227 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 systemd[1]: Stopping Ceph osd.4 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:02:28.227 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:28.219+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:28.228 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:28.219+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:28.727 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:28.445+0000 7fef67200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:02:28.727 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:28.445+0000 7fef67200700 -1 osd.4 101 *** Got signal Terminated *** 2024-04-12T14:02:28.727 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:28.445+0000 7fef67200700 -1 osd.4 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:02:28.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:28.684+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:28.728 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:28 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:28.684+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:29.657 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:29 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:29.239+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:29.658 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:29 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:29.239+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:29.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:29 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:29.656+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:29.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:29 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:29.656+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:30.678 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:30 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:30.226+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:30.678 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:30 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:30.226+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:30.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:30 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:30.676+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:30.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:30 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:30.676+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:31.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:31.199+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:31.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:31.199+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:31.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:31.721+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:31.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:31 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:31.721+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:32.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:32 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:32.209+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:32.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:32 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:32.209+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:32.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:32 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:32.721+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:32.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:32 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:32.721+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:33.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:33 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:33.189+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:51.148785+0000 front 2024-04-12T14:01:51.148719+0000 (oldest deadline 2024-04-12T14:02:16.448108+0000) 2024-04-12T14:02:33.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:33 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4[96937]: 2024-04-12T14:02:33.189+0000 7fef62a00700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:00.549516+0000 front 2024-04-12T14:02:00.549849+0000 (oldest deadline 2024-04-12T14:02:26.449407+0000) 2024-04-12T14:02:34.119 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:33 smithi110 podman[119324]: 2024-04-12 14:02:33.822249275 +0000 UTC m=+5.526562740 container died 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-12T14:02:34.119 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:33 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:33.745+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:34.119 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:33 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:33.745+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:34.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:34 smithi110 podman[119324]: 2024-04-12 14:02:34.238884938 +0000 UTC m=+5.943198419 container cleanup 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, org.label-schema.build-date=20240403, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-12T14:02:34.477 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:34 smithi110 bash[119324]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4 2024-04-12T14:02:34.977 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:34 smithi110 podman[119343]: 2024-04-12 14:02:34.514723358 +0000 UTC m=+0.672030559 container remove 033af6691a0b89418db9d56ffd93055d76a3f48c6554d96f2e30b2f470cc7f84 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240403) 2024-04-12T14:02:34.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:34 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:34.758+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:34.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:34 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:34.758+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:35.622 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:35 smithi110 podman[119426]: 2024-04-12 14:02:35.255727758 +0000 UTC m=+0.035794198 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:02:35.622 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:35 smithi110 podman[119426]: 2024-04-12 14:02:35.365766434 +0000 UTC m=+0.145832899 container create c1e0374002e4e971bffc32287cc108099d6919051d8e519d07939ae268358e00 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240403, GIT_BRANCH=HEAD) 2024-04-12T14:02:35.622 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:35 smithi110 podman[119426]: 2024-04-12 14:02:35.619684181 +0000 UTC m=+0.399750656 container init c1e0374002e4e971bffc32287cc108099d6919051d8e519d07939ae268358e00 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-12T14:02:35.977 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:35 smithi110 podman[119426]: 2024-04-12 14:02:35.632036279 +0000 UTC m=+0.412102727 container start c1e0374002e4e971bffc32287cc108099d6919051d8e519d07939ae268358e00 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T14:02:35.977 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:35 smithi110 podman[119426]: 2024-04-12 14:02:35.718158942 +0000 UTC m=+0.498225461 container attach c1e0374002e4e971bffc32287cc108099d6919051d8e519d07939ae268358e00 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-12T14:02:35.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:35 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:35.714+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:35.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:35 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:35.714+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:35.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:35 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:35.714+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:36.373 INFO:journalctl@ceph.osd.4.smithi110.stdout:Apr 12 14:02:36 smithi110 podman[119426]: 2024-04-12 14:02:36.076863106 +0000 UTC m=+0.856929605 container died c1e0374002e4e971bffc32287cc108099d6919051d8e519d07939ae268358e00 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, org.label-schema.build-date=20240403, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T14:02:36.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.4.service' 2024-04-12T14:02:36.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:02:36.863 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-12T14:02:36.863 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-12T14:02:36.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.5 2024-04-12T14:02:36.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:36 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:36.668+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:36.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:36 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:36.668+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:36.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:36 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:36.668+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:37.402 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 systemd[1]: Stopping Ceph osd.5 for 7ed74db6-f8d0-11ee-bc8c-c7b262605968... 2024-04-12T14:02:37.663 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.488+0000 7f3c01e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T14:02:37.663 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.488+0000 7f3c01e00700 -1 osd.5 101 *** Got signal Terminated *** 2024-04-12T14:02:37.663 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.488+0000 7f3c01e00700 -1 osd.5 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T14:02:37.664 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.661+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:37.664 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.661+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:37.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:37 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:37.661+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:38.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:38 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:38.658+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:38.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:38 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:38.658+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:38.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:38 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:38.658+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:39.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:39 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:39.636+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:39.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:39 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:39.636+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:39.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:39 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:39.636+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:40.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:40 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:40.656+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:40.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:40 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:40.656+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:40.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:40 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:40.656+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:41.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:41.651+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-04-12T14:01:50.527004+0000 front 2024-04-12T14:01:50.526949+0000 (oldest deadline 2024-04-12T14:02:16.426577+0000) 2024-04-12T14:02:41.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:41.651+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-04-12T14:02:02.229419+0000 front 2024-04-12T14:02:02.228971+0000 (oldest deadline 2024-04-12T14:02:28.128732+0000) 2024-04-12T14:02:41.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:41 smithi110 ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5[101775]: 2024-04-12T14:02:41.651+0000 7f3bfd600700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-04-12T14:02:09.730997+0000 front 2024-04-12T14:02:09.730953+0000 (oldest deadline 2024-04-12T14:02:34.931031+0000) 2024-04-12T14:02:43.206 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:42 smithi110 podman[119531]: 2024-04-12 14:02:42.931006324 +0000 UTC m=+5.584811986 container died 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240403, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-a971fd5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T14:02:43.477 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:43 smithi110 podman[119531]: 2024-04-12 14:02:43.341018893 +0000 UTC m=+5.994824622 container cleanup 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240403) 2024-04-12T14:02:43.477 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:43 smithi110 bash[119531]: ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5 2024-04-12T14:02:43.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:43 smithi110 podman[119551]: 2024-04-12 14:02:43.583882682 +0000 UTC m=+0.641473597 container remove 0bece313e853d6a78e1f4089e32af468d81ea731a41fece6f05ee6b4e079f220 (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux ) 2024-04-12T14:02:44.697 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:44 smithi110 podman[119639]: 2024-04-12 14:02:44.3236358 +0000 UTC m=+0.038232625 image pull b96c509eef841460b3271f5fdd331860da87b004524f4ed59414aa3680183b53 quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608 2024-04-12T14:02:44.697 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:44 smithi110 podman[119639]: 2024-04-12 14:02:44.426281407 +0000 UTC m=+0.140878250 container create 3c798f838412cdb9cb8d78f4eaf849352dc0712ec8c8ed82527d2da7079beb1e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, RELEASE=main-a971fd5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-12T14:02:44.697 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:44 smithi110 podman[119639]: 2024-04-12 14:02:44.696487516 +0000 UTC m=+0.411084337 container init 3c798f838412cdb9cb8d78f4eaf849352dc0712ec8c8ed82527d2da7079beb1e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-a971fd5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240403, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:02:44.977 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:44 smithi110 podman[119639]: 2024-04-12 14:02:44.707822708 +0000 UTC m=+0.422419551 container start 3c798f838412cdb9cb8d78f4eaf849352dc0712ec8c8ed82527d2da7079beb1e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, RELEASE=main-a971fd5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T14:02:44.978 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:44 smithi110 podman[119639]: 2024-04-12 14:02:44.795704284 +0000 UTC m=+0.510301154 container attach 3c798f838412cdb9cb8d78f4eaf849352dc0712ec8c8ed82527d2da7079beb1e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=main-a971fd5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240403, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-04-12T14:02:45.477 INFO:journalctl@ceph.osd.5.smithi110.stdout:Apr 12 14:02:45 smithi110 podman[119639]: 2024-04-12 14:02:45.151009451 +0000 UTC m=+0.865606307 container died 3c798f838412cdb9cb8d78f4eaf849352dc0712ec8c8ed82527d2da7079beb1e (image=quay.ceph.io/ceph-ci/ceph@sha256:02f0a191d4d693952654c64f93cc9c0152602c0915251b3c94c2c4e32855c608, name=ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-a971fd5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240403, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T14:02:45.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ed74db6-f8d0-11ee-bc8c-c7b262605968@osd.5.service' 2024-04-12T14:02:46.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T14:02:46.045 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-12T14:02:46.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 --force --keep-logs 2024-04-12T14:02:51.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stdout:ceph_fuse: fuse loop returned - joining 2024-04-12T14:02:51.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stdout:ceph_fuse: fuse loop returned - joined 2024-04-12T14:02:51.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:2024-04-12T14:02:51.768+0000 7fd910abf300 -1 fuse_session_loop_mt 3 -- done 2024-04-12T14:02:51.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[76337]: fuse finished with error 0 and tester_r 0 2024-04-12T14:02:51.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stdout:calling unmount 2024-04-12T14:03:14.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 --force --keep-logs 2024-04-12T14:03:21.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stdout:calling finalize 2024-04-12T14:03:34.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T14:03:34.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T14:03:34.705 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-12T14:03:34.707 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi060/crash 2024-04-12T14:03:34.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash -- . 2024-04-12T14:03:34.810 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash: Cannot open: No such file or directory 2024-04-12T14:03:34.811 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-04-12T14:03:34.816 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi110/crash 2024-04-12T14:03:34.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash -- . 2024-04-12T14:03:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/crash: Cannot open: No such file or directory 2024-04-12T14:03:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2024-04-12T14:03:34.920 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-12T14:03:34.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-12T14:03:35.043 INFO:teuthology.orchestra.run.smithi060.stdout:1712929416.4804251 mon.smithi060 (mon.0) 953 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T14:03:35.044 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-12T14:03:35.044 INFO:tasks.cephadm:Compressing logs... 2024-04-12T14:03:35.045 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T14:03:35.049 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T14:03:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-12T14:03:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-12T14:03:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-12T14:03:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log 2024-04-12T14:03:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi060.log 2024-04-12T14:03:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.1.log 2024-04-12T14:03:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi060.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi060.bpzacg.log 2024-04-12T14:03:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.mwwohl.log 2024-04-12T14:03:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi060.bpzacg.log: 91.1% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log.gz 2024-04-12T14:03:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.mwwohl.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.epmcph.log 2024-04-12T14:03:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.epmcph.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.0.log 2024-04-12T14:03:35.128 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log 2024-04-12T14:03:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log 2024-04-12T14:03:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log.gz 2024-04-12T14:03:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.2.log 2024-04-12T14:03:35.142 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-12T14:03:35.142 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-12T14:03:35.143 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.getdvx.log 2024-04-12T14:03:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi110.log 2024-04-12T14:03:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log 2024-04-12T14:03:35.146 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.getdvx.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log 2024-04-12T14:03:35.147 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi110.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.4.log 2024-04-12T14:03:35.148 INFO:teuthology.orchestra.run.smithi110.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-12T14:03:35.149 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi110.ezwdax.log 2024-04-12T14:03:35.150 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.5.log 2024-04-12T14:03:35.152 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi110.ezwdax.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.3.log 2024-04-12T14:03:35.152 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.2.log: /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log: 88.2% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log.gz 2024-04-12T14:03:35.152 INFO:teuthology.orchestra.run.smithi060.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-12T14:03:35.153 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log 2024-04-12T14:03:35.154 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.5.log: /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.3.log: 91.3% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.audit.log.gz 2024-04-12T14:03:35.155 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.zqdflr.log 2024-04-12T14:03:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log: 85.1% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.cephadm.log.gz 2024-04-12T14:03:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.zqdflr.log: gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log 2024-04-12T14:03:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log 2024-04-12T14:03:35.163 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-12T14:03:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log: 88.2% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph.log.gz 2024-04-12T14:03:35.192 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.log: 90.9% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log.gz 2024-04-12T14:03:35.204 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-volume.log.gz 2024-04-12T14:03:35.240 INFO:teuthology.orchestra.run.smithi110.stderr: 89.8% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi110.ezwdax.log.gz 2024-04-12T14:03:35.688 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mgr.smithi060.bpzacg.log.gz 2024-04-12T14:03:35.689 INFO:teuthology.orchestra.run.smithi110.stderr: 92.5% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi110.log.gz 2024-04-12T14:03:36.706 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mon.smithi060.log.gz 2024-04-12T14:03:41.352 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.0.log.gz 2024-04-12T14:03:41.632 INFO:teuthology.orchestra.run.smithi110.stderr: 93.0% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.4.log.gz 2024-04-12T14:03:41.868 INFO:teuthology.orchestra.run.smithi110.stderr: 94.7% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.getdvx.log.gz 2024-04-12T14:03:42.240 INFO:teuthology.orchestra.run.smithi110.stderr: 93.1% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.5.log.gz 2024-04-12T14:03:42.738 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.2.log.gz 2024-04-12T14:03:43.042 INFO:teuthology.orchestra.run.smithi060.stderr: 92.8% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.1.log.gz 2024-04-12T14:03:43.321 INFO:teuthology.orchestra.run.smithi110.stderr: 94.7% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi110.zqdflr.log.gz 2024-04-12T14:03:43.877 INFO:teuthology.orchestra.run.smithi060.stderr: 94.7% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.epmcph.log.gz 2024-04-12T14:03:44.335 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-osd.3.log.gz 2024-04-12T14:03:51.741 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-12T14:03:51.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-12T14:03:51.746 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-12T14:03:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m16.644s 2024-04-12T14:03:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m51.420s 2024-04-12T14:03:51.746 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m3.534s 2024-04-12T14:03:53.168 INFO:teuthology.orchestra.run.smithi060.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-12T14:05:18.422 INFO:teuthology.orchestra.run.smithi060.stderr: 92.9% -- replaced with /var/log/ceph/7ed74db6-f8d0-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi060.mwwohl.log.gz 2024-04-12T14:05:18.425 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-04-12T14:05:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:real 1m43.346s 2024-04-12T14:05:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:user 2m22.590s 2024-04-12T14:05:18.426 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m10.509s 2024-04-12T14:05:18.427 INFO:tasks.cephadm:Archiving logs... 2024-04-12T14:05:18.427 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi060/log 2024-04-12T14:05:18.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T14:05:38.852 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi110/log 2024-04-12T14:05:38.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T14:05:45.495 INFO:tasks.cephadm:Removing cluster... 2024-04-12T14:05:45.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 --force 2024-04-12T14:05:46.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ed74db6-f8d0-11ee-bc8c-c7b262605968 --force 2024-04-12T14:05:48.047 INFO:tasks.cephadm:Removing cephadm ... 2024-04-12T14:05:48.047 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-12T14:05:48.109 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-12T14:05:48.164 INFO:tasks.cephadm:Teardown complete 2024-04-12T14:05:48.165 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-12T14:05:48.178 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T14:05:48.179 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-12T14:05:48.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T14:05:48.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T14:05:48.343 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-12T14:05:48.356 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-12T14:05:48.356 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T14:05:48.366 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T14:05:48.409 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +199us[ +206us] +/- 44ms 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -181us[ -173us] +/- 67ms 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -133us[ -126us] +/- 77ms 2024-04-12T14:05:48.419 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T14:05:48.421 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-04-12T14:05:48.431 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T14:05:48.431 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-04-12T14:05:48.431 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +185us[ +204us] +/- 43ms 2024-04-12T14:05:48.431 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -194us[ -175us] +/- 67ms 2024-04-12T14:05:48.432 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -126us[ -126us] +/- 77ms 2024-04-12T14:05:48.432 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T14:05:48.433 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-12T14:05:48.444 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-12T14:05:48.445 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-12T14:05:48.513 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T14:05:48.718 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T14:05:48.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T14:05:49.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T14:05:49.049 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T14:05:49.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T14:05:49.155 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-12T14:05:49.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-12T14:05:49.184 INFO:teuthology.task.internal:Duration was 2844.860951 seconds 2024-04-12T14:05:49.184 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-12T14:05:49.195 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-12T14:05:49.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T14:05:49.202 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T14:05:49.359 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T14:05:49.366 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T14:05:49.762 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-12T14:05:49.762 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-04-12T14:05:49.763 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T14:05:49.821 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-04-12T14:05:49.821 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T14:05:49.892 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-12T14:05:49.892 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T14:05:49.900 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T14:05:49.987 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-12T14:05:49.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T14:05:49.991 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T14:05:50.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-12T14:05:50.817 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-12T14:05:50.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T14:05:50.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T14:05:51.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-12T14:05:51.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T14:05:51.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T14:05:51.138 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-04-12T14:05:51.144 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-04-12T14:05:51.213 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T14:05:51.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T14:05:51.269 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T14:05:51.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T14:05:51.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-12T14:05:51.333 INFO:teuthology.task.internal:Transferring archived files... 2024-04-12T14:05:51.334 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi060 2024-04-12T14:05:51.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-12T14:05:51.472 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889/remote/smithi110 2024-04-12T14:05:51.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-12T14:05:51.584 INFO:teuthology.task.internal:Removing archive directory... 2024-04-12T14:05:51.584 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-12T14:05:51.592 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-12T14:05:51.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-12T14:05:51.661 INFO:teuthology.task.internal:Not uploading archives. 2024-04-12T14:05:51.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-12T14:05:51.673 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-12T14:05:51.673 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T14:05:51.680 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T14:05:51.733 INFO:teuthology.orchestra.run.smithi060.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 12 14:05 /home/ubuntu/cephtest 2024-04-12T14:05:51.734 INFO:teuthology.orchestra.run.smithi060.stdout: 685468 4 d--------- 2 ubuntu ubuntu 4096 Apr 12 13:39 /home/ubuntu/cephtest/mnt.0 2024-04-12T14:05:51.734 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-12T14:05:51.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T14:05:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-12T14:05:51.737 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_vshankar_ceph_35087f9f8bbf4292364e0bbb9a4062d5cd47de0a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi060 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-12T14:05:51.738 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-12T14:05:51.751 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-12T14:05:51.764 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T14:05:51.764 INFO:teuthology.nuke:Checking targets against current locks 2024-04-12T14:05:51.790 DEBUG:teuthology.nuke:shortname: smithi060 2024-04-12T14:05:51.791 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T14:05:51.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 13:05:46.666762', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI60fY9WQqC4h9Ckumwe0dk0HzcNbwcqEcYevTJgBPXcoFYpGl5Rne1nGabJmS5yUq6g52FCCGo80PdthepUrgs='} 2024-04-12T14:05:51.820 DEBUG:teuthology.nuke:shortname: smithi110 2024-04-12T14:05:51.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T14:05:51.848 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_13:03:29-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 13:05:46.669229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPHzzWnrc2phk4GtxkpMoqCOqfD98CUXUbY9btTVj4i2a6kLFb7GGX8O/l0YwyVkwQXiMlhyWqD46PQL0wtvYI='} 2024-04-12T14:05:51.879 INFO:teuthology.orchestra.console.smithi060:Power off 2024-04-12T14:05:51.880 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T14:05:51.909 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2024-04-12T14:05:51.909 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:05:51.927 INFO:teuthology.orchestra.console.smithi110:Power off 2024-04-12T14:05:51.927 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T14:05:51.935 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-04-12T14:05:51.948 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-04-12T14:05:51.949 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:05:51.974 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-12T14:05:55.937 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:05:55.976 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:05:56.049 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-04-12T14:05:56.088 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-12T14:06:00.052 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:06:00.089 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:06:00.164 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2024-04-12T14:06:00.201 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-12T14:06:00.265 INFO:teuthology.orchestra.console.smithi060:Power off completed 2024-04-12T14:06:04.202 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T14:06:04.312 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-12T14:06:04.413 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-04-12T14:06:04.518 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2844.8609511852264 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 host.b-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 owner: scheduled_vshankar@teuthology status: fail success: false 2024-04-12T14:06:04.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T14:06:04.610 INFO:teuthology.run:FAIL